2023-06-09T04:23:41.086 INFO:root:teuthology version: 0.0.1.dev120+g2ef0dcd 2023-06-09T04:23:41.087 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/xiubli-2023-06-09_04:16:27-fs:functional-wip-lxb-fscrypt-20230607-0901-distro-default-smithi/7299738 --description fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} --owner scheduled_xiubli@teuthology --name xiubli-2023-06-09_04:16:27-fs:functional-wip-lxb-fscrypt-20230607-0901-distro-default-smithi --verbose -- /home/teuthworker/archive/xiubli-2023-06-09_04:16:27-fs:functional-wip-lxb-fscrypt-20230607-0901-distro-default-smithi/7299738/orig.config.yaml 2023-06-09T04:23:41.135 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-09T04:23:41.229 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/xiubli-2023-06-09_04:16:27-fs:functional-wip-lxb-fscrypt-20230607-0901-distro-default-smithi/7299738 branch: wip-lxb-fscrypt-20230607-0901 description: fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} email: null first_in_suite: false job_id: '7299738' kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: xiubli-2023-06-09_04:16:27-fs:functional-wip-lxb-fscrypt-20230607-0901-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-lxb-fscrypt-20230607-0901 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: a02638f808b8fe11bccdd01222c0e6e2eb71120b ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: a02638f808b8fe11bccdd01222c0e6e2eb71120b kclient: syntax: v1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-lxb-fscrypt-20230607-0901 sha1: a02638f808b8fe11bccdd01222c0e6e2eb71120b owner: scheduled_xiubli@teuthology priority: 110 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 sha1: a02638f808b8fe11bccdd01222c0e6e2eb71120b sleep_before_teardown: 0 suite: fs:functional suite_branch: wip-lxb-fscrypt-20230607-0901 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_a02638f808b8fe11bccdd01222c0e6e2eb71120b/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: a02638f808b8fe11bccdd01222c0e6e2eb71120b syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi062.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0= smithi089.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 2ef0dcdee569e9851c9d2ffb6acfd4b80d031e61 timestamp: 2023-06-09_04:16:27 tube: smithi user: xiubli verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.23459 2023-06-09T04:23:41.230 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_a02638f808b8fe11bccdd01222c0e6e2eb71120b/qa; will attempt to use it 2023-06-09T04:23:41.231 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_a02638f808b8fe11bccdd01222c0e6e2eb71120b/qa/tasks 2023-06-09T04:23:41.231 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-06-09T04:23:41.233 INFO:teuthology.task.internal:Checking packages... 2023-06-09T04:23:41.260 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'a02638f808b8fe11bccdd01222c0e6e2eb71120b' 2023-06-09T04:23:41.260 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-06-09T04:23:41.261 INFO:teuthology.packaging:ref: None 2023-06-09T04:23:41.261 INFO:teuthology.packaging:tag: None 2023-06-09T04:23:41.261 INFO:teuthology.packaging:branch: wip-lxb-fscrypt-20230607-0901 2023-06-09T04:23:41.262 INFO:teuthology.packaging:sha1: a02638f808b8fe11bccdd01222c0e6e2eb71120b 2023-06-09T04:23:41.262 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-lxb-fscrypt-20230607-0901 2023-06-09T04:23:41.498 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-4313-ga02638f8-1focal 2023-06-09T04:23:41.499 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-06-09T04:23:41.506 INFO:teuthology.task.internal:no buildpackages task found 2023-06-09T04:23:41.506 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-06-09T04:23:41.524 INFO:teuthology.task.internal:Saving configuration 2023-06-09T04:23:41.540 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-06-09T04:23:41.546 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-09T04:23:41.574 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi062.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/xiubli-2023-06-09_04:16:27-fs:functional-wip-lxb-fscrypt-20230607-0901-distro-default-smithi/7299738', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-09 04:16:35.580958', 'locked_by': 'scheduled_xiubli@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-06-09T04:23:41.597 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi089.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/xiubli-2023-06-09_04:16:27-fs:functional-wip-lxb-fscrypt-20230607-0901-distro-default-smithi/7299738', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-09 04:16:35.582345', 'locked_by': 'scheduled_xiubli@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-06-09T04:23:41.598 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-06-09T04:23:41.604 INFO:teuthology.task.internal:roles: ubuntu@smithi062.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-06-09T04:23:41.604 INFO:teuthology.task.internal:roles: ubuntu@smithi089.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-06-09T04:23:41.604 INFO:teuthology.run_tasks:Running task console_log... 2023-06-09T04:23:41.675 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb68b139f70>, signals=[15]) 2023-06-09T04:23:41.677 INFO:teuthology.run_tasks:Running task internal.connect... 2023-06-09T04:23:41.687 INFO:teuthology.task.internal:Opening connections... 2023-06-09T04:23:41.688 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi062.front.sepia.ceph.com 2023-06-09T04:23:41.689 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-09T04:23:41.745 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi089.front.sepia.ceph.com 2023-06-09T04:23:41.746 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-09T04:23:41.789 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-06-09T04:23:41.796 DEBUG:teuthology.orchestra.run.smithi062:> uname -m 2023-06-09T04:23:41.828 INFO:teuthology.orchestra.run.smithi062.stdout:x86_64 2023-06-09T04:23:41.829 DEBUG:teuthology.orchestra.run.smithi062:> cat /etc/os-release 2023-06-09T04:23:41.878 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="Ubuntu" 2023-06-09T04:23:41.878 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-06-09T04:23:41.878 INFO:teuthology.orchestra.run.smithi062.stdout:ID=ubuntu 2023-06-09T04:23:41.878 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE=debian 2023-06-09T04:23:41.878 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-06-09T04:23:41.878 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="20.04" 2023-06-09T04:23:41.879 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-09T04:23:41.879 INFO:teuthology.orchestra.run.smithi062.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-09T04:23:41.879 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-09T04:23:41.879 INFO:teuthology.orchestra.run.smithi062.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-09T04:23:41.879 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_CODENAME=focal 2023-06-09T04:23:41.879 INFO:teuthology.orchestra.run.smithi062.stdout:UBUNTU_CODENAME=focal 2023-06-09T04:23:41.880 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server 2023-06-09T04:23:41.949 DEBUG:teuthology.orchestra.run.smithi089:> uname -m 2023-06-09T04:23:41.956 INFO:teuthology.orchestra.run.smithi089.stdout:x86_64 2023-06-09T04:23:41.957 DEBUG:teuthology.orchestra.run.smithi089:> cat /etc/os-release 2023-06-09T04:23:42.006 INFO:teuthology.orchestra.run.smithi089.stdout:NAME="Ubuntu" 2023-06-09T04:23:42.006 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-06-09T04:23:42.006 INFO:teuthology.orchestra.run.smithi089.stdout:ID=ubuntu 2023-06-09T04:23:42.006 INFO:teuthology.orchestra.run.smithi089.stdout:ID_LIKE=debian 2023-06-09T04:23:42.006 INFO:teuthology.orchestra.run.smithi089.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-06-09T04:23:42.007 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_ID="20.04" 2023-06-09T04:23:42.007 INFO:teuthology.orchestra.run.smithi089.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-09T04:23:42.007 INFO:teuthology.orchestra.run.smithi089.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-09T04:23:42.007 INFO:teuthology.orchestra.run.smithi089.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-09T04:23:42.007 INFO:teuthology.orchestra.run.smithi089.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-09T04:23:42.007 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_CODENAME=focal 2023-06-09T04:23:42.007 INFO:teuthology.orchestra.run.smithi089.stdout:UBUNTU_CODENAME=focal 2023-06-09T04:23:42.008 INFO:teuthology.lock.ops:Updating smithi089.front.sepia.ceph.com on lock server 2023-06-09T04:23:42.093 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-06-09T04:23:42.102 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-06-09T04:23:42.112 INFO:teuthology.task.internal:Checking for old test directory... 2023-06-09T04:23:42.113 DEBUG:teuthology.orchestra.run.smithi062:> test '!' -e /home/ubuntu/cephtest 2023-06-09T04:23:42.115 DEBUG:teuthology.orchestra.run.smithi089:> test '!' -e /home/ubuntu/cephtest 2023-06-09T04:23:42.121 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-06-09T04:23:42.127 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-06-09T04:23:42.128 DEBUG:teuthology.orchestra.run.smithi062:> test -z $(ls -A /var/lib/ceph) 2023-06-09T04:23:42.161 DEBUG:teuthology.orchestra.run.smithi089:> test -z $(ls -A /var/lib/ceph) 2023-06-09T04:23:42.183 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-06-09T04:23:42.251 INFO:teuthology.run_tasks:Running task kernel... 2023-06-09T04:23:42.267 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2023-06-09T04:23:42.268 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2023-06-09T04:23:42.268 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2023-06-09T04:23:42.268 DEBUG:teuthology.orchestra.run.smithi062:> test -f /run/.containerenv -o -f /.dockerenv 2023-06-09T04:23:42.269 DEBUG:teuthology.orchestra.run.smithi089:> test -f /run/.containerenv -o -f /.dockerenv 2023-06-09T04:23:42.274 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T04:23:42.275 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=testing 2023-06-09T04:23:42.277 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T04:23:42.278 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=testing 2023-06-09T04:23:42.431 DEBUG:teuthology.task.kernel:sha1 for client.1 is 10b2f20a4f46c803bb730efc73498f97d45082e7 2023-06-09T04:23:42.432 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "10b2f20a4f46c803bb730efc73498f97d45082e7"... 2023-06-09T04:23:42.432 DEBUG:teuthology.orchestra.run.smithi089:> uname -r 2023-06-09T04:23:42.438 INFO:teuthology.orchestra.run.smithi089.stdout:5.4.0-124-generic 2023-06-09T04:23:42.438 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-124-generic vs 10b2f20a4f46c803bb730efc73498f97d45082e7 2023-06-09T04:23:42.439 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-06-09T04:23:42.439 INFO:teuthology.task.kernel:Installing linux-firmware on client.1... 2023-06-09T04:23:42.439 DEBUG:teuthology.orchestra.run.smithi089:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-06-09T04:23:42.500 INFO:teuthology.orchestra.run.smithi089.stderr:bash: line 0: cd: /lib/firmware/updates: No such file or directory 2023-06-09T04:23:42.522 DEBUG:teuthology.task.kernel:sha1 for client.0 is 10b2f20a4f46c803bb730efc73498f97d45082e7 2023-06-09T04:23:42.522 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "10b2f20a4f46c803bb730efc73498f97d45082e7"... 2023-06-09T04:23:42.523 DEBUG:teuthology.orchestra.run.smithi062:> uname -r 2023-06-09T04:23:42.529 INFO:teuthology.orchestra.run.smithi062.stdout:5.4.0-124-generic 2023-06-09T04:23:42.529 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-124-generic vs 10b2f20a4f46c803bb730efc73498f97d45082e7 2023-06-09T04:23:42.529 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-06-09T04:23:42.530 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2023-06-09T04:23:42.530 DEBUG:teuthology.orchestra.run.smithi062:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-06-09T04:23:42.589 INFO:teuthology.orchestra.run.smithi062.stderr:bash: line 0: cd: /lib/firmware/updates: No such file or directory 2023-06-09T04:23:42.607 INFO:teuthology.orchestra.run.smithi089.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-06-09T04:23:42.609 DEBUG:teuthology.orchestra.run.smithi089:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-06-09T04:23:42.649 DEBUG:teuthology.orchestra.run.smithi089:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-06-09T04:23:42.665 DEBUG:teuthology.orchestra.run.smithi089:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-06-09T04:23:42.708 INFO:teuthology.orchestra.run.smithi062.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-06-09T04:23:42.710 DEBUG:teuthology.orchestra.run.smithi062:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-06-09T04:23:42.742 DEBUG:teuthology.orchestra.run.smithi062:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-06-09T04:23:42.756 DEBUG:teuthology.orchestra.run.smithi062:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-06-09T04:25:50.486 INFO:teuthology.orchestra.run.smithi089.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-06-09T04:25:50.486 INFO:teuthology.orchestra.run.smithi089.stderr: * [new branch] main -> origin/main 2023-06-09T04:25:50.535 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20190312 -> 20190312 2023-06-09T04:25:50.535 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20190416 -> 20190416 2023-06-09T04:25:50.535 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20190514 -> 20190514 2023-06-09T04:25:50.536 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20190618 -> 20190618 2023-06-09T04:25:50.536 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20190717 -> 20190717 2023-06-09T04:25:50.536 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20190815 -> 20190815 2023-06-09T04:25:50.539 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20190923 -> 20190923 2023-06-09T04:25:50.539 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20191022 -> 20191022 2023-06-09T04:25:50.539 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20191215 -> 20191215 2023-06-09T04:25:50.539 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20200122 -> 20200122 2023-06-09T04:25:50.540 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20200316 -> 20200316 2023-06-09T04:25:50.540 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20200421 -> 20200421 2023-06-09T04:25:50.540 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20200519 -> 20200519 2023-06-09T04:25:50.540 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20200619 -> 20200619 2023-06-09T04:25:50.541 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20200721 -> 20200721 2023-06-09T04:25:50.541 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20200817 -> 20200817 2023-06-09T04:25:50.541 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20200918 -> 20200918 2023-06-09T04:25:50.541 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20201022 -> 20201022 2023-06-09T04:25:50.541 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20201118 -> 20201118 2023-06-09T04:25:50.542 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20201218 -> 20201218 2023-06-09T04:25:50.542 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20210208 -> 20210208 2023-06-09T04:25:50.542 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20210315 -> 20210315 2023-06-09T04:25:50.542 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20210511 -> 20210511 2023-06-09T04:25:50.542 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20210716 -> 20210716 2023-06-09T04:25:50.543 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20210818 -> 20210818 2023-06-09T04:25:50.545 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20210919 -> 20210919 2023-06-09T04:25:50.545 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20211027 -> 20211027 2023-06-09T04:25:50.546 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20211216 -> 20211216 2023-06-09T04:25:50.546 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20220209 -> 20220209 2023-06-09T04:25:50.546 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20220310 -> 20220310 2023-06-09T04:25:50.546 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20220411 -> 20220411 2023-06-09T04:25:50.546 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20220509 -> 20220509 2023-06-09T04:25:50.547 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20220610 -> 20220610 2023-06-09T04:25:50.547 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20220708 -> 20220708 2023-06-09T04:25:50.547 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20220815 -> 20220815 2023-06-09T04:25:50.547 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20220913 -> 20220913 2023-06-09T04:25:50.548 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20221012 -> 20221012 2023-06-09T04:25:50.548 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20221109 -> 20221109 2023-06-09T04:25:50.548 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20221214 -> 20221214 2023-06-09T04:25:50.548 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20230117 -> 20230117 2023-06-09T04:25:50.548 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20230210 -> 20230210 2023-06-09T04:25:50.549 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20230310 -> 20230310 2023-06-09T04:25:50.549 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20230404 -> 20230404 2023-06-09T04:25:50.549 INFO:teuthology.orchestra.run.smithi089.stderr: * [new tag] 20230515 -> 20230515 2023-06-09T04:25:53.756 INFO:teuthology.orchestra.run.smithi089.stderr:Updating files: 51% (1517/2971) Updating files: 52% (1545/2971) Updating files: 53% (1575/2971) Updating files: 54% (1605/2971) Updating files: 55% (1635/2971) Updating files: 56% (1664/2971) Updating files: 57% (1694/2971) Updating files: 58% (1724/2971) Updating files: 59% (1753/2971) Updating files: 60% (1783/2971) Updating files: 61% (1813/2971) Updating files: 62% (1843/2971) Updating files: 63% (1872/2971) Updating files: 64% (1902/2971) Updating files: 65% (1932/2971) Updating files: 65% (1952/2971) Updating files: 66% (1961/2971) Updating files: 67% (1991/2971) Updating files: 68% (2021/2971) Updating files: 69% (2050/2971) Updating files: 70% (2080/2971) Updating files: 71% (2110/2971) Updating files: 72% (2140/2971) Updating files: 73% (2169/2971) Updating files: 74% (2199/2971) Updating files: 75% (2229/2971) Updating files: 76% (2258/2971) Updating files: 77% (2288/2971) Updating files: 78% (2318/2971) Updating files: 79% (2348/2971) Updating files: 80% (2377/2971) Updating files: 81% (2407/2971) Updating files: 82% (2437/2971) Updating files: 82% (2449/2971) Updating files: 83% (2466/2971) Updating files: 84% (2496/2971) Updating files: 85% (2526/2971) Updating files: 86% (2556/2971) Updating files: 87% (2585/2971) Updating files: 88% (2615/2971) Updating files: 89% (2645/2971) Updating files: 90% (2674/2971) Updating files: 91% (2704/2971) Updating files: 92% (2734/2971) Updating files: 93% (2764/2971) Updating files: 94% (2793/2971) Updating files: 95% (2823/2971) Updating files: 96% (2853/2971) Updating files: 97% (2882/2971) Updating files: 98% (2912/2971) Updating files: 99% (2942/2971) Updating files: 100% (2971/2971) Updating files: 100% (2971/2971), done. 2023-06-09T04:25:53.761 INFO:teuthology.orchestra.run.smithi089.stdout:HEAD is now at fc90c59b Merge branch 'db410c' of https://github.com/lumag/linux-firmware 2023-06-09T04:25:53.775 INFO:teuthology.task.kernel:Downloading kernel 10b2f20a4f46c803bb730efc73498f97d45082e7 on client.1... 2023-06-09T04:25:53.775 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=10b2f20a4f46c803bb730efc73498f97d45082e7 2023-06-09T04:25:53.923 INFO:teuthology.task.kernel:fetching, builder baseurl is https://1.chacra.ceph.com/r/kernel/testing/10b2f20a4f46c803bb730efc73498f97d45082e7/ubuntu/focal/flavors/default/pool/main/l/linux-6.4.0-rc2-g10b2f20a4f46/ 2023-06-09T04:25:53.924 DEBUG:teuthology.orchestra.run.smithi089:> rm -f /tmp/linux-image.deb && echo linux-image-6.4.0-rc2-g10b2f20a4f46_6.4.0-rc2-g10b2f20a4f46-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://1.chacra.ceph.com/r/kernel/testing/10b2f20a4f46c803bb730efc73498f97d45082e7/ubuntu/focal/flavors/default/pool/main/l/linux-6.4.0-rc2-g10b2f20a4f46/ --input-file=- 2023-06-09T04:25:53.926 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi089.front.sepia.ceph.com to complete... 2023-06-09T04:25:55.981 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09 04:25:55 URL:https://1.chacra.ceph.com/r/kernel/testing/10b2f20a4f46c803bb730efc73498f97d45082e7/ubuntu/focal/flavors/default/pool/main/l/linux-6.4.0-rc2-g10b2f20a4f46/linux-image-6.4.0-rc2-g10b2f20a4f46_6.4.0-rc2-g10b2f20a4f46-1_amd64.deb [38539740/38539740] -> "/tmp/linux-image.deb" [1] 2023-06-09T04:25:55.982 INFO:teuthology.orchestra.run.smithi089.stderr:FINISHED --2023-06-09 04:25:55-- 2023-06-09T04:25:55.982 INFO:teuthology.orchestra.run.smithi089.stderr:Total wall clock time: 2.0s 2023-06-09T04:25:55.982 INFO:teuthology.orchestra.run.smithi089.stderr:Downloaded: 1 files, 37M in 1.9s (19.2 MB/s) 2023-06-09T04:25:55.983 INFO:teuthology.task.kernel:Installing kernel 10b2f20a4f46c803bb730efc73498f97d45082e7 on client.1... 2023-06-09T04:25:55.983 DEBUG:teuthology.orchestra.run.smithi089:> sudo dpkg -i /tmp/linux-image.deb 2023-06-09T04:25:56.244 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package linux-image-6.4.0-rc2-g10b2f20a4f46. 2023-06-09T04:25:58.010 INFO:teuthology.orchestra.run.smithi089.stdout:(Reading database ... 104373 files and directories currently installed.) 2023-06-09T04:25:58.015 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-06-09T04:25:58.199 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking linux-image-6.4.0-rc2-g10b2f20a4f46 (6.4.0-rc2-g10b2f20a4f46-1) ... 2023-06-09T04:26:00.939 INFO:teuthology.orchestra.run.smithi062.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-06-09T04:26:00.939 INFO:teuthology.orchestra.run.smithi062.stderr: * [new branch] main -> origin/main 2023-06-09T04:26:00.995 INFO:teuthology.orchestra.run.smithi062.stderr: * [new tag] 20190312 -> 20190312 2023-06-09T04:26:00.995 INFO:teuthology.orchestra.run.smithi062.stderr: * [new tag] 20190416 -> 20190416 2023-06-09T04:26:00.995 INFO:teuthology.orchestra.run.smithi062.stderr: * [new tag] 20190514 -> 20190514 2023-06-09T04:26:00.996 INFO:teuthology.orchestra.run.smithi062.stderr: * [new tag] 20190618 -> 20190618 2023-06-09T04:26:00.996 INFO:teuthology.orchestra.run.smithi062.stderr: * [new tag] 20190717 -> 20190717 2023-06-09T04:26:00.997 INFO:teuthology.orchestra.run.smithi062.stderr: * [new tag] 20190815 -> 20190815 2023-06-09T04:26:00.997 INFO:teuthology.orchestra.run.smithi062.stderr: * [new tag] 20190923 -> 20190923 2023-06-09T04:26:00.998 INFO:teuthology.orchestra.run.smithi062.stderr: * [new tag] 20191022 -> 20191022 2023-06-09T04:26:00.998 INFO:teuthology.orchestra.run.smithi062.stderr: * [new tag] 20191215 -> 20191215 2023-06-09T04:26:00.998 INFO:teuthology.orchestra.run.smithi062.stderr: * [new tag] 20200122 -> 20200122 2023-06-09T04:26:00.998 INFO:teuthology.orchestra.run.smithi062.stderr: * [new tag] 20200316 -> 20200316 2023-06-09T04:26:00.998 INFO:teuthology.orchestra.run.smithi062.stderr: * [new tag] 20200421 -> 20200421 2023-06-09T04:26:00.998 INFO:teuthology.orchestra.run.smithi062.stderr: * [new tag] 20200519 -> 20200519 2023-06-09T04:26:00.998 INFO:teuthology.orchestra.run.smithi062.stderr: * [new tag] 20200619 -> 20200619 2023-06-09T04:26:00.998 INFO:teuthology.orchestra.run.smithi062.stderr: * [new tag] 20200721 -> 20200721 2023-06-09T04:26:00.999 INFO:teuthology.orchestra.run.smithi062.stderr: * [new tag] 20200817 -> 20200817 2023-06-09T04:26:00.999 INFO:teuthology.orchestra.run.smithi062.stderr: * [new tag] 20200918 -> 20200918 2023-06-09T04:26:00.999 INFO:teuthology.orchestra.run.smithi062.stderr: * [new tag] 20201022 -> 20201022 2023-06-09T04:26:00.999 INFO:teuthology.orchestra.run.smithi062.stderr: * [new tag] 20201118 -> 20201118 2023-06-09T04:26:00.999 INFO:teuthology.orchestra.run.smithi062.stderr: * [new tag] 20201218 -> 20201218 2023-06-09T04:26:00.999 INFO:teuthology.orchestra.run.smithi062.stderr: * [new tag] 20210208 -> 20210208 2023-06-09T04:26:00.999 INFO:teuthology.orchestra.run.smithi062.stderr: * [new tag] 20210315 -> 20210315 2023-06-09T04:26:01.001 INFO:teuthology.orchestra.run.smithi062.stderr: * [new tag] 20210511 -> 20210511 2023-06-09T04:26:01.001 INFO:teuthology.orchestra.run.smithi062.stderr: * [new tag] 20210716 -> 20210716 2023-06-09T04:26:01.001 INFO:teuthology.orchestra.run.smithi062.stderr: * [new tag] 20210818 -> 20210818 2023-06-09T04:26:01.002 INFO:teuthology.orchestra.run.smithi062.stderr: * [new tag] 20210919 -> 20210919 2023-06-09T04:26:01.002 INFO:teuthology.orchestra.run.smithi062.stderr: * [new tag] 20211027 -> 20211027 2023-06-09T04:26:01.002 INFO:teuthology.orchestra.run.smithi062.stderr: * [new tag] 20211216 -> 20211216 2023-06-09T04:26:01.002 INFO:teuthology.orchestra.run.smithi062.stderr: * [new tag] 20220209 -> 20220209 2023-06-09T04:26:01.002 INFO:teuthology.orchestra.run.smithi062.stderr: * [new tag] 20220310 -> 20220310 2023-06-09T04:26:01.002 INFO:teuthology.orchestra.run.smithi062.stderr: * [new tag] 20220411 -> 20220411 2023-06-09T04:26:01.002 INFO:teuthology.orchestra.run.smithi062.stderr: * [new tag] 20220509 -> 20220509 2023-06-09T04:26:01.003 INFO:teuthology.orchestra.run.smithi062.stderr: * [new tag] 20220610 -> 20220610 2023-06-09T04:26:01.003 INFO:teuthology.orchestra.run.smithi062.stderr: * [new tag] 20220708 -> 20220708 2023-06-09T04:26:01.003 INFO:teuthology.orchestra.run.smithi062.stderr: * [new tag] 20220815 -> 20220815 2023-06-09T04:26:01.003 INFO:teuthology.orchestra.run.smithi062.stderr: * [new tag] 20220913 -> 20220913 2023-06-09T04:26:01.003 INFO:teuthology.orchestra.run.smithi062.stderr: * [new tag] 20221012 -> 20221012 2023-06-09T04:26:01.003 INFO:teuthology.orchestra.run.smithi062.stderr: * [new tag] 20221109 -> 20221109 2023-06-09T04:26:01.004 INFO:teuthology.orchestra.run.smithi062.stderr: * [new tag] 20221214 -> 20221214 2023-06-09T04:26:01.004 INFO:teuthology.orchestra.run.smithi062.stderr: * [new tag] 20230117 -> 20230117 2023-06-09T04:26:01.004 INFO:teuthology.orchestra.run.smithi062.stderr: * [new tag] 20230210 -> 20230210 2023-06-09T04:26:01.004 INFO:teuthology.orchestra.run.smithi062.stderr: * [new tag] 20230310 -> 20230310 2023-06-09T04:26:01.004 INFO:teuthology.orchestra.run.smithi062.stderr: * [new tag] 20230404 -> 20230404 2023-06-09T04:26:01.004 INFO:teuthology.orchestra.run.smithi062.stderr: * [new tag] 20230515 -> 20230515 2023-06-09T04:26:01.154 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up linux-image-6.4.0-rc2-g10b2f20a4f46 (6.4.0-rc2-g10b2f20a4f46-1) ... 2023-06-09T04:26:01.293 INFO:teuthology.orchestra.run.smithi089.stderr:update-initramfs: Generating /boot/initrd.img-6.4.0-rc2-g10b2f20a4f46 2023-06-09T04:26:04.379 INFO:teuthology.orchestra.run.smithi062.stderr:Updating files: 48% (1455/2971) Updating files: 49% (1456/2971) Updating files: 50% (1486/2971) Updating files: 51% (1516/2971) Updating files: 52% (1545/2971) Updating files: 53% (1575/2971) Updating files: 54% (1605/2971) Updating files: 55% (1635/2971) Updating files: 56% (1664/2971) Updating files: 57% (1694/2971) Updating files: 58% (1724/2971) Updating files: 59% (1753/2971) Updating files: 60% (1783/2971) Updating files: 61% (1813/2971) Updating files: 62% (1843/2971) Updating files: 63% (1872/2971) Updating files: 64% (1902/2971) Updating files: 65% (1932/2971) Updating files: 65% (1949/2971) Updating files: 66% (1961/2971) Updating files: 67% (1991/2971) Updating files: 68% (2021/2971) Updating files: 69% (2050/2971) Updating files: 70% (2080/2971) Updating files: 71% (2110/2971) Updating files: 72% (2140/2971) Updating files: 73% (2169/2971) Updating files: 74% (2199/2971) Updating files: 75% (2229/2971) Updating files: 76% (2258/2971) Updating files: 77% (2288/2971) Updating files: 78% (2318/2971) Updating files: 79% (2348/2971) Updating files: 80% (2377/2971) Updating files: 81% (2407/2971) Updating files: 81% (2424/2971) Updating files: 82% (2437/2971) Updating files: 83% (2466/2971) Updating files: 84% (2496/2971) Updating files: 85% (2526/2971) Updating files: 86% (2556/2971) Updating files: 87% (2585/2971) Updating files: 88% (2615/2971) Updating files: 89% (2645/2971) Updating files: 90% (2674/2971) Updating files: 91% (2704/2971) Updating files: 92% (2734/2971) Updating files: 93% (2764/2971) Updating files: 94% (2793/2971) Updating files: 95% (2823/2971) Updating files: 96% (2853/2971) Updating files: 97% (2882/2971) Updating files: 98% (2912/2971) Updating files: 99% (2942/2971) Updating files: 100% (2971/2971) Updating files: 100% (2971/2971), done. 2023-06-09T04:26:04.383 INFO:teuthology.orchestra.run.smithi062.stdout:HEAD is now at fc90c59b Merge branch 'db410c' of https://github.com/lumag/linux-firmware 2023-06-09T04:26:04.399 INFO:teuthology.task.kernel:Downloading kernel 10b2f20a4f46c803bb730efc73498f97d45082e7 on client.0... 2023-06-09T04:26:04.399 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=10b2f20a4f46c803bb730efc73498f97d45082e7 2023-06-09T04:26:04.571 INFO:teuthology.task.kernel:fetching, builder baseurl is https://1.chacra.ceph.com/r/kernel/testing/10b2f20a4f46c803bb730efc73498f97d45082e7/ubuntu/focal/flavors/default/pool/main/l/linux-6.4.0-rc2-g10b2f20a4f46/ 2023-06-09T04:26:04.572 DEBUG:teuthology.orchestra.run.smithi062:> rm -f /tmp/linux-image.deb && echo linux-image-6.4.0-rc2-g10b2f20a4f46_6.4.0-rc2-g10b2f20a4f46-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://1.chacra.ceph.com/r/kernel/testing/10b2f20a4f46c803bb730efc73498f97d45082e7/ubuntu/focal/flavors/default/pool/main/l/linux-6.4.0-rc2-g10b2f20a4f46/ --input-file=- 2023-06-09T04:26:04.574 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi062.front.sepia.ceph.com to complete... 2023-06-09T04:26:06.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09 04:26:06 URL:https://1.chacra.ceph.com/r/kernel/testing/10b2f20a4f46c803bb730efc73498f97d45082e7/ubuntu/focal/flavors/default/pool/main/l/linux-6.4.0-rc2-g10b2f20a4f46/linux-image-6.4.0-rc2-g10b2f20a4f46_6.4.0-rc2-g10b2f20a4f46-1_amd64.deb [38539740/38539740] -> "/tmp/linux-image.deb" [1] 2023-06-09T04:26:06.115 INFO:teuthology.orchestra.run.smithi062.stderr:FINISHED --2023-06-09 04:26:06-- 2023-06-09T04:26:06.115 INFO:teuthology.orchestra.run.smithi062.stderr:Total wall clock time: 1.5s 2023-06-09T04:26:06.115 INFO:teuthology.orchestra.run.smithi062.stderr:Downloaded: 1 files, 37M in 1.4s (26.4 MB/s) 2023-06-09T04:26:06.116 INFO:teuthology.task.kernel:Installing kernel 10b2f20a4f46c803bb730efc73498f97d45082e7 on client.0... 2023-06-09T04:26:06.117 DEBUG:teuthology.orchestra.run.smithi062:> sudo dpkg -i /tmp/linux-image.deb 2023-06-09T04:26:06.410 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package linux-image-6.4.0-rc2-g10b2f20a4f46. 2023-06-09T04:26:08.144 INFO:teuthology.orchestra.run.smithi062.stdout:(Reading database ... 104373 files and directories currently installed.) 2023-06-09T04:26:08.149 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-06-09T04:26:08.346 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking linux-image-6.4.0-rc2-g10b2f20a4f46 (6.4.0-rc2-g10b2f20a4f46-1) ... 2023-06-09T04:26:11.537 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up linux-image-6.4.0-rc2-g10b2f20a4f46 (6.4.0-rc2-g10b2f20a4f46-1) ... 2023-06-09T04:26:11.668 INFO:teuthology.orchestra.run.smithi062.stderr:update-initramfs: Generating /boot/initrd.img-6.4.0-rc2-g10b2f20a4f46 2023-06-09T04:26:26.250 INFO:teuthology.orchestra.run.smithi089.stderr:Sourcing file `/etc/default/grub' 2023-06-09T04:26:26.258 INFO:teuthology.orchestra.run.smithi089.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-06-09T04:26:26.289 INFO:teuthology.orchestra.run.smithi089.stderr:Generating grub configuration file ... 2023-06-09T04:26:26.696 INFO:teuthology.orchestra.run.smithi089.stderr:Found linux image: /boot/vmlinuz-6.4.0-rc2-g10b2f20a4f46 2023-06-09T04:26:26.728 INFO:teuthology.orchestra.run.smithi089.stderr:Found initrd image: /boot/initrd.img-6.4.0-rc2-g10b2f20a4f46 2023-06-09T04:26:27.158 INFO:teuthology.orchestra.run.smithi089.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-06-09T04:26:27.171 INFO:teuthology.orchestra.run.smithi089.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-06-09T04:26:29.470 INFO:teuthology.orchestra.run.smithi089.stderr:done 2023-06-09T04:26:29.681 DEBUG:teuthology.orchestra.run.smithi089:> dpkg-deb -c /tmp/linux-image.deb 2023-06-09T04:26:29.691 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./ 2023-06-09T04:26:29.691 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./boot/ 2023-06-09T04:26:29.691 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 4322013 2023-06-01 02:19 ./boot/System.map-6.4.0-rc2-g10b2f20a4f46 2023-06-09T04:26:29.707 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 167348 2023-06-01 02:19 ./boot/config-6.4.0-rc2-g10b2f20a4f46 2023-06-09T04:26:29.707 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11235616 2023-06-01 02:19 ./boot/vmlinuz-6.4.0-rc2-g10b2f20a4f46 2023-06-09T04:26:29.730 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./etc/ 2023-06-09T04:26:29.731 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./etc/kernel/ 2023-06-09T04:26:29.731 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./etc/kernel/postinst.d/ 2023-06-09T04:26:29.731 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./etc/kernel/postrm.d/ 2023-06-09T04:26:29.731 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./etc/kernel/preinst.d/ 2023-06-09T04:26:29.731 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./etc/kernel/prerm.d/ 2023-06-09T04:26:29.731 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/ 2023-06-09T04:26:29.731 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/ 2023-06-09T04:26:29.732 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/ 2023-06-09T04:26:29.732 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/ 2023-06-09T04:26:29.732 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/ 2023-06-09T04:26:29.732 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/ 2023-06-09T04:26:29.732 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/ 2023-06-09T04:26:29.732 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 490273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/aesni-intel.ko 2023-06-09T04:26:29.732 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-06-09T04:26:29.733 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-06-09T04:26:29.733 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 30129 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-06-09T04:26:29.733 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 92281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-06-09T04:26:29.733 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 106625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-06-09T04:26:29.733 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 152065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-06-09T04:26:29.733 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-06-09T04:26:29.733 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13601 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-06-09T04:26:29.734 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 83785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-06-09T04:26:29.734 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-06-09T04:26:29.734 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 46641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-06-09T04:26:29.734 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 47097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/serpent-avx2.ko 2023-06-09T04:26:29.734 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 51625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-06-09T04:26:29.734 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 38769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-06-09T04:26:29.734 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 40353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-06-09T04:26:29.734 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 58417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-06-09T04:26:29.735 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 50329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-06-09T04:26:29.735 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 31473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-06-09T04:26:29.736 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-06-09T04:26:29.736 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/kernel/ 2023-06-09T04:26:29.736 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/kernel/cpu/ 2023-06-09T04:26:29.736 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/kernel/cpu/mce/ 2023-06-09T04:26:29.736 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 40009 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-06-09T04:26:29.737 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/kernel/cpuid.ko 2023-06-09T04:26:29.737 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/kernel/msr.ko 2023-06-09T04:26:29.737 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/kvm/ 2023-06-09T04:26:29.737 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 346401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/kvm/kvm-amd.ko 2023-06-09T04:26:29.738 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 972121 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/kvm/kvm-intel.ko 2023-06-09T04:26:29.738 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 2209361 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/kvm/kvm.ko 2023-06-09T04:26:29.747 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/ 2023-06-09T04:26:29.747 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 56209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/af_alg.ko 2023-06-09T04:26:29.747 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/algif_hash.ko 2023-06-09T04:26:29.747 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/algif_skcipher.ko 2023-06-09T04:26:29.747 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/ansi_cprng.ko 2023-06-09T04:26:29.747 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/anubis.ko 2023-06-09T04:26:29.747 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/arc4.ko 2023-06-09T04:26:29.748 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/asymmetric_keys/ 2023-06-09T04:26:29.748 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10073 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-06-09T04:26:29.748 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/async_tx/ 2023-06-09T04:26:29.748 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/async_tx/async_memcpy.ko 2023-06-09T04:26:29.748 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/async_tx/async_pq.ko 2023-06-09T04:26:29.748 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/async_tx/async_raid6_recov.ko 2023-06-09T04:26:29.748 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13169 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/async_tx/async_tx.ko 2023-06-09T04:26:29.749 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/async_tx/async_xor.ko 2023-06-09T04:26:29.749 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17809 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/async_tx/raid6test.ko 2023-06-09T04:26:29.749 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20073 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/authenc.ko 2023-06-09T04:26:29.749 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/authencesn.ko 2023-06-09T04:26:29.749 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/blake2b_generic.ko 2023-06-09T04:26:29.749 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/blowfish_common.ko 2023-06-09T04:26:29.749 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/blowfish_generic.ko 2023-06-09T04:26:29.749 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 38697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/camellia_generic.ko 2023-06-09T04:26:29.750 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/cast5_generic.ko 2023-06-09T04:26:29.750 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/cast6_generic.ko 2023-06-09T04:26:29.750 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/cast_common.ko 2023-06-09T04:26:29.750 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 34985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/ccm.ko 2023-06-09T04:26:29.750 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/cmac.ko 2023-06-09T04:26:29.750 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9409 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/crc32_generic.ko 2023-06-09T04:26:29.750 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 45361 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/cryptd.ko 2023-06-09T04:26:29.751 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/crypto_engine.ko 2023-06-09T04:26:29.751 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/crypto_simd.ko 2023-06-09T04:26:29.751 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/crypto_user.ko 2023-06-09T04:26:29.751 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/cts.ko 2023-06-09T04:26:29.751 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/des_generic.ko 2023-06-09T04:26:29.751 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/dh_generic.ko 2023-06-09T04:26:29.751 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10889 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/echainiv.ko 2023-06-09T04:26:29.752 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/essiv.ko 2023-06-09T04:26:29.752 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/fcrypt.ko 2023-06-09T04:26:29.752 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/khazad.ko 2023-06-09T04:26:29.752 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15537 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/lrw.ko 2023-06-09T04:26:29.752 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/lz4.ko 2023-06-09T04:26:29.752 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11409 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/lz4hc.ko 2023-06-09T04:26:29.752 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/md4.ko 2023-06-09T04:26:29.752 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/michael_mic.ko 2023-06-09T04:26:29.753 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/pcbc.ko 2023-06-09T04:26:29.753 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/pcrypt.ko 2023-06-09T04:26:29.753 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/rmd160.ko 2023-06-09T04:26:29.753 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 29273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/seed.ko 2023-06-09T04:26:29.753 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/serpent_generic.ko 2023-06-09T04:26:29.753 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 149081 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/tcrypt.ko 2023-06-09T04:26:29.753 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/tea.ko 2023-06-09T04:26:29.754 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/twofish_common.ko 2023-06-09T04:26:29.754 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/twofish_generic.ko 2023-06-09T04:26:29.754 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/vmac.ko 2023-06-09T04:26:29.754 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 36009 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/wp512.ko 2023-06-09T04:26:29.754 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/xcbc.ko 2023-06-09T04:26:29.754 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/xor.ko 2023-06-09T04:26:29.754 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/xts.ko 2023-06-09T04:26:29.754 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/xxhash_generic.ko 2023-06-09T04:26:29.755 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ 2023-06-09T04:26:29.755 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/ 2023-06-09T04:26:29.755 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18129 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/acpi_extlog.ko 2023-06-09T04:26:29.755 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/acpi_ipmi.ko 2023-06-09T04:26:29.755 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/acpi_pad.ko 2023-06-09T04:26:29.755 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/apei/ 2023-06-09T04:26:29.755 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 31121 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/apei/einj.ko 2023-06-09T04:26:29.755 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/ec_sys.ko 2023-06-09T04:26:29.756 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/platform_profile.ko 2023-06-09T04:26:29.756 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/sbs.ko 2023-06-09T04:26:29.756 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/sbshc.ko 2023-06-09T04:26:29.756 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 98193 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/video.ko 2023-06-09T04:26:29.756 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/ 2023-06-09T04:26:29.756 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/acard-ahci.ko 2023-06-09T04:26:29.756 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 88505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/ahci.ko 2023-06-09T04:26:29.757 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/ahci_platform.ko 2023-06-09T04:26:29.757 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 85073 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/libahci.ko 2023-06-09T04:26:29.757 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 32753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/libahci_platform.ko 2023-06-09T04:26:29.757 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_acpi.ko 2023-06-09T04:26:29.757 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 30377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_ali.ko 2023-06-09T04:26:29.757 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 33513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_amd.ko 2023-06-09T04:26:29.757 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21025 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_artop.ko 2023-06-09T04:26:29.757 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_atiixp.ko 2023-06-09T04:26:29.758 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_atp867x.ko 2023-06-09T04:26:29.758 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17409 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_cmd640.ko 2023-06-09T04:26:29.758 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_cmd64x.ko 2023-06-09T04:26:29.758 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_cypress.ko 2023-06-09T04:26:29.758 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_efar.ko 2023-06-09T04:26:29.758 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21705 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_hpt366.ko 2023-06-09T04:26:29.758 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 33865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_hpt37x.ko 2023-06-09T04:26:29.759 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22889 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_hpt3x2n.ko 2023-06-09T04:26:29.759 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_hpt3x3.ko 2023-06-09T04:26:29.759 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_it8213.ko 2023-06-09T04:26:29.759 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 35065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_it821x.ko 2023-06-09T04:26:29.759 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_jmicron.ko 2023-06-09T04:26:29.759 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 51561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_legacy.ko 2023-06-09T04:26:29.759 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_marvell.ko 2023-06-09T04:26:29.759 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_mpiix.ko 2023-06-09T04:26:29.760 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12593 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_netcell.ko 2023-06-09T04:26:29.760 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_ninja32.ko 2023-06-09T04:26:29.760 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14793 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_ns87410.ko 2023-06-09T04:26:29.760 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_ns87415.ko 2023-06-09T04:26:29.760 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16265 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_oldpiix.ko 2023-06-09T04:26:29.760 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_opti.ko 2023-06-09T04:26:29.760 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_optidma.ko 2023-06-09T04:26:29.760 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 32337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_pcmcia.ko 2023-06-09T04:26:29.761 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 37609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_pdc2027x.ko 2023-06-09T04:26:29.761 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-06-09T04:26:29.761 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_piccolo.ko 2023-06-09T04:26:29.761 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_radisys.ko 2023-06-09T04:26:29.761 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_rdc.ko 2023-06-09T04:26:29.761 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15081 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_rz1000.ko 2023-06-09T04:26:29.761 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_sch.ko 2023-06-09T04:26:29.761 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22833 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_serverworks.ko 2023-06-09T04:26:29.762 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_sil680.ko 2023-06-09T04:26:29.762 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19385 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_sl82c105.ko 2023-06-09T04:26:29.762 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_triflex.ko 2023-06-09T04:26:29.762 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 30249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_via.ko 2023-06-09T04:26:29.762 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pdc_adma.ko 2023-06-09T04:26:29.762 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_inic162x.ko 2023-06-09T04:26:29.762 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 83113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_mv.ko 2023-06-09T04:26:29.763 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 70353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_nv.ko 2023-06-09T04:26:29.763 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 37257 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_promise.ko 2023-06-09T04:26:29.763 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_qstor.ko 2023-06-09T04:26:29.763 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 29025 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_sil.ko 2023-06-09T04:26:29.763 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 38089 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_sil24.ko 2023-06-09T04:26:29.763 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_sis.ko 2023-06-09T04:26:29.763 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20201 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_svw.ko 2023-06-09T04:26:29.763 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 44545 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_sx4.ko 2023-06-09T04:26:29.764 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15361 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_uli.ko 2023-06-09T04:26:29.764 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 34945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_via.ko 2023-06-09T04:26:29.764 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_vsc.ko 2023-06-09T04:26:29.764 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/auxdisplay/ 2023-06-09T04:26:29.764 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/auxdisplay/ks0108.ko 2023-06-09T04:26:29.764 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/bcma/ 2023-06-09T04:26:29.764 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 121569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/bcma/bcma.ko 2023-06-09T04:26:29.764 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/ 2023-06-09T04:26:29.765 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/aoe/ 2023-06-09T04:26:29.765 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 113433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/aoe/aoe.ko 2023-06-09T04:26:29.765 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/drbd/ 2023-06-09T04:26:29.765 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 968017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/drbd/drbd.ko 2023-06-09T04:26:29.765 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 173105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/floppy.ko 2023-06-09T04:26:29.765 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/mtip32xx/ 2023-06-09T04:26:29.765 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 94185 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-06-09T04:26:29.766 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 114049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/nbd.ko 2023-06-09T04:26:29.803 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/null_blk/ 2023-06-09T04:26:29.804 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 110145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/null_blk/null_blk.ko 2023-06-09T04:26:29.804 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 81625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/pktcdvd.ko 2023-06-09T04:26:29.804 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 254273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/rbd.ko 2023-06-09T04:26:29.804 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/xen-blkback/ 2023-06-09T04:26:29.804 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 98017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-06-09T04:26:29.805 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/zram/ 2023-06-09T04:26:29.805 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 59985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/zram/zram.ko 2023-06-09T04:26:29.805 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/ 2023-06-09T04:26:29.805 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 30737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/applicom.ko 2023-06-09T04:26:29.805 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11889 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/hangcheck-timer.ko 2023-06-09T04:26:29.805 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/hw_random/ 2023-06-09T04:26:29.805 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/hw_random/amd-rng.ko 2023-06-09T04:26:29.805 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/hw_random/intel-rng.ko 2023-06-09T04:26:29.806 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-06-09T04:26:29.806 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/hw_random/via-rng.ko 2023-06-09T04:26:29.806 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15409 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/hw_random/virtio-rng.ko 2023-06-09T04:26:29.806 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/ipmi/ 2023-06-09T04:26:29.806 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 30737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-06-09T04:26:29.806 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 147521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-06-09T04:26:29.806 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26385 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-06-09T04:26:29.806 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 138881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/ipmi/ipmi_si.ko 2023-06-09T04:26:29.807 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 70649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-06-09T04:26:29.807 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 53425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-06-09T04:26:29.807 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 36073 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/lp.ko 2023-06-09T04:26:29.807 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/mwave/ 2023-06-09T04:26:29.807 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 83945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/mwave/mwave.ko 2023-06-09T04:26:29.807 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/nvram.ko 2023-06-09T04:26:29.807 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 31921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/ppdev.ko 2023-06-09T04:26:29.808 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 51001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/tlclk.ko 2023-06-09T04:26:29.808 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/tpm/ 2023-06-09T04:26:29.808 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/tpm/tpm_atmel.ko 2023-06-09T04:26:29.808 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-06-09T04:26:29.808 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-06-09T04:26:29.808 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 32801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-06-09T04:26:29.808 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 30001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/tpm/tpm_infineon.ko 2023-06-09T04:26:29.808 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/tpm/tpm_nsc.ko 2023-06-09T04:26:29.809 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23457 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-06-09T04:26:29.809 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/xillybus/ 2023-06-09T04:26:29.809 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/xillybus/xillybus_class.ko 2023-06-09T04:26:29.809 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 50217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/xillybus/xillybus_core.ko 2023-06-09T04:26:29.809 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-06-09T04:26:29.809 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/clk/ 2023-06-09T04:26:29.809 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/clk/clk-palmas.ko 2023-06-09T04:26:29.810 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 47753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/clk/clk-si5351.ko 2023-06-09T04:26:29.810 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/clk/clk-twl6040.ko 2023-06-09T04:26:29.810 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/clk/clk-wm831x.ko 2023-06-09T04:26:29.810 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/cpufreq/ 2023-06-09T04:26:29.810 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-06-09T04:26:29.810 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16657 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/cpufreq/p4-clockmod.ko 2023-06-09T04:26:29.810 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24705 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/cpufreq/speedstep-lib.ko 2023-06-09T04:26:29.810 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/ 2023-06-09T04:26:29.811 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/ccp/ 2023-06-09T04:26:29.811 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 70609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-06-09T04:26:29.811 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 231545 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/ccp/ccp.ko 2023-06-09T04:26:29.811 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/intel/ 2023-06-09T04:26:29.811 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/intel/qat/ 2023-06-09T04:26:29.811 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/intel/qat/qat_common/ 2023-06-09T04:26:29.811 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 396281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-06-09T04:26:29.812 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-06-09T04:26:29.812 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-06-09T04:26:29.812 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/padlock-aes.ko 2023-06-09T04:26:29.812 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/padlock-sha.ko 2023-06-09T04:26:29.812 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/virtio/ 2023-06-09T04:26:29.812 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 68441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-06-09T04:26:29.812 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/dca/ 2023-06-09T04:26:29.812 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/dca/dca.ko 2023-06-09T04:26:29.813 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/dma/ 2023-06-09T04:26:29.813 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/dma/dw/ 2023-06-09T04:26:29.813 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/dma/dw/dw_dmac.ko 2023-06-09T04:26:29.813 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/dma/ioat/ 2023-06-09T04:26:29.813 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 122473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/dma/ioat/ioatdma.ko 2023-06-09T04:26:29.813 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/ 2023-06-09T04:26:29.813 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 75409 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/amd64_edac.ko 2023-06-09T04:26:29.814 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 35649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/e752x_edac.ko 2023-06-09T04:26:29.814 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 63017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/edac_mce_amd.ko 2023-06-09T04:26:29.814 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/i3000_edac.ko 2023-06-09T04:26:29.814 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/i3200_edac.ko 2023-06-09T04:26:29.814 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/i5100_edac.ko 2023-06-09T04:26:29.814 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/i5400_edac.ko 2023-06-09T04:26:29.814 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/i7300_edac.ko 2023-06-09T04:26:29.814 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 51905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/i7core_edac.ko 2023-06-09T04:26:29.815 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/i82975x_edac.ko 2023-06-09T04:26:29.815 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19841 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/ie31200_edac.ko 2023-06-09T04:26:29.815 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 56689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/sb_edac.ko 2023-06-09T04:26:29.815 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/x38_edac.ko 2023-06-09T04:26:29.815 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/extcon/ 2023-06-09T04:26:29.815 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/extcon/extcon-gpio.ko 2023-06-09T04:26:29.815 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 27017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/extcon/extcon-max14577.ko 2023-06-09T04:26:29.815 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 29457 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/extcon/extcon-max77693.ko 2023-06-09T04:26:29.816 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/extcon/extcon-max8997.ko 2023-06-09T04:26:29.816 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/extcon/extcon-palmas.ko 2023-06-09T04:26:29.816 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23601 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/extcon/extcon-rt8973a.ko 2023-06-09T04:26:29.816 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 27673 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/extcon/extcon-sm5502.ko 2023-06-09T04:26:29.816 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/firmware/ 2023-06-09T04:26:29.816 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 34777 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/firmware/dmi-sysfs.ko 2023-06-09T04:26:29.816 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/firmware/efi/ 2023-06-09T04:26:29.817 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/firmware/efi/efi-pstore.ko 2023-06-09T04:26:29.817 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20705 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/firmware/iscsi_ibft.ko 2023-06-09T04:26:29.817 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/ 2023-06-09T04:26:29.817 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12201 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-adp5520.ko 2023-06-09T04:26:29.817 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-amd8111.ko 2023-06-09T04:26:29.817 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-arizona.ko 2023-06-09T04:26:29.817 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-da9052.ko 2023-06-09T04:26:29.817 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-da9055.ko 2023-06-09T04:26:29.818 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-dln2.ko 2023-06-09T04:26:29.818 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 78249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-f7188x.ko 2023-06-09T04:26:29.818 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-generic.ko 2023-06-09T04:26:29.818 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19449 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-ich.ko 2023-06-09T04:26:29.818 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-06-09T04:26:29.818 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14009 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-kempld.ko 2023-06-09T04:26:29.818 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-lp3943.ko 2023-06-09T04:26:29.819 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-max7300.ko 2023-06-09T04:26:29.819 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-max730x.ko 2023-06-09T04:26:29.819 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-max732x.ko 2023-06-09T04:26:29.819 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-06-09T04:26:29.819 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 46641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-pca953x.ko 2023-06-09T04:26:29.819 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26665 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-pcf857x.ko 2023-06-09T04:26:29.819 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-rdc321x.ko 2023-06-09T04:26:29.819 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-sch.ko 2023-06-09T04:26:29.820 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-sch311x.ko 2023-06-09T04:26:29.820 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-tps65912.ko 2023-06-09T04:26:29.820 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-twl4030.ko 2023-06-09T04:26:29.820 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-twl6040.ko 2023-06-09T04:26:29.820 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-viperboard.ko 2023-06-09T04:26:29.820 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-vx855.ko 2023-06-09T04:26:29.820 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16169 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-wm831x.ko 2023-06-09T04:26:29.821 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-wm8350.ko 2023-06-09T04:26:29.821 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-wm8994.ko 2023-06-09T04:26:29.821 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/ 2023-06-09T04:26:29.821 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-a4tech.ko 2023-06-09T04:26:29.821 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 38809 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-apple.ko 2023-06-09T04:26:29.821 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-appleir.ko 2023-06-09T04:26:29.821 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8185 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-aureal.ko 2023-06-09T04:26:29.821 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-axff.ko 2023-06-09T04:26:29.822 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-belkin.ko 2023-06-09T04:26:29.822 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-cherry.ko 2023-06-09T04:26:29.822 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15937 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-chicony.ko 2023-06-09T04:26:29.822 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 58961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-cp2112.ko 2023-06-09T04:26:29.822 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10937 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-cypress.ko 2023-06-09T04:26:29.822 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-dr.ko 2023-06-09T04:26:29.822 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10593 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-elecom.ko 2023-06-09T04:26:29.823 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-elo.ko 2023-06-09T04:26:29.823 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-emsff.ko 2023-06-09T04:26:29.823 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-ezkey.ko 2023-06-09T04:26:29.823 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14129 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-gaff.ko 2023-06-09T04:26:29.823 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-generic.ko 2023-06-09T04:26:29.823 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-gt683r.ko 2023-06-09T04:26:29.823 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-gyration.ko 2023-06-09T04:26:29.823 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-holtek-kbd.ko 2023-06-09T04:26:29.824 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-holtek-mouse.ko 2023-06-09T04:26:29.824 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-holtekff.ko 2023-06-09T04:26:29.824 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18937 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-hyperv.ko 2023-06-09T04:26:29.824 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-icade.ko 2023-06-09T04:26:29.824 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-kensington.ko 2023-06-09T04:26:29.824 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-keytouch.ko 2023-06-09T04:26:29.824 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17089 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-kye.ko 2023-06-09T04:26:29.824 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-lcpower.ko 2023-06-09T04:26:29.825 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-led.ko 2023-06-09T04:26:29.825 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 42177 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-lenovo.ko 2023-06-09T04:26:29.825 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 30417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-lg-g15.ko 2023-06-09T04:26:29.825 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 57689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-logitech-dj.ko 2023-06-09T04:26:29.825 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 100561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-06-09T04:26:29.825 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 80889 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-logitech.ko 2023-06-09T04:26:29.825 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 30681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-magicmouse.ko 2023-06-09T04:26:29.825 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-microsoft.ko 2023-06-09T04:26:29.826 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10257 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-monterey.ko 2023-06-09T04:26:29.826 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 49977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-multitouch.ko 2023-06-09T04:26:29.826 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 32473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-ntrig.ko 2023-06-09T04:26:29.826 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-ortek.ko 2023-06-09T04:26:29.826 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9009 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-penmount.ko 2023-06-09T04:26:29.826 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12185 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-petalynx.ko 2023-06-09T04:26:29.826 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 72817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-picolcd.ko 2023-06-09T04:26:29.827 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14121 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-pl.ko 2023-06-09T04:26:29.827 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-plantronics.ko 2023-06-09T04:26:29.827 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-primax.ko 2023-06-09T04:26:29.827 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 35289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-rmi.ko 2023-06-09T04:26:29.827 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-arvo.ko 2023-06-09T04:26:29.827 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13129 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-common.ko 2023-06-09T04:26:29.827 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 31177 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-isku.ko 2023-06-09T04:26:29.827 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 29481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-kone.ko 2023-06-09T04:26:29.828 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 30945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-06-09T04:26:29.828 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-konepure.ko 2023-06-09T04:26:29.828 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 29305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-06-09T04:26:29.828 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13193 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-lua.ko 2023-06-09T04:26:29.828 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 29129 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-pyra.ko 2023-06-09T04:26:29.828 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 27713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-ryos.ko 2023-06-09T04:26:29.828 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-savu.ko 2023-06-09T04:26:29.828 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat.ko 2023-06-09T04:26:29.829 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-saitek.ko 2023-06-09T04:26:29.829 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15025 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-samsung.ko 2023-06-09T04:26:29.829 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 35521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-sensor-hub.ko 2023-06-09T04:26:29.829 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-sjoy.ko 2023-06-09T04:26:29.829 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 51025 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-sony.ko 2023-06-09T04:26:29.829 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-speedlink.ko 2023-06-09T04:26:29.829 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-steelseries.ko 2023-06-09T04:26:29.830 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-sunplus.ko 2023-06-09T04:26:29.830 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16809 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-thrustmaster.ko 2023-06-09T04:26:29.830 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-tivo.ko 2023-06-09T04:26:29.830 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-tmff.ko 2023-06-09T04:26:29.830 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-topseed.ko 2023-06-09T04:26:29.830 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-twinhan.ko 2023-06-09T04:26:29.830 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 71337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-uclogic.ko 2023-06-09T04:26:29.830 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-waltop.ko 2023-06-09T04:26:29.831 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 143417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-wiimote.ko 2023-06-09T04:26:29.831 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-xinmo.ko 2023-06-09T04:26:29.831 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-zpff.ko 2023-06-09T04:26:29.831 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-zydacron.ko 2023-06-09T04:26:29.831 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 261777 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid.ko 2023-06-09T04:26:29.831 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 32209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/uhid.ko 2023-06-09T04:26:29.831 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/usbhid/ 2023-06-09T04:26:29.832 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 125241 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/usbhid/usbhid.ko 2023-06-09T04:26:29.832 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19025 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/usbhid/usbkbd.ko 2023-06-09T04:26:29.832 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/usbhid/usbmouse.ko 2023-06-09T04:26:29.832 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 216833 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/wacom.ko 2023-06-09T04:26:29.832 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hv/ 2023-06-09T04:26:29.832 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 63153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hv/hv_balloon.ko 2023-06-09T04:26:29.832 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 89497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hv/hv_utils.ko 2023-06-09T04:26:29.832 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 292521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hv/hv_vmbus.ko 2023-06-09T04:26:29.833 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ 2023-06-09T04:26:29.833 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 66489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/abituguru.ko 2023-06-09T04:26:29.833 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 61289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/abituguru3.ko 2023-06-09T04:26:29.833 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 34625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/acpi_power_meter.ko 2023-06-09T04:26:29.833 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17385 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ad7414.ko 2023-06-09T04:26:29.833 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ad7418.ko 2023-06-09T04:26:29.833 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25089 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adc128d818.ko 2023-06-09T04:26:29.834 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 31617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adm1025.ko 2023-06-09T04:26:29.834 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 97857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adm1026.ko 2023-06-09T04:26:29.834 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adm1029.ko 2023-06-09T04:26:29.834 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 45377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adm1031.ko 2023-06-09T04:26:29.834 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26177 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adm9240.ko 2023-06-09T04:26:29.834 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14657 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ads7828.ko 2023-06-09T04:26:29.834 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10657 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adt7410.ko 2023-06-09T04:26:29.834 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21937 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adt7411.ko 2023-06-09T04:26:29.835 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 74329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adt7462.ko 2023-06-09T04:26:29.835 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 39409 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adt7470.ko 2023-06-09T04:26:29.835 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 65145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adt7475.ko 2023-06-09T04:26:29.835 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adt7x10.ko 2023-06-09T04:26:29.835 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 38953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/amc6821.ko 2023-06-09T04:26:29.835 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 55025 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/applesmc.ko 2023-06-09T04:26:29.835 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 49737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/asb100.ko 2023-06-09T04:26:29.835 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 58433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/asc7621.ko 2023-06-09T04:26:29.836 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 40697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/asus_atk0110.ko 2023-06-09T04:26:29.836 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/atxp1.ko 2023-06-09T04:26:29.836 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28177 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/coretemp.ko 2023-06-09T04:26:29.836 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/da9052-hwmon.ko 2023-06-09T04:26:29.836 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17081 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/da9055-hwmon.ko 2023-06-09T04:26:29.836 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 44297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-06-09T04:26:29.836 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 99481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/dme1737.ko 2023-06-09T04:26:29.837 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ds1621.ko 2023-06-09T04:26:29.837 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ds620.ko 2023-06-09T04:26:29.837 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 29593 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/emc1403.ko 2023-06-09T04:26:29.837 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 33001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/emc2103.ko 2023-06-09T04:26:29.837 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 30209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/emc6w201.ko 2023-06-09T04:26:29.837 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 66801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/f71805f.ko 2023-06-09T04:26:29.837 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 94473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/f71882fg.ko 2023-06-09T04:26:29.837 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 41289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/f75375s.ko 2023-06-09T04:26:29.838 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21201 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/fam15h_power.ko 2023-06-09T04:26:29.838 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 55249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/fschmd.ko 2023-06-09T04:26:29.838 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/g760a.ko 2023-06-09T04:26:29.838 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/g762.ko 2023-06-09T04:26:29.838 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 46689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/gl518sm.ko 2023-06-09T04:26:29.838 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 45345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/gl520sm.ko 2023-06-09T04:26:29.838 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/hih6130.ko 2023-06-09T04:26:29.838 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9265 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/hwmon-vid.ko 2023-06-09T04:26:29.839 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/i5500_temp.ko 2023-06-09T04:26:29.839 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/i5k_amb.ko 2023-06-09T04:26:29.839 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 34393 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ibmaem.ko 2023-06-09T04:26:29.839 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21121 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ibmpex.ko 2023-06-09T04:26:29.839 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ina209.ko 2023-06-09T04:26:29.839 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ina2xx.ko 2023-06-09T04:26:29.839 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 128913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/it87.ko 2023-06-09T04:26:29.840 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/jc42.ko 2023-06-09T04:26:29.840 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23833 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/k10temp.ko 2023-06-09T04:26:29.840 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/k8temp.ko 2023-06-09T04:26:29.840 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lineage-pem.ko 2023-06-09T04:26:29.840 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 48417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm63.ko 2023-06-09T04:26:29.840 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16585 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm73.ko 2023-06-09T04:26:29.840 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 36593 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm75.ko 2023-06-09T04:26:29.840 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm77.ko 2023-06-09T04:26:29.841 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 34473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm78.ko 2023-06-09T04:26:29.841 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 31625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm80.ko 2023-06-09T04:26:29.841 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm83.ko 2023-06-09T04:26:29.841 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 72657 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm85.ko 2023-06-09T04:26:29.841 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 45977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm87.ko 2023-06-09T04:26:29.841 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 37729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm90.ko 2023-06-09T04:26:29.841 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm92.ko 2023-06-09T04:26:29.841 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 108721 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm93.ko 2023-06-09T04:26:29.842 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 33281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm95234.ko 2023-06-09T04:26:29.842 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16089 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm95241.ko 2023-06-09T04:26:29.842 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm95245.ko 2023-06-09T04:26:29.842 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23841 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ltc2945.ko 2023-06-09T04:26:29.842 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ltc4151.ko 2023-06-09T04:26:29.842 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15081 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ltc4215.ko 2023-06-09T04:26:29.842 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ltc4222.ko 2023-06-09T04:26:29.842 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14657 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ltc4245.ko 2023-06-09T04:26:29.843 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13129 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ltc4260.ko 2023-06-09T04:26:29.843 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ltc4261.ko 2023-06-09T04:26:29.843 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 33377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/max16065.ko 2023-06-09T04:26:29.843 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/max1619.ko 2023-06-09T04:26:29.843 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/max1668.ko 2023-06-09T04:26:29.843 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/max197.ko 2023-06-09T04:26:29.843 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/max6639.ko 2023-06-09T04:26:29.843 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23201 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/max6650.ko 2023-06-09T04:26:29.844 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 35593 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/max6697.ko 2023-06-09T04:26:29.844 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/mc13783-adc.ko 2023-06-09T04:26:29.844 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/mcp3021.ko 2023-06-09T04:26:29.844 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-06-09T04:26:29.844 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 43977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/nct6683.ko 2023-06-09T04:26:29.844 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 114577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/nct6775-core.ko 2023-06-09T04:26:29.844 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 60033 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/nct6775.ko 2023-06-09T04:26:29.845 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 59553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/nct7802.ko 2023-06-09T04:26:29.845 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 82169 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pc87360.ko 2023-06-09T04:26:29.845 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 54321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pc87427.ko 2023-06-09T04:26:29.845 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pcf8591.ko 2023-06-09T04:26:29.845 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/ 2023-06-09T04:26:29.845 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20809 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-06-09T04:26:29.845 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16889 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-06-09T04:26:29.846 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-06-09T04:26:29.846 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/max16064.ko 2023-06-09T04:26:29.846 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/max34440.ko 2023-06-09T04:26:29.846 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/max8688.ko 2023-06-09T04:26:29.846 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-06-09T04:26:29.846 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 79353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-06-09T04:26:29.846 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-06-09T04:26:29.846 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 30617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-06-09T04:26:29.847 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-06-09T04:26:29.847 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-06-09T04:26:29.847 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/powr1220.ko 2023-06-09T04:26:29.847 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/sch5627.ko 2023-06-09T04:26:29.847 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/sch5636.ko 2023-06-09T04:26:29.847 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/sch56xx-common.ko 2023-06-09T04:26:29.847 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 32017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/sht15.ko 2023-06-09T04:26:29.847 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13385 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/sht21.ko 2023-06-09T04:26:29.848 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16657 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/shtc1.ko 2023-06-09T04:26:29.848 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 39937 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/sis5595.ko 2023-06-09T04:26:29.848 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 31817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/smm665.ko 2023-06-09T04:26:29.848 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/smsc47b397.ko 2023-06-09T04:26:29.848 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 39017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/smsc47m1.ko 2023-06-09T04:26:29.848 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 37273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/smsc47m192.ko 2023-06-09T04:26:29.848 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/thmc50.ko 2023-06-09T04:26:29.849 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/tmp102.ko 2023-06-09T04:26:29.849 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/tmp103.ko 2023-06-09T04:26:29.849 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/tmp401.ko 2023-06-09T04:26:29.849 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19361 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/tmp421.ko 2023-06-09T04:26:29.849 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19585 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/via-cputemp.ko 2023-06-09T04:26:29.849 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 41833 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/via686a.ko 2023-06-09T04:26:29.849 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 52337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/vt1211.ko 2023-06-09T04:26:29.849 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 51441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/vt8231.ko 2023-06-09T04:26:29.850 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 57345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/w83627ehf.ko 2023-06-09T04:26:29.850 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 78761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/w83627hf.ko 2023-06-09T04:26:29.850 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 71169 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/w83781d.ko 2023-06-09T04:26:29.850 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 63113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/w83791d.ko 2023-06-09T04:26:29.850 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 71145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/w83792d.ko 2023-06-09T04:26:29.850 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 101273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/w83793.ko 2023-06-09T04:26:29.850 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 119329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/w83795.ko 2023-06-09T04:26:29.850 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/w83l785ts.ko 2023-06-09T04:26:29.851 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 35505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/w83l786ng.ko 2023-06-09T04:26:29.851 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-06-09T04:26:29.851 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-06-09T04:26:29.851 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/ 2023-06-09T04:26:29.851 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/algos/ 2023-06-09T04:26:29.851 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-06-09T04:26:29.851 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-06-09T04:26:29.852 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/ 2023-06-09T04:26:29.852 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 27849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-06-09T04:26:29.852 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-06-09T04:26:29.852 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 27601 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-06-09T04:26:29.852 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-06-09T04:26:29.852 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-06-09T04:26:29.852 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-06-09T04:26:29.852 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-06-09T04:26:29.853 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 6521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-06-09T04:26:29.853 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-06-09T04:26:29.853 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 46345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-06-09T04:26:29.853 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-06-09T04:26:29.853 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-06-09T04:26:29.853 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17161 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-06-09T04:26:29.853 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-06-09T04:26:29.854 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-06-09T04:26:29.854 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 62337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-i801.ko 2023-06-09T04:26:29.854 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-isch.ko 2023-06-09T04:26:29.854 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 47785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-06-09T04:26:29.854 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17185 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-06-09T04:26:29.854 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-06-09T04:26:29.854 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21937 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-06-09T04:26:29.854 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-06-09T04:26:29.855 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-parport.ko 2023-06-09T04:26:29.855 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16393 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-06-09T04:26:29.855 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 47137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-06-09T04:26:29.855 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-06-09T04:26:29.855 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18537 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-06-09T04:26:29.855 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11705 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-06-09T04:26:29.855 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22193 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-06-09T04:26:29.856 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 29185 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-06-09T04:26:29.856 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-06-09T04:26:29.856 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-06-09T04:26:29.856 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-06-09T04:26:29.856 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-via.ko 2023-06-09T04:26:29.856 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-06-09T04:26:29.856 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-06-09T04:26:29.856 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 48201 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-06-09T04:26:29.857 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/i2c-mux.ko 2023-06-09T04:26:29.857 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/i2c-smbus.ko 2023-06-09T04:26:29.857 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/i2c-stub.ko 2023-06-09T04:26:29.857 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/muxes/ 2023-06-09T04:26:29.857 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-06-09T04:26:29.857 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-06-09T04:26:29.857 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-06-09T04:26:29.858 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ 2023-06-09T04:26:29.858 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/core/ 2023-06-09T04:26:29.858 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 264409 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/core/ib_cm.ko 2023-06-09T04:26:29.858 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 849113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/core/ib_core.ko 2023-06-09T04:26:29.858 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 68489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/core/ib_umad.ko 2023-06-09T04:26:29.858 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 320185 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-06-09T04:26:29.858 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 96801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/core/iw_cm.ko 2023-06-09T04:26:29.858 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 272097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/core/rdma_cm.ko 2023-06-09T04:26:29.859 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 66073 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-06-09T04:26:29.859 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/ 2023-06-09T04:26:29.859 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/cxgb4/ 2023-06-09T04:26:29.859 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 492377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-06-09T04:26:29.859 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/mlx4/ 2023-06-09T04:26:29.859 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 419097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-06-09T04:26:29.859 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/mlx5/ 2023-06-09T04:26:29.860 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 733385 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-06-09T04:26:29.860 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/mthca/ 2023-06-09T04:26:29.860 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 296481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-06-09T04:26:29.860 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/ocrdma/ 2023-06-09T04:26:29.860 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 153561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-06-09T04:26:29.860 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/usnic/ 2023-06-09T04:26:29.860 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 168905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-06-09T04:26:29.861 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/ 2023-06-09T04:26:29.861 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/ipoib/ 2023-06-09T04:26:29.861 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 263057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-06-09T04:26:29.861 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/iser/ 2023-06-09T04:26:29.861 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 100041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-06-09T04:26:29.861 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/isert/ 2023-06-09T04:26:29.861 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 111049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-06-09T04:26:29.862 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/srp/ 2023-06-09T04:26:29.862 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 128961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-06-09T04:26:29.862 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/srpt/ 2023-06-09T04:26:29.862 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 129385 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-06-09T04:26:29.862 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/ 2023-06-09T04:26:29.862 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/evbug.ko 2023-06-09T04:26:29.862 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23777 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/ff-memless.ko 2023-06-09T04:26:29.863 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/gameport/ 2023-06-09T04:26:29.863 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11777 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-06-09T04:26:29.863 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/gameport/fm801-gp.ko 2023-06-09T04:26:29.863 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 39505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/gameport/gameport.ko 2023-06-09T04:26:29.863 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12385 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/gameport/lightning.ko 2023-06-09T04:26:29.863 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/gameport/ns558.ko 2023-06-09T04:26:29.863 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 41713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/joydev.ko 2023-06-09T04:26:29.864 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/ 2023-06-09T04:26:29.864 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-06-09T04:26:29.864 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 30257 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-06-09T04:26:29.864 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-06-09T04:26:29.864 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-06-09T04:26:29.864 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 36545 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/gpio_keys.ko 2023-06-09T04:26:29.864 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-06-09T04:26:29.865 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/lkkbd.ko 2023-06-09T04:26:29.865 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 27937 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/lm8323.ko 2023-06-09T04:26:29.865 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/lm8333.ko 2023-06-09T04:26:29.865 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-06-09T04:26:29.865 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18033 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-06-09T04:26:29.865 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-06-09T04:26:29.865 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-06-09T04:26:29.866 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/newtonkbd.ko 2023-06-09T04:26:29.866 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-06-09T04:26:29.866 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15025 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/qt1070.ko 2023-06-09T04:26:29.866 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/qt2160.ko 2023-06-09T04:26:29.866 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-06-09T04:26:29.866 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/stowaway.ko 2023-06-09T04:26:29.866 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18177 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/sunkbd.ko 2023-06-09T04:26:29.866 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-06-09T04:26:29.867 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16009 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-06-09T04:26:29.867 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-06-09T04:26:29.867 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/xtkbd.ko 2023-06-09T04:26:29.867 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/matrix-keymap.ko 2023-06-09T04:26:29.867 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/ 2023-06-09T04:26:29.867 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 34209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/appletouch.ko 2023-06-09T04:26:29.867 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 34001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/bcm5974.ko 2023-06-09T04:26:29.868 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 123497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/cyapatp.ko 2023-06-09T04:26:29.868 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 89345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/elan_i2c.ko 2023-06-09T04:26:29.868 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/gpio_mouse.ko 2023-06-09T04:26:29.868 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 334393 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/psmouse.ko 2023-06-09T04:26:29.868 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/sermouse.ko 2023-06-09T04:26:29.868 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-06-09T04:26:29.868 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/synaptics_usb.ko 2023-06-09T04:26:29.869 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/vsxxxaa.ko 2023-06-09T04:26:29.869 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/rmi4/ 2023-06-09T04:26:29.869 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 108097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/rmi4/rmi_core.ko 2023-06-09T04:26:29.869 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/serio/ 2023-06-09T04:26:29.869 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/serio/altera_ps2.ko 2023-06-09T04:26:29.869 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/serio/arc_ps2.ko 2023-06-09T04:26:29.869 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16257 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/serio/ct82c710.ko 2023-06-09T04:26:29.870 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-06-09T04:26:29.870 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15721 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/serio/parkbd.ko 2023-06-09T04:26:29.870 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/serio/pcips2.ko 2023-06-09T04:26:29.870 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/serio/ps2mult.ko 2023-06-09T04:26:29.870 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/serio/serio_raw.ko 2023-06-09T04:26:29.870 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17809 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/serio/serport.ko 2023-06-09T04:26:29.870 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/sparse-keymap.ko 2023-06-09T04:26:29.871 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/iommu/ 2023-06-09T04:26:29.871 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/iommu/amd/ 2023-06-09T04:26:29.871 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 38001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/iommu/amd/iommu_v2.ko 2023-06-09T04:26:29.871 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/ 2023-06-09T04:26:29.871 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-88pm860x.ko 2023-06-09T04:26:29.871 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-adp5520.ko 2023-06-09T04:26:29.871 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 59569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-bd2802.ko 2023-06-09T04:26:29.871 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24673 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-blinkm.ko 2023-06-09T04:26:29.872 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-da903x.ko 2023-06-09T04:26:29.872 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-da9052.ko 2023-06-09T04:26:29.872 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-gpio.ko 2023-06-09T04:26:29.872 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-lm3530.ko 2023-06-09T04:26:29.872 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 30385 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-lm3533.ko 2023-06-09T04:26:29.872 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19169 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-lm355x.ko 2023-06-09T04:26:29.872 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19841 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-lm3642.ko 2023-06-09T04:26:29.872 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-lp3944.ko 2023-06-09T04:26:29.873 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11129 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-lp8788.ko 2023-06-09T04:26:29.873 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-max8997.ko 2023-06-09T04:26:29.873 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12393 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-mc13783.ko 2023-06-09T04:26:29.873 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13025 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-menf21bmc.ko 2023-06-09T04:26:29.873 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-pca9532.ko 2023-06-09T04:26:29.873 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-pca955x.ko 2023-06-09T04:26:29.873 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-pca963x.ko 2023-06-09T04:26:29.874 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 33673 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-ss4200.ko 2023-06-09T04:26:29.874 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-tca6507.ko 2023-06-09T04:26:29.874 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-wm831x-status.ko 2023-06-09T04:26:29.874 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-wm8350.ko 2023-06-09T04:26:29.874 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/trigger/ 2023-06-09T04:26:29.874 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-06-09T04:26:29.874 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-06-09T04:26:29.874 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8593 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-06-09T04:26:29.875 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 7441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-06-09T04:26:29.875 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-06-09T04:26:29.875 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-06-09T04:26:29.875 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11705 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-06-09T04:26:29.875 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-06-09T04:26:29.875 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/ 2023-06-09T04:26:29.875 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/bcache/ 2023-06-09T04:26:29.876 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 631713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/bcache/bcache.ko 2023-06-09T04:26:29.876 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 37553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-bio-prison.ko 2023-06-09T04:26:29.876 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 86033 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-bufio.ko 2023-06-09T04:26:29.876 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 47353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-cache-smq.ko 2023-06-09T04:26:29.876 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 154097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-cache.ko 2023-06-09T04:26:29.876 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 105553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-crypt.ko 2023-06-09T04:26:29.876 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-delay.ko 2023-06-09T04:26:29.876 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 53697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-era.ko 2023-06-09T04:26:29.877 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-flakey.ko 2023-06-09T04:26:29.877 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 41425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-log-userspace.ko 2023-06-09T04:26:29.877 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 32041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-log.ko 2023-06-09T04:26:29.877 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 49377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-mirror.ko 2023-06-09T04:26:29.877 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 77505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-multipath.ko 2023-06-09T04:26:29.877 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-queue-length.ko 2023-06-09T04:26:29.877 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 70657 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-raid.ko 2023-06-09T04:26:29.878 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 33881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-region-hash.ko 2023-06-09T04:26:29.878 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-round-robin.ko 2023-06-09T04:26:29.878 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-service-time.ko 2023-06-09T04:26:29.878 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 108801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-snapshot.ko 2023-06-09T04:26:29.878 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-switch.ko 2023-06-09T04:26:29.878 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 182017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-thin-pool.ko 2023-06-09T04:26:29.878 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 51625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-verity.ko 2023-06-09T04:26:29.878 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-zero.ko 2023-06-09T04:26:29.879 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/faulty.ko 2023-06-09T04:26:29.879 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/linear.ko 2023-06-09T04:26:29.879 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 32121 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/multipath.ko 2023-06-09T04:26:29.879 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/persistent-data/ 2023-06-09T04:26:29.879 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 192737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-06-09T04:26:29.879 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 37025 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/raid0.ko 2023-06-09T04:26:29.879 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 111361 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/raid1.ko 2023-06-09T04:26:29.879 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 157873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/raid10.ko 2023-06-09T04:26:29.880 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 392777 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/raid456.ko 2023-06-09T04:26:29.880 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/message/ 2023-06-09T04:26:29.880 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/message/fusion/ 2023-06-09T04:26:29.880 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 174329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/message/fusion/mptbase.ko 2023-06-09T04:26:29.880 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 63273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/message/fusion/mptctl.ko 2023-06-09T04:26:29.880 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 44465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/message/fusion/mptfc.ko 2023-06-09T04:26:29.880 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 37049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/message/fusion/mptlan.ko 2023-06-09T04:26:29.881 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 123185 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/message/fusion/mptsas.ko 2023-06-09T04:26:29.881 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 76009 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/message/fusion/mptscsih.ko 2023-06-09T04:26:29.881 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 52905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/message/fusion/mptspi.ko 2023-06-09T04:26:29.881 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/ 2023-06-09T04:26:29.881 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17193 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/88pm800.ko 2023-06-09T04:26:29.881 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/88pm805.ko 2023-06-09T04:26:29.881 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/88pm80x.ko 2023-06-09T04:26:29.881 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/arizona-i2c.ko 2023-06-09T04:26:29.882 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 121721 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/arizona.ko 2023-06-09T04:26:29.882 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/bcm590xx.ko 2023-06-09T04:26:29.882 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/cros_ec_dev.ko 2023-06-09T04:26:29.882 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 34417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/dln2.ko 2023-06-09T04:26:29.882 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/janz-cmodio.ko 2023-06-09T04:26:29.882 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 52497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/kempld-core.ko 2023-06-09T04:26:29.882 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 27041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/lm3533-core.ko 2023-06-09T04:26:29.882 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-06-09T04:26:29.883 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/lp3943.ko 2023-06-09T04:26:29.883 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 54449 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/lpc_ich.ko 2023-06-09T04:26:29.883 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/lpc_sch.ko 2023-06-09T04:26:29.883 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/max8907.ko 2023-06-09T04:26:29.883 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 27865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/mc13xxx-core.ko 2023-06-09T04:26:29.883 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-06-09T04:26:29.883 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/menf21bmc.ko 2023-06-09T04:26:29.883 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/pcf50633-adc.ko 2023-06-09T04:26:29.884 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/pcf50633-gpio.ko 2023-06-09T04:26:29.884 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 33417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/pcf50633.ko 2023-06-09T04:26:29.884 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9937 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-06-09T04:26:29.884 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/retu-mfd.ko 2023-06-09T04:26:29.884 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 76433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/si476x-core.ko 2023-06-09T04:26:29.884 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 47649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/sm501.ko 2023-06-09T04:26:29.884 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19161 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-06-09T04:26:29.885 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 50505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/tps65010.ko 2023-06-09T04:26:29.885 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/tps6507x.ko 2023-06-09T04:26:29.885 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/viperboard.ko 2023-06-09T04:26:29.885 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/vx855.ko 2023-06-09T04:26:29.885 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/wl1273-core.ko 2023-06-09T04:26:29.885 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 43521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/wm8994.ko 2023-06-09T04:26:29.885 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/ 2023-06-09T04:26:29.885 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13721 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-06-09T04:26:29.886 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 48009 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/ad525x_dpot.ko 2023-06-09T04:26:29.886 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/altera-stapl/ 2023-06-09T04:26:29.886 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 46185 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-06-09T04:26:29.886 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/apds9802als.ko 2023-06-09T04:26:29.886 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 36625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/apds990x.ko 2023-06-09T04:26:29.886 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 45473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/bh1770glc.ko 2023-06-09T04:26:29.886 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/c2port/ 2023-06-09T04:26:29.886 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-06-09T04:26:29.887 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 34801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/c2port/core.ko 2023-06-09T04:26:29.887 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/cb710/ 2023-06-09T04:26:29.887 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/cb710/cb710.ko 2023-06-09T04:26:29.887 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/ds1682.ko 2023-06-09T04:26:29.887 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8777 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/dummy-irq.ko 2023-06-09T04:26:29.887 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/echo/ 2023-06-09T04:26:29.887 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/echo/echo.ko 2023-06-09T04:26:29.887 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/eeprom/ 2023-06-09T04:26:29.888 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 37521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/eeprom/at24.ko 2023-06-09T04:26:29.888 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/eeprom/eeprom.ko 2023-06-09T04:26:29.888 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-06-09T04:26:29.888 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/eeprom/max6875.ko 2023-06-09T04:26:29.888 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 31913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/enclosure.ko 2023-06-09T04:26:29.888 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/genwqe/ 2023-06-09T04:26:29.888 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 151953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-06-09T04:26:29.889 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/hmc6352.ko 2023-06-09T04:26:29.889 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 31009 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/hpilo.ko 2023-06-09T04:26:29.889 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/ibmasm/ 2023-06-09T04:26:29.889 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 72497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-06-09T04:26:29.889 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19673 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/ics932s401.ko 2023-06-09T04:26:29.889 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/isl29003.ko 2023-06-09T04:26:29.889 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/isl29020.ko 2023-06-09T04:26:29.889 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/lis3lv02d/ 2023-06-09T04:26:29.890 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 41465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-06-09T04:26:29.890 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-06-09T04:26:29.890 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/mei/ 2023-06-09T04:26:29.890 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 124401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/mei/mei-me.ko 2023-06-09T04:26:29.890 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 56337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/mei/mei-txe.ko 2023-06-09T04:26:29.890 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 304353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/mei/mei.ko 2023-06-09T04:26:29.890 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 31161 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/phantom.ko 2023-06-09T04:26:29.890 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/ti-st/ 2023-06-09T04:26:29.891 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 74433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/ti-st/st_drv.ko 2023-06-09T04:26:29.891 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24193 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/tifm_7xx1.ko 2023-06-09T04:26:29.891 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 27305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/tifm_core.ko 2023-06-09T04:26:29.891 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/tsl2550.ko 2023-06-09T04:26:29.891 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 48569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/vmw_balloon.ko 2023-06-09T04:26:29.891 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/vmw_vmci/ 2023-06-09T04:26:29.891 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 180697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-06-09T04:26:29.892 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ 2023-06-09T04:26:29.892 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/bonding/ 2023-06-09T04:26:29.892 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 487817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/bonding/bonding.ko 2023-06-09T04:26:29.892 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/dsa/ 2023-06-09T04:26:29.892 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/dsa/b53/ 2023-06-09T04:26:29.892 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 101961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/dsa/b53/b53_common.ko 2023-06-09T04:26:29.892 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 40097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/dsa/bcm-sf2.ko 2023-06-09T04:26:29.893 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/dsa/mv88e6060.ko 2023-06-09T04:26:29.893 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/dsa/mv88e6xxx/ 2023-06-09T04:26:29.893 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 447113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-06-09T04:26:29.893 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/dummy.ko 2023-06-09T04:26:29.893 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/eql.ko 2023-06-09T04:26:29.893 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/ 2023-06-09T04:26:29.893 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/3com/ 2023-06-09T04:26:29.893 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 45609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-06-09T04:26:29.894 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 41905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-06-09T04:26:29.894 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 130385 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-06-09T04:26:29.894 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 68681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-06-09T04:26:29.894 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/8390/ 2023-06-09T04:26:29.894 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 36345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/8390/8390.ko 2023-06-09T04:26:29.894 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 59513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-06-09T04:26:29.894 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 27017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-06-09T04:26:29.894 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 98945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-06-09T04:26:29.895 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/adaptec/ 2023-06-09T04:26:29.895 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 54353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-06-09T04:26:29.895 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/agere/ 2023-06-09T04:26:29.895 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 69033 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/agere/et131x.ko 2023-06-09T04:26:29.895 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/alteon/ 2023-06-09T04:26:29.895 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 59401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-06-09T04:26:29.895 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/altera/ 2023-06-09T04:26:29.895 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 40649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-06-09T04:26:29.896 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/amd/ 2023-06-09T04:26:29.896 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 54441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-06-09T04:26:29.896 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 49105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-06-09T04:26:29.896 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 87177 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-06-09T04:26:29.896 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/atheros/ 2023-06-09T04:26:29.896 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/atheros/alx/ 2023-06-09T04:26:29.896 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 97217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-06-09T04:26:29.897 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-06-09T04:26:29.897 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 104473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-06-09T04:26:29.940 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-06-09T04:26:29.941 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 90073 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-06-09T04:26:29.941 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/atheros/atlx/ 2023-06-09T04:26:29.941 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 81329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-06-09T04:26:29.941 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 69601 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-06-09T04:26:29.941 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/broadcom/ 2023-06-09T04:26:29.941 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 78233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-06-09T04:26:29.942 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 176705 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-06-09T04:26:29.942 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-06-09T04:26:29.942 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 1422001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-06-09T04:26:29.942 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 127881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-06-09T04:26:29.942 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/broadcom/genet/ 2023-06-09T04:26:29.942 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 130785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-06-09T04:26:29.942 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 311913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-06-09T04:26:29.942 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/brocade/ 2023-06-09T04:26:29.943 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/brocade/bna/ 2023-06-09T04:26:29.943 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 323489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-06-09T04:26:29.943 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/ 2023-06-09T04:26:29.943 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-06-09T04:26:29.943 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 193321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-06-09T04:26:29.943 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-06-09T04:26:29.943 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 345761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-06-09T04:26:29.943 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-06-09T04:26:29.944 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 1038865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-06-09T04:26:29.944 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-06-09T04:26:29.944 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 166001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-06-09T04:26:29.944 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-06-09T04:26:29.944 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 33681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-06-09T04:26:29.944 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/cisco/ 2023-06-09T04:26:29.944 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/cisco/enic/ 2023-06-09T04:26:29.944 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 203425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-06-09T04:26:29.945 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dec/ 2023-06-09T04:26:29.945 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dec/tulip/ 2023-06-09T04:26:29.945 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 69281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-06-09T04:26:29.945 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 61321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-06-09T04:26:29.945 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 141049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-06-09T04:26:29.945 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 51329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-06-09T04:26:29.946 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 62689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-06-09T04:26:29.946 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 31201 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-06-09T04:26:29.946 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dlink/ 2023-06-09T04:26:29.946 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 60697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-06-09T04:26:29.946 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 62721 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-06-09T04:26:29.946 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 45609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dnet.ko 2023-06-09T04:26:29.946 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/ec_bhf.ko 2023-06-09T04:26:29.946 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/emulex/ 2023-06-09T04:26:29.947 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/emulex/benet/ 2023-06-09T04:26:29.947 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 280865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-06-09T04:26:29.947 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 49321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/ethoc.ko 2023-06-09T04:26:29.947 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 51625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/fealnx.ko 2023-06-09T04:26:29.947 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/fujitsu/ 2023-06-09T04:26:29.947 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 45161 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-06-09T04:26:29.947 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/ 2023-06-09T04:26:29.947 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 90297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/e100.ko 2023-06-09T04:26:29.948 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/e1000/ 2023-06-09T04:26:29.948 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 295609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-06-09T04:26:29.948 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/e1000e/ 2023-06-09T04:26:29.948 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 583881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-06-09T04:26:29.948 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/fm10k/ 2023-06-09T04:26:29.948 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 246201 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-06-09T04:26:29.948 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/i40e/ 2023-06-09T04:26:29.949 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 922281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-06-09T04:26:29.949 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/iavf/ 2023-06-09T04:26:29.949 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 301665 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-06-09T04:26:29.949 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/igb/ 2023-06-09T04:26:29.949 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 514281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-06-09T04:26:29.949 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/igbvf/ 2023-06-09T04:26:29.949 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 93481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-06-09T04:26:29.949 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-06-09T04:26:29.950 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 733977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-06-09T04:26:29.950 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-06-09T04:26:29.950 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 151753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-06-09T04:26:29.950 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 86737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/jme.ko 2023-06-09T04:26:29.950 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/marvell/ 2023-06-09T04:26:29.950 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-06-09T04:26:29.950 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 102273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/marvell/skge.ko 2023-06-09T04:26:29.950 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 122577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-06-09T04:26:29.951 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/mellanox/ 2023-06-09T04:26:29.951 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-06-09T04:26:29.951 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 710297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-06-09T04:26:29.951 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 280409 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-06-09T04:26:29.951 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-06-09T04:26:29.951 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-06-09T04:26:29.951 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 1050633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-06-09T04:26:29.952 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/micrel/ 2023-06-09T04:26:29.952 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 52929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-06-09T04:26:29.952 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 40345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-06-09T04:26:29.952 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19449 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-06-09T04:26:29.952 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 95497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-06-09T04:26:29.952 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/myricom/ 2023-06-09T04:26:29.952 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-06-09T04:26:29.953 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 108641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-06-09T04:26:29.953 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/natsemi/ 2023-06-09T04:26:29.953 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 73273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-06-09T04:26:29.953 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 47601 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-06-09T04:26:29.953 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/neterion/ 2023-06-09T04:26:29.953 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 150737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-06-09T04:26:29.953 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/nvidia/ 2023-06-09T04:26:29.953 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 136609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-06-09T04:26:29.954 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/packetengines/ 2023-06-09T04:26:29.954 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 50305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-06-09T04:26:29.954 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 42977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-06-09T04:26:29.954 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/qlogic/ 2023-06-09T04:26:29.954 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-06-09T04:26:29.954 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 226993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-06-09T04:26:29.954 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 86913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-06-09T04:26:29.954 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-06-09T04:26:29.955 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 671281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-06-09T04:26:29.955 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/rdc/ 2023-06-09T04:26:29.955 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 42849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-06-09T04:26:29.955 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/realtek/ 2023-06-09T04:26:29.955 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 67209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-06-09T04:26:29.955 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 83809 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-06-09T04:26:29.955 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 29217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/realtek/atp.ko 2023-06-09T04:26:29.955 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 189649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-06-09T04:26:29.956 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/samsung/ 2023-06-09T04:26:29.956 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-06-09T04:26:29.956 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 104065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-06-09T04:26:29.956 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/sfc/ 2023-06-09T04:26:29.956 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 893521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-06-09T04:26:29.956 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/silan/ 2023-06-09T04:26:29.956 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 47057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-06-09T04:26:29.957 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/sis/ 2023-06-09T04:26:29.957 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 54633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/sis/sis190.ko 2023-06-09T04:26:29.957 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 63169 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/sis/sis900.ko 2023-06-09T04:26:29.957 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/smsc/ 2023-06-09T04:26:29.957 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 61433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-06-09T04:26:29.957 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 67009 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-06-09T04:26:29.957 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 73233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-06-09T04:26:29.957 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 68105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-06-09T04:26:29.958 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/stmicro/ 2023-06-09T04:26:29.958 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-06-09T04:26:29.958 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-06-09T04:26:29.958 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 39961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-06-09T04:26:29.958 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13777 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-06-09T04:26:29.958 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 480697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-06-09T04:26:29.958 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/sun/ 2023-06-09T04:26:29.958 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 103273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/sun/cassini.ko 2023-06-09T04:26:29.959 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 166001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/sun/niu.ko 2023-06-09T04:26:29.959 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 66361 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/sun/sungem.ko 2023-06-09T04:26:29.959 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 78633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-06-09T04:26:29.959 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/tehuti/ 2023-06-09T04:26:29.959 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 49873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-06-09T04:26:29.959 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/ti/ 2023-06-09T04:26:29.959 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 86353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/ti/tlan.ko 2023-06-09T04:26:29.959 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/via/ 2023-06-09T04:26:29.960 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 80153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-06-09T04:26:29.960 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 83497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-06-09T04:26:29.960 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/wiznet/ 2023-06-09T04:26:29.960 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 45609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-06-09T04:26:29.960 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 30665 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-06-09T04:26:29.960 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/xircom/ 2023-06-09T04:26:29.960 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 59929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-06-09T04:26:29.961 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/fddi/ 2023-06-09T04:26:29.961 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 40889 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/fddi/defxx.ko 2023-06-09T04:26:29.961 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/fddi/skfp/ 2023-06-09T04:26:29.961 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 216801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/fddi/skfp/skfp.ko 2023-06-09T04:26:29.961 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 76993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/geneve.ko 2023-06-09T04:26:29.961 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/hyperv/ 2023-06-09T04:26:29.961 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 234441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-06-09T04:26:29.961 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ieee802154/ 2023-06-09T04:26:29.962 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ieee802154/fakelb.ko 2023-06-09T04:26:29.962 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ifb.ko 2023-06-09T04:26:29.962 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ipvlan/ 2023-06-09T04:26:29.962 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 82865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ipvlan/ipvlan.ko 2023-06-09T04:26:29.962 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 61337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/macvlan.ko 2023-06-09T04:26:29.962 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/macvtap.ko 2023-06-09T04:26:29.962 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/mdio/ 2023-06-09T04:26:29.962 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-06-09T04:26:29.963 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-06-09T04:26:29.963 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/mdio/mdio-gpio.ko 2023-06-09T04:26:29.963 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/mdio.ko 2023-06-09T04:26:29.963 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/mii.ko 2023-06-09T04:26:29.963 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 41585 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/netconsole.ko 2023-06-09T04:26:29.963 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/nlmon.ko 2023-06-09T04:26:29.963 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/pcs/ 2023-06-09T04:26:29.963 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/pcs/pcs-altera-tse.ko 2023-06-09T04:26:29.964 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 29601 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-06-09T04:26:29.964 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/ 2023-06-09T04:26:29.964 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/amd.ko 2023-06-09T04:26:29.964 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 40329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-06-09T04:26:29.964 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 43161 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/bcm7xxx.ko 2023-06-09T04:26:29.964 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/bcm87xx.ko 2023-06-09T04:26:29.964 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 37921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/broadcom.ko 2023-06-09T04:26:29.964 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10457 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/cicada.ko 2023-06-09T04:26:29.965 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12793 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/davicom.ko 2023-06-09T04:26:29.965 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/et1011c.ko 2023-06-09T04:26:29.965 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/icplus.ko 2023-06-09T04:26:29.965 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/lxt.ko 2023-06-09T04:26:29.965 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 78001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/marvell.ko 2023-06-09T04:26:29.965 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 75689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/micrel.ko 2023-06-09T04:26:29.965 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/national.ko 2023-06-09T04:26:29.966 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 92049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/phylink.ko 2023-06-09T04:26:29.966 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9889 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/qsemi.ko 2023-06-09T04:26:29.966 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 47505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/realtek.ko 2023-06-09T04:26:29.966 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/smsc.ko 2023-06-09T04:26:29.966 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/ste10Xp.ko 2023-06-09T04:26:29.966 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/vitesse.ko 2023-06-09T04:26:29.966 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/plip/ 2023-06-09T04:26:29.967 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 43353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/plip/plip.ko 2023-06-09T04:26:29.967 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ppp/ 2023-06-09T04:26:29.967 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ppp/bsd_comp.ko 2023-06-09T04:26:29.967 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 29745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ppp/ppp_async.ko 2023-06-09T04:26:29.967 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ppp/ppp_deflate.ko 2023-06-09T04:26:29.967 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ppp/ppp_mppe.ko 2023-06-09T04:26:29.967 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ppp/ppp_synctty.ko 2023-06-09T04:26:29.967 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 42425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ppp/pppoe.ko 2023-06-09T04:26:29.968 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ppp/pppox.ko 2023-06-09T04:26:29.968 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 31657 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ppp/pptp.ko 2023-06-09T04:26:29.968 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/sb1000.ko 2023-06-09T04:26:29.968 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/slip/ 2023-06-09T04:26:29.968 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 42329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/slip/slip.ko 2023-06-09T04:26:29.968 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/sungem_phy.ko 2023-06-09T04:26:29.968 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 63785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/tap.ko 2023-06-09T04:26:29.968 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/team/ 2023-06-09T04:26:29.969 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 104617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/team/team.ko 2023-06-09T04:26:29.969 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/team/team_mode_activebackup.ko 2023-06-09T04:26:29.969 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/team/team_mode_broadcast.ko 2023-06-09T04:26:29.969 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-06-09T04:26:29.969 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9537 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/team/team_mode_random.ko 2023-06-09T04:26:29.969 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-06-09T04:26:29.969 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 89249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/veth.ko 2023-06-09T04:26:29.969 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/vmxnet3/ 2023-06-09T04:26:29.970 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 120377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-06-09T04:26:29.970 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/vxlan/ 2023-06-09T04:26:29.970 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 290049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/vxlan/vxlan.ko 2023-06-09T04:26:29.970 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/xen-netback/ 2023-06-09T04:26:29.970 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 143697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/xen-netback/xen-netback.ko 2023-06-09T04:26:29.970 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ntb/ 2023-06-09T04:26:29.970 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ntb/ntb.ko 2023-06-09T04:26:29.970 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/nvme/ 2023-06-09T04:26:29.971 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/nvme/host/ 2023-06-09T04:26:29.971 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 255881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/nvme/host/nvme-core.ko 2023-06-09T04:26:29.971 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 101449 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/nvme/host/nvme.ko 2023-06-09T04:26:29.971 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/parport/ 2023-06-09T04:26:29.971 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 129017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/parport/parport.ko 2023-06-09T04:26:29.971 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/parport/parport_cs.ko 2023-06-09T04:26:29.971 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 83833 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/parport/parport_pc.ko 2023-06-09T04:26:29.972 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/parport/parport_serial.ko 2023-06-09T04:26:29.972 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pci/ 2023-06-09T04:26:29.972 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pci/hotplug/ 2023-06-09T04:26:29.972 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-06-09T04:26:29.972 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-06-09T04:26:29.972 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-06-09T04:26:29.972 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pci/pci-stub.ko 2023-06-09T04:26:29.973 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 47265 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pci/xen-pcifront.ko 2023-06-09T04:26:29.973 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pcmcia/ 2023-06-09T04:26:29.973 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pcmcia/i82092.ko 2023-06-09T04:26:29.973 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 143593 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pcmcia/pcmcia.ko 2023-06-09T04:26:29.973 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 60529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pcmcia/pcmcia_core.ko 2023-06-09T04:26:29.973 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 33761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-06-09T04:26:29.973 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 34081 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pcmcia/pd6729.ko 2023-06-09T04:26:29.973 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 112801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pcmcia/yenta_socket.ko 2023-06-09T04:26:29.974 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/phy/ 2023-06-09T04:26:29.974 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/phy/broadcom/ 2023-06-09T04:26:29.974 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10673 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-06-09T04:26:29.974 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/phy/samsung/ 2023-06-09T04:26:29.974 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-06-09T04:26:29.974 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pinctrl/ 2023-06-09T04:26:29.974 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pinctrl/intel/ 2023-06-09T04:26:29.974 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 70889 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-06-09T04:26:29.975 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/ 2023-06-09T04:26:29.975 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/chrome/ 2023-06-09T04:26:29.975 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 49689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-06-09T04:26:29.975 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/chrome/cros_ec.ko 2023-06-09T04:26:29.975 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-06-09T04:26:29.975 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25241 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-06-09T04:26:29.975 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-06-09T04:26:29.976 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18089 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-06-09T04:26:29.976 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-06-09T04:26:29.976 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/ 2023-06-09T04:26:29.976 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 66913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/acer-wmi.ko 2023-06-09T04:26:29.976 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 39041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/acerhdf.ko 2023-06-09T04:26:29.976 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 36849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/apple-gmux.ko 2023-06-09T04:26:29.976 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 59545 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/asus-laptop.ko 2023-06-09T04:26:29.976 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 30529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-06-09T04:26:29.977 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 106217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/asus-wmi.ko 2023-06-09T04:26:29.977 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 36745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/classmate-laptop.ko 2023-06-09T04:26:29.977 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 48945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-06-09T04:26:29.977 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13841 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-06-09T04:26:29.977 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 40089 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-06-09T04:26:29.977 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-06-09T04:26:29.977 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 36473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/hdaps.ko 2023-06-09T04:26:29.978 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/ibm_rtl.ko 2023-06-09T04:26:29.978 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/intel/ 2023-06-09T04:26:29.978 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-06-09T04:26:29.978 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-06-09T04:26:29.978 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 43169 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/intel_ips.ko 2023-06-09T04:26:29.978 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20089 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/msi-wmi.ko 2023-06-09T04:26:29.978 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/mxm-wmi.ko 2023-06-09T04:26:29.979 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 34617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-06-09T04:26:29.979 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 42145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/samsung-laptop.ko 2023-06-09T04:26:29.979 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/samsung-q10.ko 2023-06-09T04:26:29.979 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/topstar-laptop.ko 2023-06-09T04:26:29.979 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13545 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-06-09T04:26:29.979 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/toshiba_haps.ko 2023-06-09T04:26:29.979 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/wmi-bmof.ko 2023-06-09T04:26:29.979 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 54713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/wmi.ko 2023-06-09T04:26:29.980 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/ 2023-06-09T04:26:29.980 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/ 2023-06-09T04:26:29.980 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 30161 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/88pm860x_battery.ko 2023-06-09T04:26:29.980 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 33873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/88pm860x_charger.ko 2023-06-09T04:26:29.980 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 54945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/bq2415x_charger.ko 2023-06-09T04:26:29.980 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 53849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/bq24190_charger.ko 2023-06-09T04:26:29.980 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21385 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/bq24735-charger.ko 2023-06-09T04:26:29.981 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-06-09T04:26:29.981 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/da9030_battery.ko 2023-06-09T04:26:29.981 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19665 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/da9052-battery.ko 2023-06-09T04:26:29.981 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 29169 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/ds2760_battery.ko 2023-06-09T04:26:29.981 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/ds2780_battery.ko 2023-06-09T04:26:29.981 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23241 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/ds2781_battery.ko 2023-06-09T04:26:29.981 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23537 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/ds2782_battery.ko 2023-06-09T04:26:29.981 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20177 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/gpio-charger.ko 2023-06-09T04:26:29.982 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17937 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/isp1704_charger.ko 2023-06-09T04:26:29.982 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/lp8727_charger.ko 2023-06-09T04:26:29.982 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/max14577_charger.ko 2023-06-09T04:26:29.982 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25777 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/max17040_battery.ko 2023-06-09T04:26:29.982 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 30353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/max17042_battery.ko 2023-06-09T04:26:29.982 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/max8903_charger.ko 2023-06-09T04:26:29.982 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/max8925_power.ko 2023-06-09T04:26:29.983 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/pcf50633-charger.ko 2023-06-09T04:26:29.983 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 37825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/sbs-battery.ko 2023-06-09T04:26:29.983 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/test_power.ko 2023-06-09T04:26:29.983 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/tps65090-charger.ko 2023-06-09T04:26:29.983 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/wm831x_backup.ko 2023-06-09T04:26:29.983 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/wm831x_power.ko 2023-06-09T04:26:29.983 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/wm8350_power.ko 2023-06-09T04:26:29.983 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/powercap/ 2023-06-09T04:26:29.984 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 54041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/powercap/intel_rapl_common.ko 2023-06-09T04:26:29.984 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17193 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/powercap/intel_rapl_msr.ko 2023-06-09T04:26:29.984 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pps/ 2023-06-09T04:26:29.984 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pps/clients/ 2023-06-09T04:26:29.984 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pps/clients/pps-gpio.ko 2023-06-09T04:26:29.984 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13081 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pps/clients/pps-ldisc.ko 2023-06-09T04:26:29.984 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pps/clients/pps_parport.ko 2023-06-09T04:26:29.985 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 41273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pps/pps_core.ko 2023-06-09T04:26:29.985 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ptp/ 2023-06-09T04:26:29.985 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 64505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ptp/ptp.ko 2023-06-09T04:26:29.985 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ptp/ptp_kvm.ko 2023-06-09T04:26:29.985 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/ 2023-06-09T04:26:29.985 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-88pm80x.ko 2023-06-09T04:26:29.985 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24409 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-88pm860x.ko 2023-06-09T04:26:29.985 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-bq32k.ko 2023-06-09T04:26:29.986 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-bq4802.ko 2023-06-09T04:26:29.986 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-da9052.ko 2023-06-09T04:26:29.986 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18393 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-da9055.ko 2023-06-09T04:26:29.986 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-da9063.ko 2023-06-09T04:26:29.986 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-ds1286.ko 2023-06-09T04:26:29.986 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 68401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-ds1307.ko 2023-06-09T04:26:29.986 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20705 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-ds1374.ko 2023-06-09T04:26:29.986 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-ds1511.ko 2023-06-09T04:26:29.987 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-ds1553.ko 2023-06-09T04:26:29.987 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13833 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-ds1672.ko 2023-06-09T04:26:29.987 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13265 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-ds1742.ko 2023-06-09T04:26:29.987 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17129 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-ds2404.ko 2023-06-09T04:26:29.987 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-ds3232.ko 2023-06-09T04:26:29.987 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-em3027.ko 2023-06-09T04:26:29.987 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-fm3130.ko 2023-06-09T04:26:29.987 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17593 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-isl12022.ko 2023-06-09T04:26:29.988 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 35089 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-isl1208.ko 2023-06-09T04:26:29.988 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-lp8788.ko 2023-06-09T04:26:29.988 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 37977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-m41t80.ko 2023-06-09T04:26:29.988 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-m48t35.ko 2023-06-09T04:26:29.988 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-m48t59.ko 2023-06-09T04:26:29.988 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-m48t86.ko 2023-06-09T04:26:29.988 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-max6900.ko 2023-06-09T04:26:29.989 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-max8907.ko 2023-06-09T04:26:29.989 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-max8925.ko 2023-06-09T04:26:29.989 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-max8997.ko 2023-06-09T04:26:29.989 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-max8998.ko 2023-06-09T04:26:29.989 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-06-09T04:26:29.989 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-msm6242.ko 2023-06-09T04:26:29.989 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-palmas.ko 2023-06-09T04:26:29.989 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 40009 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-pcf2127.ko 2023-06-09T04:26:29.990 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-pcf50633.ko 2023-06-09T04:26:29.990 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-pcf85063.ko 2023-06-09T04:26:29.990 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-pcf8523.ko 2023-06-09T04:26:29.990 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 29705 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-pcf8563.ko 2023-06-09T04:26:29.990 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-pcf8583.ko 2023-06-09T04:26:29.990 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-rc5t583.ko 2023-06-09T04:26:29.990 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-rp5c01.ko 2023-06-09T04:26:29.990 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 33633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-rs5c372.ko 2023-06-09T04:26:29.991 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 27649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-06-09T04:26:29.991 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-rx8025.ko 2023-06-09T04:26:29.991 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-rx8581.ko 2023-06-09T04:26:29.991 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-s35390a.ko 2023-06-09T04:26:29.991 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16657 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-06-09T04:26:29.991 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-tps6586x.ko 2023-06-09T04:26:29.991 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-tps65910.ko 2023-06-09T04:26:29.992 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-wm831x.ko 2023-06-09T04:26:29.992 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21169 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-wm8350.ko 2023-06-09T04:26:29.992 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 27761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-x1205.ko 2023-06-09T04:26:29.992 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/ 2023-06-09T04:26:29.992 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 77529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/3w-9xxx.ko 2023-06-09T04:26:29.992 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 57489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/3w-sas.ko 2023-06-09T04:26:29.992 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 55001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/3w-xxxx.ko 2023-06-09T04:26:29.993 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 134993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/BusLogic.ko 2023-06-09T04:26:29.993 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/a100u2w.ko 2023-06-09T04:26:29.993 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/aacraid/ 2023-06-09T04:26:29.993 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 271033 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/aacraid/aacraid.ko 2023-06-09T04:26:29.993 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 100513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/advansys.ko 2023-06-09T04:26:29.993 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/aic7xxx/ 2023-06-09T04:26:29.993 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 356081 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-06-09T04:26:29.993 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 295697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-06-09T04:26:29.994 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/aic94xx/ 2023-06-09T04:26:29.994 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 189145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-06-09T04:26:29.994 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23889 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/am53c974.ko 2023-06-09T04:26:29.994 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/arcmsr/ 2023-06-09T04:26:29.994 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 106465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-06-09T04:26:29.994 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 38065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/atp870u.ko 2023-06-09T04:26:29.994 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/be2iscsi/ 2023-06-09T04:26:29.994 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 246785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-06-09T04:26:29.995 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/bfa/ 2023-06-09T04:26:29.995 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 1172073 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/bfa/bfa.ko 2023-06-09T04:26:29.995 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/bnx2fc/ 2023-06-09T04:26:29.995 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 237057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-06-09T04:26:29.995 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/bnx2i/ 2023-06-09T04:26:29.995 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 115289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-06-09T04:26:29.995 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 40433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/ch.ko 2023-06-09T04:26:29.995 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/csiostor/ 2023-06-09T04:26:29.996 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 308721 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/csiostor/csiostor.ko 2023-06-09T04:26:29.996 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/cxgbi/ 2023-06-09T04:26:29.996 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-06-09T04:26:29.996 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 76017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-06-09T04:26:29.996 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-06-09T04:26:29.996 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 101337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-06-09T04:26:29.996 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 141697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-06-09T04:26:29.997 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 75425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/dc395x.ko 2023-06-09T04:26:29.997 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 37937 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/dmx3191d.ko 2023-06-09T04:26:29.997 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/esas2r/ 2023-06-09T04:26:29.997 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 212297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/esas2r/esas2r.ko 2023-06-09T04:26:29.997 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 59825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/esp_scsi.ko 2023-06-09T04:26:29.997 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/fcoe/ 2023-06-09T04:26:29.997 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 78105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/fcoe/fcoe.ko 2023-06-09T04:26:29.998 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 154921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-06-09T04:26:29.998 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/fdomain.ko 2023-06-09T04:26:29.998 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/fnic/ 2023-06-09T04:26:29.998 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 261961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/fnic/fnic.ko 2023-06-09T04:26:29.998 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 201689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/hpsa.ko 2023-06-09T04:26:29.998 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 51041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/hptiop.ko 2023-06-09T04:26:29.998 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 49041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/hv_storvsc.ko 2023-06-09T04:26:29.998 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 35201 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/imm.ko 2023-06-09T04:26:29.999 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 43953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/initio.ko 2023-06-09T04:26:29.999 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 266409 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/ipr.ko 2023-06-09T04:26:29.999 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 101769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/ips.ko 2023-06-09T04:26:29.999 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/isci/ 2023-06-09T04:26:29.999 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 317137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/isci/isci.ko 2023-06-09T04:26:29.999 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-06-09T04:26:29.999 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 52529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/iscsi_tcp.ko 2023-06-09T04:26:29.999 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/libfc/ 2023-06-09T04:26:30.000 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 308257 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/libfc/libfc.ko 2023-06-09T04:26:30.000 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 140057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/libiscsi.ko 2023-06-09T04:26:30.000 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 51529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/libiscsi_tcp.ko 2023-06-09T04:26:30.000 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/libsas/ 2023-06-09T04:26:30.000 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 212865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/libsas/libsas.ko 2023-06-09T04:26:30.000 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/lpfc/ 2023-06-09T04:26:30.000 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 2193673 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/lpfc/lpfc.ko 2023-06-09T04:26:30.000 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/megaraid/ 2023-06-09T04:26:30.001 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 73433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-06-09T04:26:30.001 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 32913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-06-09T04:26:30.001 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 310561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-06-09T04:26:30.001 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 84585 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/megaraid.ko 2023-06-09T04:26:30.001 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/mpt3sas/ 2023-06-09T04:26:30.001 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 659401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-06-09T04:26:30.001 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/mvsas/ 2023-06-09T04:26:30.002 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 119745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/mvsas/mvsas.ko 2023-06-09T04:26:30.002 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 77985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/mvumi.ko 2023-06-09T04:26:30.002 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/pcmcia/ 2023-06-09T04:26:30.002 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 81433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-06-09T04:26:30.002 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11601 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-06-09T04:26:30.002 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-06-09T04:26:30.002 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-06-09T04:26:30.003 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/pm8001/ 2023-06-09T04:26:30.003 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 361249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-06-09T04:26:30.003 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 123377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/pmcraid.ko 2023-06-09T04:26:30.003 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 33497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/ppa.ko 2023-06-09T04:26:30.003 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 55161 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/qla1280.ko 2023-06-09T04:26:30.003 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/qla2xxx/ 2023-06-09T04:26:30.003 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 1850585 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-06-09T04:26:30.003 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 85145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-06-09T04:26:30.004 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/qla4xxx/ 2023-06-09T04:26:30.004 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 558681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-06-09T04:26:30.004 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/qlogicfas408.ko 2023-06-09T04:26:30.004 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18393 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/raid_class.ko 2023-06-09T04:26:30.004 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 238633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/scsi_debug.ko 2023-06-09T04:26:30.004 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 171753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/scsi_transport_fc.ko 2023-06-09T04:26:30.004 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 269985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-06-09T04:26:30.004 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 94177 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/scsi_transport_sas.ko 2023-06-09T04:26:30.005 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 72577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/scsi_transport_spi.ko 2023-06-09T04:26:30.005 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 43425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/scsi_transport_srp.ko 2023-06-09T04:26:30.005 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/ses.ko 2023-06-09T04:26:30.005 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 115665 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/st.ko 2023-06-09T04:26:30.005 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 46649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/stex.ko 2023-06-09T04:26:30.005 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/sym53c8xx_2/ 2023-06-09T04:26:30.005 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 161953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-06-09T04:26:30.005 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 42249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/virtio_scsi.ko 2023-06-09T04:26:30.006 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 50193 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/vmw_pvscsi.ko 2023-06-09T04:26:30.006 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 39833 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/wd719x.ko 2023-06-09T04:26:30.006 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 49921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/xen-scsifront.ko 2023-06-09T04:26:30.006 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ssb/ 2023-06-09T04:26:30.006 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 126913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ssb/ssb.ko 2023-06-09T04:26:30.006 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/ 2023-06-09T04:26:30.006 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/iscsi/ 2023-06-09T04:26:30.006 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 731481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-06-09T04:26:30.007 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/loopback/ 2023-06-09T04:26:30.007 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 49801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/loopback/tcm_loop.ko 2023-06-09T04:26:30.007 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 39465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/target_core_file.ko 2023-06-09T04:26:30.007 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 38281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/target_core_iblock.ko 2023-06-09T04:26:30.007 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 920681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/target_core_mod.ko 2023-06-09T04:26:30.007 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 44153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/target_core_pscsi.ko 2023-06-09T04:26:30.007 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 122425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/target_core_user.ko 2023-06-09T04:26:30.008 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/tcm_fc/ 2023-06-09T04:26:30.008 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 75537 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-06-09T04:26:30.008 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/ 2023-06-09T04:26:30.008 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/ 2023-06-09T04:26:30.008 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/ 2023-06-09T04:26:30.008 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-06-09T04:26:30.008 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-06-09T04:26:30.008 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9841 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-06-09T04:26:30.009 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10081 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-06-09T04:26:30.009 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-06-09T04:26:30.009 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-06-09T04:26:30.009 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-06-09T04:26:30.009 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-06-09T04:26:30.009 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-06-09T04:26:30.009 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-06-09T04:26:30.009 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-06-09T04:26:30.010 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 36561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-06-09T04:26:30.010 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 30625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-06-09T04:26:30.010 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-06-09T04:26:30.010 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-06-09T04:26:30.010 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-06-09T04:26:30.010 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/ 2023-06-09T04:26:30.010 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/ipwireless/ 2023-06-09T04:26:30.011 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 77969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-06-09T04:26:30.011 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 57697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/moxa.ko 2023-06-09T04:26:30.011 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 50617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/mxser.ko 2023-06-09T04:26:30.011 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 107377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/n_gsm.ko 2023-06-09T04:26:30.011 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 31833 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/n_hdlc.ko 2023-06-09T04:26:30.011 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 67961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/nozomi.ko 2023-06-09T04:26:30.011 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/ 2023-06-09T04:26:30.011 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/8250/ 2023-06-09T04:26:30.012 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 35561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-06-09T04:26:30.012 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 59385 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-06-09T04:26:30.012 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-06-09T04:26:30.012 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/altera_uart.ko 2023-06-09T04:26:30.012 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/arc_uart.ko 2023-06-09T04:26:30.012 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 70177 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-06-09T04:26:30.012 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/jsm/ 2023-06-09T04:26:30.013 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 102841 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/jsm/jsm.ko 2023-06-09T04:26:30.013 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28673 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/rp2.ko 2023-06-09T04:26:30.013 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 52025 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/sc16is7xx.ko 2023-06-09T04:26:30.013 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 100001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/synclink_gt.ko 2023-06-09T04:26:30.013 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ufs/ 2023-06-09T04:26:30.013 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ufs/core/ 2023-06-09T04:26:30.013 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 519233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ufs/core/ufshcd-core.ko 2023-06-09T04:26:30.013 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ufs/host/ 2023-06-09T04:26:30.014 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-06-09T04:26:30.014 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-06-09T04:26:30.014 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/uio/ 2023-06-09T04:26:30.014 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 43857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/uio/uio.ko 2023-06-09T04:26:30.014 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12129 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/uio/uio_aec.ko 2023-06-09T04:26:30.014 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/uio/uio_cif.ko 2023-06-09T04:26:30.014 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/uio/uio_dmem_genirq.ko 2023-06-09T04:26:30.014 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/uio/uio_mf624.ko 2023-06-09T04:26:30.015 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/uio/uio_netx.ko 2023-06-09T04:26:30.015 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/uio/uio_pci_generic.ko 2023-06-09T04:26:30.015 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-06-09T04:26:30.015 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/uio/uio_sercos3.ko 2023-06-09T04:26:30.015 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/ 2023-06-09T04:26:30.015 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/c67x00/ 2023-06-09T04:26:30.015 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 73097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/c67x00/c67x00.ko 2023-06-09T04:26:30.015 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/chipidea/ 2023-06-09T04:26:30.016 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 142417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-06-09T04:26:30.016 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18385 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-06-09T04:26:30.016 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-06-09T04:26:30.016 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12833 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-06-09T04:26:30.016 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/class/ 2023-06-09T04:26:30.016 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 85345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/class/cdc-acm.ko 2023-06-09T04:26:30.016 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 51001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/class/cdc-wdm.ko 2023-06-09T04:26:30.017 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 47353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/class/usblp.ko 2023-06-09T04:26:30.017 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 89729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/class/usbtmc.ko 2023-06-09T04:26:30.017 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/common/ 2023-06-09T04:26:30.017 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/common/ulpi.ko 2023-06-09T04:26:30.017 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/dwc2/ 2023-06-09T04:26:30.017 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11705 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-06-09T04:26:30.017 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/dwc3/ 2023-06-09T04:26:30.018 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-06-09T04:26:30.018 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 29753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-06-09T04:26:30.018 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 438457 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/dwc3/dwc3.ko 2023-06-09T04:26:30.018 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/ 2023-06-09T04:26:30.018 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/ 2023-06-09T04:26:30.018 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 57753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/u_ether.ko 2023-06-09T04:26:30.018 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 50193 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/u_serial.ko 2023-06-09T04:26:30.018 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-06-09T04:26:30.019 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 42473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-06-09T04:26:30.019 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 27977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-06-09T04:26:30.019 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 36465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-06-09T04:26:30.019 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 91705 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-06-09T04:26:30.019 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 50865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-06-09T04:26:30.019 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 117913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-06-09T04:26:30.019 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 57753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-06-09T04:26:30.020 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-06-09T04:26:30.020 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 31153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-06-09T04:26:30.020 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 57761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-06-09T04:26:30.020 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 84017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-06-09T04:26:30.020 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-06-09T04:26:30.020 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 58321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-06-09T04:26:30.020 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 67169 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-06-09T04:26:30.020 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/ 2023-06-09T04:26:30.021 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21081 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-06-09T04:26:30.021 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-06-09T04:26:30.021 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18361 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-06-09T04:26:30.021 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-06-09T04:26:30.021 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-06-09T04:26:30.021 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-06-09T04:26:30.021 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-06-09T04:26:30.022 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-06-09T04:26:30.022 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 31961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-06-09T04:26:30.022 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-06-09T04:26:30.022 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-06-09T04:26:30.022 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 27017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-06-09T04:26:30.022 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 61985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-06-09T04:26:30.022 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15033 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-06-09T04:26:30.022 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 156905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/libcomposite.ko 2023-06-09T04:26:30.023 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/ 2023-06-09T04:26:30.023 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-06-09T04:26:30.023 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/bdc/ 2023-06-09T04:26:30.023 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 157545 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-06-09T04:26:30.023 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 35953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-06-09T04:26:30.023 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 52825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-06-09T04:26:30.023 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 69577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-06-09T04:26:30.024 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 55833 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-06-09T04:26:30.024 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 75865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/net2272.ko 2023-06-09T04:26:30.024 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 74913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/net2280.ko 2023-06-09T04:26:30.024 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 73041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-06-09T04:26:30.024 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 65681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-06-09T04:26:30.024 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 65969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-06-09T04:26:30.024 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 80233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-06-09T04:26:30.024 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 145081 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-06-09T04:26:30.025 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/host/ 2023-06-09T04:26:30.025 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/host/bcma-hcd.ko 2023-06-09T04:26:30.025 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 79913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/host/isp116x-hcd.ko 2023-06-09T04:26:30.025 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 87505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-06-09T04:26:30.025 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 78745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-06-09T04:26:30.025 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 50969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/host/sl811-hcd.ko 2023-06-09T04:26:30.025 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/host/sl811_cs.ko 2023-06-09T04:26:30.025 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/host/ssb-hcd.ko 2023-06-09T04:26:30.026 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-06-09T04:26:30.026 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/image/ 2023-06-09T04:26:30.026 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 34417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/image/mdc800.ko 2023-06-09T04:26:30.026 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/image/microtek.ko 2023-06-09T04:26:30.026 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/ 2023-06-09T04:26:30.026 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 41665 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/adutux.ko 2023-06-09T04:26:30.026 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20601 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/appledisplay.ko 2023-06-09T04:26:30.026 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-06-09T04:26:30.027 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/cytherm.ko 2023-06-09T04:26:30.027 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/ehset.ko 2023-06-09T04:26:30.027 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/emi26.ko 2023-06-09T04:26:30.027 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/emi62.ko 2023-06-09T04:26:30.027 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/ezusb.ko 2023-06-09T04:26:30.027 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/idmouse.ko 2023-06-09T04:26:30.027 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 36441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/iowarrior.ko 2023-06-09T04:26:30.027 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/isight_firmware.ko 2023-06-09T04:26:30.028 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 36409 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/ldusb.ko 2023-06-09T04:26:30.028 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 36153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/legousbtower.ko 2023-06-09T04:26:30.028 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 27673 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/lvstest.ko 2023-06-09T04:26:30.028 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/sisusbvga/ 2023-06-09T04:26:30.028 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 64665 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-06-09T04:26:30.028 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/trancevibrator.ko 2023-06-09T04:26:30.028 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/usb3503.ko 2023-06-09T04:26:30.029 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/usblcd.ko 2023-06-09T04:26:30.029 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/usbsevseg.ko 2023-06-09T04:26:30.029 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 70697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/usbtest.ko 2023-06-09T04:26:30.029 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 41777 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/uss720.ko 2023-06-09T04:26:30.029 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 27513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/yurex.ko 2023-06-09T04:26:30.029 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/mon/ 2023-06-09T04:26:30.029 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 72801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/mon/usbmon.ko 2023-06-09T04:26:30.029 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/musb/ 2023-06-09T04:26:30.030 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 294937 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/musb/musb_hdrc.ko 2023-06-09T04:26:30.030 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/phy/ 2023-06-09T04:26:30.030 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/phy/phy-generic.ko 2023-06-09T04:26:30.030 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-06-09T04:26:30.030 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/phy/phy-isp1301.ko 2023-06-09T04:26:30.030 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/phy/phy-tahvo.ko 2023-06-09T04:26:30.030 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/ 2023-06-09T04:26:30.031 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/aircable.ko 2023-06-09T04:26:30.031 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 33249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/ark3116.ko 2023-06-09T04:26:30.031 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/belkin_sa.ko 2023-06-09T04:26:30.031 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 38081 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/ch341.ko 2023-06-09T04:26:30.031 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 69985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/cp210x.ko 2023-06-09T04:26:30.031 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 31057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/cyberjack.ko 2023-06-09T04:26:30.031 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 57817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/cypress_m8.ko 2023-06-09T04:26:30.031 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 49577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/digi_acceleport.ko 2023-06-09T04:26:30.032 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/empeg.ko 2023-06-09T04:26:30.032 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 43777 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/f81232.ko 2023-06-09T04:26:30.032 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 174729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/ftdi_sio.ko 2023-06-09T04:26:30.032 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 52593 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/garmin_gps.ko 2023-06-09T04:26:30.032 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 136761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/io_edgeport.ko 2023-06-09T04:26:30.032 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 124345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/io_ti.ko 2023-06-09T04:26:30.032 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 67649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/ipaq.ko 2023-06-09T04:26:30.032 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/ipw.ko 2023-06-09T04:26:30.033 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/ir-usb.ko 2023-06-09T04:26:30.033 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 57825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-06-09T04:26:30.033 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 107305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/keyspan.ko 2023-06-09T04:26:30.033 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 35153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/keyspan_pda.ko 2023-06-09T04:26:30.033 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/kl5kusb105.ko 2023-06-09T04:26:30.033 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 33345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/kobil_sct.ko 2023-06-09T04:26:30.033 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 32873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/mct_u232.ko 2023-06-09T04:26:30.034 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/metro-usb.ko 2023-06-09T04:26:30.034 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 66121 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/mos7720.ko 2023-06-09T04:26:30.034 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 77993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/mos7840.ko 2023-06-09T04:26:30.034 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 55889 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/mxuport.ko 2023-06-09T04:26:30.034 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13657 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/navman.ko 2023-06-09T04:26:30.034 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/omninet.ko 2023-06-09T04:26:30.034 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/opticon.ko 2023-06-09T04:26:30.034 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 187713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/option.ko 2023-06-09T04:26:30.035 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 38729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/oti6858.ko 2023-06-09T04:26:30.035 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 53953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/pl2303.ko 2023-06-09T04:26:30.035 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/qcaux.ko 2023-06-09T04:26:30.035 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 37713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/qcserial.ko 2023-06-09T04:26:30.035 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 34313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/quatech2.ko 2023-06-09T04:26:30.035 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/safe_serial.ko 2023-06-09T04:26:30.035 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 51185 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/sierra.ko 2023-06-09T04:26:30.035 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/spcp8x5.ko 2023-06-09T04:26:30.036 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 29737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/ssu100.ko 2023-06-09T04:26:30.036 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/symbolserial.ko 2023-06-09T04:26:30.036 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 60833 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-06-09T04:26:30.036 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-06-09T04:26:30.036 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/usb_debug.ko 2023-06-09T04:26:30.036 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 31881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/usb_wwan.ko 2023-06-09T04:26:30.036 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 122737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/usbserial.ko 2023-06-09T04:26:30.037 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/visor.ko 2023-06-09T04:26:30.037 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 37289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/whiteheat.ko 2023-06-09T04:26:30.037 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/wishbone-serial.ko 2023-06-09T04:26:30.037 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9177 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/xsens_mt.ko 2023-06-09T04:26:30.037 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ 2023-06-09T04:26:30.037 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 52737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/uas.ko 2023-06-09T04:26:30.037 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-alauda.ko 2023-06-09T04:26:30.037 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-cypress.ko 2023-06-09T04:26:30.038 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-datafab.ko 2023-06-09T04:26:30.038 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 33377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-06-09T04:26:30.038 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-freecom.ko 2023-06-09T04:26:30.038 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19665 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-isd200.ko 2023-06-09T04:26:30.038 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19193 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-06-09T04:26:30.038 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13537 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-karma.ko 2023-06-09T04:26:30.038 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-onetouch.ko 2023-06-09T04:26:30.038 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-realtek.ko 2023-06-09T04:26:30.039 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28793 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-sddr09.ko 2023-06-09T04:26:30.039 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-sddr55.ko 2023-06-09T04:26:30.039 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 35233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-usbat.ko 2023-06-09T04:26:30.039 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 176713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/usb-storage.ko 2023-06-09T04:26:30.039 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/usbip/ 2023-06-09T04:26:30.039 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 65585 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/usbip/usbip-core.ko 2023-06-09T04:26:30.039 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 71329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/usbip/usbip-host.ko 2023-06-09T04:26:30.039 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 105225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-06-09T04:26:30.040 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vfio/ 2023-06-09T04:26:30.040 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vfio/pci/ 2023-06-09T04:26:30.040 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 145697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-06-09T04:26:30.040 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 29425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vfio/pci/vfio-pci.ko 2023-06-09T04:26:30.040 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 97857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vfio/vfio.ko 2023-06-09T04:26:30.040 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 72113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-06-09T04:26:30.040 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vhost/ 2023-06-09T04:26:30.041 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 96865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vhost/vhost.ko 2023-06-09T04:26:30.041 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vhost/vhost_iotlb.ko 2023-06-09T04:26:30.041 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 57985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vhost/vhost_net.ko 2023-06-09T04:26:30.041 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 85697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vhost/vhost_scsi.ko 2023-06-09T04:26:30.041 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/ 2023-06-09T04:26:30.041 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/ 2023-06-09T04:26:30.041 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-06-09T04:26:30.041 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/aat2870_bl.ko 2023-06-09T04:26:30.042 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23201 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/adp5520_bl.ko 2023-06-09T04:26:30.042 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 32433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/adp8860_bl.ko 2023-06-09T04:26:30.042 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 39873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/adp8870_bl.ko 2023-06-09T04:26:30.042 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16809 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/apple_bl.ko 2023-06-09T04:26:30.042 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16601 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/as3711_bl.ko 2023-06-09T04:26:30.042 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/bd6107.ko 2023-06-09T04:26:30.042 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/da903x_bl.ko 2023-06-09T04:26:30.042 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/da9052_bl.ko 2023-06-09T04:26:30.043 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/gpio_backlight.ko 2023-06-09T04:26:30.043 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14657 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/kb3886_bl.ko 2023-06-09T04:26:30.043 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/lcd.ko 2023-06-09T04:26:30.043 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/lm3533_bl.ko 2023-06-09T04:26:30.043 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/lm3639_bl.ko 2023-06-09T04:26:30.043 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/lv5207lp.ko 2023-06-09T04:26:30.043 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/max8925_bl.ko 2023-06-09T04:26:30.044 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/pandora_bl.ko 2023-06-09T04:26:30.044 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-06-09T04:26:30.044 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10793 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/platform_lcd.ko 2023-06-09T04:26:30.044 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/wm831x_bl.ko 2023-06-09T04:26:30.044 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/ 2023-06-09T04:26:30.045 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/masters/ 2023-06-09T04:26:30.045 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18673 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/masters/ds2482.ko 2023-06-09T04:26:30.045 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 38857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/masters/ds2490.ko 2023-06-09T04:26:30.045 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/masters/matrox_w1.ko 2023-06-09T04:26:30.045 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12241 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/masters/w1-gpio.ko 2023-06-09T04:26:30.045 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/ 2023-06-09T04:26:30.045 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-06-09T04:26:30.045 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-06-09T04:26:30.046 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-06-09T04:26:30.046 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-06-09T04:26:30.046 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14033 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-06-09T04:26:30.046 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-06-09T04:26:30.046 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-06-09T04:26:30.046 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-06-09T04:26:30.047 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-06-09T04:26:30.047 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 7209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_smem.ko 2023-06-09T04:26:30.047 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 56313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_therm.ko 2023-06-09T04:26:30.047 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 101401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/wire.ko 2023-06-09T04:26:30.047 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/ 2023-06-09T04:26:30.047 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/acquirewdt.ko 2023-06-09T04:26:30.047 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19809 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/advantechwdt.ko 2023-06-09T04:26:30.047 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18449 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/alim1535_wdt.ko 2023-06-09T04:26:30.048 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/alim7101_wdt.ko 2023-06-09T04:26:30.048 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/cpu5wdt.ko 2023-06-09T04:26:30.048 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/da9052_wdt.ko 2023-06-09T04:26:30.048 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12665 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/da9055_wdt.ko 2023-06-09T04:26:30.048 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/da9063_wdt.ko 2023-06-09T04:26:30.048 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/dw_wdt.ko 2023-06-09T04:26:30.048 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/eurotechwdt.ko 2023-06-09T04:26:30.049 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/f71808e_wdt.ko 2023-06-09T04:26:30.049 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 27289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/hpwdt.ko 2023-06-09T04:26:30.049 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15393 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/i6300esb.ko 2023-06-09T04:26:30.049 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-06-09T04:26:30.049 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/iTCO_wdt.ko 2023-06-09T04:26:30.049 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/ib700wdt.ko 2023-06-09T04:26:30.049 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/ibmasr.ko 2023-06-09T04:26:30.049 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19601 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-06-09T04:26:30.050 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/it8712f_wdt.ko 2023-06-09T04:26:30.050 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/it87_wdt.ko 2023-06-09T04:26:30.050 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/kempld_wdt.ko 2023-06-09T04:26:30.050 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/machzwd.ko 2023-06-09T04:26:30.050 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14601 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/mena21_wdt.ko 2023-06-09T04:26:30.050 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-06-09T04:26:30.050 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/nv_tco.ko 2023-06-09T04:26:30.050 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-06-09T04:26:30.051 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22161 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/pc87413_wdt.ko 2023-06-09T04:26:30.051 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 38489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/pcwd_pci.ko 2023-06-09T04:26:30.051 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 31705 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/pcwd_usb.ko 2023-06-09T04:26:30.051 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/retu_wdt.ko 2023-06-09T04:26:30.051 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-06-09T04:26:30.051 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-06-09T04:26:30.051 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-06-09T04:26:30.051 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/sc1200wdt.ko 2023-06-09T04:26:30.052 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/sch311x_wdt.ko 2023-06-09T04:26:30.052 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21457 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-06-09T04:26:30.052 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/softdog.ko 2023-06-09T04:26:30.052 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/sp5100_tco.ko 2023-06-09T04:26:30.052 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/twl4030_wdt.ko 2023-06-09T04:26:30.052 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/via_wdt.ko 2023-06-09T04:26:30.052 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-06-09T04:26:30.053 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/w83877f_wdt.ko 2023-06-09T04:26:30.053 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/w83977f_wdt.ko 2023-06-09T04:26:30.053 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/wafer5823wdt.ko 2023-06-09T04:26:30.053 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 27905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/wdt_pci.ko 2023-06-09T04:26:30.053 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16073 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/wm831x_wdt.ko 2023-06-09T04:26:30.053 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13673 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/wm8350_wdt.ko 2023-06-09T04:26:30.053 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/xen_wdt.ko 2023-06-09T04:26:30.053 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/xen/ 2023-06-09T04:26:30.054 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/xen/xen-evtchn.ko 2023-06-09T04:26:30.054 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/xen/xen-gntalloc.ko 2023-06-09T04:26:30.054 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 47737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/xen/xen-gntdev.ko 2023-06-09T04:26:30.054 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/xen/xen-pciback/ 2023-06-09T04:26:30.054 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 176241 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-06-09T04:26:30.054 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 39617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/xen/xen-privcmd.ko 2023-06-09T04:26:30.054 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 71137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/xen/xen-scsiback.ko 2023-06-09T04:26:30.055 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/xen/xenfs/ 2023-06-09T04:26:30.055 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/xen/xenfs/xenfs.ko 2023-06-09T04:26:30.055 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ 2023-06-09T04:26:30.055 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/9p/ 2023-06-09T04:26:30.055 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 165401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/9p/9p.ko 2023-06-09T04:26:30.055 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/adfs/ 2023-06-09T04:26:30.055 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 60769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/adfs/adfs.ko 2023-06-09T04:26:30.055 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/affs/ 2023-06-09T04:26:30.056 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 162449 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/affs/affs.ko 2023-06-09T04:26:30.056 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/afs/ 2023-06-09T04:26:30.056 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 924617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/afs/kafs.ko 2023-06-09T04:26:30.056 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/autofs/ 2023-06-09T04:26:30.056 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 100641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/autofs/autofs4.ko 2023-06-09T04:26:30.056 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/befs/ 2023-06-09T04:26:30.056 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 64297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/befs/befs.ko 2023-06-09T04:26:30.056 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/bfs/ 2023-06-09T04:26:30.057 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 40905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/bfs/bfs.ko 2023-06-09T04:26:30.057 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 34401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/binfmt_misc.ko 2023-06-09T04:26:30.057 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/btrfs/ 2023-06-09T04:26:30.057 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 3445465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/btrfs/btrfs.ko 2023-06-09T04:26:30.057 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/cachefiles/ 2023-06-09T04:26:30.057 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 299849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/cachefiles/cachefiles.ko 2023-06-09T04:26:30.057 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ceph/ 2023-06-09T04:26:30.057 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 1230257 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ceph/ceph.ko 2023-06-09T04:26:30.058 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/cifs/ 2023-06-09T04:26:30.058 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 2619753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/cifs/cifs.ko 2023-06-09T04:26:30.058 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/coda/ 2023-06-09T04:26:30.058 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 99217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/coda/coda.ko 2023-06-09T04:26:30.058 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/configfs/ 2023-06-09T04:26:30.058 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 105857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/configfs/configfs.ko 2023-06-09T04:26:30.058 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/cramfs/ 2023-06-09T04:26:30.059 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 29161 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/cramfs/cramfs.ko 2023-06-09T04:26:30.059 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/dlm/ 2023-06-09T04:26:30.059 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 631321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/dlm/dlm.ko 2023-06-09T04:26:30.059 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/efs/ 2023-06-09T04:26:30.059 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 36465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/efs/efs.ko 2023-06-09T04:26:30.059 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/f2fs/ 2023-06-09T04:26:30.059 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 1472873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/f2fs/f2fs.ko 2023-06-09T04:26:30.059 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/fat/ 2023-06-09T04:26:30.060 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 27681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/fat/msdos.ko 2023-06-09T04:26:30.060 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/freevxfs/ 2023-06-09T04:26:30.060 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 42281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/freevxfs/freevxfs.ko 2023-06-09T04:26:30.060 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/fscache/ 2023-06-09T04:26:30.060 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 218609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/fscache/fscache.ko 2023-06-09T04:26:30.060 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/fuse/ 2023-06-09T04:26:30.060 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/fuse/cuse.ko 2023-06-09T04:26:30.061 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/gfs2/ 2023-06-09T04:26:30.061 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 1221153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/gfs2/gfs2.ko 2023-06-09T04:26:30.061 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/hfs/ 2023-06-09T04:26:30.061 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 141129 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/hfs/hfs.ko 2023-06-09T04:26:30.061 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/hfsplus/ 2023-06-09T04:26:30.061 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 221441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/hfsplus/hfsplus.ko 2023-06-09T04:26:30.061 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/hpfs/ 2023-06-09T04:26:30.061 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 193465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/hpfs/hpfs.ko 2023-06-09T04:26:30.062 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/isofs/ 2023-06-09T04:26:30.062 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 74281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/isofs/isofs.ko 2023-06-09T04:26:30.062 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/jfs/ 2023-06-09T04:26:30.062 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 420305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/jfs/jfs.ko 2023-06-09T04:26:30.090 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/lockd/ 2023-06-09T04:26:30.090 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 276841 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/lockd/lockd.ko 2023-06-09T04:26:30.090 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/minix/ 2023-06-09T04:26:30.090 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 87801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/minix/minix.ko 2023-06-09T04:26:30.091 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/netfs/ 2023-06-09T04:26:30.091 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 128553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/netfs/netfs.ko 2023-06-09T04:26:30.091 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/ 2023-06-09T04:26:30.091 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/blocklayout/ 2023-06-09T04:26:30.091 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 81433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-06-09T04:26:30.091 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/filelayout/ 2023-06-09T04:26:30.091 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 59249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-06-09T04:26:30.091 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/flexfilelayout/ 2023-06-09T04:26:30.092 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 117529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-06-09T04:26:30.092 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 1002305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/nfs.ko 2023-06-09T04:26:30.092 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 65985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/nfsv2.ko 2023-06-09T04:26:30.092 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 119177 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/nfsv3.ko 2023-06-09T04:26:30.092 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 2003321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/nfsv4.ko 2023-06-09T04:26:30.092 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs_common/ 2023-06-09T04:26:30.092 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs_common/grace.ko 2023-06-09T04:26:30.093 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs_common/nfs_acl.ko 2023-06-09T04:26:30.093 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfsd/ 2023-06-09T04:26:30.093 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 1407361 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfsd/nfsd.ko 2023-06-09T04:26:30.093 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nilfs2/ 2023-06-09T04:26:30.093 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 587585 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nilfs2/nilfs2.ko 2023-06-09T04:26:30.093 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/ 2023-06-09T04:26:30.093 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-celtic.ko 2023-06-09T04:26:30.093 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-centeuro.ko 2023-06-09T04:26:30.094 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-croatian.ko 2023-06-09T04:26:30.094 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-cyrillic.ko 2023-06-09T04:26:30.094 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-gaelic.ko 2023-06-09T04:26:30.094 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-greek.ko 2023-06-09T04:26:30.094 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-iceland.ko 2023-06-09T04:26:30.094 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-inuit.ko 2023-06-09T04:26:30.094 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-roman.ko 2023-06-09T04:26:30.095 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-romanian.ko 2023-06-09T04:26:30.095 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-turkish.ko 2023-06-09T04:26:30.095 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11121 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_ascii.ko 2023-06-09T04:26:30.095 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp1250.ko 2023-06-09T04:26:30.095 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp1251.ko 2023-06-09T04:26:30.095 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12809 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp1255.ko 2023-06-09T04:26:30.095 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp737.ko 2023-06-09T04:26:30.095 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp775.ko 2023-06-09T04:26:30.096 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp850.ko 2023-06-09T04:26:30.096 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp852.ko 2023-06-09T04:26:30.096 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp855.ko 2023-06-09T04:26:30.096 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp857.ko 2023-06-09T04:26:30.096 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp860.ko 2023-06-09T04:26:30.096 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp861.ko 2023-06-09T04:26:30.096 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp862.ko 2023-06-09T04:26:30.097 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp863.ko 2023-06-09T04:26:30.097 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp864.ko 2023-06-09T04:26:30.097 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp865.ko 2023-06-09T04:26:30.097 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp866.ko 2023-06-09T04:26:30.097 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp869.ko 2023-06-09T04:26:30.097 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp874.ko 2023-06-09T04:26:30.097 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 93969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp932.ko 2023-06-09T04:26:30.097 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 142505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp936.ko 2023-06-09T04:26:30.098 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 165641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp949.ko 2023-06-09T04:26:30.098 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 117945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp950.ko 2023-06-09T04:26:30.098 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_euc-jp.ko 2023-06-09T04:26:30.098 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11129 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-1.ko 2023-06-09T04:26:30.098 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-13.ko 2023-06-09T04:26:30.098 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-14.ko 2023-06-09T04:26:30.098 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-15.ko 2023-06-09T04:26:30.099 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-2.ko 2023-06-09T04:26:30.099 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-3.ko 2023-06-09T04:26:30.099 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-4.ko 2023-06-09T04:26:30.099 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-5.ko 2023-06-09T04:26:30.099 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-6.ko 2023-06-09T04:26:30.099 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-7.ko 2023-06-09T04:26:30.099 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-9.ko 2023-06-09T04:26:30.100 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_koi8-r.ko 2023-06-09T04:26:30.100 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 7913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_koi8-ru.ko 2023-06-09T04:26:30.100 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_koi8-u.ko 2023-06-09T04:26:30.100 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8169 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_utf8.ko 2023-06-09T04:26:30.100 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ntfs/ 2023-06-09T04:26:30.100 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 218905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ntfs/ntfs.ko 2023-06-09T04:26:30.100 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/ 2023-06-09T04:26:30.101 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/cluster/ 2023-06-09T04:26:30.101 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 241057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-06-09T04:26:30.101 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/dlm/ 2023-06-09T04:26:30.101 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 439521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-06-09T04:26:30.101 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/dlmfs/ 2023-06-09T04:26:30.101 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 53697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-06-09T04:26:30.101 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 2511193 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/ocfs2.ko 2023-06-09T04:26:30.102 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17793 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-06-09T04:26:30.102 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 31473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-06-09T04:26:30.102 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 33897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-06-09T04:26:30.102 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/omfs/ 2023-06-09T04:26:30.102 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 52465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/omfs/omfs.ko 2023-06-09T04:26:30.102 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/overlayfs/ 2023-06-09T04:26:30.103 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 320569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/overlayfs/overlay.ko 2023-06-09T04:26:30.103 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/pstore/ 2023-06-09T04:26:30.103 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 54441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/pstore/ramoops.ko 2023-06-09T04:26:30.103 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/qnx4/ 2023-06-09T04:26:30.103 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/qnx4/qnx4.ko 2023-06-09T04:26:30.103 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/qnx6/ 2023-06-09T04:26:30.103 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 46537 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/qnx6/qnx6.ko 2023-06-09T04:26:30.103 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/quota/ 2023-06-09T04:26:30.104 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 29993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/quota/quota_tree.ko 2023-06-09T04:26:30.104 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14177 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/quota/quota_v1.ko 2023-06-09T04:26:30.104 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21841 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/quota/quota_v2.ko 2023-06-09T04:26:30.104 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/reiserfs/ 2023-06-09T04:26:30.104 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 530593 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/reiserfs/reiserfs.ko 2023-06-09T04:26:30.104 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/romfs/ 2023-06-09T04:26:30.105 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28393 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/romfs/romfs.ko 2023-06-09T04:26:30.105 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/smbfs_common/ 2023-06-09T04:26:30.105 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 6681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/smbfs_common/cifs_arc4.ko 2023-06-09T04:26:30.105 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/smbfs_common/cifs_md4.ko 2023-06-09T04:26:30.105 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/squashfs/ 2023-06-09T04:26:30.105 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 131513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/squashfs/squashfs.ko 2023-06-09T04:26:30.105 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/sysv/ 2023-06-09T04:26:30.106 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 89537 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/sysv/sysv.ko 2023-06-09T04:26:30.106 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/udf/ 2023-06-09T04:26:30.106 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 248145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/udf/udf.ko 2023-06-09T04:26:30.106 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ufs/ 2023-06-09T04:26:30.106 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 160753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ufs/ufs.ko 2023-06-09T04:26:30.106 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/xfs/ 2023-06-09T04:26:30.106 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 3854681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/xfs/xfs.ko 2023-06-09T04:26:30.107 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/kernel/ 2023-06-09T04:26:30.107 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/kernel/locking/ 2023-06-09T04:26:30.107 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 73081 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/kernel/locking/locktorture.ko 2023-06-09T04:26:30.107 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/kernel/time/ 2023-06-09T04:26:30.107 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/kernel/time/test_udelay.ko 2023-06-09T04:26:30.107 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 55329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/kernel/torture.ko 2023-06-09T04:26:30.108 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/ 2023-06-09T04:26:30.108 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 6353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/crc-itu-t.ko 2023-06-09T04:26:30.108 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 6049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/crc7.ko 2023-06-09T04:26:30.108 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 6401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/crc8.ko 2023-06-09T04:26:30.108 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/crypto/ 2023-06-09T04:26:30.108 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 6625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/crypto/libarc4.ko 2023-06-09T04:26:30.108 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 36217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/crypto/libdes.ko 2023-06-09T04:26:30.109 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/interval_tree_test.ko 2023-06-09T04:26:30.109 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8025 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/libcrc32c.ko 2023-06-09T04:26:30.109 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/lru_cache.ko 2023-06-09T04:26:30.109 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/lz4/ 2023-06-09T04:26:30.109 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 32913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/lz4/lz4_compress.ko 2023-06-09T04:26:30.109 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/lz4/lz4hc_compress.ko 2023-06-09T04:26:30.110 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/math/ 2023-06-09T04:26:30.110 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 6217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/math/cordic.ko 2023-06-09T04:26:30.110 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/memory-notifier-error-inject.ko 2023-06-09T04:26:30.110 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/notifier-error-inject.ko 2023-06-09T04:26:30.110 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/percpu_test.ko 2023-06-09T04:26:30.110 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8185 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/pm-notifier-error-inject.ko 2023-06-09T04:26:30.110 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/raid6/ 2023-06-09T04:26:30.111 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 142193 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/raid6/raid6_pq.ko 2023-06-09T04:26:30.111 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/rbtree_test.ko 2023-06-09T04:26:30.111 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/reed_solomon/ 2023-06-09T04:26:30.111 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/reed_solomon/reed_solomon.ko 2023-06-09T04:26:30.111 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 38721 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/test-kstrtox.ko 2023-06-09T04:26:30.111 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/test-string_helpers.ko 2023-06-09T04:26:30.111 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 4760649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/test_bpf.ko 2023-06-09T04:26:30.111 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 48377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/test_firmware.ko 2023-06-09T04:26:30.112 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 6193 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/test_module.ko 2023-06-09T04:26:30.112 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/test_user_copy.ko 2023-06-09T04:26:30.112 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/ts_bm.ko 2023-06-09T04:26:30.112 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/ts_fsm.ko 2023-06-09T04:26:30.112 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/ts_kmp.ko 2023-06-09T04:26:30.112 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/xz/ 2023-06-09T04:26:30.112 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/xz/xz_dec_test.ko 2023-06-09T04:26:30.113 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/mm/ 2023-06-09T04:26:30.113 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/mm/hwpoison-inject.ko 2023-06-09T04:26:30.113 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ 2023-06-09T04:26:30.113 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/6lowpan/ 2023-06-09T04:26:30.113 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 54657 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/6lowpan/6lowpan.ko 2023-06-09T04:26:30.113 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 6873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/6lowpan/nhc_dest.ko 2023-06-09T04:26:30.113 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 6897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/6lowpan/nhc_fragment.ko 2023-06-09T04:26:30.113 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 6873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/6lowpan/nhc_hop.ko 2023-06-09T04:26:30.114 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 6873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/6lowpan/nhc_ipv6.ko 2023-06-09T04:26:30.114 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 6897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/6lowpan/nhc_mobility.ko 2023-06-09T04:26:30.114 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 6897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/6lowpan/nhc_routing.ko 2023-06-09T04:26:30.114 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/6lowpan/nhc_udp.ko 2023-06-09T04:26:30.114 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/802/ 2023-06-09T04:26:30.114 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 29545 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/802/garp.ko 2023-06-09T04:26:30.114 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 33977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/802/mrp.ko 2023-06-09T04:26:30.115 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/802/p8022.ko 2023-06-09T04:26:30.115 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/802/psnap.ko 2023-06-09T04:26:30.115 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/802/stp.ko 2023-06-09T04:26:30.115 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/8021q/ 2023-06-09T04:26:30.115 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 80913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/8021q/8021q.ko 2023-06-09T04:26:30.115 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/9p/ 2023-06-09T04:26:30.115 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 191689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/9p/9pnet.ko 2023-06-09T04:26:30.115 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 35777 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/9p/9pnet_fd.ko 2023-06-09T04:26:30.116 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/9p/9pnet_rdma.ko 2023-06-09T04:26:30.116 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 32145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/9p/9pnet_virtio.ko 2023-06-09T04:26:30.116 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/batman-adv/ 2023-06-09T04:26:30.116 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 652649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/batman-adv/batman-adv.ko 2023-06-09T04:26:30.116 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/ 2023-06-09T04:26:30.116 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 63713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/br_netfilter.ko 2023-06-09T04:26:30.116 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 769721 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/bridge.ko 2023-06-09T04:26:30.117 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ 2023-06-09T04:26:30.117 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 7553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-06-09T04:26:30.117 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_among.ko 2023-06-09T04:26:30.117 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_arp.ko 2023-06-09T04:26:30.117 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-06-09T04:26:30.117 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-06-09T04:26:30.117 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_ip.ko 2023-06-09T04:26:30.118 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-06-09T04:26:30.118 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9721 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_limit.ko 2023-06-09T04:26:30.118 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_log.ko 2023-06-09T04:26:30.118 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 7473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_mark.ko 2023-06-09T04:26:30.118 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 7425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-06-09T04:26:30.118 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-06-09T04:26:30.118 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 7433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-06-09T04:26:30.118 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9409 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-06-09T04:26:30.119 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8545 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_snat.ko 2023-06-09T04:26:30.119 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_stp.ko 2023-06-09T04:26:30.119 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-06-09T04:26:30.119 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-06-09T04:26:30.119 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-06-09T04:26:30.119 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-06-09T04:26:30.119 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 54969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebtables.ko 2023-06-09T04:26:30.120 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-06-09T04:26:30.120 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-06-09T04:26:30.120 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ceph/ 2023-06-09T04:26:30.120 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 1030089 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ceph/libceph.ko 2023-06-09T04:26:30.120 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/core/ 2023-06-09T04:26:30.120 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 124617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/core/pktgen.ko 2023-06-09T04:26:30.120 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dccp/ 2023-06-09T04:26:30.121 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 189137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dccp/dccp.ko 2023-06-09T04:26:30.121 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8545 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dccp/dccp_diag.ko 2023-06-09T04:26:30.121 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 56089 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dccp/dccp_ipv4.ko 2023-06-09T04:26:30.121 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 59529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dccp/dccp_ipv6.ko 2023-06-09T04:26:30.121 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dsa/ 2023-06-09T04:26:30.121 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 380185 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dsa/dsa_core.ko 2023-06-09T04:26:30.121 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13161 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dsa/tag_brcm.ko 2023-06-09T04:26:30.122 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dsa/tag_dsa.ko 2023-06-09T04:26:30.122 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 7609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dsa/tag_none.ko 2023-06-09T04:26:30.122 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dsa/tag_trailer.ko 2023-06-09T04:26:30.122 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/hsr/ 2023-06-09T04:26:30.122 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 99713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/hsr/hsr.ko 2023-06-09T04:26:30.122 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ieee802154/ 2023-06-09T04:26:30.122 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ieee802154/6lowpan/ 2023-06-09T04:26:30.123 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 45065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-06-09T04:26:30.123 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 245745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ieee802154/ieee802154.ko 2023-06-09T04:26:30.123 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 47393 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ieee802154/ieee802154_socket.ko 2023-06-09T04:26:30.123 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/ 2023-06-09T04:26:30.123 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 24617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/ah4.ko 2023-06-09T04:26:30.123 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 38297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/esp4.ko 2023-06-09T04:26:30.124 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 47633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/fou.ko 2023-06-09T04:26:30.124 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17673 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/gre.ko 2023-06-09T04:26:30.124 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 47305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/inet_diag.ko 2023-06-09T04:26:30.124 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 60121 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/ip_gre.ko 2023-06-09T04:26:30.124 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 58801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/ip_tunnel.ko 2023-06-09T04:26:30.124 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 34257 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/ip_vti.ko 2023-06-09T04:26:30.124 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/ipcomp.ko 2023-06-09T04:26:30.125 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/ipip.ko 2023-06-09T04:26:30.125 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/ 2023-06-09T04:26:30.125 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 36929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/arp_tables.ko 2023-06-09T04:26:30.125 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8705 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-06-09T04:26:30.125 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-06-09T04:26:30.125 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 40785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/ip_tables.ko 2023-06-09T04:26:30.125 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-06-09T04:26:30.125 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-06-09T04:26:30.126 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-06-09T04:26:30.126 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-06-09T04:26:30.126 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-06-09T04:26:30.126 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-06-09T04:26:30.126 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11537 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-06-09T04:26:30.126 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-06-09T04:26:30.126 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-06-09T04:26:30.127 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/iptable_security.ko 2023-06-09T04:26:30.127 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11601 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-06-09T04:26:30.127 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-06-09T04:26:30.127 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 27513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-06-09T04:26:30.127 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-06-09T04:26:30.127 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-06-09T04:26:30.127 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-06-09T04:26:30.127 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-06-09T04:26:30.128 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-06-09T04:26:30.128 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-06-09T04:26:30.128 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16673 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-06-09T04:26:30.128 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8889 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-06-09T04:26:30.128 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_bic.ko 2023-06-09T04:26:30.128 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_dctcp.ko 2023-06-09T04:26:30.128 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15009 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_diag.ko 2023-06-09T04:26:30.128 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_highspeed.ko 2023-06-09T04:26:30.129 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_htcp.ko 2023-06-09T04:26:30.129 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_hybla.ko 2023-06-09T04:26:30.129 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_illinois.ko 2023-06-09T04:26:30.129 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_lp.ko 2023-06-09T04:26:30.129 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_scalable.ko 2023-06-09T04:26:30.129 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_vegas.ko 2023-06-09T04:26:30.129 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_veno.ko 2023-06-09T04:26:30.130 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_westwood.ko 2023-06-09T04:26:30.130 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10073 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_yeah.ko 2023-06-09T04:26:30.130 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tunnel4.ko 2023-06-09T04:26:30.130 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16241 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/udp_diag.ko 2023-06-09T04:26:30.130 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 40337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/udp_tunnel.ko 2023-06-09T04:26:30.130 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/xfrm4_tunnel.ko 2023-06-09T04:26:30.130 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/ 2023-06-09T04:26:30.130 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26265 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/ah6.ko 2023-06-09T04:26:30.131 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 39033 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/esp6.ko 2023-06-09T04:26:30.131 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/fou6.ko 2023-06-09T04:26:30.131 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 80681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/ip6_gre.ko 2023-06-09T04:26:30.131 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 91377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/ip6_tunnel.ko 2023-06-09T04:26:30.131 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10121 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-06-09T04:26:30.131 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 53889 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/ip6_vti.ko 2023-06-09T04:26:30.131 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/ipcomp6.ko 2023-06-09T04:26:30.131 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/mip6.ko 2023-06-09T04:26:30.132 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ 2023-06-09T04:26:30.132 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 41449 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-06-09T04:26:30.132 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-06-09T04:26:30.132 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-06-09T04:26:30.132 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-06-09T04:26:30.132 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-06-09T04:26:30.132 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 7689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-06-09T04:26:30.133 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-06-09T04:26:30.133 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-06-09T04:26:30.133 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-06-09T04:26:30.133 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-06-09T04:26:30.133 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-06-09T04:26:30.133 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10721 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-06-09T04:26:30.133 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-06-09T04:26:30.133 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-06-09T04:26:30.134 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-06-09T04:26:30.134 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-06-09T04:26:30.134 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-06-09T04:26:30.134 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 38249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-06-09T04:26:30.134 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-06-09T04:26:30.134 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-06-09T04:26:30.134 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9457 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-06-09T04:26:30.134 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-06-09T04:26:30.135 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-06-09T04:26:30.135 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15537 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-06-09T04:26:30.135 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-06-09T04:26:30.135 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 73041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/sit.ko 2023-06-09T04:26:30.135 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/tunnel6.ko 2023-06-09T04:26:30.135 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/xfrm6_tunnel.ko 2023-06-09T04:26:30.135 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/key/ 2023-06-09T04:26:30.136 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 82825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/key/af_key.ko 2023-06-09T04:26:30.136 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/l2tp/ 2023-06-09T04:26:30.136 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 120649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/l2tp/l2tp_core.ko 2023-06-09T04:26:30.136 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20161 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/l2tp/l2tp_debugfs.ko 2023-06-09T04:26:30.136 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/l2tp/l2tp_eth.ko 2023-06-09T04:26:30.136 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 35065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/l2tp/l2tp_ip.ko 2023-06-09T04:26:30.136 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 36769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/l2tp/l2tp_ip6.ko 2023-06-09T04:26:30.137 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 32505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/l2tp/l2tp_netlink.ko 2023-06-09T04:26:30.137 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 53033 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/l2tp/l2tp_ppp.ko 2023-06-09T04:26:30.137 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/lapb/ 2023-06-09T04:26:30.137 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 46961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/lapb/lapb.ko 2023-06-09T04:26:30.137 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/llc/ 2023-06-09T04:26:30.137 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22169 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/llc/llc.ko 2023-06-09T04:26:30.137 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 267033 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/llc/llc2.ko 2023-06-09T04:26:30.138 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/mac802154/ 2023-06-09T04:26:30.138 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 280225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/mac802154/mac802154.ko 2023-06-09T04:26:30.138 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/mpls/ 2023-06-09T04:26:30.138 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/mpls/mpls_gso.ko 2023-06-09T04:26:30.138 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ 2023-06-09T04:26:30.138 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ 2023-06-09T04:26:30.138 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 116897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set.ko 2023-06-09T04:26:30.139 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-06-09T04:26:30.139 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-06-09T04:26:30.139 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 26345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-06-09T04:26:30.139 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 101857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-06-09T04:26:30.139 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 103001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-06-09T04:26:30.139 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 104417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-06-09T04:26:30.139 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 105017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-06-09T04:26:30.139 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 114273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-06-09T04:26:30.140 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 60985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-06-09T04:26:30.140 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 111041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-06-09T04:26:30.140 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 114561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-06-09T04:26:30.140 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 114209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-06-09T04:26:30.140 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 113033 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-06-09T04:26:30.140 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 116097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-06-09T04:26:30.140 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 30033 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-06-09T04:26:30.140 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ 2023-06-09T04:26:30.141 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 410481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs.ko 2023-06-09T04:26:30.141 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-06-09T04:26:30.141 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 7513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-06-09T04:26:30.141 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17545 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-06-09T04:26:30.141 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-06-09T04:26:30.141 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20545 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-06-09T04:26:30.141 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 7513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-06-09T04:26:30.142 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 7577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-06-09T04:26:30.142 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-06-09T04:26:30.142 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9121 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-06-09T04:26:30.142 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 7529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-06-09T04:26:30.142 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13409 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-06-09T04:26:30.142 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 7593 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-06-09T04:26:30.142 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-06-09T04:26:30.143 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 47921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conncount.ko 2023-06-09T04:26:30.143 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 397561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack.ko 2023-06-09T04:26:30.143 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-06-09T04:26:30.143 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-06-09T04:26:30.143 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 33353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-06-09T04:26:30.143 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 117633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_h323.ko 2023-06-09T04:26:30.143 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21777 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_irc.ko 2023-06-09T04:26:30.143 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-06-09T04:26:30.144 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 108217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-06-09T04:26:30.144 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 33153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-06-09T04:26:30.144 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_sane.ko 2023-06-09T04:26:30.144 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 65625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_sip.ko 2023-06-09T04:26:30.144 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10833 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-06-09T04:26:30.144 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18841 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-06-09T04:26:30.144 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_dup_netdev.ko 2023-06-09T04:26:30.144 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 86713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_flow_table.ko 2023-06-09T04:26:30.145 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_flow_table_inet.ko 2023-06-09T04:26:30.145 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 37025 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_log_syslog.ko 2023-06-09T04:26:30.145 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 91657 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_nat.ko 2023-06-09T04:26:30.145 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_nat_amanda.ko 2023-06-09T04:26:30.145 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12449 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_nat_ftp.ko 2023-06-09T04:26:30.145 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_nat_irc.ko 2023-06-09T04:26:30.145 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_nat_sip.ko 2023-06-09T04:26:30.145 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_nat_tftp.ko 2023-06-09T04:26:30.146 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 42425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_synproxy_core.ko 2023-06-09T04:26:30.146 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 579473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_tables.ko 2023-06-09T04:26:30.146 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 42457 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nfnetlink.ko 2023-06-09T04:26:30.146 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 29561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nfnetlink_acct.ko 2023-06-09T04:26:30.146 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 30505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-06-09T04:26:30.146 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 39729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nfnetlink_log.ko 2023-06-09T04:26:30.146 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nfnetlink_osf.ko 2023-06-09T04:26:30.147 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 49561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nfnetlink_queue.ko 2023-06-09T04:26:30.147 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_chain_nat.ko 2023-06-09T04:26:30.147 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 33073 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_compat.ko 2023-06-09T04:26:30.147 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 40537 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_ct.ko 2023-06-09T04:26:30.147 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_dup_netdev.ko 2023-06-09T04:26:30.147 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_fib.ko 2023-06-09T04:26:30.147 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_fwd_netdev.ko 2023-06-09T04:26:30.147 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_hash.ko 2023-06-09T04:26:30.148 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19889 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_limit.ko 2023-06-09T04:26:30.148 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_log.ko 2023-06-09T04:26:30.148 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_masq.ko 2023-06-09T04:26:30.148 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14257 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_nat.ko 2023-06-09T04:26:30.148 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_numgen.ko 2023-06-09T04:26:30.148 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_osf.ko 2023-06-09T04:26:30.148 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_queue.ko 2023-06-09T04:26:30.148 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14073 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_redir.ko 2023-06-09T04:26:30.149 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_reject.ko 2023-06-09T04:26:30.149 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_reject_inet.ko 2023-06-09T04:26:30.149 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_socket.ko 2023-06-09T04:26:30.149 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_synproxy.ko 2023-06-09T04:26:30.149 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_tproxy.ko 2023-06-09T04:26:30.149 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 84993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/x_tables.ko 2023-06-09T04:26:30.149 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_AUDIT.ko 2023-06-09T04:26:30.150 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9449 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_CHECKSUM.ko 2023-06-09T04:26:30.150 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 7625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_CLASSIFY.ko 2023-06-09T04:26:30.150 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-06-09T04:26:30.150 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_CT.ko 2023-06-09T04:26:30.150 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_DSCP.ko 2023-06-09T04:26:30.150 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_HL.ko 2023-06-09T04:26:30.150 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13257 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_HMARK.ko 2023-06-09T04:26:30.150 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 38681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_IDLETIMER.ko 2023-06-09T04:26:30.151 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13841 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_LED.ko 2023-06-09T04:26:30.151 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_LOG.ko 2023-06-09T04:26:30.151 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_MASQUERADE.ko 2023-06-09T04:26:30.151 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_NETMAP.ko 2023-06-09T04:26:30.151 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9361 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_NFLOG.ko 2023-06-09T04:26:30.151 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13185 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_NFQUEUE.ko 2023-06-09T04:26:30.151 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_RATEEST.ko 2023-06-09T04:26:30.151 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_REDIRECT.ko 2023-06-09T04:26:30.152 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_SECMARK.ko 2023-06-09T04:26:30.152 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_TCPMSS.ko 2023-06-09T04:26:30.152 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10257 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-06-09T04:26:30.152 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17193 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_TEE.ko 2023-06-09T04:26:30.152 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 16673 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_TPROXY.ko 2023-06-09T04:26:30.152 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_TRACE.ko 2023-06-09T04:26:30.152 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_addrtype.ko 2023-06-09T04:26:30.153 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13777 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_bpf.ko 2023-06-09T04:26:30.153 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_cgroup.ko 2023-06-09T04:26:30.153 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11033 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_cluster.ko 2023-06-09T04:26:30.153 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 7393 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_comment.ko 2023-06-09T04:26:30.153 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_connbytes.ko 2023-06-09T04:26:30.153 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_connlabel.ko 2023-06-09T04:26:30.153 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_connlimit.ko 2023-06-09T04:26:30.154 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_connmark.ko 2023-06-09T04:26:30.154 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_conntrack.ko 2023-06-09T04:26:30.154 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 7713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_cpu.ko 2023-06-09T04:26:30.154 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_dccp.ko 2023-06-09T04:26:30.154 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 7753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_devgroup.ko 2023-06-09T04:26:30.154 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_dscp.ko 2023-06-09T04:26:30.154 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_ecn.ko 2023-06-09T04:26:30.155 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_esp.ko 2023-06-09T04:26:30.155 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 43217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_hashlimit.ko 2023-06-09T04:26:30.155 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_helper.ko 2023-06-09T04:26:30.155 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 7753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_hl.ko 2023-06-09T04:26:30.155 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11809 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_ipcomp.ko 2023-06-09T04:26:30.155 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_iprange.ko 2023-06-09T04:26:30.155 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_ipvs.ko 2023-06-09T04:26:30.155 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_l2tp.ko 2023-06-09T04:26:30.156 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 7825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_length.ko 2023-06-09T04:26:30.156 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_limit.ko 2023-06-09T04:26:30.156 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 7433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_mac.ko 2023-06-09T04:26:30.156 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_mark.ko 2023-06-09T04:26:30.156 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_multiport.ko 2023-06-09T04:26:30.156 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13705 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_nat.ko 2023-06-09T04:26:30.156 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_nfacct.ko 2023-06-09T04:26:30.156 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_osf.ko 2023-06-09T04:26:30.157 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_owner.ko 2023-06-09T04:26:30.157 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_physdev.ko 2023-06-09T04:26:30.157 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 7457 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_pkttype.ko 2023-06-09T04:26:30.157 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_policy.ko 2023-06-09T04:26:30.157 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_quota.ko 2023-06-09T04:26:30.157 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_rateest.ko 2023-06-09T04:26:30.157 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8081 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_realm.ko 2023-06-09T04:26:30.158 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 36321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_recent.ko 2023-06-09T04:26:30.158 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_sctp.ko 2023-06-09T04:26:30.158 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 29921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_set.ko 2023-06-09T04:26:30.158 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_socket.ko 2023-06-09T04:26:30.158 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_state.ko 2023-06-09T04:26:30.158 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_statistic.ko 2023-06-09T04:26:30.158 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_string.ko 2023-06-09T04:26:30.159 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 8449 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_tcpmss.ko 2023-06-09T04:26:30.159 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15665 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_tcpudp.ko 2023-06-09T04:26:30.159 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_time.ko 2023-06-09T04:26:30.159 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_u32.ko 2023-06-09T04:26:30.159 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netlink/ 2023-06-09T04:26:30.159 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netlink/netlink_diag.ko 2023-06-09T04:26:30.159 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/nsh/ 2023-06-09T04:26:30.159 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12073 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/nsh/nsh.ko 2023-06-09T04:26:30.160 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/openvswitch/ 2023-06-09T04:26:30.160 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 377897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/openvswitch/openvswitch.ko 2023-06-09T04:26:30.160 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/openvswitch/vport-geneve.ko 2023-06-09T04:26:30.160 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/openvswitch/vport-gre.ko 2023-06-09T04:26:30.160 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 11681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/openvswitch/vport-vxlan.ko 2023-06-09T04:26:30.160 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/packet/ 2023-06-09T04:26:30.160 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 12945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/packet/af_packet_diag.ko 2023-06-09T04:26:30.161 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/phonet/ 2023-06-09T04:26:30.161 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 109953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/phonet/phonet.ko 2023-06-09T04:26:30.161 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 54737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/phonet/pn_pep.ko 2023-06-09T04:26:30.161 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/rds/ 2023-06-09T04:26:30.161 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 248865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/rds/rds.ko 2023-06-09T04:26:30.161 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 164961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/rds/rds_rdma.ko 2023-06-09T04:26:30.161 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 66761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/rds/rds_tcp.ko 2023-06-09T04:26:30.161 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/rxrpc/ 2023-06-09T04:26:30.162 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 806905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/rxrpc/rxrpc.ko 2023-06-09T04:26:30.162 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/ 2023-06-09T04:26:30.162 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 32137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/act_csum.ko 2023-06-09T04:26:30.162 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/act_gact.ko 2023-06-09T04:26:30.162 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/act_ipt.ko 2023-06-09T04:26:30.162 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 33953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/act_mirred.ko 2023-06-09T04:26:30.162 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/act_nat.ko 2023-06-09T04:26:30.163 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 42481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/act_pedit.ko 2023-06-09T04:26:30.163 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 31881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/act_police.ko 2023-06-09T04:26:30.163 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/act_simple.ko 2023-06-09T04:26:30.163 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 36241 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/act_skbedit.ko 2023-06-09T04:26:30.163 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 35945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/act_vlan.ko 2023-06-09T04:26:30.163 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/cls_basic.ko 2023-06-09T04:26:30.163 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 32729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/cls_bpf.ko 2023-06-09T04:26:30.164 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/cls_cgroup.ko 2023-06-09T04:26:30.164 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 31273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/cls_flow.ko 2023-06-09T04:26:30.164 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 30129 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/cls_fw.ko 2023-06-09T04:26:30.164 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 37113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/cls_route.ko 2023-06-09T04:26:30.164 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 58305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/cls_u32.ko 2023-06-09T04:26:30.164 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 7265 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/em_cmp.ko 2023-06-09T04:26:30.164 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 13289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/em_ipset.ko 2023-06-09T04:26:30.165 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 33153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/em_meta.ko 2023-06-09T04:26:30.165 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 7713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/em_nbyte.ko 2023-06-09T04:26:30.165 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/em_text.ko 2023-06-09T04:26:30.165 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 7073 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/em_u32.ko 2023-06-09T04:26:30.165 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_choke.ko 2023-06-09T04:26:30.165 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 19521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_codel.ko 2023-06-09T04:26:30.165 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 30761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_drr.ko 2023-06-09T04:26:30.166 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 30361 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_fq.ko 2023-06-09T04:26:30.166 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 29273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_fq_codel.ko 2023-06-09T04:26:30.166 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 32465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_gred.ko 2023-06-09T04:26:30.166 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 44665 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_hfsc.ko 2023-06-09T04:26:30.166 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_hhf.ko 2023-06-09T04:26:30.166 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 63641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_htb.ko 2023-06-09T04:26:30.166 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_ingress.ko 2023-06-09T04:26:30.167 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_mqprio.ko 2023-06-09T04:26:30.167 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_mqprio_lib.ko 2023-06-09T04:26:30.167 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_multiq.ko 2023-06-09T04:26:30.167 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 33649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_netem.ko 2023-06-09T04:26:30.167 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_pie.ko 2023-06-09T04:26:30.167 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_plug.ko 2023-06-09T04:26:30.167 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 23137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_prio.ko 2023-06-09T04:26:30.167 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 44625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_qfq.ko 2023-06-09T04:26:30.168 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 29017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_red.ko 2023-06-09T04:26:30.168 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 25201 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_sfb.ko 2023-06-09T04:26:30.168 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 28305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_sfq.ko 2023-06-09T04:26:30.168 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 27225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_tbf.ko 2023-06-09T04:26:30.168 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 27177 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_teql.ko 2023-06-09T04:26:30.168 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sctp/ 2023-06-09T04:26:30.168 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 929065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sctp/sctp.ko 2023-06-09T04:26:30.169 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 18921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sctp/sctp_diag.ko 2023-06-09T04:26:30.169 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sunrpc/ 2023-06-09T04:26:30.169 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sunrpc/auth_gss/ 2023-06-09T04:26:30.169 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 327953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-06-09T04:26:30.169 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 61649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-06-09T04:26:30.169 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 1427857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sunrpc/sunrpc.ko 2023-06-09T04:26:30.169 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sunrpc/xprtrdma/ 2023-06-09T04:26:30.169 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 681617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-06-09T04:26:30.170 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/tipc/ 2023-06-09T04:26:30.170 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/tipc/diag.ko 2023-06-09T04:26:30.170 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 853649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/tipc/tipc.ko 2023-06-09T04:26:30.170 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/unix/ 2023-06-09T04:26:30.170 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 15553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/unix/unix_diag.ko 2023-06-09T04:26:30.170 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/vmw_vsock/ 2023-06-09T04:26:30.170 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 80017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-06-09T04:26:30.170 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 67921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-06-09T04:26:30.171 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 92577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/vmw_vsock/vsock.ko 2023-06-09T04:26:30.171 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 10593 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/vmw_vsock/vsock_diag.ko 2023-06-09T04:26:30.171 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 17417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/vmw_vsock/vsock_loopback.ko 2023-06-09T04:26:30.171 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/x25/ 2023-06-09T04:26:30.171 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 125049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/x25/x25.ko 2023-06-09T04:26:30.171 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/xfrm/ 2023-06-09T04:26:30.171 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 21113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/xfrm/xfrm_algo.ko 2023-06-09T04:26:30.172 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 20065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/xfrm/xfrm_ipcomp.ko 2023-06-09T04:26:30.172 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 101529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/xfrm/xfrm_user.ko 2023-06-09T04:26:30.172 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/virt/ 2023-06-09T04:26:30.172 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/virt/lib/ 2023-06-09T04:26:30.172 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 14753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/virt/lib/irqbypass.ko 2023-06-09T04:26:30.172 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 636518 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.alias 2023-06-09T04:26:30.172 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 622189 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.alias.bin 2023-06-09T04:26:30.172 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 7605 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.builtin 2023-06-09T04:26:30.173 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 22249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.builtin.alias.bin 2023-06-09T04:26:30.173 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 9788 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.builtin.bin 2023-06-09T04:26:30.173 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 68530 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.builtin.modinfo 2023-06-09T04:26:30.173 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 146382 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.dep 2023-06-09T04:26:30.173 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 232620 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.dep.bin 2023-06-09T04:26:30.173 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 210 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.devname 2023-06-09T04:26:30.173 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 72719 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.order 2023-06-09T04:26:30.173 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 879 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.softdep 2023-06-09T04:26:30.174 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 251838 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.symbols 2023-06-09T04:26:30.174 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 306636 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.symbols.bin 2023-06-09T04:26:30.174 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./usr/ 2023-06-09T04:26:30.174 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./usr/share/ 2023-06-09T04:26:30.174 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./usr/share/doc/ 2023-06-09T04:26:30.174 INFO:teuthology.orchestra.run.smithi089.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./usr/share/doc/linux-image-6.4.0-rc2-g10b2f20a4f46/ 2023-06-09T04:26:30.174 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 173 2023-06-01 02:19 ./usr/share/doc/linux-image-6.4.0-rc2-g10b2f20a4f46/changelog.Debian.gz 2023-06-09T04:26:30.175 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r-- root/root 691 2023-06-01 02:19 ./usr/share/doc/linux-image-6.4.0-rc2-g10b2f20a4f46/copyright 2023-06-09T04:26:30.176 DEBUG:teuthology.task.kernel:get_image_version: 6.4.0-rc2-g10b2f20a4f46 2023-06-09T04:26:30.176 INFO:teuthology.task.kernel:searching for kernel 6.4.0-rc2-g10b2f20a4f46 2023-06-09T04:26:30.176 DEBUG:teuthology.orchestra.run.smithi089:> egrep '(submenu|menuentry.*6.4.0-rc2-g10b2f20a4f46).*{' /boot/grub/grub.cfg 2023-06-09T04:26:30.185 INFO:teuthology.orchestra.run.smithi089.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-06-09T04:26:30.185 INFO:teuthology.orchestra.run.smithi089.stdout: menuentry 'Ubuntu, with Linux 6.4.0-rc2-g10b2f20a4f46' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.4.0-rc2-g10b2f20a4f46-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-06-09T04:26:30.185 INFO:teuthology.orchestra.run.smithi089.stdout: menuentry 'Ubuntu, with Linux 6.4.0-rc2-g10b2f20a4f46 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.4.0-rc2-g10b2f20a4f46-recovery-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-06-09T04:26:30.186 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-06-09T04:26:30.186 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.4.0-rc2-g10b2f20a4f46 2023-06-09T04:26:30.186 DEBUG:teuthology.orchestra.run.smithi089:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-06-09T04:26:30.229 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi089.front.sepia.ceph.com to complete... 2023-06-09T04:26:30.965 INFO:teuthology.orchestra.run.smithi089.stderr:Sourcing file `/etc/default/grub' 2023-06-09T04:26:30.969 INFO:teuthology.orchestra.run.smithi089.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-06-09T04:26:30.980 INFO:teuthology.orchestra.run.smithi089.stderr:Generating grub configuration file ... 2023-06-09T04:26:31.271 INFO:teuthology.orchestra.run.smithi089.stderr:Found linux image: /boot/vmlinuz-6.4.0-rc2-g10b2f20a4f46 2023-06-09T04:26:31.284 INFO:teuthology.orchestra.run.smithi089.stderr:Found initrd image: /boot/initrd.img-6.4.0-rc2-g10b2f20a4f46 2023-06-09T04:26:31.672 INFO:teuthology.orchestra.run.smithi089.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-06-09T04:26:31.684 INFO:teuthology.orchestra.run.smithi089.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-06-09T04:26:32.942 INFO:teuthology.orchestra.run.smithi089.stderr:done 2023-06-09T04:26:36.786 INFO:teuthology.orchestra.run.smithi062.stderr:Sourcing file `/etc/default/grub' 2023-06-09T04:26:36.800 INFO:teuthology.orchestra.run.smithi062.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-06-09T04:26:36.836 INFO:teuthology.orchestra.run.smithi062.stderr:Generating grub configuration file ... 2023-06-09T04:26:37.186 INFO:teuthology.orchestra.run.smithi062.stderr:Found linux image: /boot/vmlinuz-6.4.0-rc2-g10b2f20a4f46 2023-06-09T04:26:37.218 INFO:teuthology.orchestra.run.smithi062.stderr:Found initrd image: /boot/initrd.img-6.4.0-rc2-g10b2f20a4f46 2023-06-09T04:26:37.592 INFO:teuthology.orchestra.run.smithi062.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-06-09T04:26:37.605 INFO:teuthology.orchestra.run.smithi062.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-06-09T04:26:40.232 INFO:teuthology.orchestra.run.smithi062.stderr:done 2023-06-09T04:26:40.373 DEBUG:teuthology.orchestra.run.smithi062:> dpkg-deb -c /tmp/linux-image.deb 2023-06-09T04:26:40.382 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./ 2023-06-09T04:26:40.383 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./boot/ 2023-06-09T04:26:40.383 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 4322013 2023-06-01 02:19 ./boot/System.map-6.4.0-rc2-g10b2f20a4f46 2023-06-09T04:26:40.397 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 167348 2023-06-01 02:19 ./boot/config-6.4.0-rc2-g10b2f20a4f46 2023-06-09T04:26:40.398 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11235616 2023-06-01 02:19 ./boot/vmlinuz-6.4.0-rc2-g10b2f20a4f46 2023-06-09T04:26:40.423 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./etc/ 2023-06-09T04:26:40.423 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./etc/kernel/ 2023-06-09T04:26:40.423 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./etc/kernel/postinst.d/ 2023-06-09T04:26:40.424 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./etc/kernel/postrm.d/ 2023-06-09T04:26:40.424 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./etc/kernel/preinst.d/ 2023-06-09T04:26:40.424 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./etc/kernel/prerm.d/ 2023-06-09T04:26:40.425 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/ 2023-06-09T04:26:40.425 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/ 2023-06-09T04:26:40.425 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/ 2023-06-09T04:26:40.425 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/ 2023-06-09T04:26:40.425 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/ 2023-06-09T04:26:40.425 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/ 2023-06-09T04:26:40.425 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/ 2023-06-09T04:26:40.426 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 490273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/aesni-intel.ko 2023-06-09T04:26:40.426 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 25225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-06-09T04:26:40.426 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 28945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-06-09T04:26:40.426 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 30129 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-06-09T04:26:40.426 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 92281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-06-09T04:26:40.426 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 106625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-06-09T04:26:40.426 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 152065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-06-09T04:26:40.426 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 12441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-06-09T04:26:40.427 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13601 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-06-09T04:26:40.427 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 83785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-06-09T04:26:40.427 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 18441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-06-09T04:26:40.427 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 46641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-06-09T04:26:40.427 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 47097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/serpent-avx2.ko 2023-06-09T04:26:40.427 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 51625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-06-09T04:26:40.427 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 38769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-06-09T04:26:40.427 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 40353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-06-09T04:26:40.428 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 58417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-06-09T04:26:40.428 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 50329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-06-09T04:26:40.428 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 31473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-06-09T04:26:40.428 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-06-09T04:26:40.428 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/kernel/ 2023-06-09T04:26:40.428 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/kernel/cpu/ 2023-06-09T04:26:40.428 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/kernel/cpu/mce/ 2023-06-09T04:26:40.429 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 40009 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-06-09T04:26:40.429 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/kernel/cpuid.ko 2023-06-09T04:26:40.429 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 17689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/kernel/msr.ko 2023-06-09T04:26:40.429 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/kvm/ 2023-06-09T04:26:40.429 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 346401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/kvm/kvm-amd.ko 2023-06-09T04:26:40.429 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 972121 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/kvm/kvm-intel.ko 2023-06-09T04:26:40.439 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 2209361 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/arch/x86/kvm/kvm.ko 2023-06-09T04:26:40.439 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/ 2023-06-09T04:26:40.439 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 56209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/af_alg.ko 2023-06-09T04:26:40.439 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 25153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/algif_hash.ko 2023-06-09T04:26:40.439 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 20905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/algif_skcipher.ko 2023-06-09T04:26:40.440 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 17097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/ansi_cprng.ko 2023-06-09T04:26:40.440 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 19529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/anubis.ko 2023-06-09T04:26:40.440 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 9977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/arc4.ko 2023-06-09T04:26:40.440 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/asymmetric_keys/ 2023-06-09T04:26:40.440 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10073 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-06-09T04:26:40.440 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/async_tx/ 2023-06-09T04:26:40.440 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/async_tx/async_memcpy.ko 2023-06-09T04:26:40.441 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 18985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/async_tx/async_pq.ko 2023-06-09T04:26:40.441 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 21057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/async_tx/async_raid6_recov.ko 2023-06-09T04:26:40.441 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13169 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/async_tx/async_tx.ko 2023-06-09T04:26:40.441 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 17105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/async_tx/async_xor.ko 2023-06-09T04:26:40.441 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 17809 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/async_tx/raid6test.ko 2023-06-09T04:26:40.441 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 20073 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/authenc.ko 2023-06-09T04:26:40.441 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 22473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/authencesn.ko 2023-06-09T04:26:40.441 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 21401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/blake2b_generic.ko 2023-06-09T04:26:40.442 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 12329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/blowfish_common.ko 2023-06-09T04:26:40.442 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/blowfish_generic.ko 2023-06-09T04:26:40.442 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 38697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/camellia_generic.ko 2023-06-09T04:26:40.442 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 26697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/cast5_generic.ko 2023-06-09T04:26:40.442 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 17105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/cast6_generic.ko 2023-06-09T04:26:40.442 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 9857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/cast_common.ko 2023-06-09T04:26:40.442 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 34985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/ccm.ko 2023-06-09T04:26:40.442 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 14217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/cmac.ko 2023-06-09T04:26:40.443 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 9409 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/crc32_generic.ko 2023-06-09T04:26:40.443 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 45361 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/cryptd.ko 2023-06-09T04:26:40.443 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 23305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/crypto_engine.ko 2023-06-09T04:26:40.443 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 25633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/crypto_simd.ko 2023-06-09T04:26:40.443 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 24625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/crypto_user.ko 2023-06-09T04:26:40.443 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 17553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/cts.ko 2023-06-09T04:26:40.443 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/des_generic.ko 2023-06-09T04:26:40.443 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 15105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/dh_generic.ko 2023-06-09T04:26:40.444 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10889 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/echainiv.ko 2023-06-09T04:26:40.444 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 25145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/essiv.ko 2023-06-09T04:26:40.444 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 17873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/fcrypt.ko 2023-06-09T04:26:40.444 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 26713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/khazad.ko 2023-06-09T04:26:40.444 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 15537 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/lrw.ko 2023-06-09T04:26:40.444 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/lz4.ko 2023-06-09T04:26:40.444 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11409 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/lz4hc.ko 2023-06-09T04:26:40.445 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/md4.ko 2023-06-09T04:26:40.445 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 9553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/michael_mic.ko 2023-06-09T04:26:40.445 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/pcbc.ko 2023-06-09T04:26:40.445 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 18641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/pcrypt.ko 2023-06-09T04:26:40.445 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 15873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/rmd160.ko 2023-06-09T04:26:40.445 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 29273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/seed.ko 2023-06-09T04:26:40.445 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 26369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/serpent_generic.ko 2023-06-09T04:26:40.445 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 149081 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/tcrypt.ko 2023-06-09T04:26:40.446 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/tea.ko 2023-06-09T04:26:40.446 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 28289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/twofish_common.ko 2023-06-09T04:26:40.446 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/twofish_generic.ko 2023-06-09T04:26:40.446 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 17217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/vmac.ko 2023-06-09T04:26:40.446 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 36009 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/wp512.ko 2023-06-09T04:26:40.446 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/xcbc.ko 2023-06-09T04:26:40.446 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 26329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/xor.ko 2023-06-09T04:26:40.446 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 18513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/xts.ko 2023-06-09T04:26:40.447 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 9369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/crypto/xxhash_generic.ko 2023-06-09T04:26:40.447 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ 2023-06-09T04:26:40.447 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/ 2023-06-09T04:26:40.447 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 18129 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/acpi_extlog.ko 2023-06-09T04:26:40.447 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 26857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/acpi_ipmi.ko 2023-06-09T04:26:40.447 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 28617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/acpi_pad.ko 2023-06-09T04:26:40.447 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/apei/ 2023-06-09T04:26:40.448 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 31121 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/apei/einj.ko 2023-06-09T04:26:40.448 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 12697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/ec_sys.ko 2023-06-09T04:26:40.448 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 14281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/platform_profile.ko 2023-06-09T04:26:40.448 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 24225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/sbs.ko 2023-06-09T04:26:40.448 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 18849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/sbshc.ko 2023-06-09T04:26:40.448 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 98193 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/acpi/video.ko 2023-06-09T04:26:40.448 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/ 2023-06-09T04:26:40.448 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 21353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/acard-ahci.ko 2023-06-09T04:26:40.449 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 88505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/ahci.ko 2023-06-09T04:26:40.449 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 14001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/ahci_platform.ko 2023-06-09T04:26:40.449 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 85073 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/libahci.ko 2023-06-09T04:26:40.449 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 32753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/libahci_platform.ko 2023-06-09T04:26:40.449 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 16897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_acpi.ko 2023-06-09T04:26:40.449 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 30377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_ali.ko 2023-06-09T04:26:40.449 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 33513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_amd.ko 2023-06-09T04:26:40.450 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 21025 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_artop.ko 2023-06-09T04:26:40.450 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 20881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_atiixp.ko 2023-06-09T04:26:40.450 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 24689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_atp867x.ko 2023-06-09T04:26:40.450 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 17409 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_cmd640.ko 2023-06-09T04:26:40.450 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 25065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_cmd64x.ko 2023-06-09T04:26:40.450 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 14801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_cypress.ko 2023-06-09T04:26:40.450 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 17609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_efar.ko 2023-06-09T04:26:40.450 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 21705 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_hpt366.ko 2023-06-09T04:26:40.451 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 33865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_hpt37x.ko 2023-06-09T04:26:40.451 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 22889 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_hpt3x2n.ko 2023-06-09T04:26:40.451 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 16681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_hpt3x3.ko 2023-06-09T04:26:40.451 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 16753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_it8213.ko 2023-06-09T04:26:40.451 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 35065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_it821x.ko 2023-06-09T04:26:40.451 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 12649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_jmicron.ko 2023-06-09T04:26:40.451 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 51561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_legacy.ko 2023-06-09T04:26:40.451 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 14945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_marvell.ko 2023-06-09T04:26:40.452 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 15977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_mpiix.ko 2023-06-09T04:26:40.452 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 12593 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_netcell.ko 2023-06-09T04:26:40.452 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 16577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_ninja32.ko 2023-06-09T04:26:40.452 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 14793 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_ns87410.ko 2023-06-09T04:26:40.452 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 17057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_ns87415.ko 2023-06-09T04:26:40.452 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 16265 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_oldpiix.ko 2023-06-09T04:26:40.452 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 15137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_opti.ko 2023-06-09T04:26:40.453 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 20433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_optidma.ko 2023-06-09T04:26:40.453 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 32337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_pcmcia.ko 2023-06-09T04:26:40.453 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 37609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_pdc2027x.ko 2023-06-09T04:26:40.453 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 20313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-06-09T04:26:40.453 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_piccolo.ko 2023-06-09T04:26:40.453 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 15209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_radisys.ko 2023-06-09T04:26:40.453 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 19281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_rdc.ko 2023-06-09T04:26:40.453 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 15081 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_rz1000.ko 2023-06-09T04:26:40.454 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_sch.ko 2023-06-09T04:26:40.454 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 22833 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_serverworks.ko 2023-06-09T04:26:40.454 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 23209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_sil680.ko 2023-06-09T04:26:40.454 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 19385 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_sl82c105.ko 2023-06-09T04:26:40.454 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 15769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_triflex.ko 2023-06-09T04:26:40.454 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 30249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pata_via.ko 2023-06-09T04:26:40.454 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 22617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/pdc_adma.ko 2023-06-09T04:26:40.454 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 28881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_inic162x.ko 2023-06-09T04:26:40.455 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 83113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_mv.ko 2023-06-09T04:26:40.455 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 70353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_nv.ko 2023-06-09T04:26:40.455 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 37257 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_promise.ko 2023-06-09T04:26:40.455 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 22865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_qstor.ko 2023-06-09T04:26:40.455 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 29025 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_sil.ko 2023-06-09T04:26:40.455 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 38089 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_sil24.ko 2023-06-09T04:26:40.455 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 17697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_sis.ko 2023-06-09T04:26:40.455 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 20201 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_svw.ko 2023-06-09T04:26:40.456 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 44545 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_sx4.ko 2023-06-09T04:26:40.456 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 15361 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_uli.ko 2023-06-09T04:26:40.456 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 34945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_via.ko 2023-06-09T04:26:40.456 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 19817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ata/sata_vsc.ko 2023-06-09T04:26:40.456 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/auxdisplay/ 2023-06-09T04:26:40.456 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 15337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/auxdisplay/ks0108.ko 2023-06-09T04:26:40.456 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/bcma/ 2023-06-09T04:26:40.457 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 121569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/bcma/bcma.ko 2023-06-09T04:26:40.457 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/ 2023-06-09T04:26:40.457 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/aoe/ 2023-06-09T04:26:40.457 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 113433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/aoe/aoe.ko 2023-06-09T04:26:40.457 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/drbd/ 2023-06-09T04:26:40.457 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 968017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/drbd/drbd.ko 2023-06-09T04:26:40.457 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 173105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/floppy.ko 2023-06-09T04:26:40.457 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/mtip32xx/ 2023-06-09T04:26:40.458 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 94185 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-06-09T04:26:40.458 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 114049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/nbd.ko 2023-06-09T04:26:40.458 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/null_blk/ 2023-06-09T04:26:40.458 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 110145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/null_blk/null_blk.ko 2023-06-09T04:26:40.458 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 81625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/pktcdvd.ko 2023-06-09T04:26:40.458 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 254273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/rbd.ko 2023-06-09T04:26:40.506 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/xen-blkback/ 2023-06-09T04:26:40.507 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 98017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-06-09T04:26:40.507 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/zram/ 2023-06-09T04:26:40.507 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 59985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/block/zram/zram.ko 2023-06-09T04:26:40.507 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/ 2023-06-09T04:26:40.507 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 30737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/applicom.ko 2023-06-09T04:26:40.507 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11889 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/hangcheck-timer.ko 2023-06-09T04:26:40.507 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/hw_random/ 2023-06-09T04:26:40.508 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/hw_random/amd-rng.ko 2023-06-09T04:26:40.508 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 18625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/hw_random/intel-rng.ko 2023-06-09T04:26:40.508 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-06-09T04:26:40.508 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/hw_random/via-rng.ko 2023-06-09T04:26:40.508 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 15409 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/hw_random/virtio-rng.ko 2023-06-09T04:26:40.508 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/ipmi/ 2023-06-09T04:26:40.508 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 30737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-06-09T04:26:40.509 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 147521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-06-09T04:26:40.509 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 26385 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-06-09T04:26:40.509 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 138881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/ipmi/ipmi_si.ko 2023-06-09T04:26:40.509 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 70649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-06-09T04:26:40.509 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 53425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-06-09T04:26:40.509 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 36073 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/lp.ko 2023-06-09T04:26:40.509 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/mwave/ 2023-06-09T04:26:40.510 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 83945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/mwave/mwave.ko 2023-06-09T04:26:40.510 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 25473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/nvram.ko 2023-06-09T04:26:40.510 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 31921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/ppdev.ko 2023-06-09T04:26:40.510 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 51001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/tlclk.ko 2023-06-09T04:26:40.510 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/tpm/ 2023-06-09T04:26:40.510 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 16217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/tpm/tpm_atmel.ko 2023-06-09T04:26:40.510 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 15769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-06-09T04:26:40.510 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 23353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-06-09T04:26:40.511 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 32801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-06-09T04:26:40.511 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 30001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/tpm/tpm_infineon.ko 2023-06-09T04:26:40.511 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 22577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/tpm/tpm_nsc.ko 2023-06-09T04:26:40.511 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 23457 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-06-09T04:26:40.511 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/xillybus/ 2023-06-09T04:26:40.511 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 16353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/xillybus/xillybus_class.ko 2023-06-09T04:26:40.511 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 50217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/xillybus/xillybus_core.ko 2023-06-09T04:26:40.512 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 12289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-06-09T04:26:40.512 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/clk/ 2023-06-09T04:26:40.512 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 12377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/clk/clk-palmas.ko 2023-06-09T04:26:40.512 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 47753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/clk/clk-si5351.ko 2023-06-09T04:26:40.512 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/clk/clk-twl6040.ko 2023-06-09T04:26:40.512 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 18985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/clk/clk-wm831x.ko 2023-06-09T04:26:40.512 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/cpufreq/ 2023-06-09T04:26:40.513 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 9985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-06-09T04:26:40.513 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 16657 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/cpufreq/p4-clockmod.ko 2023-06-09T04:26:40.513 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 24705 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/cpufreq/speedstep-lib.ko 2023-06-09T04:26:40.513 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/ 2023-06-09T04:26:40.513 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/ccp/ 2023-06-09T04:26:40.513 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 70609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-06-09T04:26:40.513 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 231545 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/ccp/ccp.ko 2023-06-09T04:26:40.513 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/intel/ 2023-06-09T04:26:40.514 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/intel/qat/ 2023-06-09T04:26:40.514 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/intel/qat/qat_common/ 2023-06-09T04:26:40.514 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 396281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-06-09T04:26:40.514 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-06-09T04:26:40.514 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 23921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-06-09T04:26:40.514 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 19825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/padlock-aes.ko 2023-06-09T04:26:40.514 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 21369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/padlock-sha.ko 2023-06-09T04:26:40.515 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/virtio/ 2023-06-09T04:26:40.515 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 68441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-06-09T04:26:40.515 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/dca/ 2023-06-09T04:26:40.515 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 28505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/dca/dca.ko 2023-06-09T04:26:40.515 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/dma/ 2023-06-09T04:26:40.515 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/dma/dw/ 2023-06-09T04:26:40.515 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 15737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/dma/dw/dw_dmac.ko 2023-06-09T04:26:40.515 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/dma/ioat/ 2023-06-09T04:26:40.516 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 122473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/dma/ioat/ioatdma.ko 2023-06-09T04:26:40.516 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/ 2023-06-09T04:26:40.516 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 75409 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/amd64_edac.ko 2023-06-09T04:26:40.516 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 35649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/e752x_edac.ko 2023-06-09T04:26:40.516 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 63017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/edac_mce_amd.ko 2023-06-09T04:26:40.516 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 17993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/i3000_edac.ko 2023-06-09T04:26:40.516 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 17961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/i3200_edac.ko 2023-06-09T04:26:40.516 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 22425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/i5100_edac.ko 2023-06-09T04:26:40.517 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 25481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/i5400_edac.ko 2023-06-09T04:26:40.517 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 24745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/i7300_edac.ko 2023-06-09T04:26:40.517 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 51905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/i7core_edac.ko 2023-06-09T04:26:40.517 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 18321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/i82975x_edac.ko 2023-06-09T04:26:40.517 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 19841 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/ie31200_edac.ko 2023-06-09T04:26:40.517 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 56689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/sb_edac.ko 2023-06-09T04:26:40.517 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 17417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/edac/x38_edac.ko 2023-06-09T04:26:40.518 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/extcon/ 2023-06-09T04:26:40.518 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 12561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/extcon/extcon-gpio.ko 2023-06-09T04:26:40.518 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 27017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/extcon/extcon-max14577.ko 2023-06-09T04:26:40.518 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 29457 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/extcon/extcon-max77693.ko 2023-06-09T04:26:40.518 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 24569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/extcon/extcon-max8997.ko 2023-06-09T04:26:40.518 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 26417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/extcon/extcon-palmas.ko 2023-06-09T04:26:40.518 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 23601 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/extcon/extcon-rt8973a.ko 2023-06-09T04:26:40.518 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 27673 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/extcon/extcon-sm5502.ko 2023-06-09T04:26:40.519 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/firmware/ 2023-06-09T04:26:40.519 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 34777 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/firmware/dmi-sysfs.ko 2023-06-09T04:26:40.519 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/firmware/efi/ 2023-06-09T04:26:40.519 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 15353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/firmware/efi/efi-pstore.ko 2023-06-09T04:26:40.519 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 20705 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/firmware/iscsi_ibft.ko 2023-06-09T04:26:40.519 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/ 2023-06-09T04:26:40.519 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 12201 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-adp5520.ko 2023-06-09T04:26:40.519 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 20049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-amd8111.ko 2023-06-09T04:26:40.520 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 14881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-arizona.ko 2023-06-09T04:26:40.520 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-da9052.ko 2023-06-09T04:26:40.520 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-da9055.ko 2023-06-09T04:26:40.520 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 21945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-dln2.ko 2023-06-09T04:26:40.520 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 78249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-f7188x.ko 2023-06-09T04:26:40.520 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 28249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-generic.ko 2023-06-09T04:26:40.520 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 19449 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-ich.ko 2023-06-09T04:26:40.520 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-06-09T04:26:40.521 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 14009 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-kempld.ko 2023-06-09T04:26:40.521 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 12569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-lp3943.ko 2023-06-09T04:26:40.521 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 9337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-max7300.ko 2023-06-09T04:26:40.521 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-max730x.ko 2023-06-09T04:26:40.521 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 18465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-max732x.ko 2023-06-09T04:26:40.521 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 24969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-06-09T04:26:40.521 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 46641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-pca953x.ko 2023-06-09T04:26:40.521 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 26665 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-pcf857x.ko 2023-06-09T04:26:40.522 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 14209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-rdc321x.ko 2023-06-09T04:26:40.522 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 20417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-sch.ko 2023-06-09T04:26:40.522 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 19969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-sch311x.ko 2023-06-09T04:26:40.522 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 12041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-tps65912.ko 2023-06-09T04:26:40.522 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 21873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-twl4030.ko 2023-06-09T04:26:40.522 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-twl6040.ko 2023-06-09T04:26:40.522 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 20425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-viperboard.ko 2023-06-09T04:26:40.522 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 15345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-vx855.ko 2023-06-09T04:26:40.523 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 16169 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-wm831x.ko 2023-06-09T04:26:40.523 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-wm8350.ko 2023-06-09T04:26:40.523 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 16641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/gpio/gpio-wm8994.ko 2023-06-09T04:26:40.523 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/ 2023-06-09T04:26:40.523 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-a4tech.ko 2023-06-09T04:26:40.523 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 38809 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-apple.ko 2023-06-09T04:26:40.523 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 14377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-appleir.ko 2023-06-09T04:26:40.524 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 8185 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-aureal.ko 2023-06-09T04:26:40.524 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 15001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-axff.ko 2023-06-09T04:26:40.524 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-belkin.ko 2023-06-09T04:26:40.524 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-cherry.ko 2023-06-09T04:26:40.524 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 15937 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-chicony.ko 2023-06-09T04:26:40.524 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 58961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-cp2112.ko 2023-06-09T04:26:40.524 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10937 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-cypress.ko 2023-06-09T04:26:40.524 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 16281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-dr.ko 2023-06-09T04:26:40.525 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10593 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-elecom.ko 2023-06-09T04:26:40.525 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 17489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-elo.ko 2023-06-09T04:26:40.525 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-emsff.ko 2023-06-09T04:26:40.525 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 9929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-ezkey.ko 2023-06-09T04:26:40.525 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 14129 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-gaff.ko 2023-06-09T04:26:40.525 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 9113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-generic.ko 2023-06-09T04:26:40.525 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 16369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-gt683r.ko 2023-06-09T04:26:40.525 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 12577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-gyration.ko 2023-06-09T04:26:40.526 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 9769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-holtek-kbd.ko 2023-06-09T04:26:40.526 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-holtek-mouse.ko 2023-06-09T04:26:40.526 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 14337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-holtekff.ko 2023-06-09T04:26:40.526 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 18937 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-hyperv.ko 2023-06-09T04:26:40.526 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-icade.ko 2023-06-09T04:26:40.526 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 9137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-kensington.ko 2023-06-09T04:26:40.526 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 8377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-keytouch.ko 2023-06-09T04:26:40.526 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 17089 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-kye.ko 2023-06-09T04:26:40.527 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-lcpower.ko 2023-06-09T04:26:40.527 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 20313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-led.ko 2023-06-09T04:26:40.527 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 42177 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-lenovo.ko 2023-06-09T04:26:40.527 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 30417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-lg-g15.ko 2023-06-09T04:26:40.527 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 57689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-logitech-dj.ko 2023-06-09T04:26:40.527 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 100561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-06-09T04:26:40.527 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 80889 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-logitech.ko 2023-06-09T04:26:40.528 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 30681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-magicmouse.ko 2023-06-09T04:26:40.528 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 21425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-microsoft.ko 2023-06-09T04:26:40.528 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10257 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-monterey.ko 2023-06-09T04:26:40.528 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 49977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-multitouch.ko 2023-06-09T04:26:40.528 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 32473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-ntrig.ko 2023-06-09T04:26:40.528 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 8753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-ortek.ko 2023-06-09T04:26:40.528 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 9009 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-penmount.ko 2023-06-09T04:26:40.528 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 12185 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-petalynx.ko 2023-06-09T04:26:40.529 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 72817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-picolcd.ko 2023-06-09T04:26:40.529 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 14121 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-pl.ko 2023-06-09T04:26:40.529 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 14929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-plantronics.ko 2023-06-09T04:26:40.529 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 8249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-primax.ko 2023-06-09T04:26:40.529 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 35289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-rmi.ko 2023-06-09T04:26:40.529 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 20649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-arvo.ko 2023-06-09T04:26:40.529 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13129 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-common.ko 2023-06-09T04:26:40.529 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 31177 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-isku.ko 2023-06-09T04:26:40.530 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 29481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-kone.ko 2023-06-09T04:26:40.530 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 30945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-06-09T04:26:40.530 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 20913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-konepure.ko 2023-06-09T04:26:40.530 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 29305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-06-09T04:26:40.530 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13193 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-lua.ko 2023-06-09T04:26:40.530 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 29129 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-pyra.ko 2023-06-09T04:26:40.530 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 27713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-ryos.ko 2023-06-09T04:26:40.530 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 19297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat-savu.ko 2023-06-09T04:26:40.531 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 22761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-roccat.ko 2023-06-09T04:26:40.531 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-saitek.ko 2023-06-09T04:26:40.531 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 15025 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-samsung.ko 2023-06-09T04:26:40.531 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 35521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-sensor-hub.ko 2023-06-09T04:26:40.531 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-sjoy.ko 2023-06-09T04:26:40.531 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 51025 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-sony.ko 2023-06-09T04:26:40.531 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 8137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-speedlink.ko 2023-06-09T04:26:40.531 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 14769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-steelseries.ko 2023-06-09T04:26:40.532 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 9713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-sunplus.ko 2023-06-09T04:26:40.532 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 16809 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-thrustmaster.ko 2023-06-09T04:26:40.532 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-tivo.ko 2023-06-09T04:26:40.532 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 14913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-tmff.ko 2023-06-09T04:26:40.532 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 14217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-topseed.ko 2023-06-09T04:26:40.532 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 16297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-twinhan.ko 2023-06-09T04:26:40.532 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 71337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-uclogic.ko 2023-06-09T04:26:40.532 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-waltop.ko 2023-06-09T04:26:40.533 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 143417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-wiimote.ko 2023-06-09T04:26:40.533 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 8041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-xinmo.ko 2023-06-09T04:26:40.533 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-zpff.ko 2023-06-09T04:26:40.533 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 16553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid-zydacron.ko 2023-06-09T04:26:40.533 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 261777 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/hid.ko 2023-06-09T04:26:40.533 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 32209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/uhid.ko 2023-06-09T04:26:40.533 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/usbhid/ 2023-06-09T04:26:40.534 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 125241 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/usbhid/usbhid.ko 2023-06-09T04:26:40.534 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 19025 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/usbhid/usbkbd.ko 2023-06-09T04:26:40.534 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 14849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/usbhid/usbmouse.ko 2023-06-09T04:26:40.534 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 216833 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hid/wacom.ko 2023-06-09T04:26:40.534 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hv/ 2023-06-09T04:26:40.534 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 63153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hv/hv_balloon.ko 2023-06-09T04:26:40.534 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 89497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hv/hv_utils.ko 2023-06-09T04:26:40.534 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 292521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hv/hv_vmbus.ko 2023-06-09T04:26:40.535 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ 2023-06-09T04:26:40.535 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 66489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/abituguru.ko 2023-06-09T04:26:40.535 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 61289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/abituguru3.ko 2023-06-09T04:26:40.535 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 34625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/acpi_power_meter.ko 2023-06-09T04:26:40.535 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 17385 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ad7414.ko 2023-06-09T04:26:40.535 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 19137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ad7418.ko 2023-06-09T04:26:40.535 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 25089 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adc128d818.ko 2023-06-09T04:26:40.535 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 31617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adm1025.ko 2023-06-09T04:26:40.536 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 97857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adm1026.ko 2023-06-09T04:26:40.536 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 19633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adm1029.ko 2023-06-09T04:26:40.536 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 45377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adm1031.ko 2023-06-09T04:26:40.536 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 26177 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adm9240.ko 2023-06-09T04:26:40.536 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 14657 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ads7828.ko 2023-06-09T04:26:40.536 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10657 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adt7410.ko 2023-06-09T04:26:40.536 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 21937 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adt7411.ko 2023-06-09T04:26:40.536 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 74329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adt7462.ko 2023-06-09T04:26:40.537 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 39409 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adt7470.ko 2023-06-09T04:26:40.537 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 65145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adt7475.ko 2023-06-09T04:26:40.537 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 19145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/adt7x10.ko 2023-06-09T04:26:40.537 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 38953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/amc6821.ko 2023-06-09T04:26:40.537 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 55025 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/applesmc.ko 2023-06-09T04:26:40.537 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 49737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/asb100.ko 2023-06-09T04:26:40.537 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 58433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/asc7621.ko 2023-06-09T04:26:40.537 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 40697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/asus_atk0110.ko 2023-06-09T04:26:40.538 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 17105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/atxp1.ko 2023-06-09T04:26:40.538 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 28177 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/coretemp.ko 2023-06-09T04:26:40.538 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 24489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/da9052-hwmon.ko 2023-06-09T04:26:40.538 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 17081 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/da9055-hwmon.ko 2023-06-09T04:26:40.538 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 44297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-06-09T04:26:40.538 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 99481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/dme1737.ko 2023-06-09T04:26:40.538 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 19369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ds1621.ko 2023-06-09T04:26:40.539 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 15153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ds620.ko 2023-06-09T04:26:40.539 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 29593 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/emc1403.ko 2023-06-09T04:26:40.539 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 33001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/emc2103.ko 2023-06-09T04:26:40.539 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 30209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/emc6w201.ko 2023-06-09T04:26:40.539 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 66801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/f71805f.ko 2023-06-09T04:26:40.539 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 94473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/f71882fg.ko 2023-06-09T04:26:40.539 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 41289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/f75375s.ko 2023-06-09T04:26:40.539 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 21201 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/fam15h_power.ko 2023-06-09T04:26:40.540 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 55249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/fschmd.ko 2023-06-09T04:26:40.540 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 14313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/g760a.ko 2023-06-09T04:26:40.540 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 23913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/g762.ko 2023-06-09T04:26:40.540 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 46689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/gl518sm.ko 2023-06-09T04:26:40.540 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 45345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/gl520sm.ko 2023-06-09T04:26:40.540 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/hih6130.ko 2023-06-09T04:26:40.540 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 9265 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/hwmon-vid.ko 2023-06-09T04:26:40.540 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/i5500_temp.ko 2023-06-09T04:26:40.541 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 22417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/i5k_amb.ko 2023-06-09T04:26:40.541 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 34393 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ibmaem.ko 2023-06-09T04:26:40.541 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 21121 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ibmpex.ko 2023-06-09T04:26:40.541 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 24761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ina209.ko 2023-06-09T04:26:40.542 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ina2xx.ko 2023-06-09T04:26:40.542 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 128913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/it87.ko 2023-06-09T04:26:40.542 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 18729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/jc42.ko 2023-06-09T04:26:40.543 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 23833 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/k10temp.ko 2023-06-09T04:26:40.543 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/k8temp.ko 2023-06-09T04:26:40.543 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 18817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lineage-pem.ko 2023-06-09T04:26:40.543 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 48417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm63.ko 2023-06-09T04:26:40.544 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 16585 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm73.ko 2023-06-09T04:26:40.544 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 36593 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm75.ko 2023-06-09T04:26:40.544 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 19369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm77.ko 2023-06-09T04:26:40.545 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 34473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm78.ko 2023-06-09T04:26:40.545 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 31625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm80.ko 2023-06-09T04:26:40.545 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 16713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm83.ko 2023-06-09T04:26:40.545 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 72657 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm85.ko 2023-06-09T04:26:40.545 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 45977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm87.ko 2023-06-09T04:26:40.546 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 37729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm90.ko 2023-06-09T04:26:40.546 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 19633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm92.ko 2023-06-09T04:26:40.546 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 108721 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm93.ko 2023-06-09T04:26:40.546 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 33281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm95234.ko 2023-06-09T04:26:40.546 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 16089 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm95241.ko 2023-06-09T04:26:40.546 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 17993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/lm95245.ko 2023-06-09T04:26:40.546 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 23841 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ltc2945.ko 2023-06-09T04:26:40.546 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ltc4151.ko 2023-06-09T04:26:40.547 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 15081 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ltc4215.ko 2023-06-09T04:26:40.547 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 14769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ltc4222.ko 2023-06-09T04:26:40.547 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 14657 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ltc4245.ko 2023-06-09T04:26:40.547 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13129 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ltc4260.ko 2023-06-09T04:26:40.547 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 14817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/ltc4261.ko 2023-06-09T04:26:40.547 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 33377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/max16065.ko 2023-06-09T04:26:40.547 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 18249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/max1619.ko 2023-06-09T04:26:40.548 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 24233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/max1668.ko 2023-06-09T04:26:40.548 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 19865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/max197.ko 2023-06-09T04:26:40.548 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 26505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/max6639.ko 2023-06-09T04:26:40.548 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 23201 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/max6650.ko 2023-06-09T04:26:40.548 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 35593 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/max6697.ko 2023-06-09T04:26:40.548 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 18465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/mc13783-adc.ko 2023-06-09T04:26:40.548 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/mcp3021.ko 2023-06-09T04:26:40.549 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 15753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-06-09T04:26:40.549 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 43977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/nct6683.ko 2023-06-09T04:26:40.549 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 114577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/nct6775-core.ko 2023-06-09T04:26:40.549 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 60033 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/nct6775.ko 2023-06-09T04:26:40.549 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 59553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/nct7802.ko 2023-06-09T04:26:40.549 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 82169 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pc87360.ko 2023-06-09T04:26:40.549 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 54321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pc87427.ko 2023-06-09T04:26:40.549 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 18353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pcf8591.ko 2023-06-09T04:26:40.550 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/ 2023-06-09T04:26:40.550 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 20809 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-06-09T04:26:40.550 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 16889 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-06-09T04:26:40.550 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 28153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-06-09T04:26:40.550 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 9401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/max16064.ko 2023-06-09T04:26:40.550 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 17553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/max34440.ko 2023-06-09T04:26:40.550 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/max8688.ko 2023-06-09T04:26:40.550 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 15401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-06-09T04:26:40.551 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 79353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-06-09T04:26:40.551 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 8561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-06-09T04:26:40.551 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 30617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-06-09T04:26:40.551 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 14897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-06-09T04:26:40.551 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 20569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-06-09T04:26:40.551 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 12913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/powr1220.ko 2023-06-09T04:26:40.551 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 18521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/sch5627.ko 2023-06-09T04:26:40.551 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 28633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/sch5636.ko 2023-06-09T04:26:40.552 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 26369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/sch56xx-common.ko 2023-06-09T04:26:40.552 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 32017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/sht15.ko 2023-06-09T04:26:40.552 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13385 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/sht21.ko 2023-06-09T04:26:40.552 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 16657 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/shtc1.ko 2023-06-09T04:26:40.552 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 39937 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/sis5595.ko 2023-06-09T04:26:40.552 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 31817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/smm665.ko 2023-06-09T04:26:40.552 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 19401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/smsc47b397.ko 2023-06-09T04:26:40.553 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 39017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/smsc47m1.ko 2023-06-09T04:26:40.553 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 37273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/smsc47m192.ko 2023-06-09T04:26:40.553 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 26441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/thmc50.ko 2023-06-09T04:26:40.553 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 16881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/tmp102.ko 2023-06-09T04:26:40.553 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/tmp103.ko 2023-06-09T04:26:40.553 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 21137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/tmp401.ko 2023-06-09T04:26:40.553 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 19361 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/tmp421.ko 2023-06-09T04:26:40.553 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 19585 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/via-cputemp.ko 2023-06-09T04:26:40.554 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 41833 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/via686a.ko 2023-06-09T04:26:40.554 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 52337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/vt1211.ko 2023-06-09T04:26:40.554 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 51441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/vt8231.ko 2023-06-09T04:26:40.554 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 57345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/w83627ehf.ko 2023-06-09T04:26:40.554 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 78761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/w83627hf.ko 2023-06-09T04:26:40.554 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 71169 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/w83781d.ko 2023-06-09T04:26:40.554 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 63113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/w83791d.ko 2023-06-09T04:26:40.554 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 71145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/w83792d.ko 2023-06-09T04:26:40.555 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 101273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/w83793.ko 2023-06-09T04:26:40.555 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 119329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/w83795.ko 2023-06-09T04:26:40.555 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 17145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/w83l785ts.ko 2023-06-09T04:26:40.555 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 35505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/w83l786ng.ko 2023-06-09T04:26:40.555 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-06-09T04:26:40.555 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-06-09T04:26:40.555 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/ 2023-06-09T04:26:40.555 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/algos/ 2023-06-09T04:26:40.556 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 19481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-06-09T04:26:40.556 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 18849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-06-09T04:26:40.556 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/ 2023-06-09T04:26:40.556 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 27849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-06-09T04:26:40.556 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 28625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-06-09T04:26:40.556 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 27601 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-06-09T04:26:40.556 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 17825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-06-09T04:26:40.557 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 25857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-06-09T04:26:40.557 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 16017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-06-09T04:26:40.557 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 15041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-06-09T04:26:40.557 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 6521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-06-09T04:26:40.557 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-06-09T04:26:40.557 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 46345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-06-09T04:26:40.557 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 23513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-06-09T04:26:40.557 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 19417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-06-09T04:26:40.558 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 17161 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-06-09T04:26:40.558 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 12209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-06-09T04:26:40.558 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 17473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-06-09T04:26:40.558 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 62337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-i801.ko 2023-06-09T04:26:40.558 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 22321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-isch.ko 2023-06-09T04:26:40.558 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 47785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-06-09T04:26:40.558 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 17185 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-06-09T04:26:40.558 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 17769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-06-09T04:26:40.559 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 21937 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-06-09T04:26:40.559 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 26313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-06-09T04:26:40.559 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 24945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-parport.ko 2023-06-09T04:26:40.559 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 16393 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-06-09T04:26:40.559 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 47137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-06-09T04:26:40.559 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 15113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-06-09T04:26:40.559 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 18537 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-06-09T04:26:40.560 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11705 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-06-09T04:26:40.560 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 22193 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-06-09T04:26:40.560 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 29185 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-06-09T04:26:40.560 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 20217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-06-09T04:26:40.560 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 19057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-06-09T04:26:40.560 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 19737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-06-09T04:26:40.560 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-via.ko 2023-06-09T04:26:40.560 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 25969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-06-09T04:26:40.561 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 18929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-06-09T04:26:40.561 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 48201 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-06-09T04:26:40.561 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 21729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/i2c-mux.ko 2023-06-09T04:26:40.561 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 18337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/i2c-smbus.ko 2023-06-09T04:26:40.561 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 26945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/i2c-stub.ko 2023-06-09T04:26:40.561 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/muxes/ 2023-06-09T04:26:40.561 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 14681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-06-09T04:26:40.562 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-06-09T04:26:40.562 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 26745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-06-09T04:26:40.562 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ 2023-06-09T04:26:40.562 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/core/ 2023-06-09T04:26:40.562 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 264409 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/core/ib_cm.ko 2023-06-09T04:26:40.562 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 849113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/core/ib_core.ko 2023-06-09T04:26:40.562 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 68489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/core/ib_umad.ko 2023-06-09T04:26:40.562 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 320185 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-06-09T04:26:40.563 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 96801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/core/iw_cm.ko 2023-06-09T04:26:40.563 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 272097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/core/rdma_cm.ko 2023-06-09T04:26:40.563 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 66073 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-06-09T04:26:40.563 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/ 2023-06-09T04:26:40.563 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/cxgb4/ 2023-06-09T04:26:40.563 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 492377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-06-09T04:26:40.563 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/mlx4/ 2023-06-09T04:26:40.564 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 419097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-06-09T04:26:40.564 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/mlx5/ 2023-06-09T04:26:40.564 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 733385 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-06-09T04:26:40.564 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/mthca/ 2023-06-09T04:26:40.564 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 296481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-06-09T04:26:40.564 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/ocrdma/ 2023-06-09T04:26:40.564 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 153561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-06-09T04:26:40.565 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/usnic/ 2023-06-09T04:26:40.565 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 168905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-06-09T04:26:40.565 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/ 2023-06-09T04:26:40.565 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/ipoib/ 2023-06-09T04:26:40.565 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 263057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-06-09T04:26:40.565 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/iser/ 2023-06-09T04:26:40.565 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 100041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-06-09T04:26:40.565 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/isert/ 2023-06-09T04:26:40.566 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 111049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-06-09T04:26:40.566 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/srp/ 2023-06-09T04:26:40.566 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 128961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-06-09T04:26:40.566 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/srpt/ 2023-06-09T04:26:40.566 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 129385 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-06-09T04:26:40.566 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/ 2023-06-09T04:26:40.566 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/evbug.ko 2023-06-09T04:26:40.566 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 23777 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/ff-memless.ko 2023-06-09T04:26:40.567 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/gameport/ 2023-06-09T04:26:40.567 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11777 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-06-09T04:26:40.567 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/gameport/fm801-gp.ko 2023-06-09T04:26:40.567 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 39505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/gameport/gameport.ko 2023-06-09T04:26:40.567 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 12385 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/gameport/lightning.ko 2023-06-09T04:26:40.567 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 17353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/gameport/ns558.ko 2023-06-09T04:26:40.567 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 41713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/joydev.ko 2023-06-09T04:26:40.567 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/ 2023-06-09T04:26:40.568 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-06-09T04:26:40.568 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 30257 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-06-09T04:26:40.568 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 26729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-06-09T04:26:40.568 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 24577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-06-09T04:26:40.568 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 36545 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/gpio_keys.ko 2023-06-09T04:26:40.568 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 18097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-06-09T04:26:40.568 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 21145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/lkkbd.ko 2023-06-09T04:26:40.569 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 27937 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/lm8323.ko 2023-06-09T04:26:40.569 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 15001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/lm8333.ko 2023-06-09T04:26:40.569 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 24145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-06-09T04:26:40.569 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 18033 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-06-09T04:26:40.569 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 15785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-06-09T04:26:40.569 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 16305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-06-09T04:26:40.569 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/newtonkbd.ko 2023-06-09T04:26:40.570 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-06-09T04:26:40.570 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 15025 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/qt1070.ko 2023-06-09T04:26:40.570 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 20953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/qt2160.ko 2023-06-09T04:26:40.570 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 23633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-06-09T04:26:40.570 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/stowaway.ko 2023-06-09T04:26:40.570 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 18177 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/sunkbd.ko 2023-06-09T04:26:40.570 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 20553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-06-09T04:26:40.570 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 16009 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-06-09T04:26:40.571 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 16617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-06-09T04:26:40.571 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/keyboard/xtkbd.ko 2023-06-09T04:26:40.571 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/matrix-keymap.ko 2023-06-09T04:26:40.571 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/ 2023-06-09T04:26:40.571 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 34209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/appletouch.ko 2023-06-09T04:26:40.571 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 34001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/bcm5974.ko 2023-06-09T04:26:40.571 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 123497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/cyapatp.ko 2023-06-09T04:26:40.571 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 89345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/elan_i2c.ko 2023-06-09T04:26:40.572 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/gpio_mouse.ko 2023-06-09T04:26:40.572 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 334393 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/psmouse.ko 2023-06-09T04:26:40.572 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 14497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/sermouse.ko 2023-06-09T04:26:40.572 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 23697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-06-09T04:26:40.572 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 22465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/synaptics_usb.ko 2023-06-09T04:26:40.572 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 15489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/mouse/vsxxxaa.ko 2023-06-09T04:26:40.572 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/rmi4/ 2023-06-09T04:26:40.573 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 108097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/rmi4/rmi_core.ko 2023-06-09T04:26:40.573 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/serio/ 2023-06-09T04:26:40.573 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/serio/altera_ps2.ko 2023-06-09T04:26:40.573 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 16113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/serio/arc_ps2.ko 2023-06-09T04:26:40.573 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 16257 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/serio/ct82c710.ko 2023-06-09T04:26:40.573 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 16785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-06-09T04:26:40.573 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 15721 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/serio/parkbd.ko 2023-06-09T04:26:40.573 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/serio/pcips2.ko 2023-06-09T04:26:40.574 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 19985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/serio/ps2mult.ko 2023-06-09T04:26:40.574 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 24017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/serio/serio_raw.ko 2023-06-09T04:26:40.574 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 17809 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/serio/serport.ko 2023-06-09T04:26:40.574 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 12553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/input/sparse-keymap.ko 2023-06-09T04:26:40.574 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/iommu/ 2023-06-09T04:26:40.574 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/iommu/amd/ 2023-06-09T04:26:40.574 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 38001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/iommu/amd/iommu_v2.ko 2023-06-09T04:26:40.574 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/ 2023-06-09T04:26:40.575 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-88pm860x.ko 2023-06-09T04:26:40.575 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-adp5520.ko 2023-06-09T04:26:40.575 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 59569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-bd2802.ko 2023-06-09T04:26:40.575 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 24673 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-blinkm.ko 2023-06-09T04:26:40.575 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-da903x.ko 2023-06-09T04:26:40.575 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 12137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-da9052.ko 2023-06-09T04:26:40.575 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 15481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-gpio.ko 2023-06-09T04:26:40.575 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 15681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-lm3530.ko 2023-06-09T04:26:40.576 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 30385 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-lm3533.ko 2023-06-09T04:26:40.576 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 19169 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-lm355x.ko 2023-06-09T04:26:40.576 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 19841 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-lm3642.ko 2023-06-09T04:26:40.576 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 16137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-lp3944.ko 2023-06-09T04:26:40.576 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11129 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-lp8788.ko 2023-06-09T04:26:40.576 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 14817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-max8997.ko 2023-06-09T04:26:40.576 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 12393 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-mc13783.ko 2023-06-09T04:26:40.577 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13025 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-menf21bmc.ko 2023-06-09T04:26:40.577 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 20609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-pca9532.ko 2023-06-09T04:26:40.577 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 20305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-pca955x.ko 2023-06-09T04:26:40.577 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 17681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-pca963x.ko 2023-06-09T04:26:40.577 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 33673 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-ss4200.ko 2023-06-09T04:26:40.577 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 24689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-tca6507.ko 2023-06-09T04:26:40.578 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 15489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-wm831x-status.ko 2023-06-09T04:26:40.578 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/leds-wm8350.ko 2023-06-09T04:26:40.578 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/trigger/ 2023-06-09T04:26:40.578 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 9497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-06-09T04:26:40.579 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-06-09T04:26:40.579 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 8593 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-06-09T04:26:40.579 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 7441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-06-09T04:26:40.579 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 14145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-06-09T04:26:40.580 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-06-09T04:26:40.580 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11705 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-06-09T04:26:40.580 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-06-09T04:26:40.580 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/ 2023-06-09T04:26:40.581 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/bcache/ 2023-06-09T04:26:40.581 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 631713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/bcache/bcache.ko 2023-06-09T04:26:40.581 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 37553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-bio-prison.ko 2023-06-09T04:26:40.581 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 86033 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-bufio.ko 2023-06-09T04:26:40.582 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 47353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-cache-smq.ko 2023-06-09T04:26:40.582 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 154097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-cache.ko 2023-06-09T04:26:40.582 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 105553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-crypt.ko 2023-06-09T04:26:40.582 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 21417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-delay.ko 2023-06-09T04:26:40.583 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 53697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-era.ko 2023-06-09T04:26:40.583 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 20825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-flakey.ko 2023-06-09T04:26:40.583 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 41425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-log-userspace.ko 2023-06-09T04:26:40.584 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 32041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-log.ko 2023-06-09T04:26:40.584 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 49377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-mirror.ko 2023-06-09T04:26:40.584 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 77505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-multipath.ko 2023-06-09T04:26:40.584 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 16345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-queue-length.ko 2023-06-09T04:26:40.584 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 70657 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-raid.ko 2023-06-09T04:26:40.584 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 33881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-region-hash.ko 2023-06-09T04:26:40.585 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 15681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-round-robin.ko 2023-06-09T04:26:40.585 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 16609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-service-time.ko 2023-06-09T04:26:40.585 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 108801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-snapshot.ko 2023-06-09T04:26:40.585 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 19249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-switch.ko 2023-06-09T04:26:40.585 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 182017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-thin-pool.ko 2023-06-09T04:26:40.585 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 51625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-verity.ko 2023-06-09T04:26:40.585 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 8273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/dm-zero.ko 2023-06-09T04:26:40.585 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 14921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/faulty.ko 2023-06-09T04:26:40.586 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 19313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/linear.ko 2023-06-09T04:26:40.586 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 32121 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/multipath.ko 2023-06-09T04:26:40.586 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/persistent-data/ 2023-06-09T04:26:40.586 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 192737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-06-09T04:26:40.586 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 37025 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/raid0.ko 2023-06-09T04:26:40.586 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 111361 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/raid1.ko 2023-06-09T04:26:40.586 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 157873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/raid10.ko 2023-06-09T04:26:40.586 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 392777 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/md/raid456.ko 2023-06-09T04:26:40.587 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/message/ 2023-06-09T04:26:40.587 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/message/fusion/ 2023-06-09T04:26:40.587 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 174329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/message/fusion/mptbase.ko 2023-06-09T04:26:40.587 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 63273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/message/fusion/mptctl.ko 2023-06-09T04:26:40.587 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 44465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/message/fusion/mptfc.ko 2023-06-09T04:26:40.587 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 37049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/message/fusion/mptlan.ko 2023-06-09T04:26:40.587 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 123185 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/message/fusion/mptsas.ko 2023-06-09T04:26:40.588 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 76009 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/message/fusion/mptscsih.ko 2023-06-09T04:26:40.588 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 52905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/message/fusion/mptspi.ko 2023-06-09T04:26:40.588 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/ 2023-06-09T04:26:40.588 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 17193 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/88pm800.ko 2023-06-09T04:26:40.588 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 12649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/88pm805.ko 2023-06-09T04:26:40.588 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/88pm80x.ko 2023-06-09T04:26:40.588 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/arizona-i2c.ko 2023-06-09T04:26:40.588 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 121721 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/arizona.ko 2023-06-09T04:26:40.589 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/bcm590xx.ko 2023-06-09T04:26:40.589 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 17281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/cros_ec_dev.ko 2023-06-09T04:26:40.589 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 34417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/dln2.ko 2023-06-09T04:26:40.589 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 16577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/janz-cmodio.ko 2023-06-09T04:26:40.589 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 52497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/kempld-core.ko 2023-06-09T04:26:40.589 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 27041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/lm3533-core.ko 2023-06-09T04:26:40.589 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-06-09T04:26:40.589 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 12433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/lp3943.ko 2023-06-09T04:26:40.590 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 54449 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/lpc_ich.ko 2023-06-09T04:26:40.590 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 12001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/lpc_sch.ko 2023-06-09T04:26:40.590 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 17353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/max8907.ko 2023-06-09T04:26:40.590 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 27865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/mc13xxx-core.ko 2023-06-09T04:26:40.590 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-06-09T04:26:40.590 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/menf21bmc.ko 2023-06-09T04:26:40.590 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 16897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/pcf50633-adc.ko 2023-06-09T04:26:40.591 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 8329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/pcf50633-gpio.ko 2023-06-09T04:26:40.591 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 33417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/pcf50633.ko 2023-06-09T04:26:40.591 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 9937 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-06-09T04:26:40.591 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 19881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/retu-mfd.ko 2023-06-09T04:26:40.591 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 76433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/si476x-core.ko 2023-06-09T04:26:40.591 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 47649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/sm501.ko 2023-06-09T04:26:40.591 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 19161 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-06-09T04:26:40.591 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 50505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/tps65010.ko 2023-06-09T04:26:40.592 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/tps6507x.ko 2023-06-09T04:26:40.592 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/viperboard.ko 2023-06-09T04:26:40.592 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/vx855.ko 2023-06-09T04:26:40.592 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 17785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/wl1273-core.ko 2023-06-09T04:26:40.592 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 43521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/mfd/wm8994.ko 2023-06-09T04:26:40.592 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/ 2023-06-09T04:26:40.593 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13721 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-06-09T04:26:40.593 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 48009 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/ad525x_dpot.ko 2023-06-09T04:26:40.593 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/altera-stapl/ 2023-06-09T04:26:40.593 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 46185 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-06-09T04:26:40.593 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 18217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/apds9802als.ko 2023-06-09T04:26:40.593 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 36625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/apds990x.ko 2023-06-09T04:26:40.593 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 45473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/bh1770glc.ko 2023-06-09T04:26:40.593 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/c2port/ 2023-06-09T04:26:40.594 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-06-09T04:26:40.594 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 34801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/c2port/core.ko 2023-06-09T04:26:40.594 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/cb710/ 2023-06-09T04:26:40.594 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 24465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/cb710/cb710.ko 2023-06-09T04:26:40.594 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 17617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/ds1682.ko 2023-06-09T04:26:40.594 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 8777 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/dummy-irq.ko 2023-06-09T04:26:40.594 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/echo/ 2023-06-09T04:26:40.594 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 12729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/echo/echo.ko 2023-06-09T04:26:40.595 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/eeprom/ 2023-06-09T04:26:40.595 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 37521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/eeprom/at24.ko 2023-06-09T04:26:40.595 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 14145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/eeprom/eeprom.ko 2023-06-09T04:26:40.595 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-06-09T04:26:40.595 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/eeprom/max6875.ko 2023-06-09T04:26:40.595 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 31913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/enclosure.ko 2023-06-09T04:26:40.595 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/genwqe/ 2023-06-09T04:26:40.595 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 151953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-06-09T04:26:40.596 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 14017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/hmc6352.ko 2023-06-09T04:26:40.596 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 31009 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/hpilo.ko 2023-06-09T04:26:40.596 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/ibmasm/ 2023-06-09T04:26:40.596 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 72497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-06-09T04:26:40.596 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 19673 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/ics932s401.ko 2023-06-09T04:26:40.596 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 21569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/isl29003.ko 2023-06-09T04:26:40.596 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 15569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/isl29020.ko 2023-06-09T04:26:40.597 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/lis3lv02d/ 2023-06-09T04:26:40.597 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 41465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-06-09T04:26:40.597 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-06-09T04:26:40.597 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/mei/ 2023-06-09T04:26:40.597 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 124401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/mei/mei-me.ko 2023-06-09T04:26:40.597 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 56337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/mei/mei-txe.ko 2023-06-09T04:26:40.597 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 304353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/mei/mei.ko 2023-06-09T04:26:40.597 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 31161 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/phantom.ko 2023-06-09T04:26:40.598 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/ti-st/ 2023-06-09T04:26:40.598 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 74433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/ti-st/st_drv.ko 2023-06-09T04:26:40.598 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 24193 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/tifm_7xx1.ko 2023-06-09T04:26:40.598 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 27305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/tifm_core.ko 2023-06-09T04:26:40.598 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 18617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/tsl2550.ko 2023-06-09T04:26:40.598 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 48569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/vmw_balloon.ko 2023-06-09T04:26:40.598 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/vmw_vmci/ 2023-06-09T04:26:40.598 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 180697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-06-09T04:26:40.599 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ 2023-06-09T04:26:40.599 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/bonding/ 2023-06-09T04:26:40.599 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 487817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/bonding/bonding.ko 2023-06-09T04:26:40.599 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/dsa/ 2023-06-09T04:26:40.599 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/dsa/b53/ 2023-06-09T04:26:40.599 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 101961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/dsa/b53/b53_common.ko 2023-06-09T04:26:40.599 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 40097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/dsa/bcm-sf2.ko 2023-06-09T04:26:40.599 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 14513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/dsa/mv88e6060.ko 2023-06-09T04:26:40.600 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/dsa/mv88e6xxx/ 2023-06-09T04:26:40.600 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 447113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-06-09T04:26:40.600 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 16753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/dummy.ko 2023-06-09T04:26:40.600 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 17769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/eql.ko 2023-06-09T04:26:40.600 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/ 2023-06-09T04:26:40.600 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/3com/ 2023-06-09T04:26:40.600 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 45609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-06-09T04:26:40.601 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 41905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-06-09T04:26:40.601 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 130385 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-06-09T04:26:40.601 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 68681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-06-09T04:26:40.601 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/8390/ 2023-06-09T04:26:40.601 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 36345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/8390/8390.ko 2023-06-09T04:26:40.601 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 59513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-06-09T04:26:40.601 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 27017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-06-09T04:26:40.601 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 98945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-06-09T04:26:40.602 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/adaptec/ 2023-06-09T04:26:40.602 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 54353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-06-09T04:26:40.602 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/agere/ 2023-06-09T04:26:40.602 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 69033 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/agere/et131x.ko 2023-06-09T04:26:40.602 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/alteon/ 2023-06-09T04:26:40.602 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 59401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-06-09T04:26:40.602 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/altera/ 2023-06-09T04:26:40.602 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 40649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-06-09T04:26:40.603 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/amd/ 2023-06-09T04:26:40.603 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 54441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-06-09T04:26:40.603 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 49105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-06-09T04:26:40.603 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 87177 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-06-09T04:26:40.603 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/atheros/ 2023-06-09T04:26:40.603 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/atheros/alx/ 2023-06-09T04:26:40.603 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 97217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-06-09T04:26:40.604 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-06-09T04:26:40.604 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 104473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-06-09T04:26:40.604 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-06-09T04:26:40.604 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 90073 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-06-09T04:26:40.604 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/atheros/atlx/ 2023-06-09T04:26:40.604 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 81329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-06-09T04:26:40.604 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 69601 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-06-09T04:26:40.604 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/broadcom/ 2023-06-09T04:26:40.605 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 78233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-06-09T04:26:40.605 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 176705 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-06-09T04:26:40.605 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-06-09T04:26:40.605 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 1422001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-06-09T04:26:40.605 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 127881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-06-09T04:26:40.605 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/broadcom/genet/ 2023-06-09T04:26:40.605 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 130785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-06-09T04:26:40.605 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 311913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-06-09T04:26:40.606 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/brocade/ 2023-06-09T04:26:40.606 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/brocade/bna/ 2023-06-09T04:26:40.606 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 323489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-06-09T04:26:40.665 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/ 2023-06-09T04:26:40.665 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-06-09T04:26:40.665 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 193321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-06-09T04:26:40.665 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-06-09T04:26:40.666 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 345761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-06-09T04:26:40.666 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-06-09T04:26:40.666 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 1038865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-06-09T04:26:40.666 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-06-09T04:26:40.666 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 166001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-06-09T04:26:40.666 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-06-09T04:26:40.666 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 33681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-06-09T04:26:40.666 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/cisco/ 2023-06-09T04:26:40.667 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/cisco/enic/ 2023-06-09T04:26:40.667 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 203425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-06-09T04:26:40.667 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dec/ 2023-06-09T04:26:40.667 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dec/tulip/ 2023-06-09T04:26:40.667 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 69281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-06-09T04:26:40.668 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 61321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-06-09T04:26:40.668 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 141049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-06-09T04:26:40.668 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 51329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-06-09T04:26:40.668 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 62689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-06-09T04:26:40.668 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 31201 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-06-09T04:26:40.668 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dlink/ 2023-06-09T04:26:40.669 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 60697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-06-09T04:26:40.669 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 62721 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-06-09T04:26:40.669 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 45609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/dnet.ko 2023-06-09T04:26:40.669 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 25057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/ec_bhf.ko 2023-06-09T04:26:40.669 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/emulex/ 2023-06-09T04:26:40.669 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/emulex/benet/ 2023-06-09T04:26:40.669 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 280865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-06-09T04:26:40.670 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 49321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/ethoc.ko 2023-06-09T04:26:40.670 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 51625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/fealnx.ko 2023-06-09T04:26:40.670 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/fujitsu/ 2023-06-09T04:26:40.670 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 45161 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-06-09T04:26:40.670 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/ 2023-06-09T04:26:40.670 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 90297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/e100.ko 2023-06-09T04:26:40.670 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/e1000/ 2023-06-09T04:26:40.671 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 295609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-06-09T04:26:40.671 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/e1000e/ 2023-06-09T04:26:40.671 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 583881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-06-09T04:26:40.671 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/fm10k/ 2023-06-09T04:26:40.671 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 246201 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-06-09T04:26:40.671 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/i40e/ 2023-06-09T04:26:40.671 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 922281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-06-09T04:26:40.672 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/iavf/ 2023-06-09T04:26:40.672 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 301665 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-06-09T04:26:40.672 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/igb/ 2023-06-09T04:26:40.672 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 514281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-06-09T04:26:40.672 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/igbvf/ 2023-06-09T04:26:40.672 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 93481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-06-09T04:26:40.673 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-06-09T04:26:40.673 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 733977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-06-09T04:26:40.673 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-06-09T04:26:40.673 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 151753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-06-09T04:26:40.673 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 86737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/jme.ko 2023-06-09T04:26:40.673 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/marvell/ 2023-06-09T04:26:40.673 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 20857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-06-09T04:26:40.674 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 102273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/marvell/skge.ko 2023-06-09T04:26:40.674 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 122577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-06-09T04:26:40.674 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/mellanox/ 2023-06-09T04:26:40.674 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-06-09T04:26:40.674 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 710297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-06-09T04:26:40.674 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 280409 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-06-09T04:26:40.674 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-06-09T04:26:40.674 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-06-09T04:26:40.675 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 1050633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-06-09T04:26:40.675 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/micrel/ 2023-06-09T04:26:40.675 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 52929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-06-09T04:26:40.675 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 40345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-06-09T04:26:40.675 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 19449 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-06-09T04:26:40.675 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 95497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-06-09T04:26:40.675 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/myricom/ 2023-06-09T04:26:40.676 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-06-09T04:26:40.676 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 108641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-06-09T04:26:40.676 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/natsemi/ 2023-06-09T04:26:40.676 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 73273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-06-09T04:26:40.676 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 47601 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-06-09T04:26:40.676 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/neterion/ 2023-06-09T04:26:40.677 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 150737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-06-09T04:26:40.677 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/nvidia/ 2023-06-09T04:26:40.677 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 136609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-06-09T04:26:40.677 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/packetengines/ 2023-06-09T04:26:40.678 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 50305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-06-09T04:26:40.678 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 42977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-06-09T04:26:40.678 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/qlogic/ 2023-06-09T04:26:40.678 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-06-09T04:26:40.679 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 226993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-06-09T04:26:40.679 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 86913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-06-09T04:26:40.679 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-06-09T04:26:40.679 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 671281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-06-09T04:26:40.680 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/rdc/ 2023-06-09T04:26:40.680 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 42849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-06-09T04:26:40.680 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/realtek/ 2023-06-09T04:26:40.680 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 67209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-06-09T04:26:40.681 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 83809 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-06-09T04:26:40.681 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 29217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/realtek/atp.ko 2023-06-09T04:26:40.681 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 189649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-06-09T04:26:40.682 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/samsung/ 2023-06-09T04:26:40.682 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-06-09T04:26:40.682 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 104065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-06-09T04:26:40.682 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/sfc/ 2023-06-09T04:26:40.683 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 893521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-06-09T04:26:40.683 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/silan/ 2023-06-09T04:26:40.683 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 47057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-06-09T04:26:40.683 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/sis/ 2023-06-09T04:26:40.684 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 54633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/sis/sis190.ko 2023-06-09T04:26:40.684 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 63169 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/sis/sis900.ko 2023-06-09T04:26:40.684 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/smsc/ 2023-06-09T04:26:40.684 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 61433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-06-09T04:26:40.685 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 67009 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-06-09T04:26:40.685 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 73233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-06-09T04:26:40.685 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 68105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-06-09T04:26:40.686 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/stmicro/ 2023-06-09T04:26:40.686 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-06-09T04:26:40.686 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-06-09T04:26:40.686 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 39961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-06-09T04:26:40.686 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13777 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-06-09T04:26:40.687 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 480697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-06-09T04:26:40.687 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/sun/ 2023-06-09T04:26:40.687 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 103273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/sun/cassini.ko 2023-06-09T04:26:40.687 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 166001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/sun/niu.ko 2023-06-09T04:26:40.687 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 66361 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/sun/sungem.ko 2023-06-09T04:26:40.688 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 78633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-06-09T04:26:40.688 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/tehuti/ 2023-06-09T04:26:40.688 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 49873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-06-09T04:26:40.689 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/ti/ 2023-06-09T04:26:40.689 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 86353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/ti/tlan.ko 2023-06-09T04:26:40.689 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/via/ 2023-06-09T04:26:40.689 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 80153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-06-09T04:26:40.690 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 83497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-06-09T04:26:40.690 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/wiznet/ 2023-06-09T04:26:40.690 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 45609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-06-09T04:26:40.690 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 30665 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-06-09T04:26:40.691 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/xircom/ 2023-06-09T04:26:40.691 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 59929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-06-09T04:26:40.691 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/fddi/ 2023-06-09T04:26:40.691 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 40889 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/fddi/defxx.ko 2023-06-09T04:26:40.692 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/fddi/skfp/ 2023-06-09T04:26:40.692 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 216801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/fddi/skfp/skfp.ko 2023-06-09T04:26:40.692 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 76993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/geneve.ko 2023-06-09T04:26:40.693 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/hyperv/ 2023-06-09T04:26:40.693 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 234441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-06-09T04:26:40.693 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ieee802154/ 2023-06-09T04:26:40.693 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 18137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ieee802154/fakelb.ko 2023-06-09T04:26:40.694 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 24969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ifb.ko 2023-06-09T04:26:40.694 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ipvlan/ 2023-06-09T04:26:40.694 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 82865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ipvlan/ipvlan.ko 2023-06-09T04:26:40.694 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 61337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/macvlan.ko 2023-06-09T04:26:40.695 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 15697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/macvtap.ko 2023-06-09T04:26:40.695 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/mdio/ 2023-06-09T04:26:40.695 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 19697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-06-09T04:26:40.695 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-06-09T04:26:40.696 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/mdio/mdio-gpio.ko 2023-06-09T04:26:40.696 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 15049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/mdio.ko 2023-06-09T04:26:40.696 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 19225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/mii.ko 2023-06-09T04:26:40.696 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 41585 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/netconsole.ko 2023-06-09T04:26:40.697 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 12969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/nlmon.ko 2023-06-09T04:26:40.697 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/pcs/ 2023-06-09T04:26:40.697 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 9417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/pcs/pcs-altera-tse.ko 2023-06-09T04:26:40.697 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 29601 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-06-09T04:26:40.698 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/ 2023-06-09T04:26:40.698 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 9561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/amd.ko 2023-06-09T04:26:40.698 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 40329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-06-09T04:26:40.698 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 43161 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/bcm7xxx.ko 2023-06-09T04:26:40.699 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/bcm87xx.ko 2023-06-09T04:26:40.699 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 37921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/broadcom.ko 2023-06-09T04:26:40.699 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10457 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/cicada.ko 2023-06-09T04:26:40.700 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 12793 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/davicom.ko 2023-06-09T04:26:40.700 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 9273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/et1011c.ko 2023-06-09T04:26:40.700 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 24729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/icplus.ko 2023-06-09T04:26:40.700 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 15609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/lxt.ko 2023-06-09T04:26:40.701 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 78001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/marvell.ko 2023-06-09T04:26:40.701 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 75689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/micrel.ko 2023-06-09T04:26:40.701 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/national.ko 2023-06-09T04:26:40.701 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 92049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/phylink.ko 2023-06-09T04:26:40.702 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 9889 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/qsemi.ko 2023-06-09T04:26:40.702 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 47505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/realtek.ko 2023-06-09T04:26:40.702 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 24745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/smsc.ko 2023-06-09T04:26:40.702 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/ste10Xp.ko 2023-06-09T04:26:40.703 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 23865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/phy/vitesse.ko 2023-06-09T04:26:40.703 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/plip/ 2023-06-09T04:26:40.703 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 43353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/plip/plip.ko 2023-06-09T04:26:40.703 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ppp/ 2023-06-09T04:26:40.704 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 15753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ppp/bsd_comp.ko 2023-06-09T04:26:40.704 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 29745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ppp/ppp_async.ko 2023-06-09T04:26:40.704 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 17489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ppp/ppp_deflate.ko 2023-06-09T04:26:40.705 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 18513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ppp/ppp_mppe.ko 2023-06-09T04:26:40.705 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 28769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ppp/ppp_synctty.ko 2023-06-09T04:26:40.705 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 42425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ppp/pppoe.ko 2023-06-09T04:26:40.705 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 12633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ppp/pppox.ko 2023-06-09T04:26:40.706 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 31657 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/ppp/pptp.ko 2023-06-09T04:26:40.706 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 28105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/sb1000.ko 2023-06-09T04:26:40.706 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/slip/ 2023-06-09T04:26:40.706 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 42329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/slip/slip.ko 2023-06-09T04:26:40.707 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 26529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/sungem_phy.ko 2023-06-09T04:26:40.707 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 63785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/tap.ko 2023-06-09T04:26:40.707 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/team/ 2023-06-09T04:26:40.707 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 104617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/team/team.ko 2023-06-09T04:26:40.708 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/team/team_mode_activebackup.ko 2023-06-09T04:26:40.708 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/team/team_mode_broadcast.ko 2023-06-09T04:26:40.708 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 28825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-06-09T04:26:40.708 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 9537 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/team/team_mode_random.ko 2023-06-09T04:26:40.708 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 9145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-06-09T04:26:40.708 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 89249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/veth.ko 2023-06-09T04:26:40.709 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/vmxnet3/ 2023-06-09T04:26:40.709 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 120377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-06-09T04:26:40.709 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/vxlan/ 2023-06-09T04:26:40.709 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 290049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/vxlan/vxlan.ko 2023-06-09T04:26:40.709 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/xen-netback/ 2023-06-09T04:26:40.709 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 143697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/net/xen-netback/xen-netback.ko 2023-06-09T04:26:40.709 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ntb/ 2023-06-09T04:26:40.709 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 19425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ntb/ntb.ko 2023-06-09T04:26:40.710 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/nvme/ 2023-06-09T04:26:40.710 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/nvme/host/ 2023-06-09T04:26:40.710 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 255881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/nvme/host/nvme-core.ko 2023-06-09T04:26:40.710 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 101449 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/nvme/host/nvme.ko 2023-06-09T04:26:40.710 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/parport/ 2023-06-09T04:26:40.710 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 129017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/parport/parport.ko 2023-06-09T04:26:40.710 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 14441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/parport/parport_cs.ko 2023-06-09T04:26:40.710 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 83833 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/parport/parport_pc.ko 2023-06-09T04:26:40.711 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 25945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/parport/parport_serial.ko 2023-06-09T04:26:40.711 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pci/ 2023-06-09T04:26:40.711 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pci/hotplug/ 2023-06-09T04:26:40.711 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 24825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-06-09T04:26:40.711 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 17681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-06-09T04:26:40.711 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 19953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-06-09T04:26:40.711 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pci/pci-stub.ko 2023-06-09T04:26:40.712 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 47265 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pci/xen-pcifront.ko 2023-06-09T04:26:40.712 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pcmcia/ 2023-06-09T04:26:40.712 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 26625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pcmcia/i82092.ko 2023-06-09T04:26:40.712 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 143593 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pcmcia/pcmcia.ko 2023-06-09T04:26:40.712 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 60529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pcmcia/pcmcia_core.ko 2023-06-09T04:26:40.712 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 33761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-06-09T04:26:40.712 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 34081 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pcmcia/pd6729.ko 2023-06-09T04:26:40.713 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 112801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pcmcia/yenta_socket.ko 2023-06-09T04:26:40.713 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/phy/ 2023-06-09T04:26:40.713 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/phy/broadcom/ 2023-06-09T04:26:40.713 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10673 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-06-09T04:26:40.713 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/phy/samsung/ 2023-06-09T04:26:40.713 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 8273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-06-09T04:26:40.713 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pinctrl/ 2023-06-09T04:26:40.714 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pinctrl/intel/ 2023-06-09T04:26:40.714 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 70889 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-06-09T04:26:40.714 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/ 2023-06-09T04:26:40.714 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/chrome/ 2023-06-09T04:26:40.714 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 49689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-06-09T04:26:40.714 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 20057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/chrome/cros_ec.ko 2023-06-09T04:26:40.714 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 21233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-06-09T04:26:40.714 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 25241 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-06-09T04:26:40.715 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 26049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-06-09T04:26:40.715 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 18089 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-06-09T04:26:40.715 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 16921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-06-09T04:26:40.715 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/ 2023-06-09T04:26:40.715 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 66913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/acer-wmi.ko 2023-06-09T04:26:40.715 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 39041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/acerhdf.ko 2023-06-09T04:26:40.715 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 36849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/apple-gmux.ko 2023-06-09T04:26:40.715 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 59545 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/asus-laptop.ko 2023-06-09T04:26:40.716 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 30529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-06-09T04:26:40.716 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 106217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/asus-wmi.ko 2023-06-09T04:26:40.716 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 36745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/classmate-laptop.ko 2023-06-09T04:26:40.716 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 48945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-06-09T04:26:40.716 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13841 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-06-09T04:26:40.716 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 40089 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-06-09T04:26:40.716 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 22417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-06-09T04:26:40.717 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 36473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/hdaps.ko 2023-06-09T04:26:40.717 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 19329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/ibm_rtl.ko 2023-06-09T04:26:40.717 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/intel/ 2023-06-09T04:26:40.717 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-06-09T04:26:40.717 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 8873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-06-09T04:26:40.717 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 43169 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/intel_ips.ko 2023-06-09T04:26:40.717 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 20089 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/msi-wmi.ko 2023-06-09T04:26:40.717 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 9745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/mxm-wmi.ko 2023-06-09T04:26:40.718 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 34617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-06-09T04:26:40.718 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 42145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/samsung-laptop.ko 2023-06-09T04:26:40.718 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/samsung-q10.ko 2023-06-09T04:26:40.718 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 17137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/topstar-laptop.ko 2023-06-09T04:26:40.718 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13545 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-06-09T04:26:40.718 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 16897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/toshiba_haps.ko 2023-06-09T04:26:40.718 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/wmi-bmof.ko 2023-06-09T04:26:40.718 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 54713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/platform/x86/wmi.ko 2023-06-09T04:26:40.719 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/ 2023-06-09T04:26:40.719 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/ 2023-06-09T04:26:40.719 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 30161 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/88pm860x_battery.ko 2023-06-09T04:26:40.719 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 33873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/88pm860x_charger.ko 2023-06-09T04:26:40.719 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 54945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/bq2415x_charger.ko 2023-06-09T04:26:40.719 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 53849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/bq24190_charger.ko 2023-06-09T04:26:40.719 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 21385 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/bq24735-charger.ko 2023-06-09T04:26:40.720 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 16329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-06-09T04:26:40.720 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 19425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/da9030_battery.ko 2023-06-09T04:26:40.720 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 19665 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/da9052-battery.ko 2023-06-09T04:26:40.720 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 29169 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/ds2760_battery.ko 2023-06-09T04:26:40.720 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 23097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/ds2780_battery.ko 2023-06-09T04:26:40.720 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 23241 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/ds2781_battery.ko 2023-06-09T04:26:40.720 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 23537 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/ds2782_battery.ko 2023-06-09T04:26:40.720 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 20177 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/gpio-charger.ko 2023-06-09T04:26:40.721 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 17937 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/isp1704_charger.ko 2023-06-09T04:26:40.721 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 20097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/lp8727_charger.ko 2023-06-09T04:26:40.721 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 12473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/max14577_charger.ko 2023-06-09T04:26:40.721 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 25777 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/max17040_battery.ko 2023-06-09T04:26:40.721 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 30353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/max17042_battery.ko 2023-06-09T04:26:40.721 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 18417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/max8903_charger.ko 2023-06-09T04:26:40.721 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 23617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/max8925_power.ko 2023-06-09T04:26:40.721 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 21057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/pcf50633-charger.ko 2023-06-09T04:26:40.722 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 37825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/sbs-battery.ko 2023-06-09T04:26:40.722 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 28209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/test_power.ko 2023-06-09T04:26:40.722 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 18689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/tps65090-charger.ko 2023-06-09T04:26:40.722 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/wm831x_backup.ko 2023-06-09T04:26:40.722 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 24345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/wm831x_power.ko 2023-06-09T04:26:40.722 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 22297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/power/supply/wm8350_power.ko 2023-06-09T04:26:40.722 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/powercap/ 2023-06-09T04:26:40.723 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 54041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/powercap/intel_rapl_common.ko 2023-06-09T04:26:40.723 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 17193 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/powercap/intel_rapl_msr.ko 2023-06-09T04:26:40.723 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pps/ 2023-06-09T04:26:40.723 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pps/clients/ 2023-06-09T04:26:40.723 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 15353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pps/clients/pps-gpio.ko 2023-06-09T04:26:40.723 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13081 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pps/clients/pps-ldisc.ko 2023-06-09T04:26:40.723 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 15745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pps/clients/pps_parport.ko 2023-06-09T04:26:40.723 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 41273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/pps/pps_core.ko 2023-06-09T04:26:40.724 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ptp/ 2023-06-09T04:26:40.724 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 64505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ptp/ptp.ko 2023-06-09T04:26:40.724 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 16345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ptp/ptp_kvm.ko 2023-06-09T04:26:40.724 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/ 2023-06-09T04:26:40.724 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 23321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-88pm80x.ko 2023-06-09T04:26:40.724 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 24409 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-88pm860x.ko 2023-06-09T04:26:40.724 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 15273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-bq32k.ko 2023-06-09T04:26:40.725 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 12785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-bq4802.ko 2023-06-09T04:26:40.725 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 19993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-da9052.ko 2023-06-09T04:26:40.725 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 18393 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-da9055.ko 2023-06-09T04:26:40.725 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 20065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-da9063.ko 2023-06-09T04:26:40.725 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 16337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-ds1286.ko 2023-06-09T04:26:40.725 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 68401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-ds1307.ko 2023-06-09T04:26:40.725 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 20705 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-ds1374.ko 2023-06-09T04:26:40.725 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 18041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-ds1511.ko 2023-06-09T04:26:40.726 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 16561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-ds1553.ko 2023-06-09T04:26:40.726 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13833 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-ds1672.ko 2023-06-09T04:26:40.726 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13265 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-ds1742.ko 2023-06-09T04:26:40.726 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 17129 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-ds2404.ko 2023-06-09T04:26:40.726 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 23529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-ds3232.ko 2023-06-09T04:26:40.726 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-em3027.ko 2023-06-09T04:26:40.726 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 24217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-fm3130.ko 2023-06-09T04:26:40.726 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 17593 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-isl12022.ko 2023-06-09T04:26:40.727 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 35089 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-isl1208.ko 2023-06-09T04:26:40.727 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 14561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-lp8788.ko 2023-06-09T04:26:40.727 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 37977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-m41t80.ko 2023-06-09T04:26:40.727 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-m48t35.ko 2023-06-09T04:26:40.727 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 25761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-m48t59.ko 2023-06-09T04:26:40.727 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 14065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-m48t86.ko 2023-06-09T04:26:40.727 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-max6900.ko 2023-06-09T04:26:40.727 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 14553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-max8907.ko 2023-06-09T04:26:40.728 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 15225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-max8925.ko 2023-06-09T04:26:40.728 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 25633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-max8997.ko 2023-06-09T04:26:40.728 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 16569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-max8998.ko 2023-06-09T04:26:40.728 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 18345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-06-09T04:26:40.728 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-msm6242.ko 2023-06-09T04:26:40.728 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 19513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-palmas.ko 2023-06-09T04:26:40.728 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 40009 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-pcf2127.ko 2023-06-09T04:26:40.729 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 17865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-pcf50633.ko 2023-06-09T04:26:40.729 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 26633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-pcf85063.ko 2023-06-09T04:26:40.729 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 21713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-pcf8523.ko 2023-06-09T04:26:40.729 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 29705 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-pcf8563.ko 2023-06-09T04:26:40.729 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 12321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-pcf8583.ko 2023-06-09T04:26:40.729 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 17849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-rc5t583.ko 2023-06-09T04:26:40.729 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 12945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-rp5c01.ko 2023-06-09T04:26:40.729 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 33633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-rs5c372.ko 2023-06-09T04:26:40.730 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 27649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-06-09T04:26:40.730 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 25153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-rx8025.ko 2023-06-09T04:26:40.730 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 19929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-rx8581.ko 2023-06-09T04:26:40.730 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 21497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-s35390a.ko 2023-06-09T04:26:40.730 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 16657 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-06-09T04:26:40.730 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 17713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-tps6586x.ko 2023-06-09T04:26:40.730 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 21425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-tps65910.ko 2023-06-09T04:26:40.730 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 20433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-wm831x.ko 2023-06-09T04:26:40.731 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 21169 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-wm8350.ko 2023-06-09T04:26:40.731 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 27761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/rtc/rtc-x1205.ko 2023-06-09T04:26:40.731 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/ 2023-06-09T04:26:40.731 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 77529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/3w-9xxx.ko 2023-06-09T04:26:40.731 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 57489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/3w-sas.ko 2023-06-09T04:26:40.731 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 55001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/3w-xxxx.ko 2023-06-09T04:26:40.731 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 134993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/BusLogic.ko 2023-06-09T04:26:40.731 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 26489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/a100u2w.ko 2023-06-09T04:26:40.732 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/aacraid/ 2023-06-09T04:26:40.732 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 271033 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/aacraid/aacraid.ko 2023-06-09T04:26:40.732 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 100513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/advansys.ko 2023-06-09T04:26:40.732 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/aic7xxx/ 2023-06-09T04:26:40.732 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 356081 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-06-09T04:26:40.732 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 295697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-06-09T04:26:40.732 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/aic94xx/ 2023-06-09T04:26:40.733 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 189145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-06-09T04:26:40.733 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 23889 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/am53c974.ko 2023-06-09T04:26:40.733 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/arcmsr/ 2023-06-09T04:26:40.733 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 106465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-06-09T04:26:40.733 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 38065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/atp870u.ko 2023-06-09T04:26:40.733 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/be2iscsi/ 2023-06-09T04:26:40.733 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 246785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-06-09T04:26:40.733 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/bfa/ 2023-06-09T04:26:40.734 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 1172073 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/bfa/bfa.ko 2023-06-09T04:26:40.734 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/bnx2fc/ 2023-06-09T04:26:40.734 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 237057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-06-09T04:26:40.734 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/bnx2i/ 2023-06-09T04:26:40.734 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 115289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-06-09T04:26:40.734 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 40433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/ch.ko 2023-06-09T04:26:40.734 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/csiostor/ 2023-06-09T04:26:40.734 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 308721 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/csiostor/csiostor.ko 2023-06-09T04:26:40.735 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/cxgbi/ 2023-06-09T04:26:40.735 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-06-09T04:26:40.735 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 76017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-06-09T04:26:40.735 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-06-09T04:26:40.735 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 101337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-06-09T04:26:40.735 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 141697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-06-09T04:26:40.735 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 75425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/dc395x.ko 2023-06-09T04:26:40.735 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 37937 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/dmx3191d.ko 2023-06-09T04:26:40.736 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/esas2r/ 2023-06-09T04:26:40.736 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 212297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/esas2r/esas2r.ko 2023-06-09T04:26:40.736 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 59825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/esp_scsi.ko 2023-06-09T04:26:40.736 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/fcoe/ 2023-06-09T04:26:40.736 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 78105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/fcoe/fcoe.ko 2023-06-09T04:26:40.736 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 154921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-06-09T04:26:40.736 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 18465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/fdomain.ko 2023-06-09T04:26:40.737 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/fnic/ 2023-06-09T04:26:40.737 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 261961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/fnic/fnic.ko 2023-06-09T04:26:40.737 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 201689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/hpsa.ko 2023-06-09T04:26:40.737 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 51041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/hptiop.ko 2023-06-09T04:26:40.738 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 49041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/hv_storvsc.ko 2023-06-09T04:26:40.738 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 35201 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/imm.ko 2023-06-09T04:26:40.738 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 43953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/initio.ko 2023-06-09T04:26:40.738 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 266409 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/ipr.ko 2023-06-09T04:26:40.739 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 101769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/ips.ko 2023-06-09T04:26:40.739 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/isci/ 2023-06-09T04:26:40.739 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 317137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/isci/isci.ko 2023-06-09T04:26:40.739 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 25345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-06-09T04:26:40.740 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 52529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/iscsi_tcp.ko 2023-06-09T04:26:40.740 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/libfc/ 2023-06-09T04:26:40.740 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 308257 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/libfc/libfc.ko 2023-06-09T04:26:40.740 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 140057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/libiscsi.ko 2023-06-09T04:26:40.741 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 51529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/libiscsi_tcp.ko 2023-06-09T04:26:40.741 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/libsas/ 2023-06-09T04:26:40.741 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 212865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/libsas/libsas.ko 2023-06-09T04:26:40.741 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/lpfc/ 2023-06-09T04:26:40.742 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 2193673 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/lpfc/lpfc.ko 2023-06-09T04:26:40.742 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/megaraid/ 2023-06-09T04:26:40.742 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 73433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-06-09T04:26:40.743 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 32913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-06-09T04:26:40.743 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 310561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-06-09T04:26:40.743 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 84585 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/megaraid.ko 2023-06-09T04:26:40.744 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/mpt3sas/ 2023-06-09T04:26:40.744 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 659401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-06-09T04:26:40.744 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/mvsas/ 2023-06-09T04:26:40.744 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 119745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/mvsas/mvsas.ko 2023-06-09T04:26:40.745 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 77985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/mvumi.ko 2023-06-09T04:26:40.745 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/pcmcia/ 2023-06-09T04:26:40.745 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 81433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-06-09T04:26:40.745 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11601 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-06-09T04:26:40.746 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 20689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-06-09T04:26:40.746 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 23681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-06-09T04:26:40.746 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/pm8001/ 2023-06-09T04:26:40.746 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 361249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-06-09T04:26:40.746 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 123377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/pmcraid.ko 2023-06-09T04:26:40.747 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 33497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/ppa.ko 2023-06-09T04:26:40.747 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 55161 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/qla1280.ko 2023-06-09T04:26:40.747 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/qla2xxx/ 2023-06-09T04:26:40.747 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 1850585 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-06-09T04:26:40.748 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 85145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-06-09T04:26:40.748 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/qla4xxx/ 2023-06-09T04:26:40.748 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 558681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-06-09T04:26:40.749 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 17713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/qlogicfas408.ko 2023-06-09T04:26:40.749 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 18393 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/raid_class.ko 2023-06-09T04:26:40.749 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 238633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/scsi_debug.ko 2023-06-09T04:26:40.749 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 171753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/scsi_transport_fc.ko 2023-06-09T04:26:40.749 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 269985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-06-09T04:26:40.749 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 94177 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/scsi_transport_sas.ko 2023-06-09T04:26:40.749 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 72577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/scsi_transport_spi.ko 2023-06-09T04:26:40.750 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 43425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/scsi_transport_srp.ko 2023-06-09T04:26:40.750 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 26145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/ses.ko 2023-06-09T04:26:40.750 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 115665 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/st.ko 2023-06-09T04:26:40.750 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 46649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/stex.ko 2023-06-09T04:26:40.750 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/sym53c8xx_2/ 2023-06-09T04:26:40.750 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 161953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-06-09T04:26:40.750 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 42249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/virtio_scsi.ko 2023-06-09T04:26:40.750 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 50193 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/vmw_pvscsi.ko 2023-06-09T04:26:40.751 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 39833 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/wd719x.ko 2023-06-09T04:26:40.751 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 49921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/scsi/xen-scsifront.ko 2023-06-09T04:26:40.751 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ssb/ 2023-06-09T04:26:40.751 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 126913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ssb/ssb.ko 2023-06-09T04:26:40.751 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/ 2023-06-09T04:26:40.751 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/iscsi/ 2023-06-09T04:26:40.751 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 731481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-06-09T04:26:40.752 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/loopback/ 2023-06-09T04:26:40.752 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 49801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/loopback/tcm_loop.ko 2023-06-09T04:26:40.752 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 39465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/target_core_file.ko 2023-06-09T04:26:40.752 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 38281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/target_core_iblock.ko 2023-06-09T04:26:40.752 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 920681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/target_core_mod.ko 2023-06-09T04:26:40.752 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 44153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/target_core_pscsi.ko 2023-06-09T04:26:40.752 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 122425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/target_core_user.ko 2023-06-09T04:26:40.753 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/tcm_fc/ 2023-06-09T04:26:40.753 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 75537 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-06-09T04:26:40.753 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/ 2023-06-09T04:26:40.753 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/ 2023-06-09T04:26:40.753 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/ 2023-06-09T04:26:40.753 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 18929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-06-09T04:26:40.753 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 28881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-06-09T04:26:40.753 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 9841 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-06-09T04:26:40.754 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10081 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-06-09T04:26:40.754 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 14905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-06-09T04:26:40.754 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 15897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-06-09T04:26:40.754 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 25977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-06-09T04:26:40.754 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 20097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-06-09T04:26:40.754 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 14745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-06-09T04:26:40.754 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-06-09T04:26:40.754 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 12417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-06-09T04:26:40.755 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 36561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-06-09T04:26:40.755 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 30625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-06-09T04:26:40.755 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 20985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-06-09T04:26:40.755 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-06-09T04:26:40.755 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 26369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-06-09T04:26:40.755 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/ 2023-06-09T04:26:40.755 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/ipwireless/ 2023-06-09T04:26:40.755 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 77969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-06-09T04:26:40.756 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 57697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/moxa.ko 2023-06-09T04:26:40.756 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 50617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/mxser.ko 2023-06-09T04:26:40.756 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 107377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/n_gsm.ko 2023-06-09T04:26:40.756 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 31833 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/n_hdlc.ko 2023-06-09T04:26:40.756 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 67961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/nozomi.ko 2023-06-09T04:26:40.756 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/ 2023-06-09T04:26:40.756 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/8250/ 2023-06-09T04:26:40.757 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 35561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-06-09T04:26:40.757 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 59385 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-06-09T04:26:40.757 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 18105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-06-09T04:26:40.757 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 22281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/altera_uart.ko 2023-06-09T04:26:40.757 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 9321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/arc_uart.ko 2023-06-09T04:26:40.757 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 70177 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-06-09T04:26:40.757 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/jsm/ 2023-06-09T04:26:40.758 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 102841 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/jsm/jsm.ko 2023-06-09T04:26:40.758 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 28673 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/rp2.ko 2023-06-09T04:26:40.758 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 52025 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/serial/sc16is7xx.ko 2023-06-09T04:26:40.758 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 100001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/tty/synclink_gt.ko 2023-06-09T04:26:40.758 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ufs/ 2023-06-09T04:26:40.758 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ufs/core/ 2023-06-09T04:26:40.758 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 519233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ufs/core/ufshcd-core.ko 2023-06-09T04:26:40.758 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ufs/host/ 2023-06-09T04:26:40.759 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 28425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-06-09T04:26:40.759 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 14441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-06-09T04:26:40.759 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/uio/ 2023-06-09T04:26:40.759 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 43857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/uio/uio.ko 2023-06-09T04:26:40.759 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 12129 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/uio/uio_aec.ko 2023-06-09T04:26:40.759 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/uio/uio_cif.ko 2023-06-09T04:26:40.759 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 18217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/uio/uio_dmem_genirq.ko 2023-06-09T04:26:40.759 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 12825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/uio/uio_mf624.ko 2023-06-09T04:26:40.760 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 12001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/uio/uio_netx.ko 2023-06-09T04:26:40.760 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/uio/uio_pci_generic.ko 2023-06-09T04:26:40.760 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 15873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-06-09T04:26:40.760 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/uio/uio_sercos3.ko 2023-06-09T04:26:40.760 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/ 2023-06-09T04:26:40.760 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/c67x00/ 2023-06-09T04:26:40.760 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 73097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/c67x00/c67x00.ko 2023-06-09T04:26:40.761 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/chipidea/ 2023-06-09T04:26:40.761 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 142417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-06-09T04:26:40.761 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 18385 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-06-09T04:26:40.761 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 12529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-06-09T04:26:40.761 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 12833 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-06-09T04:26:40.761 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/class/ 2023-06-09T04:26:40.761 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 85345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/class/cdc-acm.ko 2023-06-09T04:26:40.761 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 51001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/class/cdc-wdm.ko 2023-06-09T04:26:40.762 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 47353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/class/usblp.ko 2023-06-09T04:26:40.762 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 89729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/class/usbtmc.ko 2023-06-09T04:26:40.762 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/common/ 2023-06-09T04:26:40.762 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 22145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/common/ulpi.ko 2023-06-09T04:26:40.762 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/dwc2/ 2023-06-09T04:26:40.762 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11705 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-06-09T04:26:40.762 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/dwc3/ 2023-06-09T04:26:40.762 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-06-09T04:26:40.763 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 29753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-06-09T04:26:40.763 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 438457 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/dwc3/dwc3.ko 2023-06-09T04:26:40.763 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/ 2023-06-09T04:26:40.763 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/ 2023-06-09T04:26:40.763 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 57753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/u_ether.ko 2023-06-09T04:26:40.763 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 50193 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/u_serial.ko 2023-06-09T04:26:40.763 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 28929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-06-09T04:26:40.763 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 42473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-06-09T04:26:40.764 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 27977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-06-09T04:26:40.764 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 36465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-06-09T04:26:40.764 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 91705 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-06-09T04:26:40.764 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 50865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-06-09T04:26:40.764 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 117913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-06-09T04:26:40.764 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 57753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-06-09T04:26:40.764 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 22233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-06-09T04:26:40.765 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 31153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-06-09T04:26:40.765 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 57761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-06-09T04:26:40.765 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 84017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-06-09T04:26:40.765 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 19401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-06-09T04:26:40.765 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 58321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-06-09T04:26:40.765 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 67169 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-06-09T04:26:40.765 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/ 2023-06-09T04:26:40.765 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 21081 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-06-09T04:26:40.766 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 17945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-06-09T04:26:40.766 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 18361 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-06-09T04:26:40.766 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 21473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-06-09T04:26:40.766 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 28289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-06-09T04:26:40.766 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 18873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-06-09T04:26:40.767 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 20233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-06-09T04:26:40.767 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 16857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-06-09T04:26:40.767 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 31961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-06-09T04:26:40.767 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 16609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-06-09T04:26:40.767 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 19281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-06-09T04:26:40.767 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 27017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-06-09T04:26:40.768 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 61985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-06-09T04:26:40.768 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 15033 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-06-09T04:26:40.768 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 156905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/libcomposite.ko 2023-06-09T04:26:40.768 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/ 2023-06-09T04:26:40.768 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 16961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-06-09T04:26:40.768 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/bdc/ 2023-06-09T04:26:40.768 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 157545 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-06-09T04:26:40.768 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 35953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-06-09T04:26:40.769 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 52825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-06-09T04:26:40.769 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 69577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-06-09T04:26:40.769 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 55833 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-06-09T04:26:40.769 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 75865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/net2272.ko 2023-06-09T04:26:40.769 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 74913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/net2280.ko 2023-06-09T04:26:40.769 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 73041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-06-09T04:26:40.769 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 65681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-06-09T04:26:40.770 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 65969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-06-09T04:26:40.770 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 80233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-06-09T04:26:40.770 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 145081 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-06-09T04:26:40.770 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/host/ 2023-06-09T04:26:40.770 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/host/bcma-hcd.ko 2023-06-09T04:26:40.770 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 79913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/host/isp116x-hcd.ko 2023-06-09T04:26:40.770 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 87505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-06-09T04:26:40.770 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 78745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-06-09T04:26:40.771 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 50969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/host/sl811-hcd.ko 2023-06-09T04:26:40.771 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 15489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/host/sl811_cs.ko 2023-06-09T04:26:40.771 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/host/ssb-hcd.ko 2023-06-09T04:26:40.771 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 25441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-06-09T04:26:40.771 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/image/ 2023-06-09T04:26:40.771 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 34417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/image/mdc800.ko 2023-06-09T04:26:40.771 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 20905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/image/microtek.ko 2023-06-09T04:26:40.772 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/ 2023-06-09T04:26:40.772 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 41665 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/adutux.ko 2023-06-09T04:26:40.772 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 20601 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/appledisplay.ko 2023-06-09T04:26:40.772 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 17609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-06-09T04:26:40.772 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 22929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/cytherm.ko 2023-06-09T04:26:40.772 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/ehset.ko 2023-06-09T04:26:40.772 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 14945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/emi26.ko 2023-06-09T04:26:40.773 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 15881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/emi62.ko 2023-06-09T04:26:40.773 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/ezusb.ko 2023-06-09T04:26:40.773 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 19113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/idmouse.ko 2023-06-09T04:26:40.773 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 36441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/iowarrior.ko 2023-06-09T04:26:40.773 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/isight_firmware.ko 2023-06-09T04:26:40.774 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 36409 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/ldusb.ko 2023-06-09T04:26:40.774 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 36153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/legousbtower.ko 2023-06-09T04:26:40.774 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 27673 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/lvstest.ko 2023-06-09T04:26:40.774 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/sisusbvga/ 2023-06-09T04:26:40.775 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 64665 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-06-09T04:26:40.775 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 12825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/trancevibrator.ko 2023-06-09T04:26:40.775 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 20289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/usb3503.ko 2023-06-09T04:26:40.775 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 25041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/usblcd.ko 2023-06-09T04:26:40.776 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 22569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/usbsevseg.ko 2023-06-09T04:26:40.776 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 70697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/usbtest.ko 2023-06-09T04:26:40.776 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 41777 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/uss720.ko 2023-06-09T04:26:40.777 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 27513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/misc/yurex.ko 2023-06-09T04:26:40.777 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/mon/ 2023-06-09T04:26:40.777 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 72801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/mon/usbmon.ko 2023-06-09T04:26:40.777 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/musb/ 2023-06-09T04:26:40.777 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 294937 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/musb/musb_hdrc.ko 2023-06-09T04:26:40.777 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/phy/ 2023-06-09T04:26:40.777 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 20281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/phy/phy-generic.ko 2023-06-09T04:26:40.778 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 20001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-06-09T04:26:40.778 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/phy/phy-isp1301.ko 2023-06-09T04:26:40.778 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 21561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/phy/phy-tahvo.ko 2023-06-09T04:26:40.778 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/ 2023-06-09T04:26:40.778 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/aircable.ko 2023-06-09T04:26:40.778 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 33249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/ark3116.ko 2023-06-09T04:26:40.778 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 26369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/belkin_sa.ko 2023-06-09T04:26:40.778 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 38081 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/ch341.ko 2023-06-09T04:26:40.779 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 69985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/cp210x.ko 2023-06-09T04:26:40.779 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 31057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/cyberjack.ko 2023-06-09T04:26:40.779 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 57817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/cypress_m8.ko 2023-06-09T04:26:40.779 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 49577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/digi_acceleport.ko 2023-06-09T04:26:40.779 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 9441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/empeg.ko 2023-06-09T04:26:40.779 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 43777 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/f81232.ko 2023-06-09T04:26:40.779 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 174729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/ftdi_sio.ko 2023-06-09T04:26:40.780 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 52593 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/garmin_gps.ko 2023-06-09T04:26:40.780 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 136761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/io_edgeport.ko 2023-06-09T04:26:40.780 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 124345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/io_ti.ko 2023-06-09T04:26:40.780 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 67649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/ipaq.ko 2023-06-09T04:26:40.780 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 18977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/ipw.ko 2023-06-09T04:26:40.780 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 26489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/ir-usb.ko 2023-06-09T04:26:40.780 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 57825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-06-09T04:26:40.780 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 107305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/keyspan.ko 2023-06-09T04:26:40.781 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 35153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/keyspan_pda.ko 2023-06-09T04:26:40.781 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 25329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/kl5kusb105.ko 2023-06-09T04:26:40.781 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 33345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/kobil_sct.ko 2023-06-09T04:26:40.781 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 32873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/mct_u232.ko 2023-06-09T04:26:40.781 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 21817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/metro-usb.ko 2023-06-09T04:26:40.781 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 66121 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/mos7720.ko 2023-06-09T04:26:40.781 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 77993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/mos7840.ko 2023-06-09T04:26:40.782 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 55889 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/mxuport.ko 2023-06-09T04:26:40.782 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13657 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/navman.ko 2023-06-09T04:26:40.782 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/omninet.ko 2023-06-09T04:26:40.782 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 24105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/opticon.ko 2023-06-09T04:26:40.782 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 187713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/option.ko 2023-06-09T04:26:40.782 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 38729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/oti6858.ko 2023-06-09T04:26:40.782 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 53953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/pl2303.ko 2023-06-09T04:26:40.782 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 9625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/qcaux.ko 2023-06-09T04:26:40.783 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 37713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/qcserial.ko 2023-06-09T04:26:40.783 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 34313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/quatech2.ko 2023-06-09T04:26:40.783 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 14633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/safe_serial.ko 2023-06-09T04:26:40.783 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 51185 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/sierra.ko 2023-06-09T04:26:40.783 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 21561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/spcp8x5.ko 2023-06-09T04:26:40.783 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 29737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/ssu100.ko 2023-06-09T04:26:40.783 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 16737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/symbolserial.ko 2023-06-09T04:26:40.783 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 60833 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-06-09T04:26:40.784 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 22625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-06-09T04:26:40.784 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/usb_debug.ko 2023-06-09T04:26:40.784 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 31881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/usb_wwan.ko 2023-06-09T04:26:40.784 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 122737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/usbserial.ko 2023-06-09T04:26:40.784 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 28577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/visor.ko 2023-06-09T04:26:40.784 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 37289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/whiteheat.ko 2023-06-09T04:26:40.784 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/wishbone-serial.ko 2023-06-09T04:26:40.785 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 9177 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/serial/xsens_mt.ko 2023-06-09T04:26:40.785 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ 2023-06-09T04:26:40.785 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 52737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/uas.ko 2023-06-09T04:26:40.785 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 25977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-alauda.ko 2023-06-09T04:26:40.785 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 12873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-cypress.ko 2023-06-09T04:26:40.785 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 21881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-datafab.ko 2023-06-09T04:26:40.785 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 33377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-06-09T04:26:40.785 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-freecom.ko 2023-06-09T04:26:40.786 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 19665 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-isd200.ko 2023-06-09T04:26:40.786 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 19193 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-06-09T04:26:40.786 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13537 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-karma.ko 2023-06-09T04:26:40.786 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 17729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-onetouch.ko 2023-06-09T04:26:40.786 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 28321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-realtek.ko 2023-06-09T04:26:40.786 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 28793 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-sddr09.ko 2023-06-09T04:26:40.786 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 19417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-sddr55.ko 2023-06-09T04:26:40.786 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 35233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/ums-usbat.ko 2023-06-09T04:26:40.787 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 176713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/storage/usb-storage.ko 2023-06-09T04:26:40.787 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/usbip/ 2023-06-09T04:26:40.787 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 65585 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/usbip/usbip-core.ko 2023-06-09T04:26:40.787 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 71329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/usbip/usbip-host.ko 2023-06-09T04:26:40.787 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 105225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-06-09T04:26:40.787 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vfio/ 2023-06-09T04:26:40.787 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vfio/pci/ 2023-06-09T04:26:40.788 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 145697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-06-09T04:26:40.788 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 29425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vfio/pci/vfio-pci.ko 2023-06-09T04:26:40.788 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 97857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vfio/vfio.ko 2023-06-09T04:26:40.788 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 72113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-06-09T04:26:40.788 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vhost/ 2023-06-09T04:26:40.788 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 96865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vhost/vhost.ko 2023-06-09T04:26:40.788 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 15689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vhost/vhost_iotlb.ko 2023-06-09T04:26:40.789 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 57985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vhost/vhost_net.ko 2023-06-09T04:26:40.789 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 85697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/vhost/vhost_scsi.ko 2023-06-09T04:26:40.789 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/ 2023-06-09T04:26:40.789 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/ 2023-06-09T04:26:40.789 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 15297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-06-09T04:26:40.789 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 12273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/aat2870_bl.ko 2023-06-09T04:26:40.790 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 23201 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/adp5520_bl.ko 2023-06-09T04:26:40.790 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 32433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/adp8860_bl.ko 2023-06-09T04:26:40.790 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 39873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/adp8870_bl.ko 2023-06-09T04:26:40.790 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 16809 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/apple_bl.ko 2023-06-09T04:26:40.790 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 16601 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/as3711_bl.ko 2023-06-09T04:26:40.790 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/bd6107.ko 2023-06-09T04:26:40.791 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/da903x_bl.ko 2023-06-09T04:26:40.791 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/da9052_bl.ko 2023-06-09T04:26:40.791 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/gpio_backlight.ko 2023-06-09T04:26:40.791 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 14657 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/kb3886_bl.ko 2023-06-09T04:26:40.791 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 21281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/lcd.ko 2023-06-09T04:26:40.791 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 23473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/lm3533_bl.ko 2023-06-09T04:26:40.791 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 19225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/lm3639_bl.ko 2023-06-09T04:26:40.791 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/lv5207lp.ko 2023-06-09T04:26:40.792 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 14233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/max8925_bl.ko 2023-06-09T04:26:40.792 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/pandora_bl.ko 2023-06-09T04:26:40.792 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-06-09T04:26:40.792 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10793 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/platform_lcd.ko 2023-06-09T04:26:40.792 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 12609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/video/backlight/wm831x_bl.ko 2023-06-09T04:26:40.792 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/ 2023-06-09T04:26:40.793 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/masters/ 2023-06-09T04:26:40.793 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 18673 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/masters/ds2482.ko 2023-06-09T04:26:40.793 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 38857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/masters/ds2490.ko 2023-06-09T04:26:40.793 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/masters/matrox_w1.ko 2023-06-09T04:26:40.794 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 12241 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/masters/w1-gpio.ko 2023-06-09T04:26:40.794 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/ 2023-06-09T04:26:40.794 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-06-09T04:26:40.794 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 22625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-06-09T04:26:40.795 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 14929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-06-09T04:26:40.795 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-06-09T04:26:40.795 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 14033 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-06-09T04:26:40.796 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-06-09T04:26:40.796 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-06-09T04:26:40.796 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-06-09T04:26:40.797 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 17801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-06-09T04:26:40.797 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 7209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_smem.ko 2023-06-09T04:26:40.797 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 56313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/slaves/w1_therm.ko 2023-06-09T04:26:40.798 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 101401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/w1/wire.ko 2023-06-09T04:26:40.798 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/ 2023-06-09T04:26:40.798 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 18689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/acquirewdt.ko 2023-06-09T04:26:40.798 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 19809 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/advantechwdt.ko 2023-06-09T04:26:40.799 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 18449 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/alim1535_wdt.ko 2023-06-09T04:26:40.799 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 22857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/alim7101_wdt.ko 2023-06-09T04:26:40.799 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 18993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/cpu5wdt.ko 2023-06-09T04:26:40.799 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/da9052_wdt.ko 2023-06-09T04:26:40.799 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 12665 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/da9055_wdt.ko 2023-06-09T04:26:40.799 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 17289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/da9063_wdt.ko 2023-06-09T04:26:40.799 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 19993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/dw_wdt.ko 2023-06-09T04:26:40.800 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 20153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/eurotechwdt.ko 2023-06-09T04:26:40.800 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 23689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/f71808e_wdt.ko 2023-06-09T04:26:40.800 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 27289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/hpwdt.ko 2023-06-09T04:26:40.800 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 15393 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/i6300esb.ko 2023-06-09T04:26:40.800 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-06-09T04:26:40.800 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 21801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/iTCO_wdt.ko 2023-06-09T04:26:40.800 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 19137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/ib700wdt.ko 2023-06-09T04:26:40.801 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 18569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/ibmasr.ko 2023-06-09T04:26:40.801 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 19601 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-06-09T04:26:40.801 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 21041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/it8712f_wdt.ko 2023-06-09T04:26:40.802 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/it87_wdt.ko 2023-06-09T04:26:40.802 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 21313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/kempld_wdt.ko 2023-06-09T04:26:40.802 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 18505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/machzwd.ko 2023-06-09T04:26:40.802 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 14601 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/mena21_wdt.ko 2023-06-09T04:26:40.803 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-06-09T04:26:40.803 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 24497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/nv_tco.ko 2023-06-09T04:26:40.803 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 17617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-06-09T04:26:40.803 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 22161 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/pc87413_wdt.ko 2023-06-09T04:26:40.803 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 38489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/pcwd_pci.ko 2023-06-09T04:26:40.803 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 31705 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/pcwd_usb.ko 2023-06-09T04:26:40.804 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 12953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/retu_wdt.ko 2023-06-09T04:26:40.804 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 20345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-06-09T04:26:40.804 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-06-09T04:26:40.805 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 17145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-06-09T04:26:40.805 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 23641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/sc1200wdt.ko 2023-06-09T04:26:40.805 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 23209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/sch311x_wdt.ko 2023-06-09T04:26:40.805 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 21457 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-06-09T04:26:40.806 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 17097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/softdog.ko 2023-06-09T04:26:40.806 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 21921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/sp5100_tco.ko 2023-06-09T04:26:40.806 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 12641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/twl4030_wdt.ko 2023-06-09T04:26:40.807 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 17465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/via_wdt.ko 2023-06-09T04:26:40.807 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 18985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-06-09T04:26:40.807 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 20569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/w83877f_wdt.ko 2023-06-09T04:26:40.807 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 25233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/w83977f_wdt.ko 2023-06-09T04:26:40.808 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 18329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/wafer5823wdt.ko 2023-06-09T04:26:40.808 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 27905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/wdt_pci.ko 2023-06-09T04:26:40.808 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 16073 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/wm831x_wdt.ko 2023-06-09T04:26:40.809 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13673 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/wm8350_wdt.ko 2023-06-09T04:26:40.809 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 15521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/watchdog/xen_wdt.ko 2023-06-09T04:26:40.809 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/xen/ 2023-06-09T04:26:40.809 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 24377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/xen/xen-evtchn.ko 2023-06-09T04:26:40.810 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 26569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/xen/xen-gntalloc.ko 2023-06-09T04:26:40.810 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 47737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/xen/xen-gntdev.ko 2023-06-09T04:26:40.810 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/xen/xen-pciback/ 2023-06-09T04:26:40.810 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 176241 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-06-09T04:26:40.811 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 39617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/xen/xen-privcmd.ko 2023-06-09T04:26:40.811 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 71137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/xen/xen-scsiback.ko 2023-06-09T04:26:40.811 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/xen/xenfs/ 2023-06-09T04:26:40.811 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 19313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/drivers/xen/xenfs/xenfs.ko 2023-06-09T04:26:40.811 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ 2023-06-09T04:26:40.812 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/9p/ 2023-06-09T04:26:40.812 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 165401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/9p/9p.ko 2023-06-09T04:26:40.812 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/adfs/ 2023-06-09T04:26:40.813 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 60769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/adfs/adfs.ko 2023-06-09T04:26:40.813 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/affs/ 2023-06-09T04:26:40.813 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 162449 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/affs/affs.ko 2023-06-09T04:26:40.813 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/afs/ 2023-06-09T04:26:40.813 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 924617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/afs/kafs.ko 2023-06-09T04:26:40.814 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/autofs/ 2023-06-09T04:26:40.814 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 100641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/autofs/autofs4.ko 2023-06-09T04:26:40.814 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/befs/ 2023-06-09T04:26:40.814 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 64297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/befs/befs.ko 2023-06-09T04:26:40.814 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/bfs/ 2023-06-09T04:26:40.814 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 40905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/bfs/bfs.ko 2023-06-09T04:26:40.814 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 34401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/binfmt_misc.ko 2023-06-09T04:26:40.815 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/btrfs/ 2023-06-09T04:26:40.815 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 3445465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/btrfs/btrfs.ko 2023-06-09T04:26:40.815 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/cachefiles/ 2023-06-09T04:26:40.815 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 299849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/cachefiles/cachefiles.ko 2023-06-09T04:26:40.815 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ceph/ 2023-06-09T04:26:40.815 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 1230257 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ceph/ceph.ko 2023-06-09T04:26:40.815 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/cifs/ 2023-06-09T04:26:40.815 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 2619753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/cifs/cifs.ko 2023-06-09T04:26:40.816 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/coda/ 2023-06-09T04:26:40.816 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 99217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/coda/coda.ko 2023-06-09T04:26:40.816 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/configfs/ 2023-06-09T04:26:40.816 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 105857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/configfs/configfs.ko 2023-06-09T04:26:40.816 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/cramfs/ 2023-06-09T04:26:40.816 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 29161 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/cramfs/cramfs.ko 2023-06-09T04:26:40.816 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/dlm/ 2023-06-09T04:26:40.817 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 631321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/dlm/dlm.ko 2023-06-09T04:26:40.817 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/efs/ 2023-06-09T04:26:40.817 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 36465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/efs/efs.ko 2023-06-09T04:26:40.817 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/f2fs/ 2023-06-09T04:26:40.817 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 1472873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/f2fs/f2fs.ko 2023-06-09T04:26:40.817 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/fat/ 2023-06-09T04:26:40.817 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 27681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/fat/msdos.ko 2023-06-09T04:26:40.817 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/freevxfs/ 2023-06-09T04:26:40.818 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 42281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/freevxfs/freevxfs.ko 2023-06-09T04:26:40.818 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/fscache/ 2023-06-09T04:26:40.818 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 218609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/fscache/fscache.ko 2023-06-09T04:26:40.818 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/fuse/ 2023-06-09T04:26:40.818 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 24401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/fuse/cuse.ko 2023-06-09T04:26:40.818 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/gfs2/ 2023-06-09T04:26:40.818 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 1221153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/gfs2/gfs2.ko 2023-06-09T04:26:40.819 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/hfs/ 2023-06-09T04:26:40.819 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 141129 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/hfs/hfs.ko 2023-06-09T04:26:40.819 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/hfsplus/ 2023-06-09T04:26:40.819 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 221441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/hfsplus/hfsplus.ko 2023-06-09T04:26:40.819 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/hpfs/ 2023-06-09T04:26:40.819 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 193465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/hpfs/hpfs.ko 2023-06-09T04:26:40.819 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/isofs/ 2023-06-09T04:26:40.819 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 74281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/isofs/isofs.ko 2023-06-09T04:26:40.820 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/jfs/ 2023-06-09T04:26:40.820 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 420305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/jfs/jfs.ko 2023-06-09T04:26:40.820 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/lockd/ 2023-06-09T04:26:40.820 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 276841 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/lockd/lockd.ko 2023-06-09T04:26:40.820 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/minix/ 2023-06-09T04:26:40.820 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 87801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/minix/minix.ko 2023-06-09T04:26:40.820 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/netfs/ 2023-06-09T04:26:40.821 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 128553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/netfs/netfs.ko 2023-06-09T04:26:40.821 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/ 2023-06-09T04:26:40.821 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/blocklayout/ 2023-06-09T04:26:40.821 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 81433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-06-09T04:26:40.821 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/filelayout/ 2023-06-09T04:26:40.821 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 59249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-06-09T04:26:40.821 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/flexfilelayout/ 2023-06-09T04:26:40.821 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 117529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-06-09T04:26:40.822 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 1002305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/nfs.ko 2023-06-09T04:26:40.822 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 65985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/nfsv2.ko 2023-06-09T04:26:40.822 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 119177 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/nfsv3.ko 2023-06-09T04:26:40.822 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 2003321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs/nfsv4.ko 2023-06-09T04:26:40.822 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs_common/ 2023-06-09T04:26:40.822 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 16225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs_common/grace.ko 2023-06-09T04:26:40.822 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 15497 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfs_common/nfs_acl.ko 2023-06-09T04:26:40.822 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfsd/ 2023-06-09T04:26:40.823 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 1407361 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nfsd/nfsd.ko 2023-06-09T04:26:40.823 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nilfs2/ 2023-06-09T04:26:40.823 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 587585 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nilfs2/nilfs2.ko 2023-06-09T04:26:40.823 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/ 2023-06-09T04:26:40.823 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-celtic.ko 2023-06-09T04:26:40.823 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-centeuro.ko 2023-06-09T04:26:40.823 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-croatian.ko 2023-06-09T04:26:40.823 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 12689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-cyrillic.ko 2023-06-09T04:26:40.824 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-gaelic.ko 2023-06-09T04:26:40.824 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 12681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-greek.ko 2023-06-09T04:26:40.824 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-iceland.ko 2023-06-09T04:26:40.824 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 12993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-inuit.ko 2023-06-09T04:26:40.824 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-roman.ko 2023-06-09T04:26:40.824 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-romanian.ko 2023-06-09T04:26:40.824 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/mac-turkish.ko 2023-06-09T04:26:40.825 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11121 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_ascii.ko 2023-06-09T04:26:40.825 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 12369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp1250.ko 2023-06-09T04:26:40.825 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 12057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp1251.ko 2023-06-09T04:26:40.825 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 12809 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp1255.ko 2023-06-09T04:26:40.825 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 12369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp737.ko 2023-06-09T04:26:40.825 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 12369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp775.ko 2023-06-09T04:26:40.825 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 12057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp850.ko 2023-06-09T04:26:40.825 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 12057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp852.ko 2023-06-09T04:26:40.826 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 12057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp855.ko 2023-06-09T04:26:40.826 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp857.ko 2023-06-09T04:26:40.826 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 12681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp860.ko 2023-06-09T04:26:40.826 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 12985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp861.ko 2023-06-09T04:26:40.826 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp862.ko 2023-06-09T04:26:40.826 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 12985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp863.ko 2023-06-09T04:26:40.826 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 12681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp864.ko 2023-06-09T04:26:40.826 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 12985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp865.ko 2023-06-09T04:26:40.827 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 12369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp866.ko 2023-06-09T04:26:40.827 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 12057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp869.ko 2023-06-09T04:26:40.827 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp874.ko 2023-06-09T04:26:40.827 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 93969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp932.ko 2023-06-09T04:26:40.827 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 142505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp936.ko 2023-06-09T04:26:40.827 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 165641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp949.ko 2023-06-09T04:26:40.827 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 117945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_cp950.ko 2023-06-09T04:26:40.827 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 12289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_euc-jp.ko 2023-06-09T04:26:40.828 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11129 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-1.ko 2023-06-09T04:26:40.828 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-13.ko 2023-06-09T04:26:40.828 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-14.ko 2023-06-09T04:26:40.828 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-15.ko 2023-06-09T04:26:40.828 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-2.ko 2023-06-09T04:26:40.828 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-3.ko 2023-06-09T04:26:40.828 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-4.ko 2023-06-09T04:26:40.829 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-5.ko 2023-06-09T04:26:40.829 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-6.ko 2023-06-09T04:26:40.829 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 12065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-7.ko 2023-06-09T04:26:40.829 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_iso8859-9.ko 2023-06-09T04:26:40.829 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 12369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_koi8-r.ko 2023-06-09T04:26:40.829 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 7913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_koi8-ru.ko 2023-06-09T04:26:40.829 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 12369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_koi8-u.ko 2023-06-09T04:26:40.829 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 8169 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/nls/nls_utf8.ko 2023-06-09T04:26:40.830 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ntfs/ 2023-06-09T04:26:40.830 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 218905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ntfs/ntfs.ko 2023-06-09T04:26:40.830 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/ 2023-06-09T04:26:40.830 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/cluster/ 2023-06-09T04:26:40.830 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 241057 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-06-09T04:26:40.830 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/dlm/ 2023-06-09T04:26:40.830 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 439521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-06-09T04:26:40.831 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/dlmfs/ 2023-06-09T04:26:40.831 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 53697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-06-09T04:26:40.831 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 2511193 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/ocfs2.ko 2023-06-09T04:26:40.831 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 17793 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-06-09T04:26:40.831 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 31473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-06-09T04:26:40.831 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 33897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-06-09T04:26:40.832 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/omfs/ 2023-06-09T04:26:40.832 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 52465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/omfs/omfs.ko 2023-06-09T04:26:40.832 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/overlayfs/ 2023-06-09T04:26:40.832 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 320569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/overlayfs/overlay.ko 2023-06-09T04:26:40.832 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/pstore/ 2023-06-09T04:26:40.832 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 54441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/pstore/ramoops.ko 2023-06-09T04:26:40.832 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/qnx4/ 2023-06-09T04:26:40.833 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 26681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/qnx4/qnx4.ko 2023-06-09T04:26:40.833 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/qnx6/ 2023-06-09T04:26:40.833 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 46537 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/qnx6/qnx6.ko 2023-06-09T04:26:40.833 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/quota/ 2023-06-09T04:26:40.833 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 29993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/quota/quota_tree.ko 2023-06-09T04:26:40.833 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 14177 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/quota/quota_v1.ko 2023-06-09T04:26:40.833 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 21841 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/quota/quota_v2.ko 2023-06-09T04:26:40.833 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/reiserfs/ 2023-06-09T04:26:40.834 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 530593 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/reiserfs/reiserfs.ko 2023-06-09T04:26:40.834 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/romfs/ 2023-06-09T04:26:40.834 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 28393 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/romfs/romfs.ko 2023-06-09T04:26:40.834 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/smbfs_common/ 2023-06-09T04:26:40.834 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 6681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/smbfs_common/cifs_arc4.ko 2023-06-09T04:26:40.834 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/smbfs_common/cifs_md4.ko 2023-06-09T04:26:40.834 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/squashfs/ 2023-06-09T04:26:40.834 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 131513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/squashfs/squashfs.ko 2023-06-09T04:26:40.835 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/sysv/ 2023-06-09T04:26:40.835 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 89537 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/sysv/sysv.ko 2023-06-09T04:26:40.835 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/udf/ 2023-06-09T04:26:40.835 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 248145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/udf/udf.ko 2023-06-09T04:26:40.835 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ufs/ 2023-06-09T04:26:40.835 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 160753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/ufs/ufs.ko 2023-06-09T04:26:40.835 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/xfs/ 2023-06-09T04:26:40.835 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 3854681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/fs/xfs/xfs.ko 2023-06-09T04:26:40.873 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/kernel/ 2023-06-09T04:26:40.874 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/kernel/locking/ 2023-06-09T04:26:40.874 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 73081 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/kernel/locking/locktorture.ko 2023-06-09T04:26:40.874 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/kernel/time/ 2023-06-09T04:26:40.874 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/kernel/time/test_udelay.ko 2023-06-09T04:26:40.874 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 55329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/kernel/torture.ko 2023-06-09T04:26:40.874 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/ 2023-06-09T04:26:40.875 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 6353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/crc-itu-t.ko 2023-06-09T04:26:40.875 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 6049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/crc7.ko 2023-06-09T04:26:40.875 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 6401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/crc8.ko 2023-06-09T04:26:40.875 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/crypto/ 2023-06-09T04:26:40.875 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 6625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/crypto/libarc4.ko 2023-06-09T04:26:40.875 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 36217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/crypto/libdes.ko 2023-06-09T04:26:40.875 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/interval_tree_test.ko 2023-06-09T04:26:40.876 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 8025 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/libcrc32c.ko 2023-06-09T04:26:40.876 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 23273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/lru_cache.ko 2023-06-09T04:26:40.876 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/lz4/ 2023-06-09T04:26:40.876 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 32913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/lz4/lz4_compress.ko 2023-06-09T04:26:40.876 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 21913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/lz4/lz4hc_compress.ko 2023-06-09T04:26:40.877 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/math/ 2023-06-09T04:26:40.877 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 6217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/math/cordic.ko 2023-06-09T04:26:40.877 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 8113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/memory-notifier-error-inject.ko 2023-06-09T04:26:40.877 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/notifier-error-inject.ko 2023-06-09T04:26:40.877 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/percpu_test.ko 2023-06-09T04:26:40.877 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 8185 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/pm-notifier-error-inject.ko 2023-06-09T04:26:40.877 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/raid6/ 2023-06-09T04:26:40.878 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 142193 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/raid6/raid6_pq.ko 2023-06-09T04:26:40.878 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 20993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/rbtree_test.ko 2023-06-09T04:26:40.878 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/reed_solomon/ 2023-06-09T04:26:40.878 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 17961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/reed_solomon/reed_solomon.ko 2023-06-09T04:26:40.878 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 38721 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/test-kstrtox.ko 2023-06-09T04:26:40.878 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 26209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/test-string_helpers.ko 2023-06-09T04:26:40.878 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 4760649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/test_bpf.ko 2023-06-09T04:26:40.878 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 48377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/test_firmware.ko 2023-06-09T04:26:40.879 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 6193 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/test_module.ko 2023-06-09T04:26:40.879 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 20689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/test_user_copy.ko 2023-06-09T04:26:40.879 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 9481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/ts_bm.ko 2023-06-09T04:26:40.879 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/ts_fsm.ko 2023-06-09T04:26:40.879 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 9521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/ts_kmp.ko 2023-06-09T04:26:40.879 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/xz/ 2023-06-09T04:26:40.879 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/lib/xz/xz_dec_test.ko 2023-06-09T04:26:40.879 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/mm/ 2023-06-09T04:26:40.880 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 15321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/mm/hwpoison-inject.ko 2023-06-09T04:26:40.880 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ 2023-06-09T04:26:40.880 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/6lowpan/ 2023-06-09T04:26:40.880 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 54657 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/6lowpan/6lowpan.ko 2023-06-09T04:26:40.880 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 6873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/6lowpan/nhc_dest.ko 2023-06-09T04:26:40.880 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 6897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/6lowpan/nhc_fragment.ko 2023-06-09T04:26:40.880 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 6873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/6lowpan/nhc_hop.ko 2023-06-09T04:26:40.881 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 6873 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/6lowpan/nhc_ipv6.ko 2023-06-09T04:26:40.881 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 6897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/6lowpan/nhc_mobility.ko 2023-06-09T04:26:40.881 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 6897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/6lowpan/nhc_routing.ko 2023-06-09T04:26:40.881 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 15153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/6lowpan/nhc_udp.ko 2023-06-09T04:26:40.881 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/802/ 2023-06-09T04:26:40.881 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 29545 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/802/garp.ko 2023-06-09T04:26:40.881 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 33977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/802/mrp.ko 2023-06-09T04:26:40.881 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 8049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/802/p8022.ko 2023-06-09T04:26:40.882 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 15345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/802/psnap.ko 2023-06-09T04:26:40.882 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/802/stp.ko 2023-06-09T04:26:40.882 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/8021q/ 2023-06-09T04:26:40.882 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 80913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/8021q/8021q.ko 2023-06-09T04:26:40.882 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/9p/ 2023-06-09T04:26:40.882 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 191689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/9p/9pnet.ko 2023-06-09T04:26:40.882 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 35777 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/9p/9pnet_fd.ko 2023-06-09T04:26:40.883 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 26225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/9p/9pnet_rdma.ko 2023-06-09T04:26:40.883 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 32145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/9p/9pnet_virtio.ko 2023-06-09T04:26:40.883 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/batman-adv/ 2023-06-09T04:26:40.883 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 652649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/batman-adv/batman-adv.ko 2023-06-09T04:26:40.883 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/ 2023-06-09T04:26:40.883 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 63713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/br_netfilter.ko 2023-06-09T04:26:40.883 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 769721 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/bridge.ko 2023-06-09T04:26:40.883 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ 2023-06-09T04:26:40.884 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 7553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-06-09T04:26:40.884 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 12217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_among.ko 2023-06-09T04:26:40.884 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 8993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_arp.ko 2023-06-09T04:26:40.884 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 8969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-06-09T04:26:40.884 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 9513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-06-09T04:26:40.884 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 8569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_ip.ko 2023-06-09T04:26:40.884 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 8969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-06-09T04:26:40.885 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 9721 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_limit.ko 2023-06-09T04:26:40.885 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_log.ko 2023-06-09T04:26:40.885 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 7473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_mark.ko 2023-06-09T04:26:40.885 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 7425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-06-09T04:26:40.885 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 8281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-06-09T04:26:40.885 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 7433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-06-09T04:26:40.885 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 9409 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-06-09T04:26:40.885 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 8545 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_snat.ko 2023-06-09T04:26:40.886 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 8713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_stp.ko 2023-06-09T04:26:40.886 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 12281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-06-09T04:26:40.886 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-06-09T04:26:40.886 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 9713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-06-09T04:26:40.886 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 9689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-06-09T04:26:40.886 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 54969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/ebtables.ko 2023-06-09T04:26:40.886 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-06-09T04:26:40.886 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-06-09T04:26:40.887 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ceph/ 2023-06-09T04:26:40.887 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 1030089 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ceph/libceph.ko 2023-06-09T04:26:40.887 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/core/ 2023-06-09T04:26:40.887 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 124617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/core/pktgen.ko 2023-06-09T04:26:40.887 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dccp/ 2023-06-09T04:26:40.887 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 189137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dccp/dccp.ko 2023-06-09T04:26:40.887 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 8545 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dccp/dccp_diag.ko 2023-06-09T04:26:40.887 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 56089 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dccp/dccp_ipv4.ko 2023-06-09T04:26:40.888 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 59529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dccp/dccp_ipv6.ko 2023-06-09T04:26:40.888 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dsa/ 2023-06-09T04:26:40.888 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 380185 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dsa/dsa_core.ko 2023-06-09T04:26:40.888 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13161 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dsa/tag_brcm.ko 2023-06-09T04:26:40.888 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 12465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dsa/tag_dsa.ko 2023-06-09T04:26:40.888 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 7609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dsa/tag_none.ko 2023-06-09T04:26:40.888 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 8785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/dsa/tag_trailer.ko 2023-06-09T04:26:40.889 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/hsr/ 2023-06-09T04:26:40.889 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 99713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/hsr/hsr.ko 2023-06-09T04:26:40.889 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ieee802154/ 2023-06-09T04:26:40.889 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ieee802154/6lowpan/ 2023-06-09T04:26:40.889 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 45065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-06-09T04:26:40.889 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 245745 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ieee802154/ieee802154.ko 2023-06-09T04:26:40.889 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 47393 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ieee802154/ieee802154_socket.ko 2023-06-09T04:26:40.889 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/ 2023-06-09T04:26:40.890 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 24617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/ah4.ko 2023-06-09T04:26:40.890 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 38297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/esp4.ko 2023-06-09T04:26:40.890 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 47633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/fou.ko 2023-06-09T04:26:40.890 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 17673 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/gre.ko 2023-06-09T04:26:40.890 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 47305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/inet_diag.ko 2023-06-09T04:26:40.890 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 60121 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/ip_gre.ko 2023-06-09T04:26:40.890 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 58801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/ip_tunnel.ko 2023-06-09T04:26:40.890 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 34257 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/ip_vti.ko 2023-06-09T04:26:40.891 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/ipcomp.ko 2023-06-09T04:26:40.891 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 28785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/ipip.ko 2023-06-09T04:26:40.891 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/ 2023-06-09T04:26:40.891 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 36929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/arp_tables.ko 2023-06-09T04:26:40.891 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 8705 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-06-09T04:26:40.891 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-06-09T04:26:40.891 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 40785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/ip_tables.ko 2023-06-09T04:26:40.891 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 9881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-06-09T04:26:40.892 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 9505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-06-09T04:26:40.892 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-06-09T04:26:40.892 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-06-09T04:26:40.892 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 14825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-06-09T04:26:40.892 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-06-09T04:26:40.892 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11537 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-06-09T04:26:40.892 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 14825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-06-09T04:26:40.893 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-06-09T04:26:40.893 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/iptable_security.ko 2023-06-09T04:26:40.893 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11601 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-06-09T04:26:40.893 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 8417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-06-09T04:26:40.894 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 27513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-06-09T04:26:40.894 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 18049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-06-09T04:26:40.894 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-06-09T04:26:40.895 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 19577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-06-09T04:26:40.895 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 8985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-06-09T04:26:40.895 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 14641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-06-09T04:26:40.895 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 9785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-06-09T04:26:40.896 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 16673 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-06-09T04:26:40.896 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 8889 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-06-09T04:26:40.896 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 12961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_bic.ko 2023-06-09T04:26:40.896 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_dctcp.ko 2023-06-09T04:26:40.897 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 15009 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_diag.ko 2023-06-09T04:26:40.897 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 9425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_highspeed.ko 2023-06-09T04:26:40.897 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 12281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_htcp.ko 2023-06-09T04:26:40.898 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_hybla.ko 2023-06-09T04:26:40.898 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_illinois.ko 2023-06-09T04:26:40.898 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_lp.ko 2023-06-09T04:26:40.899 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 8225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_scalable.ko 2023-06-09T04:26:40.899 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_vegas.ko 2023-06-09T04:26:40.899 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 9985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_veno.ko 2023-06-09T04:26:40.900 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10849 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_westwood.ko 2023-06-09T04:26:40.900 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10073 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tcp_yeah.ko 2023-06-09T04:26:40.900 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 22105 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/tunnel4.ko 2023-06-09T04:26:40.900 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 16241 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/udp_diag.ko 2023-06-09T04:26:40.901 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 40337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/udp_tunnel.ko 2023-06-09T04:26:40.901 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv4/xfrm4_tunnel.ko 2023-06-09T04:26:40.901 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/ 2023-06-09T04:26:40.901 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 26265 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/ah6.ko 2023-06-09T04:26:40.901 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 39033 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/esp6.ko 2023-06-09T04:26:40.902 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 14313 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/fou6.ko 2023-06-09T04:26:40.902 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 80681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/ip6_gre.ko 2023-06-09T04:26:40.902 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 91377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/ip6_tunnel.ko 2023-06-09T04:26:40.903 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10121 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-06-09T04:26:40.903 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 53889 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/ip6_vti.ko 2023-06-09T04:26:40.903 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/ipcomp6.ko 2023-06-09T04:26:40.903 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 18913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/mip6.ko 2023-06-09T04:26:40.903 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ 2023-06-09T04:26:40.904 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 41449 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-06-09T04:26:40.904 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-06-09T04:26:40.904 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 9577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-06-09T04:26:40.904 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 14041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-06-09T04:26:40.904 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 14153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-06-09T04:26:40.904 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 7689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-06-09T04:26:40.905 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 16097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-06-09T04:26:40.905 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 15857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-06-09T04:26:40.905 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 8801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-06-09T04:26:40.905 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 9713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-06-09T04:26:40.905 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-06-09T04:26:40.905 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10721 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-06-09T04:26:40.905 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-06-09T04:26:40.905 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-06-09T04:26:40.906 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 14857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-06-09T04:26:40.906 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-06-09T04:26:40.906 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-06-09T04:26:40.906 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 38249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-06-09T04:26:40.906 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 8049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-06-09T04:26:40.906 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 25065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-06-09T04:26:40.906 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 9457 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-06-09T04:26:40.906 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 14857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-06-09T04:26:40.907 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 9521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-06-09T04:26:40.907 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 15537 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-06-09T04:26:40.907 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 8897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-06-09T04:26:40.907 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 73041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/sit.ko 2023-06-09T04:26:40.907 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 23697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/tunnel6.ko 2023-06-09T04:26:40.907 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 22801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/ipv6/xfrm6_tunnel.ko 2023-06-09T04:26:40.907 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/key/ 2023-06-09T04:26:40.908 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 82825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/key/af_key.ko 2023-06-09T04:26:40.908 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/l2tp/ 2023-06-09T04:26:40.908 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 120649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/l2tp/l2tp_core.ko 2023-06-09T04:26:40.908 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 20161 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/l2tp/l2tp_debugfs.ko 2023-06-09T04:26:40.908 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 25681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/l2tp/l2tp_eth.ko 2023-06-09T04:26:40.908 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 35065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/l2tp/l2tp_ip.ko 2023-06-09T04:26:40.908 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 36769 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/l2tp/l2tp_ip6.ko 2023-06-09T04:26:40.908 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 32505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/l2tp/l2tp_netlink.ko 2023-06-09T04:26:40.909 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 53033 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/l2tp/l2tp_ppp.ko 2023-06-09T04:26:40.909 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/lapb/ 2023-06-09T04:26:40.909 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 46961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/lapb/lapb.ko 2023-06-09T04:26:40.909 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/llc/ 2023-06-09T04:26:40.909 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 22169 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/llc/llc.ko 2023-06-09T04:26:40.909 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 267033 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/llc/llc2.ko 2023-06-09T04:26:40.909 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/mac802154/ 2023-06-09T04:26:40.910 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 280225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/mac802154/mac802154.ko 2023-06-09T04:26:40.910 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/mpls/ 2023-06-09T04:26:40.910 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 9217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/mpls/mpls_gso.ko 2023-06-09T04:26:40.910 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ 2023-06-09T04:26:40.910 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ 2023-06-09T04:26:40.910 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 116897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set.ko 2023-06-09T04:26:40.910 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 28337 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-06-09T04:26:40.910 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 26913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-06-09T04:26:40.911 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 26345 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-06-09T04:26:40.911 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 101857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-06-09T04:26:40.911 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 103001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-06-09T04:26:40.911 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 104417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-06-09T04:26:40.911 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 105017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-06-09T04:26:40.911 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 114273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-06-09T04:26:40.911 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 60985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-06-09T04:26:40.911 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 111041 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-06-09T04:26:40.912 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 114561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-06-09T04:26:40.912 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 114209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-06-09T04:26:40.912 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 113033 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-06-09T04:26:40.912 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 116097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-06-09T04:26:40.912 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 30033 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-06-09T04:26:40.912 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ 2023-06-09T04:26:40.912 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 410481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs.ko 2023-06-09T04:26:40.912 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-06-09T04:26:40.913 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 7513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-06-09T04:26:40.913 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 17545 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-06-09T04:26:40.913 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 17729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-06-09T04:26:40.913 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 20545 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-06-09T04:26:40.913 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 7513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-06-09T04:26:40.913 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 7577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-06-09T04:26:40.913 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-06-09T04:26:40.914 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 9121 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-06-09T04:26:40.914 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 7529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-06-09T04:26:40.914 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13409 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-06-09T04:26:40.914 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 7593 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-06-09T04:26:40.914 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-06-09T04:26:40.914 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 47921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conncount.ko 2023-06-09T04:26:40.914 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 397561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack.ko 2023-06-09T04:26:40.914 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 15641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-06-09T04:26:40.915 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 9825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-06-09T04:26:40.915 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 33353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-06-09T04:26:40.915 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 117633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_h323.ko 2023-06-09T04:26:40.915 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 21777 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_irc.ko 2023-06-09T04:26:40.915 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 8697 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-06-09T04:26:40.915 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 108217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-06-09T04:26:40.915 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 33153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-06-09T04:26:40.915 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 17281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_sane.ko 2023-06-09T04:26:40.916 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 65625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_sip.ko 2023-06-09T04:26:40.916 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10833 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-06-09T04:26:40.916 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 18841 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-06-09T04:26:40.916 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 9529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_dup_netdev.ko 2023-06-09T04:26:40.916 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 86713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_flow_table.ko 2023-06-09T04:26:40.916 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 9481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_flow_table_inet.ko 2023-06-09T04:26:40.916 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 37025 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_log_syslog.ko 2023-06-09T04:26:40.917 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 91657 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_nat.ko 2023-06-09T04:26:40.917 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 9945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_nat_amanda.ko 2023-06-09T04:26:40.917 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 12449 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_nat_ftp.ko 2023-06-09T04:26:40.917 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_nat_irc.ko 2023-06-09T04:26:40.917 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 28817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_nat_sip.ko 2023-06-09T04:26:40.917 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 8625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_nat_tftp.ko 2023-06-09T04:26:40.917 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 42425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_synproxy_core.ko 2023-06-09T04:26:40.917 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 579473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nf_tables.ko 2023-06-09T04:26:40.918 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 42457 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nfnetlink.ko 2023-06-09T04:26:40.918 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 29561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nfnetlink_acct.ko 2023-06-09T04:26:40.918 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 30505 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-06-09T04:26:40.918 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 39729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nfnetlink_log.ko 2023-06-09T04:26:40.918 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 22113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nfnetlink_osf.ko 2023-06-09T04:26:40.918 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 49561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nfnetlink_queue.ko 2023-06-09T04:26:40.918 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10281 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_chain_nat.ko 2023-06-09T04:26:40.918 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 33073 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_compat.ko 2023-06-09T04:26:40.919 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 40537 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_ct.ko 2023-06-09T04:26:40.919 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 9489 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_dup_netdev.ko 2023-06-09T04:26:40.919 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_fib.ko 2023-06-09T04:26:40.919 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_fwd_netdev.ko 2023-06-09T04:26:40.919 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 14001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_hash.ko 2023-06-09T04:26:40.919 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 19889 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_limit.ko 2023-06-09T04:26:40.919 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 15225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_log.ko 2023-06-09T04:26:40.919 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 14617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_masq.ko 2023-06-09T04:26:40.920 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 14257 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_nat.ko 2023-06-09T04:26:40.920 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13561 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_numgen.ko 2023-06-09T04:26:40.920 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_osf.ko 2023-06-09T04:26:40.920 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_queue.ko 2023-06-09T04:26:40.920 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 14073 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_redir.ko 2023-06-09T04:26:40.920 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 9609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_reject.ko 2023-06-09T04:26:40.920 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 9905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_reject_inet.ko 2023-06-09T04:26:40.921 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 12617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_socket.ko 2023-06-09T04:26:40.921 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 20225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_synproxy.ko 2023-06-09T04:26:40.921 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 14737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/nft_tproxy.ko 2023-06-09T04:26:40.921 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 84993 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/x_tables.ko 2023-06-09T04:26:40.921 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11985 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_AUDIT.ko 2023-06-09T04:26:40.921 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 9449 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_CHECKSUM.ko 2023-06-09T04:26:40.921 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 7625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_CLASSIFY.ko 2023-06-09T04:26:40.921 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-06-09T04:26:40.922 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 18065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_CT.ko 2023-06-09T04:26:40.922 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_DSCP.ko 2023-06-09T04:26:40.922 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 9297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_HL.ko 2023-06-09T04:26:40.922 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13257 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_HMARK.ko 2023-06-09T04:26:40.922 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 38681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_IDLETIMER.ko 2023-06-09T04:26:40.922 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13841 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_LED.ko 2023-06-09T04:26:40.922 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11377 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_LOG.ko 2023-06-09T04:26:40.922 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_MASQUERADE.ko 2023-06-09T04:26:40.923 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_NETMAP.ko 2023-06-09T04:26:40.923 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 9361 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_NFLOG.ko 2023-06-09T04:26:40.923 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13185 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_NFQUEUE.ko 2023-06-09T04:26:40.923 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 19209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_RATEEST.ko 2023-06-09T04:26:40.923 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_REDIRECT.ko 2023-06-09T04:26:40.923 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 14233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_SECMARK.ko 2023-06-09T04:26:40.923 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 15953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_TCPMSS.ko 2023-06-09T04:26:40.923 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10257 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-06-09T04:26:40.924 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 17193 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_TEE.ko 2023-06-09T04:26:40.924 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 16673 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_TPROXY.ko 2023-06-09T04:26:40.924 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 8153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_TRACE.ko 2023-06-09T04:26:40.924 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13785 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_addrtype.ko 2023-06-09T04:26:40.924 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13777 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_bpf.ko 2023-06-09T04:26:40.924 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 15401 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_cgroup.ko 2023-06-09T04:26:40.924 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11033 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_cluster.ko 2023-06-09T04:26:40.925 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 7393 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_comment.ko 2023-06-09T04:26:40.925 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10353 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_connbytes.ko 2023-06-09T04:26:40.925 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10969 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_connlabel.ko 2023-06-09T04:26:40.925 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 9233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_connlimit.ko 2023-06-09T04:26:40.925 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_connmark.ko 2023-06-09T04:26:40.925 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 12289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_conntrack.ko 2023-06-09T04:26:40.925 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 7713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_cpu.ko 2023-06-09T04:26:40.925 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10801 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_dccp.ko 2023-06-09T04:26:40.926 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 7753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_devgroup.ko 2023-06-09T04:26:40.926 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 8625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_dscp.ko 2023-06-09T04:26:40.926 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_ecn.ko 2023-06-09T04:26:40.926 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11297 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_esp.ko 2023-06-09T04:26:40.926 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 43217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_hashlimit.ko 2023-06-09T04:26:40.926 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_helper.ko 2023-06-09T04:26:40.926 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 7753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_hl.ko 2023-06-09T04:26:40.926 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11809 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_ipcomp.ko 2023-06-09T04:26:40.927 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_iprange.ko 2023-06-09T04:26:40.927 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11609 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_ipvs.ko 2023-06-09T04:26:40.927 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 15865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_l2tp.ko 2023-06-09T04:26:40.927 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 7825 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_length.ko 2023-06-09T04:26:40.927 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10097 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_limit.ko 2023-06-09T04:26:40.927 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 7433 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_mac.ko 2023-06-09T04:26:40.927 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 8473 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_mark.ko 2023-06-09T04:26:40.928 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_multiport.ko 2023-06-09T04:26:40.928 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13705 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_nat.ko 2023-06-09T04:26:40.928 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_nfacct.ko 2023-06-09T04:26:40.928 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 8233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_osf.ko 2023-06-09T04:26:40.928 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 9441 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_owner.ko 2023-06-09T04:26:40.928 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 9553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_physdev.ko 2023-06-09T04:26:40.928 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 7457 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_pkttype.ko 2023-06-09T04:26:40.928 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_policy.ko 2023-06-09T04:26:40.929 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 9369 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_quota.ko 2023-06-09T04:26:40.929 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10233 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_rateest.ko 2023-06-09T04:26:40.929 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 8081 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_realm.ko 2023-06-09T04:26:40.929 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 36321 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_recent.ko 2023-06-09T04:26:40.929 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13217 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_sctp.ko 2023-06-09T04:26:40.929 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 29921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_set.ko 2023-06-09T04:26:40.929 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 15977 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_socket.ko 2023-06-09T04:26:40.929 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 9329 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_state.ko 2023-06-09T04:26:40.930 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 9305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_statistic.ko 2023-06-09T04:26:40.930 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 8633 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_string.ko 2023-06-09T04:26:40.930 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 8449 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_tcpmss.ko 2023-06-09T04:26:40.930 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 15665 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_tcpudp.ko 2023-06-09T04:26:40.930 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_time.ko 2023-06-09T04:26:40.930 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 9001 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netfilter/xt_u32.ko 2023-06-09T04:26:40.930 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netlink/ 2023-06-09T04:26:40.930 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/netlink/netlink_diag.ko 2023-06-09T04:26:40.931 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/nsh/ 2023-06-09T04:26:40.931 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 12073 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/nsh/nsh.ko 2023-06-09T04:26:40.931 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/openvswitch/ 2023-06-09T04:26:40.931 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 377897 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/openvswitch/openvswitch.ko 2023-06-09T04:26:40.931 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10145 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/openvswitch/vport-geneve.ko 2023-06-09T04:26:40.931 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 9273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/openvswitch/vport-gre.ko 2023-06-09T04:26:40.931 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 11681 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/openvswitch/vport-vxlan.ko 2023-06-09T04:26:40.932 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/packet/ 2023-06-09T04:26:40.932 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 12945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/packet/af_packet_diag.ko 2023-06-09T04:26:40.932 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/phonet/ 2023-06-09T04:26:40.932 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 109953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/phonet/phonet.ko 2023-06-09T04:26:40.932 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 54737 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/phonet/pn_pep.ko 2023-06-09T04:26:40.932 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/rds/ 2023-06-09T04:26:40.932 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 248865 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/rds/rds.ko 2023-06-09T04:26:40.932 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 164961 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/rds/rds_rdma.ko 2023-06-09T04:26:40.933 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 66761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/rds/rds_tcp.ko 2023-06-09T04:26:40.933 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/rxrpc/ 2023-06-09T04:26:40.933 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 806905 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/rxrpc/rxrpc.ko 2023-06-09T04:26:40.933 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/ 2023-06-09T04:26:40.933 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 32137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/act_csum.ko 2023-06-09T04:26:40.933 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 23425 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/act_gact.ko 2023-06-09T04:26:40.934 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 25569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/act_ipt.ko 2023-06-09T04:26:40.934 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 33953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/act_mirred.ko 2023-06-09T04:26:40.934 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 23249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/act_nat.ko 2023-06-09T04:26:40.934 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 42481 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/act_pedit.ko 2023-06-09T04:26:40.934 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 31881 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/act_police.ko 2023-06-09T04:26:40.934 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 20137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/act_simple.ko 2023-06-09T04:26:40.934 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 36241 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/act_skbedit.ko 2023-06-09T04:26:40.934 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 35945 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/act_vlan.ko 2023-06-09T04:26:40.935 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 25273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/cls_basic.ko 2023-06-09T04:26:40.935 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 32729 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/cls_bpf.ko 2023-06-09T04:26:40.935 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 19049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/cls_cgroup.ko 2023-06-09T04:26:40.935 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 31273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/cls_flow.ko 2023-06-09T04:26:40.935 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 30129 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/cls_fw.ko 2023-06-09T04:26:40.935 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 37113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/cls_route.ko 2023-06-09T04:26:40.935 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 58305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/cls_u32.ko 2023-06-09T04:26:40.935 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 7265 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/em_cmp.ko 2023-06-09T04:26:40.936 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 13289 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/em_ipset.ko 2023-06-09T04:26:40.936 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 33153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/em_meta.ko 2023-06-09T04:26:40.936 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 7713 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/em_nbyte.ko 2023-06-09T04:26:40.936 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10513 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/em_text.ko 2023-06-09T04:26:40.936 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 7073 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/em_u32.ko 2023-06-09T04:26:40.936 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 19929 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_choke.ko 2023-06-09T04:26:40.936 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 19521 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_codel.ko 2023-06-09T04:26:40.937 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 30761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_drr.ko 2023-06-09T04:26:40.937 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 30361 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_fq.ko 2023-06-09T04:26:40.937 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 29273 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_fq_codel.ko 2023-06-09T04:26:40.937 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 32465 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_gred.ko 2023-06-09T04:26:40.937 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 44665 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_hfsc.ko 2023-06-09T04:26:40.937 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 20689 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_hhf.ko 2023-06-09T04:26:40.937 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 63641 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_htb.ko 2023-06-09T04:26:40.937 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 15569 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_ingress.ko 2023-06-09T04:26:40.938 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 28417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_mqprio.ko 2023-06-09T04:26:40.938 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10209 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_mqprio_lib.ko 2023-06-09T04:26:40.938 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 23761 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_multiq.ko 2023-06-09T04:26:40.938 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 33649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_netem.ko 2023-06-09T04:26:40.938 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 23817 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_pie.ko 2023-06-09T04:26:40.938 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10153 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_plug.ko 2023-06-09T04:26:40.938 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 23137 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_prio.ko 2023-06-09T04:26:40.938 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 44625 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_qfq.ko 2023-06-09T04:26:40.939 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 29017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_red.ko 2023-06-09T04:26:40.939 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 25201 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_sfb.ko 2023-06-09T04:26:40.939 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 28305 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_sfq.ko 2023-06-09T04:26:40.939 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 27225 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_tbf.ko 2023-06-09T04:26:40.939 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 27177 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sched/sch_teql.ko 2023-06-09T04:26:40.939 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sctp/ 2023-06-09T04:26:40.939 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 929065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sctp/sctp.ko 2023-06-09T04:26:40.939 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 18921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sctp/sctp_diag.ko 2023-06-09T04:26:40.940 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sunrpc/ 2023-06-09T04:26:40.940 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sunrpc/auth_gss/ 2023-06-09T04:26:40.940 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 327953 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-06-09T04:26:40.940 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 61649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-06-09T04:26:40.940 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 1427857 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sunrpc/sunrpc.ko 2023-06-09T04:26:40.940 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sunrpc/xprtrdma/ 2023-06-09T04:26:40.940 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 681617 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-06-09T04:26:40.940 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/tipc/ 2023-06-09T04:26:40.941 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 9913 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/tipc/diag.ko 2023-06-09T04:26:40.941 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 853649 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/tipc/tipc.ko 2023-06-09T04:26:40.941 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/unix/ 2023-06-09T04:26:40.941 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 15553 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/unix/unix_diag.ko 2023-06-09T04:26:40.941 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/vmw_vsock/ 2023-06-09T04:26:40.941 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 80017 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-06-09T04:26:40.941 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 67921 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-06-09T04:26:40.942 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 92577 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/vmw_vsock/vsock.ko 2023-06-09T04:26:40.942 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 10593 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/vmw_vsock/vsock_diag.ko 2023-06-09T04:26:40.942 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 17417 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/vmw_vsock/vsock_loopback.ko 2023-06-09T04:26:40.942 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/x25/ 2023-06-09T04:26:40.942 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 125049 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/x25/x25.ko 2023-06-09T04:26:40.942 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/xfrm/ 2023-06-09T04:26:40.942 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 21113 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/xfrm/xfrm_algo.ko 2023-06-09T04:26:40.942 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 20065 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/xfrm/xfrm_ipcomp.ko 2023-06-09T04:26:40.943 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 101529 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/net/xfrm/xfrm_user.ko 2023-06-09T04:26:40.943 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/virt/ 2023-06-09T04:26:40.943 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/virt/lib/ 2023-06-09T04:26:40.943 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 14753 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/kernel/virt/lib/irqbypass.ko 2023-06-09T04:26:40.943 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 636518 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.alias 2023-06-09T04:26:40.943 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 622189 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.alias.bin 2023-06-09T04:26:40.943 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 7605 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.builtin 2023-06-09T04:26:40.943 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 22249 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.builtin.alias.bin 2023-06-09T04:26:40.944 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 9788 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.builtin.bin 2023-06-09T04:26:40.944 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 68530 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.builtin.modinfo 2023-06-09T04:26:40.944 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 146382 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.dep 2023-06-09T04:26:40.944 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 232620 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.dep.bin 2023-06-09T04:26:40.944 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 210 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.devname 2023-06-09T04:26:40.944 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 72719 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.order 2023-06-09T04:26:40.944 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 879 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.softdep 2023-06-09T04:26:40.945 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 251838 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.symbols 2023-06-09T04:26:40.945 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 306636 2023-06-01 02:19 ./lib/modules/6.4.0-rc2-g10b2f20a4f46/modules.symbols.bin 2023-06-09T04:26:40.945 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./usr/ 2023-06-09T04:26:40.945 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./usr/share/ 2023-06-09T04:26:40.945 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./usr/share/doc/ 2023-06-09T04:26:40.945 INFO:teuthology.orchestra.run.smithi062.stdout:drwxr-xr-x root/root 0 2023-06-01 02:19 ./usr/share/doc/linux-image-6.4.0-rc2-g10b2f20a4f46/ 2023-06-09T04:26:40.945 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 173 2023-06-01 02:19 ./usr/share/doc/linux-image-6.4.0-rc2-g10b2f20a4f46/changelog.Debian.gz 2023-06-09T04:26:40.945 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-r--r-- root/root 691 2023-06-01 02:19 ./usr/share/doc/linux-image-6.4.0-rc2-g10b2f20a4f46/copyright 2023-06-09T04:26:40.946 DEBUG:teuthology.task.kernel:get_image_version: 6.4.0-rc2-g10b2f20a4f46 2023-06-09T04:26:40.946 INFO:teuthology.task.kernel:searching for kernel 6.4.0-rc2-g10b2f20a4f46 2023-06-09T04:26:40.947 DEBUG:teuthology.orchestra.run.smithi062:> egrep '(submenu|menuentry.*6.4.0-rc2-g10b2f20a4f46).*{' /boot/grub/grub.cfg 2023-06-09T04:26:40.955 INFO:teuthology.orchestra.run.smithi062.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-06-09T04:26:40.955 INFO:teuthology.orchestra.run.smithi062.stdout: menuentry 'Ubuntu, with Linux 6.4.0-rc2-g10b2f20a4f46' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.4.0-rc2-g10b2f20a4f46-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-06-09T04:26:40.956 INFO:teuthology.orchestra.run.smithi062.stdout: menuentry 'Ubuntu, with Linux 6.4.0-rc2-g10b2f20a4f46 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.4.0-rc2-g10b2f20a4f46-recovery-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-06-09T04:26:40.956 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-06-09T04:26:40.956 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.4.0-rc2-g10b2f20a4f46 2023-06-09T04:26:40.956 DEBUG:teuthology.orchestra.run.smithi062:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-06-09T04:26:40.958 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi062.front.sepia.ceph.com to complete... 2023-06-09T04:26:41.664 INFO:teuthology.orchestra.run.smithi062.stderr:Sourcing file `/etc/default/grub' 2023-06-09T04:26:41.675 INFO:teuthology.orchestra.run.smithi062.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-06-09T04:26:41.694 INFO:teuthology.orchestra.run.smithi062.stderr:Generating grub configuration file ... 2023-06-09T04:26:41.953 INFO:teuthology.orchestra.run.smithi062.stderr:Found linux image: /boot/vmlinuz-6.4.0-rc2-g10b2f20a4f46 2023-06-09T04:26:41.965 INFO:teuthology.orchestra.run.smithi062.stderr:Found initrd image: /boot/initrd.img-6.4.0-rc2-g10b2f20a4f46 2023-06-09T04:26:42.352 INFO:teuthology.orchestra.run.smithi062.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-06-09T04:26:42.363 INFO:teuthology.orchestra.run.smithi062.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-06-09T04:26:44.090 INFO:teuthology.orchestra.run.smithi062.stderr:done 2023-06-09T04:27:04.080 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-06-09T04:27:04.081 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2023-06-09T04:27:04.081 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-09T04:27:15.216 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-06-09T04:27:15.217 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2023-06-09T04:27:15.217 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-09T04:27:22.608 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-06-09T04:27:33.616 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-06-09T04:27:52.628 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2023-06-09T04:27:52.629 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-09T04:28:03.628 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2023-06-09T04:28:03.629 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-09T04:28:10.992 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.89 2023-06-09T04:28:22.000 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.62 2023-06-09T04:28:41.012 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2023-06-09T04:28:41.012 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-09T04:28:41.520 DEBUG:teuthology.orchestra.run.smithi089:> true 2023-06-09T04:28:42.227 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi089.front.sepia.ceph.com' 2023-06-09T04:28:42.227 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.4.0-rc2-g10b2f20a4f46"... 2023-06-09T04:28:42.228 DEBUG:teuthology.orchestra.run.smithi089:> uname -r 2023-06-09T04:28:42.293 INFO:teuthology.orchestra.run.smithi089.stdout:6.4.0-rc2-g10b2f20a4f46 2023-06-09T04:28:42.293 DEBUG:teuthology.task.kernel:current kernel version is 6.4.0-rc2-g10b2f20a4f46 vs 6.4.0-rc2-g10b2f20a4f46 2023-06-09T04:28:42.293 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-06-09T04:28:42.294 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-06-09T04:28:43.294 DEBUG:teuthology.parallel:result is None 2023-06-09T04:28:52.002 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2023-06-09T04:28:52.003 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-09T04:28:52.252 DEBUG:teuthology.orchestra.run.smithi062:> true 2023-06-09T04:28:53.067 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi062.front.sepia.ceph.com' 2023-06-09T04:28:53.067 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.4.0-rc2-g10b2f20a4f46"... 2023-06-09T04:28:53.068 DEBUG:teuthology.orchestra.run.smithi062:> uname -r 2023-06-09T04:28:53.126 INFO:teuthology.orchestra.run.smithi062.stdout:6.4.0-rc2-g10b2f20a4f46 2023-06-09T04:28:53.127 DEBUG:teuthology.task.kernel:current kernel version is 6.4.0-rc2-g10b2f20a4f46 vs 6.4.0-rc2-g10b2f20a4f46 2023-06-09T04:28:53.127 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-06-09T04:28:53.127 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-06-09T04:28:54.128 DEBUG:teuthology.parallel:result is None 2023-06-09T04:28:54.129 INFO:teuthology.run_tasks:Running task internal.base... 2023-06-09T04:28:54.138 INFO:teuthology.task.internal:Creating test directory... 2023-06-09T04:28:54.139 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-06-09T04:28:54.146 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-06-09T04:28:54.165 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-06-09T04:28:54.175 INFO:teuthology.run_tasks:Running task internal.archive... 2023-06-09T04:28:54.187 INFO:teuthology.task.internal:Creating archive directory... 2023-06-09T04:28:54.188 DEBUG:teuthology.orchestra.run.smithi062:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-06-09T04:28:54.207 DEBUG:teuthology.orchestra.run.smithi089:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-06-09T04:28:54.324 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-06-09T04:28:54.335 INFO:teuthology.task.internal:Enabling coredump saving... 2023-06-09T04:28:54.335 DEBUG:teuthology.orchestra.run.smithi062:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-06-09T04:28:54.343 DEBUG:teuthology.orchestra.run.smithi089:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-06-09T04:28:54.430 INFO:teuthology.orchestra.run.smithi089.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-09T04:28:54.438 INFO:teuthology.orchestra.run.smithi062.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-09T04:28:54.460 INFO:teuthology.orchestra.run.smithi089.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-09T04:28:54.469 INFO:teuthology.orchestra.run.smithi062.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-09T04:28:54.474 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-06-09T04:28:54.484 INFO:teuthology.task.internal:Configuring sudo... 2023-06-09T04:28:54.484 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-06-09T04:28:54.491 DEBUG:teuthology.orchestra.run.smithi089:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-06-09T04:28:54.529 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-06-09T04:28:54.553 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-06-09T04:28:54.554 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-06-09T04:28:54.571 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-06-09T04:28:54.589 DEBUG:teuthology.orchestra.run.smithi062:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-06-09T04:28:54.647 DEBUG:teuthology.orchestra.run.smithi062:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-06-09T04:28:54.707 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-06-09T04:28:54.708 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-06-09T04:28:54.791 DEBUG:teuthology.orchestra.run.smithi089:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-06-09T04:28:54.810 DEBUG:teuthology.orchestra.run.smithi089:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-06-09T04:28:54.868 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-06-09T04:28:54.868 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-06-09T04:28:54.951 DEBUG:teuthology.orchestra.run.smithi062:> sudo service rsyslog restart 2023-06-09T04:28:54.958 DEBUG:teuthology.orchestra.run.smithi089:> sudo service rsyslog restart 2023-06-09T04:28:55.102 INFO:teuthology.run_tasks:Running task internal.timer... 2023-06-09T04:28:55.110 INFO:teuthology.task.internal:Starting timer... 2023-06-09T04:28:55.110 INFO:teuthology.run_tasks:Running task pcp... 2023-06-09T04:28:55.126 INFO:teuthology.run_tasks:Running task selinux... 2023-06-09T04:28:55.134 DEBUG:teuthology.task.selinux:Excluding smithi062: OS 'ubuntu' does not support SELinux 2023-06-09T04:28:55.135 DEBUG:teuthology.task.selinux:Excluding smithi089: OS 'ubuntu' does not support SELinux 2023-06-09T04:28:55.135 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-06-09T04:28:55.135 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-06-09T04:28:55.135 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-06-09T04:28:55.136 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-06-09T04:28:55.153 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-06-09T04:28:55.160 INFO:teuthology.repo_utils:Fetching main from origin 2023-06-09T04:28:55.304 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-06-09T04:28:55.329 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-06-09T04:28:55.331 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi062.front.sepia.ceph.com,smithi089.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-06-09T04:36:22.163 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi062.front.sepia.ceph.com'), Remote(name='ubuntu@smithi089.front.sepia.ceph.com')] 2023-06-09T04:36:22.165 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2023-06-09T04:36:22.167 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-09T04:36:22.271 DEBUG:teuthology.orchestra.run.smithi062:> true 2023-06-09T04:36:22.487 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2023-06-09T04:36:22.487 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-09T04:36:22.584 DEBUG:teuthology.orchestra.run.smithi089:> true 2023-06-09T04:36:22.795 INFO:teuthology.run_tasks:Running task clock... 2023-06-09T04:36:22.806 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-06-09T04:36:22.806 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-06-09T04:36:22.807 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-06-09T04:36:22.814 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-06-09T04:36:22.814 DEBUG:teuthology.orchestra.run.smithi089:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-06-09T04:36:22.892 INFO:teuthology.orchestra.run.smithi062.stdout: 9 Jun 04:36:22 ntpd[22029]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-06-09T04:36:22.892 INFO:teuthology.orchestra.run.smithi062.stdout: 9 Jun 04:36:22 ntpd[22029]: Command line: ntpd -gq 2023-06-09T04:36:22.894 INFO:teuthology.orchestra.run.smithi062.stdout: 9 Jun 04:36:22 ntpd[22029]: proto: precision = 0.106 usec (-23) 2023-06-09T04:36:22.894 INFO:teuthology.orchestra.run.smithi062.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-06-09T04:36:22.895 INFO:teuthology.orchestra.run.smithi062.stdout: 9 Jun 04:36:22 ntpd[22029]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-06-09T04:36:22.895 INFO:teuthology.orchestra.run.smithi062.stderr:restrict ::: KOD does nothing without LIMITED. 2023-06-09T04:36:22.896 INFO:teuthology.orchestra.run.smithi062.stdout: 9 Jun 04:36:22 ntpd[22029]: restrict ::: KOD does nothing without LIMITED. 2023-06-09T04:36:22.896 INFO:teuthology.orchestra.run.smithi062.stdout: 9 Jun 04:36:22 ntpd[22029]: Listen and drop on 0 v6wildcard [::]:123 2023-06-09T04:36:22.896 INFO:teuthology.orchestra.run.smithi062.stdout: 9 Jun 04:36:22 ntpd[22029]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-06-09T04:36:22.896 INFO:teuthology.orchestra.run.smithi062.stdout: 9 Jun 04:36:22 ntpd[22029]: Listen normally on 2 lo 127.0.0.1:123 2023-06-09T04:36:22.896 INFO:teuthology.orchestra.run.smithi062.stdout: 9 Jun 04:36:22 ntpd[22029]: Listen normally on 3 enp3s0f1 172.21.15.62:123 2023-06-09T04:36:22.897 INFO:teuthology.orchestra.run.smithi062.stdout: 9 Jun 04:36:22 ntpd[22029]: Listen normally on 4 lo [::1]:123 2023-06-09T04:36:22.897 INFO:teuthology.orchestra.run.smithi062.stdout: 9 Jun 04:36:22 ntpd[22029]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:febb:d1c3%5]:123 2023-06-09T04:36:22.897 INFO:teuthology.orchestra.run.smithi062.stdout: 9 Jun 04:36:22 ntpd[22029]: Listening on routing socket on fd #22 for interface updates 2023-06-09T04:36:22.915 INFO:teuthology.orchestra.run.smithi089.stdout: 9 Jun 04:36:22 ntpd[22015]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-06-09T04:36:22.915 INFO:teuthology.orchestra.run.smithi089.stdout: 9 Jun 04:36:22 ntpd[22015]: Command line: ntpd -gq 2023-06-09T04:36:22.916 INFO:teuthology.orchestra.run.smithi089.stdout: 9 Jun 04:36:22 ntpd[22015]: proto: precision = 0.042 usec (-24) 2023-06-09T04:36:22.916 INFO:teuthology.orchestra.run.smithi089.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-06-09T04:36:22.917 INFO:teuthology.orchestra.run.smithi089.stdout: 9 Jun 04:36:22 ntpd[22015]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-06-09T04:36:22.917 INFO:teuthology.orchestra.run.smithi089.stderr:restrict ::: KOD does nothing without LIMITED. 2023-06-09T04:36:22.918 INFO:teuthology.orchestra.run.smithi089.stdout: 9 Jun 04:36:22 ntpd[22015]: restrict ::: KOD does nothing without LIMITED. 2023-06-09T04:36:22.918 INFO:teuthology.orchestra.run.smithi089.stdout: 9 Jun 04:36:22 ntpd[22015]: Listen and drop on 0 v6wildcard [::]:123 2023-06-09T04:36:22.918 INFO:teuthology.orchestra.run.smithi089.stdout: 9 Jun 04:36:22 ntpd[22015]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-06-09T04:36:22.918 INFO:teuthology.orchestra.run.smithi089.stdout: 9 Jun 04:36:22 ntpd[22015]: Listen normally on 2 lo 127.0.0.1:123 2023-06-09T04:36:22.919 INFO:teuthology.orchestra.run.smithi089.stdout: 9 Jun 04:36:22 ntpd[22015]: Listen normally on 3 enp3s0f1 172.21.15.89:123 2023-06-09T04:36:22.919 INFO:teuthology.orchestra.run.smithi089.stdout: 9 Jun 04:36:22 ntpd[22015]: Listen normally on 4 lo [::1]:123 2023-06-09T04:36:22.919 INFO:teuthology.orchestra.run.smithi089.stdout: 9 Jun 04:36:22 ntpd[22015]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d501%5]:123 2023-06-09T04:36:22.919 INFO:teuthology.orchestra.run.smithi089.stdout: 9 Jun 04:36:22 ntpd[22015]: Listening on routing socket on fd #22 for interface updates 2023-06-09T04:36:23.893 INFO:teuthology.orchestra.run.smithi062.stderr: 9 Jun 04:36:23 ntpd[22029]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:36:23.893 INFO:teuthology.orchestra.run.smithi062.stderr: 9 Jun 04:36:23 ntpd[22029]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:36:23.893 INFO:teuthology.orchestra.run.smithi062.stderr: 9 Jun 04:36:23 ntpd[22029]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:36:23.893 INFO:teuthology.orchestra.run.smithi062.stderr: 9 Jun 04:36:23 ntpd[22029]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:36:23.894 INFO:teuthology.orchestra.run.smithi062.stderr: 9 Jun 04:36:23 ntpd[22029]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:36:23.894 INFO:teuthology.orchestra.run.smithi062.stderr: 9 Jun 04:36:23 ntpd[22029]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:36:23.894 INFO:teuthology.orchestra.run.smithi062.stderr: 9 Jun 04:36:23 ntpd[22029]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-09T04:36:23.894 INFO:teuthology.orchestra.run.smithi062.stderr: 9 Jun 04:36:23 ntpd[22029]: can't open /var/log/ntpstats/peerstats.20230609: Permission denied 2023-06-09T04:36:23.894 INFO:teuthology.orchestra.run.smithi062.stderr: 9 Jun 04:36:23 ntpd[22029]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:36:23.895 INFO:teuthology.orchestra.run.smithi062.stderr: 9 Jun 04:36:23 ntpd[22029]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:36:23.895 INFO:teuthology.orchestra.run.smithi062.stderr: 9 Jun 04:36:23 ntpd[22029]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-09T04:36:23.895 INFO:teuthology.orchestra.run.smithi062.stderr: 9 Jun 04:36:23 ntpd[22029]: can't open /var/log/ntpstats/peerstats.20230609: Permission denied 2023-06-09T04:36:23.915 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Jun 04:36:23 ntpd[22015]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:36:23.916 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Jun 04:36:23 ntpd[22015]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:36:24.916 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Jun 04:36:24 ntpd[22015]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:36:24.916 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Jun 04:36:24 ntpd[22015]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:36:24.916 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Jun 04:36:24 ntpd[22015]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:36:24.917 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Jun 04:36:24 ntpd[22015]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:36:24.917 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Jun 04:36:24 ntpd[22015]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-09T04:36:24.917 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Jun 04:36:24 ntpd[22015]: can't open /var/log/ntpstats/peerstats.20230609: Permission denied 2023-06-09T04:36:25.893 INFO:teuthology.orchestra.run.smithi062.stderr: 9 Jun 04:36:25 ntpd[22029]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:36:25.893 INFO:teuthology.orchestra.run.smithi062.stderr: 9 Jun 04:36:25 ntpd[22029]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:36:25.894 INFO:teuthology.orchestra.run.smithi062.stderr: 9 Jun 04:36:25 ntpd[22029]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:36:25.894 INFO:teuthology.orchestra.run.smithi062.stderr: 9 Jun 04:36:25 ntpd[22029]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:36:25.894 INFO:teuthology.orchestra.run.smithi062.stderr: 9 Jun 04:36:25 ntpd[22029]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:36:25.894 INFO:teuthology.orchestra.run.smithi062.stderr: 9 Jun 04:36:25 ntpd[22029]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:36:25.894 INFO:teuthology.orchestra.run.smithi062.stderr: 9 Jun 04:36:25 ntpd[22029]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:36:25.894 INFO:teuthology.orchestra.run.smithi062.stderr: 9 Jun 04:36:25 ntpd[22029]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:36:25.894 INFO:teuthology.orchestra.run.smithi062.stderr: 9 Jun 04:36:25 ntpd[22029]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:36:25.894 INFO:teuthology.orchestra.run.smithi062.stderr: 9 Jun 04:36:25 ntpd[22029]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:36:25.895 INFO:teuthology.orchestra.run.smithi062.stderr: 9 Jun 04:36:25 ntpd[22029]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-09T04:36:25.896 INFO:teuthology.orchestra.run.smithi062.stderr: 9 Jun 04:36:25 ntpd[22029]: can't open /var/log/ntpstats/peerstats.20230609: Permission denied 2023-06-09T04:36:25.896 INFO:teuthology.orchestra.run.smithi062.stderr: 9 Jun 04:36:25 ntpd[22029]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:36:25.896 INFO:teuthology.orchestra.run.smithi062.stderr: 9 Jun 04:36:25 ntpd[22029]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:36:25.896 INFO:teuthology.orchestra.run.smithi062.stderr: 9 Jun 04:36:25 ntpd[22029]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-09T04:36:25.896 INFO:teuthology.orchestra.run.smithi062.stderr: 9 Jun 04:36:25 ntpd[22029]: can't open /var/log/ntpstats/peerstats.20230609: Permission denied 2023-06-09T04:36:25.896 INFO:teuthology.orchestra.run.smithi062.stderr: 9 Jun 04:36:25 ntpd[22029]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:36:25.897 INFO:teuthology.orchestra.run.smithi062.stderr: 9 Jun 04:36:25 ntpd[22029]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:36:25.897 INFO:teuthology.orchestra.run.smithi062.stderr: 9 Jun 04:36:25 ntpd[22029]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-09T04:36:25.897 INFO:teuthology.orchestra.run.smithi062.stderr: 9 Jun 04:36:25 ntpd[22029]: can't open /var/log/ntpstats/peerstats.20230609: Permission denied 2023-06-09T04:36:26.916 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Jun 04:36:26 ntpd[22015]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:36:26.917 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Jun 04:36:26 ntpd[22015]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:36:26.917 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Jun 04:36:26 ntpd[22015]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:36:26.917 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Jun 04:36:26 ntpd[22015]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:36:26.917 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Jun 04:36:26 ntpd[22015]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:36:26.917 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Jun 04:36:26 ntpd[22015]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:36:26.917 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Jun 04:36:26 ntpd[22015]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-09T04:36:26.918 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Jun 04:36:26 ntpd[22015]: can't open /var/log/ntpstats/peerstats.20230609: Permission denied 2023-06-09T04:36:26.918 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Jun 04:36:26 ntpd[22015]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:36:26.918 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Jun 04:36:26 ntpd[22015]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:36:26.918 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Jun 04:36:26 ntpd[22015]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-09T04:36:26.918 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Jun 04:36:26 ntpd[22015]: can't open /var/log/ntpstats/peerstats.20230609: Permission denied 2023-06-09T04:36:27.893 INFO:teuthology.orchestra.run.smithi062.stderr: 9 Jun 04:36:27 ntpd[22029]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:36:27.893 INFO:teuthology.orchestra.run.smithi062.stderr: 9 Jun 04:36:27 ntpd[22029]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:36:27.894 INFO:teuthology.orchestra.run.smithi062.stderr: 9 Jun 04:36:27 ntpd[22029]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:36:27.894 INFO:teuthology.orchestra.run.smithi062.stderr: 9 Jun 04:36:27 ntpd[22029]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:36:27.894 INFO:teuthology.orchestra.run.smithi062.stderr: 9 Jun 04:36:27 ntpd[22029]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:36:27.894 INFO:teuthology.orchestra.run.smithi062.stderr: 9 Jun 04:36:27 ntpd[22029]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:36:27.894 INFO:teuthology.orchestra.run.smithi062.stderr: 9 Jun 04:36:27 ntpd[22029]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:36:27.894 INFO:teuthology.orchestra.run.smithi062.stderr: 9 Jun 04:36:27 ntpd[22029]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:36:27.895 INFO:teuthology.orchestra.run.smithi062.stderr: 9 Jun 04:36:27 ntpd[22029]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-09T04:36:27.895 INFO:teuthology.orchestra.run.smithi062.stderr: 9 Jun 04:36:27 ntpd[22029]: can't open /var/log/ntpstats/peerstats.20230609: Permission denied 2023-06-09T04:36:27.895 INFO:teuthology.orchestra.run.smithi062.stderr: 9 Jun 04:36:27 ntpd[22029]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:36:27.896 INFO:teuthology.orchestra.run.smithi062.stderr: 9 Jun 04:36:27 ntpd[22029]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:36:27.896 INFO:teuthology.orchestra.run.smithi062.stderr: 9 Jun 04:36:27 ntpd[22029]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-09T04:36:27.896 INFO:teuthology.orchestra.run.smithi062.stderr: 9 Jun 04:36:27 ntpd[22029]: can't open /var/log/ntpstats/peerstats.20230609: Permission denied 2023-06-09T04:36:27.896 INFO:teuthology.orchestra.run.smithi062.stderr: 9 Jun 04:36:27 ntpd[22029]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:36:27.896 INFO:teuthology.orchestra.run.smithi062.stderr: 9 Jun 04:36:27 ntpd[22029]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:36:27.896 INFO:teuthology.orchestra.run.smithi062.stderr: 9 Jun 04:36:27 ntpd[22029]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-09T04:36:27.897 INFO:teuthology.orchestra.run.smithi062.stderr: 9 Jun 04:36:27 ntpd[22029]: can't open /var/log/ntpstats/peerstats.20230609: Permission denied 2023-06-09T04:36:27.916 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Jun 04:36:27 ntpd[22015]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:36:27.916 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Jun 04:36:27 ntpd[22015]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:36:27.916 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Jun 04:36:27 ntpd[22015]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:36:27.916 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Jun 04:36:27 ntpd[22015]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:36:27.916 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Jun 04:36:27 ntpd[22015]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-09T04:36:27.917 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Jun 04:36:27 ntpd[22015]: can't open /var/log/ntpstats/peerstats.20230609: Permission denied 2023-06-09T04:36:28.916 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Jun 04:36:28 ntpd[22015]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:36:28.916 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Jun 04:36:28 ntpd[22015]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:36:28.917 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Jun 04:36:28 ntpd[22015]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:36:28.917 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Jun 04:36:28 ntpd[22015]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:36:28.917 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Jun 04:36:28 ntpd[22015]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:36:28.917 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Jun 04:36:28 ntpd[22015]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:36:28.917 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Jun 04:36:28 ntpd[22015]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-09T04:36:28.917 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Jun 04:36:28 ntpd[22015]: can't open /var/log/ntpstats/peerstats.20230609: Permission denied 2023-06-09T04:36:28.917 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Jun 04:36:28 ntpd[22015]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:36:28.918 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Jun 04:36:28 ntpd[22015]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:36:28.918 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Jun 04:36:28 ntpd[22015]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-09T04:36:28.918 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Jun 04:36:28 ntpd[22015]: can't open /var/log/ntpstats/peerstats.20230609: Permission denied 2023-06-09T04:36:29.893 INFO:teuthology.orchestra.run.smithi062.stderr: 9 Jun 04:36:29 ntpd[22029]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:36:29.893 INFO:teuthology.orchestra.run.smithi062.stderr: 9 Jun 04:36:29 ntpd[22029]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:36:29.893 INFO:teuthology.orchestra.run.smithi062.stderr: 9 Jun 04:36:29 ntpd[22029]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:36:29.893 INFO:teuthology.orchestra.run.smithi062.stderr: 9 Jun 04:36:29 ntpd[22029]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:36:29.893 INFO:teuthology.orchestra.run.smithi062.stderr: 9 Jun 04:36:29 ntpd[22029]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:36:29.893 INFO:teuthology.orchestra.run.smithi062.stderr: 9 Jun 04:36:29 ntpd[22029]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:36:29.894 INFO:teuthology.orchestra.run.smithi062.stderr: 9 Jun 04:36:29 ntpd[22029]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:36:29.894 INFO:teuthology.orchestra.run.smithi062.stderr: 9 Jun 04:36:29 ntpd[22029]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:36:29.894 INFO:teuthology.orchestra.run.smithi062.stderr: 9 Jun 04:36:29 ntpd[22029]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-09T04:36:29.894 INFO:teuthology.orchestra.run.smithi062.stderr: 9 Jun 04:36:29 ntpd[22029]: can't open /var/log/ntpstats/peerstats.20230609: Permission denied 2023-06-09T04:36:29.895 INFO:teuthology.orchestra.run.smithi062.stdout: 9 Jun 04:36:29 ntpd[22029]: ntpd: time slew -0.002575 s 2023-06-09T04:36:29.895 INFO:teuthology.orchestra.run.smithi062.stdout:ntpd: time slew -0.002575s 2023-06-09T04:36:29.895 INFO:teuthology.orchestra.run.smithi062.stderr: 9 Jun 04:36:29 ntpd[22029]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-06-09T04:36:29.896 INFO:teuthology.orchestra.run.smithi062.stderr: 9 Jun 04:36:29 ntpd[22029]: can't open /var/log/ntpstats/loopstats.20230609: Permission denied 2023-06-09T04:36:29.916 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Jun 04:36:29 ntpd[22015]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:36:29.916 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Jun 04:36:29 ntpd[22015]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:36:29.916 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Jun 04:36:29 ntpd[22015]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:36:29.916 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Jun 04:36:29 ntpd[22015]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:36:29.916 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Jun 04:36:29 ntpd[22015]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-09T04:36:29.916 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Jun 04:36:29 ntpd[22015]: can't open /var/log/ntpstats/peerstats.20230609: Permission denied 2023-06-09T04:36:30.060 INFO:teuthology.orchestra.run.smithi062.stdout: remote refid st t when poll reach delay offset jitter 2023-06-09T04:36:30.060 INFO:teuthology.orchestra.run.smithi062.stdout:============================================================================== 2023-06-09T04:36:30.060 INFO:teuthology.orchestra.run.smithi062.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-06-09T04:36:30.060 INFO:teuthology.orchestra.run.smithi062.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-06-09T04:36:30.060 INFO:teuthology.orchestra.run.smithi062.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-06-09T04:36:30.061 INFO:teuthology.orchestra.run.smithi062.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-06-09T04:36:30.916 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Jun 04:36:30 ntpd[22015]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:36:30.917 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Jun 04:36:30 ntpd[22015]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:36:30.917 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Jun 04:36:30 ntpd[22015]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:36:30.917 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Jun 04:36:30 ntpd[22015]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:36:30.917 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Jun 04:36:30 ntpd[22015]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:36:30.917 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Jun 04:36:30 ntpd[22015]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:36:30.917 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Jun 04:36:30 ntpd[22015]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-09T04:36:30.917 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Jun 04:36:30 ntpd[22015]: can't open /var/log/ntpstats/peerstats.20230609: Permission denied 2023-06-09T04:36:30.918 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Jun 04:36:30 ntpd[22015]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-09T04:36:30.918 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Jun 04:36:30 ntpd[22015]: can't open /var/log/ntpstats/rawstats.20230609: Permission denied 2023-06-09T04:36:30.918 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Jun 04:36:30 ntpd[22015]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-09T04:36:30.918 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Jun 04:36:30 ntpd[22015]: can't open /var/log/ntpstats/peerstats.20230609: Permission denied 2023-06-09T04:36:30.918 INFO:teuthology.orchestra.run.smithi089.stdout: 9 Jun 04:36:30 ntpd[22015]: ntpd: time slew +0.001043 s 2023-06-09T04:36:30.919 INFO:teuthology.orchestra.run.smithi089.stdout:ntpd: time slew +0.001043s 2023-06-09T04:36:30.919 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Jun 04:36:30 ntpd[22015]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-06-09T04:36:30.919 INFO:teuthology.orchestra.run.smithi089.stderr: 9 Jun 04:36:30 ntpd[22015]: can't open /var/log/ntpstats/loopstats.20230609: Permission denied 2023-06-09T04:36:31.046 INFO:teuthology.orchestra.run.smithi089.stdout: remote refid st t when poll reach delay offset jitter 2023-06-09T04:36:31.047 INFO:teuthology.orchestra.run.smithi089.stdout:============================================================================== 2023-06-09T04:36:31.047 INFO:teuthology.orchestra.run.smithi089.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-06-09T04:36:31.047 INFO:teuthology.orchestra.run.smithi089.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-06-09T04:36:31.047 INFO:teuthology.orchestra.run.smithi089.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-06-09T04:36:31.047 INFO:teuthology.orchestra.run.smithi089.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-06-09T04:36:31.048 INFO:teuthology.run_tasks:Running task install... 2023-06-09T04:36:31.057 DEBUG:teuthology.task.install:project ceph 2023-06-09T04:36:31.058 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'a02638f808b8fe11bccdd01222c0e6e2eb71120b'}} 2023-06-09T04:36:31.058 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a02638f808b8fe11bccdd01222c0e6e2eb71120b'} 2023-06-09T04:36:31.058 INFO:teuthology.task.install:Using flavor: default 2023-06-09T04:36:31.064 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-06-09T04:36:31.064 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-06-09T04:36:31.065 DEBUG:teuthology.orchestra.run.smithi062:> sudo apt-key list | grep Ceph 2023-06-09T04:36:31.065 DEBUG:teuthology.orchestra.run.smithi089:> sudo apt-key list | grep Ceph 2023-06-09T04:36:31.278 INFO:teuthology.orchestra.run.smithi089.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-06-09T04:36:31.317 INFO:teuthology.orchestra.run.smithi062.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-06-09T04:36:31.423 INFO:teuthology.orchestra.run.smithi089.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-06-09T04:36:31.423 INFO:teuthology.orchestra.run.smithi089.stdout:uid [ unknown] Ceph.com (release key) 2023-06-09T04:36:31.424 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-06-09T04:36:31.424 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-06-09T04:36:31.425 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=a02638f808b8fe11bccdd01222c0e6e2eb71120b 2023-06-09T04:36:31.471 INFO:teuthology.orchestra.run.smithi062.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-06-09T04:36:31.471 INFO:teuthology.orchestra.run.smithi062.stdout:uid [ unknown] Ceph.com (release key) 2023-06-09T04:36:31.473 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-06-09T04:36:31.473 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-06-09T04:36:31.473 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=a02638f808b8fe11bccdd01222c0e6e2eb71120b 2023-06-09T04:36:31.613 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default/ 2023-06-09T04:36:31.614 INFO:teuthology.task.install.deb:Package version is 18.0.0-4313-ga02638f8-1focal 2023-06-09T04:36:31.712 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default/ 2023-06-09T04:36:31.712 INFO:teuthology.task.install.deb:Package version is 18.0.0-4313-ga02638f8-1focal 2023-06-09T04:36:31.725 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-06-09T04:36:31.725 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-06-09T04:36:31.759 DEBUG:teuthology.orchestra.run.smithi062:> sudo apt-get update 2023-06-09T04:36:31.924 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-06-09T04:36:31.924 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-06-09T04:36:31.959 DEBUG:teuthology.orchestra.run.smithi089:> sudo apt-get update 2023-06-09T04:36:32.071 INFO:teuthology.orchestra.run.smithi062.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-06-09T04:36:32.097 INFO:teuthology.orchestra.run.smithi062.stdout:Ign:2 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal InRelease 2023-06-09T04:36:32.119 INFO:teuthology.orchestra.run.smithi062.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-06-09T04:36:32.144 INFO:teuthology.orchestra.run.smithi062.stdout:Ign:4 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal Release.gpg 2023-06-09T04:36:32.153 INFO:teuthology.orchestra.run.smithi062.stdout:Hit:5 http://archive.ubuntu.com/ubuntu focal InRelease 2023-06-09T04:36:32.166 INFO:teuthology.orchestra.run.smithi062.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 Packages [17.3 kB] 2023-06-09T04:36:32.217 INFO:teuthology.orchestra.run.smithi062.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main i386 Packages [3,425 B] 2023-06-09T04:36:32.237 INFO:teuthology.orchestra.run.smithi062.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-06-09T04:36:32.285 INFO:teuthology.orchestra.run.smithi089.stdout:Ign:1 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal InRelease 2023-06-09T04:36:32.307 INFO:teuthology.orchestra.run.smithi089.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-06-09T04:36:32.319 INFO:teuthology.orchestra.run.smithi062.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-06-09T04:36:32.331 INFO:teuthology.orchestra.run.smithi089.stdout:Ign:3 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal Release.gpg 2023-06-09T04:36:32.363 INFO:teuthology.orchestra.run.smithi089.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal InRelease 2023-06-09T04:36:32.363 INFO:teuthology.orchestra.run.smithi089.stdout:Hit:5 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-06-09T04:36:32.364 INFO:teuthology.orchestra.run.smithi089.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main i386 Packages [3,425 B] 2023-06-09T04:36:32.407 INFO:teuthology.orchestra.run.smithi089.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 Packages [17.3 kB] 2023-06-09T04:36:32.423 INFO:teuthology.orchestra.run.smithi089.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-06-09T04:36:32.505 INFO:teuthology.orchestra.run.smithi089.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-06-09T04:36:33.542 INFO:teuthology.orchestra.run.smithi062.stdout:Fetched 28.4 kB in 1s (19.8 kB/s) 2023-06-09T04:36:33.793 INFO:teuthology.orchestra.run.smithi089.stdout:Fetched 28.4 kB in 2s (18.9 kB/s) 2023-06-09T04:36:34.782 INFO:teuthology.orchestra.run.smithi062.stdout:Reading package lists... 2023-06-09T04:36:34.819 DEBUG:teuthology.orchestra.run.smithi062:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-4313-ga02638f8-1focal cephadm=18.0.0-4313-ga02638f8-1focal ceph-mds=18.0.0-4313-ga02638f8-1focal ceph-mgr=18.0.0-4313-ga02638f8-1focal ceph-common=18.0.0-4313-ga02638f8-1focal ceph-fuse=18.0.0-4313-ga02638f8-1focal ceph-test=18.0.0-4313-ga02638f8-1focal ceph-volume=18.0.0-4313-ga02638f8-1focal radosgw=18.0.0-4313-ga02638f8-1focal python3-rados=18.0.0-4313-ga02638f8-1focal python3-rgw=18.0.0-4313-ga02638f8-1focal python3-cephfs=18.0.0-4313-ga02638f8-1focal python3-rbd=18.0.0-4313-ga02638f8-1focal libcephfs2=18.0.0-4313-ga02638f8-1focal libcephfs-dev=18.0.0-4313-ga02638f8-1focal librados2=18.0.0-4313-ga02638f8-1focal librbd1=18.0.0-4313-ga02638f8-1focal rbd-fuse=18.0.0-4313-ga02638f8-1focal python3-cephfs=18.0.0-4313-ga02638f8-1focal cephfs-shell=18.0.0-4313-ga02638f8-1focal cephfs-top=18.0.0-4313-ga02638f8-1focal cephfs-mirror=18.0.0-4313-ga02638f8-1focal 2023-06-09T04:36:34.940 INFO:teuthology.orchestra.run.smithi062.stdout:Reading package lists... 2023-06-09T04:36:34.964 INFO:teuthology.orchestra.run.smithi089.stdout:Reading package lists... 2023-06-09T04:36:35.003 DEBUG:teuthology.orchestra.run.smithi089:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-4313-ga02638f8-1focal cephadm=18.0.0-4313-ga02638f8-1focal ceph-mds=18.0.0-4313-ga02638f8-1focal ceph-mgr=18.0.0-4313-ga02638f8-1focal ceph-common=18.0.0-4313-ga02638f8-1focal ceph-fuse=18.0.0-4313-ga02638f8-1focal ceph-test=18.0.0-4313-ga02638f8-1focal ceph-volume=18.0.0-4313-ga02638f8-1focal radosgw=18.0.0-4313-ga02638f8-1focal python3-rados=18.0.0-4313-ga02638f8-1focal python3-rgw=18.0.0-4313-ga02638f8-1focal python3-cephfs=18.0.0-4313-ga02638f8-1focal python3-rbd=18.0.0-4313-ga02638f8-1focal libcephfs2=18.0.0-4313-ga02638f8-1focal libcephfs-dev=18.0.0-4313-ga02638f8-1focal librados2=18.0.0-4313-ga02638f8-1focal librbd1=18.0.0-4313-ga02638f8-1focal rbd-fuse=18.0.0-4313-ga02638f8-1focal python3-cephfs=18.0.0-4313-ga02638f8-1focal cephfs-shell=18.0.0-4313-ga02638f8-1focal cephfs-top=18.0.0-4313-ga02638f8-1focal cephfs-mirror=18.0.0-4313-ga02638f8-1focal 2023-06-09T04:36:35.121 INFO:teuthology.orchestra.run.smithi089.stdout:Reading package lists... 2023-06-09T04:36:35.139 INFO:teuthology.orchestra.run.smithi062.stdout:Building dependency tree... 2023-06-09T04:36:35.140 INFO:teuthology.orchestra.run.smithi062.stdout:Reading state information... 2023-06-09T04:36:35.322 INFO:teuthology.orchestra.run.smithi062.stdout:The following packages were automatically installed and are no longer required: 2023-06-09T04:36:35.323 INFO:teuthology.orchestra.run.smithi062.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-06-09T04:36:35.323 INFO:teuthology.orchestra.run.smithi062.stdout:Use 'sudo apt autoremove' to remove them. 2023-06-09T04:36:35.323 INFO:teuthology.orchestra.run.smithi062.stdout:The following additional packages will be installed: 2023-06-09T04:36:35.323 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-06-09T04:36:35.324 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-06-09T04:36:35.324 INFO:teuthology.orchestra.run.smithi062.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-06-09T04:36:35.324 INFO:teuthology.orchestra.run.smithi062.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-06-09T04:36:35.324 INFO:teuthology.orchestra.run.smithi062.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-06-09T04:36:35.325 INFO:teuthology.orchestra.run.smithi062.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-06-09T04:36:35.325 INFO:teuthology.orchestra.run.smithi062.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-06-09T04:36:35.325 INFO:teuthology.orchestra.run.smithi062.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-06-09T04:36:35.325 INFO:teuthology.orchestra.run.smithi062.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-06-09T04:36:35.325 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ceph-common python3-cherrypy3 python3-cmd2 python3-colorama 2023-06-09T04:36:35.325 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2023-06-09T04:36:35.325 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2023-06-09T04:36:35.326 INFO:teuthology.orchestra.run.smithi062.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2023-06-09T04:36:35.326 INFO:teuthology.orchestra.run.smithi062.stdout: python3-natsort python3-oauthlib python3-openssl python3-packaging 2023-06-09T04:36:35.326 INFO:teuthology.orchestra.run.smithi062.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-06-09T04:36:35.326 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2023-06-09T04:36:35.326 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2023-06-09T04:36:35.326 INFO:teuthology.orchestra.run.smithi062.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2023-06-09T04:36:35.326 INFO:teuthology.orchestra.run.smithi062.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-06-09T04:36:35.326 INFO:teuthology.orchestra.run.smithi062.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-06-09T04:36:35.327 INFO:teuthology.orchestra.run.smithi062.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-06-09T04:36:35.327 INFO:teuthology.orchestra.run.smithi062.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-06-09T04:36:35.327 INFO:teuthology.orchestra.run.smithi062.stdout: qttranslations5-l10n socat xmlstarlet 2023-06-09T04:36:35.327 INFO:teuthology.orchestra.run.smithi062.stdout:Suggested packages: 2023-06-09T04:36:35.328 INFO:teuthology.orchestra.run.smithi062.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-06-09T04:36:35.328 INFO:teuthology.orchestra.run.smithi062.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-06-09T04:36:35.328 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-06-09T04:36:35.328 INFO:teuthology.orchestra.run.smithi062.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-06-09T04:36:35.328 INFO:teuthology.orchestra.run.smithi062.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-06-09T04:36:35.328 INFO:teuthology.orchestra.run.smithi062.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-06-09T04:36:35.328 INFO:teuthology.orchestra.run.smithi062.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-06-09T04:36:35.328 INFO:teuthology.orchestra.run.smithi062.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-06-09T04:36:35.329 INFO:teuthology.orchestra.run.smithi062.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-06-09T04:36:35.329 INFO:teuthology.orchestra.run.smithi062.stdout:Recommended packages: 2023-06-09T04:36:35.329 INFO:teuthology.orchestra.run.smithi062.stdout: btrfs-tools 2023-06-09T04:36:35.329 INFO:teuthology.orchestra.run.smithi089.stdout:Building dependency tree... 2023-06-09T04:36:35.329 INFO:teuthology.orchestra.run.smithi089.stdout:Reading state information... 2023-06-09T04:36:35.508 INFO:teuthology.orchestra.run.smithi089.stdout:The following packages were automatically installed and are no longer required: 2023-06-09T04:36:35.510 INFO:teuthology.orchestra.run.smithi089.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-06-09T04:36:35.510 INFO:teuthology.orchestra.run.smithi089.stdout:Use 'sudo apt autoremove' to remove them. 2023-06-09T04:36:35.510 INFO:teuthology.orchestra.run.smithi089.stdout:The following additional packages will be installed: 2023-06-09T04:36:35.510 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-06-09T04:36:35.510 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-06-09T04:36:35.511 INFO:teuthology.orchestra.run.smithi089.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-06-09T04:36:35.511 INFO:teuthology.orchestra.run.smithi089.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-06-09T04:36:35.511 INFO:teuthology.orchestra.run.smithi089.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-06-09T04:36:35.511 INFO:teuthology.orchestra.run.smithi089.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-06-09T04:36:35.511 INFO:teuthology.orchestra.run.smithi089.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-06-09T04:36:35.511 INFO:teuthology.orchestra.run.smithi089.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-06-09T04:36:35.512 INFO:teuthology.orchestra.run.smithi089.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-06-09T04:36:35.512 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-common python3-cherrypy3 python3-cmd2 python3-colorama 2023-06-09T04:36:35.512 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2023-06-09T04:36:35.512 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2023-06-09T04:36:35.512 INFO:teuthology.orchestra.run.smithi089.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2023-06-09T04:36:35.512 INFO:teuthology.orchestra.run.smithi089.stdout: python3-natsort python3-oauthlib python3-openssl python3-packaging 2023-06-09T04:36:35.513 INFO:teuthology.orchestra.run.smithi089.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-06-09T04:36:35.513 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2023-06-09T04:36:35.513 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2023-06-09T04:36:35.513 INFO:teuthology.orchestra.run.smithi089.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2023-06-09T04:36:35.513 INFO:teuthology.orchestra.run.smithi089.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-06-09T04:36:35.513 INFO:teuthology.orchestra.run.smithi089.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-06-09T04:36:35.513 INFO:teuthology.orchestra.run.smithi089.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-06-09T04:36:35.514 INFO:teuthology.orchestra.run.smithi089.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-06-09T04:36:35.514 INFO:teuthology.orchestra.run.smithi089.stdout: qttranslations5-l10n socat xmlstarlet 2023-06-09T04:36:35.514 INFO:teuthology.orchestra.run.smithi089.stdout:Suggested packages: 2023-06-09T04:36:35.514 INFO:teuthology.orchestra.run.smithi089.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-06-09T04:36:35.514 INFO:teuthology.orchestra.run.smithi089.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-06-09T04:36:35.515 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-06-09T04:36:35.515 INFO:teuthology.orchestra.run.smithi089.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-06-09T04:36:35.515 INFO:teuthology.orchestra.run.smithi089.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-06-09T04:36:35.515 INFO:teuthology.orchestra.run.smithi089.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-06-09T04:36:35.515 INFO:teuthology.orchestra.run.smithi089.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-06-09T04:36:35.515 INFO:teuthology.orchestra.run.smithi089.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-06-09T04:36:35.515 INFO:teuthology.orchestra.run.smithi089.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-06-09T04:36:35.516 INFO:teuthology.orchestra.run.smithi089.stdout:Recommended packages: 2023-06-09T04:36:35.516 INFO:teuthology.orchestra.run.smithi089.stdout: btrfs-tools 2023-06-09T04:36:35.535 INFO:teuthology.orchestra.run.smithi062.stdout:The following NEW packages will be installed: 2023-06-09T04:36:35.535 INFO:teuthology.orchestra.run.smithi062.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-06-09T04:36:35.535 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-06-09T04:36:35.535 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-06-09T04:36:35.536 INFO:teuthology.orchestra.run.smithi062.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2023-06-09T04:36:35.537 INFO:teuthology.orchestra.run.smithi062.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2023-06-09T04:36:35.537 INFO:teuthology.orchestra.run.smithi062.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-06-09T04:36:35.537 INFO:teuthology.orchestra.run.smithi062.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2023-06-09T04:36:35.537 INFO:teuthology.orchestra.run.smithi062.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2023-06-09T04:36:35.538 INFO:teuthology.orchestra.run.smithi062.stdout: nvme-cli python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-06-09T04:36:35.538 INFO:teuthology.orchestra.run.smithi062.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-06-09T04:36:35.538 INFO:teuthology.orchestra.run.smithi062.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-06-09T04:36:35.538 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cmd2 2023-06-09T04:36:35.538 INFO:teuthology.orchestra.run.smithi062.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2023-06-09T04:36:35.538 INFO:teuthology.orchestra.run.smithi062.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-06-09T04:36:35.538 INFO:teuthology.orchestra.run.smithi062.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-06-09T04:36:35.539 INFO:teuthology.orchestra.run.smithi062.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-06-09T04:36:35.539 INFO:teuthology.orchestra.run.smithi062.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-06-09T04:36:35.539 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-06-09T04:36:35.539 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-06-09T04:36:35.539 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2023-06-09T04:36:35.539 INFO:teuthology.orchestra.run.smithi062.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-06-09T04:36:35.539 INFO:teuthology.orchestra.run.smithi062.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-06-09T04:36:35.540 INFO:teuthology.orchestra.run.smithi062.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-06-09T04:36:35.540 INFO:teuthology.orchestra.run.smithi062.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-06-09T04:36:35.540 INFO:teuthology.orchestra.run.smithi062.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-06-09T04:36:35.540 INFO:teuthology.orchestra.run.smithi062.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2023-06-09T04:36:35.541 INFO:teuthology.orchestra.run.smithi062.stdout:The following packages will be upgraded: 2023-06-09T04:36:35.541 INFO:teuthology.orchestra.run.smithi062.stdout: librados2 librbd1 2023-06-09T04:36:35.714 INFO:teuthology.orchestra.run.smithi089.stdout:The following NEW packages will be installed: 2023-06-09T04:36:35.715 INFO:teuthology.orchestra.run.smithi089.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-06-09T04:36:35.715 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-06-09T04:36:35.715 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-06-09T04:36:35.715 INFO:teuthology.orchestra.run.smithi089.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2023-06-09T04:36:35.715 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2023-06-09T04:36:35.715 INFO:teuthology.orchestra.run.smithi089.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-06-09T04:36:35.716 INFO:teuthology.orchestra.run.smithi089.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2023-06-09T04:36:35.716 INFO:teuthology.orchestra.run.smithi089.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2023-06-09T04:36:35.717 INFO:teuthology.orchestra.run.smithi089.stdout: nvme-cli python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-06-09T04:36:35.717 INFO:teuthology.orchestra.run.smithi089.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-06-09T04:36:35.717 INFO:teuthology.orchestra.run.smithi089.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-06-09T04:36:35.717 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cmd2 2023-06-09T04:36:35.717 INFO:teuthology.orchestra.run.smithi089.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2023-06-09T04:36:35.717 INFO:teuthology.orchestra.run.smithi089.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-06-09T04:36:35.718 INFO:teuthology.orchestra.run.smithi089.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-06-09T04:36:35.718 INFO:teuthology.orchestra.run.smithi089.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-06-09T04:36:35.718 INFO:teuthology.orchestra.run.smithi089.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-06-09T04:36:35.718 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-06-09T04:36:35.718 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-06-09T04:36:35.718 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2023-06-09T04:36:35.718 INFO:teuthology.orchestra.run.smithi089.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-06-09T04:36:35.719 INFO:teuthology.orchestra.run.smithi089.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-06-09T04:36:35.719 INFO:teuthology.orchestra.run.smithi089.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-06-09T04:36:35.719 INFO:teuthology.orchestra.run.smithi089.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-06-09T04:36:35.719 INFO:teuthology.orchestra.run.smithi089.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-06-09T04:36:35.719 INFO:teuthology.orchestra.run.smithi089.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2023-06-09T04:36:35.719 INFO:teuthology.orchestra.run.smithi089.stdout:The following packages will be upgraded: 2023-06-09T04:36:35.720 INFO:teuthology.orchestra.run.smithi089.stdout: librados2 librbd1 2023-06-09T04:36:35.757 INFO:teuthology.orchestra.run.smithi062.stdout:2 upgraded, 116 newly installed, 0 to remove and 186 not upgraded. 2023-06-09T04:36:35.757 INFO:teuthology.orchestra.run.smithi062.stdout:Need to get 201 MB of archives. 2023-06-09T04:36:35.758 INFO:teuthology.orchestra.run.smithi062.stdout:After this operation, 1,004 MB of additional disk space will be used. 2023-06-09T04:36:35.758 INFO:teuthology.orchestra.run.smithi062.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2023-06-09T04:36:35.801 INFO:teuthology.orchestra.run.smithi062.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.0.0-4313-ga02638f8-1focal [3,429 kB] 2023-06-09T04:36:35.842 INFO:teuthology.orchestra.run.smithi062.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-06-09T04:36:35.877 INFO:teuthology.orchestra.run.smithi062.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2023-06-09T04:36:35.939 INFO:teuthology.orchestra.run.smithi089.stdout:2 upgraded, 116 newly installed, 0 to remove and 186 not upgraded. 2023-06-09T04:36:35.939 INFO:teuthology.orchestra.run.smithi089.stdout:Need to get 201 MB of archives. 2023-06-09T04:36:35.939 INFO:teuthology.orchestra.run.smithi089.stdout:After this operation, 1,004 MB of additional disk space will be used. 2023-06-09T04:36:35.939 INFO:teuthology.orchestra.run.smithi089.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2023-06-09T04:36:35.975 INFO:teuthology.orchestra.run.smithi089.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.0.0-4313-ga02638f8-1focal [3,429 kB] 2023-06-09T04:36:36.000 INFO:teuthology.orchestra.run.smithi062.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-06-09T04:36:36.024 INFO:teuthology.orchestra.run.smithi089.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-06-09T04:36:36.058 INFO:teuthology.orchestra.run.smithi089.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2023-06-09T04:36:36.139 INFO:teuthology.orchestra.run.smithi062.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-06-09T04:36:36.157 INFO:teuthology.orchestra.run.smithi062.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-06-09T04:36:36.171 INFO:teuthology.orchestra.run.smithi062.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.0.0-4313-ga02638f8-1focal [3,984 kB] 2023-06-09T04:36:36.182 INFO:teuthology.orchestra.run.smithi089.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-06-09T04:36:36.219 INFO:teuthology.orchestra.run.smithi062.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-06-09T04:36:36.321 INFO:teuthology.orchestra.run.smithi089.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-06-09T04:36:36.338 INFO:teuthology.orchestra.run.smithi089.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-06-09T04:36:36.349 INFO:teuthology.orchestra.run.smithi089.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.0.0-4313-ga02638f8-1focal [3,984 kB] 2023-06-09T04:36:36.388 INFO:teuthology.orchestra.run.smithi062.stdout:Get:10 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.0.0-4313-ga02638f8-1focal [724 kB] 2023-06-09T04:36:36.400 INFO:teuthology.orchestra.run.smithi089.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-06-09T04:36:36.418 INFO:teuthology.orchestra.run.smithi062.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-06-09T04:36:36.426 INFO:teuthology.orchestra.run.smithi062.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-06-09T04:36:36.435 INFO:teuthology.orchestra.run.smithi062.stdout:Get:13 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.0.0-4313-ga02638f8-1focal [377 kB] 2023-06-09T04:36:36.446 INFO:teuthology.orchestra.run.smithi062.stdout:Get:14 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.0.0-4313-ga02638f8-1focal [22.5 kB] 2023-06-09T04:36:36.447 INFO:teuthology.orchestra.run.smithi062.stdout:Get:15 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.0.0-4313-ga02638f8-1focal [191 kB] 2023-06-09T04:36:36.453 INFO:teuthology.orchestra.run.smithi062.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-06-09T04:36:36.453 INFO:teuthology.orchestra.run.smithi062.stdout:Get:17 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.0.0-4313-ga02638f8-1focal [48.4 kB] 2023-06-09T04:36:36.454 INFO:teuthology.orchestra.run.smithi062.stdout:Get:18 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.0.0-4313-ga02638f8-1focal [354 kB] 2023-06-09T04:36:36.461 INFO:teuthology.orchestra.run.smithi062.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-06-09T04:36:36.493 INFO:teuthology.orchestra.run.smithi062.stdout:Get:20 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.0.0-4313-ga02638f8-1focal [6,565 kB] 2023-06-09T04:36:36.600 INFO:teuthology.orchestra.run.smithi089.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-06-09T04:36:36.608 INFO:teuthology.orchestra.run.smithi089.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-06-09T04:36:36.612 INFO:teuthology.orchestra.run.smithi089.stdout:Get:12 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.0.0-4313-ga02638f8-1focal [724 kB] 2023-06-09T04:36:36.626 INFO:teuthology.orchestra.run.smithi062.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-06-09T04:36:36.634 INFO:teuthology.orchestra.run.smithi089.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-06-09T04:36:36.643 INFO:teuthology.orchestra.run.smithi089.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-06-09T04:36:36.673 INFO:teuthology.orchestra.run.smithi089.stdout:Get:15 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.0.0-4313-ga02638f8-1focal [377 kB] 2023-06-09T04:36:36.723 INFO:teuthology.orchestra.run.smithi089.stdout:Get:16 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.0.0-4313-ga02638f8-1focal [22.5 kB] 2023-06-09T04:36:36.724 INFO:teuthology.orchestra.run.smithi089.stdout:Get:17 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.0.0-4313-ga02638f8-1focal [191 kB] 2023-06-09T04:36:36.730 INFO:teuthology.orchestra.run.smithi089.stdout:Get:18 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.0.0-4313-ga02638f8-1focal [48.4 kB] 2023-06-09T04:36:36.731 INFO:teuthology.orchestra.run.smithi089.stdout:Get:19 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.0.0-4313-ga02638f8-1focal [354 kB] 2023-06-09T04:36:36.744 INFO:teuthology.orchestra.run.smithi089.stdout:Get:20 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.0.0-4313-ga02638f8-1focal [6,565 kB] 2023-06-09T04:36:36.807 INFO:teuthology.orchestra.run.smithi089.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-06-09T04:36:36.867 INFO:teuthology.orchestra.run.smithi062.stdout:Get:22 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.0.0-4313-ga02638f8-1focal [104 kB] 2023-06-09T04:36:36.869 INFO:teuthology.orchestra.run.smithi062.stdout:Get:23 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.0.0-4313-ga02638f8-1focal [466 kB] 2023-06-09T04:36:36.919 INFO:teuthology.orchestra.run.smithi062.stdout:Get:24 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.0.0-4313-ga02638f8-1focal [25.1 MB] 2023-06-09T04:36:36.984 INFO:teuthology.orchestra.run.smithi062.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-06-09T04:36:37.002 INFO:teuthology.orchestra.run.smithi062.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-06-09T04:36:37.165 INFO:teuthology.orchestra.run.smithi089.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-06-09T04:36:37.179 INFO:teuthology.orchestra.run.smithi062.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-06-09T04:36:37.183 INFO:teuthology.orchestra.run.smithi089.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-06-09T04:36:37.188 INFO:teuthology.orchestra.run.smithi062.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-06-09T04:36:37.223 INFO:teuthology.orchestra.run.smithi062.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-06-09T04:36:37.229 INFO:teuthology.orchestra.run.smithi062.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-06-09T04:36:37.232 INFO:teuthology.orchestra.run.smithi062.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-06-09T04:36:37.234 INFO:teuthology.orchestra.run.smithi062.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-06-09T04:36:37.244 INFO:teuthology.orchestra.run.smithi062.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-06-09T04:36:37.245 INFO:teuthology.orchestra.run.smithi062.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-06-09T04:36:37.246 INFO:teuthology.orchestra.run.smithi089.stdout:Get:24 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.0.0-4313-ga02638f8-1focal [104 kB] 2023-06-09T04:36:37.248 INFO:teuthology.orchestra.run.smithi089.stdout:Get:25 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.0.0-4313-ga02638f8-1focal [466 kB] 2023-06-09T04:36:37.263 INFO:teuthology.orchestra.run.smithi089.stdout:Get:26 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.0.0-4313-ga02638f8-1focal [25.1 MB] 2023-06-09T04:36:37.360 INFO:teuthology.orchestra.run.smithi089.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-06-09T04:36:37.370 INFO:teuthology.orchestra.run.smithi089.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-06-09T04:36:37.405 INFO:teuthology.orchestra.run.smithi089.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-06-09T04:36:37.410 INFO:teuthology.orchestra.run.smithi089.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-06-09T04:36:37.410 INFO:teuthology.orchestra.run.smithi062.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-06-09T04:36:37.412 INFO:teuthology.orchestra.run.smithi089.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-06-09T04:36:37.415 INFO:teuthology.orchestra.run.smithi089.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-06-09T04:36:37.425 INFO:teuthology.orchestra.run.smithi089.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-06-09T04:36:37.426 INFO:teuthology.orchestra.run.smithi089.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-06-09T04:36:37.591 INFO:teuthology.orchestra.run.smithi089.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-06-09T04:36:37.729 INFO:teuthology.orchestra.run.smithi062.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-06-09T04:36:37.752 INFO:teuthology.orchestra.run.smithi062.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-06-09T04:36:37.823 INFO:teuthology.orchestra.run.smithi062.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-06-09T04:36:37.885 INFO:teuthology.orchestra.run.smithi062.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-06-09T04:36:37.894 INFO:teuthology.orchestra.run.smithi062.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-06-09T04:36:37.907 INFO:teuthology.orchestra.run.smithi089.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-06-09T04:36:37.930 INFO:teuthology.orchestra.run.smithi089.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-06-09T04:36:38.000 INFO:teuthology.orchestra.run.smithi089.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-06-09T04:36:38.014 INFO:teuthology.orchestra.run.smithi062.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-06-09T04:36:38.015 INFO:teuthology.orchestra.run.smithi062.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-06-09T04:36:38.019 INFO:teuthology.orchestra.run.smithi062.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-06-09T04:36:38.023 INFO:teuthology.orchestra.run.smithi062.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-06-09T04:36:38.035 INFO:teuthology.orchestra.run.smithi062.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-06-09T04:36:38.062 INFO:teuthology.orchestra.run.smithi089.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-06-09T04:36:38.070 INFO:teuthology.orchestra.run.smithi089.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-06-09T04:36:38.191 INFO:teuthology.orchestra.run.smithi089.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-06-09T04:36:38.192 INFO:teuthology.orchestra.run.smithi089.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-06-09T04:36:38.195 INFO:teuthology.orchestra.run.smithi089.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-06-09T04:36:38.199 INFO:teuthology.orchestra.run.smithi089.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-06-09T04:36:38.211 INFO:teuthology.orchestra.run.smithi089.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-06-09T04:36:38.220 INFO:teuthology.orchestra.run.smithi062.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-06-09T04:36:38.397 INFO:teuthology.orchestra.run.smithi089.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-06-09T04:36:38.433 INFO:teuthology.orchestra.run.smithi062.stdout:Get:47 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.0.0-4313-ga02638f8-1focal [11.0 MB] 2023-06-09T04:36:38.655 INFO:teuthology.orchestra.run.smithi062.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-06-09T04:36:38.668 INFO:teuthology.orchestra.run.smithi062.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2023-06-09T04:36:38.712 INFO:teuthology.orchestra.run.smithi062.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-06-09T04:36:38.756 INFO:teuthology.orchestra.run.smithi062.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-06-09T04:36:38.765 INFO:teuthology.orchestra.run.smithi062.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-06-09T04:36:38.770 INFO:teuthology.orchestra.run.smithi062.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-06-09T04:36:38.774 INFO:teuthology.orchestra.run.smithi062.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-06-09T04:36:38.800 INFO:teuthology.orchestra.run.smithi062.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-06-09T04:36:38.821 INFO:teuthology.orchestra.run.smithi062.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-06-09T04:36:38.832 INFO:teuthology.orchestra.run.smithi062.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-06-09T04:36:38.834 INFO:teuthology.orchestra.run.smithi089.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-06-09T04:36:38.846 INFO:teuthology.orchestra.run.smithi089.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2023-06-09T04:36:38.891 INFO:teuthology.orchestra.run.smithi089.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-06-09T04:36:38.935 INFO:teuthology.orchestra.run.smithi089.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-06-09T04:36:38.943 INFO:teuthology.orchestra.run.smithi089.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-06-09T04:36:38.949 INFO:teuthology.orchestra.run.smithi089.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-06-09T04:36:38.952 INFO:teuthology.orchestra.run.smithi089.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-06-09T04:36:38.979 INFO:teuthology.orchestra.run.smithi089.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-06-09T04:36:38.997 INFO:teuthology.orchestra.run.smithi062.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-06-09T04:36:39.000 INFO:teuthology.orchestra.run.smithi089.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-06-09T04:36:39.011 INFO:teuthology.orchestra.run.smithi089.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-06-09T04:36:39.082 INFO:teuthology.orchestra.run.smithi062.stdout:Get:59 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.0.0-4313-ga02638f8-1focal [223 kB] 2023-06-09T04:36:39.085 INFO:teuthology.orchestra.run.smithi062.stdout:Get:60 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.0.0-4313-ga02638f8-1focal [133 kB] 2023-06-09T04:36:39.089 INFO:teuthology.orchestra.run.smithi062.stdout:Get:61 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.0.0-4313-ga02638f8-1focal [1,550 kB] 2023-06-09T04:36:39.112 INFO:teuthology.orchestra.run.smithi089.stdout:Get:57 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.0.0-4313-ga02638f8-1focal [11.0 MB] 2023-06-09T04:36:39.176 INFO:teuthology.orchestra.run.smithi089.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-06-09T04:36:39.181 INFO:teuthology.orchestra.run.smithi062.stdout:Get:62 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.0.0-4313-ga02638f8-1focal [9,386 kB] 2023-06-09T04:36:39.187 INFO:teuthology.orchestra.run.smithi062.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-06-09T04:36:39.367 INFO:teuthology.orchestra.run.smithi089.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-06-09T04:36:39.763 INFO:teuthology.orchestra.run.smithi062.stdout:Get:64 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.0.0-4313-ga02638f8-1focal [31.3 MB] 2023-06-09T04:36:39.892 INFO:teuthology.orchestra.run.smithi089.stdout:Get:60 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.0.0-4313-ga02638f8-1focal [223 kB] 2023-06-09T04:36:39.895 INFO:teuthology.orchestra.run.smithi089.stdout:Get:61 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.0.0-4313-ga02638f8-1focal [133 kB] 2023-06-09T04:36:39.899 INFO:teuthology.orchestra.run.smithi089.stdout:Get:62 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.0.0-4313-ga02638f8-1focal [1,550 kB] 2023-06-09T04:36:39.981 INFO:teuthology.orchestra.run.smithi062.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-06-09T04:36:40.002 INFO:teuthology.orchestra.run.smithi089.stdout:Get:63 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.0.0-4313-ga02638f8-1focal [9,386 kB] 2023-06-09T04:36:40.033 INFO:teuthology.orchestra.run.smithi062.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-06-09T04:36:40.035 INFO:teuthology.orchestra.run.smithi062.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-06-09T04:36:40.105 INFO:teuthology.orchestra.run.smithi062.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-06-09T04:36:40.105 INFO:teuthology.orchestra.run.smithi062.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-06-09T04:36:40.106 INFO:teuthology.orchestra.run.smithi062.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-06-09T04:36:40.107 INFO:teuthology.orchestra.run.smithi062.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-06-09T04:36:40.107 INFO:teuthology.orchestra.run.smithi062.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-06-09T04:36:40.108 INFO:teuthology.orchestra.run.smithi062.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-06-09T04:36:40.154 INFO:teuthology.orchestra.run.smithi089.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-06-09T04:36:40.212 INFO:teuthology.orchestra.run.smithi089.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-06-09T04:36:40.214 INFO:teuthology.orchestra.run.smithi089.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-06-09T04:36:40.253 INFO:teuthology.orchestra.run.smithi089.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-06-09T04:36:40.254 INFO:teuthology.orchestra.run.smithi089.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-06-09T04:36:40.272 INFO:teuthology.orchestra.run.smithi062.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-06-09T04:36:40.280 INFO:teuthology.orchestra.run.smithi089.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-06-09T04:36:40.281 INFO:teuthology.orchestra.run.smithi089.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-06-09T04:36:40.282 INFO:teuthology.orchestra.run.smithi089.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-06-09T04:36:40.283 INFO:teuthology.orchestra.run.smithi089.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-06-09T04:36:40.448 INFO:teuthology.orchestra.run.smithi089.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-06-09T04:36:40.589 INFO:teuthology.orchestra.run.smithi062.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-06-09T04:36:40.603 INFO:teuthology.orchestra.run.smithi062.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-06-09T04:36:40.630 INFO:teuthology.orchestra.run.smithi062.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-06-09T04:36:40.710 INFO:teuthology.orchestra.run.smithi089.stdout:Get:74 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.0.0-4313-ga02638f8-1focal [31.3 MB] 2023-06-09T04:36:40.767 INFO:teuthology.orchestra.run.smithi089.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-06-09T04:36:40.781 INFO:teuthology.orchestra.run.smithi089.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-06-09T04:36:40.785 INFO:teuthology.orchestra.run.smithi062.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-06-09T04:36:40.808 INFO:teuthology.orchestra.run.smithi089.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-06-09T04:36:40.829 INFO:teuthology.orchestra.run.smithi062.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-06-09T04:36:40.857 INFO:teuthology.orchestra.run.smithi062.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-06-09T04:36:40.866 INFO:teuthology.orchestra.run.smithi062.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-06-09T04:36:40.909 INFO:teuthology.orchestra.run.smithi062.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-06-09T04:36:40.939 INFO:teuthology.orchestra.run.smithi062.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2023-06-09T04:36:40.941 INFO:teuthology.orchestra.run.smithi062.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-06-09T04:36:40.965 INFO:teuthology.orchestra.run.smithi089.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-06-09T04:36:41.010 INFO:teuthology.orchestra.run.smithi089.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-06-09T04:36:41.038 INFO:teuthology.orchestra.run.smithi089.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-06-09T04:36:41.047 INFO:teuthology.orchestra.run.smithi089.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-06-09T04:36:41.089 INFO:teuthology.orchestra.run.smithi089.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-06-09T04:36:41.120 INFO:teuthology.orchestra.run.smithi089.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2023-06-09T04:36:41.122 INFO:teuthology.orchestra.run.smithi089.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-06-09T04:36:41.225 INFO:teuthology.orchestra.run.smithi062.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-06-09T04:36:41.408 INFO:teuthology.orchestra.run.smithi089.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-06-09T04:36:41.584 INFO:teuthology.orchestra.run.smithi062.stdout:Get:86 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.0.0-4313-ga02638f8-1focal [3,812 B] 2023-06-09T04:36:41.584 INFO:teuthology.orchestra.run.smithi062.stdout:Get:87 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.0.0-4313-ga02638f8-1focal [832 kB] 2023-06-09T04:36:41.624 INFO:teuthology.orchestra.run.smithi062.stdout:Get:88 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.0.0-4313-ga02638f8-1focal [2,295 kB] 2023-06-09T04:36:41.696 INFO:teuthology.orchestra.run.smithi062.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2023-06-09T04:36:41.744 INFO:teuthology.orchestra.run.smithi062.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.0.0-4313-ga02638f8-1focal [211 kB] 2023-06-09T04:36:41.748 INFO:teuthology.orchestra.run.smithi062.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.0.0-4313-ga02638f8-1focal [123 kB] 2023-06-09T04:36:41.750 INFO:teuthology.orchestra.run.smithi062.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.0.0-4313-ga02638f8-1focal [1,774 kB] 2023-06-09T04:36:41.751 INFO:teuthology.orchestra.run.smithi062.stdout:Get:93 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-06-09T04:36:41.834 INFO:teuthology.orchestra.run.smithi062.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.0.0-4313-ga02638f8-1focal [7,894 kB] 2023-06-09T04:36:41.876 INFO:teuthology.orchestra.run.smithi089.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2023-06-09T04:36:41.932 INFO:teuthology.orchestra.run.smithi089.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-06-09T04:36:42.101 INFO:teuthology.orchestra.run.smithi062.stdout:Get:95 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-06-09T04:36:42.103 INFO:teuthology.orchestra.run.smithi062.stdout:Get:96 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-06-09T04:36:42.104 INFO:teuthology.orchestra.run.smithi062.stdout:Get:97 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-06-09T04:36:42.105 INFO:teuthology.orchestra.run.smithi062.stdout:Get:98 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-06-09T04:36:42.106 INFO:teuthology.orchestra.run.smithi062.stdout:Get:99 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-06-09T04:36:42.108 INFO:teuthology.orchestra.run.smithi062.stdout:Get:100 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-06-09T04:36:42.147 INFO:teuthology.orchestra.run.smithi062.stdout:Get:101 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-06-09T04:36:42.148 INFO:teuthology.orchestra.run.smithi062.stdout:Get:102 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-06-09T04:36:42.252 INFO:teuthology.orchestra.run.smithi062.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.0.0-4313-ga02638f8-1focal [3,932 B] 2023-06-09T04:36:42.252 INFO:teuthology.orchestra.run.smithi062.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.0.0-4313-ga02638f8-1focal [43.8 MB] 2023-06-09T04:36:42.282 INFO:teuthology.orchestra.run.smithi089.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-06-09T04:36:42.285 INFO:teuthology.orchestra.run.smithi089.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-06-09T04:36:42.285 INFO:teuthology.orchestra.run.smithi089.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-06-09T04:36:42.286 INFO:teuthology.orchestra.run.smithi089.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-06-09T04:36:42.287 INFO:teuthology.orchestra.run.smithi089.stdout:Get:92 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-06-09T04:36:42.288 INFO:teuthology.orchestra.run.smithi089.stdout:Get:93 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-06-09T04:36:42.317 INFO:teuthology.orchestra.run.smithi062.stdout:Get:105 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-06-09T04:36:42.327 INFO:teuthology.orchestra.run.smithi089.stdout:Get:94 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-06-09T04:36:42.327 INFO:teuthology.orchestra.run.smithi089.stdout:Get:95 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-06-09T04:36:42.485 INFO:teuthology.orchestra.run.smithi062.stdout:Get:106 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-06-09T04:36:42.492 INFO:teuthology.orchestra.run.smithi089.stdout:Get:96 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-06-09T04:36:42.661 INFO:teuthology.orchestra.run.smithi089.stdout:Get:97 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-06-09T04:36:42.699 INFO:teuthology.orchestra.run.smithi062.stdout:Get:107 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-06-09T04:36:42.746 INFO:teuthology.orchestra.run.smithi062.stdout:Get:108 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-06-09T04:36:42.759 INFO:teuthology.orchestra.run.smithi062.stdout:Get:109 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-06-09T04:36:42.823 INFO:teuthology.orchestra.run.smithi062.stdout:Get:110 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-06-09T04:36:42.836 INFO:teuthology.orchestra.run.smithi062.stdout:Get:111 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-06-09T04:36:42.874 INFO:teuthology.orchestra.run.smithi089.stdout:Get:98 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-06-09T04:36:42.921 INFO:teuthology.orchestra.run.smithi089.stdout:Get:99 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-06-09T04:36:42.934 INFO:teuthology.orchestra.run.smithi089.stdout:Get:100 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-06-09T04:36:42.997 INFO:teuthology.orchestra.run.smithi089.stdout:Get:101 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-06-09T04:36:43.011 INFO:teuthology.orchestra.run.smithi089.stdout:Get:102 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-06-09T04:36:43.390 INFO:teuthology.orchestra.run.smithi089.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.0.0-4313-ga02638f8-1focal [3,812 B] 2023-06-09T04:36:43.390 INFO:teuthology.orchestra.run.smithi089.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.0.0-4313-ga02638f8-1focal [832 kB] 2023-06-09T04:36:43.459 INFO:teuthology.orchestra.run.smithi089.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.0.0-4313-ga02638f8-1focal [2,295 kB] 2023-06-09T04:36:43.653 INFO:teuthology.orchestra.run.smithi089.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.0.0-4313-ga02638f8-1focal [211 kB] 2023-06-09T04:36:43.660 INFO:teuthology.orchestra.run.smithi089.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.0.0-4313-ga02638f8-1focal [123 kB] 2023-06-09T04:36:43.665 INFO:teuthology.orchestra.run.smithi089.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.0.0-4313-ga02638f8-1focal [1,774 kB] 2023-06-09T04:36:43.811 INFO:teuthology.orchestra.run.smithi089.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.0.0-4313-ga02638f8-1focal [7,894 kB] 2023-06-09T04:36:44.475 INFO:teuthology.orchestra.run.smithi089.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.0.0-4313-ga02638f8-1focal [3,932 B] 2023-06-09T04:36:44.476 INFO:teuthology.orchestra.run.smithi089.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.0.0-4313-ga02638f8-1focal [43.8 MB] 2023-06-09T04:36:44.592 INFO:teuthology.orchestra.run.smithi062.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.0.0-4313-ga02638f8-1focal [220 kB] 2023-06-09T04:36:44.594 INFO:teuthology.orchestra.run.smithi062.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 18.0.0-4313-ga02638f8-1focal [253 kB] 2023-06-09T04:36:44.597 INFO:teuthology.orchestra.run.smithi062.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 18.0.0-4313-ga02638f8-1focal [23.3 kB] 2023-06-09T04:36:44.598 INFO:teuthology.orchestra.run.smithi062.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 18.0.0-4313-ga02638f8-1focal [12.9 kB] 2023-06-09T04:36:44.598 INFO:teuthology.orchestra.run.smithi062.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.0.0-4313-ga02638f8-1focal [28.0 kB] 2023-06-09T04:36:44.598 INFO:teuthology.orchestra.run.smithi062.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.0.0-4313-ga02638f8-1focal [13.4 MB] 2023-06-09T04:36:45.320 INFO:teuthology.orchestra.run.smithi062.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.0.0-4313-ga02638f8-1focal [97.4 kB] 2023-06-09T04:36:46.240 INFO:teuthology.orchestra.run.smithi062.stdout:Fetched 201 MB in 10s (20.6 MB/s) 2023-06-09T04:36:46.425 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pyperclip. 2023-06-09T04:36:46.497 INFO:teuthology.orchestra.run.smithi062.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 107756 files and directories currently installed.) 2023-06-09T04:36:46.500 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2023-06-09T04:36:46.538 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2023-06-09T04:36:46.643 INFO:teuthology.orchestra.run.smithi089.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.0.0-4313-ga02638f8-1focal [220 kB] 2023-06-09T04:36:46.645 INFO:teuthology.orchestra.run.smithi089.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 18.0.0-4313-ga02638f8-1focal [253 kB] 2023-06-09T04:36:46.647 INFO:teuthology.orchestra.run.smithi089.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 18.0.0-4313-ga02638f8-1focal [23.3 kB] 2023-06-09T04:36:46.647 INFO:teuthology.orchestra.run.smithi089.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 18.0.0-4313-ga02638f8-1focal [12.9 kB] 2023-06-09T04:36:46.648 INFO:teuthology.orchestra.run.smithi089.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.0.0-4313-ga02638f8-1focal [28.0 kB] 2023-06-09T04:36:46.648 INFO:teuthology.orchestra.run.smithi089.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.0.0-4313-ga02638f8-1focal [13.4 MB] 2023-06-09T04:36:46.867 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-wcwidth. 2023-06-09T04:36:46.886 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-06-09T04:36:46.924 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-06-09T04:36:47.229 INFO:teuthology.orchestra.run.smithi089.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/wip-lxb-fscrypt-20230607-0901/a02638f808b8fe11bccdd01222c0e6e2eb71120b/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.0.0-4313-ga02638f8-1focal [97.4 kB] 2023-06-09T04:36:47.270 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-cmd2. 2023-06-09T04:36:47.289 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2023-06-09T04:36:47.327 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2023-06-09T04:36:47.697 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-06-09T04:36:47.716 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-06-09T04:36:47.797 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-06-09T04:36:48.140 INFO:teuthology.orchestra.run.smithi089.stdout:Fetched 201 MB in 12s (17.5 MB/s) 2023-06-09T04:36:48.312 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-06-09T04:36:48.318 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-pyperclip. 2023-06-09T04:36:48.330 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-06-09T04:36:48.369 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-06-09T04:36:48.388 INFO:teuthology.orchestra.run.smithi089.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 107756 files and directories currently installed.) 2023-06-09T04:36:48.391 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2023-06-09T04:36:48.431 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2023-06-09T04:36:48.724 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-06-09T04:36:48.742 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../005-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-06-09T04:36:48.751 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-wcwidth. 2023-06-09T04:36:48.768 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-06-09T04:36:48.782 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-06-09T04:36:48.809 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-06-09T04:36:49.278 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-06-09T04:36:49.291 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-cmd2. 2023-06-09T04:36:49.297 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../006-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-06-09T04:36:49.308 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2023-06-09T04:36:49.355 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-06-09T04:36:49.362 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2023-06-09T04:36:49.716 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-06-09T04:36:49.735 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-06-09T04:36:49.815 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-06-09T04:36:49.999 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-06-09T04:36:50.017 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../007-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-06-09T04:36:50.057 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-06-09T04:36:50.196 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-06-09T04:36:50.215 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-06-09T04:36:50.254 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-06-09T04:36:50.444 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-06-09T04:36:50.463 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../008-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-06-09T04:36:50.502 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-06-09T04:36:50.617 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-06-09T04:36:50.635 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../005-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-06-09T04:36:50.675 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-06-09T04:36:50.905 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-06-09T04:36:50.923 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../009-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-06-09T04:36:50.963 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-06-09T04:36:51.171 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-06-09T04:36:51.190 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../006-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-06-09T04:36:51.250 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-06-09T04:36:51.352 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../010-librbd1_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:36:51.475 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking librbd1 (18.0.0-4313-ga02638f8-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-06-09T04:36:51.750 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-06-09T04:36:51.768 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../007-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-06-09T04:36:51.799 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-06-09T04:36:52.154 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-06-09T04:36:52.172 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../008-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-06-09T04:36:52.207 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../011-librados2_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:36:52.211 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-06-09T04:36:52.330 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking librados2 (18.0.0-4313-ga02638f8-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-06-09T04:36:52.623 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-06-09T04:36:52.642 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../009-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-06-09T04:36:52.681 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-06-09T04:36:53.054 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../010-librbd1_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:36:53.092 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libcephfs2. 2023-06-09T04:36:53.104 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:36:53.142 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libcephfs2 (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:36:53.176 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking librbd1 (18.0.0-4313-ga02638f8-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-06-09T04:36:53.469 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-rados. 2023-06-09T04:36:53.482 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../013-python3-rados_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:36:53.511 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-rados (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:36:53.889 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-06-09T04:36:53.900 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../011-librados2_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:36:53.901 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-4313-ga02638f8-1focal_all.deb ... 2023-06-09T04:36:53.938 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-ceph-argparse (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:36:54.022 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking librados2 (18.0.0-4313-ga02638f8-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-06-09T04:36:54.200 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-cephfs. 2023-06-09T04:36:54.212 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:36:54.249 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-cephfs (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:36:54.577 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-ceph-common. 2023-06-09T04:36:54.590 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-4313-ga02638f8-1focal_all.deb ... 2023-06-09T04:36:54.636 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-ceph-common (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:36:54.759 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libcephfs2. 2023-06-09T04:36:54.771 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:36:54.809 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libcephfs2 (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:36:54.956 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-prettytable. 2023-06-09T04:36:54.975 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../017-python3-prettytable_0.7.2-5_all.deb ... 2023-06-09T04:36:55.005 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-06-09T04:36:55.179 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-rados. 2023-06-09T04:36:55.196 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../013-python3-rados_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:36:55.237 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-rados (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:36:55.300 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-rbd. 2023-06-09T04:36:55.319 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:36:55.358 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-rbd (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:36:55.598 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-06-09T04:36:55.616 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-4313-ga02638f8-1focal_all.deb ... 2023-06-09T04:36:55.656 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-ceph-argparse (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:36:55.745 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-06-09T04:36:55.764 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../019-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-06-09T04:36:55.803 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-06-09T04:36:55.942 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-cephfs. 2023-06-09T04:36:55.961 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:36:56.000 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-cephfs (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:36:56.174 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-06-09T04:36:56.194 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../020-librabbitmq4_0.10.0-1_amd64.deb ... 2023-06-09T04:36:56.232 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-06-09T04:36:56.337 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-ceph-common. 2023-06-09T04:36:56.355 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-4313-ga02638f8-1focal_all.deb ... 2023-06-09T04:36:56.395 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-ceph-common (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:36:56.583 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-06-09T04:36:56.595 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../021-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-06-09T04:36:56.633 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-06-09T04:36:56.764 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-prettytable. 2023-06-09T04:36:56.783 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../017-python3-prettytable_0.7.2-5_all.deb ... 2023-06-09T04:36:56.822 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-06-09T04:36:56.978 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package librgw2. 2023-06-09T04:36:56.996 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../022-librgw2_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:36:57.027 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking librgw2 (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:36:57.092 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-rbd. 2023-06-09T04:36:57.110 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:36:57.150 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-rbd (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:36:57.526 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-06-09T04:36:57.544 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../019-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-06-09T04:36:57.587 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-06-09T04:36:57.930 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-rgw. 2023-06-09T04:36:57.942 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../023-python3-rgw_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:36:57.974 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-06-09T04:36:57.979 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-rgw (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:36:57.993 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../020-librabbitmq4_0.10.0-1_amd64.deb ... 2023-06-09T04:36:58.033 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-06-09T04:36:58.358 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package liboath0. 2023-06-09T04:36:58.378 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2023-06-09T04:36:58.400 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-06-09T04:36:58.416 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-06-09T04:36:58.419 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../021-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-06-09T04:36:58.458 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-06-09T04:36:58.753 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libradosstriper1. 2023-06-09T04:36:58.772 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../025-libradosstriper1_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:36:58.810 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libradosstriper1 (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:36:58.836 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package librgw2. 2023-06-09T04:36:58.855 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../022-librgw2_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:36:58.894 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking librgw2 (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:36:59.231 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-common. 2023-06-09T04:36:59.250 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../026-ceph-common_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:36:59.281 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-common (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:37:00.022 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-rgw. 2023-06-09T04:37:00.039 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../023-python3-rgw_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:37:00.080 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-rgw (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:37:00.450 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package liboath0. 2023-06-09T04:37:00.468 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2023-06-09T04:37:00.508 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-06-09T04:37:00.844 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libradosstriper1. 2023-06-09T04:37:00.863 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../025-libradosstriper1_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:37:00.902 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libradosstriper1 (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:37:01.381 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-common. 2023-06-09T04:37:01.400 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../026-ceph-common_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:37:01.439 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-common (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:37:01.853 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-base. 2023-06-09T04:37:01.873 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../027-ceph-base_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:37:01.951 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-base (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:37:03.342 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-cherrypy3. 2023-06-09T04:37:03.359 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../028-python3-cherrypy3_8.9.1-6_all.deb ... 2023-06-09T04:37:03.399 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-06-09T04:37:03.778 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-natsort. 2023-06-09T04:37:03.790 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../029-python3-natsort_7.0.1-1_all.deb ... 2023-06-09T04:37:03.827 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-06-09T04:37:03.929 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-base. 2023-06-09T04:37:03.947 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../027-ceph-base_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:37:04.009 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-base (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:37:04.164 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-logutils. 2023-06-09T04:37:04.177 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../030-python3-logutils_0.3.3-7_all.deb ... 2023-06-09T04:37:04.214 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-06-09T04:37:04.542 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-markupsafe. 2023-06-09T04:37:04.561 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../031-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-06-09T04:37:04.600 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-06-09T04:37:04.938 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-mako. 2023-06-09T04:37:04.957 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../032-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-06-09T04:37:04.996 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-06-09T04:37:05.450 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-cherrypy3. 2023-06-09T04:37:05.468 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../028-python3-cherrypy3_8.9.1-6_all.deb ... 2023-06-09T04:37:05.508 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-06-09T04:37:05.887 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-natsort. 2023-06-09T04:37:05.905 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../029-python3-natsort_7.0.1-1_all.deb ... 2023-06-09T04:37:05.945 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-06-09T04:37:06.025 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-simplegeneric. 2023-06-09T04:37:06.043 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../033-python3-simplegeneric_0.8.1-3_all.deb ... 2023-06-09T04:37:06.083 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-06-09T04:37:06.298 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-logutils. 2023-06-09T04:37:06.316 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../030-python3-logutils_0.3.3-7_all.deb ... 2023-06-09T04:37:06.356 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-06-09T04:37:06.411 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-singledispatch. 2023-06-09T04:37:06.430 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../034-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-06-09T04:37:06.469 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-06-09T04:37:06.676 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-markupsafe. 2023-06-09T04:37:06.695 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../031-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-06-09T04:37:06.733 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-06-09T04:37:06.797 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-webob. 2023-06-09T04:37:06.815 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../035-python3-webob_1%3a1.8.5-2_all.deb ... 2023-06-09T04:37:06.855 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-06-09T04:37:07.063 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-mako. 2023-06-09T04:37:07.080 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../032-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-06-09T04:37:07.121 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-06-09T04:37:07.258 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-soupsieve. 2023-06-09T04:37:07.276 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../036-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-06-09T04:37:07.316 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-06-09T04:37:07.508 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-simplegeneric. 2023-06-09T04:37:07.526 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../033-python3-simplegeneric_0.8.1-3_all.deb ... 2023-06-09T04:37:07.566 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-06-09T04:37:07.653 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-bs4. 2023-06-09T04:37:07.672 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../037-python3-bs4_4.8.2-1_all.deb ... 2023-06-09T04:37:07.710 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-06-09T04:37:07.902 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-singledispatch. 2023-06-09T04:37:07.920 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../034-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-06-09T04:37:07.960 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-06-09T04:37:08.081 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-waitress. 2023-06-09T04:37:08.100 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../038-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-06-09T04:37:08.145 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-06-09T04:37:08.305 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-webob. 2023-06-09T04:37:08.323 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../035-python3-webob_1%3a1.8.5-2_all.deb ... 2023-06-09T04:37:08.363 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-06-09T04:37:08.501 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-tempita. 2023-06-09T04:37:08.519 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../039-python3-tempita_0.5.2-6_all.deb ... 2023-06-09T04:37:08.559 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-06-09T04:37:08.725 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-soupsieve. 2023-06-09T04:37:08.743 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../036-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-06-09T04:37:08.782 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-06-09T04:37:08.898 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-paste. 2023-06-09T04:37:08.917 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../040-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-06-09T04:37:08.947 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-06-09T04:37:09.119 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-bs4. 2023-06-09T04:37:09.138 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../037-python3-bs4_4.8.2-1_all.deb ... 2023-06-09T04:37:09.177 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-06-09T04:37:09.284 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-06-09T04:37:09.303 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../041-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-06-09T04:37:09.342 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-06-09T04:37:09.572 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-waitress. 2023-06-09T04:37:09.592 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../038-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-06-09T04:37:09.678 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pastedeploy. 2023-06-09T04:37:09.698 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../042-python3-pastedeploy_2.1.0-1_all.deb ... 2023-06-09T04:37:09.736 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-06-09T04:37:09.886 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-06-09T04:37:10.073 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-webtest. 2023-06-09T04:37:10.092 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../043-python3-webtest_2.0.32-2_all.deb ... 2023-06-09T04:37:10.131 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-06-09T04:37:10.492 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pecan. 2023-06-09T04:37:10.511 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../044-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-06-09T04:37:10.534 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-tempita. 2023-06-09T04:37:10.542 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-06-09T04:37:10.552 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../039-python3-tempita_0.5.2-6_all.deb ... 2023-06-09T04:37:10.583 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-06-09T04:37:10.929 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-paste. 2023-06-09T04:37:10.947 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-werkzeug. 2023-06-09T04:37:10.947 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../040-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-06-09T04:37:10.966 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../045-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-06-09T04:37:10.986 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-06-09T04:37:11.004 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-06-09T04:37:11.323 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-06-09T04:37:11.325 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-06-09T04:37:11.342 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../041-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-06-09T04:37:11.343 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../046-ceph-mgr-modules-core_18.0.0-4313-ga02638f8-1focal_all.deb ... 2023-06-09T04:37:11.373 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-06-09T04:37:11.382 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mgr-modules-core (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:37:11.701 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-pastedeploy. 2023-06-09T04:37:11.719 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../042-python3-pastedeploy_2.1.0-1_all.deb ... 2023-06-09T04:37:11.759 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-06-09T04:37:11.829 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-06-09T04:37:11.848 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../047-libsqlite3-mod-ceph_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:37:11.887 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:37:12.096 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-webtest. 2023-06-09T04:37:12.115 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../043-python3-webtest_2.0.32-2_all.deb ... 2023-06-09T04:37:12.154 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-06-09T04:37:12.224 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-cryptography. 2023-06-09T04:37:12.242 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../048-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-06-09T04:37:12.282 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-06-09T04:37:12.515 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-pecan. 2023-06-09T04:37:12.534 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../044-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-06-09T04:37:12.573 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-06-09T04:37:12.677 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-openssl. 2023-06-09T04:37:12.695 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../049-python3-openssl_19.0.0-1build1_all.deb ... 2023-06-09T04:37:12.735 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-06-09T04:37:12.978 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-werkzeug. 2023-06-09T04:37:12.997 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../045-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-06-09T04:37:13.045 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-06-09T04:37:13.105 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mgr. 2023-06-09T04:37:13.124 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../050-ceph-mgr_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:37:13.163 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mgr (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:37:13.390 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-06-09T04:37:13.408 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../046-ceph-mgr-modules-core_18.0.0-4313-ga02638f8-1focal_all.deb ... 2023-06-09T04:37:13.448 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-mgr-modules-core (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:37:13.691 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mon. 2023-06-09T04:37:13.710 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../051-ceph-mon_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:37:13.749 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mon (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:37:13.911 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-06-09T04:37:13.930 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../047-libsqlite3-mod-ceph_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:37:13.969 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:37:14.308 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-cryptography. 2023-06-09T04:37:14.326 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../048-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-06-09T04:37:14.365 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-06-09T04:37:14.778 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-openssl. 2023-06-09T04:37:14.796 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../049-python3-openssl_19.0.0-1build1_all.deb ... 2023-06-09T04:37:14.836 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-06-09T04:37:15.028 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-osd. 2023-06-09T04:37:15.046 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../052-ceph-osd_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:37:15.086 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-osd (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:37:15.231 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-mgr. 2023-06-09T04:37:15.248 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../050-ceph-mgr_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:37:15.289 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-mgr (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:37:15.801 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-mon. 2023-06-09T04:37:15.820 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../051-ceph-mon_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:37:15.859 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-mon (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:37:17.096 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-osd. 2023-06-09T04:37:17.116 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../052-ceph-osd_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:37:17.154 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-osd (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:37:17.847 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph. 2023-06-09T04:37:17.866 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../053-ceph_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:37:17.905 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:37:18.267 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-fuse. 2023-06-09T04:37:18.284 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../054-ceph-fuse_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:37:18.325 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-fuse (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:37:18.762 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mds. 2023-06-09T04:37:18.780 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../055-ceph-mds_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:37:18.819 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mds (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:37:19.372 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package cephadm. 2023-06-09T04:37:19.391 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../056-cephadm_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:37:19.430 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking cephadm (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:37:19.767 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-asyncssh. 2023-06-09T04:37:19.786 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../057-python3-asyncssh_1.12.2-1_all.deb ... 2023-06-09T04:37:19.824 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2023-06-09T04:37:19.857 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph. 2023-06-09T04:37:19.869 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../053-ceph_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:37:19.907 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:37:20.194 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-jinja2. 2023-06-09T04:37:20.212 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../058-python3-jinja2_2.10.1-2_all.deb ... 2023-06-09T04:37:20.243 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-06-09T04:37:20.260 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-fuse. 2023-06-09T04:37:20.272 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../054-ceph-fuse_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:37:20.309 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-fuse (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:37:20.605 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-06-09T04:37:20.624 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../059-ceph-mgr-cephadm_18.0.0-4313-ga02638f8-1focal_all.deb ... 2023-06-09T04:37:20.663 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mgr-cephadm (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:37:20.763 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-mds. 2023-06-09T04:37:20.774 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../055-ceph-mds_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:37:20.812 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-mds (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:37:21.283 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-bcrypt. 2023-06-09T04:37:21.303 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../060-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-06-09T04:37:21.341 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-06-09T04:37:21.375 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package cephadm. 2023-06-09T04:37:21.393 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../056-cephadm_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:37:21.424 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking cephadm (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:37:21.677 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-jwt. 2023-06-09T04:37:21.696 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../061-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-06-09T04:37:21.735 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-06-09T04:37:21.777 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-asyncssh. 2023-06-09T04:37:21.795 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../057-python3-asyncssh_1.12.2-1_all.deb ... 2023-06-09T04:37:21.835 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2023-06-09T04:37:22.089 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-repoze.lru. 2023-06-09T04:37:22.107 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../062-python3-repoze.lru_0.7-2_all.deb ... 2023-06-09T04:37:22.146 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-06-09T04:37:22.223 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-jinja2. 2023-06-09T04:37:22.241 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../058-python3-jinja2_2.10.1-2_all.deb ... 2023-06-09T04:37:22.280 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-06-09T04:37:22.416 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libjs-underscore. 2023-06-09T04:37:22.435 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../063-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-06-09T04:37:22.474 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-06-09T04:37:22.642 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-06-09T04:37:22.660 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../059-ceph-mgr-cephadm_18.0.0-4313-ga02638f8-1focal_all.deb ... 2023-06-09T04:37:22.700 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-mgr-cephadm (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:37:22.760 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-06-09T04:37:22.780 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../064-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-06-09T04:37:22.818 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-06-09T04:37:23.095 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-bcrypt. 2023-06-09T04:37:23.113 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../060-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-06-09T04:37:23.153 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-06-09T04:37:23.196 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-routes. 2023-06-09T04:37:23.214 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../065-python3-routes_2.4.1-2_all.deb ... 2023-06-09T04:37:23.253 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-06-09T04:37:23.490 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-jwt. 2023-06-09T04:37:23.508 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../061-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-06-09T04:37:23.547 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-06-09T04:37:23.624 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-06-09T04:37:23.643 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../066-ceph-mgr-dashboard_18.0.0-4313-ga02638f8-1focal_all.deb ... 2023-06-09T04:37:23.681 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mgr-dashboard (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:37:23.876 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-repoze.lru. 2023-06-09T04:37:23.896 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../062-python3-repoze.lru_0.7-2_all.deb ... 2023-06-09T04:37:23.934 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-06-09T04:37:24.204 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libjs-underscore. 2023-06-09T04:37:24.210 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-decorator. 2023-06-09T04:37:24.220 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../063-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-06-09T04:37:24.230 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../067-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-06-09T04:37:24.261 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-06-09T04:37:24.268 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-06-09T04:37:24.581 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-06-09T04:37:24.599 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../064-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-06-09T04:37:24.604 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-06-09T04:37:24.623 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../068-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-06-09T04:37:24.639 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-06-09T04:37:24.662 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-06-09T04:37:24.991 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-scipy. 2023-06-09T04:37:24.992 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-routes. 2023-06-09T04:37:25.010 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../069-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-06-09T04:37:25.010 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../065-python3-routes_2.4.1-2_all.deb ... 2023-06-09T04:37:25.048 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-06-09T04:37:25.050 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-06-09T04:37:25.428 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-06-09T04:37:25.447 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../066-ceph-mgr-dashboard_18.0.0-4313-ga02638f8-1focal_all.deb ... 2023-06-09T04:37:25.486 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-mgr-dashboard (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:37:26.015 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-decorator. 2023-06-09T04:37:26.034 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../067-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-06-09T04:37:26.073 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-06-09T04:37:26.418 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-06-09T04:37:26.432 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-06-09T04:37:26.436 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../068-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-06-09T04:37:26.451 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../070-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-06-09T04:37:26.476 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-06-09T04:37:26.490 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-06-09T04:37:26.821 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-scipy. 2023-06-09T04:37:26.839 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../069-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-06-09T04:37:26.878 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-06-09T04:37:27.077 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-joblib. 2023-06-09T04:37:27.095 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../071-python3-joblib_0.14.0-3_all.deb ... 2023-06-09T04:37:27.134 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-06-09T04:37:27.530 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-sklearn. 2023-06-09T04:37:27.550 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../072-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-06-09T04:37:27.588 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-06-09T04:37:28.305 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-06-09T04:37:28.324 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../070-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-06-09T04:37:28.338 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-06-09T04:37:28.358 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../073-ceph-mgr-diskprediction-local_18.0.0-4313-ga02638f8-1focal_all.deb ... 2023-06-09T04:37:28.363 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-06-09T04:37:28.396 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:37:28.942 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-joblib. 2023-06-09T04:37:28.961 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../071-python3-joblib_0.14.0-3_all.deb ... 2023-06-09T04:37:28.999 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-06-09T04:37:29.404 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-sklearn. 2023-06-09T04:37:29.423 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../072-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-06-09T04:37:29.461 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-06-09T04:37:29.641 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-cachetools. 2023-06-09T04:37:29.660 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../074-python3-cachetools_4.0.0-1_all.deb ... 2023-06-09T04:37:29.699 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-06-09T04:37:30.027 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pyasn1. 2023-06-09T04:37:30.046 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../075-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-06-09T04:37:30.084 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-06-09T04:37:30.196 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-06-09T04:37:30.213 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../073-ceph-mgr-diskprediction-local_18.0.0-4313-ga02638f8-1focal_all.deb ... 2023-06-09T04:37:30.253 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:37:30.455 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-06-09T04:37:30.474 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../076-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-06-09T04:37:30.512 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-06-09T04:37:30.865 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-rsa. 2023-06-09T04:37:30.885 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../077-python3-rsa_4.0-3_all.deb ... 2023-06-09T04:37:30.923 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-rsa (4.0-3) ... 2023-06-09T04:37:31.277 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-google-auth. 2023-06-09T04:37:31.296 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../078-python3-google-auth_1.5.1-2_all.deb ... 2023-06-09T04:37:31.334 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-06-09T04:37:31.482 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-cachetools. 2023-06-09T04:37:31.501 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../074-python3-cachetools_4.0.0-1_all.deb ... 2023-06-09T04:37:31.540 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-06-09T04:37:31.721 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-blinker. 2023-06-09T04:37:31.741 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../079-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-06-09T04:37:31.779 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-06-09T04:37:31.892 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-pyasn1. 2023-06-09T04:37:31.911 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../075-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-06-09T04:37:31.950 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-06-09T04:37:32.098 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-oauthlib. 2023-06-09T04:37:32.113 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../080-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-06-09T04:37:32.156 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-06-09T04:37:32.304 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-06-09T04:37:32.324 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../076-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-06-09T04:37:32.362 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-06-09T04:37:32.613 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-06-09T04:37:32.633 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../081-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-06-09T04:37:32.670 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-06-09T04:37:32.707 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-rsa. 2023-06-09T04:37:32.725 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../077-python3-rsa_4.0-3_all.deb ... 2023-06-09T04:37:32.765 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-rsa (4.0-3) ... 2023-06-09T04:37:33.024 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-websocket. 2023-06-09T04:37:33.044 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../082-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-06-09T04:37:33.082 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-06-09T04:37:33.127 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-google-auth. 2023-06-09T04:37:33.145 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../078-python3-google-auth_1.5.1-2_all.deb ... 2023-06-09T04:37:33.185 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-06-09T04:37:33.461 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-kubernetes. 2023-06-09T04:37:33.480 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../083-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-06-09T04:37:33.519 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-06-09T04:37:33.530 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-blinker. 2023-06-09T04:37:33.548 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../079-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-06-09T04:37:33.588 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-06-09T04:37:33.916 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-oauthlib. 2023-06-09T04:37:33.936 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../080-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-06-09T04:37:33.974 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-06-09T04:37:34.150 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-06-09T04:37:34.170 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../084-ceph-mgr-k8sevents_18.0.0-4313-ga02638f8-1focal_all.deb ... 2023-06-09T04:37:34.207 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:37:34.431 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-06-09T04:37:34.449 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../081-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-06-09T04:37:34.488 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-06-09T04:37:34.569 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libonig5:amd64. 2023-06-09T04:37:34.589 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../085-libonig5_6.9.4-1_amd64.deb ... 2023-06-09T04:37:34.626 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-06-09T04:37:34.842 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-websocket. 2023-06-09T04:37:34.861 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../082-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-06-09T04:37:34.900 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-06-09T04:37:34.972 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libjq1:amd64. 2023-06-09T04:37:34.991 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../086-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-06-09T04:37:35.021 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-06-09T04:37:35.254 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-kubernetes. 2023-06-09T04:37:35.273 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../083-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-06-09T04:37:35.311 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-06-09T04:37:35.333 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package jq. 2023-06-09T04:37:35.351 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../087-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-06-09T04:37:35.390 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-06-09T04:37:35.661 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package socat. 2023-06-09T04:37:35.679 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../088-socat_1.7.3.3-2_amd64.deb ... 2023-06-09T04:37:35.718 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking socat (1.7.3.3-2) ... 2023-06-09T04:37:35.935 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-06-09T04:37:35.954 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../084-ceph-mgr-k8sevents_18.0.0-4313-ga02638f8-1focal_all.deb ... 2023-06-09T04:37:35.984 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:37:36.080 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package xmlstarlet. 2023-06-09T04:37:36.099 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../089-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-06-09T04:37:36.138 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-06-09T04:37:36.328 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libonig5:amd64. 2023-06-09T04:37:36.341 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../085-libonig5_6.9.4-1_amd64.deb ... 2023-06-09T04:37:36.386 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-06-09T04:37:36.543 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-test. 2023-06-09T04:37:36.562 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../090-ceph-test_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:37:36.600 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-test (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:37:36.757 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libjq1:amd64. 2023-06-09T04:37:36.770 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../086-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-06-09T04:37:36.815 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-06-09T04:37:37.085 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package jq. 2023-06-09T04:37:37.098 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../087-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-06-09T04:37:37.134 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-06-09T04:37:37.412 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package socat. 2023-06-09T04:37:37.425 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../088-socat_1.7.3.3-2_amd64.deb ... 2023-06-09T04:37:37.470 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking socat (1.7.3.3-2) ... 2023-06-09T04:37:37.807 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package xmlstarlet. 2023-06-09T04:37:37.820 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../089-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-06-09T04:37:37.865 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-06-09T04:37:38.270 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-test. 2023-06-09T04:37:38.289 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../090-ceph-test_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:37:38.328 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-test (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:37:40.346 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-volume. 2023-06-09T04:37:40.366 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../091-ceph-volume_18.0.0-4313-ga02638f8-1focal_all.deb ... 2023-06-09T04:37:40.404 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-volume (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:37:40.759 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package cephfs-mirror. 2023-06-09T04:37:40.771 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../092-cephfs-mirror_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:37:40.808 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking cephfs-mirror (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:37:41.153 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-colorama. 2023-06-09T04:37:41.166 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../093-python3-colorama_0.4.3-1build1_all.deb ... 2023-06-09T04:37:41.211 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2023-06-09T04:37:41.497 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package cephfs-shell. 2023-06-09T04:37:41.510 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../094-cephfs-shell_18.0.0-4313-ga02638f8-1focal_all.deb ... 2023-06-09T04:37:41.555 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking cephfs-shell (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:37:41.858 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package cephfs-top. 2023-06-09T04:37:41.877 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../095-cephfs-top_18.0.0-4313-ga02638f8-1focal_all.deb ... 2023-06-09T04:37:41.916 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking cephfs-top (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:37:42.025 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ceph-volume. 2023-06-09T04:37:42.044 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../091-ceph-volume_18.0.0-4313-ga02638f8-1focal_all.deb ... 2023-06-09T04:37:42.082 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ceph-volume (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:37:42.202 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package fonts-mathjax. 2023-06-09T04:37:42.221 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../096-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-06-09T04:37:42.260 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-06-09T04:37:42.463 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package cephfs-mirror. 2023-06-09T04:37:42.482 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../092-cephfs-mirror_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:37:42.520 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking cephfs-mirror (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:37:42.820 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libcephfs-dev. 2023-06-09T04:37:42.839 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../097-libcephfs-dev_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:37:42.869 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libcephfs-dev (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:37:42.890 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-colorama. 2023-06-09T04:37:42.908 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../093-python3-colorama_0.4.3-1build1_all.deb ... 2023-06-09T04:37:42.948 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2023-06-09T04:37:43.227 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package cephfs-shell. 2023-06-09T04:37:43.245 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../094-cephfs-shell_18.0.0-4313-ga02638f8-1focal_all.deb ... 2023-06-09T04:37:43.284 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking cephfs-shell (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:37:43.331 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package nvme-cli. 2023-06-09T04:37:43.350 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../098-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-06-09T04:37:43.425 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-06-09T04:37:43.562 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package cephfs-top. 2023-06-09T04:37:43.581 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../095-cephfs-top_18.0.0-4313-ga02638f8-1focal_all.deb ... 2023-06-09T04:37:43.620 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking cephfs-top (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:37:43.794 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-06-09T04:37:43.812 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../099-python-asyncssh-doc_1.12.2-1_all.deb ... 2023-06-09T04:37:43.851 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2023-06-09T04:37:43.907 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package fonts-mathjax. 2023-06-09T04:37:43.924 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../096-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-06-09T04:37:43.956 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-06-09T04:37:44.255 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libjs-mathjax. 2023-06-09T04:37:44.274 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../100-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-06-09T04:37:44.312 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-06-09T04:37:44.502 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libcephfs-dev. 2023-06-09T04:37:44.522 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../097-libcephfs-dev_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:37:44.560 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libcephfs-dev (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:37:44.981 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package nvme-cli. 2023-06-09T04:37:45.000 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../098-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-06-09T04:37:45.069 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-06-09T04:37:45.410 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-06-09T04:37:45.423 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../099-python-asyncssh-doc_1.12.2-1_all.deb ... 2023-06-09T04:37:45.468 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2023-06-09T04:37:45.905 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libjs-mathjax. 2023-06-09T04:37:45.924 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../100-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-06-09T04:37:45.963 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-06-09T04:37:46.248 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python-natsort-doc. 2023-06-09T04:37:46.269 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../101-python-natsort-doc_7.0.1-1_all.deb ... 2023-06-09T04:37:46.313 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-06-09T04:37:46.683 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-atomicwrites. 2023-06-09T04:37:46.704 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../102-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-06-09T04:37:46.741 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-06-09T04:37:47.078 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-attr. 2023-06-09T04:37:47.097 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../103-python3-attr_19.3.0-2_all.deb ... 2023-06-09T04:37:47.135 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-06-09T04:37:47.489 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-webencodings. 2023-06-09T04:37:47.509 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../104-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-06-09T04:37:47.546 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-06-09T04:37:47.883 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-html5lib. 2023-06-09T04:37:47.901 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../105-python3-html5lib_1.0.1-2_all.deb ... 2023-06-09T04:37:47.922 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python-natsort-doc. 2023-06-09T04:37:47.940 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-06-09T04:37:47.942 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../101-python-natsort-doc_7.0.1-1_all.deb ... 2023-06-09T04:37:47.987 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-06-09T04:37:48.294 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-06-09T04:37:48.314 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../106-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-06-09T04:37:48.351 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-06-09T04:37:48.366 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-atomicwrites. 2023-06-09T04:37:48.385 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../102-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-06-09T04:37:48.424 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-06-09T04:37:48.744 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-attr. 2023-06-09T04:37:48.761 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../103-python3-attr_19.3.0-2_all.deb ... 2023-06-09T04:37:48.801 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-06-09T04:37:48.830 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-packaging. 2023-06-09T04:37:48.849 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../107-python3-packaging_20.3-1_all.deb ... 2023-06-09T04:37:48.888 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-packaging (20.3-1) ... 2023-06-09T04:37:49.138 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-webencodings. 2023-06-09T04:37:49.158 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../104-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-06-09T04:37:49.196 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-06-09T04:37:49.225 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pastescript. 2023-06-09T04:37:49.244 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../108-python3-pastescript_2.0.2-4_all.deb ... 2023-06-09T04:37:49.282 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-06-09T04:37:49.508 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-html5lib. 2023-06-09T04:37:49.526 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../105-python3-html5lib_1.0.1-2_all.deb ... 2023-06-09T04:37:49.565 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-06-09T04:37:49.644 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pluggy. 2023-06-09T04:37:49.664 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../109-python3-pluggy_0.13.0-2_all.deb ... 2023-06-09T04:37:49.702 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-06-09T04:37:49.943 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-06-09T04:37:49.957 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../106-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-06-09T04:37:50.001 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-06-09T04:37:50.064 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-psutil. 2023-06-09T04:37:50.084 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../110-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-06-09T04:37:50.121 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-06-09T04:37:50.492 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-py. 2023-06-09T04:37:50.497 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-packaging. 2023-06-09T04:37:50.512 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../111-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-06-09T04:37:50.517 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../107-python3-packaging_20.3-1_all.deb ... 2023-06-09T04:37:50.549 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-06-09T04:37:50.554 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-packaging (20.3-1) ... 2023-06-09T04:37:50.928 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pyinotify. 2023-06-09T04:37:50.933 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-pastescript. 2023-06-09T04:37:50.949 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../112-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-06-09T04:37:50.953 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../108-python3-pastescript_2.0.2-4_all.deb ... 2023-06-09T04:37:50.991 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-06-09T04:37:50.994 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-06-09T04:37:51.314 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pytest. 2023-06-09T04:37:51.333 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../113-python3-pytest_4.6.9-1_all.deb ... 2023-06-09T04:37:51.353 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-pluggy. 2023-06-09T04:37:51.371 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-06-09T04:37:51.372 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../109-python3-pluggy_0.13.0-2_all.deb ... 2023-06-09T04:37:51.411 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-06-09T04:37:51.757 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-psutil. 2023-06-09T04:37:51.776 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../110-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-06-09T04:37:51.814 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-06-09T04:37:52.034 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-simplejson. 2023-06-09T04:37:52.053 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../114-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-06-09T04:37:52.092 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-06-09T04:37:52.192 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-py. 2023-06-09T04:37:52.213 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../111-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-06-09T04:37:52.250 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-06-09T04:37:52.420 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-06-09T04:37:52.440 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-06-09T04:37:52.478 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-06-09T04:37:52.629 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-pyinotify. 2023-06-09T04:37:52.648 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../112-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-06-09T04:37:52.687 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-06-09T04:37:53.024 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-pytest. 2023-06-09T04:37:53.043 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../113-python3-pytest_4.6.9-1_all.deb ... 2023-06-09T04:37:53.081 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-06-09T04:37:53.174 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package radosgw. 2023-06-09T04:37:53.193 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../116-radosgw_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:37:53.231 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking radosgw (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:37:53.419 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package python3-simplejson. 2023-06-09T04:37:53.438 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../114-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-06-09T04:37:53.476 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-06-09T04:37:53.797 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-06-09T04:37:53.817 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-06-09T04:37:53.855 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-06-09T04:37:54.567 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package radosgw. 2023-06-09T04:37:54.579 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../116-radosgw_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:37:54.601 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package rbd-fuse. 2023-06-09T04:37:54.608 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking radosgw (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:37:54.621 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../117-rbd-fuse_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:37:54.659 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking rbd-fuse (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:37:55.002 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-attr (19.3.0-2) ... 2023-06-09T04:37:55.365 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-06-09T04:37:55.508 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-06-09T04:37:55.634 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-06-09T04:37:55.852 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up cephadm (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:37:56.129 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package rbd-fuse. 2023-06-09T04:37:56.142 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../117-rbd-fuse_18.0.0-4313-ga02638f8-1focal_amd64.deb ... 2023-06-09T04:37:56.187 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking rbd-fuse (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:37:56.526 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-attr (19.3.0-2) ... 2023-06-09T04:37:56.627 INFO:teuthology.orchestra.run.smithi062.stdout:Adding system user cephadm....done 2023-06-09T04:37:56.837 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-06-09T04:37:56.885 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-06-09T04:37:56.971 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-06-09T04:37:57.010 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-06-09T04:37:57.137 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-06-09T04:37:57.355 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up cephadm (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:37:57.389 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-06-09T04:37:57.749 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-06-09T04:37:57.875 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-06-09T04:37:58.001 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-06-09T04:37:58.075 INFO:teuthology.orchestra.run.smithi089.stdout:Adding system user cephadm....done 2023-06-09T04:37:58.257 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-06-09T04:37:58.383 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-06-09T04:37:58.402 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-06-09T04:37:58.810 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-06-09T04:37:58.947 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-06-09T04:37:59.170 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-06-09T04:37:59.296 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-06-09T04:37:59.307 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-06-09T04:37:59.422 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-06-09T04:37:59.666 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2023-06-09T04:37:59.807 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-06-09T04:38:00.017 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-06-09T04:38:00.285 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-06-09T04:38:00.360 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-06-09T04:38:00.628 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-06-09T04:38:00.715 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-ceph-argparse (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:00.980 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2023-06-09T04:38:01.091 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-06-09T04:38:01.216 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2023-06-09T04:38:01.330 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-06-09T04:38:01.576 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-06-09T04:38:01.665 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-06-09T04:38:01.927 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-06-09T04:38:02.021 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-ceph-argparse (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:02.278 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-06-09T04:38:02.372 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-06-09T04:38:02.406 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-06-09T04:38:02.498 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2023-06-09T04:38:02.849 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-06-09T04:38:02.864 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-06-09T04:38:03.193 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-06-09T04:38:03.231 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-06-09T04:38:03.544 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-06-09T04:38:03.593 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-06-09T04:38:03.670 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-06-09T04:38:04.002 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-06-09T04:38:04.138 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-06-09T04:38:04.353 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-06-09T04:38:04.489 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-06-09T04:38:04.780 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-06-09T04:38:04.834 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-06-09T04:38:05.139 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-packaging (20.3-1) ... 2023-06-09T04:38:05.236 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-06-09T04:38:05.507 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-06-09T04:38:05.587 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-06-09T04:38:05.633 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-06-09T04:38:05.767 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-06-09T04:38:05.988 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-06-09T04:38:06.118 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-06-09T04:38:06.573 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-packaging (20.3-1) ... 2023-06-09T04:38:06.594 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2023-06-09T04:38:06.924 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-06-09T04:38:06.979 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-06-09T04:38:07.050 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-06-09T04:38:07.176 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-06-09T04:38:07.422 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-06-09T04:38:07.669 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-06-09T04:38:07.874 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up socat (1.7.3.3-2) ... 2023-06-09T04:38:08.000 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-ceph-common (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:08.137 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2023-06-09T04:38:08.401 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-06-09T04:38:08.489 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-06-09T04:38:08.536 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-06-09T04:38:08.915 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-06-09T04:38:08.962 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-06-09T04:38:09.088 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-06-09T04:38:09.214 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-06-09T04:38:09.358 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up socat (1.7.3.3-2) ... 2023-06-09T04:38:09.484 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-ceph-common (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:09.574 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-06-09T04:38:09.869 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-06-09T04:38:09.966 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-06-09T04:38:10.012 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-06-09T04:38:10.093 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-06-09T04:38:10.219 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-06-09T04:38:10.430 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-06-09T04:38:10.556 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-06-09T04:38:10.604 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-06-09T04:38:10.682 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-06-09T04:38:10.957 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-06-09T04:38:11.042 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-06-09T04:38:11.325 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-06-09T04:38:11.435 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-06-09T04:38:11.451 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-06-09T04:38:11.562 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-06-09T04:38:11.696 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-06-09T04:38:11.803 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-06-09T04:38:12.164 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-06-09T04:38:12.170 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-06-09T04:38:12.518 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-06-09T04:38:12.546 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-06-09T04:38:12.869 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-06-09T04:38:12.973 INFO:teuthology.orchestra.run.smithi062.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-06-09T04:38:12.996 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-06-09T04:38:13.277 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-06-09T04:38:13.338 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-06-09T04:38:13.402 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-06-09T04:38:13.690 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-06-09T04:38:13.804 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-06-09T04:38:14.066 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-06-09T04:38:14.239 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-06-09T04:38:14.365 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-06-09T04:38:14.458 INFO:teuthology.orchestra.run.smithi089.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-06-09T04:38:14.482 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-06-09T04:38:14.772 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-06-09T04:38:14.898 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-06-09T04:38:14.900 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-06-09T04:38:15.278 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-06-09T04:38:15.283 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-06-09T04:38:15.711 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-06-09T04:38:15.835 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-06-09T04:38:15.961 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-06-09T04:38:16.363 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-06-09T04:38:16.708 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-06-09T04:38:17.142 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-06-09T04:38:17.268 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-06-09T04:38:17.720 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-06-09T04:38:18.113 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-06-09T04:38:18.464 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-06-09T04:38:18.481 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-06-09T04:38:18.590 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-06-09T04:38:18.607 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-06-09T04:38:19.007 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-06-09T04:38:19.058 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-06-09T04:38:19.401 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2023-06-09T04:38:19.426 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-06-09T04:38:19.777 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-06-09T04:38:19.869 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-06-09T04:38:19.903 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-06-09T04:38:20.270 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-06-09T04:38:20.321 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-06-09T04:38:20.715 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2023-06-09T04:38:21.166 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-06-09T04:38:21.535 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-06-09T04:38:21.577 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-06-09T04:38:21.661 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-06-09T04:38:21.787 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-06-09T04:38:21.913 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-rsa (4.0-3) ... 2023-06-09T04:38:22.423 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-06-09T04:38:22.549 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-06-09T04:38:22.807 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-06-09T04:38:22.925 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-06-09T04:38:22.941 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-06-09T04:38:23.067 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-06-09T04:38:23.193 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-rsa (4.0-3) ... 2023-06-09T04:38:23.292 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-06-09T04:38:23.544 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-06-09T04:38:23.677 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-06-09T04:38:23.679 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-06-09T04:38:24.047 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-06-09T04:38:24.121 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up librados2 (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:24.351 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2023-06-09T04:38:24.406 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-06-09T04:38:24.477 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up librgw2 (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:24.603 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libsqlite3-mod-ceph (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:24.729 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libcephfs2 (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:24.783 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-06-09T04:38:24.855 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-routes (2.4.1-2) ... 2023-06-09T04:38:25.210 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up librados2 (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:25.215 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libradosstriper1 (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:25.341 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-06-09T04:38:25.438 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2023-06-09T04:38:25.564 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up librgw2 (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:25.691 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libsqlite3-mod-ceph (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:25.718 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up librbd1 (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:25.817 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libcephfs2 (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:25.844 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mgr-modules-core (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:25.943 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-routes (2.4.1-2) ... 2023-06-09T04:38:25.970 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-fuse (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:26.224 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-06-09T04:38:26.225 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-06-09T04:38:26.303 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libradosstriper1 (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:26.429 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-06-09T04:38:26.789 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up librbd1 (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:26.915 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-mgr-modules-core (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:27.041 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-fuse (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:27.046 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libcephfs-dev (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:27.172 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-rados (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:27.306 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-06-09T04:38:27.306 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-06-09T04:38:27.365 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up cephfs-top (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:27.491 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-06-09T04:38:28.118 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libcephfs-dev (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:28.244 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-rados (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:28.370 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up cephfs-top (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:28.505 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-06-09T04:38:28.662 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-rbd (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:28.779 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up rbd-fuse (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:28.905 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-rgw (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:29.040 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-cephfs (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:29.166 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up cephfs-shell (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:29.292 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-common (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:29.642 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-rbd (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:29.760 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up rbd-fuse (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:29.864 INFO:teuthology.orchestra.run.smithi062.stdout:Adding group ceph....done 2023-06-09T04:38:29.886 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-rgw (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:30.031 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up python3-cephfs (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:30.157 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up cephfs-shell (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:30.274 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-common (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:30.305 INFO:teuthology.orchestra.run.smithi062.stdout:Adding system user ceph....done 2023-06-09T04:38:30.529 INFO:teuthology.orchestra.run.smithi062.stdout:Setting system user ceph properties....done 2023-06-09T04:38:30.561 INFO:teuthology.orchestra.run.smithi062.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-06-09T04:38:30.763 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-06-09T04:38:30.847 INFO:teuthology.orchestra.run.smithi089.stdout:Adding group ceph....done 2023-06-09T04:38:31.283 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-06-09T04:38:31.287 INFO:teuthology.orchestra.run.smithi089.stdout:Adding system user ceph....done 2023-06-09T04:38:31.509 INFO:teuthology.orchestra.run.smithi089.stdout:Setting system user ceph properties....done 2023-06-09T04:38:31.541 INFO:teuthology.orchestra.run.smithi089.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-06-09T04:38:31.727 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-06-09T04:38:32.210 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up cephfs-mirror (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:32.298 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-06-09T04:38:32.336 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-test (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:32.497 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up radosgw (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:32.817 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-06-09T04:38:32.817 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-06-09T04:38:33.243 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up cephfs-mirror (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:33.369 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-test (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:33.495 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up radosgw (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:33.814 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-06-09T04:38:33.815 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-06-09T04:38:34.068 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-base (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:34.565 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-06-09T04:38:35.039 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-base (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:35.453 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mds (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:35.543 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-06-09T04:38:35.742 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-06-09T04:38:35.743 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-06-09T04:38:36.427 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-mds (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:36.613 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mgr (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:36.699 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-06-09T04:38:36.700 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-06-09T04:38:36.893 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-06-09T04:38:36.893 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-06-09T04:38:37.554 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-mgr (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:37.715 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-osd (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:37.826 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-06-09T04:38:37.827 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-06-09T04:38:38.495 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-06-09T04:38:38.496 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-06-09T04:38:38.680 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-osd (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:39.359 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mgr-k8sevents (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:39.476 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-06-09T04:38:39.476 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-06-09T04:38:39.484 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:39.635 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mon (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:39.900 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-06-09T04:38:39.901 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-06-09T04:38:40.340 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-mgr-k8sevents (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:40.465 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:40.616 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-mon (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:40.753 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mgr-cephadm (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:40.880 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-06-09T04:38:40.880 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-06-09T04:38:40.904 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:41.055 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mgr-dashboard (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:41.216 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-volume (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:41.344 INFO:teuthology.orchestra.run.smithi062.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-06-09T04:38:41.504 INFO:teuthology.orchestra.run.smithi062.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-06-09T04:38:41.709 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-mgr-cephadm (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:41.852 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:41.978 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-mgr-dashboard (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:41.979 INFO:teuthology.orchestra.run.smithi062.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-06-09T04:38:42.180 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ceph-volume (18.0.0-4313-ga02638f8-1focal) ... 2023-06-09T04:38:42.307 INFO:teuthology.orchestra.run.smithi089.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-06-09T04:38:42.469 INFO:teuthology.orchestra.run.smithi089.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-06-09T04:38:42.929 INFO:teuthology.orchestra.run.smithi089.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-06-09T04:38:47.066 INFO:teuthology.orchestra.run.smithi062.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-06-09T04:38:47.834 INFO:teuthology.orchestra.run.smithi062.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-06-09T04:38:47.839 DEBUG:teuthology.orchestra.run.smithi062:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-06-09T04:38:47.970 INFO:teuthology.orchestra.run.smithi062.stdout:Reading package lists... 2023-06-09T04:38:47.973 INFO:teuthology.orchestra.run.smithi089.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-06-09T04:38:48.173 INFO:teuthology.orchestra.run.smithi062.stdout:Building dependency tree... 2023-06-09T04:38:48.174 INFO:teuthology.orchestra.run.smithi062.stdout:Reading state information... 2023-06-09T04:38:48.365 INFO:teuthology.orchestra.run.smithi062.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2023-06-09T04:38:48.366 INFO:teuthology.orchestra.run.smithi062.stdout:flex is already the newest version (2.6.4-6.2). 2023-06-09T04:38:48.366 INFO:teuthology.orchestra.run.smithi062.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2023-06-09T04:38:48.366 INFO:teuthology.orchestra.run.smithi062.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-06-09T04:38:48.366 INFO:teuthology.orchestra.run.smithi062.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-06-09T04:38:48.366 INFO:teuthology.orchestra.run.smithi062.stdout:util-linux is already the newest version (2.34-0.1ubuntu9.3). 2023-06-09T04:38:48.366 INFO:teuthology.orchestra.run.smithi062.stdout:uuid-dev is already the newest version (2.34-0.1ubuntu9.3). 2023-06-09T04:38:48.366 INFO:teuthology.orchestra.run.smithi062.stdout:The following packages were automatically installed and are no longer required: 2023-06-09T04:38:48.367 INFO:teuthology.orchestra.run.smithi062.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-06-09T04:38:48.367 INFO:teuthology.orchestra.run.smithi062.stdout:Use 'sudo apt autoremove' to remove them. 2023-06-09T04:38:48.367 INFO:teuthology.orchestra.run.smithi062.stdout:The following additional packages will be installed: 2023-06-09T04:38:48.368 INFO:teuthology.orchestra.run.smithi062.stdout: libbluetooth3 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 2023-06-09T04:38:48.368 INFO:teuthology.orchestra.run.smithi062.stdout: libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl1.1 libteamdctl0 modemmanager 2023-06-09T04:38:48.368 INFO:teuthology.orchestra.run.smithi062.stdout: network-manager-pptp postgresql-12 postgresql-client-12 2023-06-09T04:38:48.368 INFO:teuthology.orchestra.run.smithi062.stdout: postgresql-client-common ppp pptp-linux usb-modeswitch usb-modeswitch-data 2023-06-09T04:38:48.369 INFO:teuthology.orchestra.run.smithi062.stdout: wpasupplicant 2023-06-09T04:38:48.369 INFO:teuthology.orchestra.run.smithi062.stdout:Suggested packages: 2023-06-09T04:38:48.369 INFO:teuthology.orchestra.run.smithi062.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils postgresql-doc 2023-06-09T04:38:48.370 INFO:teuthology.orchestra.run.smithi062.stdout: postgresql-doc-12 libjson-perl comgt wvdial wpagui libengine-pkcs11-openssl 2023-06-09T04:38:48.465 INFO:teuthology.orchestra.run.smithi062.stdout:The following NEW packages will be installed: 2023-06-09T04:38:48.465 INFO:teuthology.orchestra.run.smithi062.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2023-06-09T04:38:48.465 INFO:teuthology.orchestra.run.smithi062.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy 2023-06-09T04:38:48.466 INFO:teuthology.orchestra.run.smithi062.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2023-06-09T04:38:48.466 INFO:teuthology.orchestra.run.smithi062.stdout: postgresql postgresql-12 postgresql-client postgresql-client-12 2023-06-09T04:38:48.466 INFO:teuthology.orchestra.run.smithi062.stdout: postgresql-client-common postgresql-common postgresql-contrib ppp pptp-linux 2023-06-09T04:38:48.467 INFO:teuthology.orchestra.run.smithi062.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-06-09T04:38:48.467 INFO:teuthology.orchestra.run.smithi062.stdout:The following packages will be upgraded: 2023-06-09T04:38:48.468 INFO:teuthology.orchestra.run.smithi062.stdout: libssl1.1 2023-06-09T04:38:48.554 INFO:teuthology.orchestra.run.smithi062.stdout:1 upgraded, 31 newly installed, 0 to remove and 185 not upgraded. 2023-06-09T04:38:48.555 INFO:teuthology.orchestra.run.smithi062.stdout:Need to get 24.0 MB of archives. 2023-06-09T04:38:48.555 INFO:teuthology.orchestra.run.smithi062.stdout:After this operation, 79.9 MB of additional disk space will be used. 2023-06-09T04:38:48.555 INFO:teuthology.orchestra.run.smithi062.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.19 [1,321 kB] 2023-06-09T04:38:48.690 INFO:teuthology.orchestra.run.smithi062.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2023-06-09T04:38:48.692 INFO:teuthology.orchestra.run.smithi062.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2023-06-09T04:38:48.696 INFO:teuthology.orchestra.run.smithi062.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 indent amd64 2.2.12-1 [86.9 kB] 2023-06-09T04:38:48.699 INFO:teuthology.orchestra.run.smithi062.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2023-06-09T04:38:48.699 INFO:teuthology.orchestra.run.smithi062.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.6 [60.6 kB] 2023-06-09T04:38:48.701 INFO:teuthology.orchestra.run.smithi062.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 libelf-dev amd64 0.176-1.1build1 [57.0 kB] 2023-06-09T04:38:48.701 INFO:teuthology.orchestra.run.smithi062.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2023-06-09T04:38:48.704 INFO:teuthology.orchestra.run.smithi062.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2023-06-09T04:38:48.704 INFO:teuthology.orchestra.run.smithi062.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2023-06-09T04:38:48.707 INFO:teuthology.orchestra.run.smithi062.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2023-06-09T04:38:48.737 INFO:teuthology.orchestra.run.smithi089.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-06-09T04:38:48.743 INFO:teuthology.orchestra.run.smithi062.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.3 [370 kB] 2023-06-09T04:38:48.743 DEBUG:teuthology.orchestra.run.smithi089:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-06-09T04:38:48.848 INFO:teuthology.orchestra.run.smithi062.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpq5 amd64 12.15-0ubuntu0.20.04.1 [116 kB] 2023-06-09T04:38:48.853 INFO:teuthology.orchestra.run.smithi062.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2023-06-09T04:38:48.867 INFO:teuthology.orchestra.run.smithi089.stdout:Reading package lists... 2023-06-09T04:38:48.878 INFO:teuthology.orchestra.run.smithi062.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2023-06-09T04:38:48.879 INFO:teuthology.orchestra.run.smithi062.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.19 [1,584 kB] 2023-06-09T04:38:48.904 INFO:teuthology.orchestra.run.smithi062.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2023-06-09T04:38:48.905 INFO:teuthology.orchestra.run.smithi062.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2023-06-09T04:38:48.915 INFO:teuthology.orchestra.run.smithi062.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2023-06-09T04:38:48.928 INFO:teuthology.orchestra.run.smithi062.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.3 [1,855 kB] 2023-06-09T04:38:48.948 INFO:teuthology.orchestra.run.smithi062.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2023-06-09T04:38:48.952 INFO:teuthology.orchestra.run.smithi062.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2023-06-09T04:38:48.987 INFO:teuthology.orchestra.run.smithi062.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2023-06-09T04:38:49.028 INFO:teuthology.orchestra.run.smithi062.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-common all 214ubuntu0.1 [28.2 kB] 2023-06-09T04:38:49.039 INFO:teuthology.orchestra.run.smithi062.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-12 amd64 12.15-0ubuntu0.20.04.1 [1,052 kB] 2023-06-09T04:38:49.072 INFO:teuthology.orchestra.run.smithi089.stdout:Building dependency tree... 2023-06-09T04:38:49.073 INFO:teuthology.orchestra.run.smithi089.stdout:Reading state information... 2023-06-09T04:38:49.121 INFO:teuthology.orchestra.run.smithi062.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-common all 214ubuntu0.1 [169 kB] 2023-06-09T04:38:49.125 INFO:teuthology.orchestra.run.smithi062.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-12 amd64 12.15-0ubuntu0.20.04.1 [13.5 MB] 2023-06-09T04:38:49.251 INFO:teuthology.orchestra.run.smithi089.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2023-06-09T04:38:49.252 INFO:teuthology.orchestra.run.smithi089.stdout:flex is already the newest version (2.6.4-6.2). 2023-06-09T04:38:49.252 INFO:teuthology.orchestra.run.smithi089.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2023-06-09T04:38:49.252 INFO:teuthology.orchestra.run.smithi089.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-06-09T04:38:49.252 INFO:teuthology.orchestra.run.smithi089.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-06-09T04:38:49.252 INFO:teuthology.orchestra.run.smithi089.stdout:util-linux is already the newest version (2.34-0.1ubuntu9.3). 2023-06-09T04:38:49.252 INFO:teuthology.orchestra.run.smithi089.stdout:uuid-dev is already the newest version (2.34-0.1ubuntu9.3). 2023-06-09T04:38:49.252 INFO:teuthology.orchestra.run.smithi089.stdout:The following packages were automatically installed and are no longer required: 2023-06-09T04:38:49.253 INFO:teuthology.orchestra.run.smithi089.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-06-09T04:38:49.253 INFO:teuthology.orchestra.run.smithi089.stdout:Use 'sudo apt autoremove' to remove them. 2023-06-09T04:38:49.253 INFO:teuthology.orchestra.run.smithi089.stdout:The following additional packages will be installed: 2023-06-09T04:38:49.254 INFO:teuthology.orchestra.run.smithi089.stdout: libbluetooth3 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 2023-06-09T04:38:49.254 INFO:teuthology.orchestra.run.smithi089.stdout: libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl1.1 libteamdctl0 modemmanager 2023-06-09T04:38:49.254 INFO:teuthology.orchestra.run.smithi089.stdout: network-manager-pptp postgresql-12 postgresql-client-12 2023-06-09T04:38:49.254 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql-client-common ppp pptp-linux usb-modeswitch usb-modeswitch-data 2023-06-09T04:38:49.254 INFO:teuthology.orchestra.run.smithi089.stdout: wpasupplicant 2023-06-09T04:38:49.254 INFO:teuthology.orchestra.run.smithi089.stdout:Suggested packages: 2023-06-09T04:38:49.255 INFO:teuthology.orchestra.run.smithi089.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils postgresql-doc 2023-06-09T04:38:49.255 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql-doc-12 libjson-perl comgt wvdial wpagui libengine-pkcs11-openssl 2023-06-09T04:38:49.279 INFO:teuthology.orchestra.run.smithi062.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql all 12+214ubuntu0.1 [3,924 B] 2023-06-09T04:38:49.280 INFO:teuthology.orchestra.run.smithi062.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client all 12+214ubuntu0.1 [3,940 B] 2023-06-09T04:38:49.280 INFO:teuthology.orchestra.run.smithi062.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-contrib all 12+214ubuntu0.1 [3,932 B] 2023-06-09T04:38:49.280 INFO:teuthology.orchestra.run.smithi062.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2023-06-09T04:38:49.281 INFO:teuthology.orchestra.run.smithi062.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2023-06-09T04:38:49.346 INFO:teuthology.orchestra.run.smithi089.stdout:The following NEW packages will be installed: 2023-06-09T04:38:49.346 INFO:teuthology.orchestra.run.smithi089.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2023-06-09T04:38:49.347 INFO:teuthology.orchestra.run.smithi089.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy 2023-06-09T04:38:49.347 INFO:teuthology.orchestra.run.smithi089.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2023-06-09T04:38:49.347 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql postgresql-12 postgresql-client postgresql-client-12 2023-06-09T04:38:49.348 INFO:teuthology.orchestra.run.smithi089.stdout: postgresql-client-common postgresql-common postgresql-contrib ppp pptp-linux 2023-06-09T04:38:49.348 INFO:teuthology.orchestra.run.smithi089.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-06-09T04:38:49.348 INFO:teuthology.orchestra.run.smithi089.stdout:The following packages will be upgraded: 2023-06-09T04:38:49.349 INFO:teuthology.orchestra.run.smithi089.stdout: libssl1.1 2023-06-09T04:38:49.542 INFO:teuthology.orchestra.run.smithi089.stdout:1 upgraded, 31 newly installed, 0 to remove and 185 not upgraded. 2023-06-09T04:38:49.542 INFO:teuthology.orchestra.run.smithi089.stdout:Need to get 24.0 MB of archives. 2023-06-09T04:38:49.543 INFO:teuthology.orchestra.run.smithi089.stdout:After this operation, 79.9 MB of additional disk space will be used. 2023-06-09T04:38:49.543 INFO:teuthology.orchestra.run.smithi089.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.19 [1,321 kB] 2023-06-09T04:38:49.835 INFO:teuthology.orchestra.run.smithi062.stdout:Preconfiguring packages ... 2023-06-09T04:38:50.047 INFO:teuthology.orchestra.run.smithi062.stdout:Fetched 24.0 MB in 1s (29.8 MB/s) 2023-06-09T04:38:50.199 INFO:teuthology.orchestra.run.smithi089.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2023-06-09T04:38:50.201 INFO:teuthology.orchestra.run.smithi089.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2023-06-09T04:38:50.207 INFO:teuthology.orchestra.run.smithi089.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 indent amd64 2.2.12-1 [86.9 kB] 2023-06-09T04:38:50.210 INFO:teuthology.orchestra.run.smithi089.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2023-06-09T04:38:50.211 INFO:teuthology.orchestra.run.smithi089.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.6 [60.6 kB] 2023-06-09T04:38:50.213 INFO:teuthology.orchestra.run.smithi089.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 libelf-dev amd64 0.176-1.1build1 [57.0 kB] 2023-06-09T04:38:50.215 INFO:teuthology.orchestra.run.smithi089.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2023-06-09T04:38:50.221 INFO:teuthology.orchestra.run.smithi089.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2023-06-09T04:38:50.222 INFO:teuthology.orchestra.run.smithi089.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2023-06-09T04:38:50.280 INFO:teuthology.orchestra.run.smithi089.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2023-06-09T04:38:50.383 INFO:teuthology.orchestra.run.smithi062.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118860 files and directories currently installed.) 2023-06-09T04:38:50.387 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../00-libssl1.1_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-06-09T04:38:50.445 INFO:teuthology.orchestra.run.smithi089.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.3 [370 kB] 2023-06-09T04:38:50.567 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.19) over (1.1.1f-1ubuntu2.16) ... 2023-06-09T04:38:50.946 INFO:teuthology.orchestra.run.smithi089.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpq5 amd64 12.15-0ubuntu0.20.04.1 [116 kB] 2023-06-09T04:38:50.964 INFO:teuthology.orchestra.run.smithi089.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2023-06-09T04:38:51.087 INFO:teuthology.orchestra.run.smithi089.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2023-06-09T04:38:51.087 INFO:teuthology.orchestra.run.smithi089.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.19 [1,584 kB] 2023-06-09T04:38:51.096 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-06-09T04:38:51.118 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2_amd64.deb ... 2023-06-09T04:38:51.163 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2023-06-09T04:38:51.206 INFO:teuthology.orchestra.run.smithi089.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2023-06-09T04:38:51.207 INFO:teuthology.orchestra.run.smithi089.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2023-06-09T04:38:51.240 INFO:teuthology.orchestra.run.smithi089.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2023-06-09T04:38:51.275 INFO:teuthology.orchestra.run.smithi089.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.3 [1,855 kB] 2023-06-09T04:38:51.320 INFO:teuthology.orchestra.run.smithi089.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2023-06-09T04:38:51.330 INFO:teuthology.orchestra.run.smithi089.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2023-06-09T04:38:51.495 INFO:teuthology.orchestra.run.smithi089.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2023-06-09T04:38:51.525 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package dump. 2023-06-09T04:38:51.545 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../02-dump_0.4b46-6_amd64.deb ... 2023-06-09T04:38:51.583 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking dump (0.4b46-6) ... 2023-06-09T04:38:51.685 INFO:teuthology.orchestra.run.smithi089.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-common all 214ubuntu0.1 [28.2 kB] 2023-06-09T04:38:51.735 INFO:teuthology.orchestra.run.smithi089.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-12 amd64 12.15-0ubuntu0.20.04.1 [1,052 kB] 2023-06-09T04:38:51.962 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package indent. 2023-06-09T04:38:51.982 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../03-indent_2.2.12-1_amd64.deb ... 2023-06-09T04:38:52.020 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking indent (2.2.12-1) ... 2023-06-09T04:38:52.113 INFO:teuthology.orchestra.run.smithi089.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-common all 214ubuntu0.1 [169 kB] 2023-06-09T04:38:52.129 INFO:teuthology.orchestra.run.smithi089.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-12 amd64 12.15-0ubuntu0.20.04.1 [13.5 MB] 2023-06-09T04:38:52.357 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-06-09T04:38:52.377 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-5_amd64.deb ... 2023-06-09T04:38:52.423 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2023-06-09T04:38:52.560 INFO:teuthology.orchestra.run.smithi089.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql all 12+214ubuntu0.1 [3,924 B] 2023-06-09T04:38:52.561 INFO:teuthology.orchestra.run.smithi089.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client all 12+214ubuntu0.1 [3,940 B] 2023-06-09T04:38:52.561 INFO:teuthology.orchestra.run.smithi089.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-contrib all 12+214ubuntu0.1 [3,932 B] 2023-06-09T04:38:52.561 INFO:teuthology.orchestra.run.smithi089.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2023-06-09T04:38:52.562 INFO:teuthology.orchestra.run.smithi089.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2023-06-09T04:38:52.785 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-06-09T04:38:52.805 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../05-libbluetooth3_5.53-0ubuntu3.6_amd64.deb ... 2023-06-09T04:38:52.842 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-06-09T04:38:53.105 INFO:teuthology.orchestra.run.smithi089.stdout:Preconfiguring packages ... 2023-06-09T04:38:53.349 INFO:teuthology.orchestra.run.smithi089.stdout:Fetched 24.0 MB in 3s (7,480 kB/s) 2023-06-09T04:38:53.589 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-06-09T04:38:53.609 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../06-libelf-dev_0.176-1.1build1_amd64.deb ... 2023-06-09T04:38:53.647 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libelf-dev:amd64 (0.176-1.1build1) ... 2023-06-09T04:38:53.687 INFO:teuthology.orchestra.run.smithi089.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118860 files and directories currently installed.) 2023-06-09T04:38:53.691 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../00-libssl1.1_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-06-09T04:38:53.866 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.19) over (1.1.1f-1ubuntu2.16) ... 2023-06-09T04:38:54.017 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-06-09T04:38:54.037 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../07-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-06-09T04:38:54.074 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-06-09T04:38:54.386 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libmbim-proxy. 2023-06-09T04:38:54.386 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-06-09T04:38:54.405 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../08-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-06-09T04:38:54.406 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2_amd64.deb ... 2023-06-09T04:38:54.444 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-06-09T04:38:54.444 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2023-06-09T04:38:54.798 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package dump. 2023-06-09T04:38:54.805 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-06-09T04:38:54.818 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../02-dump_0.4b46-6_amd64.deb ... 2023-06-09T04:38:54.825 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../09-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-06-09T04:38:54.856 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking dump (0.4b46-6) ... 2023-06-09T04:38:54.863 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-06-09T04:38:55.235 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package indent. 2023-06-09T04:38:55.241 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libndp0:amd64. 2023-06-09T04:38:55.255 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../03-indent_2.2.12-1_amd64.deb ... 2023-06-09T04:38:55.261 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../10-libndp0_1.7-0ubuntu1_amd64.deb ... 2023-06-09T04:38:55.293 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking indent (2.2.12-1) ... 2023-06-09T04:38:55.299 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2023-06-09T04:38:55.637 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-06-09T04:38:55.652 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libnm0:amd64. 2023-06-09T04:38:55.657 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-5_amd64.deb ... 2023-06-09T04:38:55.673 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../11-libnm0_1.22.10-1ubuntu2.3_amd64.deb ... 2023-06-09T04:38:55.695 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2023-06-09T04:38:55.710 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-06-09T04:38:56.066 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-06-09T04:38:56.085 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../05-libbluetooth3_5.53-0ubuntu3.6_amd64.deb ... 2023-06-09T04:38:56.105 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libpq5:amd64. 2023-06-09T04:38:56.124 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-06-09T04:38:56.125 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../12-libpq5_12.15-0ubuntu0.20.04.1_amd64.deb ... 2023-06-09T04:38:56.162 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libpq5:amd64 (12.15-0ubuntu0.20.04.1) ... 2023-06-09T04:38:56.426 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-06-09T04:38:56.445 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../06-libelf-dev_0.176-1.1build1_amd64.deb ... 2023-06-09T04:38:56.484 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libelf-dev:amd64 (0.176-1.1build1) ... 2023-06-09T04:38:56.541 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-06-09T04:38:56.561 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../13-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-06-09T04:38:56.599 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-06-09T04:38:56.921 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-06-09T04:38:56.941 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../07-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-06-09T04:38:56.944 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libqmi-proxy. 2023-06-09T04:38:56.963 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../14-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-06-09T04:38:56.979 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-06-09T04:38:57.001 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-06-09T04:38:57.287 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-06-09T04:38:57.290 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libmbim-proxy. 2023-06-09T04:38:57.309 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../15-libssl-dev_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-06-09T04:38:57.310 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../08-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-06-09T04:38:57.348 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-06-09T04:38:57.353 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-06-09T04:38:57.794 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-06-09T04:38:57.814 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../09-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-06-09T04:38:57.852 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-06-09T04:38:57.907 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-06-09T04:38:57.928 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../16-libteamdctl0_1.30-1_amd64.deb ... 2023-06-09T04:38:57.965 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2023-06-09T04:38:58.255 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libndp0:amd64. 2023-06-09T04:38:58.275 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../10-libndp0_1.7-0ubuntu1_amd64.deb ... 2023-06-09T04:38:58.313 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2023-06-09T04:38:58.394 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package modemmanager. 2023-06-09T04:38:58.414 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../17-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-06-09T04:38:58.472 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-06-09T04:38:58.675 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libnm0:amd64. 2023-06-09T04:38:58.695 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../11-libnm0_1.22.10-1ubuntu2.3_amd64.deb ... 2023-06-09T04:38:58.733 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-06-09T04:38:59.119 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libpq5:amd64. 2023-06-09T04:38:59.134 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../12-libpq5_12.15-0ubuntu0.20.04.1_amd64.deb ... 2023-06-09T04:38:59.177 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libpq5:amd64 (12.15-0ubuntu0.20.04.1) ... 2023-06-09T04:38:59.427 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package wpasupplicant. 2023-06-09T04:38:59.447 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../18-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2023-06-09T04:38:59.484 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-06-09T04:38:59.555 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-06-09T04:38:59.574 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../13-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-06-09T04:38:59.613 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-06-09T04:38:59.974 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libqmi-proxy. 2023-06-09T04:38:59.995 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../14-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-06-09T04:39:00.032 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-06-09T04:39:00.090 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package network-manager. 2023-06-09T04:39:00.109 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../19-network-manager_1.22.10-1ubuntu2.3_amd64.deb ... 2023-06-09T04:39:00.194 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking network-manager (1.22.10-1ubuntu2.3) ... 2023-06-09T04:39:00.293 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-06-09T04:39:00.313 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../15-libssl-dev_1.1.1f-1ubuntu2.19_amd64.deb ... 2023-06-09T04:39:00.351 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-06-09T04:39:00.905 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-06-09T04:39:00.925 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../16-libteamdctl0_1.30-1_amd64.deb ... 2023-06-09T04:39:00.963 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2023-06-09T04:39:01.014 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ppp. 2023-06-09T04:39:01.033 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../20-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2023-06-09T04:39:01.366 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package modemmanager. 2023-06-09T04:39:01.386 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../17-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-06-09T04:39:01.445 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-06-09T04:39:01.497 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-06-09T04:39:01.860 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package pptp-linux. 2023-06-09T04:39:01.874 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../21-pptp-linux_1.10.0-1build1_amd64.deb ... 2023-06-09T04:39:01.918 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2023-06-09T04:39:02.105 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package wpasupplicant. 2023-06-09T04:39:02.125 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../18-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2023-06-09T04:39:02.163 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-06-09T04:39:02.305 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package network-manager-pptp. 2023-06-09T04:39:02.318 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../22-network-manager-pptp_1.2.8-2_amd64.deb ... 2023-06-09T04:39:02.391 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2023-06-09T04:39:02.716 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package postgresql-client-common. 2023-06-09T04:39:02.730 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../23-postgresql-client-common_214ubuntu0.1_all.deb ... 2023-06-09T04:39:02.775 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking postgresql-client-common (214ubuntu0.1) ... 2023-06-09T04:39:02.936 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package network-manager. 2023-06-09T04:39:02.957 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../19-network-manager_1.22.10-1ubuntu2.3_amd64.deb ... 2023-06-09T04:39:03.041 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking network-manager (1.22.10-1ubuntu2.3) ... 2023-06-09T04:39:03.095 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package postgresql-client-12. 2023-06-09T04:39:03.109 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../24-postgresql-client-12_12.15-0ubuntu0.20.04.1_amd64.deb ... 2023-06-09T04:39:03.153 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking postgresql-client-12 (12.15-0ubuntu0.20.04.1) ... 2023-06-09T04:39:03.759 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package postgresql-common. 2023-06-09T04:39:03.778 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../25-postgresql-common_214ubuntu0.1_all.deb ... 2023-06-09T04:39:03.827 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package ppp. 2023-06-09T04:39:03.847 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../20-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2023-06-09T04:39:03.850 INFO:teuthology.orchestra.run.smithi062.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-06-09T04:39:03.896 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking postgresql-common (214ubuntu0.1) ... 2023-06-09T04:39:04.340 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-06-09T04:39:04.366 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package postgresql-12. 2023-06-09T04:39:04.385 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../26-postgresql-12_12.15-0ubuntu0.20.04.1_amd64.deb ... 2023-06-09T04:39:04.430 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking postgresql-12 (12.15-0ubuntu0.20.04.1) ... 2023-06-09T04:39:04.715 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package pptp-linux. 2023-06-09T04:39:04.736 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../21-pptp-linux_1.10.0-1build1_amd64.deb ... 2023-06-09T04:39:04.773 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2023-06-09T04:39:05.160 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package network-manager-pptp. 2023-06-09T04:39:05.181 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../22-network-manager-pptp_1.2.8-2_amd64.deb ... 2023-06-09T04:39:05.253 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2023-06-09T04:39:05.588 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package postgresql-client-common. 2023-06-09T04:39:05.609 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../23-postgresql-client-common_214ubuntu0.1_all.deb ... 2023-06-09T04:39:05.646 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking postgresql-client-common (214ubuntu0.1) ... 2023-06-09T04:39:06.008 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package postgresql-client-12. 2023-06-09T04:39:06.019 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package postgresql. 2023-06-09T04:39:06.022 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../24-postgresql-client-12_12.15-0ubuntu0.20.04.1_amd64.deb ... 2023-06-09T04:39:06.039 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../27-postgresql_12+214ubuntu0.1_all.deb ... 2023-06-09T04:39:06.066 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking postgresql-client-12 (12.15-0ubuntu0.20.04.1) ... 2023-06-09T04:39:06.076 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking postgresql (12+214ubuntu0.1) ... 2023-06-09T04:39:06.346 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package postgresql-client. 2023-06-09T04:39:06.365 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../28-postgresql-client_12+214ubuntu0.1_all.deb ... 2023-06-09T04:39:06.403 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking postgresql-client (12+214ubuntu0.1) ... 2023-06-09T04:39:06.673 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package postgresql-contrib. 2023-06-09T04:39:06.680 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package postgresql-common. 2023-06-09T04:39:06.693 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../29-postgresql-contrib_12+214ubuntu0.1_all.deb ... 2023-06-09T04:39:06.700 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../25-postgresql-common_214ubuntu0.1_all.deb ... 2023-06-09T04:39:06.730 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking postgresql-contrib (12+214ubuntu0.1) ... 2023-06-09T04:39:06.778 INFO:teuthology.orchestra.run.smithi089.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-06-09T04:39:06.808 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking postgresql-common (214ubuntu0.1) ... 2023-06-09T04:39:07.017 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-06-09T04:39:07.037 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../30-usb-modeswitch-data_20191128-3_all.deb ... 2023-06-09T04:39:07.074 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2023-06-09T04:39:07.295 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package postgresql-12. 2023-06-09T04:39:07.315 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../26-postgresql-12_12.15-0ubuntu0.20.04.1_amd64.deb ... 2023-06-09T04:39:07.360 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking postgresql-12 (12.15-0ubuntu0.20.04.1) ... 2023-06-09T04:39:07.486 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package usb-modeswitch. 2023-06-09T04:39:07.507 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../31-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2023-06-09T04:39:07.569 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-06-09T04:39:07.925 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up postgresql-client-common (214ubuntu0.1) ... 2023-06-09T04:39:08.151 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.19) ... 2023-06-09T04:39:08.511 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libpq5:amd64 (12.15-0ubuntu0.20.04.1) ... 2023-06-09T04:39:08.636 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2023-06-09T04:39:08.762 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2023-06-09T04:39:08.888 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-06-09T04:39:09.048 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package postgresql. 2023-06-09T04:39:09.069 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../27-postgresql_12+214ubuntu0.1_all.deb ... 2023-06-09T04:39:09.106 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking postgresql (12+214ubuntu0.1) ... 2023-06-09T04:39:09.338 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-06-09T04:39:09.338 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-06-09T04:39:09.384 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package postgresql-client. 2023-06-09T04:39:09.405 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../28-postgresql-client_12+214ubuntu0.1_all.deb ... 2023-06-09T04:39:09.450 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking postgresql-client (12+214ubuntu0.1) ... 2023-06-09T04:39:09.727 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package postgresql-contrib. 2023-06-09T04:39:09.748 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../29-postgresql-contrib_12+214ubuntu0.1_all.deb ... 2023-06-09T04:39:09.785 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking postgresql-contrib (12+214ubuntu0.1) ... 2023-06-09T04:39:10.046 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-06-09T04:39:10.060 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../30-usb-modeswitch-data_20191128-3_all.deb ... 2023-06-09T04:39:10.104 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2023-06-09T04:39:10.225 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up postgresql-client-12 (12.15-0ubuntu0.20.04.1) ... 2023-06-09T04:39:10.515 INFO:teuthology.orchestra.run.smithi089.stdout:Selecting previously unselected package usb-modeswitch. 2023-06-09T04:39:10.529 INFO:teuthology.orchestra.run.smithi089.stdout:Preparing to unpack .../31-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2023-06-09T04:39:10.598 INFO:teuthology.orchestra.run.smithi089.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-06-09T04:39:10.927 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up postgresql-client-common (214ubuntu0.1) ... 2023-06-09T04:39:11.138 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.19) ... 2023-06-09T04:39:11.498 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libpq5:amd64 (12.15-0ubuntu0.20.04.1) ... 2023-06-09T04:39:11.624 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2023-06-09T04:39:11.750 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2023-06-09T04:39:11.876 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-06-09T04:39:12.306 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-06-09T04:39:12.306 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-06-09T04:39:12.423 INFO:teuthology.orchestra.run.smithi062.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-06-09T04:39:12.538 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2023-06-09T04:39:12.673 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up postgresql-common (214ubuntu0.1) ... 2023-06-09T04:39:13.254 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up postgresql-client-12 (12.15-0ubuntu0.20.04.1) ... 2023-06-09T04:39:13.917 INFO:teuthology.orchestra.run.smithi062.stdout:Adding user postgres to group ssl-cert 2023-06-09T04:39:14.295 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:39:14.295 INFO:teuthology.orchestra.run.smithi062.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-06-09T04:39:14.785 INFO:teuthology.orchestra.run.smithi062.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-06-09T04:39:14.785 INFO:teuthology.orchestra.run.smithi062.stdout:Removing obsolete dictionary files: 2023-06-09T04:39:15.331 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-06-09T04:39:15.359 INFO:teuthology.orchestra.run.smithi089.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-06-09T04:39:15.468 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2023-06-09T04:39:15.594 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up postgresql-common (214ubuntu0.1) ... 2023-06-09T04:39:16.741 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-06-09T04:39:16.815 INFO:teuthology.orchestra.run.smithi089.stdout:Adding user postgres to group ssl-cert 2023-06-09T04:39:16.867 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2023-06-09T04:39:16.993 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libelf-dev:amd64 (0.176-1.1build1) ... 2023-06-09T04:39:17.119 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-06-09T04:39:17.167 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-06-09T04:39:17.168 INFO:teuthology.orchestra.run.smithi089.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-06-09T04:39:17.245 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-06-09T04:39:17.658 INFO:teuthology.orchestra.run.smithi089.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-06-09T04:39:17.658 INFO:teuthology.orchestra.run.smithi089.stdout:Removing obsolete dictionary files: 2023-06-09T04:39:18.216 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-06-09T04:39:18.477 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2023-06-09T04:39:18.909 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up dump (0.4b46-6) ... 2023-06-09T04:39:19.019 INFO:teuthology.orchestra.run.smithi062.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-06-09T04:39:19.086 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-06-09T04:39:19.212 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-06-09T04:39:19.612 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.19) ... 2023-06-09T04:39:19.738 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up indent (2.2.12-1) ... 2023-06-09T04:39:19.755 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2023-06-09T04:39:19.864 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-06-09T04:39:19.880 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libelf-dev:amd64 (0.176-1.1build1) ... 2023-06-09T04:39:20.007 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-06-09T04:39:20.049 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2023-06-09T04:39:20.133 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-06-09T04:39:20.175 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up postgresql-12 (12.15-0ubuntu0.20.04.1) ... 2023-06-09T04:39:20.709 INFO:teuthology.orchestra.run.smithi062.stdout:Creating new PostgreSQL cluster 12/main ... 2023-06-09T04:39:20.741 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/lib/postgresql/12/bin/initdb -D /var/lib/postgresql/12/main --auth-local peer --auth-host md5 2023-06-09T04:39:20.820 INFO:teuthology.orchestra.run.smithi062.stdout:The files belonging to this database system will be owned by user "postgres". 2023-06-09T04:39:20.821 INFO:teuthology.orchestra.run.smithi062.stdout:This user must also own the server process. 2023-06-09T04:39:20.821 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:39:20.821 INFO:teuthology.orchestra.run.smithi062.stdout:The database cluster will be initialized with locale "en_US". 2023-06-09T04:39:20.821 INFO:teuthology.orchestra.run.smithi062.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-06-09T04:39:20.821 INFO:teuthology.orchestra.run.smithi062.stdout:The default text search configuration will be set to "english". 2023-06-09T04:39:20.821 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:39:20.822 INFO:teuthology.orchestra.run.smithi062.stdout:Data page checksums are disabled. 2023-06-09T04:39:20.822 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:39:20.822 INFO:teuthology.orchestra.run.smithi062.stdout:fixing permissions on existing directory /var/lib/postgresql/12/main ... ok 2023-06-09T04:39:20.824 INFO:teuthology.orchestra.run.smithi062.stdout:creating subdirectories ... ok 2023-06-09T04:39:20.824 INFO:teuthology.orchestra.run.smithi062.stdout:selecting dynamic shared memory implementation ... posix 2023-06-09T04:39:20.861 INFO:teuthology.orchestra.run.smithi062.stdout:selecting default max_connections ... 100 2023-06-09T04:39:20.913 INFO:teuthology.orchestra.run.smithi062.stdout:selecting default shared_buffers ... 128MB 2023-06-09T04:39:20.935 INFO:teuthology.orchestra.run.smithi062.stdout:selecting default time zone ... Etc/UTC 2023-06-09T04:39:20.936 INFO:teuthology.orchestra.run.smithi062.stdout:creating configuration files ... ok 2023-06-09T04:39:21.136 INFO:teuthology.orchestra.run.smithi062.stdout:running bootstrap script ... ok 2023-06-09T04:39:21.367 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2023-06-09T04:39:21.771 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up dump (0.4b46-6) ... 2023-06-09T04:39:21.787 INFO:teuthology.orchestra.run.smithi062.stdout:performing post-bootstrap initialization ... ok 2023-06-09T04:39:21.881 INFO:teuthology.orchestra.run.smithi089.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-06-09T04:39:21.948 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-06-09T04:39:22.074 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.6) ... 2023-06-09T04:39:22.200 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up indent (2.2.12-1) ... 2023-06-09T04:39:22.305 INFO:teuthology.orchestra.run.smithi062.stdout:syncing data to disk ... ok 2023-06-09T04:39:22.305 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:39:22.305 INFO:teuthology.orchestra.run.smithi062.stdout:Success. You can now start the database server using: 2023-06-09T04:39:22.305 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:39:22.306 INFO:teuthology.orchestra.run.smithi062.stdout: pg_ctlcluster 12 main start 2023-06-09T04:39:22.306 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:39:22.326 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-06-09T04:39:22.511 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2023-06-09T04:39:22.637 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up postgresql-12 (12.15-0ubuntu0.20.04.1) ... 2023-06-09T04:39:22.866 INFO:teuthology.orchestra.run.smithi062.stdout:Ver Cluster Port Status Owner Data directory Log file 2023-06-09T04:39:22.867 INFO:teuthology.orchestra.run.smithi062.stdout:12 main 5432 down postgres /var/lib/postgresql/12/main /var/log/postgresql/postgresql-12-main.log 2023-06-09T04:39:23.084 INFO:teuthology.orchestra.run.smithi062.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-06-09T04:39:23.136 INFO:teuthology.orchestra.run.smithi089.stdout:Creating new PostgreSQL cluster 12/main ... 2023-06-09T04:39:23.172 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/lib/postgresql/12/bin/initdb -D /var/lib/postgresql/12/main --auth-local peer --auth-host md5 2023-06-09T04:39:23.242 INFO:teuthology.orchestra.run.smithi089.stdout:The files belonging to this database system will be owned by user "postgres". 2023-06-09T04:39:23.242 INFO:teuthology.orchestra.run.smithi089.stdout:This user must also own the server process. 2023-06-09T04:39:23.242 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-06-09T04:39:23.242 INFO:teuthology.orchestra.run.smithi089.stdout:The database cluster will be initialized with locale "en_US". 2023-06-09T04:39:23.243 INFO:teuthology.orchestra.run.smithi089.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-06-09T04:39:23.243 INFO:teuthology.orchestra.run.smithi089.stdout:The default text search configuration will be set to "english". 2023-06-09T04:39:23.243 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-06-09T04:39:23.243 INFO:teuthology.orchestra.run.smithi089.stdout:Data page checksums are disabled. 2023-06-09T04:39:23.243 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-06-09T04:39:23.243 INFO:teuthology.orchestra.run.smithi089.stdout:fixing permissions on existing directory /var/lib/postgresql/12/main ... ok 2023-06-09T04:39:23.244 INFO:teuthology.orchestra.run.smithi089.stdout:creating subdirectories ... ok 2023-06-09T04:39:23.244 INFO:teuthology.orchestra.run.smithi089.stdout:selecting dynamic shared memory implementation ... posix 2023-06-09T04:39:23.277 INFO:teuthology.orchestra.run.smithi089.stdout:selecting default max_connections ... 100 2023-06-09T04:39:23.322 INFO:teuthology.orchestra.run.smithi089.stdout:selecting default shared_buffers ... 128MB 2023-06-09T04:39:23.343 INFO:teuthology.orchestra.run.smithi089.stdout:selecting default time zone ... Etc/UTC 2023-06-09T04:39:23.344 INFO:teuthology.orchestra.run.smithi089.stdout:creating configuration files ... ok 2023-06-09T04:39:23.539 INFO:teuthology.orchestra.run.smithi089.stdout:running bootstrap script ... ok 2023-06-09T04:39:24.171 INFO:teuthology.orchestra.run.smithi089.stdout:performing post-bootstrap initialization ... ok 2023-06-09T04:39:24.692 INFO:teuthology.orchestra.run.smithi089.stdout:syncing data to disk ... ok 2023-06-09T04:39:24.692 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-06-09T04:39:24.692 INFO:teuthology.orchestra.run.smithi089.stdout:Success. You can now start the database server using: 2023-06-09T04:39:24.692 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-06-09T04:39:24.693 INFO:teuthology.orchestra.run.smithi089.stdout: pg_ctlcluster 12 main start 2023-06-09T04:39:24.693 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-06-09T04:39:25.228 INFO:teuthology.orchestra.run.smithi089.stdout:Ver Cluster Port Status Owner Data directory Log file 2023-06-09T04:39:25.228 INFO:teuthology.orchestra.run.smithi089.stdout:12 main 5432 down postgres /var/lib/postgresql/12/main /var/log/postgresql/postgresql-12-main.log 2023-06-09T04:39:25.434 INFO:teuthology.orchestra.run.smithi089.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-06-09T04:39:26.700 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-06-09T04:39:26.826 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2023-06-09T04:39:26.994 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up postgresql-client (12+214ubuntu0.1) ... 2023-06-09T04:39:27.120 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up network-manager (1.22.10-1ubuntu2.3) ... 2023-06-09T04:39:28.292 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:39:28.292 INFO:teuthology.orchestra.run.smithi062.stdout:The following network interfaces were found in /etc/network/interfaces 2023-06-09T04:39:28.292 INFO:teuthology.orchestra.run.smithi062.stdout:which means they are currently configured by ifupdown: 2023-06-09T04:39:28.293 INFO:teuthology.orchestra.run.smithi062.stdout:- enp3s0f1 2023-06-09T04:39:28.293 INFO:teuthology.orchestra.run.smithi062.stdout:If you want to manage those interfaces with NetworkManager instead 2023-06-09T04:39:28.293 INFO:teuthology.orchestra.run.smithi062.stdout:remove their configuration from /etc/network/interfaces. 2023-06-09T04:39:28.293 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:39:28.539 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-06-09T04:39:29.054 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-06-09T04:39:29.086 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-06-09T04:39:29.180 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2023-06-09T04:39:29.348 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up postgresql-client (12+214ubuntu0.1) ... 2023-06-09T04:39:29.474 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up network-manager (1.22.10-1ubuntu2.3) ... 2023-06-09T04:39:30.039 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-06-09T04:39:30.629 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-06-09T04:39:30.630 INFO:teuthology.orchestra.run.smithi089.stdout:The following network interfaces were found in /etc/network/interfaces 2023-06-09T04:39:30.630 INFO:teuthology.orchestra.run.smithi089.stdout:which means they are currently configured by ifupdown: 2023-06-09T04:39:30.630 INFO:teuthology.orchestra.run.smithi089.stdout:- enp3s0f1 2023-06-09T04:39:30.630 INFO:teuthology.orchestra.run.smithi089.stdout:If you want to manage those interfaces with NetworkManager instead 2023-06-09T04:39:30.630 INFO:teuthology.orchestra.run.smithi089.stdout:remove their configuration from /etc/network/interfaces. 2023-06-09T04:39:30.630 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-06-09T04:39:30.857 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-06-09T04:39:30.948 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-06-09T04:39:31.083 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2023-06-09T04:39:31.242 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up postgresql-contrib (12+214ubuntu0.1) ... 2023-06-09T04:39:31.368 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up postgresql (12+214ubuntu0.1) ... 2023-06-09T04:39:31.395 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-06-09T04:39:31.503 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-06-09T04:39:31.629 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-06-09T04:39:31.754 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-06-09T04:39:32.083 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-06-09T04:39:32.084 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-06-09T04:39:32.335 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-06-09T04:39:33.084 INFO:teuthology.orchestra.run.smithi062.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-06-09T04:39:33.219 INFO:teuthology.orchestra.run.smithi062.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-06-09T04:39:33.268 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-06-09T04:39:33.378 INFO:teuthology.orchestra.run.smithi062.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-06-09T04:39:33.403 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2023-06-09T04:39:33.696 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up postgresql-contrib (12+214ubuntu0.1) ... 2023-06-09T04:39:33.822 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up postgresql (12+214ubuntu0.1) ... 2023-06-09T04:39:33.864 INFO:teuthology.orchestra.run.smithi062.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-06-09T04:39:33.948 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-06-09T04:39:34.074 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-06-09T04:39:34.200 INFO:teuthology.orchestra.run.smithi089.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-06-09T04:39:34.513 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-06-09T04:39:34.513 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-06-09T04:39:35.536 INFO:teuthology.orchestra.run.smithi089.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-06-09T04:39:35.670 INFO:teuthology.orchestra.run.smithi089.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-06-09T04:39:35.830 INFO:teuthology.orchestra.run.smithi089.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-06-09T04:39:36.306 INFO:teuthology.orchestra.run.smithi089.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-06-09T04:39:44.917 INFO:teuthology.orchestra.run.smithi062.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-06-09T04:39:45.024 INFO:teuthology.orchestra.run.smithi062.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-06-09T04:39:46.185 INFO:teuthology.orchestra.run.smithi062.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-06-09T04:39:46.190 DEBUG:teuthology.parallel:result is None 2023-06-09T04:39:47.093 INFO:teuthology.orchestra.run.smithi089.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-06-09T04:39:47.202 INFO:teuthology.orchestra.run.smithi089.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-06-09T04:39:48.421 INFO:teuthology.orchestra.run.smithi089.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-06-09T04:39:48.427 DEBUG:teuthology.parallel:result is None 2023-06-09T04:39:48.427 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=a02638f808b8fe11bccdd01222c0e6e2eb71120b 2023-06-09T04:39:48.666 DEBUG:teuthology.orchestra.run.smithi062:> dpkg-query -W -f '${Version}' ceph 2023-06-09T04:39:48.704 INFO:teuthology.orchestra.run.smithi062.stdout:18.0.0-4313-ga02638f8-1focal 2023-06-09T04:39:48.705 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4313-ga02638f8-1focal 2023-06-09T04:39:48.705 INFO:teuthology.task.install:The correct ceph version 18.0.0-4313-ga02638f8-1focal is installed. 2023-06-09T04:39:48.706 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=a02638f808b8fe11bccdd01222c0e6e2eb71120b 2023-06-09T04:39:48.840 DEBUG:teuthology.orchestra.run.smithi089:> dpkg-query -W -f '${Version}' ceph 2023-06-09T04:39:48.876 INFO:teuthology.orchestra.run.smithi089.stdout:18.0.0-4313-ga02638f8-1focal 2023-06-09T04:39:48.876 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4313-ga02638f8-1focal 2023-06-09T04:39:48.876 INFO:teuthology.task.install:The correct ceph version 18.0.0-4313-ga02638f8-1focal is installed. 2023-06-09T04:39:48.877 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-06-09T04:39:48.877 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-06-09T04:39:48.877 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-06-09T04:39:48.912 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-06-09T04:39:48.912 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-06-09T04:39:48.955 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-06-09T04:39:48.956 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-06-09T04:39:48.956 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/usr/bin/daemon-helper 2023-06-09T04:39:48.989 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-06-09T04:39:49.062 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-06-09T04:39:49.062 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/daemon-helper 2023-06-09T04:39:49.095 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-06-09T04:39:49.170 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-06-09T04:39:49.170 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-06-09T04:39:49.171 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/usr/bin/adjust-ulimits 2023-06-09T04:39:49.204 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-06-09T04:39:49.278 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-06-09T04:39:49.278 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/adjust-ulimits 2023-06-09T04:39:49.311 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-06-09T04:39:49.390 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-06-09T04:39:49.391 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-06-09T04:39:49.391 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/usr/bin/stdin-killer 2023-06-09T04:39:49.424 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-06-09T04:39:49.498 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-06-09T04:39:49.498 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/stdin-killer 2023-06-09T04:39:49.531 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-06-09T04:39:49.605 INFO:teuthology.run_tasks:Running task ceph... 2023-06-09T04:39:49.672 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-06-09T04:39:49.673 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 777 /var/log/ceph 2023-06-09T04:39:49.680 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 777 /var/log/ceph 2023-06-09T04:39:49.713 INFO:tasks.ceph:Disabling ceph logrotate... 2023-06-09T04:39:49.713 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f -- /etc/logrotate.d/ceph 2023-06-09T04:39:49.757 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f -- /etc/logrotate.d/ceph 2023-06-09T04:39:49.789 INFO:tasks.ceph:Creating extra log directories... 2023-06-09T04:39:49.789 DEBUG:teuthology.orchestra.run.smithi062:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-06-09T04:39:49.836 DEBUG:teuthology.orchestra.run.smithi089:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-06-09T04:39:49.878 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-06-09T04:39:49.879 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-06-09T04:39:49.879 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-06-09T04:39:49.879 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-06-09T04:39:49.879 DEBUG:teuthology.orchestra.run.smithi062:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-06-09T04:39:49.927 DEBUG:teuthology.orchestra.run.smithi062:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-06-09T04:39:50.057 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-06-09T04:39:50.057 DEBUG:teuthology.orchestra.run.smithi089:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-06-09T04:39:50.076 DEBUG:teuthology.orchestra.run.smithi089:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-06-09T04:39:50.208 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-06-09T04:39:50.208 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-06-09T04:39:50.209 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/xiubli-2023-06-09_04:16:27-fs:functional-wip-lxb-fscrypt-20230607-0901-distro-default-smithi/7299738', 'branch': 'wip-lxb-fscrypt-20230607-0901', 'description': 'fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev}', 'email': None, 'first_in_suite': False, 'job_id': '7299738', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'xiubli-2023-06-09_04:16:27-fs:functional-wip-lxb-fscrypt-20230607-0901-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'wip-lxb-fscrypt-20230607-0901'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'a02638f808b8fe11bccdd01222c0e6e2eb71120b'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'a02638f808b8fe11bccdd01222c0e6e2eb71120b'}}, 'kclient': {'syntax': 'v1'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-lxb-fscrypt-20230607-0901', 'sha1': 'a02638f808b8fe11bccdd01222c0e6e2eb71120b'}}, 'owner': 'scheduled_xiubli@teuthology', 'priority': 110, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'sha1': 'a02638f808b8fe11bccdd01222c0e6e2eb71120b', 'sleep_before_teardown': 0, 'suite': 'fs:functional', 'suite_branch': 'wip-lxb-fscrypt-20230607-0901', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_a02638f808b8fe11bccdd01222c0e6e2eb71120b/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'a02638f808b8fe11bccdd01222c0e6e2eb71120b', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi062.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0=', 'smithi089.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a02638f808b8fe11bccdd01222c0e6e2eb71120b'}}, {'ceph': None}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '2ef0dcdee569e9851c9d2ffb6acfd4b80d031e61', 'timestamp': '2023-06-09_04:16:27', 'tube': 'smithi', 'user': 'xiubli', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.23459'} 2023-06-09T04:39:50.209 DEBUG:teuthology.orchestra.run.smithi062:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-06-09T04:39:50.216 DEBUG:teuthology.orchestra.run.smithi089:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-06-09T04:39:50.236 DEBUG:teuthology.orchestra.run.smithi062:> sudo install -d -m0777 -- /var/run/ceph 2023-06-09T04:39:50.276 DEBUG:teuthology.orchestra.run.smithi089:> sudo install -d -m0777 -- /var/run/ceph 2023-06-09T04:39:50.317 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-06-09T04:39:50.318 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/scratch_devs of=/dev/stdout 2023-06-09T04:39:50.362 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-06-09T04:39:50.362 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_1 2023-06-09T04:39:50.427 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-06-09T04:39:50.427 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-09T04:39:50.427 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 5h/5d Inode: 500 Links: 1 2023-06-09T04:39:50.428 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-09T04:39:50.428 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2023-06-09 04:34:31.759326877 +0000 2023-06-09T04:39:50.428 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2023-06-09 04:34:31.299337485 +0000 2023-06-09T04:39:50.428 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2023-06-09 04:34:31.299337485 +0000 2023-06-09T04:39:50.428 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: - 2023-06-09T04:39:50.429 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-06-09T04:39:50.505 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2023-06-09T04:39:50.505 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2023-06-09T04:39:50.505 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000706428 s, 725 kB/s 2023-06-09T04:39:50.507 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-06-09T04:39:50.577 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_2 2023-06-09T04:39:50.635 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-06-09T04:39:50.635 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-09T04:39:50.636 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 5h/5d Inode: 504 Links: 1 2023-06-09T04:39:50.636 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-09T04:39:50.636 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2023-06-09 04:34:32.503309718 +0000 2023-06-09T04:39:50.636 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2023-06-09 04:34:32.039320419 +0000 2023-06-09T04:39:50.636 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2023-06-09 04:34:32.039320419 +0000 2023-06-09T04:39:50.636 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: - 2023-06-09T04:39:50.637 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-06-09T04:39:50.709 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2023-06-09T04:39:50.710 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2023-06-09T04:39:50.710 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.00070858 s, 723 kB/s 2023-06-09T04:39:50.712 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-06-09T04:39:50.779 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_3 2023-06-09T04:39:50.840 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-06-09T04:39:50.841 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-09T04:39:50.841 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 5h/5d Inode: 511 Links: 1 2023-06-09T04:39:50.841 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-09T04:39:50.841 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2023-06-09 04:34:33.243292652 +0000 2023-06-09T04:39:50.841 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2023-06-09 04:34:32.771303538 +0000 2023-06-09T04:39:50.841 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2023-06-09 04:34:32.771303538 +0000 2023-06-09T04:39:50.842 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: - 2023-06-09T04:39:50.842 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-06-09T04:39:50.917 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2023-06-09T04:39:50.917 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2023-06-09T04:39:50.917 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000685555 s, 747 kB/s 2023-06-09T04:39:50.919 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-06-09T04:39:50.985 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_4 2023-06-09T04:39:51.043 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-06-09T04:39:51.043 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-09T04:39:51.043 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 5h/5d Inode: 515 Links: 1 2023-06-09T04:39:51.044 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-09T04:39:51.044 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2023-06-09 04:34:33.999275219 +0000 2023-06-09T04:39:51.044 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2023-06-09 04:34:33.527286103 +0000 2023-06-09T04:39:51.044 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2023-06-09 04:34:33.527286103 +0000 2023-06-09T04:39:51.044 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: - 2023-06-09T04:39:51.045 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-06-09T04:39:51.117 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2023-06-09T04:39:51.117 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2023-06-09T04:39:51.117 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000684688 s, 748 kB/s 2023-06-09T04:39:51.119 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-06-09T04:39:51.191 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-09T04:39:51.192 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-06-09T04:39:51.192 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/scratch_devs of=/dev/stdout 2023-06-09T04:39:51.211 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-06-09T04:39:51.211 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_1 2023-06-09T04:39:51.272 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-06-09T04:39:51.273 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-09T04:39:51.273 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 5h/5d Inode: 495 Links: 1 2023-06-09T04:39:51.273 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-09T04:39:51.273 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2023-06-09 04:34:30.994113215 +0000 2023-06-09T04:39:51.273 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2023-06-09 04:34:30.542123632 +0000 2023-06-09T04:39:51.273 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2023-06-09 04:34:30.542123632 +0000 2023-06-09T04:39:51.274 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: - 2023-06-09T04:39:51.274 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-06-09T04:39:51.348 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2023-06-09T04:39:51.349 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2023-06-09T04:39:51.349 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000705838 s, 725 kB/s 2023-06-09T04:39:51.350 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-06-09T04:39:51.417 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_2 2023-06-09T04:39:51.480 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-06-09T04:39:51.481 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-09T04:39:51.481 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 5h/5d Inode: 501 Links: 1 2023-06-09T04:39:51.481 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-09T04:39:51.481 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2023-06-09 04:34:31.762095512 +0000 2023-06-09T04:39:51.481 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2023-06-09 04:34:31.270106853 +0000 2023-06-09T04:39:51.481 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2023-06-09 04:34:31.270106853 +0000 2023-06-09T04:39:51.481 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: - 2023-06-09T04:39:51.482 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-06-09T04:39:51.552 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2023-06-09T04:39:51.552 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2023-06-09T04:39:51.552 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.00066636 s, 768 kB/s 2023-06-09T04:39:51.554 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-06-09T04:39:51.617 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_3 2023-06-09T04:39:51.676 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-06-09T04:39:51.677 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-09T04:39:51.677 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 5h/5d Inode: 509 Links: 1 2023-06-09T04:39:51.677 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-09T04:39:51.677 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2023-06-09 04:34:32.522077995 +0000 2023-06-09T04:39:51.677 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2023-06-09 04:34:32.058088690 +0000 2023-06-09T04:39:51.677 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2023-06-09 04:34:32.058088690 +0000 2023-06-09T04:39:51.677 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: - 2023-06-09T04:39:51.678 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-06-09T04:39:51.752 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2023-06-09T04:39:51.752 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2023-06-09T04:39:51.753 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000540121 s, 948 kB/s 2023-06-09T04:39:51.754 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-06-09T04:39:51.826 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_4 2023-06-09T04:39:51.885 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-06-09T04:39:51.885 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-09T04:39:51.885 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 5h/5d Inode: 516 Links: 1 2023-06-09T04:39:51.885 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-09T04:39:51.885 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2023-06-09 04:34:32.802071540 +0000 2023-06-09T04:39:51.885 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2023-06-09 04:34:32.798071633 +0000 2023-06-09T04:39:51.885 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2023-06-09 04:34:32.798071633 +0000 2023-06-09T04:39:51.886 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: - 2023-06-09T04:39:51.886 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-06-09T04:39:51.960 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2023-06-09T04:39:51.961 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2023-06-09T04:39:51.961 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000656015 s, 780 kB/s 2023-06-09T04:39:51.962 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-06-09T04:39:52.034 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-09T04:39:52.035 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi062.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi089.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-06-09T04:39:52.035 INFO:tasks.ceph:Generating config... 2023-06-09T04:39:52.036 INFO:tasks.ceph:[client] client mount timeout = 600 2023-06-09T04:39:52.036 INFO:tasks.ceph:[client] debug client = 20 2023-06-09T04:39:52.037 INFO:tasks.ceph:[client] debug ms = 1 2023-06-09T04:39:52.037 INFO:tasks.ceph:[client] pid file = 2023-06-09T04:39:52.037 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-06-09T04:39:52.037 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-06-09T04:39:52.037 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-06-09T04:39:52.037 INFO:tasks.ceph:[mds] debug mds = 20 2023-06-09T04:39:52.038 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-06-09T04:39:52.038 INFO:tasks.ceph:[mds] debug ms = 1 2023-06-09T04:39:52.038 INFO:tasks.ceph:[mds] mds debug frag = True 2023-06-09T04:39:52.038 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-06-09T04:39:52.038 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-06-09T04:39:52.039 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-06-09T04:39:52.039 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-06-09T04:39:52.039 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-06-09T04:39:52.039 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-06-09T04:39:52.039 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-06-09T04:39:52.040 INFO:tasks.ceph:[mgr] debug ms = 1 2023-06-09T04:39:52.040 INFO:tasks.ceph:[mon] debug mon = 20 2023-06-09T04:39:52.040 INFO:tasks.ceph:[mon] debug ms = 1 2023-06-09T04:39:52.040 INFO:tasks.ceph:[mon] debug paxos = 20 2023-06-09T04:39:52.040 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-06-09T04:39:52.041 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-06-09T04:39:52.041 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-06-09T04:39:52.041 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-06-09T04:39:52.041 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-06-09T04:39:52.041 INFO:tasks.ceph:[osd] debug ms = 1 2023-06-09T04:39:52.041 INFO:tasks.ceph:[osd] debug osd = 20 2023-06-09T04:39:52.042 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-06-09T04:39:52.042 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-06-09T04:39:52.042 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-06-09T04:39:52.042 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-06-09T04:39:52.042 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-06-09T04:39:52.043 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-06-09T04:39:52.043 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-06-09T04:39:52.043 INFO:tasks.ceph:Setting up mon.a... 2023-06-09T04:39:52.043 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-06-09T04:39:52.118 INFO:teuthology.orchestra.run.smithi062.stdout:creating /etc/ceph/ceph.keyring 2023-06-09T04:39:52.140 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-06-09T04:39:52.215 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-06-09T04:39:52.246 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.62'), ('mon.b', '172.21.15.89'), ('mon.c', '[v2:172.21.15.89:3301,v1:172.21.15.89:6790]')] 2023-06-09T04:39:52.247 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.62,172.21.15.89,[v2:172.21.15.89:3301,v1:172.21.15.89:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-06-09T04:39:52.248 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-06-09T04:39:52.248 DEBUG:teuthology.orchestra.run.smithi062:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-06-09T04:39:52.311 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.62 --add b 172.21.15.89 --addv c '[v2:172.21.15.89:3301,v1:172.21.15.89:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-06-09T04:39:52.424 INFO:teuthology.orchestra.run.smithi062.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-06-09T04:39:52.425 INFO:teuthology.orchestra.run.smithi062.stdout:monmaptool: generated fsid f7998a1e-e5a9-4202-abaa-70c0eaae1047 2023-06-09T04:39:52.425 INFO:teuthology.orchestra.run.smithi062.stdout:setting min_mon_release = pacific 2023-06-09T04:39:52.425 INFO:teuthology.orchestra.run.smithi062.stdout:epoch 0 2023-06-09T04:39:52.425 INFO:teuthology.orchestra.run.smithi062.stdout:fsid f7998a1e-e5a9-4202-abaa-70c0eaae1047 2023-06-09T04:39:52.425 INFO:teuthology.orchestra.run.smithi062.stdout:last_changed 2023-06-09T04:39:52.421756+0000 2023-06-09T04:39:52.425 INFO:teuthology.orchestra.run.smithi062.stdout:created 2023-06-09T04:39:52.421756+0000 2023-06-09T04:39:52.426 INFO:teuthology.orchestra.run.smithi062.stdout:min_mon_release 16 (pacific) 2023-06-09T04:39:52.426 INFO:teuthology.orchestra.run.smithi062.stdout:election_strategy: 1 2023-06-09T04:39:52.426 INFO:teuthology.orchestra.run.smithi062.stdout:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2023-06-09T04:39:52.426 INFO:teuthology.orchestra.run.smithi062.stdout:1: [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon.b 2023-06-09T04:39:52.426 INFO:teuthology.orchestra.run.smithi062.stdout:2: [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] mon.c 2023-06-09T04:39:52.426 INFO:teuthology.orchestra.run.smithi062.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-06-09T04:39:52.428 DEBUG:teuthology.orchestra.run.smithi062:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-06-09T04:39:52.446 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID f7998a1e-e5a9-4202-abaa-70c0eaae1047... 2023-06-09T04:39:52.447 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-06-09T04:39:52.500 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-06-09T04:39:52.573 INFO:teuthology.orchestra.run.smithi062.stdout:[global] 2023-06-09T04:39:52.573 INFO:teuthology.orchestra.run.smithi062.stdout: chdir = "" 2023-06-09T04:39:52.574 INFO:teuthology.orchestra.run.smithi062.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-06-09T04:39:52.574 INFO:teuthology.orchestra.run.smithi062.stdout: auth supported = cephx 2023-06-09T04:39:52.574 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:39:52.574 INFO:teuthology.orchestra.run.smithi062.stdout: filestore xattr use omap = true 2023-06-09T04:39:52.574 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:39:52.574 INFO:teuthology.orchestra.run.smithi062.stdout: mon clock drift allowed = 1.000 2023-06-09T04:39:52.574 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:39:52.574 INFO:teuthology.orchestra.run.smithi062.stdout: osd crush chooseleaf type = 0 2023-06-09T04:39:52.575 INFO:teuthology.orchestra.run.smithi062.stdout: auth debug = true 2023-06-09T04:39:52.575 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:39:52.575 INFO:teuthology.orchestra.run.smithi062.stdout: ms die on old message = true 2023-06-09T04:39:52.575 INFO:teuthology.orchestra.run.smithi062.stdout: ms die on bug = true 2023-06-09T04:39:52.575 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:39:52.575 INFO:teuthology.orchestra.run.smithi062.stdout: mon max pg per osd = 10000 # >= luminous 2023-06-09T04:39:52.575 INFO:teuthology.orchestra.run.smithi062.stdout: mon pg warn max object skew = 0 2023-06-09T04:39:52.575 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:39:52.576 INFO:teuthology.orchestra.run.smithi062.stdout: # disable pg_autoscaler by default for new pools 2023-06-09T04:39:52.576 INFO:teuthology.orchestra.run.smithi062.stdout: osd_pool_default_pg_autoscale_mode = off 2023-06-09T04:39:52.576 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:39:52.576 INFO:teuthology.orchestra.run.smithi062.stdout: osd pool default size = 2 2023-06-09T04:39:52.576 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:39:52.576 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd allow primary affinity = true 2023-06-09T04:39:52.576 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd allow pg remap = true 2023-06-09T04:39:52.577 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on legacy crush tunables = false 2023-06-09T04:39:52.577 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on crush straw calc version zero = false 2023-06-09T04:39:52.577 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on no sortbitwise = false 2023-06-09T04:39:52.577 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on osd down out interval zero = false 2023-06-09T04:39:52.577 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on too few osds = false 2023-06-09T04:39:52.577 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-06-09T04:39:52.577 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_pool_no_redundancy = false 2023-06-09T04:39:52.577 INFO:teuthology.orchestra.run.smithi062.stdout: mon_allow_pool_size_one = true 2023-06-09T04:39:52.578 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:39:52.578 INFO:teuthology.orchestra.run.smithi062.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-06-09T04:39:52.578 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:39:52.578 INFO:teuthology.orchestra.run.smithi062.stdout: osd default data pool replay window = 5 2023-06-09T04:39:52.578 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:39:52.578 INFO:teuthology.orchestra.run.smithi062.stdout: mon allow pool delete = true 2023-06-09T04:39:52.578 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:39:52.578 INFO:teuthology.orchestra.run.smithi062.stdout: mon cluster log file level = debug 2023-06-09T04:39:52.579 INFO:teuthology.orchestra.run.smithi062.stdout: debug asserts on shutdown = true 2023-06-09T04:39:52.579 INFO:teuthology.orchestra.run.smithi062.stdout: mon health detail to clog = false 2023-06-09T04:39:52.579 INFO:teuthology.orchestra.run.smithi062.stdout: mon host = "172.21.15.62,172.21.15.89,[v2:172.21.15.89:3301,v1:172.21.15.89:6790]" 2023-06-09T04:39:52.579 INFO:teuthology.orchestra.run.smithi062.stdout: ms die on skipped message = False 2023-06-09T04:39:52.579 INFO:teuthology.orchestra.run.smithi062.stdout: fsid = f7998a1e-e5a9-4202-abaa-70c0eaae1047 2023-06-09T04:39:52.579 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:39:52.579 INFO:teuthology.orchestra.run.smithi062.stdout:[osd] 2023-06-09T04:39:52.579 INFO:teuthology.orchestra.run.smithi062.stdout: osd journal size = 100 2023-06-09T04:39:52.580 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:39:52.580 INFO:teuthology.orchestra.run.smithi062.stdout: osd scrub load threshold = 5.0 2023-06-09T04:39:52.580 INFO:teuthology.orchestra.run.smithi062.stdout: osd scrub max interval = 600 2023-06-09T04:39:52.580 INFO:teuthology.orchestra.run.smithi062.stdout: osd mclock profile = high_recovery_ops 2023-06-09T04:39:52.580 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:39:52.580 INFO:teuthology.orchestra.run.smithi062.stdout: osd recover clone overlap = true 2023-06-09T04:39:52.580 INFO:teuthology.orchestra.run.smithi062.stdout: osd recovery max chunk = 1048576 2023-06-09T04:39:52.580 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:39:52.581 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug shutdown = true 2023-06-09T04:39:52.581 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug op order = true 2023-06-09T04:39:52.581 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug verify stray on activate = true 2023-06-09T04:39:52.581 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:39:52.581 INFO:teuthology.orchestra.run.smithi062.stdout: osd open classes on start = true 2023-06-09T04:39:52.581 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug pg log writeout = true 2023-06-09T04:39:52.581 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:39:52.581 INFO:teuthology.orchestra.run.smithi062.stdout: osd deep scrub update digest min age = 30 2023-06-09T04:39:52.582 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:39:52.582 INFO:teuthology.orchestra.run.smithi062.stdout: osd map max advance = 10 2023-06-09T04:39:52.582 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:39:52.582 INFO:teuthology.orchestra.run.smithi062.stdout: journal zero on create = true 2023-06-09T04:39:52.582 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:39:52.582 INFO:teuthology.orchestra.run.smithi062.stdout: filestore ondisk finisher threads = 3 2023-06-09T04:39:52.582 INFO:teuthology.orchestra.run.smithi062.stdout: filestore apply finisher threads = 3 2023-06-09T04:39:52.582 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:39:52.583 INFO:teuthology.orchestra.run.smithi062.stdout: bdev debug aio = true 2023-06-09T04:39:52.583 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug misdirected ops = true 2023-06-09T04:39:52.583 INFO:teuthology.orchestra.run.smithi062.stdout: bluestore block size = 96636764160 2023-06-09T04:39:52.583 INFO:teuthology.orchestra.run.smithi062.stdout: bluestore fsck on mount = True 2023-06-09T04:39:52.583 INFO:teuthology.orchestra.run.smithi062.stdout: debug bluefs = 20 2023-06-09T04:39:52.583 INFO:teuthology.orchestra.run.smithi062.stdout: debug bluestore = 20 2023-06-09T04:39:52.583 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2023-06-09T04:39:52.583 INFO:teuthology.orchestra.run.smithi062.stdout: debug osd = 20 2023-06-09T04:39:52.584 INFO:teuthology.orchestra.run.smithi062.stdout: debug rocksdb = 10 2023-06-09T04:39:52.584 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd backfillfull_ratio = 0.85 2023-06-09T04:39:52.584 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd full ratio = 0.9 2023-06-09T04:39:52.584 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd nearfull ratio = 0.8 2023-06-09T04:39:52.584 INFO:teuthology.orchestra.run.smithi062.stdout: osd failsafe full ratio = 0.95 2023-06-09T04:39:52.584 INFO:teuthology.orchestra.run.smithi062.stdout: osd objectstore = bluestore 2023-06-09T04:39:52.584 INFO:teuthology.orchestra.run.smithi062.stdout: osd op complaint time = 180 2023-06-09T04:39:52.585 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:39:52.585 INFO:teuthology.orchestra.run.smithi062.stdout:[mgr] 2023-06-09T04:39:52.585 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2023-06-09T04:39:52.585 INFO:teuthology.orchestra.run.smithi062.stdout: debug mgr = 20 2023-06-09T04:39:52.585 INFO:teuthology.orchestra.run.smithi062.stdout: debug mon = 20 2023-06-09T04:39:52.585 INFO:teuthology.orchestra.run.smithi062.stdout: debug auth = 20 2023-06-09T04:39:52.585 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min pgs per osd = 4 2023-06-09T04:39:52.585 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min bytes per osd = 10 2023-06-09T04:39:52.586 INFO:teuthology.orchestra.run.smithi062.stdout: mgr/telemetry/nag = false 2023-06-09T04:39:52.586 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:39:52.586 INFO:teuthology.orchestra.run.smithi062.stdout:[mon] 2023-06-09T04:39:52.586 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2023-06-09T04:39:52.586 INFO:teuthology.orchestra.run.smithi062.stdout: debug mon = 20 2023-06-09T04:39:52.586 INFO:teuthology.orchestra.run.smithi062.stdout: debug paxos = 20 2023-06-09T04:39:52.586 INFO:teuthology.orchestra.run.smithi062.stdout: debug auth = 20 2023-06-09T04:39:52.586 INFO:teuthology.orchestra.run.smithi062.stdout: mon data avail warn = 5 2023-06-09T04:39:52.587 INFO:teuthology.orchestra.run.smithi062.stdout: mon mgr mkfs grace = 240 2023-06-09T04:39:52.587 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min pgs per osd = 4 2023-06-09T04:39:52.587 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd reporter subtree level = osd 2023-06-09T04:39:52.587 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd prime pg temp = true 2023-06-09T04:39:52.587 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min bytes per osd = 10 2023-06-09T04:39:52.587 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:39:52.587 INFO:teuthology.orchestra.run.smithi062.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-06-09T04:39:52.587 INFO:teuthology.orchestra.run.smithi062.stdout: auth mon ticket ttl = 660 # 11m 2023-06-09T04:39:52.588 INFO:teuthology.orchestra.run.smithi062.stdout: auth service ticket ttl = 240 # 4m 2023-06-09T04:39:52.588 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:39:52.588 INFO:teuthology.orchestra.run.smithi062.stdout: # don't complain about insecure global_id in the test suite 2023-06-09T04:39:52.588 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-06-09T04:39:52.588 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-06-09T04:39:52.588 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:39:52.588 INFO:teuthology.orchestra.run.smithi062.stdout: # 1m isn't quite enough 2023-06-09T04:39:52.588 INFO:teuthology.orchestra.run.smithi062.stdout: mon_down_mkfs_grace = 2m 2023-06-09T04:39:52.589 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:39:52.589 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_filestore_osds = false 2023-06-09T04:39:52.589 INFO:teuthology.orchestra.run.smithi062.stdout: mon op complaint time = 120 2023-06-09T04:39:52.589 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:39:52.589 INFO:teuthology.orchestra.run.smithi062.stdout:[client] 2023-06-09T04:39:52.589 INFO:teuthology.orchestra.run.smithi062.stdout: rgw cache enabled = true 2023-06-09T04:39:52.589 INFO:teuthology.orchestra.run.smithi062.stdout: rgw enable ops log = true 2023-06-09T04:39:52.589 INFO:teuthology.orchestra.run.smithi062.stdout: rgw enable usage log = true 2023-06-09T04:39:52.590 INFO:teuthology.orchestra.run.smithi062.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-06-09T04:39:52.590 INFO:teuthology.orchestra.run.smithi062.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-06-09T04:39:52.590 INFO:teuthology.orchestra.run.smithi062.stdout: client mount timeout = 600 2023-06-09T04:39:52.590 INFO:teuthology.orchestra.run.smithi062.stdout: debug client = 20 2023-06-09T04:39:52.590 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2023-06-09T04:39:52.590 INFO:teuthology.orchestra.run.smithi062.stdout: pid file = "" 2023-06-09T04:39:52.590 INFO:teuthology.orchestra.run.smithi062.stdout: rados mon op timeout = 900 2023-06-09T04:39:52.590 INFO:teuthology.orchestra.run.smithi062.stdout: rados osd op timeout = 900 2023-06-09T04:39:52.591 INFO:teuthology.orchestra.run.smithi062.stdout:[mon.a] 2023-06-09T04:39:52.591 INFO:teuthology.orchestra.run.smithi062.stdout:[mon.b] 2023-06-09T04:39:52.591 INFO:teuthology.orchestra.run.smithi062.stdout:[mon.c] 2023-06-09T04:39:52.591 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.a] 2023-06-09T04:39:52.591 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.c] 2023-06-09T04:39:52.591 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.b] 2023-06-09T04:39:52.591 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.d] 2023-06-09T04:39:52.591 INFO:teuthology.orchestra.run.smithi062.stdout:[mds] 2023-06-09T04:39:52.592 INFO:teuthology.orchestra.run.smithi062.stdout: debug mds = 20 2023-06-09T04:39:52.592 INFO:teuthology.orchestra.run.smithi062.stdout: debug mds balancer = 20 2023-06-09T04:39:52.592 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2023-06-09T04:39:52.592 INFO:teuthology.orchestra.run.smithi062.stdout: mds debug frag = True 2023-06-09T04:39:52.592 INFO:teuthology.orchestra.run.smithi062.stdout: mds debug scatterstat = True 2023-06-09T04:39:52.592 INFO:teuthology.orchestra.run.smithi062.stdout: mds op complaint time = 180 2023-06-09T04:39:52.592 INFO:teuthology.orchestra.run.smithi062.stdout: mds verify scatter = True 2023-06-09T04:39:52.592 INFO:teuthology.orchestra.run.smithi062.stdout: osd op complaint time = 180 2023-06-09T04:39:52.593 INFO:teuthology.orchestra.run.smithi062.stdout: rados mon op timeout = 900 2023-06-09T04:39:52.593 INFO:teuthology.orchestra.run.smithi062.stdout: rados osd op timeout = 900 2023-06-09T04:39:52.593 INFO:teuthology.orchestra.run.smithi089.stdout:[global] 2023-06-09T04:39:52.593 INFO:teuthology.orchestra.run.smithi089.stdout: chdir = "" 2023-06-09T04:39:52.593 INFO:teuthology.orchestra.run.smithi089.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-06-09T04:39:52.594 INFO:teuthology.orchestra.run.smithi089.stdout: auth supported = cephx 2023-06-09T04:39:52.594 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-06-09T04:39:52.594 INFO:teuthology.orchestra.run.smithi089.stdout: filestore xattr use omap = true 2023-06-09T04:39:52.594 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-06-09T04:39:52.594 INFO:teuthology.orchestra.run.smithi089.stdout: mon clock drift allowed = 1.000 2023-06-09T04:39:52.594 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-06-09T04:39:52.594 INFO:teuthology.orchestra.run.smithi089.stdout: osd crush chooseleaf type = 0 2023-06-09T04:39:52.594 INFO:teuthology.orchestra.run.smithi089.stdout: auth debug = true 2023-06-09T04:39:52.595 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-06-09T04:39:52.595 INFO:teuthology.orchestra.run.smithi089.stdout: ms die on old message = true 2023-06-09T04:39:52.595 INFO:teuthology.orchestra.run.smithi089.stdout: ms die on bug = true 2023-06-09T04:39:52.595 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-06-09T04:39:52.595 INFO:teuthology.orchestra.run.smithi089.stdout: mon max pg per osd = 10000 # >= luminous 2023-06-09T04:39:52.595 INFO:teuthology.orchestra.run.smithi089.stdout: mon pg warn max object skew = 0 2023-06-09T04:39:52.595 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-06-09T04:39:52.595 INFO:teuthology.orchestra.run.smithi089.stdout: # disable pg_autoscaler by default for new pools 2023-06-09T04:39:52.596 INFO:teuthology.orchestra.run.smithi089.stdout: osd_pool_default_pg_autoscale_mode = off 2023-06-09T04:39:52.596 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-06-09T04:39:52.596 INFO:teuthology.orchestra.run.smithi089.stdout: osd pool default size = 2 2023-06-09T04:39:52.596 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-06-09T04:39:52.596 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd allow primary affinity = true 2023-06-09T04:39:52.596 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd allow pg remap = true 2023-06-09T04:39:52.596 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on legacy crush tunables = false 2023-06-09T04:39:52.596 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on crush straw calc version zero = false 2023-06-09T04:39:52.597 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on no sortbitwise = false 2023-06-09T04:39:52.597 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on osd down out interval zero = false 2023-06-09T04:39:52.597 INFO:teuthology.orchestra.run.smithi089.stdout: mon warn on too few osds = false 2023-06-09T04:39:52.597 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-06-09T04:39:52.597 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_pool_no_redundancy = false 2023-06-09T04:39:52.597 INFO:teuthology.orchestra.run.smithi089.stdout: mon_allow_pool_size_one = true 2023-06-09T04:39:52.597 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-06-09T04:39:52.597 INFO:teuthology.orchestra.run.smithi089.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-06-09T04:39:52.598 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-06-09T04:39:52.598 INFO:teuthology.orchestra.run.smithi089.stdout: osd default data pool replay window = 5 2023-06-09T04:39:52.598 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-06-09T04:39:52.598 INFO:teuthology.orchestra.run.smithi089.stdout: mon allow pool delete = true 2023-06-09T04:39:52.598 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-06-09T04:39:52.598 INFO:teuthology.orchestra.run.smithi089.stdout: mon cluster log file level = debug 2023-06-09T04:39:52.598 INFO:teuthology.orchestra.run.smithi089.stdout: debug asserts on shutdown = true 2023-06-09T04:39:52.598 INFO:teuthology.orchestra.run.smithi089.stdout: mon health detail to clog = false 2023-06-09T04:39:52.599 INFO:teuthology.orchestra.run.smithi089.stdout: mon host = "172.21.15.62,172.21.15.89,[v2:172.21.15.89:3301,v1:172.21.15.89:6790]" 2023-06-09T04:39:52.599 INFO:teuthology.orchestra.run.smithi089.stdout: ms die on skipped message = False 2023-06-09T04:39:52.599 INFO:teuthology.orchestra.run.smithi089.stdout: fsid = f7998a1e-e5a9-4202-abaa-70c0eaae1047 2023-06-09T04:39:52.599 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-06-09T04:39:52.599 INFO:teuthology.orchestra.run.smithi089.stdout:[osd] 2023-06-09T04:39:52.599 INFO:teuthology.orchestra.run.smithi089.stdout: osd journal size = 100 2023-06-09T04:39:52.599 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-06-09T04:39:52.599 INFO:teuthology.orchestra.run.smithi089.stdout: osd scrub load threshold = 5.0 2023-06-09T04:39:52.600 INFO:teuthology.orchestra.run.smithi089.stdout: osd scrub max interval = 600 2023-06-09T04:39:52.600 INFO:teuthology.orchestra.run.smithi089.stdout: osd mclock profile = high_recovery_ops 2023-06-09T04:39:52.600 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-06-09T04:39:52.600 INFO:teuthology.orchestra.run.smithi089.stdout: osd recover clone overlap = true 2023-06-09T04:39:52.600 INFO:teuthology.orchestra.run.smithi089.stdout: osd recovery max chunk = 1048576 2023-06-09T04:39:52.600 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-06-09T04:39:52.600 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug shutdown = true 2023-06-09T04:39:52.600 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug op order = true 2023-06-09T04:39:52.601 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug verify stray on activate = true 2023-06-09T04:39:52.601 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-06-09T04:39:52.601 INFO:teuthology.orchestra.run.smithi089.stdout: osd open classes on start = true 2023-06-09T04:39:52.601 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug pg log writeout = true 2023-06-09T04:39:52.601 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-06-09T04:39:52.601 INFO:teuthology.orchestra.run.smithi089.stdout: osd deep scrub update digest min age = 30 2023-06-09T04:39:52.601 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-06-09T04:39:52.601 INFO:teuthology.orchestra.run.smithi089.stdout: osd map max advance = 10 2023-06-09T04:39:52.602 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-06-09T04:39:52.602 INFO:teuthology.orchestra.run.smithi089.stdout: journal zero on create = true 2023-06-09T04:39:52.602 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-06-09T04:39:52.602 INFO:teuthology.orchestra.run.smithi089.stdout: filestore ondisk finisher threads = 3 2023-06-09T04:39:52.602 INFO:teuthology.orchestra.run.smithi089.stdout: filestore apply finisher threads = 3 2023-06-09T04:39:52.602 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-06-09T04:39:52.602 INFO:teuthology.orchestra.run.smithi089.stdout: bdev debug aio = true 2023-06-09T04:39:52.602 INFO:teuthology.orchestra.run.smithi089.stdout: osd debug misdirected ops = true 2023-06-09T04:39:52.603 INFO:teuthology.orchestra.run.smithi089.stdout: bluestore block size = 96636764160 2023-06-09T04:39:52.603 INFO:teuthology.orchestra.run.smithi089.stdout: bluestore fsck on mount = True 2023-06-09T04:39:52.603 INFO:teuthology.orchestra.run.smithi089.stdout: debug bluefs = 20 2023-06-09T04:39:52.603 INFO:teuthology.orchestra.run.smithi089.stdout: debug bluestore = 20 2023-06-09T04:39:52.603 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2023-06-09T04:39:52.603 INFO:teuthology.orchestra.run.smithi089.stdout: debug osd = 20 2023-06-09T04:39:52.603 INFO:teuthology.orchestra.run.smithi089.stdout: debug rocksdb = 10 2023-06-09T04:39:52.603 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd backfillfull_ratio = 0.85 2023-06-09T04:39:52.604 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd full ratio = 0.9 2023-06-09T04:39:52.604 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd nearfull ratio = 0.8 2023-06-09T04:39:52.604 INFO:teuthology.orchestra.run.smithi089.stdout: osd failsafe full ratio = 0.95 2023-06-09T04:39:52.604 INFO:teuthology.orchestra.run.smithi089.stdout: osd objectstore = bluestore 2023-06-09T04:39:52.604 INFO:teuthology.orchestra.run.smithi089.stdout: osd op complaint time = 180 2023-06-09T04:39:52.604 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-06-09T04:39:52.604 INFO:teuthology.orchestra.run.smithi089.stdout:[mgr] 2023-06-09T04:39:52.604 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2023-06-09T04:39:52.605 INFO:teuthology.orchestra.run.smithi089.stdout: debug mgr = 20 2023-06-09T04:39:52.605 INFO:teuthology.orchestra.run.smithi089.stdout: debug mon = 20 2023-06-09T04:39:52.605 INFO:teuthology.orchestra.run.smithi089.stdout: debug auth = 20 2023-06-09T04:39:52.605 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min pgs per osd = 4 2023-06-09T04:39:52.605 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min bytes per osd = 10 2023-06-09T04:39:52.605 INFO:teuthology.orchestra.run.smithi089.stdout: mgr/telemetry/nag = false 2023-06-09T04:39:52.605 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-06-09T04:39:52.605 INFO:teuthology.orchestra.run.smithi089.stdout:[mon] 2023-06-09T04:39:52.606 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2023-06-09T04:39:52.606 INFO:teuthology.orchestra.run.smithi089.stdout: debug mon = 20 2023-06-09T04:39:52.606 INFO:teuthology.orchestra.run.smithi089.stdout: debug paxos = 20 2023-06-09T04:39:52.606 INFO:teuthology.orchestra.run.smithi089.stdout: debug auth = 20 2023-06-09T04:39:52.606 INFO:teuthology.orchestra.run.smithi089.stdout: mon data avail warn = 5 2023-06-09T04:39:52.606 INFO:teuthology.orchestra.run.smithi089.stdout: mon mgr mkfs grace = 240 2023-06-09T04:39:52.606 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min pgs per osd = 4 2023-06-09T04:39:52.606 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd reporter subtree level = osd 2023-06-09T04:39:52.607 INFO:teuthology.orchestra.run.smithi089.stdout: mon osd prime pg temp = true 2023-06-09T04:39:52.607 INFO:teuthology.orchestra.run.smithi089.stdout: mon reweight min bytes per osd = 10 2023-06-09T04:39:52.607 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-06-09T04:39:52.607 INFO:teuthology.orchestra.run.smithi089.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-06-09T04:39:52.607 INFO:teuthology.orchestra.run.smithi089.stdout: auth mon ticket ttl = 660 # 11m 2023-06-09T04:39:52.607 INFO:teuthology.orchestra.run.smithi089.stdout: auth service ticket ttl = 240 # 4m 2023-06-09T04:39:52.607 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-06-09T04:39:52.607 INFO:teuthology.orchestra.run.smithi089.stdout: # don't complain about insecure global_id in the test suite 2023-06-09T04:39:52.608 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-06-09T04:39:52.608 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-06-09T04:39:52.608 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-06-09T04:39:52.608 INFO:teuthology.orchestra.run.smithi089.stdout: # 1m isn't quite enough 2023-06-09T04:39:52.608 INFO:teuthology.orchestra.run.smithi089.stdout: mon_down_mkfs_grace = 2m 2023-06-09T04:39:52.608 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-06-09T04:39:52.608 INFO:teuthology.orchestra.run.smithi089.stdout: mon_warn_on_filestore_osds = false 2023-06-09T04:39:52.608 INFO:teuthology.orchestra.run.smithi089.stdout: mon op complaint time = 120 2023-06-09T04:39:52.609 INFO:teuthology.orchestra.run.smithi089.stdout: 2023-06-09T04:39:52.609 INFO:teuthology.orchestra.run.smithi089.stdout:[client] 2023-06-09T04:39:52.609 INFO:teuthology.orchestra.run.smithi089.stdout: rgw cache enabled = true 2023-06-09T04:39:52.609 INFO:teuthology.orchestra.run.smithi089.stdout: rgw enable ops log = true 2023-06-09T04:39:52.609 INFO:teuthology.orchestra.run.smithi089.stdout: rgw enable usage log = true 2023-06-09T04:39:52.609 INFO:teuthology.orchestra.run.smithi089.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-06-09T04:39:52.609 INFO:teuthology.orchestra.run.smithi089.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-06-09T04:39:52.609 INFO:teuthology.orchestra.run.smithi089.stdout: client mount timeout = 600 2023-06-09T04:39:52.610 INFO:teuthology.orchestra.run.smithi089.stdout: debug client = 20 2023-06-09T04:39:52.610 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2023-06-09T04:39:52.610 INFO:teuthology.orchestra.run.smithi089.stdout: pid file = "" 2023-06-09T04:39:52.610 INFO:teuthology.orchestra.run.smithi089.stdout: rados mon op timeout = 900 2023-06-09T04:39:52.610 INFO:teuthology.orchestra.run.smithi089.stdout: rados osd op timeout = 900 2023-06-09T04:39:52.610 INFO:teuthology.orchestra.run.smithi089.stdout:[mon.a] 2023-06-09T04:39:52.610 INFO:teuthology.orchestra.run.smithi089.stdout:[mon.b] 2023-06-09T04:39:52.610 INFO:teuthology.orchestra.run.smithi089.stdout:[mon.c] 2023-06-09T04:39:52.611 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.a] 2023-06-09T04:39:52.611 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.c] 2023-06-09T04:39:52.611 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.b] 2023-06-09T04:39:52.611 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.d] 2023-06-09T04:39:52.611 INFO:teuthology.orchestra.run.smithi089.stdout:[mds] 2023-06-09T04:39:52.611 INFO:teuthology.orchestra.run.smithi089.stdout: debug mds = 20 2023-06-09T04:39:52.611 INFO:teuthology.orchestra.run.smithi089.stdout: debug mds balancer = 20 2023-06-09T04:39:52.611 INFO:teuthology.orchestra.run.smithi089.stdout: debug ms = 1 2023-06-09T04:39:52.612 INFO:teuthology.orchestra.run.smithi089.stdout: mds debug frag = True 2023-06-09T04:39:52.612 INFO:teuthology.orchestra.run.smithi089.stdout: mds debug scatterstat = True 2023-06-09T04:39:52.612 INFO:teuthology.orchestra.run.smithi089.stdout: mds op complaint time = 180 2023-06-09T04:39:52.612 INFO:teuthology.orchestra.run.smithi089.stdout: mds verify scatter = True 2023-06-09T04:39:52.612 INFO:teuthology.orchestra.run.smithi089.stdout: osd op complaint time = 180 2023-06-09T04:39:52.612 INFO:teuthology.orchestra.run.smithi089.stdout: rados mon op timeout = 900 2023-06-09T04:39:52.612 INFO:teuthology.orchestra.run.smithi089.stdout: rados osd op timeout = 900 2023-06-09T04:39:52.613 INFO:tasks.ceph:Creating admin key on mon.a... 2023-06-09T04:39:52.614 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-06-09T04:39:52.700 INFO:tasks.ceph:Copying monmap to all nodes... 2023-06-09T04:39:52.701 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-06-09T04:39:52.701 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-06-09T04:39:52.719 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-06-09T04:39:52.720 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-06-09T04:39:52.783 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi062.front.sepia.ceph.com 2023-06-09T04:39:52.784 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-06-09T04:39:52.784 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/ceph/ceph.keyring 2023-06-09T04:39:52.784 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-06-09T04:39:52.886 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-06-09T04:39:52.887 DEBUG:teuthology.orchestra.run.smithi062:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-06-09T04:39:52.948 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi089.front.sepia.ceph.com 2023-06-09T04:39:52.949 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-06-09T04:39:52.949 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/ceph/ceph.keyring 2023-06-09T04:39:52.950 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-06-09T04:39:53.010 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-06-09T04:39:53.010 DEBUG:teuthology.orchestra.run.smithi089:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-06-09T04:39:53.068 INFO:tasks.ceph:Setting up mon nodes... 2023-06-09T04:39:53.068 INFO:tasks.ceph:Setting up mgr nodes... 2023-06-09T04:39:53.068 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-06-09T04:39:53.174 INFO:teuthology.orchestra.run.smithi062.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-06-09T04:39:53.182 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-06-09T04:39:53.275 INFO:teuthology.orchestra.run.smithi089.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-06-09T04:39:53.293 INFO:tasks.ceph:Setting up mds nodes... 2023-06-09T04:39:53.293 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-06-09T04:39:53.397 INFO:teuthology.orchestra.run.smithi062.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-06-09T04:39:53.404 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-06-09T04:39:53.439 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-06-09T04:39:53.583 INFO:teuthology.orchestra.run.smithi062.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-06-09T04:39:53.590 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-06-09T04:39:53.621 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-06-09T04:39:53.719 INFO:teuthology.orchestra.run.smithi089.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-06-09T04:39:53.725 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-06-09T04:39:53.757 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-06-09T04:39:53.898 INFO:teuthology.orchestra.run.smithi089.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-06-09T04:39:53.905 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-06-09T04:39:53.939 INFO:tasks.ceph_client:Setting up client nodes... 2023-06-09T04:39:53.940 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-06-09T04:39:54.019 INFO:teuthology.orchestra.run.smithi062.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-06-09T04:39:54.049 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-06-09T04:39:54.118 INFO:teuthology.orchestra.run.smithi062.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-06-09T04:39:54.146 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-06-09T04:39:54.222 INFO:teuthology.orchestra.run.smithi089.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-06-09T04:39:54.251 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-06-09T04:39:54.329 INFO:teuthology.orchestra.run.smithi089.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-06-09T04:39:54.357 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-06-09T04:39:54.357 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi062.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi089.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-06-09T04:39:54.357 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-06-09T04:39:54.393 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-09T04:39:54.393 INFO:tasks.ceph:role: osd.0 2023-06-09T04:39:54.393 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi062.front.sepia.ceph.com 2023-06-09T04:39:54.394 DEBUG:teuthology.orchestra.run.smithi062:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-06-09T04:39:54.977 INFO:teuthology.orchestra.run.smithi062.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-06-09T04:39:54.977 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-09T04:39:54.978 INFO:teuthology.orchestra.run.smithi062.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-09T04:39:54.978 INFO:teuthology.orchestra.run.smithi062.stdout: = reflink=1 2023-06-09T04:39:54.978 INFO:teuthology.orchestra.run.smithi062.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-09T04:39:54.978 INFO:teuthology.orchestra.run.smithi062.stdout: = sunit=0 swidth=0 blks 2023-06-09T04:39:54.978 INFO:teuthology.orchestra.run.smithi062.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-09T04:39:54.978 INFO:teuthology.orchestra.run.smithi062.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-09T04:39:54.978 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-09T04:39:54.979 INFO:teuthology.orchestra.run.smithi062.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-09T04:39:54.982 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi062.front.sepia.ceph.com -o noatime 2023-06-09T04:39:54.982 DEBUG:teuthology.orchestra.run.smithi062:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-06-09T04:39:55.076 DEBUG:teuthology.orchestra.run.smithi062:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-06-09T04:39:55.100 INFO:teuthology.orchestra.run.smithi062.stderr:sudo: /sbin/restorecon: command not found 2023-06-09T04:39:55.100 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T04:39:55.101 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-06-09T04:39:55.174 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-09T04:39:55.174 INFO:tasks.ceph:role: osd.1 2023-06-09T04:39:55.175 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi062.front.sepia.ceph.com 2023-06-09T04:39:55.175 DEBUG:teuthology.orchestra.run.smithi062:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-06-09T04:39:55.694 INFO:teuthology.orchestra.run.smithi062.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-06-09T04:39:55.694 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-09T04:39:55.694 INFO:teuthology.orchestra.run.smithi062.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-09T04:39:55.694 INFO:teuthology.orchestra.run.smithi062.stdout: = reflink=1 2023-06-09T04:39:55.694 INFO:teuthology.orchestra.run.smithi062.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-09T04:39:55.695 INFO:teuthology.orchestra.run.smithi062.stdout: = sunit=0 swidth=0 blks 2023-06-09T04:39:55.695 INFO:teuthology.orchestra.run.smithi062.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-09T04:39:55.695 INFO:teuthology.orchestra.run.smithi062.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-09T04:39:55.695 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-09T04:39:55.695 INFO:teuthology.orchestra.run.smithi062.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-09T04:39:55.697 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi062.front.sepia.ceph.com -o noatime 2023-06-09T04:39:55.697 DEBUG:teuthology.orchestra.run.smithi062:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-06-09T04:39:55.745 DEBUG:teuthology.orchestra.run.smithi062:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-06-09T04:39:55.813 INFO:teuthology.orchestra.run.smithi062.stderr:sudo: /sbin/restorecon: command not found 2023-06-09T04:39:55.814 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T04:39:55.815 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-06-09T04:39:55.897 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-09T04:39:55.897 INFO:tasks.ceph:role: osd.2 2023-06-09T04:39:55.898 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi062.front.sepia.ceph.com 2023-06-09T04:39:55.898 DEBUG:teuthology.orchestra.run.smithi062:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-06-09T04:39:56.482 INFO:teuthology.orchestra.run.smithi062.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-06-09T04:39:56.482 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-09T04:39:56.482 INFO:teuthology.orchestra.run.smithi062.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-09T04:39:56.482 INFO:teuthology.orchestra.run.smithi062.stdout: = reflink=1 2023-06-09T04:39:56.483 INFO:teuthology.orchestra.run.smithi062.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-09T04:39:56.483 INFO:teuthology.orchestra.run.smithi062.stdout: = sunit=0 swidth=0 blks 2023-06-09T04:39:56.483 INFO:teuthology.orchestra.run.smithi062.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-09T04:39:56.483 INFO:teuthology.orchestra.run.smithi062.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-09T04:39:56.483 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-09T04:39:56.483 INFO:teuthology.orchestra.run.smithi062.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-09T04:39:56.486 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi062.front.sepia.ceph.com -o noatime 2023-06-09T04:39:56.486 DEBUG:teuthology.orchestra.run.smithi062:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-06-09T04:39:56.570 DEBUG:teuthology.orchestra.run.smithi062:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-06-09T04:39:56.591 INFO:teuthology.orchestra.run.smithi062.stderr:sudo: /sbin/restorecon: command not found 2023-06-09T04:39:56.592 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T04:39:56.593 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-06-09T04:39:56.673 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-09T04:39:56.673 INFO:tasks.ceph:role: osd.3 2023-06-09T04:39:56.673 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi062.front.sepia.ceph.com 2023-06-09T04:39:56.673 DEBUG:teuthology.orchestra.run.smithi062:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-06-09T04:39:57.277 INFO:teuthology.orchestra.run.smithi062.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-06-09T04:39:57.278 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-09T04:39:57.278 INFO:teuthology.orchestra.run.smithi062.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-09T04:39:57.278 INFO:teuthology.orchestra.run.smithi062.stdout: = reflink=1 2023-06-09T04:39:57.278 INFO:teuthology.orchestra.run.smithi062.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-09T04:39:57.278 INFO:teuthology.orchestra.run.smithi062.stdout: = sunit=0 swidth=0 blks 2023-06-09T04:39:57.278 INFO:teuthology.orchestra.run.smithi062.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-09T04:39:57.278 INFO:teuthology.orchestra.run.smithi062.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-09T04:39:57.279 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-09T04:39:57.279 INFO:teuthology.orchestra.run.smithi062.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-09T04:39:57.282 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi062.front.sepia.ceph.com -o noatime 2023-06-09T04:39:57.282 DEBUG:teuthology.orchestra.run.smithi062:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-06-09T04:39:57.462 DEBUG:teuthology.orchestra.run.smithi062:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-06-09T04:39:57.480 INFO:teuthology.orchestra.run.smithi062.stderr:sudo: /sbin/restorecon: command not found 2023-06-09T04:39:57.480 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T04:39:57.481 DEBUG:teuthology.orchestra.run.smithi062:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-09T04:39:57.643 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:39:57.635+0000 7fa03e5ee700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-06-09T04:39:57.649 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:39:57.643+0000 7fa03e5ee700 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-06-09T04:39:57.650 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:39:57.643+0000 7fa03e5ee700 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-06-09T04:39:57.650 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:39:57.643+0000 7fa03e5ee700 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-06-09T04:39:57.650 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:39:57.643+0000 7fa03e5ee700 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-06-09T04:39:57.660 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:39:57.651+0000 7fa03e5ee700 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-06-09T04:40:00.724 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-06-09T04:40:00.760 DEBUG:teuthology.orchestra.run.smithi062:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-09T04:40:00.890 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:00.883+0000 7fbf07f21700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-06-09T04:40:00.891 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:00.883+0000 7fbf07f21700 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-06-09T04:40:00.891 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:00.883+0000 7fbf07f21700 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-06-09T04:40:00.891 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:00.883+0000 7fbf07f21700 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-06-09T04:40:00.891 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:00.883+0000 7fbf07f21700 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-06-09T04:40:00.894 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:00.887+0000 7fbf07f21700 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-06-09T04:40:03.950 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-06-09T04:40:03.986 DEBUG:teuthology.orchestra.run.smithi062:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-09T04:40:04.117 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:04.111+0000 7f2f0f647700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-06-09T04:40:04.118 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:04.111+0000 7f2f0f647700 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-06-09T04:40:04.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:04.111+0000 7f2f0f647700 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-06-09T04:40:04.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:04.111+0000 7f2f0f647700 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-06-09T04:40:04.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:04.111+0000 7f2f0f647700 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-06-09T04:40:04.120 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:04.115+0000 7f2f0f647700 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-06-09T04:40:07.186 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-06-09T04:40:07.219 DEBUG:teuthology.orchestra.run.smithi062:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-09T04:40:07.347 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:07.339+0000 7f6614ae2700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-06-09T04:40:07.347 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:07.339+0000 7f6614ae2700 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-06-09T04:40:07.348 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:07.339+0000 7f6614ae2700 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-06-09T04:40:07.348 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:07.339+0000 7f6614ae2700 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-06-09T04:40:07.348 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:07.339+0000 7f6614ae2700 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-06-09T04:40:07.350 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:07.343+0000 7f6614ae2700 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-06-09T04:40:10.410 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-06-09T04:40:10.446 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-06-09T04:40:10.489 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-09T04:40:10.489 INFO:tasks.ceph:role: osd.4 2023-06-09T04:40:10.489 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi089.front.sepia.ceph.com 2023-06-09T04:40:10.489 DEBUG:teuthology.orchestra.run.smithi089:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-06-09T04:40:11.083 INFO:teuthology.orchestra.run.smithi089.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-06-09T04:40:11.083 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-09T04:40:11.083 INFO:teuthology.orchestra.run.smithi089.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-09T04:40:11.083 INFO:teuthology.orchestra.run.smithi089.stdout: = reflink=1 2023-06-09T04:40:11.084 INFO:teuthology.orchestra.run.smithi089.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-09T04:40:11.084 INFO:teuthology.orchestra.run.smithi089.stdout: = sunit=0 swidth=0 blks 2023-06-09T04:40:11.084 INFO:teuthology.orchestra.run.smithi089.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-09T04:40:11.084 INFO:teuthology.orchestra.run.smithi089.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-09T04:40:11.084 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-09T04:40:11.084 INFO:teuthology.orchestra.run.smithi089.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-09T04:40:11.090 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi089.front.sepia.ceph.com -o noatime 2023-06-09T04:40:11.090 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-06-09T04:40:11.209 DEBUG:teuthology.orchestra.run.smithi089:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-06-09T04:40:11.231 INFO:teuthology.orchestra.run.smithi089.stderr:sudo: /sbin/restorecon: command not found 2023-06-09T04:40:11.232 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T04:40:11.233 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-06-09T04:40:11.308 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-09T04:40:11.309 INFO:tasks.ceph:role: osd.5 2023-06-09T04:40:11.309 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi089.front.sepia.ceph.com 2023-06-09T04:40:11.309 DEBUG:teuthology.orchestra.run.smithi089:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-06-09T04:40:11.845 INFO:teuthology.orchestra.run.smithi089.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-06-09T04:40:11.845 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-09T04:40:11.845 INFO:teuthology.orchestra.run.smithi089.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-09T04:40:11.845 INFO:teuthology.orchestra.run.smithi089.stdout: = reflink=1 2023-06-09T04:40:11.845 INFO:teuthology.orchestra.run.smithi089.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-09T04:40:11.846 INFO:teuthology.orchestra.run.smithi089.stdout: = sunit=0 swidth=0 blks 2023-06-09T04:40:11.846 INFO:teuthology.orchestra.run.smithi089.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-09T04:40:11.846 INFO:teuthology.orchestra.run.smithi089.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-09T04:40:11.846 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-09T04:40:11.846 INFO:teuthology.orchestra.run.smithi089.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-09T04:40:11.850 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi089.front.sepia.ceph.com -o noatime 2023-06-09T04:40:11.851 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-06-09T04:40:11.924 DEBUG:teuthology.orchestra.run.smithi089:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-06-09T04:40:11.943 INFO:teuthology.orchestra.run.smithi089.stderr:sudo: /sbin/restorecon: command not found 2023-06-09T04:40:11.944 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T04:40:11.945 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-06-09T04:40:12.021 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-09T04:40:12.021 INFO:tasks.ceph:role: osd.6 2023-06-09T04:40:12.021 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi089.front.sepia.ceph.com 2023-06-09T04:40:12.022 DEBUG:teuthology.orchestra.run.smithi089:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-06-09T04:40:12.606 INFO:teuthology.orchestra.run.smithi089.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-06-09T04:40:12.607 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-09T04:40:12.607 INFO:teuthology.orchestra.run.smithi089.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-09T04:40:12.607 INFO:teuthology.orchestra.run.smithi089.stdout: = reflink=1 2023-06-09T04:40:12.607 INFO:teuthology.orchestra.run.smithi089.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-09T04:40:12.607 INFO:teuthology.orchestra.run.smithi089.stdout: = sunit=0 swidth=0 blks 2023-06-09T04:40:12.607 INFO:teuthology.orchestra.run.smithi089.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-09T04:40:12.608 INFO:teuthology.orchestra.run.smithi089.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-09T04:40:12.608 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-09T04:40:12.608 INFO:teuthology.orchestra.run.smithi089.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-09T04:40:12.611 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi089.front.sepia.ceph.com -o noatime 2023-06-09T04:40:12.611 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-06-09T04:40:12.743 DEBUG:teuthology.orchestra.run.smithi089:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-06-09T04:40:12.761 INFO:teuthology.orchestra.run.smithi089.stderr:sudo: /sbin/restorecon: command not found 2023-06-09T04:40:12.762 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T04:40:12.763 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-06-09T04:40:12.839 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-09T04:40:12.839 INFO:tasks.ceph:role: osd.7 2023-06-09T04:40:12.840 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi089.front.sepia.ceph.com 2023-06-09T04:40:12.840 DEBUG:teuthology.orchestra.run.smithi089:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-06-09T04:40:13.406 INFO:teuthology.orchestra.run.smithi089.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-06-09T04:40:13.407 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-09T04:40:13.407 INFO:teuthology.orchestra.run.smithi089.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-09T04:40:13.407 INFO:teuthology.orchestra.run.smithi089.stdout: = reflink=1 2023-06-09T04:40:13.407 INFO:teuthology.orchestra.run.smithi089.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-09T04:40:13.407 INFO:teuthology.orchestra.run.smithi089.stdout: = sunit=0 swidth=0 blks 2023-06-09T04:40:13.407 INFO:teuthology.orchestra.run.smithi089.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-09T04:40:13.407 INFO:teuthology.orchestra.run.smithi089.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-09T04:40:13.408 INFO:teuthology.orchestra.run.smithi089.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-09T04:40:13.408 INFO:teuthology.orchestra.run.smithi089.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-09T04:40:13.413 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi089.front.sepia.ceph.com -o noatime 2023-06-09T04:40:13.413 DEBUG:teuthology.orchestra.run.smithi089:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-06-09T04:40:13.535 DEBUG:teuthology.orchestra.run.smithi089:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-06-09T04:40:13.554 INFO:teuthology.orchestra.run.smithi089.stderr:sudo: /sbin/restorecon: command not found 2023-06-09T04:40:13.554 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T04:40:13.555 DEBUG:teuthology.orchestra.run.smithi089:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-09T04:40:13.716 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:13.714+0000 7f003e544700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-06-09T04:40:13.720 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:13.718+0000 7f003e544700 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-06-09T04:40:13.720 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:13.718+0000 7f003e544700 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-06-09T04:40:13.721 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:13.718+0000 7f003e544700 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-06-09T04:40:13.721 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:13.718+0000 7f003e544700 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-06-09T04:40:13.723 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:13.722+0000 7f003e544700 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-06-09T04:40:16.788 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-06-09T04:40:16.820 DEBUG:teuthology.orchestra.run.smithi089:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-09T04:40:16.945 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:16.942+0000 7f8adaeac700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-06-09T04:40:16.946 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:16.942+0000 7f8adaeac700 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-06-09T04:40:16.946 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:16.942+0000 7f8adaeac700 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-06-09T04:40:16.946 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:16.942+0000 7f8adaeac700 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-06-09T04:40:16.947 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:16.942+0000 7f8adaeac700 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-06-09T04:40:16.948 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:16.946+0000 7f8adaeac700 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-06-09T04:40:20.003 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-06-09T04:40:20.033 DEBUG:teuthology.orchestra.run.smithi089:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-09T04:40:20.158 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:20.154+0000 7f530eb62700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-06-09T04:40:20.159 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:20.158+0000 7f530eb62700 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-06-09T04:40:20.160 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:20.158+0000 7f530eb62700 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-06-09T04:40:20.160 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:20.158+0000 7f530eb62700 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-06-09T04:40:20.160 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:20.158+0000 7f530eb62700 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-06-09T04:40:20.161 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:20.158+0000 7f530eb62700 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-06-09T04:40:20.211 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:40:20.218 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:40:23.231 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-06-09T04:40:23.264 DEBUG:teuthology.orchestra.run.smithi089:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-09T04:40:23.392 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:23.390+0000 7f6003c76700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-06-09T04:40:23.393 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:23.390+0000 7f6003c76700 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-06-09T04:40:23.393 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:23.390+0000 7f6003c76700 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-06-09T04:40:23.394 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:23.390+0000 7f6003c76700 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-06-09T04:40:23.394 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:23.390+0000 7f6003c76700 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-06-09T04:40:23.396 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:23.394+0000 7f6003c76700 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-06-09T04:40:26.446 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-06-09T04:40:26.479 INFO:tasks.ceph:Reading keys from all nodes... 2023-06-09T04:40:26.479 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-06-09T04:40:26.480 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-06-09T04:40:26.514 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-06-09T04:40:26.515 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-06-09T04:40:26.588 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-06-09T04:40:26.589 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-06-09T04:40:26.669 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-06-09T04:40:26.669 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-06-09T04:40:26.744 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-06-09T04:40:26.744 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-06-09T04:40:26.825 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-06-09T04:40:26.825 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-06-09T04:40:26.905 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-06-09T04:40:26.905 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-06-09T04:40:26.979 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-06-09T04:40:26.979 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-06-09T04:40:27.012 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-06-09T04:40:27.012 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-06-09T04:40:27.086 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-06-09T04:40:27.087 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-06-09T04:40:27.163 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-06-09T04:40:27.163 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-06-09T04:40:27.238 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-06-09T04:40:27.238 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-06-09T04:40:27.314 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-06-09T04:40:27.314 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-06-09T04:40:27.390 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-06-09T04:40:27.391 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-06-09T04:40:27.466 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-06-09T04:40:27.467 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-06-09T04:40:27.483 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-06-09T04:40:27.483 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-06-09T04:40:27.545 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-06-09T04:40:27.545 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-06-09T04:40:27.562 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-06-09T04:40:27.562 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-06-09T04:40:27.619 INFO:tasks.ceph:Adding keys to all mons... 2023-06-09T04:40:27.620 DEBUG:teuthology.orchestra.run.smithi062:> sudo tee -a /etc/ceph/ceph.keyring 2023-06-09T04:40:27.626 DEBUG:teuthology.orchestra.run.smithi089:> sudo tee -a /etc/ceph/ceph.keyring 2023-06-09T04:40:27.669 INFO:teuthology.orchestra.run.smithi062.stdout:[mgr.y] 2023-06-09T04:40:27.669 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQAZrYJkiH83ChAAC28n3BSdrXf3XU+7S34z0w== 2023-06-09T04:40:27.669 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.a] 2023-06-09T04:40:27.669 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQAZrYJk42iDFxAA+c2CwYweXtVaFzUMyaacNQ== 2023-06-09T04:40:27.669 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.c] 2023-06-09T04:40:27.670 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQAZrYJkooeaIhAAMlbe2ux/81h5CzYjg+Ulsw== 2023-06-09T04:40:27.670 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.0] 2023-06-09T04:40:27.670 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQAdrYJkRss1JhAAcdLrgbERFQVCiEykWwPVPw== 2023-06-09T04:40:27.670 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.1] 2023-06-09T04:40:27.670 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQAgrYJkvHfvNBAASz7iQzBaI2LSpPqYEjbLAA== 2023-06-09T04:40:27.670 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.2] 2023-06-09T04:40:27.670 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQAkrYJk/WTmBhAAlrHI/fMDgRMA+2a4fTxW2w== 2023-06-09T04:40:27.670 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.3] 2023-06-09T04:40:27.671 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQAnrYJkcZyVFBAAlH7++y04LZmd2DKV1ZbYgQ== 2023-06-09T04:40:27.671 INFO:teuthology.orchestra.run.smithi062.stdout:[mgr.x] 2023-06-09T04:40:27.671 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQAZrYJkMv+HEBAAuyUeDIJdP2fkpuI+XkvVNw== 2023-06-09T04:40:27.671 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.b] 2023-06-09T04:40:27.671 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQAZrYJkvFH5KhAA4Pl4utP88ZxAE4zdkXdjjw== 2023-06-09T04:40:27.671 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.d] 2023-06-09T04:40:27.671 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQAZrYJkRA6kNRAACD2W4V91yXmgwVDZ5dQddA== 2023-06-09T04:40:27.672 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.4] 2023-06-09T04:40:27.672 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQAtrYJkWJvLKhAALJUSOqdOW7z4nLtu71072A== 2023-06-09T04:40:27.672 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.5] 2023-06-09T04:40:27.672 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQAwrYJkFdt8OBAAOcWVsLco9sD6WUxNxYuW/g== 2023-06-09T04:40:27.672 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.6] 2023-06-09T04:40:27.672 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQA0rYJkx2eRCRAA3KTwiARC9abe6rjN99Erew== 2023-06-09T04:40:27.672 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.7] 2023-06-09T04:40:27.672 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQA3rYJkSsaGFxAAVncX4e/ABMEcJ4hqiqHZCg== 2023-06-09T04:40:27.673 INFO:teuthology.orchestra.run.smithi062.stdout:[client.0] 2023-06-09T04:40:27.673 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQAarYJkIa0DARAAVRIC7NMEOq/Qp+fO+wQe5w== 2023-06-09T04:40:27.673 INFO:teuthology.orchestra.run.smithi062.stdout:[client.2] 2023-06-09T04:40:27.673 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQAarYJksGznBhAAmyV0iiUHFGmesplmEY9tjw== 2023-06-09T04:40:27.673 INFO:teuthology.orchestra.run.smithi062.stdout:[client.1] 2023-06-09T04:40:27.673 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQAarYJkWbxgDRAA0769AOxjUqgFIfhLTSHVrw== 2023-06-09T04:40:27.673 INFO:teuthology.orchestra.run.smithi062.stdout:[client.3] 2023-06-09T04:40:27.674 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQAarYJktADAExAA2lvRbNjB4bH/EE8bL0rtGg== 2023-06-09T04:40:27.692 INFO:teuthology.orchestra.run.smithi089.stdout:[mgr.y] 2023-06-09T04:40:27.692 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQAZrYJkiH83ChAAC28n3BSdrXf3XU+7S34z0w== 2023-06-09T04:40:27.692 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.a] 2023-06-09T04:40:27.693 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQAZrYJk42iDFxAA+c2CwYweXtVaFzUMyaacNQ== 2023-06-09T04:40:27.693 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.c] 2023-06-09T04:40:27.693 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQAZrYJkooeaIhAAMlbe2ux/81h5CzYjg+Ulsw== 2023-06-09T04:40:27.693 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.0] 2023-06-09T04:40:27.693 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQAdrYJkRss1JhAAcdLrgbERFQVCiEykWwPVPw== 2023-06-09T04:40:27.693 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.1] 2023-06-09T04:40:27.694 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQAgrYJkvHfvNBAASz7iQzBaI2LSpPqYEjbLAA== 2023-06-09T04:40:27.694 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.2] 2023-06-09T04:40:27.694 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQAkrYJk/WTmBhAAlrHI/fMDgRMA+2a4fTxW2w== 2023-06-09T04:40:27.694 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.3] 2023-06-09T04:40:27.694 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQAnrYJkcZyVFBAAlH7++y04LZmd2DKV1ZbYgQ== 2023-06-09T04:40:27.694 INFO:teuthology.orchestra.run.smithi089.stdout:[mgr.x] 2023-06-09T04:40:27.694 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQAZrYJkMv+HEBAAuyUeDIJdP2fkpuI+XkvVNw== 2023-06-09T04:40:27.694 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.b] 2023-06-09T04:40:27.695 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQAZrYJkvFH5KhAA4Pl4utP88ZxAE4zdkXdjjw== 2023-06-09T04:40:27.695 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.d] 2023-06-09T04:40:27.695 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQAZrYJkRA6kNRAACD2W4V91yXmgwVDZ5dQddA== 2023-06-09T04:40:27.695 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.4] 2023-06-09T04:40:27.695 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQAtrYJkWJvLKhAALJUSOqdOW7z4nLtu71072A== 2023-06-09T04:40:27.695 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.5] 2023-06-09T04:40:27.695 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQAwrYJkFdt8OBAAOcWVsLco9sD6WUxNxYuW/g== 2023-06-09T04:40:27.695 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.6] 2023-06-09T04:40:27.696 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQA0rYJkx2eRCRAA3KTwiARC9abe6rjN99Erew== 2023-06-09T04:40:27.696 INFO:teuthology.orchestra.run.smithi089.stdout:[osd.7] 2023-06-09T04:40:27.696 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQA3rYJkSsaGFxAAVncX4e/ABMEcJ4hqiqHZCg== 2023-06-09T04:40:27.696 INFO:teuthology.orchestra.run.smithi089.stdout:[client.0] 2023-06-09T04:40:27.696 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQAarYJkIa0DARAAVRIC7NMEOq/Qp+fO+wQe5w== 2023-06-09T04:40:27.696 INFO:teuthology.orchestra.run.smithi089.stdout:[client.2] 2023-06-09T04:40:27.696 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQAarYJksGznBhAAmyV0iiUHFGmesplmEY9tjw== 2023-06-09T04:40:27.697 INFO:teuthology.orchestra.run.smithi089.stdout:[client.1] 2023-06-09T04:40:27.697 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQAarYJkWbxgDRAA0769AOxjUqgFIfhLTSHVrw== 2023-06-09T04:40:27.697 INFO:teuthology.orchestra.run.smithi089.stdout:[client.3] 2023-06-09T04:40:27.697 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQAarYJktADAExAA2lvRbNjB4bH/EE8bL0rtGg== 2023-06-09T04:40:27.698 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-06-09T04:40:27.721 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-06-09T04:40:27.820 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-09T04:40:27.827 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-09T04:40:27.910 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-09T04:40:27.916 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-09T04:40:28.000 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T04:40:28.006 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T04:40:28.089 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T04:40:28.095 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T04:40:28.174 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T04:40:28.180 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T04:40:28.261 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T04:40:28.267 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T04:40:28.347 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-06-09T04:40:28.354 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-06-09T04:40:28.433 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-09T04:40:28.440 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-09T04:40:28.526 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-09T04:40:28.532 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-09T04:40:28.618 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T04:40:28.624 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T04:40:28.707 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T04:40:28.713 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T04:40:28.794 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T04:40:28.801 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T04:40:28.882 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T04:40:28.888 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-09T04:40:28.971 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-09T04:40:28.978 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-09T04:40:29.059 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-09T04:40:29.066 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-09T04:40:29.151 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-09T04:40:29.157 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-09T04:40:29.243 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-09T04:40:29.249 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-09T04:40:29.334 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-06-09T04:40:29.335 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-06-09T04:40:29.370 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-06-09T04:40:29.518 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-06-09T04:40:29.552 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-06-09T04:40:29.588 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-06-09T04:40:29.739 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-06-09T04:40:29.771 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-06-09T04:40:29.848 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-06-09T04:40:29.992 DEBUG:teuthology.orchestra.run.smithi089:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-06-09T04:40:30.025 DEBUG:teuthology.orchestra.run.smithi062:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-06-09T04:40:30.032 DEBUG:teuthology.orchestra.run.smithi089:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-06-09T04:40:30.082 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-06-09T04:40:30.083 INFO:tasks.ceph.mon.a:Restarting daemon 2023-06-09T04:40:30.083 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-06-09T04:40:30.093 INFO:tasks.ceph.mon.a:Started 2023-06-09T04:40:30.094 INFO:tasks.ceph.mon.b:Restarting daemon 2023-06-09T04:40:30.094 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-06-09T04:40:30.136 INFO:tasks.ceph.mon.b:Started 2023-06-09T04:40:30.137 INFO:tasks.ceph.mon.c:Restarting daemon 2023-06-09T04:40:30.137 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-06-09T04:40:30.141 INFO:tasks.ceph.mon.c:Started 2023-06-09T04:40:30.141 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-06-09T04:40:30.141 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-06-09T04:40:30.142 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-06-09T04:40:30.149 INFO:tasks.ceph.mgr.y:Started 2023-06-09T04:40:30.149 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-06-09T04:40:30.149 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-06-09T04:40:30.154 INFO:tasks.ceph.mgr.x:Started 2023-06-09T04:40:30.155 INFO:tasks.ceph:Setting crush tunables to default 2023-06-09T04:40:30.155 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd crush tunables default 2023-06-09T04:40:30.312 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.308+0000 7f53bd9aa700 1 Processor -- start 2023-06-09T04:40:30.312 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.308+0000 7f53bd9aa700 1 -- start start 2023-06-09T04:40:30.315 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.308+0000 7f53bd9aa700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f53b815c6e0 0x7f53b806a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:30.315 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.308+0000 7f53bd9aa700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53b815cb30 con 0x7f53b80b0f50 2023-06-09T04:40:30.315 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.308+0000 7f53bd9aa700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53b80ca110 con 0x7f53b806aa70 2023-06-09T04:40:30.316 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.308+0000 7f53bd9aa700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53b8069a50 con 0x7f53b815c6e0 2023-06-09T04:40:30.316 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.308+0000 7f53b6ffd700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f53b80b0f50 0x7f53b80c9930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:45666/0 (socket says 172.21.15.62:45666) 2023-06-09T04:40:30.316 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.312+0000 7f53b6ffd700 1 -- 172.21.15.62:0/4232673635 learned_addr learned my addr 172.21.15.62:0/4232673635 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:40:30.316 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.312+0000 7f53b67fc700 1 --2- 172.21.15.62:0/4232673635 >> v2:172.21.15.89:3300/0 conn(0x7f53b815c6e0 0x7f53b806a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:30.317 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.312+0000 7f53b67fc700 1 -- 172.21.15.62:0/4232673635 >> v2:172.21.15.89:3300/0 conn(0x7f53b815c6e0 msgr2=0x7f53b806a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-06-09T04:40:30.317 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.312+0000 7f53b67fc700 1 -- 172.21.15.62:0/4232673635 >> v2:172.21.15.89:3300/0 conn(0x7f53b815c6e0 msgr2=0x7f53b806a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-09T04:40:30.317 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.312+0000 7f53b67fc700 1 --2- 172.21.15.62:0/4232673635 >> v2:172.21.15.89:3300/0 conn(0x7f53b815c6e0 0x7f53b806a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-09T04:40:30.317 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.312+0000 7f53b67fc700 1 --2- 172.21.15.62:0/4232673635 >> v2:172.21.15.89:3300/0 conn(0x7f53b815c6e0 0x7f53b806a530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-06-09T04:40:30.495 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.488+0000 7f53b5ffb700 1 -- 172.21.15.62:0/4232673635 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 99880983 0 0) 0x7f53b815cb30 con 0x7f53b80b0f50 2023-06-09T04:40:30.495 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.488+0000 7f53b5ffb700 1 -- 172.21.15.62:0/4232673635 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53a00035d0 con 0x7f53b80b0f50 2023-06-09T04:40:30.496 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.492+0000 7f53b5ffb700 1 -- 172.21.15.62:0/4232673635 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2433078822 0 0) 0x7f53a00035d0 con 0x7f53b80b0f50 2023-06-09T04:40:30.496 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.492+0000 7f53b5ffb700 1 -- 172.21.15.62:0/4232673635 >> v2:172.21.15.89:3300/0 conn(0x7f53b815c6e0 msgr2=0x7f53b806a530 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-09T04:40:30.496 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.492+0000 7f53b5ffb700 1 --2- 172.21.15.62:0/4232673635 >> v2:172.21.15.89:3300/0 conn(0x7f53b815c6e0 0x7f53b806a530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:30.496 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.492+0000 7f53b5ffb700 1 -- 172.21.15.62:0/4232673635 >> v1:172.21.15.89:6789/0 conn(0x7f53b806aa70 legacy=0x7f53b80aeaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:30.497 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.492+0000 7f53b5ffb700 1 -- 172.21.15.62:0/4232673635 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53b8069d30 con 0x7f53b80b0f50 2023-06-09T04:40:30.497 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.492+0000 7f53b5ffb700 1 -- 172.21.15.62:0/4232673635 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 540845019 0 0) 0x7f53a8001670 con 0x7f53b80b0f50 2023-06-09T04:40:30.497 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.492+0000 7f53b5ffb700 1 -- 172.21.15.62:0/4232673635 >> v1:172.21.15.62:6789/0 conn(0x7f53b80b0f50 legacy=0x7f53b80c9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:30.497 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.492+0000 7f53b5ffb700 1 --2- 172.21.15.62:0/4232673635 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53a0003a20 0x7f53a0003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:30.497 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.492+0000 7f53b5ffb700 1 --2- 172.21.15.62:0/4232673635 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f53a0004870 0x7f53a0004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:30.498 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.492+0000 7f53b5ffb700 1 --2- 172.21.15.62:0/4232673635 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53a0005220 0x7f53a000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:30.498 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.492+0000 7f53b5ffb700 1 -- 172.21.15.62:0/4232673635 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53b8069a50 con 0x7f53a0004870 2023-06-09T04:40:30.498 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.492+0000 7f53b5ffb700 1 -- 172.21.15.62:0/4232673635 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a000c1b0 con 0x7f53a0003a20 2023-06-09T04:40:30.498 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.492+0000 7f53b5ffb700 1 -- 172.21.15.62:0/4232673635 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53a000c370 con 0x7f53a0005220 2023-06-09T04:40:30.498 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.492+0000 7f53b6ffd700 1 --2- 172.21.15.62:0/4232673635 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53a0003a20 0x7f53a0003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:30.498 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.492+0000 7f53b67fc700 1 --2- 172.21.15.62:0/4232673635 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f53a0004870 0x7f53a0004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:30.499 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.492+0000 7f53b77fe700 1 --2- 172.21.15.62:0/4232673635 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53a0005220 0x7f53a000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:30.499 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.492+0000 7f53b6ffd700 1 -- 172.21.15.62:0/4232673635 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53a0005220 msgr2=0x7f53a000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:40:30.499 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.492+0000 7f53b6ffd700 1 --2- 172.21.15.62:0/4232673635 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53a0005220 0x7f53a000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:30.500 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.492+0000 7f53b6ffd700 1 -- 172.21.15.62:0/4232673635 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f53a0004870 msgr2=0x7f53a0004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:40:30.500 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.492+0000 7f53b6ffd700 1 --2- 172.21.15.62:0/4232673635 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f53a0004870 0x7f53a0004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:30.500 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.492+0000 7f53b6ffd700 1 -- 172.21.15.62:0/4232673635 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53a00035d0 con 0x7f53a0003a20 2023-06-09T04:40:30.500 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.492+0000 7f53b77fe700 1 --2- 172.21.15.62:0/4232673635 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53a0005220 0x7f53a000ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:40:30.500 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.492+0000 7f53b77fe700 1 -- 172.21.15.62:0/4232673635 reap_dead start 2023-06-09T04:40:30.500 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.492+0000 7f53b6ffd700 1 --2- 172.21.15.62:0/4232673635 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53a0003a20 0x7f53a0003e30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f53a800c2f0 tx=0x7f53a00058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76facb033a633bcd server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:30.500 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.492+0000 7f53b5ffb700 1 -- 172.21.15.62:0/4232673635 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a8007c30 con 0x7f53a0003a20 2023-06-09T04:40:30.501 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.492+0000 7f53b5ffb700 1 -- 172.21.15.62:0/4232673635 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53a800ce50 con 0x7f53a0003a20 2023-06-09T04:40:30.501 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.492+0000 7f53b5ffb700 1 -- 172.21.15.62:0/4232673635 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a8005bc0 con 0x7f53a0003a20 2023-06-09T04:40:30.501 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.496+0000 7f53bd9aa700 1 -- 172.21.15.62:0/4232673635 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53a0003a20 msgr2=0x7f53a0003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:30.502 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.496+0000 7f53bd9aa700 1 --2- 172.21.15.62:0/4232673635 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53a0003a20 0x7f53a0003e30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f53a800c2f0 tx=0x7f53a00058a0 comp rx=0 tx=0).stop 2023-06-09T04:40:30.502 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.496+0000 7f53bd9aa700 1 -- 172.21.15.62:0/4232673635 shutdown_connections 2023-06-09T04:40:30.502 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.496+0000 7f53bd9aa700 1 --2- 172.21.15.62:0/4232673635 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53a0003a20 0x7f53a0003e30 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:30.502 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.496+0000 7f53bd9aa700 1 -- 172.21.15.62:0/4232673635 >> 172.21.15.62:0/4232673635 conn(0x7f53b80ce830 msgr2=0x7f53b80cec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:40:30.502 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.496+0000 7f53bd9aa700 1 -- 172.21.15.62:0/4232673635 shutdown_connections 2023-06-09T04:40:30.502 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.496+0000 7f53bd9aa700 1 -- 172.21.15.62:0/4232673635 wait complete. 2023-06-09T04:40:30.505 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.500+0000 7f53bd9aa700 1 Processor -- start 2023-06-09T04:40:30.506 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.500+0000 7f53bd9aa700 1 -- start start 2023-06-09T04:40:30.507 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.504+0000 7f53bd9aa700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53a0003a20 0x7f53b81f5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:30.508 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.504+0000 7f53bd9aa700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f53b81435a0 0x7f53b81f1160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:30.508 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.504+0000 7f53bd9aa700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53b81f16a0 0x7f53b815bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:30.508 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.504+0000 7f53bd9aa700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53b81f1c40 con 0x7f53b81435a0 2023-06-09T04:40:30.508 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.504+0000 7f53bd9aa700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53b81f1f20 con 0x7f53b81f16a0 2023-06-09T04:40:30.508 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.504+0000 7f53bd9aa700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53b81f4930 con 0x7f53a0003a20 2023-06-09T04:40:30.508 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.504+0000 7f53b67fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f53b81435a0 0x7f53b81f1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:30.509 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.504+0000 7f53b67fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f53b81435a0 0x7f53b81f1160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:58486/0 (socket says 172.21.15.62:58486) 2023-06-09T04:40:30.509 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.504+0000 7f53b6ffd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53a0003a20 0x7f53b81f5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:30.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.504+0000 7f53b67fc700 1 -- 172.21.15.62:0/3502357530 learned_addr learned my addr 172.21.15.62:0/3502357530 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:40:30.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.504+0000 7f53b77fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53b81f16a0 0x7f53b815bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:30.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.504+0000 7f53b67fc700 1 -- 172.21.15.62:0/3502357530 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53a0003a20 msgr2=0x7f53b81f5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:30.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.504+0000 7f53b67fc700 1 --2- 172.21.15.62:0/3502357530 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53a0003a20 0x7f53b81f5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:30.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.504+0000 7f53b67fc700 1 -- 172.21.15.62:0/3502357530 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53b81f16a0 msgr2=0x7f53b815bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:30.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.504+0000 7f53b67fc700 1 --2- 172.21.15.62:0/3502357530 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53b81f16a0 0x7f53b815bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:30.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.504+0000 7f53b67fc700 1 -- 172.21.15.62:0/3502357530 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53b80ca570 con 0x7f53b81435a0 2023-06-09T04:40:30.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.504+0000 7f53b67fc700 1 --2- 172.21.15.62:0/3502357530 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f53b81435a0 0x7f53b81f1160 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f53ac0115d0 tx=0x7f53ac0118e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:30.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.504+0000 7f539ffff700 1 -- 172.21.15.62:0/3502357530 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ac00c070 con 0x7f53b81435a0 2023-06-09T04:40:30.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.504+0000 7f539ffff700 1 -- 172.21.15.62:0/3502357530 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53ac015870 con 0x7f53b81435a0 2023-06-09T04:40:30.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.504+0000 7f53bd9aa700 1 -- 172.21.15.62:0/3502357530 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53b81f4c10 con 0x7f53b81435a0 2023-06-09T04:40:30.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.504+0000 7f539ffff700 1 -- 172.21.15.62:0/3502357530 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ac015c20 con 0x7f53b81435a0 2023-06-09T04:40:30.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.504+0000 7f53bd9aa700 1 -- 172.21.15.62:0/3502357530 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53b81f5670 con 0x7f53b81435a0 2023-06-09T04:40:30.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.504+0000 7f539ffff700 1 -- 172.21.15.62:0/3502357530 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f53ac01e450 con 0x7f53b81435a0 2023-06-09T04:40:30.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.504+0000 7f539ffff700 1 -- 172.21.15.62:0/3502357530 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f53ac014720 con 0x7f53b81435a0 2023-06-09T04:40:30.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.508+0000 7f53bd9aa700 1 -- 172.21.15.62:0/3502357530 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53b81f4770 con 0x7f53b81435a0 2023-06-09T04:40:30.517 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.512+0000 7f539ffff700 1 -- 172.21.15.62:0/3502357530 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f53ac023060 con 0x7f53b81435a0 2023-06-09T04:40:30.690 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.684+0000 7f53bd9aa700 1 -- 172.21.15.62:0/3502357530 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f53b81f4da0 con 0x7f53b81435a0 2023-06-09T04:40:30.700 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.696+0000 7f539ffff700 1 -- 172.21.15.62:0/3502357530 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f53ac019070 con 0x7f53b81435a0 2023-06-09T04:40:30.702 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.696+0000 7f53bd9aa700 1 -- 172.21.15.62:0/3502357530 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f53b81435a0 msgr2=0x7f53b81f1160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:30.702 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.696+0000 7f53bd9aa700 1 --2- 172.21.15.62:0/3502357530 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f53b81435a0 0x7f53b81f1160 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f53ac0115d0 tx=0x7f53ac0118e0 comp rx=0 tx=0).stop 2023-06-09T04:40:30.702 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.696+0000 7f53bd9aa700 1 -- 172.21.15.62:0/3502357530 shutdown_connections 2023-06-09T04:40:30.702 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.696+0000 7f53bd9aa700 1 --2- 172.21.15.62:0/3502357530 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53b81f16a0 0x7f53b815bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:30.702 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.696+0000 7f53bd9aa700 1 --2- 172.21.15.62:0/3502357530 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f53b81435a0 0x7f53b81f1160 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:30.702 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.696+0000 7f53bd9aa700 1 --2- 172.21.15.62:0/3502357530 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f53a0003a20 0x7f53b81f5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:30.703 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.696+0000 7f53bd9aa700 1 -- 172.21.15.62:0/3502357530 >> 172.21.15.62:0/3502357530 conn(0x7f53b80ce830 msgr2=0x7f53b80cd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:40:30.703 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.696+0000 7f53bd9aa700 1 -- 172.21.15.62:0/3502357530 shutdown_connections 2023-06-09T04:40:30.703 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:30.696+0000 7f53bd9aa700 1 -- 172.21.15.62:0/3502357530 wait complete. 2023-06-09T04:40:30.704 INFO:teuthology.orchestra.run.smithi062.stderr:adjusted tunables profile to default 2023-06-09T04:40:30.724 INFO:tasks.ceph:check_enable_crimson: False 2023-06-09T04:40:30.724 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-06-09T04:40:30.724 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-06-09T04:40:30.725 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-06-09T04:40:30.754 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-06-09T04:40:30.754+0000 7f1ef18002c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-06-09T04:40:30.757 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-06-09T04:40:30.757 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-06-09T04:40:30.758 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-06-09T04:40:30.752+0000 7f5964e692c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-06-09T04:40:30.791 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-06-09T04:40:30.791 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-06-09T04:40:30.869 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-06-09T04:40:30.869 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-06-09T04:40:30.943 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-06-09T04:40:30.943 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-06-09T04:40:30.975 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-06-09T04:40:30.975 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-06-09T04:40:31.049 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-06-09T04:40:31.049 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-06-09T04:40:31.123 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-06-09T04:40:31.123 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-06-09T04:40:31.198 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new bc50bbc0-dd08-42ed-804c-ec3029e36c19 0 2023-06-09T04:40:31.399 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.398+0000 7f57d5386700 1 Processor -- start 2023-06-09T04:40:31.400 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.398+0000 7f57d5386700 1 -- start start 2023-06-09T04:40:31.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.398+0000 7f57d5386700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f57d0071730 0x7f57d006f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:31.402 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.398+0000 7f57d5386700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f57d00b0260 0x7f57d00c8720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:31.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.402+0000 7f57d5386700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57d015d860 con 0x7f57d00ca1c0 2023-06-09T04:40:31.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.402+0000 7f57d5386700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57d0071b00 con 0x7f57d00b0260 2023-06-09T04:40:31.403 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.402+0000 7f57d5386700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57d015dab0 con 0x7f57d0071730 2023-06-09T04:40:31.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.402+0000 7f57ceffd700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f57d0071730 0x7f57d006f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:31.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.402+0000 7f57ceffd700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f57d0071730 0x7f57d006f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34460/0 (socket says 172.21.15.89:34460) 2023-06-09T04:40:31.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.402+0000 7f57ceffd700 1 -- 172.21.15.89:0/715179971 learned_addr learned my addr 172.21.15.89:0/715179971 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-06-09T04:40:31.404 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.402+0000 7f57cf7fe700 1 --2- 172.21.15.89:0/715179971 >> v2:172.21.15.62:3300/0 conn(0x7f57d00b0260 0x7f57d00c8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:31.405 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.402+0000 7f57ceffd700 1 -- 172.21.15.89:0/715179971 >> v2:172.21.15.62:3300/0 conn(0x7f57d00b0260 msgr2=0x7f57d00c8720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:40:31.405 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.402+0000 7f57ceffd700 1 --2- 172.21.15.89:0/715179971 >> v2:172.21.15.62:3300/0 conn(0x7f57d00b0260 0x7f57d00c8720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:31.405 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.402+0000 7f57ceffd700 1 -- 172.21.15.89:0/715179971 >> v1:172.21.15.62:6789/0 conn(0x7f57d00ca1c0 legacy=0x7f57d00afb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:40:31.405 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.402+0000 7f57ceffd700 1 -- 172.21.15.89:0/715179971 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57d015dd90 con 0x7f57d0071730 2023-06-09T04:40:31.405 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.402+0000 7f57ceffd700 1 --2- 172.21.15.89:0/715179971 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57d0071730 0x7f57d006f610 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f57d0071d00 tx=0x7f57c0009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b188bbac499248a9 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:31.405 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.402+0000 7f57cdffb700 1 -- 172.21.15.89:0/715179971 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c0004230 con 0x7f57d0071730 2023-06-09T04:40:31.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.402+0000 7f57cdffb700 1 -- 172.21.15.89:0/715179971 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57c0004390 con 0x7f57d0071730 2023-06-09T04:40:31.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.402+0000 7f57cdffb700 1 -- 172.21.15.89:0/715179971 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c00036c0 con 0x7f57d0071730 2023-06-09T04:40:31.406 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.402+0000 7f57d5386700 1 -- 172.21.15.89:0/715179971 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57d0071730 msgr2=0x7f57d006f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:31.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.402+0000 7f57d5386700 1 --2- 172.21.15.89:0/715179971 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57d0071730 0x7f57d006f610 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f57d0071d00 tx=0x7f57c0009bf0 comp rx=0 tx=0).stop 2023-06-09T04:40:31.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.402+0000 7f57d5386700 1 -- 172.21.15.89:0/715179971 shutdown_connections 2023-06-09T04:40:31.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.402+0000 7f57d5386700 1 --2- 172.21.15.89:0/715179971 >> v2:172.21.15.62:3300/0 conn(0x7f57d00b0260 0x7f57d00c8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:31.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.402+0000 7f57d5386700 1 --2- 172.21.15.89:0/715179971 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57d0071730 0x7f57d006f610 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:31.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.402+0000 7f57d5386700 1 -- 172.21.15.89:0/715179971 >> 172.21.15.89:0/715179971 conn(0x7f57d00cab50 msgr2=0x7f57d00caf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:40:31.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.402+0000 7f57d5386700 1 -- 172.21.15.89:0/715179971 shutdown_connections 2023-06-09T04:40:31.407 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.402+0000 7f57d5386700 1 -- 172.21.15.89:0/715179971 wait complete. 2023-06-09T04:40:31.408 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.406+0000 7f57d5386700 1 Processor -- start 2023-06-09T04:40:31.409 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.406+0000 7f57d5386700 1 -- start start 2023-06-09T04:40:31.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.406+0000 7f57d5386700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f57d0071730 0x7f57d00c6840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:31.410 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.406+0000 7f57d5386700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57d00b0260 0x7f57d015b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:31.411 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.406+0000 7f57d5386700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f57d00ca1c0 0x7f57d014f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:31.411 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.406+0000 7f57d5386700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57d00c7b50 con 0x7f57d0071730 2023-06-09T04:40:31.411 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.406+0000 7f57d5386700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57d014f790 con 0x7f57d00b0260 2023-06-09T04:40:31.411 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.406+0000 7f57d5386700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57d00c6f40 con 0x7f57d00ca1c0 2023-06-09T04:40:31.412 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.410+0000 7f57cf7fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f57d00ca1c0 0x7f57d014f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:31.412 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.410+0000 7f57ce7fc700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57d00b0260 0x7f57d015b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:31.412 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.410+0000 7f57cf7fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f57d00ca1c0 0x7f57d014f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:44186/0 (socket says 172.21.15.89:44186) 2023-06-09T04:40:31.413 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.410+0000 7f57ce7fc700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57d00b0260 0x7f57d015b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34464/0 (socket says 172.21.15.89:34464) 2023-06-09T04:40:31.413 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.410+0000 7f57cf7fe700 1 -- 172.21.15.89:0/3991820555 learned_addr learned my addr 172.21.15.89:0/3991820555 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-06-09T04:40:31.413 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.410+0000 7f57ceffd700 1 --2- 172.21.15.89:0/3991820555 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f57d0071730 0x7f57d00c6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:31.413 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.410+0000 7f57ce7fc700 1 -- 172.21.15.89:0/3991820555 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f57d00ca1c0 msgr2=0x7f57d014f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:31.413 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.410+0000 7f57ce7fc700 1 --2- 172.21.15.89:0/3991820555 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f57d00ca1c0 0x7f57d014f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:31.413 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.410+0000 7f57ce7fc700 1 -- 172.21.15.89:0/3991820555 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f57d0071730 msgr2=0x7f57d00c6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:31.413 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.410+0000 7f57ce7fc700 1 --2- 172.21.15.89:0/3991820555 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f57d0071730 0x7f57d00c6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:31.413 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.410+0000 7f57ce7fc700 1 -- 172.21.15.89:0/3991820555 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c0009570 con 0x7f57d00b0260 2023-06-09T04:40:31.414 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.410+0000 7f57ce7fc700 1 --2- 172.21.15.89:0/3991820555 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57d00b0260 0x7f57d015b890 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f57c400c400 tx=0x7f57c400c710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:31.414 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.410+0000 7f57b77fe700 1 -- 172.21.15.89:0/3991820555 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c40054e0 con 0x7f57d00b0260 2023-06-09T04:40:31.414 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.410+0000 7f57b77fe700 1 -- 172.21.15.89:0/3991820555 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57c400ce10 con 0x7f57d00b0260 2023-06-09T04:40:31.414 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.410+0000 7f57b77fe700 1 -- 172.21.15.89:0/3991820555 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c40038e0 con 0x7f57d00b0260 2023-06-09T04:40:31.414 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.410+0000 7f57d5386700 1 -- 172.21.15.89:0/3991820555 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57d00c7220 con 0x7f57d00b0260 2023-06-09T04:40:31.415 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.410+0000 7f57d5386700 1 -- 172.21.15.89:0/3991820555 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57d00c77e0 con 0x7f57d00b0260 2023-06-09T04:40:31.415 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.410+0000 7f57b77fe700 1 -- 172.21.15.89:0/3991820555 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f57c4003d40 con 0x7f57d00b0260 2023-06-09T04:40:31.415 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.410+0000 7f57b77fe700 1 -- 172.21.15.89:0/3991820555 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f57c40072f0 con 0x7f57d00b0260 2023-06-09T04:40:31.415 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.410+0000 7f57d5386700 1 -- 172.21.15.89:0/3991820555 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57d00c7cc0 con 0x7f57d00b0260 2023-06-09T04:40:31.419 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.418+0000 7f57b77fe700 1 -- 172.21.15.89:0/3991820555 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f57c4017070 con 0x7f57d00b0260 2023-06-09T04:40:31.447 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-06-09T04:40:31.446+0000 7f1ef18002c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-06-09T04:40:31.495 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-06-09T04:40:31.488+0000 7f5964e692c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-06-09T04:40:31.497 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.494+0000 7f57d5386700 1 -- 172.21.15.89:0/3991820555 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd new", "uuid": "bc50bbc0-dd08-42ed-804c-ec3029e36c19", "id": 0} v 0) v1 -- 0x7f57d00739c0 con 0x7f57d00b0260 2023-06-09T04:40:31.510 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.506+0000 7f57b77fe700 1 -- 172.21.15.89:0/3991820555 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bc50bbc0-dd08-42ed-804c-ec3029e36c19", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f57c4007640 con 0x7f57d00b0260 2023-06-09T04:40:31.510 INFO:teuthology.orchestra.run.smithi089.stdout:0 2023-06-09T04:40:31.512 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.510+0000 7f57d5386700 1 -- 172.21.15.89:0/3991820555 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57d00b0260 msgr2=0x7f57d015b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:31.512 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.510+0000 7f57d5386700 1 --2- 172.21.15.89:0/3991820555 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57d00b0260 0x7f57d015b890 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f57c400c400 tx=0x7f57c400c710 comp rx=0 tx=0).stop 2023-06-09T04:40:31.512 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.510+0000 7f57d5386700 1 -- 172.21.15.89:0/3991820555 shutdown_connections 2023-06-09T04:40:31.512 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.510+0000 7f57d5386700 1 --2- 172.21.15.89:0/3991820555 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f57d00ca1c0 0x7f57d014f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:31.512 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.510+0000 7f57d5386700 1 --2- 172.21.15.89:0/3991820555 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57d00b0260 0x7f57d015b890 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:31.513 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.510+0000 7f57d5386700 1 --2- 172.21.15.89:0/3991820555 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f57d0071730 0x7f57d00c6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:31.513 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.510+0000 7f57d5386700 1 -- 172.21.15.89:0/3991820555 >> 172.21.15.89:0/3991820555 conn(0x7f57d00cab50 msgr2=0x7f57d00caf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:40:31.513 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.510+0000 7f57d5386700 1 -- 172.21.15.89:0/3991820555 shutdown_connections 2023-06-09T04:40:31.513 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.510+0000 7f57d5386700 1 -- 172.21.15.89:0/3991820555 wait complete. 2023-06-09T04:40:31.526 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-06-09T04:40:31.526+0000 7f1ef18002c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-06-09T04:40:31.532 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new 8230b12d-e22f-4985-a584-4cc64404cdbf 1 2023-06-09T04:40:31.578 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-06-09T04:40:31.572+0000 7f5964e692c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-06-09T04:40:31.690 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.690+0000 7fc5d11eb700 1 Processor -- start 2023-06-09T04:40:31.691 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.690+0000 7fc5d11eb700 1 -- start start 2023-06-09T04:40:31.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.690+0000 7fc5d11eb700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc5cc0b3f00 0x7fc5cc06b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:31.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.690+0000 7fc5d11eb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5cc0d0660 0x7fc5cc0d0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:31.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.690+0000 7fc5d11eb700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5cc0cf630 con 0x7fc5cc0cf1e0 2023-06-09T04:40:31.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.690+0000 7fc5d11eb700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5cc0d0210 con 0x7fc5cc0b3f00 2023-06-09T04:40:31.693 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.690+0000 7fc5d11eb700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5cc0cf870 con 0x7fc5cc0d0660 2023-06-09T04:40:31.694 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.690+0000 7fc5cbfff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc5cc0b3f00 0x7fc5cc06b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:31.694 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.690+0000 7fc5d09ea700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5cc0d0660 0x7fc5cc0d0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:31.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.690+0000 7fc5cbfff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc5cc0b3f00 0x7fc5cc06b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34472/0 (socket says 172.21.15.89:34472) 2023-06-09T04:40:31.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.690+0000 7fc5cbfff700 1 -- 172.21.15.89:0/4039207239 learned_addr learned my addr 172.21.15.89:0/4039207239 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-06-09T04:40:31.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.690+0000 7fc5cb7fe700 1 --1- 172.21.15.89:0/4039207239 >> v1:172.21.15.62:6789/0 conn(0x7fc5cc0cf1e0 0x7fc5cc0b42d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.89:49028/0 (socket says 172.21.15.89:49028) 2023-06-09T04:40:31.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.690+0000 7fc5cbfff700 1 -- 172.21.15.89:0/4039207239 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5cc0d0660 msgr2=0x7fc5cc0d0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:40:31.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.690+0000 7fc5cbfff700 1 --2- 172.21.15.89:0/4039207239 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5cc0d0660 0x7fc5cc0d0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:31.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.690+0000 7fc5cbfff700 1 -- 172.21.15.89:0/4039207239 >> v1:172.21.15.62:6789/0 conn(0x7fc5cc0cf1e0 legacy=0x7fc5cc0b42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:31.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.694+0000 7fc5caffd700 1 -- 172.21.15.89:0/4039207239 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 776855288 0 0) 0x7fc5c0001110 con 0x7fc5cc0cf1e0 2023-06-09T04:40:31.695 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.694+0000 7fc5cbfff700 1 -- 172.21.15.89:0/4039207239 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5cc0b4da0 con 0x7fc5cc0b3f00 2023-06-09T04:40:31.696 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.694+0000 7fc5cbfff700 1 --2- 172.21.15.89:0/4039207239 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5cc0b3f00 0x7fc5cc06b510 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc009910 tx=0x7fc5bc009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ca6c4ad5eda642a server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:31.696 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.694+0000 7fc5caffd700 1 -- 172.21.15.89:0/4039207239 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5bc011830 con 0x7fc5cc0b3f00 2023-06-09T04:40:31.697 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.694+0000 7fc5caffd700 1 -- 172.21.15.89:0/4039207239 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5bc011990 con 0x7fc5cc0b3f00 2023-06-09T04:40:31.697 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.694+0000 7fc5caffd700 1 -- 172.21.15.89:0/4039207239 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5bc011d40 con 0x7fc5cc0b3f00 2023-06-09T04:40:31.697 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.694+0000 7fc5d11eb700 1 -- 172.21.15.89:0/4039207239 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5cc0b3f00 msgr2=0x7fc5cc06b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:31.697 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.694+0000 7fc5d11eb700 1 --2- 172.21.15.89:0/4039207239 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5cc0b3f00 0x7fc5cc06b510 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc009910 tx=0x7fc5bc009c20 comp rx=0 tx=0).stop 2023-06-09T04:40:31.697 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.694+0000 7fc5d11eb700 1 -- 172.21.15.89:0/4039207239 shutdown_connections 2023-06-09T04:40:31.698 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.694+0000 7fc5d11eb700 1 --2- 172.21.15.89:0/4039207239 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5cc0d0660 0x7fc5cc0d0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:31.698 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.694+0000 7fc5d11eb700 1 --2- 172.21.15.89:0/4039207239 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5cc0b3f00 0x7fc5cc06b510 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:31.698 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.694+0000 7fc5d11eb700 1 -- 172.21.15.89:0/4039207239 >> 172.21.15.89:0/4039207239 conn(0x7fc5cc070f20 msgr2=0x7fc5cc071320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:40:31.698 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.694+0000 7fc5d11eb700 1 -- 172.21.15.89:0/4039207239 shutdown_connections 2023-06-09T04:40:31.698 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.694+0000 7fc5d11eb700 1 -- 172.21.15.89:0/4039207239 wait complete. 2023-06-09T04:40:31.699 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.698+0000 7fc5d11eb700 1 Processor -- start 2023-06-09T04:40:31.699 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.698+0000 7fc5d11eb700 1 -- start start 2023-06-09T04:40:31.700 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.698+0000 7fc5d11eb700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5cc0b3f00 0x7fc5cc15ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:31.700 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.698+0000 7fc5d11eb700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5cc0cf1e0 0x7fc5cc1589f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:31.700 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.698+0000 7fc5d11eb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5cc0d0660 0x7fc5cc1e5660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:31.700 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.698+0000 7fc5d11eb700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5cc0c6c70 con 0x7fc5cc0b3f00 2023-06-09T04:40:31.700 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.698+0000 7fc5d11eb700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5cc1e6630 con 0x7fc5cc0cf1e0 2023-06-09T04:40:31.701 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.698+0000 7fc5d11eb700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5cc0c6f10 con 0x7fc5cc0d0660 2023-06-09T04:40:31.702 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.698+0000 7fc5d09ea700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5cc0d0660 0x7fc5cc1e5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:31.702 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.698+0000 7fc5cb7fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5cc0cf1e0 0x7fc5cc1589f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:31.702 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.698+0000 7fc5d09ea700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5cc0d0660 0x7fc5cc1e5660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:44208/0 (socket says 172.21.15.89:44208) 2023-06-09T04:40:31.702 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.698+0000 7fc5d09ea700 1 -- 172.21.15.89:0/4231164743 learned_addr learned my addr 172.21.15.89:0/4231164743 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-06-09T04:40:31.702 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.698+0000 7fc5cbfff700 1 --2- 172.21.15.89:0/4231164743 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5cc0b3f00 0x7fc5cc15ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:31.702 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.698+0000 7fc5d09ea700 1 -- 172.21.15.89:0/4231164743 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5cc0cf1e0 msgr2=0x7fc5cc1589f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:31.702 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.698+0000 7fc5d09ea700 1 --2- 172.21.15.89:0/4231164743 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5cc0cf1e0 0x7fc5cc1589f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:31.703 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.698+0000 7fc5d09ea700 1 -- 172.21.15.89:0/4231164743 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5cc0b3f00 msgr2=0x7fc5cc15ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:31.703 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.698+0000 7fc5d09ea700 1 --2- 172.21.15.89:0/4231164743 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5cc0b3f00 0x7fc5cc15ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:31.703 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.698+0000 7fc5d09ea700 1 -- 172.21.15.89:0/4231164743 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5bc009570 con 0x7fc5cc0d0660 2023-06-09T04:40:31.703 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.698+0000 7fc5d09ea700 1 --2- 172.21.15.89:0/4231164743 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5cc0d0660 0x7fc5cc1e5660 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc5c400efc0 tx=0x7fc5c400c0c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:31.703 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.698+0000 7fc5c8ff9700 1 -- 172.21.15.89:0/4231164743 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c400cad0 con 0x7fc5cc0d0660 2023-06-09T04:40:31.703 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.698+0000 7fc5c8ff9700 1 -- 172.21.15.89:0/4231164743 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5c400f040 con 0x7fc5cc0d0660 2023-06-09T04:40:31.703 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.698+0000 7fc5d11eb700 1 -- 172.21.15.89:0/4231164743 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5cc0c71f0 con 0x7fc5cc0d0660 2023-06-09T04:40:31.704 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.698+0000 7fc5c8ff9700 1 -- 172.21.15.89:0/4231164743 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c400ce70 con 0x7fc5cc0d0660 2023-06-09T04:40:31.704 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.698+0000 7fc5d11eb700 1 -- 172.21.15.89:0/4231164743 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5cc158f30 con 0x7fc5cc0d0660 2023-06-09T04:40:31.704 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.698+0000 7fc5c8ff9700 1 -- 172.21.15.89:0/4231164743 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc5c4014780 con 0x7fc5cc0d0660 2023-06-09T04:40:31.704 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.698+0000 7fc5c8ff9700 1 -- 172.21.15.89:0/4231164743 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fc5c401dd30 con 0x7fc5cc0d0660 2023-06-09T04:40:31.704 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.702+0000 7fc5d11eb700 1 -- 172.21.15.89:0/4231164743 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5cc0c7710 con 0x7fc5cc0d0660 2023-06-09T04:40:31.707 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.706+0000 7fc5c8ff9700 1 -- 172.21.15.89:0/4231164743 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fc5cc0c7710 con 0x7fc5cc0d0660 2023-06-09T04:40:31.715 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-06-09T04:40:31.714+0000 7f1ef18002c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-06-09T04:40:31.758 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-06-09T04:40:31.752+0000 7f5964e692c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-06-09T04:40:31.780 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.778+0000 7fc5d11eb700 1 -- 172.21.15.89:0/4231164743 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd new", "uuid": "8230b12d-e22f-4985-a584-4cc64404cdbf", "id": 1} v 0) v1 -- 0x7fc5cc0739c0 con 0x7fc5cc0d0660 2023-06-09T04:40:31.788 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.786+0000 7fc5c8ff9700 1 -- 172.21.15.89:0/4231164743 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8230b12d-e22f-4985-a584-4cc64404cdbf", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc5c4018020 con 0x7fc5cc0d0660 2023-06-09T04:40:31.788 INFO:teuthology.orchestra.run.smithi089.stdout:1 2023-06-09T04:40:31.790 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.786+0000 7fc5d11eb700 1 -- 172.21.15.89:0/4231164743 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5cc0d0660 msgr2=0x7fc5cc1e5660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:31.790 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.786+0000 7fc5d11eb700 1 --2- 172.21.15.89:0/4231164743 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5cc0d0660 0x7fc5cc1e5660 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc5c400efc0 tx=0x7fc5c400c0c0 comp rx=0 tx=0).stop 2023-06-09T04:40:31.790 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.786+0000 7fc5d11eb700 1 -- 172.21.15.89:0/4231164743 shutdown_connections 2023-06-09T04:40:31.790 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.786+0000 7fc5d11eb700 1 --2- 172.21.15.89:0/4231164743 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5cc0d0660 0x7fc5cc1e5660 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:31.790 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.786+0000 7fc5d11eb700 1 --2- 172.21.15.89:0/4231164743 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5cc0cf1e0 0x7fc5cc1589f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:31.790 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.786+0000 7fc5d11eb700 1 --2- 172.21.15.89:0/4231164743 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5cc0b3f00 0x7fc5cc15ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:31.791 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.786+0000 7fc5d11eb700 1 -- 172.21.15.89:0/4231164743 >> 172.21.15.89:0/4231164743 conn(0x7fc5cc070f20 msgr2=0x7fc5cc0d1330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:40:31.791 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.786+0000 7fc5d11eb700 1 -- 172.21.15.89:0/4231164743 shutdown_connections 2023-06-09T04:40:31.791 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.786+0000 7fc5d11eb700 1 -- 172.21.15.89:0/4231164743 wait complete. 2023-06-09T04:40:31.808 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new d0202506-dbe9-4e3c-9271-687929abf96a 2 2023-06-09T04:40:31.971 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.970+0000 7f863ecaa700 1 Processor -- start 2023-06-09T04:40:31.971 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.970+0000 7f863ecaa700 1 -- start start 2023-06-09T04:40:31.973 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.970+0000 7f863ecaa700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f863806ac50 0x7f86380d2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:31.973 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.970+0000 7f863ecaa700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86380cce90 con 0x7f86380cd320 2023-06-09T04:40:31.973 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.970+0000 7f863ecaa700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f863806bb60 con 0x7f86380d0270 2023-06-09T04:40:31.973 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.970+0000 7f863ecaa700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f863815c720 con 0x7f863806ac50 2023-06-09T04:40:31.974 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.970+0000 7f8637fff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f863806ac50 0x7f86380d2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:31.974 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.970+0000 7f863ca46700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f86380d0270 0x7f86380d0640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:39498/0 (socket says 172.21.15.89:39498) 2023-06-09T04:40:31.974 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.970+0000 7f863ca46700 1 -- 172.21.15.89:0/1473995130 learned_addr learned my addr 172.21.15.89:0/1473995130 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-06-09T04:40:31.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.970+0000 7f8637fff700 1 -- 172.21.15.89:0/1473995130 >> v1:172.21.15.89:6789/0 conn(0x7f86380d0270 legacy=0x7f86380d0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:31.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.970+0000 7f8637fff700 1 -- 172.21.15.89:0/1473995130 >> v1:172.21.15.62:6789/0 conn(0x7f86380cd320 legacy=0x7f86380cd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:31.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.970+0000 7f8637fff700 1 -- 172.21.15.89:0/1473995130 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86380b1e90 con 0x7f863806ac50 2023-06-09T04:40:31.975 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.974+0000 7f8637fff700 1 --2- 172.21.15.89:0/1473995130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f863806ac50 0x7f86380d2220 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8624009850 tx=0x7f8624009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1fa3d51ffb6b5d5b server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:31.976 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.974+0000 7f86377fe700 1 -- 172.21.15.89:0/1473995130 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8624011830 con 0x7f863806ac50 2023-06-09T04:40:31.976 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.974+0000 7f86377fe700 1 -- 172.21.15.89:0/1473995130 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8624011990 con 0x7f863806ac50 2023-06-09T04:40:31.976 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.974+0000 7f86377fe700 1 -- 172.21.15.89:0/1473995130 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8624011d20 con 0x7f863806ac50 2023-06-09T04:40:31.976 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.974+0000 7f863ecaa700 1 -- 172.21.15.89:0/1473995130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f863806ac50 msgr2=0x7f86380d2220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:31.976 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.974+0000 7f863ecaa700 1 --2- 172.21.15.89:0/1473995130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f863806ac50 0x7f86380d2220 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8624009850 tx=0x7f8624009b60 comp rx=0 tx=0).stop 2023-06-09T04:40:31.977 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.974+0000 7f863ecaa700 1 -- 172.21.15.89:0/1473995130 shutdown_connections 2023-06-09T04:40:31.977 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.974+0000 7f863ecaa700 1 --2- 172.21.15.89:0/1473995130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f863806ac50 0x7f86380d2220 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:31.977 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.974+0000 7f863ecaa700 1 -- 172.21.15.89:0/1473995130 >> 172.21.15.89:0/1473995130 conn(0x7f8638089fc0 msgr2=0x7f863809b950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:40:31.977 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.974+0000 7f863ecaa700 1 -- 172.21.15.89:0/1473995130 shutdown_connections 2023-06-09T04:40:31.977 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.974+0000 7f863ecaa700 1 -- 172.21.15.89:0/1473995130 wait complete. 2023-06-09T04:40:31.978 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.974+0000 7f863ecaa700 1 Processor -- start 2023-06-09T04:40:31.978 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.978+0000 7f863ecaa700 1 -- start start 2023-06-09T04:40:31.980 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.978+0000 7f863ecaa700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f863806ac50 0x7f86380b7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:31.980 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.978+0000 7f863ecaa700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86380cd320 0x7f86381f50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:31.981 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.978+0000 7f863ecaa700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86380d0270 0x7f8638154940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:31.981 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.978+0000 7f863ecaa700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f863809c840 con 0x7f863806ac50 2023-06-09T04:40:31.981 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.978+0000 7f863ecaa700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f863809fd90 con 0x7f86380cd320 2023-06-09T04:40:31.981 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.978+0000 7f863ecaa700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86380a0310 con 0x7f86380d0270 2023-06-09T04:40:31.982 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.978+0000 7f8637fff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86380cd320 0x7f86381f50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:31.982 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.978+0000 7f863d247700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86380d0270 0x7f8638154940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:31.982 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.978+0000 7f8637fff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86380cd320 0x7f86381f50b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34510/0 (socket says 172.21.15.89:34510) 2023-06-09T04:40:31.982 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.978+0000 7f8637fff700 1 -- 172.21.15.89:0/1682510606 learned_addr learned my addr 172.21.15.89:0/1682510606 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-06-09T04:40:31.983 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.978+0000 7f863ca46700 1 --2- 172.21.15.89:0/1682510606 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f863806ac50 0x7f86380b7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:31.983 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.978+0000 7f863d247700 1 -- 172.21.15.89:0/1682510606 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86380cd320 msgr2=0x7f86381f50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:31.983 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.978+0000 7f863d247700 1 --2- 172.21.15.89:0/1682510606 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86380cd320 0x7f86381f50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:31.983 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.978+0000 7f863d247700 1 -- 172.21.15.89:0/1682510606 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f863806ac50 msgr2=0x7f86380b7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:31.983 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.978+0000 7f863d247700 1 --2- 172.21.15.89:0/1682510606 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f863806ac50 0x7f86380b7450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:31.983 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.978+0000 7f863d247700 1 -- 172.21.15.89:0/1682510606 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86240094b0 con 0x7f86380d0270 2023-06-09T04:40:31.983 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.978+0000 7f8637fff700 1 --2- 172.21.15.89:0/1682510606 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86380cd320 0x7f86381f50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:40:31.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.978+0000 7f863d247700 1 --2- 172.21.15.89:0/1682510606 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86380d0270 0x7f8638154940 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f863000cae0 tx=0x7f863000cdf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:31.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.978+0000 7f86357fa700 1 -- 172.21.15.89:0/1682510606 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8630003c20 con 0x7f86380d0270 2023-06-09T04:40:31.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.978+0000 7f86357fa700 1 -- 172.21.15.89:0/1682510606 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8630003d80 con 0x7f86380d0270 2023-06-09T04:40:31.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.978+0000 7f86357fa700 1 -- 172.21.15.89:0/1682510606 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f863000aa20 con 0x7f86380d0270 2023-06-09T04:40:31.984 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.978+0000 7f863ecaa700 1 -- 172.21.15.89:0/1682510606 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86380a0030 con 0x7f86380d0270 2023-06-09T04:40:31.985 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.982+0000 7f863ecaa700 1 -- 172.21.15.89:0/1682510606 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86380b7990 con 0x7f86380d0270 2023-06-09T04:40:31.985 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.982+0000 7f86357fa700 1 -- 172.21.15.89:0/1682510606 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f86300050d0 con 0x7f86380d0270 2023-06-09T04:40:31.985 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.982+0000 7f86357fa700 1 -- 172.21.15.89:0/1682510606 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f86300057a0 con 0x7f86380d0270 2023-06-09T04:40:31.985 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.982+0000 7f863ecaa700 1 -- 172.21.15.89:0/1682510606 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f863809c980 con 0x7f86380d0270 2023-06-09T04:40:31.985 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-06-09T04:40:31.982+0000 7f1ef18002c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-06-09T04:40:31.986 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:31.982+0000 7f86357fa700 1 -- 172.21.15.89:0/1682510606 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f863809c980 con 0x7f86380d0270 2023-06-09T04:40:32.024 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-06-09T04:40:32.020+0000 7f5964e692c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-06-09T04:40:32.057 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.054+0000 7f863ecaa700 1 -- 172.21.15.89:0/1682510606 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d0202506-dbe9-4e3c-9271-687929abf96a", "id": 2} v 0) v1 -- 0x7f86380739c0 con 0x7f86380d0270 2023-06-09T04:40:32.058 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-06-09T04:40:32.058+0000 7f1ef18002c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-06-09T04:40:32.069 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.066+0000 7f86357fa700 1 -- 172.21.15.89:0/1682510606 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d0202506-dbe9-4e3c-9271-687929abf96a", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8630005380 con 0x7f86380d0270 2023-06-09T04:40:32.069 INFO:teuthology.orchestra.run.smithi089.stdout:2 2023-06-09T04:40:32.070 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.070+0000 7f863ecaa700 1 -- 172.21.15.89:0/1682510606 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86380d0270 msgr2=0x7f8638154940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:32.071 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.070+0000 7f863ecaa700 1 --2- 172.21.15.89:0/1682510606 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86380d0270 0x7f8638154940 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f863000cae0 tx=0x7f863000cdf0 comp rx=0 tx=0).stop 2023-06-09T04:40:32.071 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.070+0000 7f863ecaa700 1 -- 172.21.15.89:0/1682510606 shutdown_connections 2023-06-09T04:40:32.071 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.070+0000 7f863ecaa700 1 --2- 172.21.15.89:0/1682510606 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f86380d0270 0x7f8638154940 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:32.072 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.070+0000 7f863ecaa700 1 --2- 172.21.15.89:0/1682510606 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86380cd320 0x7f86381f50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:32.072 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.070+0000 7f863ecaa700 1 --2- 172.21.15.89:0/1682510606 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f863806ac50 0x7f86380b7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:32.072 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.070+0000 7f863ecaa700 1 -- 172.21.15.89:0/1682510606 >> 172.21.15.89:0/1682510606 conn(0x7f8638089fc0 msgr2=0x7f86380cf520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:40:32.072 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.070+0000 7f863ecaa700 1 -- 172.21.15.89:0/1682510606 shutdown_connections 2023-06-09T04:40:32.072 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.070+0000 7f863ecaa700 1 -- 172.21.15.89:0/1682510606 wait complete. 2023-06-09T04:40:32.092 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new f3c0298a-b075-4411-af50-e16cd74fdddb 3 2023-06-09T04:40:32.099 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-06-09T04:40:32.092+0000 7f5964e692c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-06-09T04:40:32.258 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.254+0000 7f0d6f0f4700 1 Processor -- start 2023-06-09T04:40:32.258 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.254+0000 7f0d6f0f4700 1 -- start start 2023-06-09T04:40:32.259 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.258+0000 7f0d6f0f4700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0d68071730 0x7f0d6806f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:32.260 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.258+0000 7f0d6f0f4700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0d680ca1c0 0x7f0d680afb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:32.260 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.258+0000 7f0d6f0f4700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d680b04f0 con 0x7f0d680b0090 2023-06-09T04:40:32.260 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.258+0000 7f0d6f0f4700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d6815d860 con 0x7f0d680ca1c0 2023-06-09T04:40:32.260 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.258+0000 7f0d6f0f4700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d68071b00 con 0x7f0d68071730 2023-06-09T04:40:32.261 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.258+0000 7f0d6e0f2700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0d68071730 0x7f0d6806f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:32.261 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.258+0000 7f0d6e8f3700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f0d680b0090 0x7f0d680cbfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:39510/0 (socket says 172.21.15.89:39510) 2023-06-09T04:40:32.261 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.258+0000 7f0d6e8f3700 1 -- 172.21.15.89:0/815981540 learned_addr learned my addr 172.21.15.89:0/815981540 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-06-09T04:40:32.262 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.258+0000 7f0d6d8f1700 1 --2- 172.21.15.89:0/815981540 >> v2:172.21.15.62:3300/0 conn(0x7f0d680ca1c0 0x7f0d680afb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:32.262 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.258+0000 7f0d6e0f2700 1 -- 172.21.15.89:0/815981540 >> v2:172.21.15.62:3300/0 conn(0x7f0d680ca1c0 msgr2=0x7f0d680afb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:40:32.262 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.258+0000 7f0d6e0f2700 1 --2- 172.21.15.89:0/815981540 >> v2:172.21.15.62:3300/0 conn(0x7f0d680ca1c0 0x7f0d680afb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:32.262 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.258+0000 7f0d6e0f2700 1 -- 172.21.15.89:0/815981540 >> v1:172.21.15.89:6789/0 conn(0x7f0d680b0090 legacy=0x7f0d680cbfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:32.262 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.258+0000 7f0d6e0f2700 1 -- 172.21.15.89:0/815981540 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d6815dab0 con 0x7f0d68071730 2023-06-09T04:40:32.262 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.258+0000 7f0d6e0f2700 1 --2- 172.21.15.89:0/815981540 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d68071730 0x7f0d6806f610 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0d68071d00 tx=0x7f0d64009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b108854c88b44fc server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:32.263 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.258+0000 7f0d6d0f0700 1 -- 172.21.15.89:0/815981540 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d64011830 con 0x7f0d68071730 2023-06-09T04:40:32.263 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.258+0000 7f0d6d0f0700 1 -- 172.21.15.89:0/815981540 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d64011990 con 0x7f0d68071730 2023-06-09T04:40:32.263 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.258+0000 7f0d6d0f0700 1 -- 172.21.15.89:0/815981540 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d64011d40 con 0x7f0d68071730 2023-06-09T04:40:32.263 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.258+0000 7f0d6f0f4700 1 -- 172.21.15.89:0/815981540 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d68071730 msgr2=0x7f0d6806f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:32.264 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.258+0000 7f0d6f0f4700 1 --2- 172.21.15.89:0/815981540 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d68071730 0x7f0d6806f610 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0d68071d00 tx=0x7f0d64009b30 comp rx=0 tx=0).stop 2023-06-09T04:40:32.264 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.262+0000 7f0d6f0f4700 1 -- 172.21.15.89:0/815981540 shutdown_connections 2023-06-09T04:40:32.264 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.262+0000 7f0d6f0f4700 1 --2- 172.21.15.89:0/815981540 >> v2:172.21.15.62:3300/0 conn(0x7f0d680ca1c0 0x7f0d680afb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:32.264 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.262+0000 7f0d6f0f4700 1 --2- 172.21.15.89:0/815981540 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d68071730 0x7f0d6806f610 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:32.264 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.262+0000 7f0d6f0f4700 1 -- 172.21.15.89:0/815981540 >> 172.21.15.89:0/815981540 conn(0x7f0d680cab50 msgr2=0x7f0d680caf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:40:32.264 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.262+0000 7f0d6f0f4700 1 -- 172.21.15.89:0/815981540 shutdown_connections 2023-06-09T04:40:32.264 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.262+0000 7f0d6f0f4700 1 -- 172.21.15.89:0/815981540 wait complete. 2023-06-09T04:40:32.265 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.262+0000 7f0d6f0f4700 1 Processor -- start 2023-06-09T04:40:32.265 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.262+0000 7f0d6f0f4700 1 -- start start 2023-06-09T04:40:32.266 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.262+0000 7f0d6f0f4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d68071730 0x7f0d681f22d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:32.266 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.262+0000 7f0d6f0f4700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d680b0090 0x7f0d681571b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:32.266 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.262+0000 7f0d6f0f4700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0d680ca1c0 0x7f0d680b0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:32.266 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.262+0000 7f0d6f0f4700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d680ac980 con 0x7f0d680ca1c0 2023-06-09T04:40:32.266 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.262+0000 7f0d6f0f4700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d681f2810 con 0x7f0d680b0090 2023-06-09T04:40:32.267 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.262+0000 7f0d6f0f4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6815d020 con 0x7f0d68071730 2023-06-09T04:40:32.267 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.262+0000 7f0d6e0f2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d68071730 0x7f0d681f22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:32.267 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.262+0000 7f0d6e0f2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d68071730 0x7f0d681f22d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:44222/0 (socket says 172.21.15.89:44222) 2023-06-09T04:40:32.267 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.262+0000 7f0d6e0f2700 1 -- 172.21.15.89:0/365251390 learned_addr learned my addr 172.21.15.89:0/365251390 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-06-09T04:40:32.268 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.266+0000 7f0d6e8f3700 1 --2- 172.21.15.89:0/365251390 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0d680ca1c0 0x7f0d680b0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:32.268 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.266+0000 7f0d6d8f1700 1 --2- 172.21.15.89:0/365251390 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d680b0090 0x7f0d681571b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:32.268 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.266+0000 7f0d6e0f2700 1 -- 172.21.15.89:0/365251390 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d680b0090 msgr2=0x7f0d681571b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:32.269 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.266+0000 7f0d6e0f2700 1 --2- 172.21.15.89:0/365251390 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d680b0090 0x7f0d681571b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:32.269 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.266+0000 7f0d6e0f2700 1 -- 172.21.15.89:0/365251390 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0d680ca1c0 msgr2=0x7f0d680b0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:32.269 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.266+0000 7f0d6e0f2700 1 --2- 172.21.15.89:0/365251390 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0d680ca1c0 0x7f0d680b0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:32.269 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.266+0000 7f0d6e0f2700 1 -- 172.21.15.89:0/365251390 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d640094b0 con 0x7f0d68071730 2023-06-09T04:40:32.269 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.266+0000 7f0d6d8f1700 1 --2- 172.21.15.89:0/365251390 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d680b0090 0x7f0d681571b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:40:32.269 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.266+0000 7f0d6e0f2700 1 --2- 172.21.15.89:0/365251390 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d68071730 0x7f0d681f22d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0d640090b0 tx=0x7f0d64004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:32.269 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.266+0000 7f0d5effd700 1 -- 172.21.15.89:0/365251390 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d640036c0 con 0x7f0d68071730 2023-06-09T04:40:32.269 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.266+0000 7f0d5effd700 1 -- 172.21.15.89:0/365251390 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d6401e070 con 0x7f0d68071730 2023-06-09T04:40:32.270 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.266+0000 7f0d6f0f4700 1 -- 172.21.15.89:0/365251390 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d680abd00 con 0x7f0d68071730 2023-06-09T04:40:32.270 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.266+0000 7f0d5effd700 1 -- 172.21.15.89:0/365251390 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d64003a80 con 0x7f0d68071730 2023-06-09T04:40:32.270 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.266+0000 7f0d6f0f4700 1 -- 172.21.15.89:0/365251390 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d680ac2c0 con 0x7f0d68071730 2023-06-09T04:40:32.270 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.266+0000 7f0d5effd700 1 -- 172.21.15.89:0/365251390 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0d64025480 con 0x7f0d68071730 2023-06-09T04:40:32.270 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.266+0000 7f0d5effd700 1 -- 172.21.15.89:0/365251390 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f0d64020070 con 0x7f0d68071730 2023-06-09T04:40:32.270 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.266+0000 7f0d6f0f4700 1 -- 172.21.15.89:0/365251390 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d680739c0 con 0x7f0d68071730 2023-06-09T04:40:32.274 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.274+0000 7f0d5effd700 1 -- 172.21.15.89:0/365251390 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f0d64045b00 con 0x7f0d68071730 2023-06-09T04:40:32.305 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-06-09T04:40:32.302+0000 7f1ef18002c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-06-09T04:40:32.346 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-06-09T04:40:32.340+0000 7f5964e692c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-06-09T04:40:32.354 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.350+0000 7f0d6f0f4700 1 -- 172.21.15.89:0/365251390 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd new", "uuid": "f3c0298a-b075-4411-af50-e16cd74fdddb", "id": 3} v 0) v1 -- 0x7f0d680cd4e0 con 0x7f0d68071730 2023-06-09T04:40:32.364 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.362+0000 7f0d5effd700 1 -- 172.21.15.89:0/365251390 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f3c0298a-b075-4411-af50-e16cd74fdddb", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0d64034030 con 0x7f0d68071730 2023-06-09T04:40:32.365 INFO:teuthology.orchestra.run.smithi089.stdout:3 2023-06-09T04:40:32.366 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.362+0000 7f0d6f0f4700 1 -- 172.21.15.89:0/365251390 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d68071730 msgr2=0x7f0d681f22d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:32.366 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.362+0000 7f0d6f0f4700 1 --2- 172.21.15.89:0/365251390 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d68071730 0x7f0d681f22d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0d640090b0 tx=0x7f0d64004770 comp rx=0 tx=0).stop 2023-06-09T04:40:32.366 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.362+0000 7f0d6f0f4700 1 -- 172.21.15.89:0/365251390 shutdown_connections 2023-06-09T04:40:32.367 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.362+0000 7f0d6f0f4700 1 --2- 172.21.15.89:0/365251390 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0d680ca1c0 0x7f0d680b0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:32.367 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.362+0000 7f0d6f0f4700 1 --2- 172.21.15.89:0/365251390 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0d680b0090 0x7f0d681571b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:32.367 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.362+0000 7f0d6f0f4700 1 --2- 172.21.15.89:0/365251390 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0d68071730 0x7f0d681f22d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:32.367 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.362+0000 7f0d6f0f4700 1 -- 172.21.15.89:0/365251390 >> 172.21.15.89:0/365251390 conn(0x7f0d680cab50 msgr2=0x7f0d680b1d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:40:32.367 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.362+0000 7f0d6f0f4700 1 -- 172.21.15.89:0/365251390 shutdown_connections 2023-06-09T04:40:32.367 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.362+0000 7f0d6f0f4700 1 -- 172.21.15.89:0/365251390 wait complete. 2023-06-09T04:40:32.384 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new 1ab5c5ca-e74f-475a-a309-683cc0029928 4 2023-06-09T04:40:32.395 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-06-09T04:40:32.394+0000 7f1ef18002c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-06-09T04:40:32.435 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-06-09T04:40:32.428+0000 7f5964e692c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-06-09T04:40:32.490 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-06-09T04:40:32.486+0000 7f1ef18002c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-06-09T04:40:32.533 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-06-09T04:40:32.528+0000 7f5964e692c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-06-09T04:40:32.550 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.546+0000 7f607ee93700 1 Processor -- start 2023-06-09T04:40:32.550 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.550+0000 7f607ee93700 1 -- start start 2023-06-09T04:40:32.552 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.550+0000 7f607ee93700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6078153290 0x7f607806cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:32.552 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.550+0000 7f607ee93700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60780cd0e0 0x7f60780cd550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:32.552 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.550+0000 7f607ee93700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f607815d630 con 0x7f607815c690 2023-06-09T04:40:32.552 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.550+0000 7f607ee93700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f607806c8e0 con 0x7f6078153290 2023-06-09T04:40:32.552 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.550+0000 7f607ee93700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60780cda90 con 0x7f60780cd0e0 2023-06-09T04:40:32.553 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.550+0000 7f607de91700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6078153290 0x7f607806cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:32.553 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.550+0000 7f607e692700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f607815c690 0x7f607815cad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:39512/0 (socket says 172.21.15.89:39512) 2023-06-09T04:40:32.553 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.550+0000 7f607e692700 1 -- 172.21.15.89:0/447275530 learned_addr learned my addr 172.21.15.89:0/447275530 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-06-09T04:40:32.554 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.550+0000 7f607d690700 1 --2- 172.21.15.89:0/447275530 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60780cd0e0 0x7f60780cd550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:32.554 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.550+0000 7f607ce8f700 1 -- 172.21.15.89:0/447275530 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3134768898 0 0) 0x7f607815d630 con 0x7f607815c690 2023-06-09T04:40:32.554 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.550+0000 7f607de91700 1 -- 172.21.15.89:0/447275530 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60780cd0e0 msgr2=0x7f60780cd550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:40:32.554 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.550+0000 7f607de91700 1 --2- 172.21.15.89:0/447275530 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60780cd0e0 0x7f60780cd550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:32.554 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.550+0000 7f607de91700 1 -- 172.21.15.89:0/447275530 >> v1:172.21.15.89:6789/0 conn(0x7f607815c690 legacy=0x7f607815cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:32.554 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.550+0000 7f607de91700 1 -- 172.21.15.89:0/447275530 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f607815d350 con 0x7f6078153290 2023-06-09T04:40:32.555 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.550+0000 7f607de91700 1 --2- 172.21.15.89:0/447275530 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6078153290 0x7f607806cd00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6074009880 tx=0x7f6074009b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66a4cff7021133ee server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:32.555 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.550+0000 7f607ce8f700 1 -- 172.21.15.89:0/447275530 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6074011830 con 0x7f6078153290 2023-06-09T04:40:32.555 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.550+0000 7f607ce8f700 1 -- 172.21.15.89:0/447275530 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6074011990 con 0x7f6078153290 2023-06-09T04:40:32.555 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.550+0000 7f607ce8f700 1 -- 172.21.15.89:0/447275530 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6074011d20 con 0x7f6078153290 2023-06-09T04:40:32.556 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.554+0000 7f607ee93700 1 -- 172.21.15.89:0/447275530 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6078153290 msgr2=0x7f607806cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:32.556 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.554+0000 7f607ee93700 1 --2- 172.21.15.89:0/447275530 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6078153290 0x7f607806cd00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6074009880 tx=0x7f6074009b90 comp rx=0 tx=0).stop 2023-06-09T04:40:32.556 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.554+0000 7f607ee93700 1 -- 172.21.15.89:0/447275530 shutdown_connections 2023-06-09T04:40:32.556 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.554+0000 7f607ee93700 1 --2- 172.21.15.89:0/447275530 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60780cd0e0 0x7f60780cd550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:32.557 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.554+0000 7f607ee93700 1 --2- 172.21.15.89:0/447275530 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6078153290 0x7f607806cd00 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:32.557 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.554+0000 7f607ee93700 1 -- 172.21.15.89:0/447275530 >> 172.21.15.89:0/447275530 conn(0x7f60780cab50 msgr2=0x7f60780caf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:40:32.557 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.554+0000 7f607ee93700 1 -- 172.21.15.89:0/447275530 shutdown_connections 2023-06-09T04:40:32.557 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.554+0000 7f607ee93700 1 -- 172.21.15.89:0/447275530 wait complete. 2023-06-09T04:40:32.559 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.558+0000 7f607ee93700 1 Processor -- start 2023-06-09T04:40:32.559 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.558+0000 7f607ee93700 1 -- start start 2023-06-09T04:40:32.560 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.558+0000 7f607ee93700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60780cd0e0 0x7f60781f4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:32.560 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.558+0000 7f607ee93700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6078153290 0x7f6078147160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:32.561 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.558+0000 7f607ee93700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f607815c690 0x7f6078157a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:32.561 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.558+0000 7f607ee93700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60781487c0 con 0x7f607815c690 2023-06-09T04:40:32.561 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.558+0000 7f607ee93700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60781f4bd0 con 0x7f60780cd0e0 2023-06-09T04:40:32.561 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.558+0000 7f607ee93700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6078147b40 con 0x7f6078153290 2023-06-09T04:40:32.562 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.558+0000 7f607de91700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60780cd0e0 0x7f60781f4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:32.562 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.558+0000 7f607d690700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6078153290 0x7f6078147160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:32.562 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.558+0000 7f607de91700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60780cd0e0 0x7f60781f4690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34538/0 (socket says 172.21.15.89:34538) 2023-06-09T04:40:32.563 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.558+0000 7f607de91700 1 -- 172.21.15.89:0/3578495886 learned_addr learned my addr 172.21.15.89:0/3578495886 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-06-09T04:40:32.563 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.558+0000 7f607e692700 1 --2- 172.21.15.89:0/3578495886 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f607815c690 0x7f6078157a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:32.563 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.558+0000 7f607d690700 1 -- 172.21.15.89:0/3578495886 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60780cd0e0 msgr2=0x7f60781f4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:32.563 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.558+0000 7f607d690700 1 --2- 172.21.15.89:0/3578495886 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60780cd0e0 0x7f60781f4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:32.563 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.558+0000 7f607d690700 1 -- 172.21.15.89:0/3578495886 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f607815c690 msgr2=0x7f6078157a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:32.563 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.558+0000 7f607d690700 1 --2- 172.21.15.89:0/3578495886 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f607815c690 0x7f6078157a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:32.563 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.558+0000 7f607d690700 1 -- 172.21.15.89:0/3578495886 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60740094b0 con 0x7f6078153290 2023-06-09T04:40:32.563 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.558+0000 7f607d690700 1 --2- 172.21.15.89:0/3578495886 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6078153290 0x7f6078147160 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f606800fa30 tx=0x7f606800fd40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:32.564 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.558+0000 7f606e7fc700 1 -- 172.21.15.89:0/3578495886 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606800c070 con 0x7f6078153290 2023-06-09T04:40:32.564 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.558+0000 7f606e7fc700 1 -- 172.21.15.89:0/3578495886 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f606800da60 con 0x7f6078153290 2023-06-09T04:40:32.564 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.558+0000 7f606e7fc700 1 -- 172.21.15.89:0/3578495886 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6068009660 con 0x7f6078153290 2023-06-09T04:40:32.564 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.558+0000 7f607ee93700 1 -- 172.21.15.89:0/3578495886 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6078147e20 con 0x7f6078153290 2023-06-09T04:40:32.564 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.558+0000 7f607ee93700 1 -- 172.21.15.89:0/3578495886 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60781483e0 con 0x7f6078153290 2023-06-09T04:40:32.565 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.562+0000 7f606e7fc700 1 -- 172.21.15.89:0/3578495886 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6068005d40 con 0x7f6078153290 2023-06-09T04:40:32.565 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.562+0000 7f606e7fc700 1 -- 172.21.15.89:0/3578495886 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f6068015070 con 0x7f6078153290 2023-06-09T04:40:32.565 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.562+0000 7f607ee93700 1 -- 172.21.15.89:0/3578495886 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60780739c0 con 0x7f6078153290 2023-06-09T04:40:32.567 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.566+0000 7f606e7fc700 1 -- 172.21.15.89:0/3578495886 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f606801f020 con 0x7f6078153290 2023-06-09T04:40:32.646 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.646+0000 7f607ee93700 1 -- 172.21.15.89:0/3578495886 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd new", "uuid": "1ab5c5ca-e74f-475a-a309-683cc0029928", "id": 4} v 0) v1 -- 0x7f6078158ae0 con 0x7f6078153290 2023-06-09T04:40:32.656 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.654+0000 7f606e7fc700 1 -- 172.21.15.89:0/3578495886 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1ab5c5ca-e74f-475a-a309-683cc0029928", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6068006890 con 0x7f6078153290 2023-06-09T04:40:32.657 INFO:teuthology.orchestra.run.smithi089.stdout:4 2023-06-09T04:40:32.658 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.654+0000 7f607ee93700 1 -- 172.21.15.89:0/3578495886 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6078153290 msgr2=0x7f6078147160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:32.658 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.654+0000 7f607ee93700 1 --2- 172.21.15.89:0/3578495886 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6078153290 0x7f6078147160 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f606800fa30 tx=0x7f606800fd40 comp rx=0 tx=0).stop 2023-06-09T04:40:32.659 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.654+0000 7f607ee93700 1 -- 172.21.15.89:0/3578495886 shutdown_connections 2023-06-09T04:40:32.659 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.654+0000 7f607ee93700 1 --2- 172.21.15.89:0/3578495886 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f607815c690 0x7f6078157a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:32.659 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.654+0000 7f607ee93700 1 --2- 172.21.15.89:0/3578495886 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6078153290 0x7f6078147160 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:32.659 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.654+0000 7f607ee93700 1 --2- 172.21.15.89:0/3578495886 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60780cd0e0 0x7f60781f4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:32.659 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.654+0000 7f607ee93700 1 -- 172.21.15.89:0/3578495886 >> 172.21.15.89:0/3578495886 conn(0x7f60780cab50 msgr2=0x7f60780c8e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:40:32.659 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.658+0000 7f607ee93700 1 -- 172.21.15.89:0/3578495886 shutdown_connections 2023-06-09T04:40:32.659 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.658+0000 7f607ee93700 1 -- 172.21.15.89:0/3578495886 wait complete. 2023-06-09T04:40:32.677 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new a933e184-bd8f-4369-a1ba-a68de53c578c 5 2023-06-09T04:40:32.883 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.882+0000 7f38a5e53700 1 Processor -- start 2023-06-09T04:40:32.883 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.882+0000 7f38a5e53700 1 -- start start 2023-06-09T04:40:32.885 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.882+0000 7f38a5e53700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f38a0071730 0x7f38a006f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:32.886 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.882+0000 7f38a5e53700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f38a00ca1c0 0x7f38a00afb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:32.886 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.882+0000 7f38a5e53700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38a00b04f0 con 0x7f38a00b0090 2023-06-09T04:40:32.886 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.882+0000 7f38a5e53700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38a015d860 con 0x7f38a00ca1c0 2023-06-09T04:40:32.886 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.882+0000 7f38a5e53700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38a0071b00 con 0x7f38a0071730 2023-06-09T04:40:32.887 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.882+0000 7f38a5652700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f38a00b0090 0x7f38a00cbfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:39524/0 (socket says 172.21.15.89:39524) 2023-06-09T04:40:32.887 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.882+0000 7f38a5652700 1 -- 172.21.15.89:0/166588175 learned_addr learned my addr 172.21.15.89:0/166588175 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-06-09T04:40:32.887 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.882+0000 7f38a4e51700 1 --2- 172.21.15.89:0/166588175 >> v2:172.21.15.89:3300/0 conn(0x7f38a0071730 0x7f38a006f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:32.888 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.886+0000 7f3897fff700 1 --2- 172.21.15.89:0/166588175 >> v2:172.21.15.62:3300/0 conn(0x7f38a00ca1c0 0x7f38a00afb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:32.888 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.886+0000 7f38977fe700 1 -- 172.21.15.89:0/166588175 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1356898857 0 0) 0x7f38a00b04f0 con 0x7f38a00b0090 2023-06-09T04:40:32.888 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.886+0000 7f38977fe700 1 -- 172.21.15.89:0/166588175 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38880035d0 con 0x7f38a00b0090 2023-06-09T04:40:32.888 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.886+0000 7f38a4e51700 1 -- 172.21.15.89:0/166588175 >> v2:172.21.15.62:3300/0 conn(0x7f38a00ca1c0 msgr2=0x7f38a00afb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:40:32.888 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.886+0000 7f38a4e51700 1 --2- 172.21.15.89:0/166588175 >> v2:172.21.15.62:3300/0 conn(0x7f38a00ca1c0 0x7f38a00afb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:32.889 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.886+0000 7f38a4e51700 1 -- 172.21.15.89:0/166588175 >> v1:172.21.15.89:6789/0 conn(0x7f38a00b0090 legacy=0x7f38a00cbfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:32.889 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.886+0000 7f38a4e51700 1 -- 172.21.15.89:0/166588175 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38a015dab0 con 0x7f38a0071730 2023-06-09T04:40:32.889 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.886+0000 7f3897fff700 1 --2- 172.21.15.89:0/166588175 >> v2:172.21.15.62:3300/0 conn(0x7f38a00ca1c0 0x7f38a00afb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:40:32.889 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.886+0000 7f38a4e51700 1 --2- 172.21.15.89:0/166588175 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38a0071730 0x7f38a006f610 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f38a0071d00 tx=0x7f389c009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d332ce750c58f5f2 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:32.889 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.886+0000 7f38977fe700 1 -- 172.21.15.89:0/166588175 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f389c011830 con 0x7f38a0071730 2023-06-09T04:40:32.889 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.886+0000 7f38977fe700 1 -- 172.21.15.89:0/166588175 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f389c011990 con 0x7f38a0071730 2023-06-09T04:40:32.889 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.886+0000 7f38977fe700 1 -- 172.21.15.89:0/166588175 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f389c011d20 con 0x7f38a0071730 2023-06-09T04:40:32.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.886+0000 7f38a5e53700 1 -- 172.21.15.89:0/166588175 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38a0071730 msgr2=0x7f38a006f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:32.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.886+0000 7f38a5e53700 1 --2- 172.21.15.89:0/166588175 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38a0071730 0x7f38a006f610 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f38a0071d00 tx=0x7f389c009b30 comp rx=0 tx=0).stop 2023-06-09T04:40:32.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.886+0000 7f38a5e53700 1 -- 172.21.15.89:0/166588175 shutdown_connections 2023-06-09T04:40:32.890 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.886+0000 7f38a5e53700 1 --2- 172.21.15.89:0/166588175 >> v2:172.21.15.62:3300/0 conn(0x7f38a00ca1c0 0x7f38a00afb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:32.891 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.886+0000 7f38a5e53700 1 --2- 172.21.15.89:0/166588175 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38a0071730 0x7f38a006f610 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:32.891 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.886+0000 7f38a5e53700 1 -- 172.21.15.89:0/166588175 >> 172.21.15.89:0/166588175 conn(0x7f38a00cab50 msgr2=0x7f38a00caf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:40:32.891 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.886+0000 7f38a5e53700 1 -- 172.21.15.89:0/166588175 shutdown_connections 2023-06-09T04:40:32.891 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.886+0000 7f38a5e53700 1 -- 172.21.15.89:0/166588175 wait complete. 2023-06-09T04:40:32.892 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.890+0000 7f38a5e53700 1 Processor -- start 2023-06-09T04:40:32.892 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.890+0000 7f38a5e53700 1 -- start start 2023-06-09T04:40:32.894 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.890+0000 7f38a5e53700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38a0071730 0x7f38a015bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:32.894 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.890+0000 7f38a5e53700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38a00b0090 0x7f38a01ef360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:32.894 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.890+0000 7f38a5e53700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38a00ca1c0 0x7f38a01ef8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:32.894 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.890+0000 7f38a5e53700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a00c1bc0 con 0x7f38a00ca1c0 2023-06-09T04:40:32.894 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.890+0000 7f38a5e53700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a015c5e0 con 0x7f38a00b0090 2023-06-09T04:40:32.894 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.890+0000 7f38a5e53700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38a015c8c0 con 0x7f38a0071730 2023-06-09T04:40:32.896 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.890+0000 7f38a4e51700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38a0071730 0x7f38a015bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:32.896 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.890+0000 7f3897fff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38a00b0090 0x7f38a01ef360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:32.896 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.890+0000 7f38a4e51700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38a0071730 0x7f38a015bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:44260/0 (socket says 172.21.15.89:44260) 2023-06-09T04:40:32.896 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.890+0000 7f38a4e51700 1 -- 172.21.15.89:0/142341820 learned_addr learned my addr 172.21.15.89:0/142341820 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-06-09T04:40:32.896 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.894+0000 7f38a5652700 1 --2- 172.21.15.89:0/142341820 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38a00ca1c0 0x7f38a01ef8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:32.896 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.894+0000 7f38a4e51700 1 -- 172.21.15.89:0/142341820 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38a00b0090 msgr2=0x7f38a01ef360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:32.896 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.894+0000 7f38a4e51700 1 --2- 172.21.15.89:0/142341820 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38a00b0090 0x7f38a01ef360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:32.897 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.894+0000 7f38a4e51700 1 -- 172.21.15.89:0/142341820 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38a00ca1c0 msgr2=0x7f38a01ef8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:32.897 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.894+0000 7f38a4e51700 1 --2- 172.21.15.89:0/142341820 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38a00ca1c0 0x7f38a01ef8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:32.897 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.894+0000 7f38a4e51700 1 -- 172.21.15.89:0/142341820 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38900094b0 con 0x7f38a0071730 2023-06-09T04:40:32.897 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.894+0000 7f38a4e51700 1 --2- 172.21.15.89:0/142341820 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38a0071730 0x7f38a015bd00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f389c0090b0 tx=0x7f389c004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:32.897 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.894+0000 7f38957fa700 1 -- 172.21.15.89:0/142341820 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f389c004510 con 0x7f38a0071730 2023-06-09T04:40:32.897 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.894+0000 7f38957fa700 1 -- 172.21.15.89:0/142341820 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f389c01e070 con 0x7f38a0071730 2023-06-09T04:40:32.897 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.894+0000 7f38a5e53700 1 -- 172.21.15.89:0/142341820 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f389c0094b0 con 0x7f38a0071730 2023-06-09T04:40:32.898 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.894+0000 7f38957fa700 1 -- 172.21.15.89:0/142341820 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f389c0038e0 con 0x7f38a0071730 2023-06-09T04:40:32.898 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.894+0000 7f38a5e53700 1 -- 172.21.15.89:0/142341820 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38a00c6dd0 con 0x7f38a0071730 2023-06-09T04:40:32.898 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.894+0000 7f38957fa700 1 -- 172.21.15.89:0/142341820 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f389c003d40 con 0x7f38a0071730 2023-06-09T04:40:32.898 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.894+0000 7f38957fa700 1 -- 172.21.15.89:0/142341820 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f389c01a420 con 0x7f38a0071730 2023-06-09T04:40:32.899 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.894+0000 7f38a5e53700 1 -- 172.21.15.89:0/142341820 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38a00c6fc0 con 0x7f38a0071730 2023-06-09T04:40:32.901 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.898+0000 7f38957fa700 1 -- 172.21.15.89:0/142341820 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f389c020070 con 0x7f38a0071730 2023-06-09T04:40:32.978 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.974+0000 7f38a5e53700 1 -- 172.21.15.89:0/142341820 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a933e184-bd8f-4369-a1ba-a68de53c578c", "id": 5} v 0) v1 -- 0x7f38a00739c0 con 0x7f38a0071730 2023-06-09T04:40:32.988 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.986+0000 7f38957fa700 1 -- 172.21.15.89:0/142341820 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a933e184-bd8f-4369-a1ba-a68de53c578c", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f389c015020 con 0x7f38a0071730 2023-06-09T04:40:32.988 INFO:teuthology.orchestra.run.smithi089.stdout:5 2023-06-09T04:40:32.990 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.986+0000 7f38a5e53700 1 -- 172.21.15.89:0/142341820 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38a0071730 msgr2=0x7f38a015bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:32.990 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.986+0000 7f38a5e53700 1 --2- 172.21.15.89:0/142341820 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38a0071730 0x7f38a015bd00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f389c0090b0 tx=0x7f389c004770 comp rx=0 tx=0).stop 2023-06-09T04:40:32.990 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-06-09T04:40:32.986+0000 7f1ef18002c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-06-09T04:40:32.991 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.986+0000 7f38a5e53700 1 -- 172.21.15.89:0/142341820 shutdown_connections 2023-06-09T04:40:32.991 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.986+0000 7f38a5e53700 1 --2- 172.21.15.89:0/142341820 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38a00ca1c0 0x7f38a01ef8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:32.991 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.986+0000 7f38a5e53700 1 --2- 172.21.15.89:0/142341820 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38a00b0090 0x7f38a01ef360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:32.991 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.986+0000 7f38a5e53700 1 --2- 172.21.15.89:0/142341820 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38a0071730 0x7f38a015bd00 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:32.991 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.986+0000 7f38a5e53700 1 -- 172.21.15.89:0/142341820 >> 172.21.15.89:0/142341820 conn(0x7f38a00cab50 msgr2=0x7f38a00b1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:40:32.991 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.990+0000 7f38a5e53700 1 -- 172.21.15.89:0/142341820 shutdown_connections 2023-06-09T04:40:32.992 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:32.990+0000 7f38a5e53700 1 -- 172.21.15.89:0/142341820 wait complete. 2023-06-09T04:40:33.009 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new 1ed7ad37-2eee-49a6-954c-b537e2b7f0ed 6 2023-06-09T04:40:33.018 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-06-09T04:40:33.012+0000 7f5964e692c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-06-09T04:40:33.174 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-06-09T04:40:33.170+0000 7f1ef18002c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-06-09T04:40:33.175 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.174+0000 7f42d5b02700 1 Processor -- start 2023-06-09T04:40:33.176 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.174+0000 7f42d5b02700 1 -- start start 2023-06-09T04:40:33.178 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.174+0000 7f42d5b02700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42d00b0260 0x7f42d0164bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:33.178 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.174+0000 7f42d5b02700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42d015d860 con 0x7f42d0071730 2023-06-09T04:40:33.178 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.174+0000 7f42d5b02700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42d0071b00 con 0x7f42d006f610 2023-06-09T04:40:33.178 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.174+0000 7f42d5b02700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42d015dab0 con 0x7f42d00b0260 2023-06-09T04:40:33.179 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.178+0000 7f42cffff700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f42d006f610 0x7f42d00afb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.89:39534/0 (socket says 172.21.15.89:39534) 2023-06-09T04:40:33.179 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.178+0000 7f42cffff700 1 -- 172.21.15.89:0/1839347288 learned_addr learned my addr 172.21.15.89:0/1839347288 (peer_addr_for_me v1:172.21.15.89:0/0) 2023-06-09T04:40:33.179 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.178+0000 7f42d5301700 1 --2- 172.21.15.89:0/1839347288 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42d00b0260 0x7f42d0164bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:33.180 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.178+0000 7f42d5301700 1 -- 172.21.15.89:0/1839347288 >> v1:172.21.15.89:6789/0 conn(0x7f42d006f610 legacy=0x7f42d00afb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:33.180 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.178+0000 7f42d5301700 1 -- 172.21.15.89:0/1839347288 >> v1:172.21.15.62:6789/0 conn(0x7f42d0071730 legacy=0x7f42d00ca1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:33.180 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.178+0000 7f42cf7fe700 1 -- 172.21.15.89:0/1839347288 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3783926194 0 0) 0x7f42d0071b00 con 0x7f42d006f610 2023-06-09T04:40:33.180 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.178+0000 7f42d5301700 1 -- 172.21.15.89:0/1839347288 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42d015dd90 con 0x7f42d00b0260 2023-06-09T04:40:33.180 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.178+0000 7f42d5301700 1 --2- 172.21.15.89:0/1839347288 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42d00b0260 0x7f42d0164bf0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f42c8009dc0 tx=0x7f42c800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37906ff3f90af4d3 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:33.181 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.178+0000 7f42cf7fe700 1 -- 172.21.15.89:0/1839347288 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c800e070 con 0x7f42d00b0260 2023-06-09T04:40:33.181 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.178+0000 7f42cf7fe700 1 -- 172.21.15.89:0/1839347288 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42c800bbd0 con 0x7f42d00b0260 2023-06-09T04:40:33.181 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.178+0000 7f42cf7fe700 1 -- 172.21.15.89:0/1839347288 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c8012430 con 0x7f42d00b0260 2023-06-09T04:40:33.182 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.178+0000 7f42d5b02700 1 -- 172.21.15.89:0/1839347288 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42d00b0260 msgr2=0x7f42d0164bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:33.182 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.178+0000 7f42d5b02700 1 --2- 172.21.15.89:0/1839347288 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42d00b0260 0x7f42d0164bf0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f42c8009dc0 tx=0x7f42c800b330 comp rx=0 tx=0).stop 2023-06-09T04:40:33.182 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.178+0000 7f42d5b02700 1 -- 172.21.15.89:0/1839347288 shutdown_connections 2023-06-09T04:40:33.182 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.178+0000 7f42d5b02700 1 --2- 172.21.15.89:0/1839347288 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42d00b0260 0x7f42d0164bf0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:33.183 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.178+0000 7f42d5b02700 1 -- 172.21.15.89:0/1839347288 >> 172.21.15.89:0/1839347288 conn(0x7f42d00cab50 msgr2=0x7f42d00caf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:40:33.183 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.178+0000 7f42d5b02700 1 -- 172.21.15.89:0/1839347288 shutdown_connections 2023-06-09T04:40:33.183 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.178+0000 7f42d5b02700 1 -- 172.21.15.89:0/1839347288 wait complete. 2023-06-09T04:40:33.185 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.182+0000 7f42d5b02700 1 Processor -- start 2023-06-09T04:40:33.185 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.182+0000 7f42d5b02700 1 -- start start 2023-06-09T04:40:33.187 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.186+0000 7f42d5b02700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42d006f610 0x7f42d01f0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:33.187 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.186+0000 7f42d5b02700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42d0071730 0x7f42d00c43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:33.187 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.186+0000 7f42d5b02700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42d00b0260 0x7f42d00b18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:33.188 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.186+0000 7f42d5b02700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d00c3f40 con 0x7f42d0071730 2023-06-09T04:40:33.188 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.186+0000 7f42d5b02700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d00c3090 con 0x7f42d00b0260 2023-06-09T04:40:33.188 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.186+0000 7f42d5b02700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42d00c3330 con 0x7f42d006f610 2023-06-09T04:40:33.189 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.186+0000 7f42d4b00700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42d006f610 0x7f42d01f0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:33.189 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.186+0000 7f42d5301700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42d00b0260 0x7f42d00b18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:33.189 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.186+0000 7f42d5301700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42d00b0260 0x7f42d00b18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34554/0 (socket says 172.21.15.89:34554) 2023-06-09T04:40:33.189 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.186+0000 7f42d5301700 1 -- 172.21.15.89:0/3530825271 learned_addr learned my addr 172.21.15.89:0/3530825271 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-06-09T04:40:33.189 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.186+0000 7f42cffff700 1 --2- 172.21.15.89:0/3530825271 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42d0071730 0x7f42d00c43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:33.189 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.186+0000 7f42d4b00700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42d006f610 0x7f42d01f0c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:44278/0 (socket says 172.21.15.89:44278) 2023-06-09T04:40:33.190 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.186+0000 7f42d5301700 1 -- 172.21.15.89:0/3530825271 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42d006f610 msgr2=0x7f42d01f0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:33.190 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.186+0000 7f42d5301700 1 --2- 172.21.15.89:0/3530825271 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42d006f610 0x7f42d01f0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:33.190 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.186+0000 7f42d5301700 1 -- 172.21.15.89:0/3530825271 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42d0071730 msgr2=0x7f42d00c43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:33.190 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.186+0000 7f42d5301700 1 --2- 172.21.15.89:0/3530825271 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42d0071730 0x7f42d00c43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:33.190 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.186+0000 7f42d5301700 1 -- 172.21.15.89:0/3530825271 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c8009a70 con 0x7f42d00b0260 2023-06-09T04:40:33.190 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.186+0000 7f42d5301700 1 --2- 172.21.15.89:0/3530825271 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42d00b0260 0x7f42d00b18e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f42c8014040 tx=0x7f42c8004af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:33.191 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.186+0000 7f42cd7fa700 1 -- 172.21.15.89:0/3530825271 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c801b810 con 0x7f42d00b0260 2023-06-09T04:40:33.191 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.186+0000 7f42cd7fa700 1 -- 172.21.15.89:0/3530825271 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42c8020070 con 0x7f42d00b0260 2023-06-09T04:40:33.191 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.186+0000 7f42d5b02700 1 -- 172.21.15.89:0/3530825271 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42d00c3610 con 0x7f42d00b0260 2023-06-09T04:40:33.192 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.186+0000 7f42cd7fa700 1 -- 172.21.15.89:0/3530825271 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c801bbd0 con 0x7f42d00b0260 2023-06-09T04:40:33.192 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.186+0000 7f42d5b02700 1 -- 172.21.15.89:0/3530825271 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42d00c3bd0 con 0x7f42d00b0260 2023-06-09T04:40:33.192 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.186+0000 7f42cd7fa700 1 -- 172.21.15.89:0/3530825271 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f42c8027780 con 0x7f42d00b0260 2023-06-09T04:40:33.192 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.186+0000 7f42cd7fa700 1 -- 172.21.15.89:0/3530825271 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f42c8022070 con 0x7f42d00b0260 2023-06-09T04:40:33.192 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.190+0000 7f42d5b02700 1 -- 172.21.15.89:0/3530825271 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42d00c40b0 con 0x7f42d00b0260 2023-06-09T04:40:33.193 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-06-09T04:40:33.188+0000 7f5964e692c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-06-09T04:40:33.195 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.194+0000 7f42cd7fa700 1 -- 172.21.15.89:0/3530825271 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f42c8046b00 con 0x7f42d00b0260 2023-06-09T04:40:33.273 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.270+0000 7f42d5b02700 1 -- 172.21.15.89:0/3530825271 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1ed7ad37-2eee-49a6-954c-b537e2b7f0ed", "id": 6} v 0) v1 -- 0x7f42d00739c0 con 0x7f42d00b0260 2023-06-09T04:40:33.284 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.282+0000 7f42cd7fa700 1 -- 172.21.15.89:0/3530825271 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1ed7ad37-2eee-49a6-954c-b537e2b7f0ed", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f42c8035030 con 0x7f42d00b0260 2023-06-09T04:40:33.284 INFO:teuthology.orchestra.run.smithi089.stdout:6 2023-06-09T04:40:33.285 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.282+0000 7f42d5b02700 1 -- 172.21.15.89:0/3530825271 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42d00b0260 msgr2=0x7f42d00b18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:33.286 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.282+0000 7f42d5b02700 1 --2- 172.21.15.89:0/3530825271 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42d00b0260 0x7f42d00b18e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f42c8014040 tx=0x7f42c8004af0 comp rx=0 tx=0).stop 2023-06-09T04:40:33.286 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.282+0000 7f42d5b02700 1 -- 172.21.15.89:0/3530825271 shutdown_connections 2023-06-09T04:40:33.286 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.282+0000 7f42d5b02700 1 --2- 172.21.15.89:0/3530825271 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f42d00b0260 0x7f42d00b18e0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:33.287 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.282+0000 7f42d5b02700 1 --2- 172.21.15.89:0/3530825271 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42d0071730 0x7f42d00c43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:33.287 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.282+0000 7f42d5b02700 1 --2- 172.21.15.89:0/3530825271 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f42d006f610 0x7f42d01f0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:33.287 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.282+0000 7f42d5b02700 1 -- 172.21.15.89:0/3530825271 >> 172.21.15.89:0/3530825271 conn(0x7f42d00cab50 msgr2=0x7f42d0158150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:40:33.287 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.282+0000 7f42d5b02700 1 -- 172.21.15.89:0/3530825271 shutdown_connections 2023-06-09T04:40:33.287 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.282+0000 7f42d5b02700 1 -- 172.21.15.89:0/3530825271 wait complete. 2023-06-09T04:40:33.306 DEBUG:teuthology.orchestra.run.smithi089:> sudo ceph --cluster ceph osd new 6ed732e9-33ff-40df-9038-a9f1d1622671 7 2023-06-09T04:40:33.472 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.470+0000 7f499293a700 1 Processor -- start 2023-06-09T04:40:33.472 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.470+0000 7f499293a700 1 -- start start 2023-06-09T04:40:33.474 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.470+0000 7f499293a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f498c0d0270 0x7f498c0d0640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:33.474 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.470+0000 7f499293a700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f498c0af240 0x7f498c0af650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:33.474 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.470+0000 7f499293a700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f498c06ad20 0x7f498c06b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:33.474 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.470+0000 7f499293a700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f498c0afb90 con 0x7f498c06ad20 2023-06-09T04:40:33.474 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.470+0000 7f499293a700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f498c0b09c0 con 0x7f498c0af240 2023-06-09T04:40:33.475 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.470+0000 7f499293a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f498c0d0b80 con 0x7f498c0d0270 2023-06-09T04:40:33.475 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.470+0000 7f498bfff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f498c0d0270 0x7f498c0d0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:33.476 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.474+0000 7f4983fff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f498c0af240 0x7f498c0af650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:33.476 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.474+0000 7f498bfff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f498c0d0270 0x7f498c0d0640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.89:44288/0 (socket says 172.21.15.89:44288) 2023-06-09T04:40:33.476 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.474+0000 7f498bfff700 1 -- 172.21.15.89:0/1994133759 learned_addr learned my addr 172.21.15.89:0/1994133759 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-06-09T04:40:33.476 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.474+0000 7f4990ed7700 1 --2- 172.21.15.89:0/1994133759 >> v2:172.21.15.62:3300/0 conn(0x7f498c06ad20 0x7f498c06b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:33.476 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.474+0000 7f4983fff700 1 -- 172.21.15.89:0/1994133759 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f498c0d0270 msgr2=0x7f498c0d0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:40:33.476 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.474+0000 7f4983fff700 1 --2- 172.21.15.89:0/1994133759 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f498c0d0270 0x7f498c0d0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:33.476 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.474+0000 7f4983fff700 1 -- 172.21.15.89:0/1994133759 >> v2:172.21.15.62:3300/0 conn(0x7f498c06ad20 msgr2=0x7f498c06b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:40:33.477 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.474+0000 7f4983fff700 1 --2- 172.21.15.89:0/1994133759 >> v2:172.21.15.62:3300/0 conn(0x7f498c06ad20 0x7f498c06b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:33.477 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.474+0000 7f4983fff700 1 -- 172.21.15.89:0/1994133759 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f498c0afdb0 con 0x7f498c0af240 2023-06-09T04:40:33.477 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.474+0000 7f498bfff700 1 --2- 172.21.15.89:0/1994133759 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f498c0d0270 0x7f498c0d0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:40:33.478 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.474+0000 7f4983fff700 1 --2- 172.21.15.89:0/1994133759 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f498c0af240 0x7f498c0af650 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f498c08b3c0 tx=0x7f497c009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=524b3c8449b8a6d0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:33.478 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.474+0000 7f498b7fe700 1 -- 172.21.15.89:0/1994133759 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497c011830 con 0x7f498c0af240 2023-06-09T04:40:33.478 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.474+0000 7f498b7fe700 1 -- 172.21.15.89:0/1994133759 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f497c011990 con 0x7f498c0af240 2023-06-09T04:40:33.478 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.474+0000 7f498b7fe700 1 -- 172.21.15.89:0/1994133759 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497c011d20 con 0x7f498c0af240 2023-06-09T04:40:33.479 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.474+0000 7f499293a700 1 -- 172.21.15.89:0/1994133759 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f498c0af240 msgr2=0x7f498c0af650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:33.479 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.474+0000 7f499293a700 1 --2- 172.21.15.89:0/1994133759 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f498c0af240 0x7f498c0af650 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f498c08b3c0 tx=0x7f497c009b30 comp rx=0 tx=0).stop 2023-06-09T04:40:33.479 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.474+0000 7f499293a700 1 -- 172.21.15.89:0/1994133759 shutdown_connections 2023-06-09T04:40:33.479 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.474+0000 7f499293a700 1 --2- 172.21.15.89:0/1994133759 >> v2:172.21.15.62:3300/0 conn(0x7f498c06ad20 0x7f498c06b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:33.479 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.474+0000 7f499293a700 1 --2- 172.21.15.89:0/1994133759 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f498c0af240 0x7f498c0af650 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:33.479 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.474+0000 7f499293a700 1 --2- 172.21.15.89:0/1994133759 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f498c0d0270 0x7f498c0d0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:33.479 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.474+0000 7f499293a700 1 -- 172.21.15.89:0/1994133759 >> 172.21.15.89:0/1994133759 conn(0x7f498c089fc0 msgr2=0x7f498c09b950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:40:33.479 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.474+0000 7f499293a700 1 -- 172.21.15.89:0/1994133759 shutdown_connections 2023-06-09T04:40:33.480 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.474+0000 7f499293a700 1 -- 172.21.15.89:0/1994133759 wait complete. 2023-06-09T04:40:33.481 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.478+0000 7f499293a700 1 Processor -- start 2023-06-09T04:40:33.482 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.478+0000 7f499293a700 1 -- start start 2023-06-09T04:40:33.483 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.482+0000 7f499293a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f498c06ad20 0x7f498c1e5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:33.483 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.482+0000 7f499293a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f498c0af240 0x7f498c09d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:33.483 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.482+0000 7f499293a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f498c0d0270 0x7f498c1e70a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:33.483 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.482+0000 7f499293a700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f498c09dbb0 con 0x7f498c0af240 2023-06-09T04:40:33.484 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.482+0000 7f499293a700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f498c09de90 con 0x7f498c06ad20 2023-06-09T04:40:33.484 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.482+0000 7f499293a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f498c09e170 con 0x7f498c0d0270 2023-06-09T04:40:33.484 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.482+0000 7f498bfff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f498c06ad20 0x7f498c1e5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:33.485 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.482+0000 7f498bfff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f498c06ad20 0x7f498c1e5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34582/0 (socket says 172.21.15.89:34582) 2023-06-09T04:40:33.485 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.482+0000 7f498bfff700 1 -- 172.21.15.89:0/2533924382 learned_addr learned my addr 172.21.15.89:0/2533924382 (peer_addr_for_me v2:172.21.15.89:0/0) 2023-06-09T04:40:33.485 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.482+0000 7f4990ed7700 1 --2- 172.21.15.89:0/2533924382 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f498c0d0270 0x7f498c1e70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:33.485 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.482+0000 7f4983fff700 1 --2- 172.21.15.89:0/2533924382 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f498c0af240 0x7f498c09d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:33.485 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.482+0000 7f498bfff700 1 -- 172.21.15.89:0/2533924382 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f498c0d0270 msgr2=0x7f498c1e70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:33.485 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.482+0000 7f498bfff700 1 --2- 172.21.15.89:0/2533924382 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f498c0d0270 0x7f498c1e70a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:33.485 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.482+0000 7f498bfff700 1 -- 172.21.15.89:0/2533924382 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f498c0af240 msgr2=0x7f498c09d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:33.486 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.482+0000 7f498bfff700 1 --2- 172.21.15.89:0/2533924382 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f498c0af240 0x7f498c09d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:33.486 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.482+0000 7f498bfff700 1 -- 172.21.15.89:0/2533924382 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4974009570 con 0x7f498c06ad20 2023-06-09T04:40:33.486 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.482+0000 7f4983fff700 1 --2- 172.21.15.89:0/2533924382 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f498c0af240 0x7f498c09d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:40:33.486 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.482+0000 7f498bfff700 1 --2- 172.21.15.89:0/2533924382 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f498c06ad20 0x7f498c1e5cb0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f497400e9d0 tx=0x7f497400ece0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:33.487 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.482+0000 7f49897fa700 1 -- 172.21.15.89:0/2533924382 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497400c850 con 0x7f498c06ad20 2023-06-09T04:40:33.487 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.482+0000 7f49897fa700 1 -- 172.21.15.89:0/2533924382 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f497400c9b0 con 0x7f498c06ad20 2023-06-09T04:40:33.487 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.482+0000 7f499293a700 1 -- 172.21.15.89:0/2533924382 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f497c0094b0 con 0x7f498c06ad20 2023-06-09T04:40:33.487 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.482+0000 7f49897fa700 1 -- 172.21.15.89:0/2533924382 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f497400cd20 con 0x7f498c06ad20 2023-06-09T04:40:33.487 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.482+0000 7f499293a700 1 -- 172.21.15.89:0/2533924382 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f498c09e730 con 0x7f498c06ad20 2023-06-09T04:40:33.487 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.482+0000 7f49897fa700 1 -- 172.21.15.89:0/2533924382 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f4974005d40 con 0x7f498c06ad20 2023-06-09T04:40:33.488 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.482+0000 7f49897fa700 1 -- 172.21.15.89:0/2533924382 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f4974006840 con 0x7f498c06ad20 2023-06-09T04:40:33.488 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.486+0000 7f499293a700 1 -- 172.21.15.89:0/2533924382 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f498c0739c0 con 0x7f498c06ad20 2023-06-09T04:40:33.489 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.486+0000 7f49897fa700 1 -- 172.21.15.89:0/2533924382 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f4974021060 con 0x7f498c06ad20 2023-06-09T04:40:33.566 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-06-09T04:40:33.560+0000 7f5964e692c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-06-09T04:40:33.567 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.566+0000 7f499293a700 1 -- 172.21.15.89:0/2533924382 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd new", "uuid": "6ed732e9-33ff-40df-9038-a9f1d1622671", "id": 7} v 0) v1 -- 0x7f498c06c360 con 0x7f498c06ad20 2023-06-09T04:40:33.577 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.574+0000 7f49897fa700 1 -- 172.21.15.89:0/2533924382 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6ed732e9-33ff-40df-9038-a9f1d1622671", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4974029020 con 0x7f498c06ad20 2023-06-09T04:40:33.577 INFO:teuthology.orchestra.run.smithi089.stdout:7 2023-06-09T04:40:33.579 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.578+0000 7f499293a700 1 -- 172.21.15.89:0/2533924382 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f498c06ad20 msgr2=0x7f498c1e5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:33.579 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.578+0000 7f499293a700 1 --2- 172.21.15.89:0/2533924382 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f498c06ad20 0x7f498c1e5cb0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f497400e9d0 tx=0x7f497400ece0 comp rx=0 tx=0).stop 2023-06-09T04:40:33.579 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.578+0000 7f499293a700 1 -- 172.21.15.89:0/2533924382 shutdown_connections 2023-06-09T04:40:33.579 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.578+0000 7f499293a700 1 --2- 172.21.15.89:0/2533924382 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f498c0d0270 0x7f498c1e70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:33.579 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.578+0000 7f499293a700 1 --2- 172.21.15.89:0/2533924382 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f498c0af240 0x7f498c09d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:33.580 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.578+0000 7f499293a700 1 --2- 172.21.15.89:0/2533924382 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f498c06ad20 0x7f498c1e5cb0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:33.580 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.578+0000 7f499293a700 1 -- 172.21.15.89:0/2533924382 >> 172.21.15.89:0/2533924382 conn(0x7f498c089fc0 msgr2=0x7f498c0c9800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:40:33.580 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.578+0000 7f499293a700 1 -- 172.21.15.89:0/2533924382 shutdown_connections 2023-06-09T04:40:33.580 INFO:teuthology.orchestra.run.smithi089.stderr:2023-06-09T04:40:33.578+0000 7f499293a700 1 -- 172.21.15.89:0/2533924382 wait complete. 2023-06-09T04:40:33.581 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-06-09T04:40:33.578+0000 7f1ef18002c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-06-09T04:40:33.597 INFO:tasks.ceph.osd.0:Restarting daemon 2023-06-09T04:40:33.598 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-06-09T04:40:33.604 INFO:tasks.ceph.osd.0:Started 2023-06-09T04:40:33.604 INFO:tasks.ceph.osd.1:Restarting daemon 2023-06-09T04:40:33.605 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-06-09T04:40:33.609 INFO:tasks.ceph.osd.1:Started 2023-06-09T04:40:33.609 INFO:tasks.ceph.osd.2:Restarting daemon 2023-06-09T04:40:33.609 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-06-09T04:40:33.613 INFO:tasks.ceph.osd.2:Started 2023-06-09T04:40:33.613 INFO:tasks.ceph.osd.3:Restarting daemon 2023-06-09T04:40:33.614 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-06-09T04:40:33.619 INFO:tasks.ceph.osd.3:Started 2023-06-09T04:40:33.619 INFO:tasks.ceph.osd.4:Restarting daemon 2023-06-09T04:40:33.619 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-06-09T04:40:33.626 INFO:tasks.ceph.osd.4:Started 2023-06-09T04:40:33.626 INFO:tasks.ceph.osd.5:Restarting daemon 2023-06-09T04:40:33.627 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-06-09T04:40:33.630 INFO:tasks.ceph.osd.5:Started 2023-06-09T04:40:33.630 INFO:tasks.ceph.osd.6:Restarting daemon 2023-06-09T04:40:33.631 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-06-09T04:40:33.635 INFO:tasks.ceph.osd.6:Started 2023-06-09T04:40:33.635 INFO:tasks.ceph.osd.7:Restarting daemon 2023-06-09T04:40:33.636 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-06-09T04:40:33.641 INFO:tasks.ceph.osd.7:Started 2023-06-09T04:40:33.641 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:40:33.819 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-06-09T04:40:33.818+0000 7f1ef18002c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-06-09T04:40:33.821 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-06-09T04:40:33.816+0000 7f5964e692c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-06-09T04:40:33.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.836+0000 7f6a5d019700 1 Processor -- start 2023-06-09T04:40:33.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.836+0000 7f6a5d019700 1 -- start start 2023-06-09T04:40:33.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.836+0000 7f6a5d019700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6a58159a40 0x7f6a580cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:33.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.836+0000 7f6a5d019700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a58071180 con 0x7f6a580c9ea0 2023-06-09T04:40:33.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.836+0000 7f6a5d019700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a580cc180 con 0x7f6a580cd4f0 2023-06-09T04:40:33.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.836+0000 7f6a5d019700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a580cbc00 con 0x7f6a58159a40 2023-06-09T04:40:33.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.836+0000 7f6a5c818700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f6a580c9ea0 0x7f6a5815d6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:58910/0 (socket says 172.21.15.62:58910) 2023-06-09T04:40:33.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.836+0000 7f6a5c818700 1 -- 172.21.15.62:0/3261747445 learned_addr learned my addr 172.21.15.62:0/3261747445 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:40:33.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.836+0000 7f6a57fff700 1 --2- 172.21.15.62:0/3261747445 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6a58159a40 0x7f6a580cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:33.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.836+0000 7f6a56ffd700 1 -- 172.21.15.62:0/3261747445 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1009565209 0 0) 0x7f6a50001490 con 0x7f6a580c9ea0 2023-06-09T04:40:33.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.836+0000 7f6a56ffd700 1 -- 172.21.15.62:0/3261747445 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a400035d0 con 0x7f6a580c9ea0 2023-06-09T04:40:33.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.836+0000 7f6a56ffd700 1 -- 172.21.15.62:0/3261747445 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2128480005 0 0) 0x7f6a400035d0 con 0x7f6a580c9ea0 2023-06-09T04:40:33.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.836+0000 7f6a56ffd700 1 -- 172.21.15.62:0/3261747445 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6a58159a40 msgr2=0x7f6a580cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:40:33.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.836+0000 7f6a56ffd700 1 --2- 172.21.15.62:0/3261747445 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6a58159a40 0x7f6a580cc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:33.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.836+0000 7f6a56ffd700 1 -- 172.21.15.62:0/3261747445 >> v1:172.21.15.89:6789/0 conn(0x7f6a580cd4f0 legacy=0x7f6a58070a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:33.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.836+0000 7f6a56ffd700 1 -- 172.21.15.62:0/3261747445 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a580713c0 con 0x7f6a580c9ea0 2023-06-09T04:40:33.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.836+0000 7f6a56ffd700 1 -- 172.21.15.62:0/3261747445 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 540845019 0 0) 0x7f6a50001b80 con 0x7f6a580c9ea0 2023-06-09T04:40:33.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.836+0000 7f6a56ffd700 1 -- 172.21.15.62:0/3261747445 >> v1:172.21.15.62:6789/0 conn(0x7f6a580c9ea0 legacy=0x7f6a5815d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:33.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.836+0000 7f6a56ffd700 1 --2- 172.21.15.62:0/3261747445 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6a40003a50 0x7f6a40003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:33.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.836+0000 7f6a56ffd700 1 --2- 172.21.15.62:0/3261747445 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a40004870 0x7f6a40004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:33.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.836+0000 7f6a56ffd700 1 --2- 172.21.15.62:0/3261747445 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a40005270 0x7f6a4000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:33.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.840+0000 7f6a56ffd700 1 -- 172.21.15.62:0/3261747445 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a580cbc00 con 0x7f6a40005270 2023-06-09T04:40:33.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.840+0000 7f6a56ffd700 1 -- 172.21.15.62:0/3261747445 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4000c160 con 0x7f6a40004870 2023-06-09T04:40:33.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.840+0000 7f6a56ffd700 1 -- 172.21.15.62:0/3261747445 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4000c320 con 0x7f6a40003a50 2023-06-09T04:40:33.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.840+0000 7f6a5c818700 1 --2- 172.21.15.62:0/3261747445 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a40005270 0x7f6a4000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:33.847 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.840+0000 7f6a577fe700 1 --2- 172.21.15.62:0/3261747445 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a40004870 0x7f6a40004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:33.847 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.840+0000 7f6a57fff700 1 --2- 172.21.15.62:0/3261747445 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6a40003a50 0x7f6a40003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:33.847 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.840+0000 7f6a5c818700 1 -- 172.21.15.62:0/3261747445 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6a40003a50 msgr2=0x7f6a40003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:40:33.847 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.840+0000 7f6a5c818700 1 --2- 172.21.15.62:0/3261747445 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6a40003a50 0x7f6a40003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:33.847 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.840+0000 7f6a5c818700 1 -- 172.21.15.62:0/3261747445 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a40004870 msgr2=0x7f6a40004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:40:33.847 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.840+0000 7f6a5c818700 1 --2- 172.21.15.62:0/3261747445 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a40004870 0x7f6a40004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:33.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.840+0000 7f6a5c818700 1 -- 172.21.15.62:0/3261747445 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a400035d0 con 0x7f6a40005270 2023-06-09T04:40:33.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.840+0000 7f6a577fe700 1 --2- 172.21.15.62:0/3261747445 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a40004870 0x7f6a40004ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:40:33.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.840+0000 7f6a5c818700 1 --2- 172.21.15.62:0/3261747445 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a40005270 0x7f6a4000ba30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6a5000a830 tx=0x7f6a400058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c818e32b1374092b server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:33.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.840+0000 7f6a56ffd700 1 -- 172.21.15.62:0/3261747445 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5000a490 con 0x7f6a40005270 2023-06-09T04:40:33.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.840+0000 7f6a56ffd700 1 -- 172.21.15.62:0/3261747445 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a500072f0 con 0x7f6a40005270 2023-06-09T04:40:33.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.840+0000 7f6a56ffd700 1 -- 172.21.15.62:0/3261747445 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a500076a0 con 0x7f6a40005270 2023-06-09T04:40:33.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.840+0000 7f6a5d019700 1 -- 172.21.15.62:0/3261747445 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a40005270 msgr2=0x7f6a4000ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:33.849 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.840+0000 7f6a5d019700 1 --2- 172.21.15.62:0/3261747445 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a40005270 0x7f6a4000ba30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6a5000a830 tx=0x7f6a400058a0 comp rx=0 tx=0).stop 2023-06-09T04:40:33.849 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.840+0000 7f6a5c818700 1 -- 172.21.15.62:0/3261747445 reap_dead start 2023-06-09T04:40:33.849 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.840+0000 7f6a5d019700 1 -- 172.21.15.62:0/3261747445 shutdown_connections 2023-06-09T04:40:33.849 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.840+0000 7f6a5d019700 1 -- 172.21.15.62:0/3261747445 >> 172.21.15.62:0/3261747445 conn(0x7f6a5806a420 msgr2=0x7f6a580afc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:40:33.849 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.840+0000 7f6a5d019700 1 -- 172.21.15.62:0/3261747445 shutdown_connections 2023-06-09T04:40:33.849 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.840+0000 7f6a5d019700 1 -- 172.21.15.62:0/3261747445 wait complete. 2023-06-09T04:40:33.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.844+0000 7f6a5d019700 1 Processor -- start 2023-06-09T04:40:33.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.844+0000 7f6a5d019700 1 -- start start 2023-06-09T04:40:33.851 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.844+0000 7f6a5d019700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a5815cb50 0x7f6a581f5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:33.851 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.844+0000 7f6a5d019700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a5815cf20 0x7f6a580b1f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:33.851 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.844+0000 7f6a5d019700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6a580b24b0 0x7f6a5815a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:33.851 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.844+0000 7f6a5d019700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a580b2950 con 0x7f6a5815cf20 2023-06-09T04:40:33.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.844+0000 7f6a5d019700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a58158580 con 0x7f6a5815cb50 2023-06-09T04:40:33.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.844+0000 7f6a5d019700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a581f57d0 con 0x7f6a580b24b0 2023-06-09T04:40:33.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.844+0000 7f6a577fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a5815cf20 0x7f6a580b1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:33.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.844+0000 7f6a577fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a5815cf20 0x7f6a580b1f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:39130/0 (socket says 172.21.15.62:39130) 2023-06-09T04:40:33.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.844+0000 7f6a577fe700 1 -- 172.21.15.62:0/3788100149 learned_addr learned my addr 172.21.15.62:0/3788100149 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:40:33.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.844+0000 7f6a5c818700 1 --2- 172.21.15.62:0/3788100149 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6a580b24b0 0x7f6a5815a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:33.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.844+0000 7f6a57fff700 1 --2- 172.21.15.62:0/3788100149 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a5815cb50 0x7f6a581f5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:33.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.844+0000 7f6a577fe700 1 -- 172.21.15.62:0/3788100149 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6a580b24b0 msgr2=0x7f6a5815a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:33.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.844+0000 7f6a577fe700 1 --2- 172.21.15.62:0/3788100149 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6a580b24b0 0x7f6a5815a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:33.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.844+0000 7f6a577fe700 1 -- 172.21.15.62:0/3788100149 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a5815cb50 msgr2=0x7f6a581f5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:33.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.844+0000 7f6a577fe700 1 --2- 172.21.15.62:0/3788100149 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a5815cb50 0x7f6a581f5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:33.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.844+0000 7f6a577fe700 1 -- 172.21.15.62:0/3788100149 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a581f15a0 con 0x7f6a5815cf20 2023-06-09T04:40:33.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.844+0000 7f6a5c818700 1 --2- 172.21.15.62:0/3788100149 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6a580b24b0 0x7f6a5815a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:40:33.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.844+0000 7f6a57fff700 1 --2- 172.21.15.62:0/3788100149 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a5815cb50 0x7f6a581f5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:40:33.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.848+0000 7f6a577fe700 1 --2- 172.21.15.62:0/3788100149 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a5815cf20 0x7f6a580b1f70 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c00e7b0 tx=0x7f6a4c00eb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:33.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.848+0000 7f6a54ff9700 1 -- 172.21.15.62:0/3788100149 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4c0052e0 con 0x7f6a5815cf20 2023-06-09T04:40:33.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.848+0000 7f6a54ff9700 1 -- 172.21.15.62:0/3788100149 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a4c005440 con 0x7f6a5815cf20 2023-06-09T04:40:33.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.848+0000 7f6a54ff9700 1 -- 172.21.15.62:0/3788100149 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4c0038c0 con 0x7f6a5815cf20 2023-06-09T04:40:33.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.848+0000 7f6a5d019700 1 -- 172.21.15.62:0/3788100149 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a581f1880 con 0x7f6a5815cf20 2023-06-09T04:40:33.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.848+0000 7f6a54ff9700 1 -- 172.21.15.62:0/3788100149 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6a4c003d20 con 0x7f6a5815cf20 2023-06-09T04:40:33.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.848+0000 7f6a5d019700 1 -- 172.21.15.62:0/3788100149 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a581f1e40 con 0x7f6a5815cf20 2023-06-09T04:40:33.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.848+0000 7f6a54ff9700 1 -- 172.21.15.62:0/3788100149 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f6a4c013af0 con 0x7f6a5815cf20 2023-06-09T04:40:33.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.848+0000 7f6a5d019700 1 -- 172.21.15.62:0/3788100149 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a580739c0 con 0x7f6a5815cf20 2023-06-09T04:40:33.857 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.852+0000 7f6a54ff9700 1 -- 172.21.15.62:0/3788100149 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f6a4c001330 con 0x7f6a5815cf20 2023-06-09T04:40:33.915 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-06-09T04:40:33.914+0000 7f1ef18002c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-06-09T04:40:33.923 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-06-09T04:40:33.920+0000 7f5964e692c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-06-09T04:40:33.955 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.948+0000 7f6a5d019700 1 -- 172.21.15.62:0/3788100149 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6a580cd0a0 con 0x7f6a5815cf20 2023-06-09T04:40:33.956 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.952+0000 7f6a54ff9700 1 -- 172.21.15.62:0/3788100149 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f6a4c02c090 con 0x7f6a5815cf20 2023-06-09T04:40:33.957 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:40:33.957 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":10,"fsid":"f7998a1e-e5a9-4202-abaa-70c0eaae1047","created":"2023-06-09T04:40:30.469588+0000","modified":"2023-06-09T04:40:33.568221+0000","last_up_change":"0.000000","last_in_change":"2023-06-09T04:40:33.568221+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"bc50bbc0-dd08-42ed-804c-ec3029e36c19","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8230b12d-e22f-4985-a584-4cc64404cdbf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d0202506-dbe9-4e3c-9271-687929abf96a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"f3c0298a-b075-4411-af50-e16cd74fdddb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"1ab5c5ca-e74f-475a-a309-683cc0029928","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"a933e184-bd8f-4369-a1ba-a68de53c578c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"1ed7ad37-2eee-49a6-954c-b537e2b7f0ed","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"6ed732e9-33ff-40df-9038-a9f1d1622671","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:40:33.959 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.952+0000 7f6a5d019700 1 -- 172.21.15.62:0/3788100149 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a5815cf20 msgr2=0x7f6a580b1f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:33.959 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.952+0000 7f6a5d019700 1 --2- 172.21.15.62:0/3788100149 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a5815cf20 0x7f6a580b1f70 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c00e7b0 tx=0x7f6a4c00eb70 comp rx=0 tx=0).stop 2023-06-09T04:40:33.959 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.952+0000 7f6a5d019700 1 -- 172.21.15.62:0/3788100149 shutdown_connections 2023-06-09T04:40:33.959 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.952+0000 7f6a5d019700 1 --2- 172.21.15.62:0/3788100149 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6a580b24b0 0x7f6a5815a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:33.959 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.952+0000 7f6a5d019700 1 --2- 172.21.15.62:0/3788100149 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a5815cf20 0x7f6a580b1f70 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:33.960 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.952+0000 7f6a5d019700 1 --2- 172.21.15.62:0/3788100149 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a5815cb50 0x7f6a581f5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:33.960 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.952+0000 7f6a5d019700 1 -- 172.21.15.62:0/3788100149 >> 172.21.15.62:0/3788100149 conn(0x7f6a40005270 msgr2=0x7f6a5806cfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:40:33.960 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.956+0000 7f6a5d019700 1 -- 172.21.15.62:0/3788100149 shutdown_connections 2023-06-09T04:40:33.960 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:33.956+0000 7f6a5d019700 1 -- 172.21.15.62:0/3788100149 wait complete. 2023-06-09T04:40:33.979 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-06-09T04:40:33.979 INFO:tasks.ceph:Waiting for OSDs to come up 2023-06-09T04:40:33.996 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-06-09T04:40:33.994+0000 7f1ef18002c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-06-09T04:40:34.007 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-06-09T04:40:34.000+0000 7f5964e692c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-06-09T04:40:34.282 INFO:tasks.ceph.osd.0.smithi062.stderr:2023-06-09T04:40:34.276+0000 7fa055e7f700 -1 Falling back to public interface 2023-06-09T04:40:34.283 INFO:tasks.ceph.osd.2.smithi062.stderr:2023-06-09T04:40:34.276+0000 7f9e399a6700 -1 Falling back to public interface 2023-06-09T04:40:34.301 INFO:tasks.ceph.osd.3.smithi062.stderr:2023-06-09T04:40:34.296+0000 7fb4b2607700 -1 Falling back to public interface 2023-06-09T04:40:34.301 INFO:tasks.ceph.osd.7.smithi089.stderr:2023-06-09T04:40:34.298+0000 7ff7d0212700 -1 Falling back to public interface 2023-06-09T04:40:34.326 INFO:tasks.ceph.osd.6.smithi089.stderr:2023-06-09T04:40:34.322+0000 7f68365c8700 -1 Falling back to public interface 2023-06-09T04:40:34.339 INFO:tasks.ceph.osd.4.smithi089.stderr:2023-06-09T04:40:34.338+0000 7f3afd00b700 -1 Falling back to public interface 2023-06-09T04:40:34.346 INFO:tasks.ceph.osd.1.smithi062.stderr:2023-06-09T04:40:34.340+0000 7f51f2607700 -1 Falling back to public interface 2023-06-09T04:40:34.364 INFO:tasks.ceph.osd.5.smithi089.stderr:2023-06-09T04:40:34.362+0000 7fa3011f4700 -1 Falling back to public interface 2023-06-09T04:40:34.783 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-06-09T04:40:34.797 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-06-09T04:40:34.792+0000 7f5964e692c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-06-09T04:40:34.825 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-06-09T04:40:34.822+0000 7f1ef18002c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-06-09T04:40:34.886 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-06-09T04:40:34.880+0000 7f5964e692c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-06-09T04:40:34.905 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-06-09T04:40:34.902+0000 7f1ef18002c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-06-09T04:40:34.934 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:34.928+0000 7f78abfae700 1 Processor -- start 2023-06-09T04:40:34.934 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:34.928+0000 7f78abfae700 1 -- start start 2023-06-09T04:40:34.936 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:34.932+0000 7f78abfae700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f78a406c5c0 0x7f78a406a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:34.936 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:34.932+0000 7f78abfae700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f78a4070520 0x7f78a40caf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:34.936 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:34.932+0000 7f78abfae700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78a406a8f0 con 0x7f78a4159cb0 2023-06-09T04:40:34.936 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:34.932+0000 7f78abfae700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78a415a080 con 0x7f78a4070520 2023-06-09T04:40:34.936 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:34.932+0000 7f78abfae700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78a406b100 con 0x7f78a406c5c0 2023-06-09T04:40:34.937 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:34.932+0000 7f78aa54b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f78a4070520 0x7f78a40caf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:34.937 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:34.932+0000 7f78aa54b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f78a4070520 0x7f78a40caf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:39142/0 (socket says 172.21.15.62:39142) 2023-06-09T04:40:34.938 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:34.932+0000 7f78aa54b700 1 -- 172.21.15.62:0/657390130 learned_addr learned my addr 172.21.15.62:0/657390130 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:40:34.938 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:34.932+0000 7f78a9549700 1 --2- 172.21.15.62:0/657390130 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f78a406c5c0 0x7f78a406a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:34.938 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:34.932+0000 7f78aa54b700 1 -- 172.21.15.62:0/657390130 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f78a406c5c0 msgr2=0x7f78a406a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:40:34.938 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:34.932+0000 7f78aa54b700 1 --2- 172.21.15.62:0/657390130 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f78a406c5c0 0x7f78a406a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:34.938 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:34.932+0000 7f78aa54b700 1 -- 172.21.15.62:0/657390130 >> v1:172.21.15.62:6789/0 conn(0x7f78a4159cb0 legacy=0x7f78a406beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:40:34.938 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:34.932+0000 7f78aa54b700 1 -- 172.21.15.62:0/657390130 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a40ca7a0 con 0x7f78a4070520 2023-06-09T04:40:34.938 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:34.932+0000 7f78aa54b700 1 --2- 172.21.15.62:0/657390130 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78a4070520 0x7f78a40caf20 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f789c009e50 tx=0x7f789c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3073bd0cbb32c01c server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:34.939 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:34.932+0000 7f78a8d48700 1 -- 172.21.15.62:0/657390130 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789c00e070 con 0x7f78a4070520 2023-06-09T04:40:34.939 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:34.932+0000 7f78a8d48700 1 -- 172.21.15.62:0/657390130 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f789c00b9c0 con 0x7f78a4070520 2023-06-09T04:40:34.939 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:34.932+0000 7f78a8d48700 1 -- 172.21.15.62:0/657390130 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789c00bd70 con 0x7f78a4070520 2023-06-09T04:40:34.940 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:34.932+0000 7f78abfae700 1 -- 172.21.15.62:0/657390130 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78a4070520 msgr2=0x7f78a40caf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:34.940 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:34.932+0000 7f78abfae700 1 --2- 172.21.15.62:0/657390130 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78a4070520 0x7f78a40caf20 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f789c009e50 tx=0x7f789c00b330 comp rx=0 tx=0).stop 2023-06-09T04:40:34.940 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:34.932+0000 7f78abfae700 1 -- 172.21.15.62:0/657390130 shutdown_connections 2023-06-09T04:40:34.940 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:34.932+0000 7f78abfae700 1 --2- 172.21.15.62:0/657390130 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78a4070520 0x7f78a40caf20 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:34.940 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:34.932+0000 7f78abfae700 1 --2- 172.21.15.62:0/657390130 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f78a406c5c0 0x7f78a406a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:34.940 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:34.932+0000 7f78abfae700 1 -- 172.21.15.62:0/657390130 >> 172.21.15.62:0/657390130 conn(0x7f78a40ceb00 msgr2=0x7f78a40ceed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:40:34.940 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:34.932+0000 7f78abfae700 1 -- 172.21.15.62:0/657390130 shutdown_connections 2023-06-09T04:40:34.941 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:34.932+0000 7f78abfae700 1 -- 172.21.15.62:0/657390130 wait complete. 2023-06-09T04:40:34.942 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:34.936+0000 7f78abfae700 1 Processor -- start 2023-06-09T04:40:34.942 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:34.936+0000 7f78abfae700 1 -- start start 2023-06-09T04:40:34.943 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:34.940+0000 7f78abfae700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78a406c5c0 0x7f78a414d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:34.944 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:34.940+0000 7f78abfae700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f78a4070520 0x7f78a41f2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:34.944 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:34.940+0000 7f78abfae700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78a4159cb0 0x7f78a40c7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:34.944 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:34.940+0000 7f78abfae700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a414e5c0 con 0x7f78a4159cb0 2023-06-09T04:40:34.944 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:34.940+0000 7f78abfae700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a414e2e0 con 0x7f78a406c5c0 2023-06-09T04:40:34.944 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:34.940+0000 7f78abfae700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78a40cc870 con 0x7f78a4070520 2023-06-09T04:40:34.945 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:34.940+0000 7f78aa54b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78a4159cb0 0x7f78a40c7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:34.946 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:34.940+0000 7f78aa54b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78a4159cb0 0x7f78a40c7e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:39144/0 (socket says 172.21.15.62:39144) 2023-06-09T04:40:34.946 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:34.940+0000 7f78aa54b700 1 -- 172.21.15.62:0/1449178310 learned_addr learned my addr 172.21.15.62:0/1449178310 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:40:34.946 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:34.940+0000 7f78a9d4a700 1 --2- 172.21.15.62:0/1449178310 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78a406c5c0 0x7f78a414d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:34.946 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:34.940+0000 7f78a9549700 1 --2- 172.21.15.62:0/1449178310 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f78a4070520 0x7f78a41f2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:34.946 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:34.940+0000 7f78aa54b700 1 -- 172.21.15.62:0/1449178310 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f78a4070520 msgr2=0x7f78a41f2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:34.946 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:34.940+0000 7f78aa54b700 1 --2- 172.21.15.62:0/1449178310 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f78a4070520 0x7f78a41f2520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:34.946 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:34.940+0000 7f78aa54b700 1 -- 172.21.15.62:0/1449178310 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78a406c5c0 msgr2=0x7f78a414d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:34.947 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:34.940+0000 7f78aa54b700 1 --2- 172.21.15.62:0/1449178310 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78a406c5c0 0x7f78a414d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:34.947 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:34.940+0000 7f78aa54b700 1 -- 172.21.15.62:0/1449178310 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f789c009b30 con 0x7f78a4159cb0 2023-06-09T04:40:34.947 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:34.940+0000 7f78aa54b700 1 --2- 172.21.15.62:0/1449178310 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78a4159cb0 0x7f78a40c7e70 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f789c00b730 tx=0x7f789c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:34.947 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:34.940+0000 7f78967fc700 1 -- 172.21.15.62:0/1449178310 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789c0092e0 con 0x7f78a4159cb0 2023-06-09T04:40:34.947 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:34.940+0000 7f78967fc700 1 -- 172.21.15.62:0/1449178310 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f789c003e30 con 0x7f78a4159cb0 2023-06-09T04:40:34.947 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:34.940+0000 7f78abfae700 1 -- 172.21.15.62:0/1449178310 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78a40ccb50 con 0x7f78a4159cb0 2023-06-09T04:40:34.947 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:34.940+0000 7f78967fc700 1 -- 172.21.15.62:0/1449178310 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789c01c6a0 con 0x7f78a4159cb0 2023-06-09T04:40:34.947 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:34.940+0000 7f78abfae700 1 -- 172.21.15.62:0/1449178310 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78a414deb0 con 0x7f78a4159cb0 2023-06-09T04:40:34.948 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:34.940+0000 7f78967fc700 1 -- 172.21.15.62:0/1449178310 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f789c01cb00 con 0x7f78a4159cb0 2023-06-09T04:40:34.948 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:34.940+0000 7f78967fc700 1 -- 172.21.15.62:0/1449178310 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f789c0094d0 con 0x7f78a4159cb0 2023-06-09T04:40:34.948 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:34.940+0000 7f78abfae700 1 -- 172.21.15.62:0/1449178310 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78a40cc6d0 con 0x7f78a4159cb0 2023-06-09T04:40:34.952 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:34.948+0000 7f78967fc700 1 -- 172.21.15.62:0/1449178310 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f78a40cc6d0 con 0x7f78a4159cb0 2023-06-09T04:40:35.023 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:35.020+0000 7f78abfae700 1 -- 172.21.15.62:0/1449178310 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f78a40cd070 con 0x7f78a4159cb0 2023-06-09T04:40:35.025 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:35.020+0000 7f78967fc700 1 -- 172.21.15.62:0/1449178310 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f78a40cd070 con 0x7f78a4159cb0 2023-06-09T04:40:35.025 INFO:teuthology.misc.health.smithi062.stdout: 2023-06-09T04:40:35.025 INFO:teuthology.misc.health.smithi062.stdout:{"epoch":10,"fsid":"f7998a1e-e5a9-4202-abaa-70c0eaae1047","created":"2023-06-09T04:40:30.469588+0000","modified":"2023-06-09T04:40:33.568221+0000","last_up_change":"0.000000","last_in_change":"2023-06-09T04:40:33.568221+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"bc50bbc0-dd08-42ed-804c-ec3029e36c19","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8230b12d-e22f-4985-a584-4cc64404cdbf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d0202506-dbe9-4e3c-9271-687929abf96a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"f3c0298a-b075-4411-af50-e16cd74fdddb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"1ab5c5ca-e74f-475a-a309-683cc0029928","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"a933e184-bd8f-4369-a1ba-a68de53c578c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"1ed7ad37-2eee-49a6-954c-b537e2b7f0ed","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"6ed732e9-33ff-40df-9038-a9f1d1622671","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:40:35.026 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:35.020+0000 7f78abfae700 1 -- 172.21.15.62:0/1449178310 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78a4159cb0 msgr2=0x7f78a40c7e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:35.026 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:35.020+0000 7f78abfae700 1 --2- 172.21.15.62:0/1449178310 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78a4159cb0 0x7f78a40c7e70 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f789c00b730 tx=0x7f789c004af0 comp rx=0 tx=0).stop 2023-06-09T04:40:35.027 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:35.020+0000 7f78abfae700 1 -- 172.21.15.62:0/1449178310 shutdown_connections 2023-06-09T04:40:35.027 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:35.020+0000 7f78abfae700 1 --2- 172.21.15.62:0/1449178310 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78a4159cb0 0x7f78a40c7e70 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:35.027 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:35.020+0000 7f78abfae700 1 --2- 172.21.15.62:0/1449178310 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f78a4070520 0x7f78a41f2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:35.027 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:35.020+0000 7f78abfae700 1 --2- 172.21.15.62:0/1449178310 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78a406c5c0 0x7f78a414d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:35.027 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:35.020+0000 7f78abfae700 1 -- 172.21.15.62:0/1449178310 >> 172.21.15.62:0/1449178310 conn(0x7f78a40ceb00 msgr2=0x7f78a40b3b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:40:35.027 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:35.020+0000 7f78abfae700 1 -- 172.21.15.62:0/1449178310 shutdown_connections 2023-06-09T04:40:35.027 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:35.020+0000 7f78abfae700 1 -- 172.21.15.62:0/1449178310 wait complete. 2023-06-09T04:40:35.042 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-06-09T04:40:35.073 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-06-09T04:40:35.068+0000 7f5964e692c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-06-09T04:40:35.153 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-06-09T04:40:35.150+0000 7f1ef18002c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-06-09T04:40:35.164 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-06-09T04:40:35.160+0000 7f5964e692c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-06-09T04:40:35.232 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-06-09T04:40:35.230+0000 7f1ef18002c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-06-09T04:40:35.270 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-06-09T04:40:35.264+0000 7f5964e692c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-06-09T04:40:35.327 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-06-09T04:40:35.326+0000 7f1ef18002c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-06-09T04:40:35.501 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-06-09T04:40:35.496+0000 7f5964e692c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-06-09T04:40:35.528 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-06-09T04:40:35.526+0000 7f1ef18002c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-06-09T04:40:35.768 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-06-09T04:40:35.766+0000 7f1ef18002c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-06-09T04:40:35.773 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-06-09T04:40:35.768+0000 7f5964e692c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-06-09T04:40:36.530 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-06-09T04:40:36.526+0000 7f1ef18002c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-06-09T04:40:36.618 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-06-09T04:40:36.612+0000 7f5964e692c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-06-09T04:40:37.570 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-06-09T04:40:37.566+0000 7f1ed8ab2700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-06-09T04:40:37.570 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-06-09T04:40:37.570+0000 7f1ed8ab2700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-06-09T04:40:38.056 INFO:tasks.ceph.osd.4.smithi089.stderr:2023-06-09T04:40:38.054+0000 7f3afd00b700 -1 osd.4 0 log_to_monitors true 2023-06-09T04:40:38.196 INFO:tasks.ceph.osd.2.smithi062.stderr:2023-06-09T04:40:38.192+0000 7f9e399a6700 -1 osd.2 0 log_to_monitors true 2023-06-09T04:40:38.240 INFO:tasks.ceph.osd.3.smithi062.stderr:2023-06-09T04:40:38.236+0000 7fb4b2607700 -1 osd.3 0 log_to_monitors true 2023-06-09T04:40:38.282 INFO:tasks.ceph.osd.0.smithi062.stderr:2023-06-09T04:40:38.276+0000 7fa055e7f700 -1 osd.0 0 log_to_monitors true 2023-06-09T04:40:38.289 INFO:tasks.ceph.osd.7.smithi089.stderr:2023-06-09T04:40:38.286+0000 7ff7d0212700 -1 osd.7 0 log_to_monitors true 2023-06-09T04:40:38.321 INFO:tasks.ceph.osd.6.smithi089.stderr:2023-06-09T04:40:38.318+0000 7f68365c8700 -1 osd.6 0 log_to_monitors true 2023-06-09T04:40:38.340 INFO:tasks.ceph.osd.5.smithi089.stderr:2023-06-09T04:40:38.338+0000 7fa3011f4700 -1 osd.5 0 log_to_monitors true 2023-06-09T04:40:38.367 INFO:tasks.ceph.osd.1.smithi062.stderr:2023-06-09T04:40:38.360+0000 7f51f2607700 -1 osd.1 0 log_to_monitors true 2023-06-09T04:40:41.847 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-06-09T04:40:42.060 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:42.056+0000 7f1fb5691700 1 Processor -- start 2023-06-09T04:40:42.063 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:42.056+0000 7f1fb5691700 1 -- start start 2023-06-09T04:40:42.063 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:42.056+0000 7f1fb5691700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1fb00ad6a0 0x7f1fb00c1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:42.063 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:42.056+0000 7f1fb5691700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1fb0071280 0x7f1fb00c1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:42.063 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:42.060+0000 7f1fb5691700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fb00701e0 con 0x7f1fb01601c0 2023-06-09T04:40:42.064 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:42.060+0000 7f1fb5691700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fb00704c0 con 0x7f1fb00ad6a0 2023-06-09T04:40:42.064 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:42.060+0000 7f1fb5691700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb00707a0 con 0x7f1fb0071280 2023-06-09T04:40:42.064 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:42.060+0000 7f1faeffd700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f1fb01601c0 0x7f1fb00acf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.62:33516/0 (socket says 172.21.15.62:33516) 2023-06-09T04:40:42.065 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:42.060+0000 7f1faf7fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1fb0071280 0x7f1fb00c1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:42.065 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:42.060+0000 7f1fae7fc700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1fb00ad6a0 0x7f1fb00c1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:42.065 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:42.060+0000 7f1faeffd700 1 -- 172.21.15.62:0/3351523577 learned_addr learned my addr 172.21.15.62:0/3351523577 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:40:42.065 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:42.060+0000 7f1faf7fe700 1 -- 172.21.15.62:0/3351523577 >> v2:172.21.15.62:3300/0 conn(0x7f1fb00ad6a0 msgr2=0x7f1fb00c1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:40:42.066 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:42.060+0000 7f1faf7fe700 1 --2- 172.21.15.62:0/3351523577 >> v2:172.21.15.62:3300/0 conn(0x7f1fb00ad6a0 0x7f1fb00c1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:42.066 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:42.060+0000 7f1faf7fe700 1 -- 172.21.15.62:0/3351523577 >> v1:172.21.15.89:6789/0 conn(0x7f1fb01601c0 legacy=0x7f1fb00acf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:42.066 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:42.060+0000 7f1faf7fe700 1 -- 172.21.15.62:0/3351523577 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fb0070a80 con 0x7f1fb0071280 2023-06-09T04:40:42.066 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:42.060+0000 7f1fadffb700 1 -- 172.21.15.62:0/3351523577 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3212086956 0 0) 0x7f1fb00701e0 con 0x7f1fb01601c0 2023-06-09T04:40:42.066 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:42.060+0000 7f1fae7fc700 1 --2- 172.21.15.62:0/3351523577 >> v2:172.21.15.62:3300/0 conn(0x7f1fb00ad6a0 0x7f1fb00c1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:40:42.066 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:42.060+0000 7f1faf7fe700 1 --2- 172.21.15.62:0/3351523577 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1fb0071280 0x7f1fb00c1560 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1fa8009d90 tx=0x7f1fa800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bfd1be8dc72690ff server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:42.067 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:42.060+0000 7f1fadffb700 1 -- 172.21.15.62:0/3351523577 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa800e070 con 0x7f1fb0071280 2023-06-09T04:40:42.067 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:42.060+0000 7f1fadffb700 1 -- 172.21.15.62:0/3351523577 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fa800bb20 con 0x7f1fb0071280 2023-06-09T04:40:42.067 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:42.060+0000 7f1fadffb700 1 -- 172.21.15.62:0/3351523577 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa8012430 con 0x7f1fb0071280 2023-06-09T04:40:42.067 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:42.060+0000 7f1fb5691700 1 -- 172.21.15.62:0/3351523577 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1fb0071280 msgr2=0x7f1fb00c1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:42.068 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:42.060+0000 7f1fb5691700 1 --2- 172.21.15.62:0/3351523577 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1fb0071280 0x7f1fb00c1560 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1fa8009d90 tx=0x7f1fa800b330 comp rx=0 tx=0).stop 2023-06-09T04:40:42.068 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:42.064+0000 7f1fb5691700 1 -- 172.21.15.62:0/3351523577 shutdown_connections 2023-06-09T04:40:42.068 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:42.064+0000 7f1fb5691700 1 --2- 172.21.15.62:0/3351523577 >> v2:172.21.15.62:3300/0 conn(0x7f1fb00ad6a0 0x7f1fb00c1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:42.068 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:42.064+0000 7f1fb5691700 1 --2- 172.21.15.62:0/3351523577 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1fb0071280 0x7f1fb00c1560 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:42.068 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:42.064+0000 7f1fb5691700 1 -- 172.21.15.62:0/3351523577 >> 172.21.15.62:0/3351523577 conn(0x7f1fb00caad0 msgr2=0x7f1fb00caea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:40:42.068 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:42.064+0000 7f1fb5691700 1 -- 172.21.15.62:0/3351523577 shutdown_connections 2023-06-09T04:40:42.069 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:42.064+0000 7f1fb5691700 1 -- 172.21.15.62:0/3351523577 wait complete. 2023-06-09T04:40:42.069 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:42.064+0000 7f1fb5691700 1 Processor -- start 2023-06-09T04:40:42.070 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:42.064+0000 7f1fb5691700 1 -- start start 2023-06-09T04:40:42.071 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:42.068+0000 7f1fb5691700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1fb0071280 0x7f1fb00ae230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:42.071 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:42.068+0000 7f1fb5691700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1fb00ad6a0 0x7f1fb00ae770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:42.072 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:42.068+0000 7f1fb5691700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1fb01601c0 0x7f1fb006b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:42.072 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:42.068+0000 7f1faeffd700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1fb0071280 0x7f1fb00ae230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:42.072 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:42.068+0000 7f1fae7fc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1fb00ad6a0 0x7f1fb00ae770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:42.073 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:42.068+0000 7f1faeffd700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1fb0071280 0x7f1fb00ae230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.62:52816/0 (socket says 172.21.15.62:52816) 2023-06-09T04:40:42.073 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:42.068+0000 7f1fb5691700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb00b1ad0 con 0x7f1fb01601c0 2023-06-09T04:40:42.073 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:42.068+0000 7f1fb5691700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb00b1db0 con 0x7f1fb0071280 2023-06-09T04:40:42.073 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:42.068+0000 7f1fb5691700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb00b2090 con 0x7f1fb00ad6a0 2023-06-09T04:40:42.073 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:42.068+0000 7f1fae7fc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1fb00ad6a0 0x7f1fb00ae770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.62:46542/0 (socket says 172.21.15.62:46542) 2023-06-09T04:40:42.073 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:42.068+0000 7f1fae7fc700 1 -- 172.21.15.62:0/3684579024 learned_addr learned my addr 172.21.15.62:0/3684579024 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:40:42.073 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:42.068+0000 7f1faf7fe700 1 --2- 172.21.15.62:0/3684579024 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1fb01601c0 0x7f1fb006b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:42.074 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:42.068+0000 7f1fae7fc700 1 -- 172.21.15.62:0/3684579024 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1fb0071280 msgr2=0x7f1fb00ae230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:42.074 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:42.068+0000 7f1fae7fc700 1 --2- 172.21.15.62:0/3684579024 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1fb0071280 0x7f1fb00ae230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:42.074 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:42.068+0000 7f1fae7fc700 1 -- 172.21.15.62:0/3684579024 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1fb01601c0 msgr2=0x7f1fb006b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:42.074 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:42.068+0000 7f1fae7fc700 1 --2- 172.21.15.62:0/3684579024 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1fb01601c0 0x7f1fb006b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:42.074 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:42.068+0000 7f1fae7fc700 1 -- 172.21.15.62:0/3684579024 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa00094b0 con 0x7f1fb00ad6a0 2023-06-09T04:40:42.075 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:42.068+0000 7f1fae7fc700 1 --2- 172.21.15.62:0/3684579024 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1fb00ad6a0 0x7f1fb00ae770 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f1fa000ebe0 tx=0x7f1fa000eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:42.085 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:42.080+0000 7f1f977fe700 1 -- 172.21.15.62:0/3684579024 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa000c850 con 0x7f1fb00ad6a0 2023-06-09T04:40:42.085 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:42.080+0000 7f1fb5691700 1 -- 172.21.15.62:0/3684579024 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fa8009a70 con 0x7f1fb00ad6a0 2023-06-09T04:40:42.085 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:42.080+0000 7f1fb5691700 1 -- 172.21.15.62:0/3684579024 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fb00b2650 con 0x7f1fb00ad6a0 2023-06-09T04:40:42.087 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:42.080+0000 7f1f977fe700 1 -- 172.21.15.62:0/3684579024 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fa000c9b0 con 0x7f1fb00ad6a0 2023-06-09T04:40:42.087 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:42.080+0000 7f1f977fe700 1 -- 172.21.15.62:0/3684579024 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa000cd40 con 0x7f1fb00ad6a0 2023-06-09T04:40:42.088 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:42.084+0000 7f1fb5691700 1 -- 172.21.15.62:0/3684579024 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fb0164ad0 con 0x7f1fb00ad6a0 2023-06-09T04:40:42.088 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:42.084+0000 7f1f977fe700 1 -- 172.21.15.62:0/3684579024 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 4) v1 ==== 85602+0+0 (secure 0 0 0) 0x7f1fa0013470 con 0x7f1fb00ad6a0 2023-06-09T04:40:42.089 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:42.084+0000 7f1f977fe700 1 --2- 172.21.15.62:0/3684579024 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f1f9c066330 0x7f1f9c0687e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:42.090 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:42.084+0000 7f1f977fe700 1 -- 172.21.15.62:0/3684579024 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f1fa0082db0 con 0x7f1fb00ad6a0 2023-06-09T04:40:42.090 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:42.084+0000 7f1faeffd700 1 --2- 172.21.15.62:0/3684579024 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f1f9c066330 0x7f1f9c0687e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:42.091 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:42.088+0000 7f1faeffd700 1 --2- 172.21.15.62:0/3684579024 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f1f9c066330 0x7f1f9c0687e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1fa4000f60 tx=0x7f1fa4007e90 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:42.097 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:42.092+0000 7f1f977fe700 1 -- 172.21.15.62:0/3684579024 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1fb0164ad0 con 0x7f1fb00ad6a0 2023-06-09T04:40:42.116 INFO:tasks.ceph.osd.7.smithi089.stderr:2023-06-09T04:40:42.114+0000 7ff7cc051700 -1 osd.7 0 waiting for initial osdmap 2023-06-09T04:40:42.126 INFO:tasks.ceph.osd.7.smithi089.stderr:2023-06-09T04:40:42.122+0000 7ff7c39f0700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-09T04:40:42.229 INFO:tasks.ceph.osd.1.smithi062.stderr:2023-06-09T04:40:42.220+0000 7f51ee446700 -1 osd.1 0 waiting for initial osdmap 2023-06-09T04:40:42.232 INFO:tasks.ceph.osd.6.smithi089.stderr:2023-06-09T04:40:42.230+0000 7f6832407700 -1 osd.6 0 waiting for initial osdmap 2023-06-09T04:40:42.234 INFO:tasks.ceph.osd.5.smithi089.stderr:2023-06-09T04:40:42.230+0000 7fa2fd033700 -1 osd.5 0 waiting for initial osdmap 2023-06-09T04:40:42.240 INFO:tasks.ceph.osd.0.smithi062.stderr:2023-06-09T04:40:42.236+0000 7fa051cbe700 -1 osd.0 0 waiting for initial osdmap 2023-06-09T04:40:42.242 INFO:tasks.ceph.osd.6.smithi089.stderr:2023-06-09T04:40:42.238+0000 7f6829df0700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-09T04:40:42.243 INFO:tasks.ceph.osd.5.smithi089.stderr:2023-06-09T04:40:42.242+0000 7fa2f49f0700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-09T04:40:42.243 INFO:tasks.ceph.osd.4.smithi089.stderr:2023-06-09T04:40:42.242+0000 7f3af97d1700 -1 osd.4 0 waiting for initial osdmap 2023-06-09T04:40:42.249 INFO:tasks.ceph.osd.4.smithi089.stderr:2023-06-09T04:40:42.246+0000 7f3af07f0700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-09T04:40:42.252 INFO:tasks.ceph.osd.1.smithi062.stderr:2023-06-09T04:40:42.248+0000 7f51e5df0700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-09T04:40:42.255 INFO:tasks.ceph.osd.0.smithi062.stderr:2023-06-09T04:40:42.252+0000 7fa0495f0700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-09T04:40:42.327 INFO:tasks.ceph.osd.3.smithi062.stderr:2023-06-09T04:40:42.320+0000 7fb4ae446700 -1 osd.3 0 waiting for initial osdmap 2023-06-09T04:40:42.339 INFO:tasks.ceph.osd.3.smithi062.stderr:2023-06-09T04:40:42.336+0000 7fb4a5df0700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-09T04:40:42.362 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:42.356+0000 7f1fb5691700 1 -- 172.21.15.62:0/3684579024 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1fb00b21d0 con 0x7f1fb00ad6a0 2023-06-09T04:40:42.363 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:42.360+0000 7f1f977fe700 1 -- 172.21.15.62:0/3684579024 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f1fb00b21d0 con 0x7f1fb00ad6a0 2023-06-09T04:40:42.364 INFO:teuthology.misc.health.smithi062.stdout: 2023-06-09T04:40:42.364 INFO:teuthology.misc.health.smithi062.stdout:{"epoch":12,"fsid":"f7998a1e-e5a9-4202-abaa-70c0eaae1047","created":"2023-06-09T04:40:30.469588+0000","modified":"2023-06-09T04:40:39.607461+0000","last_up_change":"0.000000","last_in_change":"2023-06-09T04:40:33.568221+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"bc50bbc0-dd08-42ed-804c-ec3029e36c19","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8230b12d-e22f-4985-a584-4cc64404cdbf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d0202506-dbe9-4e3c-9271-687929abf96a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"f3c0298a-b075-4411-af50-e16cd74fdddb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"1ab5c5ca-e74f-475a-a309-683cc0029928","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"a933e184-bd8f-4369-a1ba-a68de53c578c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"1ed7ad37-2eee-49a6-954c-b537e2b7f0ed","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"6ed732e9-33ff-40df-9038-a9f1d1622671","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:40:42.366 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:42.360+0000 7f1fb5691700 1 -- 172.21.15.62:0/3684579024 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f1f9c066330 msgr2=0x7f1f9c0687e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:42.366 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:42.360+0000 7f1fb5691700 1 --2- 172.21.15.62:0/3684579024 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f1f9c066330 0x7f1f9c0687e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1fa4000f60 tx=0x7f1fa4007e90 comp rx=0 tx=0).stop 2023-06-09T04:40:42.367 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:42.360+0000 7f1fb5691700 1 -- 172.21.15.62:0/3684579024 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1fb00ad6a0 msgr2=0x7f1fb00ae770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:42.367 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:42.360+0000 7f1fb5691700 1 --2- 172.21.15.62:0/3684579024 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1fb00ad6a0 0x7f1fb00ae770 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f1fa000ebe0 tx=0x7f1fa000eef0 comp rx=0 tx=0).stop 2023-06-09T04:40:42.367 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:42.360+0000 7f1fb5691700 1 -- 172.21.15.62:0/3684579024 shutdown_connections 2023-06-09T04:40:42.367 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:42.360+0000 7f1fb5691700 1 --2- 172.21.15.62:0/3684579024 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f1f9c066330 0x7f1f9c0687e0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:42.367 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:42.360+0000 7f1fb5691700 1 --2- 172.21.15.62:0/3684579024 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1fb01601c0 0x7f1fb006b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:42.367 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:42.360+0000 7f1fb5691700 1 --2- 172.21.15.62:0/3684579024 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1fb00ad6a0 0x7f1fb00ae770 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:42.367 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:42.360+0000 7f1fb5691700 1 --2- 172.21.15.62:0/3684579024 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1fb0071280 0x7f1fb00ae230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:42.368 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:42.360+0000 7f1fb5691700 1 -- 172.21.15.62:0/3684579024 >> 172.21.15.62:0/3684579024 conn(0x7f1fb00caad0 msgr2=0x7f1fb006b100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:40:42.368 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:42.360+0000 7f1fb5691700 1 -- 172.21.15.62:0/3684579024 shutdown_connections 2023-06-09T04:40:42.368 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:42.360+0000 7f1fb5691700 1 -- 172.21.15.62:0/3684579024 wait complete. 2023-06-09T04:40:42.384 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-06-09T04:40:42.402 INFO:tasks.ceph.osd.2.smithi062.stderr:2023-06-09T04:40:42.396+0000 7f9e357e5700 -1 osd.2 0 waiting for initial osdmap 2023-06-09T04:40:42.413 INFO:tasks.ceph.osd.2.smithi062.stderr:2023-06-09T04:40:42.408+0000 7f9e2d1f0700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-09T04:40:49.189 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-06-09T04:40:49.347 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:49.344+0000 7fc52d4df700 1 Processor -- start 2023-06-09T04:40:49.348 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:49.344+0000 7fc52d4df700 1 -- start start 2023-06-09T04:40:49.351 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:49.344+0000 7fc52d4df700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc52815c380 0x7fc5280cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:49.351 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:49.344+0000 7fc52d4df700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc52815f9f0 0x7fc52815fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:49.351 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:49.344+0000 7fc52d4df700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc52815c800 con 0x7fc5280ccbc0 2023-06-09T04:40:49.351 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:49.344+0000 7fc52d4df700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5280cede0 con 0x7fc52815f9f0 2023-06-09T04:40:49.351 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:49.344+0000 7fc52d4df700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5280cfde0 con 0x7fc52815c380 2023-06-09T04:40:49.352 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:49.348+0000 7fc526ffd700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fc5280ccbc0 0x7fc5280ccf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:35198/0 (socket says 172.21.15.62:35198) 2023-06-09T04:40:49.352 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:49.348+0000 7fc526ffd700 1 -- 172.21.15.62:0/3065266304 learned_addr learned my addr 172.21.15.62:0/3065266304 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:40:49.352 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:49.348+0000 7fc5277fe700 1 --2- 172.21.15.62:0/3065266304 >> v2:172.21.15.62:3300/0 conn(0x7fc52815f9f0 0x7fc52815fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:49.352 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:49.348+0000 7fc51ffff700 1 --2- 172.21.15.62:0/3065266304 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc52815c380 0x7fc5280cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:49.352 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:49.348+0000 7fc5267fc700 1 -- 172.21.15.62:0/3065266304 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2709641691 0 0) 0x7fc518001110 con 0x7fc5280ccbc0 2023-06-09T04:40:49.353 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:49.348+0000 7fc5267fc700 1 -- 172.21.15.62:0/3065266304 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5140035d0 con 0x7fc5280ccbc0 2023-06-09T04:40:49.353 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:49.348+0000 7fc5277fe700 1 -- 172.21.15.62:0/3065266304 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc52815c380 msgr2=0x7fc5280cf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:40:49.353 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:49.348+0000 7fc5277fe700 1 --2- 172.21.15.62:0/3065266304 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc52815c380 0x7fc5280cf8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:49.354 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:49.348+0000 7fc5277fe700 1 -- 172.21.15.62:0/3065266304 >> v1:172.21.15.62:6789/0 conn(0x7fc5280ccbc0 legacy=0x7fc5280ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:49.354 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:49.348+0000 7fc5277fe700 1 -- 172.21.15.62:0/3065266304 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5281604b0 con 0x7fc52815f9f0 2023-06-09T04:40:49.354 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:49.348+0000 7fc5277fe700 1 --2- 172.21.15.62:0/3065266304 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc52815f9f0 0x7fc52815fe70 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc520009d90 tx=0x7fc52000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a570481f475f6cd9 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:49.355 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:49.348+0000 7fc5267fc700 1 -- 172.21.15.62:0/3065266304 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc52000e070 con 0x7fc52815f9f0 2023-06-09T04:40:49.355 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:49.348+0000 7fc5267fc700 1 -- 172.21.15.62:0/3065266304 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc52000bb20 con 0x7fc52815f9f0 2023-06-09T04:40:49.355 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:49.348+0000 7fc5267fc700 1 -- 172.21.15.62:0/3065266304 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc52000be90 con 0x7fc52815f9f0 2023-06-09T04:40:49.355 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:49.348+0000 7fc52d4df700 1 -- 172.21.15.62:0/3065266304 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc52815f9f0 msgr2=0x7fc52815fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:49.355 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:49.348+0000 7fc52d4df700 1 --2- 172.21.15.62:0/3065266304 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc52815f9f0 0x7fc52815fe70 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc520009d90 tx=0x7fc52000b330 comp rx=0 tx=0).stop 2023-06-09T04:40:49.355 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:49.348+0000 7fc52d4df700 1 -- 172.21.15.62:0/3065266304 shutdown_connections 2023-06-09T04:40:49.355 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:49.348+0000 7fc52d4df700 1 --2- 172.21.15.62:0/3065266304 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc52815f9f0 0x7fc52815fe70 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:49.356 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:49.348+0000 7fc52d4df700 1 --2- 172.21.15.62:0/3065266304 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc52815c380 0x7fc5280cf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:49.356 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:49.348+0000 7fc52d4df700 1 -- 172.21.15.62:0/3065266304 >> 172.21.15.62:0/3065266304 conn(0x7fc52806a0c0 msgr2=0x7fc52809b860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:40:49.356 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:49.348+0000 7fc52d4df700 1 -- 172.21.15.62:0/3065266304 shutdown_connections 2023-06-09T04:40:49.356 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:49.348+0000 7fc52d4df700 1 -- 172.21.15.62:0/3065266304 wait complete. 2023-06-09T04:40:49.357 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:49.352+0000 7fc52d4df700 1 Processor -- start 2023-06-09T04:40:49.357 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:49.352+0000 7fc52d4df700 1 -- start start 2023-06-09T04:40:49.359 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:49.352+0000 7fc52d4df700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5280ccbc0 0x7fc528154ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:49.359 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:49.356+0000 7fc52d4df700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc52815c380 0x7fc5280b53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:49.359 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:49.356+0000 7fc52d4df700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc52815f9f0 0x7fc52815e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:49.359 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:49.356+0000 7fc52d4df700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5280cb020 con 0x7fc52815f9f0 2023-06-09T04:40:49.360 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:49.356+0000 7fc52d4df700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5280b58e0 con 0x7fc52815c380 2023-06-09T04:40:49.360 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:49.356+0000 7fc52d4df700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc528156200 con 0x7fc5280ccbc0 2023-06-09T04:40:49.361 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:49.356+0000 7fc5277fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc52815f9f0 0x7fc52815e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:49.361 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:49.356+0000 7fc5277fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc52815f9f0 0x7fc52815e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46410/0 (socket says 172.21.15.62:46410) 2023-06-09T04:40:49.361 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:49.356+0000 7fc5277fe700 1 -- 172.21.15.62:0/435200641 learned_addr learned my addr 172.21.15.62:0/435200641 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:40:49.361 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:49.356+0000 7fc526ffd700 1 --2- 172.21.15.62:0/435200641 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5280ccbc0 0x7fc528154ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:49.361 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:49.356+0000 7fc51ffff700 1 --2- 172.21.15.62:0/435200641 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc52815c380 0x7fc5280b53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:49.361 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:49.356+0000 7fc5277fe700 1 -- 172.21.15.62:0/435200641 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5280ccbc0 msgr2=0x7fc528154ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:49.361 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:49.356+0000 7fc5277fe700 1 --2- 172.21.15.62:0/435200641 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5280ccbc0 0x7fc528154ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:49.362 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:49.356+0000 7fc5277fe700 1 -- 172.21.15.62:0/435200641 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc52815c380 msgr2=0x7fc5280b53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:49.362 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:49.356+0000 7fc5277fe700 1 --2- 172.21.15.62:0/435200641 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc52815c380 0x7fc5280b53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:49.362 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:49.356+0000 7fc5277fe700 1 -- 172.21.15.62:0/435200641 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc520009a70 con 0x7fc52815f9f0 2023-06-09T04:40:49.362 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:49.356+0000 7fc51ffff700 1 --2- 172.21.15.62:0/435200641 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc52815c380 0x7fc5280b53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:40:49.362 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:49.356+0000 7fc5277fe700 1 --2- 172.21.15.62:0/435200641 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc52815f9f0 0x7fc52815e680 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc52000b370 tx=0x7fc520004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:49.363 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:49.356+0000 7fc51f7fe700 1 -- 172.21.15.62:0/435200641 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5200098f0 con 0x7fc52815f9f0 2023-06-09T04:40:49.363 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:49.356+0000 7fc51f7fe700 1 -- 172.21.15.62:0/435200641 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc520003e30 con 0x7fc52815f9f0 2023-06-09T04:40:49.363 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:49.356+0000 7fc51f7fe700 1 -- 172.21.15.62:0/435200641 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc520012670 con 0x7fc52815f9f0 2023-06-09T04:40:49.363 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:49.356+0000 7fc52d4df700 1 -- 172.21.15.62:0/435200641 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5281564e0 con 0x7fc52815f9f0 2023-06-09T04:40:49.363 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:49.356+0000 7fc52d4df700 1 -- 172.21.15.62:0/435200641 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5280ca960 con 0x7fc52815f9f0 2023-06-09T04:40:49.364 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:49.360+0000 7fc52d4df700 1 -- 172.21.15.62:0/435200641 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5280b3e60 con 0x7fc52815f9f0 2023-06-09T04:40:49.366 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:49.360+0000 7fc51f7fe700 1 -- 172.21.15.62:0/435200641 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc5200127d0 con 0x7fc52815f9f0 2023-06-09T04:40:49.367 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:49.364+0000 7fc51f7fe700 1 --2- 172.21.15.62:0/435200641 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fc508066320 0x7fc5080687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:49.368 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:49.364+0000 7fc51f7fe700 1 -- 172.21.15.62:0/435200641 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc520085b10 con 0x7fc52815f9f0 2023-06-09T04:40:49.368 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:49.364+0000 7fc526ffd700 1 --2- 172.21.15.62:0/435200641 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fc508066320 0x7fc5080687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:49.369 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:49.364+0000 7fc526ffd700 1 --2- 172.21.15.62:0/435200641 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fc508066320 0x7fc5080687d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc518005930 tx=0x7fc518009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:49.373 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:49.368+0000 7fc51f7fe700 1 -- 172.21.15.62:0/435200641 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc520053580 con 0x7fc52815f9f0 2023-06-09T04:40:49.547 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:49.544+0000 7fc52d4df700 1 -- 172.21.15.62:0/435200641 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc528066e70 con 0x7fc52815f9f0 2023-06-09T04:40:49.549 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:49.544+0000 7fc51f7fe700 1 -- 172.21.15.62:0/435200641 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12814 (secure 0 0 0) 0x7fc52002b090 con 0x7fc52815f9f0 2023-06-09T04:40:49.549 INFO:teuthology.misc.health.smithi062.stdout: 2023-06-09T04:40:49.550 INFO:teuthology.misc.health.smithi062.stdout:{"epoch":17,"fsid":"f7998a1e-e5a9-4202-abaa-70c0eaae1047","created":"2023-06-09T04:40:30.469588+0000","modified":"2023-06-09T04:40:47.178150+0000","last_up_change":"2023-06-09T04:40:43.120747+0000","last_in_change":"2023-06-09T04:40:33.568221+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:40:44.646921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bc50bbc0-dd08-42ed-804c-ec3029e36c19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6802","nonce":1295788017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6807","nonce":1295788017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6815","nonce":1295788017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6809","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6811","nonce":1295788017}]},"public_addr":"172.21.15.62:6802/1295788017","cluster_addr":"172.21.15.62:6807/1295788017","heartbeat_back_addr":"172.21.15.62:6815/1295788017","heartbeat_front_addr":"172.21.15.62:6811/1295788017","state":["exists","up"]},{"osd":1,"uuid":"8230b12d-e22f-4985-a584-4cc64404cdbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6825","nonce":4120692006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6827","nonce":4120692006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6831","nonce":4120692006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6829","nonce":4120692006}]},"public_addr":"172.21.15.62:6825/4120692006","cluster_addr":"172.21.15.62:6827/4120692006","heartbeat_back_addr":"172.21.15.62:6831/4120692006","heartbeat_front_addr":"172.21.15.62:6829/4120692006","state":["exists","up"]},{"osd":2,"uuid":"d0202506-dbe9-4e3c-9271-687929abf96a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6801","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6803","nonce":4169607876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6805","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6806","nonce":4169607876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6814","nonce":4169607876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6810","nonce":4169607876}]},"public_addr":"172.21.15.62:6803/4169607876","cluster_addr":"172.21.15.62:6806/4169607876","heartbeat_back_addr":"172.21.15.62:6814/4169607876","heartbeat_front_addr":"172.21.15.62:6810/4169607876","state":["exists","up"]},{"osd":3,"uuid":"f3c0298a-b075-4411-af50-e16cd74fdddb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6817","nonce":3268438986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6819","nonce":3268438986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6823","nonce":3268438986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6821","nonce":3268438986}]},"public_addr":"172.21.15.62:6817/3268438986","cluster_addr":"172.21.15.62:6819/3268438986","heartbeat_back_addr":"172.21.15.62:6823/3268438986","heartbeat_front_addr":"172.21.15.62:6821/3268438986","state":["exists","up"]},{"osd":4,"uuid":"1ab5c5ca-e74f-475a-a309-683cc0029928","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6817","nonce":3139617628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6819","nonce":3139617628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6823","nonce":3139617628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6821","nonce":3139617628}]},"public_addr":"172.21.15.89:6817/3139617628","cluster_addr":"172.21.15.89:6819/3139617628","heartbeat_back_addr":"172.21.15.89:6823/3139617628","heartbeat_front_addr":"172.21.15.89:6821/3139617628","state":["exists","up"]},{"osd":5,"uuid":"a933e184-bd8f-4369-a1ba-a68de53c578c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6825","nonce":2681723596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6827","nonce":2681723596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6831","nonce":2681723596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6829","nonce":2681723596}]},"public_addr":"172.21.15.89:6825/2681723596","cluster_addr":"172.21.15.89:6827/2681723596","heartbeat_back_addr":"172.21.15.89:6831/2681723596","heartbeat_front_addr":"172.21.15.89:6829/2681723596","state":["exists","up"]},{"osd":6,"uuid":"1ed7ad37-2eee-49a6-954c-b537e2b7f0ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6809","nonce":1657136033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6811","nonce":1657136033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6815","nonce":1657136033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6813","nonce":1657136033}]},"public_addr":"172.21.15.89:6809/1657136033","cluster_addr":"172.21.15.89:6811/1657136033","heartbeat_back_addr":"172.21.15.89:6815/1657136033","heartbeat_front_addr":"172.21.15.89:6813/1657136033","state":["exists","up"]},{"osd":7,"uuid":"6ed732e9-33ff-40df-9038-a9f1d1622671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6801","nonce":1710561686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6803","nonce":1710561686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6807","nonce":1710561686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6805","nonce":1710561686}]},"public_addr":"172.21.15.89:6801/1710561686","cluster_addr":"172.21.15.89:6803/1710561686","heartbeat_back_addr":"172.21.15.89:6807/1710561686","heartbeat_front_addr":"172.21.15.89:6805/1710561686","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.335803+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.419788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.179334+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.263310+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.071846+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.375627+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.282277+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.315997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:40:49.552 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:49.548+0000 7fc52d4df700 1 -- 172.21.15.62:0/435200641 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fc508066320 msgr2=0x7fc5080687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:49.552 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:49.548+0000 7fc52d4df700 1 --2- 172.21.15.62:0/435200641 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fc508066320 0x7fc5080687d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc518005930 tx=0x7fc518009040 comp rx=0 tx=0).stop 2023-06-09T04:40:49.552 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:49.548+0000 7fc52d4df700 1 -- 172.21.15.62:0/435200641 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc52815f9f0 msgr2=0x7fc52815e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:49.552 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:49.548+0000 7fc52d4df700 1 --2- 172.21.15.62:0/435200641 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc52815f9f0 0x7fc52815e680 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc52000b370 tx=0x7fc520004af0 comp rx=0 tx=0).stop 2023-06-09T04:40:49.553 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:49.548+0000 7fc52d4df700 1 -- 172.21.15.62:0/435200641 shutdown_connections 2023-06-09T04:40:49.553 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:49.548+0000 7fc52d4df700 1 --2- 172.21.15.62:0/435200641 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fc508066320 0x7fc5080687d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:49.553 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:49.548+0000 7fc52d4df700 1 --2- 172.21.15.62:0/435200641 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc52815f9f0 0x7fc52815e680 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:49.553 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:49.548+0000 7fc52d4df700 1 --2- 172.21.15.62:0/435200641 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc52815c380 0x7fc5280b53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:49.554 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:49.548+0000 7fc52d4df700 1 --2- 172.21.15.62:0/435200641 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5280ccbc0 0x7fc528154ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:49.554 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:49.548+0000 7fc52d4df700 1 -- 172.21.15.62:0/435200641 >> 172.21.15.62:0/435200641 conn(0x7fc52806a0c0 msgr2=0x7fc5280d2500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:40:49.554 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:49.548+0000 7fc52d4df700 1 -- 172.21.15.62:0/435200641 shutdown_connections 2023-06-09T04:40:49.554 INFO:teuthology.misc.health.smithi062.stderr:2023-06-09T04:40:49.548+0000 7fc52d4df700 1 -- 172.21.15.62:0/435200641 wait complete. 2023-06-09T04:40:49.573 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-06-09T04:40:49.573 INFO:tasks.ceph:Creating RBD pool 2023-06-09T04:40:49.574 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd pool create rbd 8 2023-06-09T04:40:49.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:49.732+0000 7f66729ae700 1 Processor -- start 2023-06-09T04:40:49.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:49.732+0000 7f66729ae700 1 -- start start 2023-06-09T04:40:49.739 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:49.736+0000 7f66729ae700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f666c0d0270 0x7f666c06ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:49.739 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:49.736+0000 7f66729ae700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f666c0d2670 con 0x7f666c0cd320 2023-06-09T04:40:49.740 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:49.736+0000 7f66729ae700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f666c0cce90 con 0x7f666c0d2220 2023-06-09T04:40:49.740 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:49.736+0000 7f66729ae700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f666c15c720 con 0x7f666c0d0270 2023-06-09T04:40:49.740 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:49.736+0000 7f6670f4b700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f666c0cd320 0x7f666c0cd7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:35202/0 (socket says 172.21.15.62:35202) 2023-06-09T04:40:49.740 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:49.736+0000 7f6670f4b700 1 -- 172.21.15.62:0/3898710966 learned_addr learned my addr 172.21.15.62:0/3898710966 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:40:49.741 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:49.736+0000 7f666bfff700 1 --2- 172.21.15.62:0/3898710966 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f666c0d0270 0x7f666c06ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:49.741 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:49.736+0000 7f666b7fe700 1 -- 172.21.15.62:0/3898710966 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1340875118 0 0) 0x7f666c0d2670 con 0x7f666c0cd320 2023-06-09T04:40:49.741 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:49.736+0000 7f666b7fe700 1 -- 172.21.15.62:0/3898710966 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66580035d0 con 0x7f666c0cd320 2023-06-09T04:40:49.742 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:49.736+0000 7f666bfff700 1 -- 172.21.15.62:0/3898710966 >> v1:172.21.15.89:6789/0 conn(0x7f666c0d2220 legacy=0x7f666c0d0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:49.742 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:49.736+0000 7f666b7fe700 1 -- 172.21.15.62:0/3898710966 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2961437362 0 0) 0x7f666c0cce90 con 0x7f666c0d2220 2023-06-09T04:40:49.742 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:49.736+0000 7f666bfff700 1 -- 172.21.15.62:0/3898710966 >> v1:172.21.15.62:6789/0 conn(0x7f666c0cd320 legacy=0x7f666c0cd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:49.742 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:49.736+0000 7f666bfff700 1 -- 172.21.15.62:0/3898710966 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f666c06bb60 con 0x7f666c0d0270 2023-06-09T04:40:49.742 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:49.736+0000 7f666bfff700 1 --2- 172.21.15.62:0/3898710966 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f666c0d0270 0x7f666c06ac50 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f665c009e10 tx=0x7f665c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae1421791ef557ba server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:49.743 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:49.736+0000 7f666b7fe700 1 -- 172.21.15.62:0/3898710966 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f665c00e070 con 0x7f666c0d0270 2023-06-09T04:40:49.743 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:49.736+0000 7f666b7fe700 1 -- 172.21.15.62:0/3898710966 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f665c00b910 con 0x7f666c0d0270 2023-06-09T04:40:49.743 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:49.736+0000 7f666b7fe700 1 -- 172.21.15.62:0/3898710966 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f665c00bc80 con 0x7f666c0d0270 2023-06-09T04:40:49.743 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:49.740+0000 7f66729ae700 1 -- 172.21.15.62:0/3898710966 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f666c0d0270 msgr2=0x7f666c06ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:49.743 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:49.740+0000 7f66729ae700 1 --2- 172.21.15.62:0/3898710966 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f666c0d0270 0x7f666c06ac50 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f665c009e10 tx=0x7f665c00b330 comp rx=0 tx=0).stop 2023-06-09T04:40:49.744 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:49.740+0000 7f66729ae700 1 -- 172.21.15.62:0/3898710966 shutdown_connections 2023-06-09T04:40:49.744 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:49.740+0000 7f66729ae700 1 --2- 172.21.15.62:0/3898710966 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f666c0d0270 0x7f666c06ac50 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:49.744 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:49.740+0000 7f66729ae700 1 -- 172.21.15.62:0/3898710966 >> 172.21.15.62:0/3898710966 conn(0x7f666c089fc0 msgr2=0x7f666c09b950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:40:49.745 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:49.740+0000 7f66729ae700 1 -- 172.21.15.62:0/3898710966 shutdown_connections 2023-06-09T04:40:49.745 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:49.740+0000 7f66729ae700 1 -- 172.21.15.62:0/3898710966 wait complete. 2023-06-09T04:40:49.746 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:49.740+0000 7f66729ae700 1 Processor -- start 2023-06-09T04:40:49.747 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:49.744+0000 7f66729ae700 1 -- start start 2023-06-09T04:40:49.749 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:49.744+0000 7f66729ae700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f666c0cd320 0x7f666c159c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:49.749 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:49.744+0000 7f66729ae700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f666c0d0270 0x7f666c15c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:49.749 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:49.744+0000 7f66729ae700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f666c0d2220 0x7f666c15f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:49.749 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:49.744+0000 7f66729ae700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f666c0b55d0 con 0x7f666c0d2220 2023-06-09T04:40:49.749 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:49.744+0000 7f66729ae700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f666c0cc010 con 0x7f666c0cd320 2023-06-09T04:40:49.749 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:49.744+0000 7f66729ae700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f666c0b7300 con 0x7f666c0d0270 2023-06-09T04:40:49.750 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:49.744+0000 7f6670f4b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f666c0d2220 0x7f666c15f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:49.750 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:49.744+0000 7f6670f4b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f666c0d2220 0x7f666c15f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46426/0 (socket says 172.21.15.62:46426) 2023-06-09T04:40:49.751 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:49.744+0000 7f6670f4b700 1 -- 172.21.15.62:0/2787607064 learned_addr learned my addr 172.21.15.62:0/2787607064 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:40:49.751 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:49.744+0000 7f66637fe700 1 --2- 172.21.15.62:0/2787607064 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f666c0d0270 0x7f666c15c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:49.751 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:49.744+0000 7f666bfff700 1 --2- 172.21.15.62:0/2787607064 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f666c0cd320 0x7f666c159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:49.751 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:49.744+0000 7f6670f4b700 1 -- 172.21.15.62:0/2787607064 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f666c0d0270 msgr2=0x7f666c15c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:49.751 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:49.744+0000 7f6670f4b700 1 --2- 172.21.15.62:0/2787607064 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f666c0d0270 0x7f666c15c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:49.751 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:49.744+0000 7f6670f4b700 1 -- 172.21.15.62:0/2787607064 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f666c0cd320 msgr2=0x7f666c159c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:49.751 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:49.744+0000 7f6670f4b700 1 --2- 172.21.15.62:0/2787607064 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f666c0cd320 0x7f666c159c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:49.752 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:49.744+0000 7f6670f4b700 1 -- 172.21.15.62:0/2787607064 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f665c009a70 con 0x7f666c0d2220 2023-06-09T04:40:49.752 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:49.744+0000 7f666bfff700 1 --2- 172.21.15.62:0/2787607064 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f666c0cd320 0x7f666c159c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:40:49.752 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:49.744+0000 7f6670f4b700 1 --2- 172.21.15.62:0/2787607064 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f666c0d2220 0x7f666c15f230 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f666400c500 tx=0x7f666400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:49.752 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:49.748+0000 7f66697fa700 1 -- 172.21.15.62:0/2787607064 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6664005d90 con 0x7f666c0d2220 2023-06-09T04:40:49.753 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:49.748+0000 7f66697fa700 1 -- 172.21.15.62:0/2787607064 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66640070d0 con 0x7f666c0d2220 2023-06-09T04:40:49.753 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:49.748+0000 7f66697fa700 1 -- 172.21.15.62:0/2787607064 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6664007460 con 0x7f666c0d2220 2023-06-09T04:40:49.753 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:49.748+0000 7f66729ae700 1 -- 172.21.15.62:0/2787607064 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f666c0ca950 con 0x7f666c0d2220 2023-06-09T04:40:49.753 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:49.748+0000 7f66729ae700 1 -- 172.21.15.62:0/2787607064 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f666c0caed0 con 0x7f666c0d2220 2023-06-09T04:40:49.753 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:49.748+0000 7f66729ae700 1 -- 172.21.15.62:0/2787607064 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f666c0b5710 con 0x7f666c0d2220 2023-06-09T04:40:49.754 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:49.748+0000 7f66697fa700 1 -- 172.21.15.62:0/2787607064 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f66640075c0 con 0x7f666c0d2220 2023-06-09T04:40:49.755 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:49.752+0000 7f66697fa700 1 --2- 172.21.15.62:0/2787607064 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f664c0662f0 0x7f664c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:49.756 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:49.752+0000 7f66697fa700 1 -- 172.21.15.62:0/2787607064 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6664082db0 con 0x7f666c0d2220 2023-06-09T04:40:49.756 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:49.752+0000 7f666bfff700 1 --2- 172.21.15.62:0/2787607064 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f664c0662f0 0x7f664c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:49.757 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:49.752+0000 7f666bfff700 1 --2- 172.21.15.62:0/2787607064 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f664c0662f0 0x7f664c0687a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f665c014040 tx=0x7f665c011000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:49.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:49.760+0000 7f66697fa700 1 -- 172.21.15.62:0/2787607064 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f666c0b5710 con 0x7f666c0d2220 2023-06-09T04:40:49.941 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:49.936+0000 7f66729ae700 1 -- 172.21.15.62:0/2787607064 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f666c0b5710 con 0x7f666c0d2220 2023-06-09T04:40:50.228 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:50.224+0000 7f66697fa700 1 -- 172.21.15.62:0/2787607064 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v18) v1 ==== 109+0+0 (secure 0 0 0) 0x7f666c0b5710 con 0x7f666c0d2220 2023-06-09T04:40:50.232 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:50.228+0000 7f66729ae700 1 -- 172.21.15.62:0/2787607064 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f664c0662f0 msgr2=0x7f664c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:50.233 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:50.228+0000 7f66729ae700 1 --2- 172.21.15.62:0/2787607064 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f664c0662f0 0x7f664c0687a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f665c014040 tx=0x7f665c011000 comp rx=0 tx=0).stop 2023-06-09T04:40:50.233 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:50.228+0000 7f66729ae700 1 -- 172.21.15.62:0/2787607064 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f666c0d2220 msgr2=0x7f666c15f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:50.233 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:50.228+0000 7f66729ae700 1 --2- 172.21.15.62:0/2787607064 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f666c0d2220 0x7f666c15f230 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f666400c500 tx=0x7f666400c810 comp rx=0 tx=0).stop 2023-06-09T04:40:50.234 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:50.228+0000 7f66729ae700 1 -- 172.21.15.62:0/2787607064 shutdown_connections 2023-06-09T04:40:50.234 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:50.228+0000 7f66729ae700 1 --2- 172.21.15.62:0/2787607064 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f664c0662f0 0x7f664c0687a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:50.234 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:50.228+0000 7f66729ae700 1 --2- 172.21.15.62:0/2787607064 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f666c0d2220 0x7f666c15f230 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:50.234 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:50.228+0000 7f66729ae700 1 --2- 172.21.15.62:0/2787607064 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f666c0d0270 0x7f666c15c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:50.234 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:50.228+0000 7f66729ae700 1 --2- 172.21.15.62:0/2787607064 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f666c0cd320 0x7f666c159c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:50.234 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:50.228+0000 7f66729ae700 1 -- 172.21.15.62:0/2787607064 >> 172.21.15.62:0/2787607064 conn(0x7f666c089fc0 msgr2=0x7f666c0cf7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:40:50.235 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:50.228+0000 7f66729ae700 1 -- 172.21.15.62:0/2787607064 shutdown_connections 2023-06-09T04:40:50.235 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:50.228+0000 7f66729ae700 1 -- 172.21.15.62:0/2787607064 wait complete. 2023-06-09T04:40:50.235 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'rbd' created 2023-06-09T04:40:50.253 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-06-09T04:40:50.298 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:40:50.308 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:40:50.415 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:50.412+0000 7f77c0da1700 1 Processor -- start 2023-06-09T04:40:50.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:50.412+0000 7f77c0da1700 1 -- start start 2023-06-09T04:40:50.418 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:50.412+0000 7f77c0da1700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f77bc0b7d70 0x7f77bc0d1c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:50.418 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:50.412+0000 7f77c0da1700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f77bc0b1af0 0x7f77bc0cef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:50.418 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:50.412+0000 7f77c0da1700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77bc160360 con 0x7f77bc0cf440 2023-06-09T04:40:50.418 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:50.412+0000 7f77c0da1700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77bc0cf8e0 con 0x7f77bc0b7d70 2023-06-09T04:40:50.419 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:50.412+0000 7f77c0da1700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77bc160640 con 0x7f77bc0b1af0 2023-06-09T04:40:50.419 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:50.416+0000 7f77baffd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f77bc0b1af0 0x7f77bc0cef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:50.419 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:50.416+0000 7f77bbfff700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f77bc0cf440 0x7f77bc0b3f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.62:33530/0 (socket says 172.21.15.62:33530) 2023-06-09T04:40:50.419 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:50.416+0000 7f77bbfff700 1 -- 172.21.15.62:0/3639845619 learned_addr learned my addr 172.21.15.62:0/3639845619 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:40:50.420 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:50.416+0000 7f77bb7fe700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f77bc0b7d70 0x7f77bc0d1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:50.420 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:50.416+0000 7f77ba7fc700 1 -- 172.21.15.62:0/3639845619 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4239081005 0 0) 0x7f77bc160360 con 0x7f77bc0cf440 2023-06-09T04:40:50.420 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:50.416+0000 7f77ba7fc700 1 -- 172.21.15.62:0/3639845619 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77a40035d0 con 0x7f77bc0cf440 2023-06-09T04:40:50.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:50.416+0000 7f77bb7fe700 1 -- 172.21.15.62:0/3639845619 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f77bc0b1af0 msgr2=0x7f77bc0cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:40:50.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:50.416+0000 7f77bb7fe700 1 --2- 172.21.15.62:0/3639845619 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f77bc0b1af0 0x7f77bc0cef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:50.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:50.416+0000 7f77bb7fe700 1 -- 172.21.15.62:0/3639845619 >> v1:172.21.15.89:6789/0 conn(0x7f77bc0cf440 legacy=0x7f77bc0b3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:50.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:50.416+0000 7f77bb7fe700 1 -- 172.21.15.62:0/3639845619 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77bc0d00d0 con 0x7f77bc0b7d70 2023-06-09T04:40:50.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:50.416+0000 7f77baffd700 1 --2- 172.21.15.62:0/3639845619 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f77bc0b1af0 0x7f77bc0cef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:40:50.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:50.416+0000 7f77bb7fe700 1 --2- 172.21.15.62:0/3639845619 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77bc0b7d70 0x7f77bc0d1c30 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f77ac009850 tx=0x7f77ac009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70fb1b85a7ad0139 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:50.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:50.416+0000 7f77ba7fc700 1 -- 172.21.15.62:0/3639845619 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77ac011830 con 0x7f77bc0b7d70 2023-06-09T04:40:50.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:50.416+0000 7f77ba7fc700 1 -- 172.21.15.62:0/3639845619 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77ac011990 con 0x7f77bc0b7d70 2023-06-09T04:40:50.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:50.416+0000 7f77ba7fc700 1 -- 172.21.15.62:0/3639845619 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77ac011d40 con 0x7f77bc0b7d70 2023-06-09T04:40:50.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:50.416+0000 7f77c0da1700 1 -- 172.21.15.62:0/3639845619 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77bc0b7d70 msgr2=0x7f77bc0d1c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:50.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:50.416+0000 7f77c0da1700 1 --2- 172.21.15.62:0/3639845619 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77bc0b7d70 0x7f77bc0d1c30 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f77ac009850 tx=0x7f77ac009b60 comp rx=0 tx=0).stop 2023-06-09T04:40:50.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:50.416+0000 7f77c0da1700 1 -- 172.21.15.62:0/3639845619 shutdown_connections 2023-06-09T04:40:50.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:50.416+0000 7f77c0da1700 1 --2- 172.21.15.62:0/3639845619 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f77bc0b1af0 0x7f77bc0cef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:50.424 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:50.416+0000 7f77c0da1700 1 --2- 172.21.15.62:0/3639845619 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77bc0b7d70 0x7f77bc0d1c30 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:50.424 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:50.416+0000 7f77c0da1700 1 -- 172.21.15.62:0/3639845619 >> 172.21.15.62:0/3639845619 conn(0x7f77bc0657d0 msgr2=0x7f77bc070f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:40:50.424 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:50.416+0000 7f77c0da1700 1 -- 172.21.15.62:0/3639845619 shutdown_connections 2023-06-09T04:40:50.424 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:50.416+0000 7f77c0da1700 1 -- 172.21.15.62:0/3639845619 wait complete. 2023-06-09T04:40:50.424 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:50.420+0000 7f77c0da1700 1 Processor -- start 2023-06-09T04:40:50.425 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:50.420+0000 7f77c0da1700 1 -- start start 2023-06-09T04:40:50.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:50.420+0000 7f77c0da1700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f77bc0b1af0 0x7f77bc1f5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:50.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:50.420+0000 7f77c0da1700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f77bc0b7d70 0x7f77bc0b0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:50.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:50.420+0000 7f77c0da1700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77bc0cf440 0x7f77bc15a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:50.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:50.420+0000 7f77c0da1700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77bc1f5bd0 con 0x7f77bc0b1af0 2023-06-09T04:40:50.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:50.420+0000 7f77c0da1700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77bc0b1190 con 0x7f77bc0cf440 2023-06-09T04:40:50.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:50.420+0000 7f77c0da1700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77bc15cc20 con 0x7f77bc0b7d70 2023-06-09T04:40:50.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:50.424+0000 7f77bb7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f77bc0b1af0 0x7f77bc1f5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:50.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:50.424+0000 7f77baffd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f77bc0b7d70 0x7f77bc0b0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:50.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:50.424+0000 7f77bb7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f77bc0b1af0 0x7f77bc1f5690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46434/0 (socket says 172.21.15.62:46434) 2023-06-09T04:40:50.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:50.424+0000 7f77bb7fe700 1 -- 172.21.15.62:0/3473364297 learned_addr learned my addr 172.21.15.62:0/3473364297 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:40:50.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:50.424+0000 7f77bbfff700 1 --2- 172.21.15.62:0/3473364297 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77bc0cf440 0x7f77bc15a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:50.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:50.424+0000 7f77baffd700 1 -- 172.21.15.62:0/3473364297 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77bc0cf440 msgr2=0x7f77bc15a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:50.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:50.424+0000 7f77baffd700 1 --2- 172.21.15.62:0/3473364297 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77bc0cf440 0x7f77bc15a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:50.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:50.424+0000 7f77baffd700 1 -- 172.21.15.62:0/3473364297 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f77bc0b1af0 msgr2=0x7f77bc1f5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:50.430 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:50.424+0000 7f77baffd700 1 --2- 172.21.15.62:0/3473364297 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f77bc0b1af0 0x7f77bc1f5690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:50.430 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:50.424+0000 7f77baffd700 1 -- 172.21.15.62:0/3473364297 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77b00094b0 con 0x7f77bc0b7d70 2023-06-09T04:40:50.430 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:50.424+0000 7f77baffd700 1 --2- 172.21.15.62:0/3473364297 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f77bc0b7d70 0x7f77bc0b0c50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f77b000e9b0 tx=0x7f77b000ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:50.430 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:50.424+0000 7f77a3fff700 1 -- 172.21.15.62:0/3473364297 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b000c640 con 0x7f77bc0b7d70 2023-06-09T04:40:50.431 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:50.424+0000 7f77a3fff700 1 -- 172.21.15.62:0/3473364297 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77b000c7a0 con 0x7f77bc0b7d70 2023-06-09T04:40:50.431 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:50.424+0000 7f77a3fff700 1 -- 172.21.15.62:0/3473364297 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b000cb50 con 0x7f77bc0b7d70 2023-06-09T04:40:50.431 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:50.424+0000 7f77c0da1700 1 -- 172.21.15.62:0/3473364297 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77ac0094b0 con 0x7f77bc0b7d70 2023-06-09T04:40:50.431 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:50.424+0000 7f77c0da1700 1 -- 172.21.15.62:0/3473364297 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77bc1f1be0 con 0x7f77bc0b7d70 2023-06-09T04:40:50.431 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:50.424+0000 7f77c0da1700 1 -- 172.21.15.62:0/3473364297 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77bc15ce20 con 0x7f77bc0b7d70 2023-06-09T04:40:50.432 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:50.428+0000 7f77a3fff700 1 -- 172.21.15.62:0/3473364297 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f77b003b080 con 0x7f77bc0b7d70 2023-06-09T04:40:50.434 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:50.428+0000 7f77a3fff700 1 --2- 172.21.15.62:0/3473364297 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f77a80662f0 0x7f77a80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:50.434 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:50.428+0000 7f77a3fff700 1 -- 172.21.15.62:0/3473364297 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5199+0+0 (secure 0 0 0) 0x7f77b0083a10 con 0x7f77bc0b7d70 2023-06-09T04:40:50.434 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:50.428+0000 7f77bb7fe700 1 --2- 172.21.15.62:0/3473364297 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f77a80662f0 0x7f77a80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:50.436 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:50.432+0000 7f77bb7fe700 1 --2- 172.21.15.62:0/3473364297 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f77a80662f0 0x7f77a80687a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f77ac000c00 tx=0x7f77ac01c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:50.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:50.436+0000 7f77a3fff700 1 -- 172.21.15.62:0/3473364297 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f77b00511d0 con 0x7f77bc0b7d70 2023-06-09T04:40:50.616 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:50.612+0000 7f77c0da1700 1 -- 172.21.15.62:0/3473364297 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f77bc04db30 con 0x7f77bc0b7d70 2023-06-09T04:40:51.244 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.240+0000 7f77a3fff700 1 -- 172.21.15.62:0/3473364297 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v19) v1 ==== 173+0+0 (secure 0 0 0) 0x7f77b00170c0 con 0x7f77bc0b7d70 2023-06-09T04:40:51.249 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.244+0000 7f77c0da1700 1 -- 172.21.15.62:0/3473364297 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f77a80662f0 msgr2=0x7f77a80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:51.249 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.244+0000 7f77c0da1700 1 --2- 172.21.15.62:0/3473364297 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f77a80662f0 0x7f77a80687a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f77ac000c00 tx=0x7f77ac01c040 comp rx=0 tx=0).stop 2023-06-09T04:40:51.250 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.244+0000 7f77c0da1700 1 -- 172.21.15.62:0/3473364297 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f77bc0b7d70 msgr2=0x7f77bc0b0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:51.250 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.244+0000 7f77c0da1700 1 --2- 172.21.15.62:0/3473364297 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f77bc0b7d70 0x7f77bc0b0c50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f77b000e9b0 tx=0x7f77b000ecc0 comp rx=0 tx=0).stop 2023-06-09T04:40:51.250 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.244+0000 7f77c0da1700 1 -- 172.21.15.62:0/3473364297 shutdown_connections 2023-06-09T04:40:51.250 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.244+0000 7f77c0da1700 1 --2- 172.21.15.62:0/3473364297 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f77a80662f0 0x7f77a80687a0 secure :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f77ac000c00 tx=0x7f77ac01c040 comp rx=0 tx=0).stop 2023-06-09T04:40:51.250 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.244+0000 7f77c0da1700 1 --2- 172.21.15.62:0/3473364297 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77bc0cf440 0x7f77bc15a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:51.250 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.244+0000 7f77c0da1700 1 --2- 172.21.15.62:0/3473364297 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f77bc0b7d70 0x7f77bc0b0c50 secure :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f77b000e9b0 tx=0x7f77b000ecc0 comp rx=0 tx=0).stop 2023-06-09T04:40:51.250 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.244+0000 7f77c0da1700 1 --2- 172.21.15.62:0/3473364297 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f77bc0b1af0 0x7f77bc1f5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:51.251 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.244+0000 7f77c0da1700 1 -- 172.21.15.62:0/3473364297 >> 172.21.15.62:0/3473364297 conn(0x7f77bc0657d0 msgr2=0x7f77bc15f970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:40:51.251 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.244+0000 7f77c0da1700 1 -- 172.21.15.62:0/3473364297 shutdown_connections 2023-06-09T04:40:51.251 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.244+0000 7f77c0da1700 1 -- 172.21.15.62:0/3473364297 wait complete. 2023-06-09T04:40:51.253 INFO:teuthology.orchestra.run.smithi062.stderr:enabled application 'rbd' on pool 'rbd' 2023-06-09T04:40:51.272 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-06-09T04:40:51.273 INFO:tasks.ceph.mds.a:Restarting daemon 2023-06-09T04:40:51.273 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-06-09T04:40:51.276 INFO:tasks.ceph.mds.a:Started 2023-06-09T04:40:51.277 INFO:tasks.ceph.mds.c:Restarting daemon 2023-06-09T04:40:51.277 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-06-09T04:40:51.281 INFO:tasks.ceph.mds.c:Started 2023-06-09T04:40:51.281 INFO:tasks.ceph.mds.b:Restarting daemon 2023-06-09T04:40:51.281 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-06-09T04:40:51.286 INFO:tasks.ceph.mds.b:Started 2023-06-09T04:40:51.286 INFO:tasks.ceph.mds.d:Restarting daemon 2023-06-09T04:40:51.286 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-06-09T04:40:51.291 INFO:tasks.ceph.mds.d:Started 2023-06-09T04:40:51.291 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-06-09T04:40:51.291 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:40:51.394 INFO:tasks.ceph.mds.c.smithi062.stdout:starting mds.c at 2023-06-09T04:40:51.396 INFO:tasks.ceph.mds.a.smithi062.stdout:starting mds.a at 2023-06-09T04:40:51.400 INFO:tasks.ceph.mds.d.smithi089.stdout:starting mds.d at 2023-06-09T04:40:51.401 INFO:tasks.ceph.mds.b.smithi089.stdout:starting mds.b at 2023-06-09T04:40:51.458 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.452+0000 7f3b10def700 1 Processor -- start 2023-06-09T04:40:51.459 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.456+0000 7f3b10def700 1 -- start start 2023-06-09T04:40:51.461 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.456+0000 7f3b10def700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3b0c0cc1a0 0x7f3b0c06c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:51.461 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.456+0000 7f3b10def700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b0c06c4c0 con 0x7f3b0c158890 2023-06-09T04:40:51.462 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.456+0000 7f3b10def700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b0c06b920 con 0x7f3b0c06ce90 2023-06-09T04:40:51.462 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.456+0000 7f3b10def700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b0c06bb90 con 0x7f3b0c0cc1a0 2023-06-09T04:40:51.462 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.456+0000 7f3b0affd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3b0c0cc1a0 0x7f3b0c06c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:51.462 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.456+0000 7f3b0b7fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f3b0c158890 0x7f3b0c0cd0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:45714/0 (socket says 172.21.15.62:45714) 2023-06-09T04:40:51.462 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.456+0000 7f3b0b7fe700 1 -- 172.21.15.62:0/690330105 learned_addr learned my addr 172.21.15.62:0/690330105 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:40:51.463 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.456+0000 7f3b0affd700 1 -- 172.21.15.62:0/690330105 >> v1:172.21.15.89:6789/0 conn(0x7f3b0c06ce90 legacy=0x7f3b0c0c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:51.463 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.456+0000 7f3b0affd700 1 -- 172.21.15.62:0/690330105 >> v1:172.21.15.62:6789/0 conn(0x7f3b0c158890 legacy=0x7f3b0c0cd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:51.463 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.456+0000 7f3b0a7fc700 1 -- 172.21.15.62:0/690330105 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2473959642 0 0) 0x7f3b0c06b920 con 0x7f3b0c06ce90 2023-06-09T04:40:51.463 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.456+0000 7f3b0affd700 1 -- 172.21.15.62:0/690330105 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b0c06be70 con 0x7f3b0c0cc1a0 2023-06-09T04:40:51.464 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.460+0000 7f3b0affd700 1 --2- 172.21.15.62:0/690330105 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3b0c0cc1a0 0x7f3b0c06c950 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3b00009850 tx=0x7f3b00009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2f72c9a77495d0c server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:51.464 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.460+0000 7f3b0a7fc700 1 -- 172.21.15.62:0/690330105 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b00011830 con 0x7f3b0c0cc1a0 2023-06-09T04:40:51.464 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.460+0000 7f3b0a7fc700 1 -- 172.21.15.62:0/690330105 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b00011990 con 0x7f3b0c0cc1a0 2023-06-09T04:40:51.464 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.460+0000 7f3b0a7fc700 1 -- 172.21.15.62:0/690330105 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b00011d20 con 0x7f3b0c0cc1a0 2023-06-09T04:40:51.465 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.460+0000 7f3b10def700 1 -- 172.21.15.62:0/690330105 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3b0c0cc1a0 msgr2=0x7f3b0c06c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:51.465 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.460+0000 7f3b10def700 1 --2- 172.21.15.62:0/690330105 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3b0c0cc1a0 0x7f3b0c06c950 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3b00009850 tx=0x7f3b00009b60 comp rx=0 tx=0).stop 2023-06-09T04:40:51.465 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.460+0000 7f3b10def700 1 -- 172.21.15.62:0/690330105 shutdown_connections 2023-06-09T04:40:51.466 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.460+0000 7f3b10def700 1 --2- 172.21.15.62:0/690330105 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3b0c0cc1a0 0x7f3b0c06c950 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:51.466 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.460+0000 7f3b10def700 1 -- 172.21.15.62:0/690330105 >> 172.21.15.62:0/690330105 conn(0x7f3b0c06a420 msgr2=0x7f3b0c0afc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:40:51.466 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.460+0000 7f3b10def700 1 -- 172.21.15.62:0/690330105 shutdown_connections 2023-06-09T04:40:51.466 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.460+0000 7f3b10def700 1 -- 172.21.15.62:0/690330105 wait complete. 2023-06-09T04:40:51.468 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.464+0000 7f3b10def700 1 Processor -- start 2023-06-09T04:40:51.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.464+0000 7f3b10def700 1 -- start start 2023-06-09T04:40:51.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.464+0000 7f3b10def700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3b0c0cc1a0 0x7f3b0c0c6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:51.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.468+0000 7f3b10def700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3b0c158890 0x7f3b0c159840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:51.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.468+0000 7f3b10def700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b0c0c7c80 0x7f3b0c159d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:51.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.468+0000 7f3b10def700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0c0c7860 con 0x7f3b0c0cc1a0 2023-06-09T04:40:51.472 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.468+0000 7f3b10def700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0c0c6960 con 0x7f3b0c0c7c80 2023-06-09T04:40:51.472 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.468+0000 7f3b10def700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0c0c6be0 con 0x7f3b0c158890 2023-06-09T04:40:51.472 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.468+0000 7f3b0b7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3b0c0cc1a0 0x7f3b0c0c6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:51.473 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.468+0000 7f3b0b7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3b0c0cc1a0 0x7f3b0c0c6420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52958/0 (socket says 172.21.15.62:52958) 2023-06-09T04:40:51.473 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.468+0000 7f3b0b7fe700 1 -- 172.21.15.62:0/1307835193 learned_addr learned my addr 172.21.15.62:0/1307835193 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:40:51.473 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.468+0000 7f3b0affd700 1 --2- 172.21.15.62:0/1307835193 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3b0c158890 0x7f3b0c159840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:51.473 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.468+0000 7f3b0bfff700 1 --2- 172.21.15.62:0/1307835193 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b0c0c7c80 0x7f3b0c159d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:51.474 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.468+0000 7f3b0b7fe700 1 -- 172.21.15.62:0/1307835193 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3b0c158890 msgr2=0x7f3b0c159840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:51.474 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.468+0000 7f3b0b7fe700 1 --2- 172.21.15.62:0/1307835193 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3b0c158890 0x7f3b0c159840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:51.474 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.468+0000 7f3b0b7fe700 1 -- 172.21.15.62:0/1307835193 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b0c0c7c80 msgr2=0x7f3b0c159d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:51.474 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.468+0000 7f3b0b7fe700 1 --2- 172.21.15.62:0/1307835193 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b0c0c7c80 0x7f3b0c159d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:51.474 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.468+0000 7f3b0b7fe700 1 -- 172.21.15.62:0/1307835193 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b000094b0 con 0x7f3b0c0cc1a0 2023-06-09T04:40:51.474 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.468+0000 7f3b0bfff700 1 --2- 172.21.15.62:0/1307835193 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b0c0c7c80 0x7f3b0c159d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:40:51.474 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.468+0000 7f3b0b7fe700 1 --2- 172.21.15.62:0/1307835193 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3b0c0cc1a0 0x7f3b0c0c6420 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3afc001eb0 tx=0x7f3afc00c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:51.474 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.468+0000 7f3af3fff700 1 -- 172.21.15.62:0/1307835193 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3afc005d90 con 0x7f3b0c0cc1a0 2023-06-09T04:40:51.475 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.468+0000 7f3af3fff700 1 -- 172.21.15.62:0/1307835193 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3afc0070d0 con 0x7f3b0c0cc1a0 2023-06-09T04:40:51.475 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.468+0000 7f3b10def700 1 -- 172.21.15.62:0/1307835193 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b0c0c6ec0 con 0x7f3b0c0cc1a0 2023-06-09T04:40:51.475 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.468+0000 7f3af3fff700 1 -- 172.21.15.62:0/1307835193 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3afc007440 con 0x7f3b0c0cc1a0 2023-06-09T04:40:51.475 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.468+0000 7f3b10def700 1 -- 172.21.15.62:0/1307835193 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b0c0c7480 con 0x7f3b0c0cc1a0 2023-06-09T04:40:51.475 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.468+0000 7f3b10def700 1 -- 172.21.15.62:0/1307835193 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b0c06c130 con 0x7f3b0c0cc1a0 2023-06-09T04:40:51.477 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.472+0000 7f3af3fff700 1 -- 172.21.15.62:0/1307835193 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3afc0075a0 con 0x7f3b0c0cc1a0 2023-06-09T04:40:51.478 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.472+0000 7f3af3fff700 1 --2- 172.21.15.62:0/1307835193 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f3af80662f0 0x7f3af80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:51.479 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.472+0000 7f3af3fff700 1 -- 172.21.15.62:0/1307835193 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f3afc083080 con 0x7f3b0c0cc1a0 2023-06-09T04:40:51.479 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.476+0000 7f3b0affd700 1 --2- 172.21.15.62:0/1307835193 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f3af80662f0 0x7f3af80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:51.481 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.476+0000 7f3b0affd700 1 --2- 172.21.15.62:0/1307835193 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f3af80662f0 0x7f3af80687a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3b000090b0 tx=0x7f3b00008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:51.485 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.480+0000 7f3af3fff700 1 -- 172.21.15.62:0/1307835193 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3afc050860 con 0x7f3b0c0cc1a0 2023-06-09T04:40:51.665 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.660+0000 7f3b10def700 1 -- 172.21.15.62:0/1307835193 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3b0c06c130 con 0x7f3b0c0cc1a0 2023-06-09T04:40:51.668 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.664+0000 7f3af3fff700 1 -- 172.21.15.62:0/1307835193 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+14613 (secure 0 0 0) 0x7f3b0c06c130 con 0x7f3b0c0cc1a0 2023-06-09T04:40:51.668 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:40:51.668 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":19,"fsid":"f7998a1e-e5a9-4202-abaa-70c0eaae1047","created":"2023-06-09T04:40:30.469588+0000","modified":"2023-06-09T04:40:51.225126+0000","last_up_change":"2023-06-09T04:40:43.120747+0000","last_in_change":"2023-06-09T04:40:33.568221+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:40:44.646921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:40:50.006643+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bc50bbc0-dd08-42ed-804c-ec3029e36c19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6802","nonce":1295788017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6807","nonce":1295788017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6815","nonce":1295788017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6809","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6811","nonce":1295788017}]},"public_addr":"172.21.15.62:6802/1295788017","cluster_addr":"172.21.15.62:6807/1295788017","heartbeat_back_addr":"172.21.15.62:6815/1295788017","heartbeat_front_addr":"172.21.15.62:6811/1295788017","state":["exists","up"]},{"osd":1,"uuid":"8230b12d-e22f-4985-a584-4cc64404cdbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6825","nonce":4120692006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6827","nonce":4120692006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6831","nonce":4120692006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6829","nonce":4120692006}]},"public_addr":"172.21.15.62:6825/4120692006","cluster_addr":"172.21.15.62:6827/4120692006","heartbeat_back_addr":"172.21.15.62:6831/4120692006","heartbeat_front_addr":"172.21.15.62:6829/4120692006","state":["exists","up"]},{"osd":2,"uuid":"d0202506-dbe9-4e3c-9271-687929abf96a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6801","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6803","nonce":4169607876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6805","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6806","nonce":4169607876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6814","nonce":4169607876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6810","nonce":4169607876}]},"public_addr":"172.21.15.62:6803/4169607876","cluster_addr":"172.21.15.62:6806/4169607876","heartbeat_back_addr":"172.21.15.62:6814/4169607876","heartbeat_front_addr":"172.21.15.62:6810/4169607876","state":["exists","up"]},{"osd":3,"uuid":"f3c0298a-b075-4411-af50-e16cd74fdddb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6817","nonce":3268438986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6819","nonce":3268438986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6823","nonce":3268438986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6821","nonce":3268438986}]},"public_addr":"172.21.15.62:6817/3268438986","cluster_addr":"172.21.15.62:6819/3268438986","heartbeat_back_addr":"172.21.15.62:6823/3268438986","heartbeat_front_addr":"172.21.15.62:6821/3268438986","state":["exists","up"]},{"osd":4,"uuid":"1ab5c5ca-e74f-475a-a309-683cc0029928","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6817","nonce":3139617628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6819","nonce":3139617628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6823","nonce":3139617628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6821","nonce":3139617628}]},"public_addr":"172.21.15.89:6817/3139617628","cluster_addr":"172.21.15.89:6819/3139617628","heartbeat_back_addr":"172.21.15.89:6823/3139617628","heartbeat_front_addr":"172.21.15.89:6821/3139617628","state":["exists","up"]},{"osd":5,"uuid":"a933e184-bd8f-4369-a1ba-a68de53c578c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6825","nonce":2681723596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6827","nonce":2681723596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6831","nonce":2681723596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6829","nonce":2681723596}]},"public_addr":"172.21.15.89:6825/2681723596","cluster_addr":"172.21.15.89:6827/2681723596","heartbeat_back_addr":"172.21.15.89:6831/2681723596","heartbeat_front_addr":"172.21.15.89:6829/2681723596","state":["exists","up"]},{"osd":6,"uuid":"1ed7ad37-2eee-49a6-954c-b537e2b7f0ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6809","nonce":1657136033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6811","nonce":1657136033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6815","nonce":1657136033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6813","nonce":1657136033}]},"public_addr":"172.21.15.89:6809/1657136033","cluster_addr":"172.21.15.89:6811/1657136033","heartbeat_back_addr":"172.21.15.89:6815/1657136033","heartbeat_front_addr":"172.21.15.89:6813/1657136033","state":["exists","up"]},{"osd":7,"uuid":"6ed732e9-33ff-40df-9038-a9f1d1622671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6801","nonce":1710561686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6803","nonce":1710561686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6807","nonce":1710561686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6805","nonce":1710561686}]},"public_addr":"172.21.15.89:6801/1710561686","cluster_addr":"172.21.15.89:6803/1710561686","heartbeat_back_addr":"172.21.15.89:6807/1710561686","heartbeat_front_addr":"172.21.15.89:6805/1710561686","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.335803+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.419788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.179334+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.263310+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.071846+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.375627+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.282277+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.315997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:40:51.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.664+0000 7f3b10def700 1 -- 172.21.15.62:0/1307835193 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f3af80662f0 msgr2=0x7f3af80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:51.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.664+0000 7f3b10def700 1 --2- 172.21.15.62:0/1307835193 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f3af80662f0 0x7f3af80687a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3b000090b0 tx=0x7f3b00008030 comp rx=0 tx=0).stop 2023-06-09T04:40:51.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.664+0000 7f3b10def700 1 -- 172.21.15.62:0/1307835193 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3b0c0cc1a0 msgr2=0x7f3b0c0c6420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:51.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.664+0000 7f3b10def700 1 --2- 172.21.15.62:0/1307835193 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3b0c0cc1a0 0x7f3b0c0c6420 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3afc001eb0 tx=0x7f3afc00c7b0 comp rx=0 tx=0).stop 2023-06-09T04:40:51.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.664+0000 7f3b10def700 1 -- 172.21.15.62:0/1307835193 shutdown_connections 2023-06-09T04:40:51.672 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.668+0000 7f3b10def700 1 --2- 172.21.15.62:0/1307835193 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f3af80662f0 0x7f3af80687a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:51.672 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.668+0000 7f3b10def700 1 --2- 172.21.15.62:0/1307835193 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b0c0c7c80 0x7f3b0c159d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:51.672 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.668+0000 7f3b10def700 1 --2- 172.21.15.62:0/1307835193 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3b0c158890 0x7f3b0c159840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:51.672 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.668+0000 7f3b10def700 1 --2- 172.21.15.62:0/1307835193 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3b0c0cc1a0 0x7f3b0c0c6420 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:51.672 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.668+0000 7f3b10def700 1 -- 172.21.15.62:0/1307835193 >> 172.21.15.62:0/1307835193 conn(0x7f3b0c06ce90 msgr2=0x7f3b0c0caa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:40:51.673 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.668+0000 7f3b10def700 1 -- 172.21.15.62:0/1307835193 shutdown_connections 2023-06-09T04:40:51.673 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.668+0000 7f3b10def700 1 -- 172.21.15.62:0/1307835193 wait complete. 2023-06-09T04:40:51.693 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:40:44.646921+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:40:50.006643+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-09T04:40:51.693 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:40:51.879 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.876+0000 7fc56359e700 1 Processor -- start 2023-06-09T04:40:51.880 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.876+0000 7fc56359e700 1 -- start start 2023-06-09T04:40:51.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.876+0000 7fc56359e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5640d1f80 0x7fc5640b3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:51.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.876+0000 7fc56359e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc5640cebf0 0x7fc5640ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:51.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.876+0000 7fc56359e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5640b4d50 con 0x7fc5640cd110 2023-06-09T04:40:51.883 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.876+0000 7fc56359e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5640cd590 con 0x7fc5640cebf0 2023-06-09T04:40:51.883 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.876+0000 7fc56359e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5640cf040 con 0x7fc5640d1f80 2023-06-09T04:40:51.883 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.880+0000 7fc56259c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5640d1f80 0x7fc5640b3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:51.883 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.880+0000 7fc56259c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5640d1f80 0x7fc5640b3b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.62:50438/0 (socket says 172.21.15.62:50438) 2023-06-09T04:40:51.884 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.880+0000 7fc56259c700 1 -- 172.21.15.62:0/3903246708 learned_addr learned my addr 172.21.15.62:0/3903246708 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:40:51.884 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.880+0000 7fc561d9b700 1 --2- 172.21.15.62:0/3903246708 >> v2:172.21.15.89:3300/0 conn(0x7fc5640cebf0 0x7fc5640ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:51.884 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.880+0000 7fc56259c700 1 -- 172.21.15.62:0/3903246708 >> v2:172.21.15.89:3300/0 conn(0x7fc5640cebf0 msgr2=0x7fc5640ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:40:51.884 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.880+0000 7fc56259c700 1 --2- 172.21.15.62:0/3903246708 >> v2:172.21.15.89:3300/0 conn(0x7fc5640cebf0 0x7fc5640ccbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:51.885 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.880+0000 7fc56259c700 1 -- 172.21.15.62:0/3903246708 >> v1:172.21.15.89:6789/0 conn(0x7fc5640cd110 legacy=0x7fc5640b2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:51.885 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.880+0000 7fc56259c700 1 -- 172.21.15.62:0/3903246708 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5640b4140 con 0x7fc5640d1f80 2023-06-09T04:40:51.885 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.880+0000 7fc561d9b700 1 --2- 172.21.15.62:0/3903246708 >> v2:172.21.15.89:3300/0 conn(0x7fc5640cebf0 0x7fc5640ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:40:51.885 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.880+0000 7fc56259c700 1 --2- 172.21.15.62:0/3903246708 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5640d1f80 0x7fc5640b3b20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc554009910 tx=0x7fc554009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=657313c3b6627151 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:51.886 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.880+0000 7fc56159a700 1 -- 172.21.15.62:0/3903246708 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc554005e50 con 0x7fc5640d1f80 2023-06-09T04:40:51.886 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.880+0000 7fc56159a700 1 -- 172.21.15.62:0/3903246708 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc554006030 con 0x7fc5640d1f80 2023-06-09T04:40:51.886 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.880+0000 7fc56159a700 1 -- 172.21.15.62:0/3903246708 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5540063e0 con 0x7fc5640d1f80 2023-06-09T04:40:51.887 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.884+0000 7fc56359e700 1 -- 172.21.15.62:0/3903246708 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5640d1f80 msgr2=0x7fc5640b3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:51.887 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.884+0000 7fc56359e700 1 --2- 172.21.15.62:0/3903246708 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5640d1f80 0x7fc5640b3b20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc554009910 tx=0x7fc554009c20 comp rx=0 tx=0).stop 2023-06-09T04:40:51.887 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.884+0000 7fc56359e700 1 -- 172.21.15.62:0/3903246708 shutdown_connections 2023-06-09T04:40:51.888 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.884+0000 7fc56359e700 1 --2- 172.21.15.62:0/3903246708 >> v2:172.21.15.89:3300/0 conn(0x7fc5640cebf0 0x7fc5640ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:51.888 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.884+0000 7fc56359e700 1 --2- 172.21.15.62:0/3903246708 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5640d1f80 0x7fc5640b3b20 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:51.888 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.884+0000 7fc56359e700 1 -- 172.21.15.62:0/3903246708 >> 172.21.15.62:0/3903246708 conn(0x7fc564071840 msgr2=0x7fc56409b760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:40:51.888 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.884+0000 7fc56359e700 1 -- 172.21.15.62:0/3903246708 shutdown_connections 2023-06-09T04:40:51.888 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.884+0000 7fc56359e700 1 -- 172.21.15.62:0/3903246708 wait complete. 2023-06-09T04:40:51.890 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.884+0000 7fc56359e700 1 Processor -- start 2023-06-09T04:40:51.890 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.884+0000 7fc56359e700 1 -- start start 2023-06-09T04:40:51.892 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.888+0000 7fc56359e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5640cd110 0x7fc5641f47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:51.892 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.888+0000 7fc56359e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5640cebf0 0x7fc5641f0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:51.892 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.888+0000 7fc56359e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5640d1f80 0x7fc5640b07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:51.892 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.888+0000 7fc56359e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5640b6350 con 0x7fc5640cd110 2023-06-09T04:40:51.892 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.888+0000 7fc56359e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5640b65a0 con 0x7fc5640cebf0 2023-06-09T04:40:51.892 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.888+0000 7fc56359e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5640b6880 con 0x7fc5640d1f80 2023-06-09T04:40:51.893 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.888+0000 7fc56259c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5640cd110 0x7fc5641f47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:51.893 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.888+0000 7fc56259c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5640cd110 0x7fc5641f47c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52962/0 (socket says 172.21.15.62:52962) 2023-06-09T04:40:51.894 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.888+0000 7fc56259c700 1 -- 172.21.15.62:0/2872858350 learned_addr learned my addr 172.21.15.62:0/2872858350 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:40:51.894 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.888+0000 7fc561d9b700 1 --2- 172.21.15.62:0/2872858350 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5640cebf0 0x7fc5641f0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:51.894 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.888+0000 7fc562d9d700 1 --2- 172.21.15.62:0/2872858350 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5640d1f80 0x7fc5640b07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:51.894 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.888+0000 7fc56259c700 1 -- 172.21.15.62:0/2872858350 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5640d1f80 msgr2=0x7fc5640b07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:51.894 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.888+0000 7fc56259c700 1 --2- 172.21.15.62:0/2872858350 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5640d1f80 0x7fc5640b07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:51.894 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.888+0000 7fc56259c700 1 -- 172.21.15.62:0/2872858350 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5640cebf0 msgr2=0x7fc5641f0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:51.894 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.888+0000 7fc56259c700 1 --2- 172.21.15.62:0/2872858350 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5640cebf0 0x7fc5641f0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:51.895 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.888+0000 7fc56259c700 1 -- 172.21.15.62:0/2872858350 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5580094b0 con 0x7fc5640cd110 2023-06-09T04:40:51.895 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.888+0000 7fc562d9d700 1 --2- 172.21.15.62:0/2872858350 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5640d1f80 0x7fc5640b07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:40:51.895 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.888+0000 7fc56259c700 1 --2- 172.21.15.62:0/2872858350 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5640cd110 0x7fc5641f47c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc554009c60 tx=0x7fc554004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:51.895 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.888+0000 7fc552ffd700 1 -- 172.21.15.62:0/2872858350 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5540068c0 con 0x7fc5640cd110 2023-06-09T04:40:51.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.888+0000 7fc552ffd700 1 -- 172.21.15.62:0/2872858350 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc554020070 con 0x7fc5640cd110 2023-06-09T04:40:51.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.888+0000 7fc552ffd700 1 -- 172.21.15.62:0/2872858350 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc554004260 con 0x7fc5640cd110 2023-06-09T04:40:51.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.888+0000 7fc56359e700 1 -- 172.21.15.62:0/2872858350 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc554009520 con 0x7fc5640cd110 2023-06-09T04:40:51.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.888+0000 7fc56359e700 1 -- 172.21.15.62:0/2872858350 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5640b6e40 con 0x7fc5640cd110 2023-06-09T04:40:51.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.892+0000 7fc56359e700 1 -- 172.21.15.62:0/2872858350 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5640739c0 con 0x7fc5640cd110 2023-06-09T04:40:51.898 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.892+0000 7fc552ffd700 1 -- 172.21.15.62:0/2872858350 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc554022030 con 0x7fc5640cd110 2023-06-09T04:40:51.899 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.896+0000 7fc552ffd700 1 --2- 172.21.15.62:0/2872858350 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fc5440662f0 0x7fc5440687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:51.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.896+0000 7fc552ffd700 1 -- 172.21.15.62:0/2872858350 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fc554084d20 con 0x7fc5640cd110 2023-06-09T04:40:51.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.896+0000 7fc561d9b700 1 --2- 172.21.15.62:0/2872858350 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fc5440662f0 0x7fc5440687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:51.901 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.896+0000 7fc561d9b700 1 --2- 172.21.15.62:0/2872858350 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fc5440662f0 0x7fc5440687a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc56406bf40 tx=0x7fc558009240 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:51.905 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:51.900+0000 7fc552ffd700 1 -- 172.21.15.62:0/2872858350 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc554052580 con 0x7fc5640cd110 2023-06-09T04:40:52.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.072+0000 7fc56359e700 1 -- 172.21.15.62:0/2872858350 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc5640ce7d0 con 0x7fc5640cd110 2023-06-09T04:40:52.077 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.072+0000 7fc552ffd700 1 -- 172.21.15.62:0/2872858350 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc554055ba0 con 0x7fc5640cd110 2023-06-09T04:40:52.077 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2023-06-09T04:40:52.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.076+0000 7fc56359e700 1 -- 172.21.15.62:0/2872858350 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fc5440662f0 msgr2=0x7fc5440687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:52.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.076+0000 7fc56359e700 1 --2- 172.21.15.62:0/2872858350 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fc5440662f0 0x7fc5440687a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc56406bf40 tx=0x7fc558009240 comp rx=0 tx=0).stop 2023-06-09T04:40:52.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.076+0000 7fc56359e700 1 -- 172.21.15.62:0/2872858350 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5640cd110 msgr2=0x7fc5641f47c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:52.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.076+0000 7fc56359e700 1 --2- 172.21.15.62:0/2872858350 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5640cd110 0x7fc5641f47c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc554009c60 tx=0x7fc554004770 comp rx=0 tx=0).stop 2023-06-09T04:40:52.083 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.076+0000 7fc56359e700 1 -- 172.21.15.62:0/2872858350 shutdown_connections 2023-06-09T04:40:52.083 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.076+0000 7fc56359e700 1 --2- 172.21.15.62:0/2872858350 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fc5440662f0 0x7fc5440687a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:52.083 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.076+0000 7fc56359e700 1 --2- 172.21.15.62:0/2872858350 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc5640d1f80 0x7fc5640b07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:52.083 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.076+0000 7fc56359e700 1 --2- 172.21.15.62:0/2872858350 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5640cebf0 0x7fc5641f0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:52.083 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.076+0000 7fc56359e700 1 --2- 172.21.15.62:0/2872858350 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5640cd110 0x7fc5641f47c0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:52.083 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.076+0000 7fc56359e700 1 -- 172.21.15.62:0/2872858350 >> 172.21.15.62:0/2872858350 conn(0x7fc564071840 msgr2=0x7fc5640cf1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:40:52.083 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.076+0000 7fc56359e700 1 -- 172.21.15.62:0/2872858350 shutdown_connections 2023-06-09T04:40:52.084 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.076+0000 7fc56359e700 1 -- 172.21.15.62:0/2872858350 wait complete. 2023-06-09T04:40:52.103 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:40:52.282 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.276+0000 7f0f94f3e700 1 Processor -- start 2023-06-09T04:40:52.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.276+0000 7f0f94f3e700 1 -- start start 2023-06-09T04:40:52.284 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.280+0000 7f0f94f3e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0f900b3f00 0x7f0f90161280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:52.284 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.280+0000 7f0f94f3e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f900b42d0 0x7f0f900cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:52.285 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.280+0000 7f0f94f3e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f900cf890 con 0x7f0f9006a920 2023-06-09T04:40:52.285 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.280+0000 7f0f94f3e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f900cf470 con 0x7f0f900b3f00 2023-06-09T04:40:52.286 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.280+0000 7f0f94f3e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f900ce7f0 con 0x7f0f900b42d0 2023-06-09T04:40:52.286 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.280+0000 7f0f8f7fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0f900b3f00 0x7f0f90161280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:52.286 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.280+0000 7f0f8f7fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0f900b3f00 0x7f0f90161280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52966/0 (socket says 172.21.15.62:52966) 2023-06-09T04:40:52.286 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.280+0000 7f0f8f7fe700 1 -- 172.21.15.62:0/2749565260 learned_addr learned my addr 172.21.15.62:0/2749565260 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:40:52.286 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.280+0000 7f0f8effd700 1 --2- 172.21.15.62:0/2749565260 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f900b42d0 0x7f0f900cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:52.287 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.280+0000 7f0f8f7fe700 1 -- 172.21.15.62:0/2749565260 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f900b42d0 msgr2=0x7f0f900cdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:40:52.287 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.280+0000 7f0f8f7fe700 1 --2- 172.21.15.62:0/2749565260 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f900b42d0 0x7f0f900cdf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:52.287 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.280+0000 7f0f8f7fe700 1 -- 172.21.15.62:0/2749565260 >> v1:172.21.15.89:6789/0 conn(0x7f0f9006a920 legacy=0x7f0f9006ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:52.287 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.280+0000 7f0f8f7fe700 1 -- 172.21.15.62:0/2749565260 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f900cead0 con 0x7f0f900b3f00 2023-06-09T04:40:52.287 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.280+0000 7f0f8f7fe700 1 --2- 172.21.15.62:0/2749565260 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0f900b3f00 0x7f0f90161280 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0f80009910 tx=0x7f0f80009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11e35c3883e9e5d5 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:52.288 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.284+0000 7f0f8e7fc700 1 -- 172.21.15.62:0/2749565260 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f80011830 con 0x7f0f900b3f00 2023-06-09T04:40:52.288 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.284+0000 7f0f8e7fc700 1 -- 172.21.15.62:0/2749565260 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f80011990 con 0x7f0f900b3f00 2023-06-09T04:40:52.288 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.284+0000 7f0f8e7fc700 1 -- 172.21.15.62:0/2749565260 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f80011d40 con 0x7f0f900b3f00 2023-06-09T04:40:52.289 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.284+0000 7f0f94f3e700 1 -- 172.21.15.62:0/2749565260 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0f900b3f00 msgr2=0x7f0f90161280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:52.289 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.284+0000 7f0f94f3e700 1 --2- 172.21.15.62:0/2749565260 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0f900b3f00 0x7f0f90161280 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0f80009910 tx=0x7f0f80009c20 comp rx=0 tx=0).stop 2023-06-09T04:40:52.289 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.284+0000 7f0f94f3e700 1 -- 172.21.15.62:0/2749565260 shutdown_connections 2023-06-09T04:40:52.289 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.284+0000 7f0f94f3e700 1 --2- 172.21.15.62:0/2749565260 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f900b42d0 0x7f0f900cdf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:52.289 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.284+0000 7f0f94f3e700 1 --2- 172.21.15.62:0/2749565260 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0f900b3f00 0x7f0f90161280 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:52.289 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.284+0000 7f0f94f3e700 1 -- 172.21.15.62:0/2749565260 >> 172.21.15.62:0/2749565260 conn(0x7f0f90070f20 msgr2=0x7f0f90071320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:40:52.289 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.284+0000 7f0f94f3e700 1 -- 172.21.15.62:0/2749565260 shutdown_connections 2023-06-09T04:40:52.290 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.284+0000 7f0f94f3e700 1 -- 172.21.15.62:0/2749565260 wait complete. 2023-06-09T04:40:52.292 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.288+0000 7f0f94f3e700 1 Processor -- start 2023-06-09T04:40:52.293 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.288+0000 7f0f94f3e700 1 -- start start 2023-06-09T04:40:52.294 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.288+0000 7f0f94f3e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f9006a920 0x7f0f900cbd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:52.294 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.288+0000 7f0f94f3e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0f900b3f00 0x7f0f901f6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:52.294 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.288+0000 7f0f94f3e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f900b42d0 0x7f0f9015c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:52.294 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.288+0000 7f0f94f3e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f901f6690 con 0x7f0f900b3f00 2023-06-09T04:40:52.294 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.288+0000 7f0f94f3e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f901f8cc0 con 0x7f0f900b42d0 2023-06-09T04:40:52.294 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.288+0000 7f0f94f3e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f901f9840 con 0x7f0f9006a920 2023-06-09T04:40:52.295 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.288+0000 7f0f8effd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0f900b3f00 0x7f0f901f6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:52.295 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.288+0000 7f0f8effd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0f900b3f00 0x7f0f901f6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52974/0 (socket says 172.21.15.62:52974) 2023-06-09T04:40:52.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.288+0000 7f0f8effd700 1 -- 172.21.15.62:0/2268539618 learned_addr learned my addr 172.21.15.62:0/2268539618 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:40:52.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.288+0000 7f0f8ffff700 1 --2- 172.21.15.62:0/2268539618 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f900b42d0 0x7f0f9015c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:52.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.292+0000 7f0f8f7fe700 1 --2- 172.21.15.62:0/2268539618 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f9006a920 0x7f0f900cbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:52.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.292+0000 7f0f8effd700 1 -- 172.21.15.62:0/2268539618 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f9006a920 msgr2=0x7f0f900cbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:52.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.292+0000 7f0f8effd700 1 --2- 172.21.15.62:0/2268539618 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f9006a920 0x7f0f900cbd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:52.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.292+0000 7f0f8effd700 1 -- 172.21.15.62:0/2268539618 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f900b42d0 msgr2=0x7f0f9015c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:52.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.292+0000 7f0f8effd700 1 --2- 172.21.15.62:0/2268539618 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f900b42d0 0x7f0f9015c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:52.297 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.292+0000 7f0f8effd700 1 -- 172.21.15.62:0/2268539618 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f80009570 con 0x7f0f900b3f00 2023-06-09T04:40:52.297 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.292+0000 7f0f8effd700 1 --2- 172.21.15.62:0/2268539618 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0f900b3f00 0x7f0f901f6150 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0f8400e9d0 tx=0x7f0f8400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:52.297 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.292+0000 7f0f77fff700 1 -- 172.21.15.62:0/2268539618 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f84009720 con 0x7f0f900b3f00 2023-06-09T04:40:52.298 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.292+0000 7f0f77fff700 1 -- 172.21.15.62:0/2268539618 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f8400ee70 con 0x7f0f900b3f00 2023-06-09T04:40:52.298 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.292+0000 7f0f94f3e700 1 -- 172.21.15.62:0/2268539618 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f901f8f10 con 0x7f0f900b3f00 2023-06-09T04:40:52.298 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.292+0000 7f0f77fff700 1 -- 172.21.15.62:0/2268539618 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f8400ca50 con 0x7f0f900b3f00 2023-06-09T04:40:52.298 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.292+0000 7f0f94f3e700 1 -- 172.21.15.62:0/2268539618 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f901f94d0 con 0x7f0f900b3f00 2023-06-09T04:40:52.298 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.292+0000 7f0f94f3e700 1 -- 172.21.15.62:0/2268539618 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f901f99b0 con 0x7f0f900b3f00 2023-06-09T04:40:52.300 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.296+0000 7f0f77fff700 1 -- 172.21.15.62:0/2268539618 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0f8400cbb0 con 0x7f0f900b3f00 2023-06-09T04:40:52.301 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.296+0000 7f0f77fff700 1 --2- 172.21.15.62:0/2268539618 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f0f7c0662f0 0x7f0f7c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:52.302 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.296+0000 7f0f77fff700 1 -- 172.21.15.62:0/2268539618 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0f840839d0 con 0x7f0f900b3f00 2023-06-09T04:40:52.302 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.296+0000 7f0f8f7fe700 1 --2- 172.21.15.62:0/2268539618 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f0f7c0662f0 0x7f0f7c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:52.304 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.300+0000 7f0f8f7fe700 1 --2- 172.21.15.62:0/2268539618 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f0f7c0662f0 0x7f0f7c0687a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0f80000c00 tx=0x7f0f80008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:52.307 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.304+0000 7f0f77fff700 1 -- 172.21.15.62:0/2268539618 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0f84054c20 con 0x7f0f900b3f00 2023-06-09T04:40:52.483 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.476+0000 7f0f94f3e700 1 -- 172.21.15.62:0/2268539618 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0f900739c0 con 0x7f0f900b3f00 2023-06-09T04:40:52.483 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.480+0000 7f0f77fff700 1 -- 172.21.15.62:0/2268539618 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0f840170a0 con 0x7f0f900b3f00 2023-06-09T04:40:52.484 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2023-06-09T04:40:52.486 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.480+0000 7f0f94f3e700 1 -- 172.21.15.62:0/2268539618 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f0f7c0662f0 msgr2=0x7f0f7c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:52.486 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.480+0000 7f0f94f3e700 1 --2- 172.21.15.62:0/2268539618 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f0f7c0662f0 0x7f0f7c0687a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0f80000c00 tx=0x7f0f80008030 comp rx=0 tx=0).stop 2023-06-09T04:40:52.487 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.480+0000 7f0f94f3e700 1 -- 172.21.15.62:0/2268539618 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0f900b3f00 msgr2=0x7f0f901f6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:52.487 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.480+0000 7f0f94f3e700 1 --2- 172.21.15.62:0/2268539618 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0f900b3f00 0x7f0f901f6150 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0f8400e9d0 tx=0x7f0f8400ece0 comp rx=0 tx=0).stop 2023-06-09T04:40:52.487 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.480+0000 7f0f94f3e700 1 -- 172.21.15.62:0/2268539618 shutdown_connections 2023-06-09T04:40:52.487 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.480+0000 7f0f94f3e700 1 --2- 172.21.15.62:0/2268539618 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f0f7c0662f0 0x7f0f7c0687a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:52.487 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.480+0000 7f0f94f3e700 1 --2- 172.21.15.62:0/2268539618 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f900b42d0 0x7f0f9015c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:52.487 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.480+0000 7f0f94f3e700 1 --2- 172.21.15.62:0/2268539618 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0f900b3f00 0x7f0f901f6150 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:52.487 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.480+0000 7f0f94f3e700 1 --2- 172.21.15.62:0/2268539618 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f9006a920 0x7f0f900cbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:52.487 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.480+0000 7f0f94f3e700 1 -- 172.21.15.62:0/2268539618 >> 172.21.15.62:0/2268539618 conn(0x7f0f90070f20 msgr2=0x7f0f900714a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:40:52.488 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.480+0000 7f0f94f3e700 1 -- 172.21.15.62:0/2268539618 shutdown_connections 2023-06-09T04:40:52.488 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.480+0000 7f0f94f3e700 1 -- 172.21.15.62:0/2268539618 wait complete. 2023-06-09T04:40:52.507 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-09T04:40:52.686 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.680+0000 7f6164284700 1 Processor -- start 2023-06-09T04:40:52.687 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.680+0000 7f6164284700 1 -- start start 2023-06-09T04:40:52.689 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.684+0000 7f6164284700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f615c0b08d0 0x7f615c0ca870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:52.689 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.684+0000 7f6164284700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f615c06f9b0 con 0x7f615c0cb850 2023-06-09T04:40:52.689 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.684+0000 7f6164284700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f615c15a060 con 0x7f615c159c90 2023-06-09T04:40:52.690 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.684+0000 7f6164284700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f615c06b960 con 0x7f615c0b08d0 2023-06-09T04:40:52.690 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.684+0000 7f616181f700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f615c0cb850 0x7f615c0ca160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:45716/0 (socket says 172.21.15.62:45716) 2023-06-09T04:40:52.690 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.684+0000 7f616181f700 1 -- 172.21.15.62:0/3298936226 learned_addr learned my addr 172.21.15.62:0/3298936226 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:40:52.690 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.684+0000 7f6162821700 1 --2- 172.21.15.62:0/3298936226 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f615c0b08d0 0x7f615c0ca870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:52.691 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.684+0000 7f616101e700 1 -- 172.21.15.62:0/3298936226 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1140254712 0 0) 0x7f615c06f9b0 con 0x7f615c0cb850 2023-06-09T04:40:52.691 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.684+0000 7f616101e700 1 -- 172.21.15.62:0/3298936226 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61480035d0 con 0x7f615c0cb850 2023-06-09T04:40:52.691 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.684+0000 7f616101e700 1 -- 172.21.15.62:0/3298936226 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4088246527 0 0) 0x7f615c15a060 con 0x7f615c159c90 2023-06-09T04:40:52.692 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.688+0000 7f616101e700 1 -- 172.21.15.62:0/3298936226 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f615c06f9b0 con 0x7f615c159c90 2023-06-09T04:40:52.692 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.688+0000 7f6162821700 1 -- 172.21.15.62:0/3298936226 >> v1:172.21.15.89:6789/0 conn(0x7f615c159c90 legacy=0x7f615c070e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:52.692 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.688+0000 7f6162821700 1 -- 172.21.15.62:0/3298936226 >> v1:172.21.15.62:6789/0 conn(0x7f615c0cb850 legacy=0x7f615c0ca160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:52.692 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.688+0000 7f6162821700 1 -- 172.21.15.62:0/3298936226 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f615c0c89e0 con 0x7f615c0b08d0 2023-06-09T04:40:52.693 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.688+0000 7f6162821700 1 --2- 172.21.15.62:0/3298936226 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f615c0b08d0 0x7f615c0ca870 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6154009dc0 tx=0x7f615400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0ee4dd9b6bce8c server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:52.693 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.688+0000 7f616101e700 1 -- 172.21.15.62:0/3298936226 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615400e070 con 0x7f615c0b08d0 2023-06-09T04:40:52.693 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.688+0000 7f616101e700 1 -- 172.21.15.62:0/3298936226 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f615400bb20 con 0x7f615c0b08d0 2023-06-09T04:40:52.693 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.688+0000 7f616101e700 1 -- 172.21.15.62:0/3298936226 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6154012430 con 0x7f615c0b08d0 2023-06-09T04:40:52.693 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.688+0000 7f6164284700 1 -- 172.21.15.62:0/3298936226 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f615c0b08d0 msgr2=0x7f615c0ca870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:52.694 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.688+0000 7f6164284700 1 --2- 172.21.15.62:0/3298936226 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f615c0b08d0 0x7f615c0ca870 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6154009dc0 tx=0x7f615400b330 comp rx=0 tx=0).stop 2023-06-09T04:40:52.694 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.688+0000 7f6164284700 1 -- 172.21.15.62:0/3298936226 shutdown_connections 2023-06-09T04:40:52.694 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.688+0000 7f6164284700 1 --2- 172.21.15.62:0/3298936226 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f615c0b08d0 0x7f615c0ca870 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:52.694 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.688+0000 7f6164284700 1 -- 172.21.15.62:0/3298936226 >> 172.21.15.62:0/3298936226 conn(0x7f615c06a410 msgr2=0x7f615c0afd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:40:52.695 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.688+0000 7f6164284700 1 -- 172.21.15.62:0/3298936226 shutdown_connections 2023-06-09T04:40:52.695 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.688+0000 7f6164284700 1 -- 172.21.15.62:0/3298936226 wait complete. 2023-06-09T04:40:52.696 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.692+0000 7f6164284700 1 Processor -- start 2023-06-09T04:40:52.697 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.692+0000 7f6164284700 1 -- start start 2023-06-09T04:40:52.698 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.692+0000 7f6164284700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f615c0b08d0 0x7f615c0cc680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:52.698 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.692+0000 7f6164284700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f615c0cb850 0x7f615c0ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:52.698 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.692+0000 7f6164284700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f615c159c90 0x7f615c0c2250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:52.699 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.692+0000 7f6164284700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f615c1f1260 con 0x7f615c159c90 2023-06-09T04:40:52.699 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.692+0000 7f6164284700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f615c1f14d0 con 0x7f615c0b08d0 2023-06-09T04:40:52.699 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.692+0000 7f6164284700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f615c1f17b0 con 0x7f615c0cb850 2023-06-09T04:40:52.700 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.692+0000 7f6162821700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f615c159c90 0x7f615c0c2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:52.700 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.696+0000 7f6162821700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f615c159c90 0x7f615c0c2250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52988/0 (socket says 172.21.15.62:52988) 2023-06-09T04:40:52.700 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.696+0000 7f6162821700 1 -- 172.21.15.62:0/1461966044 learned_addr learned my addr 172.21.15.62:0/1461966044 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:40:52.700 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.696+0000 7f6162020700 1 --2- 172.21.15.62:0/1461966044 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f615c0b08d0 0x7f615c0cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:52.700 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.696+0000 7f616181f700 1 --2- 172.21.15.62:0/1461966044 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f615c0cb850 0x7f615c0ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:52.700 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.696+0000 7f6162821700 1 -- 172.21.15.62:0/1461966044 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f615c0cb850 msgr2=0x7f615c0ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:52.701 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.696+0000 7f6162821700 1 --2- 172.21.15.62:0/1461966044 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f615c0cb850 0x7f615c0ccbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:52.701 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.696+0000 7f6162821700 1 -- 172.21.15.62:0/1461966044 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f615c0b08d0 msgr2=0x7f615c0cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:52.701 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.696+0000 7f6162821700 1 --2- 172.21.15.62:0/1461966044 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f615c0b08d0 0x7f615c0cc680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:52.701 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.696+0000 7f6162821700 1 -- 172.21.15.62:0/1461966044 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6154009a70 con 0x7f615c159c90 2023-06-09T04:40:52.702 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.696+0000 7f6162821700 1 --2- 172.21.15.62:0/1461966044 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f615c159c90 0x7f615c0c2250 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f615400b370 tx=0x7f6154004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:52.702 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.696+0000 7f6152ffd700 1 -- 172.21.15.62:0/1461966044 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6154004780 con 0x7f615c159c90 2023-06-09T04:40:52.702 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.696+0000 7f6152ffd700 1 -- 172.21.15.62:0/1461966044 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6154020070 con 0x7f615c159c90 2023-06-09T04:40:52.702 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.696+0000 7f6164284700 1 -- 172.21.15.62:0/1461966044 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f615c1f1a90 con 0x7f615c159c90 2023-06-09T04:40:52.702 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.696+0000 7f6152ffd700 1 -- 172.21.15.62:0/1461966044 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61540098f0 con 0x7f615c159c90 2023-06-09T04:40:52.702 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.696+0000 7f6164284700 1 -- 172.21.15.62:0/1461966044 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f615c15ccf0 con 0x7f615c159c90 2023-06-09T04:40:52.703 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.696+0000 7f6164284700 1 -- 172.21.15.62:0/1461966044 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f615c1f1fb0 con 0x7f615c159c90 2023-06-09T04:40:52.704 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.700+0000 7f6152ffd700 1 -- 172.21.15.62:0/1461966044 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6154012430 con 0x7f615c159c90 2023-06-09T04:40:52.705 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.700+0000 7f6152ffd700 1 --2- 172.21.15.62:0/1461966044 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f61400662f0 0x7f61400687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:52.705 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.700+0000 7f6152ffd700 1 -- 172.21.15.62:0/1461966044 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6154022070 con 0x7f615c159c90 2023-06-09T04:40:52.706 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.700+0000 7f6162020700 1 --2- 172.21.15.62:0/1461966044 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f61400662f0 0x7f61400687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:52.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.704+0000 7f6162020700 1 --2- 172.21.15.62:0/1461966044 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f61400662f0 0x7f61400687a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f61580011e0 tx=0x7f6158009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:52.712 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.708+0000 7f6152ffd700 1 -- 172.21.15.62:0/1461966044 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f615c1f1fb0 con 0x7f615c159c90 2023-06-09T04:40:52.928 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.924+0000 7f6164284700 1 -- 172.21.15.62:0/1461966044 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f615c1f1fb0 con 0x7f615c159c90 2023-06-09T04:40:52.929 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.924+0000 7f6152ffd700 1 -- 172.21.15.62:0/1461966044 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3521 (secure 0 0 0) 0x7f615402cde0 con 0x7f615c159c90 2023-06-09T04:40:52.930 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:40:52.930 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4256,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/2242182358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2242182358},{"type":"v1","addr":"172.21.15.89:6836","nonce":2242182358}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6834/326702802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":326702802},{"type":"v1","addr":"172.21.15.62:6834","nonce":326702802}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4296,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/3851882562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":3851882562},{"type":"v1","addr":"172.21.15.62:6835","nonce":3851882562}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4312,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/1496954959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1496954959},{"type":"v1","addr":"172.21.15.89:6837","nonce":1496954959}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-06-09T04:40:52.932 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.928+0000 7f6164284700 1 -- 172.21.15.62:0/1461966044 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f61400662f0 msgr2=0x7f61400687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:52.932 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.928+0000 7f6164284700 1 --2- 172.21.15.62:0/1461966044 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f61400662f0 0x7f61400687a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f61580011e0 tx=0x7f6158009040 comp rx=0 tx=0).stop 2023-06-09T04:40:52.932 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.928+0000 7f6164284700 1 -- 172.21.15.62:0/1461966044 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f615c159c90 msgr2=0x7f615c0c2250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:52.932 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.928+0000 7f6164284700 1 --2- 172.21.15.62:0/1461966044 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f615c159c90 0x7f615c0c2250 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f615400b370 tx=0x7f6154004af0 comp rx=0 tx=0).stop 2023-06-09T04:40:52.933 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.928+0000 7f6164284700 1 -- 172.21.15.62:0/1461966044 shutdown_connections 2023-06-09T04:40:52.933 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.928+0000 7f6164284700 1 --2- 172.21.15.62:0/1461966044 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f61400662f0 0x7f61400687a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:52.933 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.928+0000 7f6164284700 1 --2- 172.21.15.62:0/1461966044 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f615c159c90 0x7f615c0c2250 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:52.933 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.928+0000 7f6164284700 1 --2- 172.21.15.62:0/1461966044 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f615c0cb850 0x7f615c0ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:52.933 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.928+0000 7f6164284700 1 --2- 172.21.15.62:0/1461966044 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f615c0b08d0 0x7f615c0cc680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:52.934 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.928+0000 7f6164284700 1 -- 172.21.15.62:0/1461966044 >> 172.21.15.62:0/1461966044 conn(0x7f615c06a410 msgr2=0x7f615c158520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:40:52.934 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.928+0000 7f6164284700 1 -- 172.21.15.62:0/1461966044 shutdown_connections 2023-06-09T04:40:52.934 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:52.928+0000 7f6164284700 1 -- 172.21.15.62:0/1461966044 wait complete. 2023-06-09T04:40:52.934 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 3 2023-06-09T04:40:52.956 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:40:53.138 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.132+0000 7f75e10bc700 1 Processor -- start 2023-06-09T04:40:53.139 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.132+0000 7f75e10bc700 1 -- start start 2023-06-09T04:40:53.141 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.136+0000 7f75e10bc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75dc0cb850 0x7f75dc0ca160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:53.141 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.136+0000 7f75e10bc700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75dc06f9b0 con 0x7f75dc159c90 2023-06-09T04:40:53.142 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.136+0000 7f75e10bc700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75dc15a060 con 0x7f75dc0b08d0 2023-06-09T04:40:53.142 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.136+0000 7f75e10bc700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75dc06b960 con 0x7f75dc0cb850 2023-06-09T04:40:53.142 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.136+0000 7f75dad9d700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f75dc159c90 0x7f75dc070e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:45722/0 (socket says 172.21.15.62:45722) 2023-06-09T04:40:53.142 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.136+0000 7f75dad9d700 1 -- 172.21.15.62:0/3745540205 learned_addr learned my addr 172.21.15.62:0/3745540205 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:40:53.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.136+0000 7f75d3fff700 1 --2- 172.21.15.62:0/3745540205 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75dc0cb850 0x7f75dc0ca160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:53.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.136+0000 7f75da59c700 1 -- 172.21.15.62:0/3745540205 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3237183930 0 0) 0x7f75dc06f9b0 con 0x7f75dc159c90 2023-06-09T04:40:53.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.136+0000 7f75da59c700 1 -- 172.21.15.62:0/3745540205 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75c80035d0 con 0x7f75dc159c90 2023-06-09T04:40:53.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.136+0000 7f75d3fff700 1 -- 172.21.15.62:0/3745540205 >> v1:172.21.15.89:6789/0 conn(0x7f75dc0b08d0 legacy=0x7f75dc0ca6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:53.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.136+0000 7f75da59c700 1 -- 172.21.15.62:0/3745540205 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2562884746 0 0) 0x7f75dc15a060 con 0x7f75dc0b08d0 2023-06-09T04:40:53.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.136+0000 7f75d3fff700 1 -- 172.21.15.62:0/3745540205 >> v1:172.21.15.62:6789/0 conn(0x7f75dc159c90 legacy=0x7f75dc070e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:53.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.136+0000 7f75d3fff700 1 -- 172.21.15.62:0/3745540205 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75dc0c89e0 con 0x7f75dc0cb850 2023-06-09T04:40:53.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.140+0000 7f75d3fff700 1 --2- 172.21.15.62:0/3745540205 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75dc0cb850 0x7f75dc0ca160 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f75c4009880 tx=0x7f75c4009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c518b3939d0bbdcc server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:53.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.140+0000 7f75da59c700 1 -- 172.21.15.62:0/3745540205 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c4011830 con 0x7f75dc0cb850 2023-06-09T04:40:53.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.140+0000 7f75da59c700 1 -- 172.21.15.62:0/3745540205 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75c4011990 con 0x7f75dc0cb850 2023-06-09T04:40:53.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.140+0000 7f75da59c700 1 -- 172.21.15.62:0/3745540205 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c4011d20 con 0x7f75dc0cb850 2023-06-09T04:40:53.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.140+0000 7f75e10bc700 1 -- 172.21.15.62:0/3745540205 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75dc0cb850 msgr2=0x7f75dc0ca160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:53.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.140+0000 7f75e10bc700 1 --2- 172.21.15.62:0/3745540205 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75dc0cb850 0x7f75dc0ca160 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f75c4009880 tx=0x7f75c4009b90 comp rx=0 tx=0).stop 2023-06-09T04:40:53.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.140+0000 7f75e10bc700 1 -- 172.21.15.62:0/3745540205 shutdown_connections 2023-06-09T04:40:53.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.140+0000 7f75e10bc700 1 --2- 172.21.15.62:0/3745540205 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75dc0cb850 0x7f75dc0ca160 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:53.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.140+0000 7f75e10bc700 1 -- 172.21.15.62:0/3745540205 >> 172.21.15.62:0/3745540205 conn(0x7f75dc06a410 msgr2=0x7f75dc0afd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:40:53.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.140+0000 7f75e10bc700 1 -- 172.21.15.62:0/3745540205 shutdown_connections 2023-06-09T04:40:53.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.140+0000 7f75e10bc700 1 -- 172.21.15.62:0/3745540205 wait complete. 2023-06-09T04:40:53.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.144+0000 7f75e10bc700 1 Processor -- start 2023-06-09T04:40:53.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.144+0000 7f75e10bc700 1 -- start start 2023-06-09T04:40:53.149 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.144+0000 7f75e10bc700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75dc0b08d0 0x7f75dc0c5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:53.149 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.144+0000 7f75e10bc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75dc0cb850 0x7f75dc1461e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:53.149 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.144+0000 7f75e10bc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75dc159c90 0x7f75dc149920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:53.149 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.144+0000 7f75e10bc700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75dc0ae060 con 0x7f75dc0cb850 2023-06-09T04:40:53.149 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.144+0000 7f75e10bc700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75dc146c30 con 0x7f75dc0b08d0 2023-06-09T04:40:53.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.144+0000 7f75e10bc700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75dc146f10 con 0x7f75dc159c90 2023-06-09T04:40:53.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.144+0000 7f75d3fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75dc0cb850 0x7f75dc1461e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:53.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.144+0000 7f75d3fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75dc0cb850 0x7f75dc1461e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:52994/0 (socket says 172.21.15.62:52994) 2023-06-09T04:40:53.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.144+0000 7f75d3fff700 1 -- 172.21.15.62:0/2731543855 learned_addr learned my addr 172.21.15.62:0/2731543855 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:40:53.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.144+0000 7f75dad9d700 1 --2- 172.21.15.62:0/2731543855 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75dc0b08d0 0x7f75dc0c5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:53.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.144+0000 7f75db59e700 1 --2- 172.21.15.62:0/2731543855 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75dc159c90 0x7f75dc149920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:53.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.144+0000 7f75d3fff700 1 -- 172.21.15.62:0/2731543855 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75dc159c90 msgr2=0x7f75dc149920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:53.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.144+0000 7f75d3fff700 1 --2- 172.21.15.62:0/2731543855 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75dc159c90 0x7f75dc149920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:53.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.144+0000 7f75d3fff700 1 -- 172.21.15.62:0/2731543855 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75dc0b08d0 msgr2=0x7f75dc0c5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:53.152 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.144+0000 7f75d3fff700 1 --2- 172.21.15.62:0/2731543855 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75dc0b08d0 0x7f75dc0c5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:53.152 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.144+0000 7f75d3fff700 1 -- 172.21.15.62:0/2731543855 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75c40094b0 con 0x7f75dc0cb850 2023-06-09T04:40:53.152 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.144+0000 7f75db59e700 1 --2- 172.21.15.62:0/2731543855 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75dc159c90 0x7f75dc149920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:40:53.152 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.148+0000 7f75d3fff700 1 --2- 172.21.15.62:0/2731543855 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75dc0cb850 0x7f75dc1461e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f75c4013040 tx=0x7f75c4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:53.153 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.148+0000 7f75d37fe700 1 -- 172.21.15.62:0/2731543855 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c4004590 con 0x7f75dc0cb850 2023-06-09T04:40:53.153 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.148+0000 7f75d37fe700 1 -- 172.21.15.62:0/2731543855 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75c401e070 con 0x7f75dc0cb850 2023-06-09T04:40:53.153 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.148+0000 7f75e10bc700 1 -- 172.21.15.62:0/2731543855 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75dc0adcf0 con 0x7f75dc0cb850 2023-06-09T04:40:53.153 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.148+0000 7f75d37fe700 1 -- 172.21.15.62:0/2731543855 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c4003900 con 0x7f75dc0cb850 2023-06-09T04:40:53.153 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.148+0000 7f75e10bc700 1 -- 172.21.15.62:0/2731543855 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75dc0c7530 con 0x7f75dc0cb850 2023-06-09T04:40:53.154 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.148+0000 7f75e10bc700 1 -- 172.21.15.62:0/2731543855 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75dc0adaf0 con 0x7f75dc0cb850 2023-06-09T04:40:53.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.152+0000 7f75d37fe700 1 -- 172.21.15.62:0/2731543855 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f75c4003a60 con 0x7f75dc0cb850 2023-06-09T04:40:53.157 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.152+0000 7f75d37fe700 1 --2- 172.21.15.62:0/2731543855 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f75bc0662f0 0x7f75bc0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:53.158 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.152+0000 7f75d37fe700 1 -- 172.21.15.62:0/2731543855 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f75c4084910 con 0x7f75dc0cb850 2023-06-09T04:40:53.158 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.152+0000 7f75dad9d700 1 --2- 172.21.15.62:0/2731543855 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f75bc0662f0 0x7f75bc0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:53.159 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.156+0000 7f75dad9d700 1 --2- 172.21.15.62:0/2731543855 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f75bc0662f0 0x7f75bc0687a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f75cc007fd0 tx=0x7f75cc007de0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:53.163 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.160+0000 7f75d37fe700 1 -- 172.21.15.62:0/2731543855 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f75c4052050 con 0x7f75dc0cb850 2023-06-09T04:40:53.340 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.336+0000 7f75e10bc700 1 -- 172.21.15.62:0/2731543855 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f75dc04db30 con 0x7f75dc0cb850 2023-06-09T04:40:53.341 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.336+0000 7f75d37fe700 1 -- 172.21.15.62:0/2731543855 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+14600 (secure 0 0 0) 0x7f75c4055670 con 0x7f75dc0cb850 2023-06-09T04:40:53.342 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:40:53.342 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":20,"fsid":"f7998a1e-e5a9-4202-abaa-70c0eaae1047","created":"2023-06-09T04:40:30.469588+0000","modified":"2023-06-09T04:40:52.236328+0000","last_up_change":"2023-06-09T04:40:43.120747+0000","last_in_change":"2023-06-09T04:40:33.568221+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:40:44.646921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:40:50.006643+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bc50bbc0-dd08-42ed-804c-ec3029e36c19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6802","nonce":1295788017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6807","nonce":1295788017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6815","nonce":1295788017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6809","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6811","nonce":1295788017}]},"public_addr":"172.21.15.62:6802/1295788017","cluster_addr":"172.21.15.62:6807/1295788017","heartbeat_back_addr":"172.21.15.62:6815/1295788017","heartbeat_front_addr":"172.21.15.62:6811/1295788017","state":["exists","up"]},{"osd":1,"uuid":"8230b12d-e22f-4985-a584-4cc64404cdbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6825","nonce":4120692006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6827","nonce":4120692006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6831","nonce":4120692006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6829","nonce":4120692006}]},"public_addr":"172.21.15.62:6825/4120692006","cluster_addr":"172.21.15.62:6827/4120692006","heartbeat_back_addr":"172.21.15.62:6831/4120692006","heartbeat_front_addr":"172.21.15.62:6829/4120692006","state":["exists","up"]},{"osd":2,"uuid":"d0202506-dbe9-4e3c-9271-687929abf96a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6801","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6803","nonce":4169607876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6805","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6806","nonce":4169607876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6814","nonce":4169607876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6810","nonce":4169607876}]},"public_addr":"172.21.15.62:6803/4169607876","cluster_addr":"172.21.15.62:6806/4169607876","heartbeat_back_addr":"172.21.15.62:6814/4169607876","heartbeat_front_addr":"172.21.15.62:6810/4169607876","state":["exists","up"]},{"osd":3,"uuid":"f3c0298a-b075-4411-af50-e16cd74fdddb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6817","nonce":3268438986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6819","nonce":3268438986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6823","nonce":3268438986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6821","nonce":3268438986}]},"public_addr":"172.21.15.62:6817/3268438986","cluster_addr":"172.21.15.62:6819/3268438986","heartbeat_back_addr":"172.21.15.62:6823/3268438986","heartbeat_front_addr":"172.21.15.62:6821/3268438986","state":["exists","up"]},{"osd":4,"uuid":"1ab5c5ca-e74f-475a-a309-683cc0029928","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6817","nonce":3139617628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6819","nonce":3139617628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6823","nonce":3139617628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6821","nonce":3139617628}]},"public_addr":"172.21.15.89:6817/3139617628","cluster_addr":"172.21.15.89:6819/3139617628","heartbeat_back_addr":"172.21.15.89:6823/3139617628","heartbeat_front_addr":"172.21.15.89:6821/3139617628","state":["exists","up"]},{"osd":5,"uuid":"a933e184-bd8f-4369-a1ba-a68de53c578c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6825","nonce":2681723596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6827","nonce":2681723596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6831","nonce":2681723596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6829","nonce":2681723596}]},"public_addr":"172.21.15.89:6825/2681723596","cluster_addr":"172.21.15.89:6827/2681723596","heartbeat_back_addr":"172.21.15.89:6831/2681723596","heartbeat_front_addr":"172.21.15.89:6829/2681723596","state":["exists","up"]},{"osd":6,"uuid":"1ed7ad37-2eee-49a6-954c-b537e2b7f0ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6809","nonce":1657136033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6811","nonce":1657136033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6815","nonce":1657136033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6813","nonce":1657136033}]},"public_addr":"172.21.15.89:6809/1657136033","cluster_addr":"172.21.15.89:6811/1657136033","heartbeat_back_addr":"172.21.15.89:6815/1657136033","heartbeat_front_addr":"172.21.15.89:6813/1657136033","state":["exists","up"]},{"osd":7,"uuid":"6ed732e9-33ff-40df-9038-a9f1d1622671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6801","nonce":1710561686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6803","nonce":1710561686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6807","nonce":1710561686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6805","nonce":1710561686}]},"public_addr":"172.21.15.89:6801/1710561686","cluster_addr":"172.21.15.89:6803/1710561686","heartbeat_back_addr":"172.21.15.89:6807/1710561686","heartbeat_front_addr":"172.21.15.89:6805/1710561686","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.335803+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.419788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.179334+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.263310+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.071846+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.375627+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.282277+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.315997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:40:53.344 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.340+0000 7f75e10bc700 1 -- 172.21.15.62:0/2731543855 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f75bc0662f0 msgr2=0x7f75bc0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:53.344 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.340+0000 7f75e10bc700 1 --2- 172.21.15.62:0/2731543855 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f75bc0662f0 0x7f75bc0687a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f75cc007fd0 tx=0x7f75cc007de0 comp rx=0 tx=0).stop 2023-06-09T04:40:53.345 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.340+0000 7f75e10bc700 1 -- 172.21.15.62:0/2731543855 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75dc0cb850 msgr2=0x7f75dc1461e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:53.345 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.340+0000 7f75e10bc700 1 --2- 172.21.15.62:0/2731543855 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75dc0cb850 0x7f75dc1461e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f75c4013040 tx=0x7f75c4004770 comp rx=0 tx=0).stop 2023-06-09T04:40:53.345 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.340+0000 7f75e10bc700 1 -- 172.21.15.62:0/2731543855 shutdown_connections 2023-06-09T04:40:53.345 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.340+0000 7f75e10bc700 1 --2- 172.21.15.62:0/2731543855 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f75bc0662f0 0x7f75bc0687a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:53.345 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.340+0000 7f75e10bc700 1 --2- 172.21.15.62:0/2731543855 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75dc159c90 0x7f75dc149920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:53.345 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.340+0000 7f75e10bc700 1 --2- 172.21.15.62:0/2731543855 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75dc0cb850 0x7f75dc1461e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:53.345 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.340+0000 7f75e10bc700 1 --2- 172.21.15.62:0/2731543855 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75dc0b08d0 0x7f75dc0c5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:53.346 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.340+0000 7f75e10bc700 1 -- 172.21.15.62:0/2731543855 >> 172.21.15.62:0/2731543855 conn(0x7f75dc06a410 msgr2=0x7f75dc0c9f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:40:53.346 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.340+0000 7f75e10bc700 1 -- 172.21.15.62:0/2731543855 shutdown_connections 2023-06-09T04:40:53.346 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.340+0000 7f75e10bc700 1 -- 172.21.15.62:0/2731543855 wait complete. 2023-06-09T04:40:53.366 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:40:44.646921+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:40:50.006643+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-09T04:40:53.367 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:40:53.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.532+0000 7fd4d9337700 1 Processor -- start 2023-06-09T04:40:53.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.532+0000 7fd4d9337700 1 -- start start 2023-06-09T04:40:53.539 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.536+0000 7fd4d9337700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd4d40b3ed0 0x7fd4d40b42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:53.540 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.536+0000 7fd4d9337700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4d40d0c00 con 0x7fd4d40cf2b0 2023-06-09T04:40:53.540 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.536+0000 7fd4d9337700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4d40b1b30 con 0x7fd4d40d1090 2023-06-09T04:40:53.540 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.536+0000 7fd4d9337700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d40cf730 con 0x7fd4d40b3ed0 2023-06-09T04:40:53.541 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.536+0000 7fd4d8b36700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fd4d40cf2b0 0x7fd4d40b52a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:45730/0 (socket says 172.21.15.62:45730) 2023-06-09T04:40:53.541 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.536+0000 7fd4d8b36700 1 -- 172.21.15.62:0/2572803785 learned_addr learned my addr 172.21.15.62:0/2572803785 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:40:53.541 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.536+0000 7fd4d3fff700 1 --2- 172.21.15.62:0/2572803785 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd4d40b3ed0 0x7fd4d40b42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:53.542 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.536+0000 7fd4d2ffd700 1 -- 172.21.15.62:0/2572803785 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 660404055 0 0) 0x7fd4d40d0c00 con 0x7fd4d40cf2b0 2023-06-09T04:40:53.542 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.536+0000 7fd4d2ffd700 1 -- 172.21.15.62:0/2572803785 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4bc0035d0 con 0x7fd4d40cf2b0 2023-06-09T04:40:53.542 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.536+0000 7fd4d2ffd700 1 -- 172.21.15.62:0/2572803785 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3872894933 0 0) 0x7fd4d40b1b30 con 0x7fd4d40d1090 2023-06-09T04:40:53.542 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.536+0000 7fd4d2ffd700 1 -- 172.21.15.62:0/2572803785 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4d40d0c00 con 0x7fd4d40d1090 2023-06-09T04:40:53.542 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.536+0000 7fd4d3fff700 1 -- 172.21.15.62:0/2572803785 >> v1:172.21.15.89:6789/0 conn(0x7fd4d40d1090 legacy=0x7fd4d40ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:53.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.536+0000 7fd4d3fff700 1 -- 172.21.15.62:0/2572803785 >> v1:172.21.15.62:6789/0 conn(0x7fd4d40cf2b0 legacy=0x7fd4d40b52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:53.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.536+0000 7fd4d3fff700 1 -- 172.21.15.62:0/2572803785 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4d40b47e0 con 0x7fd4d40b3ed0 2023-06-09T04:40:53.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.536+0000 7fd4d3fff700 1 --2- 172.21.15.62:0/2572803785 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd4d40b3ed0 0x7fd4d40b42a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd4c4009880 tx=0x7fd4c4009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b38ea2576450792a server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:53.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.536+0000 7fd4d2ffd700 1 -- 172.21.15.62:0/2572803785 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4c4011830 con 0x7fd4d40b3ed0 2023-06-09T04:40:53.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.540+0000 7fd4d2ffd700 1 -- 172.21.15.62:0/2572803785 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4c4011990 con 0x7fd4d40b3ed0 2023-06-09T04:40:53.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.540+0000 7fd4d2ffd700 1 -- 172.21.15.62:0/2572803785 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4c4011d20 con 0x7fd4d40b3ed0 2023-06-09T04:40:53.545 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.540+0000 7fd4d9337700 1 -- 172.21.15.62:0/2572803785 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd4d40b3ed0 msgr2=0x7fd4d40b42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:53.545 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.540+0000 7fd4d9337700 1 --2- 172.21.15.62:0/2572803785 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd4d40b3ed0 0x7fd4d40b42a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd4c4009880 tx=0x7fd4c4009b90 comp rx=0 tx=0).stop 2023-06-09T04:40:53.545 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.540+0000 7fd4d9337700 1 -- 172.21.15.62:0/2572803785 shutdown_connections 2023-06-09T04:40:53.545 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.540+0000 7fd4d9337700 1 --2- 172.21.15.62:0/2572803785 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd4d40b3ed0 0x7fd4d40b42a0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:53.545 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.540+0000 7fd4d9337700 1 -- 172.21.15.62:0/2572803785 >> 172.21.15.62:0/2572803785 conn(0x7fd4d406a500 msgr2=0x7fd4d406a900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:40:53.545 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.540+0000 7fd4d9337700 1 -- 172.21.15.62:0/2572803785 shutdown_connections 2023-06-09T04:40:53.546 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.540+0000 7fd4d9337700 1 -- 172.21.15.62:0/2572803785 wait complete. 2023-06-09T04:40:53.547 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.544+0000 7fd4d9337700 1 Processor -- start 2023-06-09T04:40:53.547 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.544+0000 7fd4d9337700 1 -- start start 2023-06-09T04:40:53.548 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.544+0000 7fd4d9337700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd4d40b3ed0 0x7fd4d40c80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:53.549 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.544+0000 7fd4d9337700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4d40cf2b0 0x7fd4d40cc430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:53.549 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.544+0000 7fd4d9337700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4d40d1090 0x7fd4d40cc970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:53.549 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.544+0000 7fd4d9337700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d40cd870 con 0x7fd4d40d1090 2023-06-09T04:40:53.549 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.544+0000 7fd4d9337700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d40ccfd0 con 0x7fd4d40cf2b0 2023-06-09T04:40:53.549 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.544+0000 7fd4d9337700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4d40cd2b0 con 0x7fd4d40b3ed0 2023-06-09T04:40:53.550 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.544+0000 7fd4d8b36700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4d40d1090 0x7fd4d40cc970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:53.550 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.544+0000 7fd4d8b36700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4d40d1090 0x7fd4d40cc970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53010/0 (socket says 172.21.15.62:53010) 2023-06-09T04:40:53.550 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.544+0000 7fd4d8b36700 1 -- 172.21.15.62:0/2858708689 learned_addr learned my addr 172.21.15.62:0/2858708689 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:40:53.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.544+0000 7fd4d3fff700 1 --2- 172.21.15.62:0/2858708689 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd4d40b3ed0 0x7fd4d40c80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:53.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.544+0000 7fd4d37fe700 1 --2- 172.21.15.62:0/2858708689 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4d40cf2b0 0x7fd4d40cc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:53.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.544+0000 7fd4d8b36700 1 -- 172.21.15.62:0/2858708689 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd4d40b3ed0 msgr2=0x7fd4d40c80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:53.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.544+0000 7fd4d8b36700 1 --2- 172.21.15.62:0/2858708689 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd4d40b3ed0 0x7fd4d40c80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:53.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.544+0000 7fd4d8b36700 1 -- 172.21.15.62:0/2858708689 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4d40cf2b0 msgr2=0x7fd4d40cc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:53.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.544+0000 7fd4d8b36700 1 --2- 172.21.15.62:0/2858708689 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4d40cf2b0 0x7fd4d40cc430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:53.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.544+0000 7fd4d8b36700 1 -- 172.21.15.62:0/2858708689 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4c40094b0 con 0x7fd4d40d1090 2023-06-09T04:40:53.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.544+0000 7fd4d37fe700 1 --2- 172.21.15.62:0/2858708689 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4d40cf2b0 0x7fd4d40cc430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:40:53.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.544+0000 7fd4d3fff700 1 --2- 172.21.15.62:0/2858708689 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd4d40b3ed0 0x7fd4d40c80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:40:53.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.544+0000 7fd4d8b36700 1 --2- 172.21.15.62:0/2858708689 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4d40d1090 0x7fd4d40cc970 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc00cba0 tx=0x7fd4cc00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:53.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.544+0000 7fd4d0ff9700 1 -- 172.21.15.62:0/2858708689 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4cc00a980 con 0x7fd4d40d1090 2023-06-09T04:40:53.553 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.548+0000 7fd4d0ff9700 1 -- 172.21.15.62:0/2858708689 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4cc00aae0 con 0x7fd4d40d1090 2023-06-09T04:40:53.553 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.548+0000 7fd4d0ff9700 1 -- 172.21.15.62:0/2858708689 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4cc00ae70 con 0x7fd4d40d1090 2023-06-09T04:40:53.553 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.548+0000 7fd4d9337700 1 -- 172.21.15.62:0/2858708689 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4d40cd590 con 0x7fd4d40d1090 2023-06-09T04:40:53.553 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.548+0000 7fd4d9337700 1 -- 172.21.15.62:0/2858708689 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4d40c9790 con 0x7fd4d40d1090 2023-06-09T04:40:53.553 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.548+0000 7fd4d9337700 1 -- 172.21.15.62:0/2858708689 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4d40b6d90 con 0x7fd4d40d1090 2023-06-09T04:40:53.555 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.552+0000 7fd4d0ff9700 1 -- 172.21.15.62:0/2858708689 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd4cc01b3b0 con 0x7fd4d40d1090 2023-06-09T04:40:53.556 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.552+0000 7fd4d0ff9700 1 --2- 172.21.15.62:0/2858708689 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fd4c0066340 0x7fd4c00687f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:53.557 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.552+0000 7fd4d0ff9700 1 -- 172.21.15.62:0/2858708689 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fd4cc083430 con 0x7fd4d40d1090 2023-06-09T04:40:53.557 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.552+0000 7fd4d3fff700 1 --2- 172.21.15.62:0/2858708689 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fd4c0066340 0x7fd4c00687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:53.558 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.552+0000 7fd4d3fff700 1 --2- 172.21.15.62:0/2858708689 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fd4c0066340 0x7fd4c00687f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd4c40090b0 tx=0x7fd4c401c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:53.563 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.560+0000 7fd4d0ff9700 1 -- 172.21.15.62:0/2858708689 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd4d40b6d90 con 0x7fd4d40d1090 2023-06-09T04:40:53.741 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.736+0000 7fd4d9337700 1 -- 172.21.15.62:0/2858708689 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd4d40b6d90 con 0x7fd4d40d1090 2023-06-09T04:40:53.742 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.736+0000 7fd4d0ff9700 1 -- 172.21.15.62:0/2858708689 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd4d40b6d90 con 0x7fd4d40d1090 2023-06-09T04:40:53.742 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2023-06-09T04:40:53.745 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.740+0000 7fd4d9337700 1 -- 172.21.15.62:0/2858708689 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fd4c0066340 msgr2=0x7fd4c00687f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:53.745 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.740+0000 7fd4d9337700 1 --2- 172.21.15.62:0/2858708689 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fd4c0066340 0x7fd4c00687f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd4c40090b0 tx=0x7fd4c401c040 comp rx=0 tx=0).stop 2023-06-09T04:40:53.745 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.740+0000 7fd4d9337700 1 -- 172.21.15.62:0/2858708689 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4d40d1090 msgr2=0x7fd4d40cc970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:53.746 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.740+0000 7fd4d9337700 1 --2- 172.21.15.62:0/2858708689 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4d40d1090 0x7fd4d40cc970 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc00cba0 tx=0x7fd4cc00cc80 comp rx=0 tx=0).stop 2023-06-09T04:40:53.746 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.740+0000 7fd4d9337700 1 -- 172.21.15.62:0/2858708689 shutdown_connections 2023-06-09T04:40:53.746 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.740+0000 7fd4d9337700 1 --2- 172.21.15.62:0/2858708689 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fd4c0066340 0x7fd4c00687f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:53.746 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.740+0000 7fd4d9337700 1 --2- 172.21.15.62:0/2858708689 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd4d40d1090 0x7fd4d40cc970 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:53.747 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.740+0000 7fd4d9337700 1 --2- 172.21.15.62:0/2858708689 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd4d40cf2b0 0x7fd4d40cc430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:53.747 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.740+0000 7fd4d9337700 1 --2- 172.21.15.62:0/2858708689 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd4d40b3ed0 0x7fd4d40c80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:53.747 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.740+0000 7fd4d9337700 1 -- 172.21.15.62:0/2858708689 >> 172.21.15.62:0/2858708689 conn(0x7fd4d406a500 msgr2=0x7fd4d4072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:40:53.747 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.740+0000 7fd4d9337700 1 -- 172.21.15.62:0/2858708689 shutdown_connections 2023-06-09T04:40:53.747 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.740+0000 7fd4d9337700 1 -- 172.21.15.62:0/2858708689 wait complete. 2023-06-09T04:40:53.769 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:40:53.949 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.944+0000 7f759d570700 1 Processor -- start 2023-06-09T04:40:53.949 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.944+0000 7f759d570700 1 -- start start 2023-06-09T04:40:53.951 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.948+0000 7f759d570700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7598160360 0x7f75980ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:53.951 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.948+0000 7f759d570700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7598160730 con 0x7f75980b0260 2023-06-09T04:40:53.951 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.948+0000 7f759d570700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75980ca860 con 0x7f75980c8800 2023-06-09T04:40:53.952 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.948+0000 7f759d570700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75980ca580 con 0x7f7598160360 2023-06-09T04:40:53.952 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.948+0000 7f759cd6f700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f75980b0260 0x7f75980705b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:45736/0 (socket says 172.21.15.62:45736) 2023-06-09T04:40:53.953 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.948+0000 7f759cd6f700 1 -- 172.21.15.62:0/3561674206 learned_addr learned my addr 172.21.15.62:0/3561674206 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:40:53.953 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.948+0000 7f7597fff700 1 --2- 172.21.15.62:0/3561674206 >> v2:172.21.15.89:3300/0 conn(0x7f7598160360 0x7f75980ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:53.953 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.948+0000 7f7596ffd700 1 -- 172.21.15.62:0/3561674206 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3125492853 0 0) 0x7f7598160730 con 0x7f75980b0260 2023-06-09T04:40:53.953 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.948+0000 7f7596ffd700 1 -- 172.21.15.62:0/3561674206 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75800035d0 con 0x7f75980b0260 2023-06-09T04:40:53.954 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.948+0000 7f7596ffd700 1 -- 172.21.15.62:0/3561674206 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4139175294 0 0) 0x7f75800035d0 con 0x7f75980b0260 2023-06-09T04:40:53.954 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.948+0000 7f7596ffd700 1 -- 172.21.15.62:0/3561674206 >> v2:172.21.15.89:3300/0 conn(0x7f7598160360 msgr2=0x7f75980ccb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:40:53.955 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.948+0000 7f7596ffd700 1 --2- 172.21.15.62:0/3561674206 >> v2:172.21.15.89:3300/0 conn(0x7f7598160360 0x7f75980ccb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:53.955 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.948+0000 7f7596ffd700 1 -- 172.21.15.62:0/3561674206 >> v1:172.21.15.89:6789/0 conn(0x7f75980c8800 legacy=0x7f75980afb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:53.955 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.948+0000 7f7596ffd700 1 -- 172.21.15.62:0/3561674206 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75980cc070 con 0x7f75980b0260 2023-06-09T04:40:53.955 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.948+0000 7f7596ffd700 1 -- 172.21.15.62:0/3561674206 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 540845019 0 0) 0x7f75900019f0 con 0x7f75980b0260 2023-06-09T04:40:53.955 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.948+0000 7f7596ffd700 1 -- 172.21.15.62:0/3561674206 >> v1:172.21.15.62:6789/0 conn(0x7f75980b0260 legacy=0x7f75980705b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:53.955 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.948+0000 7f7596ffd700 1 --2- 172.21.15.62:0/3561674206 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7580003a20 0x7f7580003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:53.955 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.948+0000 7f7596ffd700 1 --2- 172.21.15.62:0/3561674206 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7580004410 0x7f75800048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:53.956 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.948+0000 7f7596ffd700 1 --2- 172.21.15.62:0/3561674206 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75800050d0 0x7f758000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:53.956 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.948+0000 7f7596ffd700 1 -- 172.21.15.62:0/3561674206 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75980ca580 con 0x7f7580004410 2023-06-09T04:40:53.956 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.948+0000 7f7596ffd700 1 -- 172.21.15.62:0/3561674206 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f758000c020 con 0x7f7580003a20 2023-06-09T04:40:53.956 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.948+0000 7f7596ffd700 1 -- 172.21.15.62:0/3561674206 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f758000c1e0 con 0x7f75800050d0 2023-06-09T04:40:53.956 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.948+0000 7f7597fff700 1 --2- 172.21.15.62:0/3561674206 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7580003a20 0x7f7580003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:53.957 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.948+0000 7f75977fe700 1 --2- 172.21.15.62:0/3561674206 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7580004410 0x7f75800048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:53.957 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.948+0000 7f759cd6f700 1 --2- 172.21.15.62:0/3561674206 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75800050d0 0x7f758000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:53.958 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.952+0000 7f7597fff700 1 -- 172.21.15.62:0/3561674206 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75800050d0 msgr2=0x7f758000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:40:53.958 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.952+0000 7f7597fff700 1 --2- 172.21.15.62:0/3561674206 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75800050d0 0x7f758000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:53.958 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.952+0000 7f7597fff700 1 -- 172.21.15.62:0/3561674206 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7580004410 msgr2=0x7f75800048d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:40:53.958 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.952+0000 7f7597fff700 1 --2- 172.21.15.62:0/3561674206 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7580004410 0x7f75800048d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:53.958 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.952+0000 7f7597fff700 1 -- 172.21.15.62:0/3561674206 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75800035d0 con 0x7f7580003a20 2023-06-09T04:40:53.959 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.952+0000 7f75977fe700 1 --2- 172.21.15.62:0/3561674206 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7580004410 0x7f75800048d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:40:53.959 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.952+0000 7f759cd6f700 1 -- 172.21.15.62:0/3561674206 reap_dead start 2023-06-09T04:40:53.959 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.952+0000 7f7597fff700 1 --2- 172.21.15.62:0/3561674206 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7580003a20 0x7f7580003df0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7588009b70 tx=0x7f75800058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0916fc6d63f94c5 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:53.959 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.952+0000 7f7596ffd700 1 -- 172.21.15.62:0/3561674206 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758800e6c0 con 0x7f7580003a20 2023-06-09T04:40:53.959 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.952+0000 7f7596ffd700 1 -- 172.21.15.62:0/3561674206 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f758800e820 con 0x7f7580003a20 2023-06-09T04:40:53.959 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.952+0000 7f7596ffd700 1 -- 172.21.15.62:0/3561674206 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758800ebb0 con 0x7f7580003a20 2023-06-09T04:40:53.959 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.952+0000 7f759d570700 1 -- 172.21.15.62:0/3561674206 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7580003a20 msgr2=0x7f7580003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:53.959 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.952+0000 7f759d570700 1 --2- 172.21.15.62:0/3561674206 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7580003a20 0x7f7580003df0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7588009b70 tx=0x7f75800058a0 comp rx=0 tx=0).stop 2023-06-09T04:40:53.960 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.952+0000 7f759d570700 1 -- 172.21.15.62:0/3561674206 shutdown_connections 2023-06-09T04:40:53.960 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.952+0000 7f759d570700 1 --2- 172.21.15.62:0/3561674206 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7580003a20 0x7f7580003df0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:53.960 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.952+0000 7f759d570700 1 -- 172.21.15.62:0/3561674206 >> 172.21.15.62:0/3561674206 conn(0x7f75980cab50 msgr2=0x7f75980caf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:40:53.960 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.952+0000 7f759d570700 1 -- 172.21.15.62:0/3561674206 shutdown_connections 2023-06-09T04:40:53.960 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.952+0000 7f759d570700 1 -- 172.21.15.62:0/3561674206 wait complete. 2023-06-09T04:40:53.960 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.956+0000 7f759d570700 1 Processor -- start 2023-06-09T04:40:53.961 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.956+0000 7f759d570700 1 -- start start 2023-06-09T04:40:53.963 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.960+0000 7f759d570700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7580003a20 0x7f759806f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:53.963 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.960+0000 7f759d570700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f759806f9e0 0x7f75981e5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:53.963 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.960+0000 7f759d570700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75981e5b70 0x7f75981e5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:53.963 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.960+0000 7f759d570700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75980c1e00 con 0x7f7580003a20 2023-06-09T04:40:53.964 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.960+0000 7f759d570700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f759806fe50 con 0x7f759806f9e0 2023-06-09T04:40:53.964 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.960+0000 7f759d570700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f759814f5b0 con 0x7f75981e5b70 2023-06-09T04:40:53.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.960+0000 7f7597fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7580003a20 0x7f759806f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:53.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.960+0000 7f7597fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7580003a20 0x7f759806f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53024/0 (socket says 172.21.15.62:53024) 2023-06-09T04:40:53.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.960+0000 7f7597fff700 1 -- 172.21.15.62:0/2052882403 learned_addr learned my addr 172.21.15.62:0/2052882403 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:40:53.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.960+0000 7f75977fe700 1 --2- 172.21.15.62:0/2052882403 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f759806f9e0 0x7f75981e5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:53.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.960+0000 7f759cd6f700 1 --2- 172.21.15.62:0/2052882403 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75981e5b70 0x7f75981e5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:53.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.960+0000 7f7597fff700 1 -- 172.21.15.62:0/2052882403 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75981e5b70 msgr2=0x7f75981e5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:53.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.960+0000 7f7597fff700 1 --2- 172.21.15.62:0/2052882403 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75981e5b70 0x7f75981e5fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:53.966 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.960+0000 7f7597fff700 1 -- 172.21.15.62:0/2052882403 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f759806f9e0 msgr2=0x7f75981e5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:53.966 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.960+0000 7f7597fff700 1 --2- 172.21.15.62:0/2052882403 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f759806f9e0 0x7f75981e5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:53.966 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.960+0000 7f7597fff700 1 -- 172.21.15.62:0/2052882403 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f759814f890 con 0x7f7580003a20 2023-06-09T04:40:53.966 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.960+0000 7f7597fff700 1 --2- 172.21.15.62:0/2052882403 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7580003a20 0x7f759806f4a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f75880090b0 tx=0x7f75880047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:53.966 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.960+0000 7f7594ff9700 1 -- 172.21.15.62:0/2052882403 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758800e6c0 con 0x7f7580003a20 2023-06-09T04:40:53.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.960+0000 7f7594ff9700 1 -- 172.21.15.62:0/2052882403 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75880038e0 con 0x7f7580003a20 2023-06-09T04:40:53.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.960+0000 7f759d570700 1 -- 172.21.15.62:0/2052882403 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f759814fb70 con 0x7f7580003a20 2023-06-09T04:40:53.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.960+0000 7f7594ff9700 1 -- 172.21.15.62:0/2052882403 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7588003c90 con 0x7f7580003a20 2023-06-09T04:40:53.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.960+0000 7f759d570700 1 -- 172.21.15.62:0/2052882403 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75980c3860 con 0x7f7580003a20 2023-06-09T04:40:53.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.964+0000 7f759d570700 1 -- 172.21.15.62:0/2052882403 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75980739c0 con 0x7f7580003a20 2023-06-09T04:40:53.970 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.964+0000 7f7594ff9700 1 -- 172.21.15.62:0/2052882403 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7588013470 con 0x7f7580003a20 2023-06-09T04:40:53.971 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.968+0000 7f7594ff9700 1 --2- 172.21.15.62:0/2052882403 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f7584066320 0x7f75840687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:53.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.968+0000 7f7594ff9700 1 -- 172.21.15.62:0/2052882403 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f7588084d10 con 0x7f7580003a20 2023-06-09T04:40:53.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.968+0000 7f75977fe700 1 --2- 172.21.15.62:0/2052882403 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f7584066320 0x7f75840687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:53.973 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.968+0000 7f75977fe700 1 --2- 172.21.15.62:0/2052882403 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f7584066320 0x7f75840687d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f75981f90f0 tx=0x7f758c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:53.975 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:53.972+0000 7f7594ff9700 1 -- 172.21.15.62:0/2052882403 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f758808a020 con 0x7f7580003a20 2023-06-09T04:40:54.152 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.148+0000 7f759d570700 1 -- 172.21.15.62:0/2052882403 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f75980cd4e0 con 0x7f7580003a20 2023-06-09T04:40:54.153 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.148+0000 7f7594ff9700 1 -- 172.21.15.62:0/2052882403 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7588056080 con 0x7f7580003a20 2023-06-09T04:40:54.153 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2023-06-09T04:40:54.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.152+0000 7f759d570700 1 -- 172.21.15.62:0/2052882403 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f7584066320 msgr2=0x7f75840687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:54.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.152+0000 7f759d570700 1 --2- 172.21.15.62:0/2052882403 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f7584066320 0x7f75840687d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f75981f90f0 tx=0x7f758c009040 comp rx=0 tx=0).stop 2023-06-09T04:40:54.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.152+0000 7f759d570700 1 -- 172.21.15.62:0/2052882403 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7580003a20 msgr2=0x7f759806f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:54.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.152+0000 7f759d570700 1 --2- 172.21.15.62:0/2052882403 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7580003a20 0x7f759806f4a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f75880090b0 tx=0x7f75880047e0 comp rx=0 tx=0).stop 2023-06-09T04:40:54.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.152+0000 7f759d570700 1 -- 172.21.15.62:0/2052882403 shutdown_connections 2023-06-09T04:40:54.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.152+0000 7f759d570700 1 --2- 172.21.15.62:0/2052882403 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f7584066320 0x7f75840687d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:54.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.152+0000 7f759d570700 1 --2- 172.21.15.62:0/2052882403 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75981e5b70 0x7f75981e5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:54.157 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.152+0000 7f759d570700 1 --2- 172.21.15.62:0/2052882403 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f759806f9e0 0x7f75981e5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:54.157 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.152+0000 7f759d570700 1 --2- 172.21.15.62:0/2052882403 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7580003a20 0x7f759806f4a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:54.157 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.152+0000 7f759d570700 1 -- 172.21.15.62:0/2052882403 >> 172.21.15.62:0/2052882403 conn(0x7f75980cab50 msgr2=0x7f759815f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:40:54.157 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.152+0000 7f759d570700 1 -- 172.21.15.62:0/2052882403 shutdown_connections 2023-06-09T04:40:54.157 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.152+0000 7f759d570700 1 -- 172.21.15.62:0/2052882403 wait complete. 2023-06-09T04:40:54.177 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-06-09T04:40:54.352 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.348+0000 7f570dd90700 1 Processor -- start 2023-06-09T04:40:54.352 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.348+0000 7f570dd90700 1 -- start start 2023-06-09T04:40:54.354 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.348+0000 7f570dd90700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f57080d1ac0 0x7f57080ced90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:54.354 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.348+0000 7f570dd90700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f57080cf2d0 0x7f5708165730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:54.354 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.348+0000 7f570dd90700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57080b51e0 con 0x7f57080ce9c0 2023-06-09T04:40:54.354 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.348+0000 7f570dd90700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57080d0190 con 0x7f57080d1ac0 2023-06-09T04:40:54.354 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.348+0000 7f570dd90700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57080cd0f0 con 0x7f57080cf2d0 2023-06-09T04:40:54.355 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.348+0000 7f56fffff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f57080d1ac0 0x7f57080ced90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:54.355 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.348+0000 7f570cd8e700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f57080ce9c0 0x7f57080cc9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.62:53620/0 (socket says 172.21.15.62:53620) 2023-06-09T04:40:54.355 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.348+0000 7f570cd8e700 1 -- 172.21.15.62:0/2209067930 learned_addr learned my addr 172.21.15.62:0/2209067930 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:40:54.355 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.348+0000 7f56fffff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f57080d1ac0 0x7f57080ced90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53038/0 (socket says 172.21.15.62:53038) 2023-06-09T04:40:54.356 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.348+0000 7f570d58f700 1 --2- 172.21.15.62:0/2209067930 >> v2:172.21.15.89:3300/0 conn(0x7f57080cf2d0 0x7f5708165730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:54.356 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.352+0000 7f56ff7fe700 1 -- 172.21.15.62:0/2209067930 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1136981241 0 0) 0x7f57080b51e0 con 0x7f57080ce9c0 2023-06-09T04:40:54.357 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.352+0000 7f56ff7fe700 1 -- 172.21.15.62:0/2209067930 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56f00035d0 con 0x7f57080ce9c0 2023-06-09T04:40:54.357 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.352+0000 7f56fffff700 1 -- 172.21.15.62:0/2209067930 >> v2:172.21.15.89:3300/0 conn(0x7f57080cf2d0 msgr2=0x7f5708165730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:40:54.357 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.352+0000 7f56fffff700 1 --2- 172.21.15.62:0/2209067930 >> v2:172.21.15.89:3300/0 conn(0x7f57080cf2d0 0x7f5708165730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:54.357 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.352+0000 7f56fffff700 1 -- 172.21.15.62:0/2209067930 >> v1:172.21.15.89:6789/0 conn(0x7f57080ce9c0 legacy=0x7f57080cc9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:54.357 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.352+0000 7f56fffff700 1 -- 172.21.15.62:0/2209067930 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57080d29f0 con 0x7f57080d1ac0 2023-06-09T04:40:54.357 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.352+0000 7f56fffff700 1 --2- 172.21.15.62:0/2209067930 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f57080d1ac0 0x7f57080ced90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f57080c93f0 tx=0x7f56f8009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e44163bf7117ed1 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:54.358 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.352+0000 7f56ff7fe700 1 -- 172.21.15.62:0/2209067930 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f8011830 con 0x7f57080d1ac0 2023-06-09T04:40:54.359 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.352+0000 7f56ff7fe700 1 -- 172.21.15.62:0/2209067930 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56f8011990 con 0x7f57080d1ac0 2023-06-09T04:40:54.359 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.352+0000 7f56ff7fe700 1 -- 172.21.15.62:0/2209067930 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f8011d20 con 0x7f57080d1ac0 2023-06-09T04:40:54.359 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.352+0000 7f570dd90700 1 -- 172.21.15.62:0/2209067930 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f57080d1ac0 msgr2=0x7f57080ced90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:54.359 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.352+0000 7f570dd90700 1 --2- 172.21.15.62:0/2209067930 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f57080d1ac0 0x7f57080ced90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f57080c93f0 tx=0x7f56f8009b30 comp rx=0 tx=0).stop 2023-06-09T04:40:54.359 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.352+0000 7f570dd90700 1 -- 172.21.15.62:0/2209067930 shutdown_connections 2023-06-09T04:40:54.359 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.352+0000 7f570dd90700 1 --2- 172.21.15.62:0/2209067930 >> v2:172.21.15.89:3300/0 conn(0x7f57080cf2d0 0x7f5708165730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:54.359 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.352+0000 7f570dd90700 1 --2- 172.21.15.62:0/2209067930 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f57080d1ac0 0x7f57080ced90 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:54.360 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.352+0000 7f570dd90700 1 -- 172.21.15.62:0/2209067930 >> 172.21.15.62:0/2209067930 conn(0x7f5708070f20 msgr2=0x7f57080712f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:40:54.360 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.352+0000 7f570dd90700 1 -- 172.21.15.62:0/2209067930 shutdown_connections 2023-06-09T04:40:54.360 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.352+0000 7f570dd90700 1 -- 172.21.15.62:0/2209067930 wait complete. 2023-06-09T04:40:54.360 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.356+0000 7f570dd90700 1 Processor -- start 2023-06-09T04:40:54.361 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.356+0000 7f570dd90700 1 -- start start 2023-06-09T04:40:54.362 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.356+0000 7f570dd90700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f57080ce9c0 0x7f57081f0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:54.362 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.356+0000 7f570dd90700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57080cf2d0 0x7f5708159770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:54.363 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.356+0000 7f570dd90700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f57080b0ad0 0x7f570815c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:54.363 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.356+0000 7f570dd90700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5708159cb0 con 0x7f57080ce9c0 2023-06-09T04:40:54.363 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.356+0000 7f570dd90700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57080c9600 con 0x7f57080cf2d0 2023-06-09T04:40:54.363 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.356+0000 7f570dd90700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57080c98e0 con 0x7f57080b0ad0 2023-06-09T04:40:54.364 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.356+0000 7f570cd8e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f57080ce9c0 0x7f57081f0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:54.364 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.360+0000 7f570cd8e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f57080ce9c0 0x7f57081f0ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53040/0 (socket says 172.21.15.62:53040) 2023-06-09T04:40:54.364 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.360+0000 7f56fffff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57080cf2d0 0x7f5708159770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:54.365 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.360+0000 7f570cd8e700 1 -- 172.21.15.62:0/949857547 learned_addr learned my addr 172.21.15.62:0/949857547 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:40:54.365 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.360+0000 7f570d58f700 1 --2- 172.21.15.62:0/949857547 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f57080b0ad0 0x7f570815c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:54.365 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.360+0000 7f56fffff700 1 -- 172.21.15.62:0/949857547 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f57080b0ad0 msgr2=0x7f570815c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:54.365 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.360+0000 7f56fffff700 1 --2- 172.21.15.62:0/949857547 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f57080b0ad0 0x7f570815c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:54.365 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.360+0000 7f56fffff700 1 -- 172.21.15.62:0/949857547 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f57080ce9c0 msgr2=0x7f57081f0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:54.365 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.360+0000 7f56fffff700 1 --2- 172.21.15.62:0/949857547 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f57080ce9c0 0x7f57081f0ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:54.365 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.360+0000 7f56fffff700 1 -- 172.21.15.62:0/949857547 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56f80094b0 con 0x7f57080cf2d0 2023-06-09T04:40:54.365 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.360+0000 7f570cd8e700 1 --2- 172.21.15.62:0/949857547 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f57080ce9c0 0x7f57081f0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:40:54.366 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.360+0000 7f56fffff700 1 --2- 172.21.15.62:0/949857547 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57080cf2d0 0x7f5708159770 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f570808b660 tx=0x7f56f8004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:54.366 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.360+0000 7f56fd7fa700 1 -- 172.21.15.62:0/949857547 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f8004590 con 0x7f57080cf2d0 2023-06-09T04:40:54.366 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.360+0000 7f56fd7fa700 1 -- 172.21.15.62:0/949857547 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56f80036c0 con 0x7f57080cf2d0 2023-06-09T04:40:54.366 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.360+0000 7f570dd90700 1 -- 172.21.15.62:0/949857547 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57080c9bc0 con 0x7f57080cf2d0 2023-06-09T04:40:54.367 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.360+0000 7f56fd7fa700 1 -- 172.21.15.62:0/949857547 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f8003a70 con 0x7f57080cf2d0 2023-06-09T04:40:54.367 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.360+0000 7f570dd90700 1 -- 172.21.15.62:0/949857547 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f570815c690 con 0x7f57080cf2d0 2023-06-09T04:40:54.367 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.364+0000 7f570dd90700 1 -- 172.21.15.62:0/949857547 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57080ca0e0 con 0x7f57080cf2d0 2023-06-09T04:40:54.369 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.364+0000 7f56fd7fa700 1 -- 172.21.15.62:0/949857547 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f56f8003bd0 con 0x7f57080cf2d0 2023-06-09T04:40:54.370 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.364+0000 7f56fd7fa700 1 --2- 172.21.15.62:0/949857547 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f56f40662f0 0x7f56f40687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:54.371 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.368+0000 7f56fd7fa700 1 -- 172.21.15.62:0/949857547 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f56f8021030 con 0x7f57080cf2d0 2023-06-09T04:40:54.371 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.368+0000 7f570cd8e700 1 --2- 172.21.15.62:0/949857547 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f56f40662f0 0x7f56f40687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:54.372 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.368+0000 7f570cd8e700 1 --2- 172.21.15.62:0/949857547 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f56f40662f0 0x7f56f40687a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5704001560 tx=0x7f5704009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:54.380 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.376+0000 7f56fd7fa700 1 -- 172.21.15.62:0/949857547 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f57080ca0e0 con 0x7f57080cf2d0 2023-06-09T04:40:54.557 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.552+0000 7f570dd90700 1 -- 172.21.15.62:0/949857547 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f57080ca0e0 con 0x7f57080cf2d0 2023-06-09T04:40:54.559 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.552+0000 7f56fd7fa700 1 -- 172.21.15.62:0/949857547 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v20) v1 ==== 84+0+126 (secure 0 0 0) 0x7f57080ca0e0 con 0x7f57080cf2d0 2023-06-09T04:40:54.559 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:40:54.559 INFO:teuthology.orchestra.run.smithi062.stdout:[ 2023-06-09T04:40:54.559 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-06-09T04:40:54.559 INFO:teuthology.orchestra.run.smithi062.stdout: "poolnum": 1, 2023-06-09T04:40:54.560 INFO:teuthology.orchestra.run.smithi062.stdout: "poolname": ".mgr" 2023-06-09T04:40:54.560 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-06-09T04:40:54.560 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-06-09T04:40:54.560 INFO:teuthology.orchestra.run.smithi062.stdout: "poolnum": 2, 2023-06-09T04:40:54.561 INFO:teuthology.orchestra.run.smithi062.stdout: "poolname": "rbd" 2023-06-09T04:40:54.561 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-06-09T04:40:54.561 INFO:teuthology.orchestra.run.smithi062.stdout:] 2023-06-09T04:40:54.562 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.556+0000 7f570dd90700 1 -- 172.21.15.62:0/949857547 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f56f40662f0 msgr2=0x7f56f40687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:54.562 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.556+0000 7f570dd90700 1 --2- 172.21.15.62:0/949857547 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f56f40662f0 0x7f56f40687a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5704001560 tx=0x7f5704009040 comp rx=0 tx=0).stop 2023-06-09T04:40:54.562 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.556+0000 7f570dd90700 1 -- 172.21.15.62:0/949857547 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57080cf2d0 msgr2=0x7f5708159770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:54.562 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.556+0000 7f570dd90700 1 --2- 172.21.15.62:0/949857547 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57080cf2d0 0x7f5708159770 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f570808b660 tx=0x7f56f8004770 comp rx=0 tx=0).stop 2023-06-09T04:40:54.563 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.556+0000 7f570dd90700 1 -- 172.21.15.62:0/949857547 shutdown_connections 2023-06-09T04:40:54.563 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.556+0000 7f570dd90700 1 --2- 172.21.15.62:0/949857547 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f56f40662f0 0x7f56f40687a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:54.563 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.556+0000 7f570dd90700 1 --2- 172.21.15.62:0/949857547 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f57080b0ad0 0x7f570815c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:54.563 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.556+0000 7f570dd90700 1 --2- 172.21.15.62:0/949857547 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57080cf2d0 0x7f5708159770 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:54.563 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.556+0000 7f570dd90700 1 --2- 172.21.15.62:0/949857547 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f57080ce9c0 0x7f57081f0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:54.563 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.556+0000 7f570dd90700 1 -- 172.21.15.62:0/949857547 >> 172.21.15.62:0/949857547 conn(0x7f5708070f20 msgr2=0x7f57080b51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:40:54.563 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.556+0000 7f570dd90700 1 -- 172.21.15.62:0/949857547 shutdown_connections 2023-06-09T04:40:54.564 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.556+0000 7f570dd90700 1 -- 172.21.15.62:0/949857547 wait complete. 2023-06-09T04:40:54.583 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-06-09T04:40:54.584 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-06-09T04:40:54.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.764+0000 7f4dd556b700 1 Processor -- start 2023-06-09T04:40:54.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.764+0000 7f4dd556b700 1 -- start start 2023-06-09T04:40:54.772 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.768+0000 7f4dd556b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4dd0158a20 0x7f4dd006fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:54.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.768+0000 7f4dd556b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4dd00cab40 0x7f4dd00cafc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:54.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.768+0000 7f4dd556b700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dd00cc570 con 0x7f4dd00ad640 2023-06-09T04:40:54.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.768+0000 7f4dd556b700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dd00cb500 con 0x7f4dd00cab40 2023-06-09T04:40:54.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.768+0000 7f4dd556b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd015ccb0 con 0x7f4dd0158a20 2023-06-09T04:40:54.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.768+0000 7f4dd4d6a700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4dd00cab40 0x7f4dd00cafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:54.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.768+0000 7f4dd4d6a700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4dd00cab40 0x7f4dd00cafc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53048/0 (socket says 172.21.15.62:53048) 2023-06-09T04:40:54.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.768+0000 7f4dd4d6a700 1 -- 172.21.15.62:0/2028771762 learned_addr learned my addr 172.21.15.62:0/2028771762 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:40:54.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.768+0000 7f4dcffff700 1 --2- 172.21.15.62:0/2028771762 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4dd0158a20 0x7f4dd006fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:54.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.768+0000 7f4dd4d6a700 1 -- 172.21.15.62:0/2028771762 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4dd0158a20 msgr2=0x7f4dd006fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:40:54.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.768+0000 7f4dd4d6a700 1 --2- 172.21.15.62:0/2028771762 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4dd0158a20 0x7f4dd006fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:54.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.768+0000 7f4dd4d6a700 1 -- 172.21.15.62:0/2028771762 >> v1:172.21.15.89:6789/0 conn(0x7f4dd00ad640 legacy=0x7f4dd015c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:54.776 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.768+0000 7f4dd4d6a700 1 -- 172.21.15.62:0/2028771762 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dd0158df0 con 0x7f4dd00cab40 2023-06-09T04:40:54.776 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.768+0000 7f4dd4d6a700 1 --2- 172.21.15.62:0/2028771762 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4dd00cab40 0x7f4dd00cafc0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4dc8009e50 tx=0x7f4dc800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=393535a143d3e32a server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:54.776 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.768+0000 7f4dceffd700 1 -- 172.21.15.62:0/2028771762 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc800e070 con 0x7f4dd00cab40 2023-06-09T04:40:54.776 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.772+0000 7f4dceffd700 1 -- 172.21.15.62:0/2028771762 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dc800b9c0 con 0x7f4dd00cab40 2023-06-09T04:40:54.776 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.772+0000 7f4dceffd700 1 -- 172.21.15.62:0/2028771762 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc800bd70 con 0x7f4dd00cab40 2023-06-09T04:40:54.777 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.772+0000 7f4dd556b700 1 -- 172.21.15.62:0/2028771762 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4dd00cab40 msgr2=0x7f4dd00cafc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:54.777 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.772+0000 7f4dd556b700 1 --2- 172.21.15.62:0/2028771762 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4dd00cab40 0x7f4dd00cafc0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4dc8009e50 tx=0x7f4dc800b330 comp rx=0 tx=0).stop 2023-06-09T04:40:54.777 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.772+0000 7f4dd556b700 1 -- 172.21.15.62:0/2028771762 shutdown_connections 2023-06-09T04:40:54.777 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.772+0000 7f4dd556b700 1 --2- 172.21.15.62:0/2028771762 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4dd00cab40 0x7f4dd00cafc0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:54.777 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.772+0000 7f4dd556b700 1 --2- 172.21.15.62:0/2028771762 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4dd0158a20 0x7f4dd006fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:54.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.772+0000 7f4dd556b700 1 -- 172.21.15.62:0/2028771762 >> 172.21.15.62:0/2028771762 conn(0x7f4dd00657d0 msgr2=0x7f4dd00697f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:40:54.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.772+0000 7f4dd556b700 1 -- 172.21.15.62:0/2028771762 shutdown_connections 2023-06-09T04:40:54.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.772+0000 7f4dd556b700 1 -- 172.21.15.62:0/2028771762 wait complete. 2023-06-09T04:40:54.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.772+0000 7f4dd556b700 1 Processor -- start 2023-06-09T04:40:54.779 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.776+0000 7f4dd556b700 1 -- start start 2023-06-09T04:40:54.780 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.776+0000 7f4dd556b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4dd00ad640 0x7f4dd01476f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:54.780 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.776+0000 7f4dd556b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4dd00cab40 0x7f4dd0148120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:54.780 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.776+0000 7f4dd556b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4dd0158a20 0x7f4dd00aff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:54.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.776+0000 7f4dd556b700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd00afaf0 con 0x7f4dd00cab40 2023-06-09T04:40:54.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.776+0000 7f4dd556b700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd00aee90 con 0x7f4dd0158a20 2023-06-09T04:40:54.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.776+0000 7f4dd556b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dd00af150 con 0x7f4dd00ad640 2023-06-09T04:40:54.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.776+0000 7f4dcf7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4dd00cab40 0x7f4dd0148120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:54.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.776+0000 7f4dcf7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4dd00cab40 0x7f4dd0148120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53052/0 (socket says 172.21.15.62:53052) 2023-06-09T04:40:54.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.776+0000 7f4dcf7fe700 1 -- 172.21.15.62:0/1185658875 learned_addr learned my addr 172.21.15.62:0/1185658875 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:40:54.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.776+0000 7f4dcffff700 1 --2- 172.21.15.62:0/1185658875 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4dd00ad640 0x7f4dd01476f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:54.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.776+0000 7f4dd4d6a700 1 --2- 172.21.15.62:0/1185658875 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4dd0158a20 0x7f4dd00aff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:54.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.776+0000 7f4dcf7fe700 1 -- 172.21.15.62:0/1185658875 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4dd00ad640 msgr2=0x7f4dd01476f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:54.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.776+0000 7f4dcf7fe700 1 --2- 172.21.15.62:0/1185658875 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4dd00ad640 0x7f4dd01476f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:54.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.776+0000 7f4dcf7fe700 1 -- 172.21.15.62:0/1185658875 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4dd0158a20 msgr2=0x7f4dd00aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:54.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.776+0000 7f4dcf7fe700 1 --2- 172.21.15.62:0/1185658875 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4dd0158a20 0x7f4dd00aff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:54.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.776+0000 7f4dcf7fe700 1 -- 172.21.15.62:0/1185658875 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc8009b30 con 0x7f4dd00cab40 2023-06-09T04:40:54.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.776+0000 7f4dcffff700 1 --2- 172.21.15.62:0/1185658875 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4dd00ad640 0x7f4dd01476f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:40:54.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.776+0000 7f4dd4d6a700 1 --2- 172.21.15.62:0/1185658875 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4dd0158a20 0x7f4dd00aff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:40:54.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.776+0000 7f4dcf7fe700 1 --2- 172.21.15.62:0/1185658875 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4dd00cab40 0x7f4dd0148120 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4dc400c500 tx=0x7f4dc400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:54.784 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.776+0000 7f4dccff9700 1 -- 172.21.15.62:0/1185658875 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc40052d0 con 0x7f4dd00cab40 2023-06-09T04:40:54.784 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.776+0000 7f4dccff9700 1 -- 172.21.15.62:0/1185658875 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dc4005430 con 0x7f4dd00cab40 2023-06-09T04:40:54.784 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.776+0000 7f4dd556b700 1 -- 172.21.15.62:0/1185658875 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dd00af430 con 0x7f4dd00cab40 2023-06-09T04:40:54.785 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.776+0000 7f4dccff9700 1 -- 172.21.15.62:0/1185658875 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc40055a0 con 0x7f4dd00cab40 2023-06-09T04:40:54.785 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.776+0000 7f4dd556b700 1 -- 172.21.15.62:0/1185658875 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dd0147c30 con 0x7f4dd00cab40 2023-06-09T04:40:54.785 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.780+0000 7f4dd556b700 1 -- 172.21.15.62:0/1185658875 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dd00afc30 con 0x7f4dd00cab40 2023-06-09T04:40:54.785 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.780+0000 7f4dccff9700 1 -- 172.21.15.62:0/1185658875 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4dc40038e0 con 0x7f4dd00cab40 2023-06-09T04:40:54.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.784+0000 7f4dccff9700 1 --2- 172.21.15.62:0/1185658875 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f4dbc0662f0 0x7f4dbc0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:54.788 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.784+0000 7f4dccff9700 1 -- 172.21.15.62:0/1185658875 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f4dc4082f60 con 0x7f4dd00cab40 2023-06-09T04:40:54.788 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.784+0000 7f4dcffff700 1 --2- 172.21.15.62:0/1185658875 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f4dbc0662f0 0x7f4dbc0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:54.789 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.784+0000 7f4dcffff700 1 --2- 172.21.15.62:0/1185658875 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f4dbc0662f0 0x7f4dbc0687a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4dd0071d20 tx=0x7f4dc0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:54.794 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.788+0000 7f4dccff9700 1 -- 172.21.15.62:0/1185658875 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4dd00afc30 con 0x7f4dd00cab40 2023-06-09T04:40:54.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:54.964+0000 7f4dd556b700 1 -- 172.21.15.62:0/1185658875 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f4dd00afc30 con 0x7f4dd00cab40 2023-06-09T04:40:55.278 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:55.272+0000 7f4dccff9700 1 -- 172.21.15.62:0/1185658875 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v21) v1 ==== 138+0+0 (secure 0 0 0) 0x7f4dd00afc30 con 0x7f4dd00cab40 2023-06-09T04:40:55.285 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:55.280+0000 7f4dd556b700 1 -- 172.21.15.62:0/1185658875 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f4dbc0662f0 msgr2=0x7f4dbc0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:55.285 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:55.280+0000 7f4dd556b700 1 --2- 172.21.15.62:0/1185658875 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f4dbc0662f0 0x7f4dbc0687a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4dd0071d20 tx=0x7f4dc0008040 comp rx=0 tx=0).stop 2023-06-09T04:40:55.285 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:55.280+0000 7f4dd556b700 1 -- 172.21.15.62:0/1185658875 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4dd00cab40 msgr2=0x7f4dd0148120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:55.285 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:55.280+0000 7f4dd556b700 1 --2- 172.21.15.62:0/1185658875 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4dd00cab40 0x7f4dd0148120 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4dc400c500 tx=0x7f4dc400c8c0 comp rx=0 tx=0).stop 2023-06-09T04:40:55.289 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:55.284+0000 7f4dd556b700 1 -- 172.21.15.62:0/1185658875 shutdown_connections 2023-06-09T04:40:55.289 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:55.284+0000 7f4dd556b700 1 --2- 172.21.15.62:0/1185658875 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f4dbc0662f0 0x7f4dbc0687a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:55.290 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:55.284+0000 7f4dd556b700 1 --2- 172.21.15.62:0/1185658875 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4dd0158a20 0x7f4dd00aff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:55.290 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:55.284+0000 7f4dd556b700 1 --2- 172.21.15.62:0/1185658875 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4dd00cab40 0x7f4dd0148120 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:55.290 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:55.284+0000 7f4dd556b700 1 --2- 172.21.15.62:0/1185658875 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4dd00ad640 0x7f4dd01476f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:55.290 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:55.284+0000 7f4dd556b700 1 -- 172.21.15.62:0/1185658875 >> 172.21.15.62:0/1185658875 conn(0x7f4dd00657d0 msgr2=0x7f4dd00697f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:40:55.290 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:55.284+0000 7f4dd556b700 1 -- 172.21.15.62:0/1185658875 shutdown_connections 2023-06-09T04:40:55.291 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:55.284+0000 7f4dd556b700 1 -- 172.21.15.62:0/1185658875 wait complete. 2023-06-09T04:40:55.292 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_metadata' created 2023-06-09T04:40:55.311 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-06-09T04:40:55.505 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:55.500+0000 7fd1b0701700 1 Processor -- start 2023-06-09T04:40:55.505 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:55.500+0000 7fd1b0701700 1 -- start start 2023-06-09T04:40:55.509 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:55.504+0000 7fd1b0701700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd1a8160290 0x7fd1a8164940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:55.509 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:55.504+0000 7fd1b0701700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd1a8160660 0x7fd1a80afbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:55.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:55.504+0000 7fd1b0701700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd1a806c480 0x7fd1a80b0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:55.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:55.504+0000 7fd1b0701700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1a8164e80 con 0x7fd1a8160660 2023-06-09T04:40:55.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:55.504+0000 7fd1b0701700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1a80ccf30 con 0x7fd1a8160290 2023-06-09T04:40:55.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:55.504+0000 7fd1b0701700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a80cd210 con 0x7fd1a806c480 2023-06-09T04:40:55.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:55.504+0000 7fd1ae49d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd1a8160290 0x7fd1a8164940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:55.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:55.504+0000 7fd1adc9c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd1a8160660 0x7fd1a80afbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:55.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:55.504+0000 7fd1ae49d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd1a8160290 0x7fd1a8164940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.62:52344/0 (socket says 172.21.15.62:52344) 2023-06-09T04:40:55.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:55.504+0000 7fd1aec9e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd1a806c480 0x7fd1a80b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:55.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:55.504+0000 7fd1ae49d700 1 -- 172.21.15.62:0/1852898874 learned_addr learned my addr 172.21.15.62:0/1852898874 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:40:55.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:55.508+0000 7fd1adc9c700 1 -- 172.21.15.62:0/1852898874 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd1a806c480 msgr2=0x7fd1a80b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:40:55.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:55.508+0000 7fd1adc9c700 1 --2- 172.21.15.62:0/1852898874 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd1a806c480 0x7fd1a80b0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:55.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:55.508+0000 7fd1adc9c700 1 -- 172.21.15.62:0/1852898874 >> v2:172.21.15.89:3300/0 conn(0x7fd1a8160290 msgr2=0x7fd1a8164940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:40:55.513 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:55.508+0000 7fd1adc9c700 1 --2- 172.21.15.62:0/1852898874 >> v2:172.21.15.89:3300/0 conn(0x7fd1a8160290 0x7fd1a8164940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:55.513 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:55.508+0000 7fd1adc9c700 1 -- 172.21.15.62:0/1852898874 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1a80cd4f0 con 0x7fd1a8160660 2023-06-09T04:40:55.513 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:55.508+0000 7fd1ae49d700 1 --2- 172.21.15.62:0/1852898874 >> v2:172.21.15.89:3300/0 conn(0x7fd1a8160290 0x7fd1a8164940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:40:55.513 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:55.508+0000 7fd1aec9e700 1 --2- 172.21.15.62:0/1852898874 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd1a806c480 0x7fd1a80b0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:40:55.513 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:55.508+0000 7fd1adc9c700 1 --2- 172.21.15.62:0/1852898874 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1a8160660 0x7fd1a80afbc0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd1a806f540 tx=0x7fd198009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=467751ce6d5ba012 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:55.513 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:55.508+0000 7fd1ad49b700 1 -- 172.21.15.62:0/1852898874 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd198005e50 con 0x7fd1a8160660 2023-06-09T04:40:55.514 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:55.508+0000 7fd1ad49b700 1 -- 172.21.15.62:0/1852898874 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd198006030 con 0x7fd1a8160660 2023-06-09T04:40:55.514 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:55.508+0000 7fd1ad49b700 1 -- 172.21.15.62:0/1852898874 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1980063c0 con 0x7fd1a8160660 2023-06-09T04:40:55.514 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:55.508+0000 7fd1b0701700 1 -- 172.21.15.62:0/1852898874 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1a8160660 msgr2=0x7fd1a80afbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:55.514 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:55.508+0000 7fd1b0701700 1 --2- 172.21.15.62:0/1852898874 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1a8160660 0x7fd1a80afbc0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd1a806f540 tx=0x7fd198009b20 comp rx=0 tx=0).stop 2023-06-09T04:40:55.515 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:55.508+0000 7fd1b0701700 1 -- 172.21.15.62:0/1852898874 shutdown_connections 2023-06-09T04:40:55.515 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:55.508+0000 7fd1b0701700 1 --2- 172.21.15.62:0/1852898874 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd1a806c480 0x7fd1a80b0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:55.515 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:55.508+0000 7fd1b0701700 1 --2- 172.21.15.62:0/1852898874 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1a8160660 0x7fd1a80afbc0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:55.515 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:55.508+0000 7fd1b0701700 1 --2- 172.21.15.62:0/1852898874 >> v2:172.21.15.89:3300/0 conn(0x7fd1a8160290 0x7fd1a8164940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:55.515 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:55.508+0000 7fd1b0701700 1 -- 172.21.15.62:0/1852898874 >> 172.21.15.62:0/1852898874 conn(0x7fd1a80697f0 msgr2=0x7fd1a8069bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:40:55.515 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:55.508+0000 7fd1b0701700 1 -- 172.21.15.62:0/1852898874 shutdown_connections 2023-06-09T04:40:55.515 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:55.508+0000 7fd1b0701700 1 -- 172.21.15.62:0/1852898874 wait complete. 2023-06-09T04:40:55.517 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:55.512+0000 7fd1b0701700 1 Processor -- start 2023-06-09T04:40:55.518 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:55.512+0000 7fd1b0701700 1 -- start start 2023-06-09T04:40:55.520 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:55.516+0000 7fd1b0701700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1a806c480 0x7fd1a815f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:55.520 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:55.516+0000 7fd1b0701700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1a8160290 0x7fd1a80c33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:55.520 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:55.516+0000 7fd1b0701700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd1a8160660 0x7fd1a80c3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:55.520 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:55.516+0000 7fd1b0701700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a80b0f70 con 0x7fd1a8160290 2023-06-09T04:40:55.520 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:55.516+0000 7fd1b0701700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a80c29b0 con 0x7fd1a806c480 2023-06-09T04:40:55.520 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:55.516+0000 7fd1b0701700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a80c2c90 con 0x7fd1a8160660 2023-06-09T04:40:55.521 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:55.516+0000 7fd1adc9c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1a8160290 0x7fd1a80c33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:55.522 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:55.516+0000 7fd1adc9c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1a8160290 0x7fd1a80c33c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53062/0 (socket says 172.21.15.62:53062) 2023-06-09T04:40:55.522 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:55.516+0000 7fd1adc9c700 1 -- 172.21.15.62:0/2469503863 learned_addr learned my addr 172.21.15.62:0/2469503863 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:40:55.522 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:55.516+0000 7fd1aec9e700 1 --2- 172.21.15.62:0/2469503863 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd1a8160660 0x7fd1a80c3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:55.522 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:55.516+0000 7fd1ae49d700 1 --2- 172.21.15.62:0/2469503863 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1a806c480 0x7fd1a815f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:55.522 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:55.516+0000 7fd1adc9c700 1 -- 172.21.15.62:0/2469503863 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd1a8160660 msgr2=0x7fd1a80c3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:55.522 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:55.516+0000 7fd1adc9c700 1 --2- 172.21.15.62:0/2469503863 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd1a8160660 0x7fd1a80c3900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:55.522 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:55.516+0000 7fd1adc9c700 1 -- 172.21.15.62:0/2469503863 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1a806c480 msgr2=0x7fd1a815f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:55.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:55.516+0000 7fd1adc9c700 1 --2- 172.21.15.62:0/2469503863 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1a806c480 0x7fd1a815f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:55.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:55.516+0000 7fd1adc9c700 1 -- 172.21.15.62:0/2469503863 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1a0009a70 con 0x7fd1a8160290 2023-06-09T04:40:55.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:55.516+0000 7fd1ae49d700 1 --2- 172.21.15.62:0/2469503863 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1a806c480 0x7fd1a815f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:40:55.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:55.516+0000 7fd1adc9c700 1 --2- 172.21.15.62:0/2469503863 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1a8160290 0x7fd1a80c33c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd198000c00 tx=0x7fd198004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:55.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:55.516+0000 7fd19effd700 1 -- 172.21.15.62:0/2469503863 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1980036c0 con 0x7fd1a8160290 2023-06-09T04:40:55.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:55.516+0000 7fd19effd700 1 -- 172.21.15.62:0/2469503863 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd198020070 con 0x7fd1a8160290 2023-06-09T04:40:55.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:55.516+0000 7fd19effd700 1 -- 172.21.15.62:0/2469503863 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd198003a80 con 0x7fd1a8160290 2023-06-09T04:40:55.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:55.516+0000 7fd1b0701700 1 -- 172.21.15.62:0/2469503863 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1a4009570 con 0x7fd1a8160290 2023-06-09T04:40:55.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:55.516+0000 7fd1b0701700 1 -- 172.21.15.62:0/2469503863 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd198009450 con 0x7fd1a8160290 2023-06-09T04:40:55.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:55.520+0000 7fd1b0701700 1 -- 172.21.15.62:0/2469503863 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1a806f220 con 0x7fd1a8160290 2023-06-09T04:40:55.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:55.524+0000 7fd19effd700 1 -- 172.21.15.62:0/2469503863 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd198022030 con 0x7fd1a8160290 2023-06-09T04:40:55.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:55.524+0000 7fd19effd700 1 --2- 172.21.15.62:0/2469503863 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fd18c0662f0 0x7fd18c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:55.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:55.524+0000 7fd19effd700 1 -- 172.21.15.62:0/2469503863 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5580+0+0 (secure 0 0 0) 0x7fd198085340 con 0x7fd1a8160290 2023-06-09T04:40:55.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:55.524+0000 7fd1ae49d700 1 --2- 172.21.15.62:0/2469503863 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fd18c0662f0 0x7fd18c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:55.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:55.528+0000 7fd1ae49d700 1 --2- 172.21.15.62:0/2469503863 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fd18c0662f0 0x7fd18c0687a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd1a4006d50 tx=0x7fd1a40092e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:55.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:55.528+0000 7fd19effd700 1 -- 172.21.15.62:0/2469503863 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd198052990 con 0x7fd1a8160290 2023-06-09T04:40:55.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:55.704+0000 7fd1b0701700 1 -- 172.21.15.62:0/2469503863 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7fd1a8073a30 con 0x7fd1a8160290 2023-06-09T04:40:56.288 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.284+0000 7fd19effd700 1 -- 172.21.15.62:0/2469503863 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v22) v1 ==== 171+0+0 (secure 0 0 0) 0x7fd198055fb0 con 0x7fd1a8160290 2023-06-09T04:40:56.294 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.288+0000 7fd1b0701700 1 -- 172.21.15.62:0/2469503863 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fd18c0662f0 msgr2=0x7fd18c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:56.294 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.288+0000 7fd1b0701700 1 --2- 172.21.15.62:0/2469503863 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fd18c0662f0 0x7fd18c0687a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd1a4006d50 tx=0x7fd1a40092e0 comp rx=0 tx=0).stop 2023-06-09T04:40:56.295 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.288+0000 7fd1b0701700 1 -- 172.21.15.62:0/2469503863 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1a8160290 msgr2=0x7fd1a80c33c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:56.295 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.288+0000 7fd1b0701700 1 --2- 172.21.15.62:0/2469503863 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1a8160290 0x7fd1a80c33c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd198000c00 tx=0x7fd198004770 comp rx=0 tx=0).stop 2023-06-09T04:40:56.297 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.292+0000 7fd1b0701700 1 -- 172.21.15.62:0/2469503863 shutdown_connections 2023-06-09T04:40:56.297 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.292+0000 7fd1b0701700 1 --2- 172.21.15.62:0/2469503863 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fd18c0662f0 0x7fd18c0687a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:56.298 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.292+0000 7fd1b0701700 1 --2- 172.21.15.62:0/2469503863 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd1a8160660 0x7fd1a80c3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:56.298 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.292+0000 7fd1b0701700 1 --2- 172.21.15.62:0/2469503863 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1a8160290 0x7fd1a80c33c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:56.298 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.292+0000 7fd1b0701700 1 --2- 172.21.15.62:0/2469503863 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd1a806c480 0x7fd1a815f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:56.298 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.292+0000 7fd1b0701700 1 -- 172.21.15.62:0/2469503863 >> 172.21.15.62:0/2469503863 conn(0x7fd1a80697f0 msgr2=0x7fd1a8070e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:40:56.299 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.296+0000 7fd1b0701700 1 -- 172.21.15.62:0/2469503863 shutdown_connections 2023-06-09T04:40:56.300 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.296+0000 7fd1b0701700 1 -- 172.21.15.62:0/2469503863 wait complete. 2023-06-09T04:40:56.319 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_data' created 2023-06-09T04:40:56.334 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-06-09T04:40:56.514 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.508+0000 7f7e827c3700 1 Processor -- start 2023-06-09T04:40:56.515 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.512+0000 7f7e827c3700 1 -- start start 2023-06-09T04:40:56.518 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.512+0000 7f7e827c3700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7e7c0cd2e0 0x7f7e7c0b3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:56.518 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.512+0000 7f7e827c3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e7c0cebf0 0x7f7e7c0d0250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:56.519 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.512+0000 7f7e827c3700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e7c0b4d50 con 0x7f7e7c0d1f80 2023-06-09T04:40:56.519 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.512+0000 7f7e827c3700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e7c0cf010 con 0x7f7e7c0cd2e0 2023-06-09T04:40:56.519 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.512+0000 7f7e827c3700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7c0b4140 con 0x7f7e7c0cebf0 2023-06-09T04:40:56.520 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.516+0000 7f7e80fc0700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7e7c0cd2e0 0x7f7e7c0b3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:56.520 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.516+0000 7f7e81fc2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e7c0cebf0 0x7f7e7c0d0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:56.520 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.516+0000 7f7e80fc0700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7e7c0cd2e0 0x7f7e7c0b3b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53064/0 (socket says 172.21.15.62:53064) 2023-06-09T04:40:56.520 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.516+0000 7f7e817c1700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f7e7c0d1f80 0x7f7e7c0ccbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.62:53646/0 (socket says 172.21.15.62:53646) 2023-06-09T04:40:56.520 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.516+0000 7f7e80fc0700 1 -- 172.21.15.62:0/3936538163 learned_addr learned my addr 172.21.15.62:0/3936538163 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:40:56.521 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.516+0000 7f7e73fff700 1 -- 172.21.15.62:0/3936538163 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1095886310 0 0) 0x7f7e7c0b4d50 con 0x7f7e7c0d1f80 2023-06-09T04:40:56.521 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.516+0000 7f7e80fc0700 1 -- 172.21.15.62:0/3936538163 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e7c0cebf0 msgr2=0x7f7e7c0d0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:40:56.521 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.516+0000 7f7e80fc0700 1 --2- 172.21.15.62:0/3936538163 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e7c0cebf0 0x7f7e7c0d0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:56.521 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.516+0000 7f7e80fc0700 1 -- 172.21.15.62:0/3936538163 >> v1:172.21.15.89:6789/0 conn(0x7f7e7c0d1f80 legacy=0x7f7e7c0ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:56.521 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.516+0000 7f7e80fc0700 1 -- 172.21.15.62:0/3936538163 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e7c0b4420 con 0x7f7e7c0cd2e0 2023-06-09T04:40:56.522 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.516+0000 7f7e81fc2700 1 --2- 172.21.15.62:0/3936538163 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e7c0cebf0 0x7f7e7c0d0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:40:56.522 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.516+0000 7f7e80fc0700 1 --2- 172.21.15.62:0/3936538163 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7e7c0cd2e0 0x7f7e7c0b3b20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c009910 tx=0x7f7e6c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c0f8780aed5a3bb server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:56.522 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.516+0000 7f7e73fff700 1 -- 172.21.15.62:0/3936538163 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c011830 con 0x7f7e7c0cd2e0 2023-06-09T04:40:56.522 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.516+0000 7f7e73fff700 1 -- 172.21.15.62:0/3936538163 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e6c011990 con 0x7f7e7c0cd2e0 2023-06-09T04:40:56.522 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.516+0000 7f7e73fff700 1 -- 172.21.15.62:0/3936538163 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c011d40 con 0x7f7e7c0cd2e0 2023-06-09T04:40:56.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.516+0000 7f7e827c3700 1 -- 172.21.15.62:0/3936538163 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7e7c0cd2e0 msgr2=0x7f7e7c0b3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:56.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.516+0000 7f7e827c3700 1 --2- 172.21.15.62:0/3936538163 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7e7c0cd2e0 0x7f7e7c0b3b20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c009910 tx=0x7f7e6c009c20 comp rx=0 tx=0).stop 2023-06-09T04:40:56.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.520+0000 7f7e827c3700 1 -- 172.21.15.62:0/3936538163 shutdown_connections 2023-06-09T04:40:56.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.520+0000 7f7e827c3700 1 --2- 172.21.15.62:0/3936538163 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7e7c0cd2e0 0x7f7e7c0b3b20 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:56.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.520+0000 7f7e827c3700 1 --2- 172.21.15.62:0/3936538163 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e7c0cebf0 0x7f7e7c0d0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:56.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.520+0000 7f7e827c3700 1 -- 172.21.15.62:0/3936538163 >> 172.21.15.62:0/3936538163 conn(0x7f7e7c071840 msgr2=0x7f7e7c09b760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:40:56.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.520+0000 7f7e827c3700 1 -- 172.21.15.62:0/3936538163 shutdown_connections 2023-06-09T04:40:56.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.520+0000 7f7e827c3700 1 -- 172.21.15.62:0/3936538163 wait complete. 2023-06-09T04:40:56.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.520+0000 7f7e827c3700 1 Processor -- start 2023-06-09T04:40:56.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.520+0000 7f7e827c3700 1 -- start start 2023-06-09T04:40:56.526 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.520+0000 7f7e827c3700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7e7c0cd2e0 0x7f7e7c15f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:56.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.520+0000 7f7e827c3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e7c0cebf0 0x7f7e7c0d0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:56.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.520+0000 7f7e827c3700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e7c0d1f80 0x7f7e7c0d1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:56.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.520+0000 7f7e827c3700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7c0b6b40 con 0x7f7e7c0cd2e0 2023-06-09T04:40:56.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.520+0000 7f7e827c3700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7c15cff0 con 0x7f7e7c0d1f80 2023-06-09T04:40:56.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.520+0000 7f7e827c3700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7c0b5fc0 con 0x7f7e7c0cebf0 2023-06-09T04:40:56.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.524+0000 7f7e817c1700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7e7c0cd2e0 0x7f7e7c15f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:56.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.524+0000 7f7e817c1700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7e7c0cd2e0 0x7f7e7c15f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53076/0 (socket says 172.21.15.62:53076) 2023-06-09T04:40:56.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.524+0000 7f7e817c1700 1 -- 172.21.15.62:0/4170019506 learned_addr learned my addr 172.21.15.62:0/4170019506 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:40:56.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.524+0000 7f7e80fc0700 1 --2- 172.21.15.62:0/4170019506 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e7c0cebf0 0x7f7e7c0d0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:56.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.524+0000 7f7e81fc2700 1 --2- 172.21.15.62:0/4170019506 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e7c0d1f80 0x7f7e7c0d1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:56.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.524+0000 7f7e817c1700 1 -- 172.21.15.62:0/4170019506 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e7c0cebf0 msgr2=0x7f7e7c0d0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:56.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.524+0000 7f7e817c1700 1 --2- 172.21.15.62:0/4170019506 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e7c0cebf0 0x7f7e7c0d0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:56.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.524+0000 7f7e817c1700 1 -- 172.21.15.62:0/4170019506 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e7c0d1f80 msgr2=0x7f7e7c0d1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:56.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.524+0000 7f7e817c1700 1 --2- 172.21.15.62:0/4170019506 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e7c0d1f80 0x7f7e7c0d1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:56.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.524+0000 7f7e817c1700 1 -- 172.21.15.62:0/4170019506 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e740094b0 con 0x7f7e7c0cd2e0 2023-06-09T04:40:56.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.524+0000 7f7e817c1700 1 --2- 172.21.15.62:0/4170019506 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7e7c0cd2e0 0x7f7e7c15f170 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7e7800cbc0 tx=0x7f7e7800ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:56.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.524+0000 7f7e71ffb700 1 -- 172.21.15.62:0/4170019506 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7800aa40 con 0x7f7e7c0cd2e0 2023-06-09T04:40:56.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.524+0000 7f7e71ffb700 1 -- 172.21.15.62:0/4170019506 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e7800abc0 con 0x7f7e7c0cd2e0 2023-06-09T04:40:56.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.524+0000 7f7e827c3700 1 -- 172.21.15.62:0/4170019506 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e6c009570 con 0x7f7e7c0cd2e0 2023-06-09T04:40:56.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.524+0000 7f7e71ffb700 1 -- 172.21.15.62:0/4170019506 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e780070d0 con 0x7f7e7c0cd2e0 2023-06-09T04:40:56.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.524+0000 7f7e827c3700 1 -- 172.21.15.62:0/4170019506 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e7c0b6580 con 0x7f7e7c0cd2e0 2023-06-09T04:40:56.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.528+0000 7f7e827c3700 1 -- 172.21.15.62:0/4170019506 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e7c0739c0 con 0x7f7e7c0cd2e0 2023-06-09T04:40:56.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.528+0000 7f7e71ffb700 1 -- 172.21.15.62:0/4170019506 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7e78007230 con 0x7f7e7c0cd2e0 2023-06-09T04:40:56.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.532+0000 7f7e71ffb700 1 --2- 172.21.15.62:0/4170019506 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f7e600662f0 0x7f7e600687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:56.536 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.532+0000 7f7e71ffb700 1 -- 172.21.15.62:0/4170019506 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f7e780839f0 con 0x7f7e7c0cd2e0 2023-06-09T04:40:56.536 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.532+0000 7f7e80fc0700 1 --2- 172.21.15.62:0/4170019506 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f7e600662f0 0x7f7e600687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:56.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.532+0000 7f7e80fc0700 1 --2- 172.21.15.62:0/4170019506 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f7e600662f0 0x7f7e600687a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c000c00 tx=0x7f7e6c008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:56.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.540+0000 7f7e71ffb700 1 -- 172.21.15.62:0/4170019506 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7e78050ec0 con 0x7f7e7c0cd2e0 2023-06-09T04:40:56.757 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.752+0000 7f7e827c3700 1 -- 172.21.15.62:0/4170019506 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f7e7c0ce7d0 con 0x7f7e7c0cd2e0 2023-06-09T04:40:56.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.768+0000 7f7e71ffb700 1 -- 172.21.15.62:0/4170019506 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f7e780180c0 con 0x7f7e7c0cd2e0 2023-06-09T04:40:56.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.776+0000 7f7e827c3700 1 -- 172.21.15.62:0/4170019506 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f7e600662f0 msgr2=0x7f7e600687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:56.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.776+0000 7f7e827c3700 1 --2- 172.21.15.62:0/4170019506 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f7e600662f0 0x7f7e600687a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c000c00 tx=0x7f7e6c008030 comp rx=0 tx=0).stop 2023-06-09T04:40:56.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.776+0000 7f7e827c3700 1 -- 172.21.15.62:0/4170019506 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7e7c0cd2e0 msgr2=0x7f7e7c15f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:56.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.776+0000 7f7e827c3700 1 --2- 172.21.15.62:0/4170019506 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7e7c0cd2e0 0x7f7e7c15f170 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7e7800cbc0 tx=0x7f7e7800ced0 comp rx=0 tx=0).stop 2023-06-09T04:40:56.786 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.780+0000 7f7e827c3700 1 -- 172.21.15.62:0/4170019506 shutdown_connections 2023-06-09T04:40:56.786 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.780+0000 7f7e827c3700 1 --2- 172.21.15.62:0/4170019506 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f7e600662f0 0x7f7e600687a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:56.786 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.780+0000 7f7e827c3700 1 --2- 172.21.15.62:0/4170019506 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e7c0d1f80 0x7f7e7c0d1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:56.786 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.780+0000 7f7e827c3700 1 --2- 172.21.15.62:0/4170019506 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7e7c0cebf0 0x7f7e7c0d0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:56.786 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.780+0000 7f7e827c3700 1 --2- 172.21.15.62:0/4170019506 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7e7c0cd2e0 0x7f7e7c15f170 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:56.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.780+0000 7f7e827c3700 1 -- 172.21.15.62:0/4170019506 >> 172.21.15.62:0/4170019506 conn(0x7f7e7c071840 msgr2=0x7f7e7c15b780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:40:56.788 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.780+0000 7f7e827c3700 1 -- 172.21.15.62:0/4170019506 shutdown_connections 2023-06-09T04:40:56.789 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.780+0000 7f7e827c3700 1 -- 172.21.15.62:0/4170019506 wait complete. 2023-06-09T04:40:56.789 INFO:teuthology.orchestra.run.smithi062.stderr:new fs with metadata pool 3 and data pool 4 2023-06-09T04:40:56.816 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-06-09T04:40:56.817 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-06-09T04:40:56.995 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.992+0000 7f933827b700 1 Processor -- start 2023-06-09T04:40:56.996 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.992+0000 7f933827b700 1 -- start start 2023-06-09T04:40:56.998 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.992+0000 7f933827b700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f93300d0430 0x7f93300d08b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:56.998 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.992+0000 7f933827b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f93300cea40 0x7f93300ceea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:56.998 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.992+0000 7f933827b700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93300cd760 con 0x7f933015c2c0 2023-06-09T04:40:56.998 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.992+0000 7f933827b700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93300ce000 con 0x7f93300d0430 2023-06-09T04:40:56.998 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.992+0000 7f933827b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93300d0df0 con 0x7f93300cea40 2023-06-09T04:40:56.999 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.992+0000 7f9335816700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f93300d0430 0x7f93300d08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:56.999 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.996+0000 7f9335816700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f93300d0430 0x7f93300d08b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.62:52378/0 (socket says 172.21.15.62:52378) 2023-06-09T04:40:56.999 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.996+0000 7f9336017700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f933015c2c0 0x7f93300ccca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.62:53656/0 (socket says 172.21.15.62:53656) 2023-06-09T04:40:56.999 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.996+0000 7f9335816700 1 -- 172.21.15.62:0/3758356351 learned_addr learned my addr 172.21.15.62:0/3758356351 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:40:57.000 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.996+0000 7f9336818700 1 --2- 172.21.15.62:0/3758356351 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f93300cea40 0x7f93300ceea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:57.000 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.996+0000 7f9335816700 1 -- 172.21.15.62:0/3758356351 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f93300cea40 msgr2=0x7f93300ceea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:40:57.001 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.996+0000 7f9335816700 1 --2- 172.21.15.62:0/3758356351 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f93300cea40 0x7f93300ceea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:57.001 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.996+0000 7f9335816700 1 -- 172.21.15.62:0/3758356351 >> v1:172.21.15.89:6789/0 conn(0x7f933015c2c0 legacy=0x7f93300ccca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:57.001 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.996+0000 7f9335816700 1 -- 172.21.15.62:0/3758356351 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93300cda40 con 0x7f93300d0430 2023-06-09T04:40:57.001 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.996+0000 7f9335816700 1 --2- 172.21.15.62:0/3758356351 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93300d0430 0x7f93300d08b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9320009910 tx=0x7f9320009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d54c122095474a2c server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:57.001 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.996+0000 7f9335015700 1 -- 172.21.15.62:0/3758356351 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9320011830 con 0x7f93300d0430 2023-06-09T04:40:57.001 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.996+0000 7f9335015700 1 -- 172.21.15.62:0/3758356351 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9320011990 con 0x7f93300d0430 2023-06-09T04:40:57.001 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.996+0000 7f9335015700 1 -- 172.21.15.62:0/3758356351 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9320011d40 con 0x7f93300d0430 2023-06-09T04:40:57.002 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.996+0000 7f933827b700 1 -- 172.21.15.62:0/3758356351 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93300d0430 msgr2=0x7f93300d08b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:57.002 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.996+0000 7f933827b700 1 --2- 172.21.15.62:0/3758356351 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93300d0430 0x7f93300d08b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9320009910 tx=0x7f9320009c20 comp rx=0 tx=0).stop 2023-06-09T04:40:57.002 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.996+0000 7f933827b700 1 -- 172.21.15.62:0/3758356351 shutdown_connections 2023-06-09T04:40:57.003 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.996+0000 7f933827b700 1 --2- 172.21.15.62:0/3758356351 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93300d0430 0x7f93300d08b0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:57.003 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.996+0000 7f933827b700 1 --2- 172.21.15.62:0/3758356351 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f93300cea40 0x7f93300ceea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:57.003 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.996+0000 7f933827b700 1 -- 172.21.15.62:0/3758356351 >> 172.21.15.62:0/3758356351 conn(0x7f9330071840 msgr2=0x7f933009b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:40:57.003 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.996+0000 7f933827b700 1 -- 172.21.15.62:0/3758356351 shutdown_connections 2023-06-09T04:40:57.003 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:56.996+0000 7f933827b700 1 -- 172.21.15.62:0/3758356351 wait complete. 2023-06-09T04:40:57.006 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:57.000+0000 7f933827b700 1 Processor -- start 2023-06-09T04:40:57.007 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:57.004+0000 7f933827b700 1 -- start start 2023-06-09T04:40:57.008 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:57.004+0000 7f933827b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f93300cea40 0x7f9330157a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:57.008 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:57.004+0000 7f933827b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93300d0430 0x7f93300c9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:57.008 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:57.004+0000 7f933827b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f933015c2c0 0x7f93300b45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:57.008 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:57.004+0000 7f933827b700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93300b0520 con 0x7f93300cea40 2023-06-09T04:40:57.008 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:57.004+0000 7f933827b700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93300b20b0 con 0x7f93300d0430 2023-06-09T04:40:57.009 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:57.004+0000 7f933827b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93300b2300 con 0x7f933015c2c0 2023-06-09T04:40:57.009 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:57.004+0000 7f9336017700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f93300cea40 0x7f9330157a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:57.009 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:57.004+0000 7f9335816700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93300d0430 0x7f93300c9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:57.010 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:57.004+0000 7f9336017700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f93300cea40 0x7f9330157a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53092/0 (socket says 172.21.15.62:53092) 2023-06-09T04:40:57.010 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:57.004+0000 7f9336017700 1 -- 172.21.15.62:0/401632188 learned_addr learned my addr 172.21.15.62:0/401632188 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:40:57.010 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:57.004+0000 7f9336818700 1 --2- 172.21.15.62:0/401632188 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f933015c2c0 0x7f93300b45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:57.010 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:57.004+0000 7f9335816700 1 -- 172.21.15.62:0/401632188 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f933015c2c0 msgr2=0x7f93300b45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:57.010 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:57.004+0000 7f9335816700 1 --2- 172.21.15.62:0/401632188 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f933015c2c0 0x7f93300b45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:57.010 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:57.004+0000 7f9335816700 1 -- 172.21.15.62:0/401632188 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f93300cea40 msgr2=0x7f9330157a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:57.010 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:57.004+0000 7f9335816700 1 --2- 172.21.15.62:0/401632188 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f93300cea40 0x7f9330157a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:57.011 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:57.004+0000 7f9335816700 1 -- 172.21.15.62:0/401632188 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9320009570 con 0x7f93300d0430 2023-06-09T04:40:57.011 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:57.004+0000 7f9335816700 1 --2- 172.21.15.62:0/401632188 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93300d0430 0x7f93300c9720 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f933008c020 tx=0x7f9320004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:57.011 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:57.004+0000 7f9326ffd700 1 -- 172.21.15.62:0/401632188 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9320004510 con 0x7f93300d0430 2023-06-09T04:40:57.011 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:57.004+0000 7f9326ffd700 1 -- 172.21.15.62:0/401632188 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f932001e070 con 0x7f93300d0430 2023-06-09T04:40:57.012 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:57.004+0000 7f933827b700 1 -- 172.21.15.62:0/401632188 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93300b25e0 con 0x7f93300d0430 2023-06-09T04:40:57.012 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:57.004+0000 7f9326ffd700 1 -- 172.21.15.62:0/401632188 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9320003900 con 0x7f93300d0430 2023-06-09T04:40:57.012 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:57.008+0000 7f933827b700 1 -- 172.21.15.62:0/401632188 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93300b2d10 con 0x7f93300d0430 2023-06-09T04:40:57.012 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:57.008+0000 7f933827b700 1 -- 172.21.15.62:0/401632188 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9330159f20 con 0x7f93300d0430 2023-06-09T04:40:57.015 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:57.012+0000 7f9326ffd700 1 -- 172.21.15.62:0/401632188 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9320003a60 con 0x7f93300d0430 2023-06-09T04:40:57.017 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:57.012+0000 7f9326ffd700 1 --2- 172.21.15.62:0/401632188 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f93140662f0 0x7f93140687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:57.017 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:57.012+0000 7f9326ffd700 1 -- 172.21.15.62:0/401632188 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9320084950 con 0x7f93300d0430 2023-06-09T04:40:57.017 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:57.012+0000 7f9336017700 1 --2- 172.21.15.62:0/401632188 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f93140662f0 0x7f93140687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:57.018 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:57.012+0000 7f9336017700 1 --2- 172.21.15.62:0/401632188 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f93140662f0 0x7f93140687a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f932c000f60 tx=0x7f932c001190 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:57.022 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:57.016+0000 7f9326ffd700 1 -- 172.21.15.62:0/401632188 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9320051e40 con 0x7f93300d0430 2023-06-09T04:40:57.206 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:57.200+0000 7f933827b700 1 -- 172.21.15.62:0/401632188 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f9330159f20 con 0x7f93300d0430 2023-06-09T04:40:57.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:57.780+0000 7f9326ffd700 1 -- 172.21.15.62:0/401632188 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v24) v1 ==== 157+0+0 (secure 0 0 0) 0x7f9330159f20 con 0x7f93300d0430 2023-06-09T04:40:57.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:57.780+0000 7f933827b700 1 -- 172.21.15.62:0/401632188 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f93140662f0 msgr2=0x7f93140687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:57.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:57.780+0000 7f933827b700 1 --2- 172.21.15.62:0/401632188 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f93140662f0 0x7f93140687a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f932c000f60 tx=0x7f932c001190 comp rx=0 tx=0).stop 2023-06-09T04:40:57.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:57.784+0000 7f933827b700 1 -- 172.21.15.62:0/401632188 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93300d0430 msgr2=0x7f93300c9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:57.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:57.784+0000 7f933827b700 1 --2- 172.21.15.62:0/401632188 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93300d0430 0x7f93300c9720 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f933008c020 tx=0x7f9320004770 comp rx=0 tx=0).stop 2023-06-09T04:40:57.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:57.784+0000 7f933827b700 1 -- 172.21.15.62:0/401632188 shutdown_connections 2023-06-09T04:40:57.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:57.784+0000 7f933827b700 1 --2- 172.21.15.62:0/401632188 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f93140662f0 0x7f93140687a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:57.788 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:57.784+0000 7f933827b700 1 --2- 172.21.15.62:0/401632188 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f933015c2c0 0x7f93300b45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:57.788 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:57.784+0000 7f933827b700 1 --2- 172.21.15.62:0/401632188 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93300d0430 0x7f93300c9720 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:57.788 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:57.784+0000 7f933827b700 1 --2- 172.21.15.62:0/401632188 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f93300cea40 0x7f9330157a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:57.788 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:57.784+0000 7f933827b700 1 -- 172.21.15.62:0/401632188 >> 172.21.15.62:0/401632188 conn(0x7f9330071840 msgr2=0x7f93300ccfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:40:57.789 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:57.784+0000 7f933827b700 1 -- 172.21.15.62:0/401632188 shutdown_connections 2023-06-09T04:40:57.789 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:57.784+0000 7f933827b700 1 -- 172.21.15.62:0/401632188 wait complete. 2023-06-09T04:40:57.810 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-06-09T04:40:58.006 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:58.000+0000 7f2ed14d8700 1 Processor -- start 2023-06-09T04:40:58.007 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:58.004+0000 7f2ed14d8700 1 -- start start 2023-06-09T04:40:58.012 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:58.008+0000 7f2ed14d8700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2ecc1604c0 0x7f2ecc06f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:58.012 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:58.008+0000 7f2ed14d8700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2ecc0cd630 0x7f2ecc0cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:58.012 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:58.008+0000 7f2ed14d8700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ecc164f00 con 0x7f2ecc070060 2023-06-09T04:40:58.012 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:58.008+0000 7f2ed14d8700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ecc0705d0 con 0x7f2ecc0cd630 2023-06-09T04:40:58.012 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:58.008+0000 7f2ed14d8700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ecc160890 con 0x7f2ecc1604c0 2023-06-09T04:40:58.015 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:58.008+0000 7f2ecb7fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2ecc0cd630 0x7f2ecc0cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:58.015 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:58.008+0000 7f2ecb7fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2ecc0cd630 0x7f2ecc0cabf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53108/0 (socket says 172.21.15.62:53108) 2023-06-09T04:40:58.015 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:58.008+0000 7f2ecb7fe700 1 -- 172.21.15.62:0/3483288149 learned_addr learned my addr 172.21.15.62:0/3483288149 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:40:58.016 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:58.012+0000 7f2ecaffd700 1 --2- 172.21.15.62:0/3483288149 >> v2:172.21.15.89:3300/0 conn(0x7f2ecc1604c0 0x7f2ecc06f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:58.016 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:58.012+0000 7f2ecb7fe700 1 -- 172.21.15.62:0/3483288149 >> v2:172.21.15.89:3300/0 conn(0x7f2ecc1604c0 msgr2=0x7f2ecc06f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:40:58.016 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:58.012+0000 7f2ecb7fe700 1 --2- 172.21.15.62:0/3483288149 >> v2:172.21.15.89:3300/0 conn(0x7f2ecc1604c0 0x7f2ecc06f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:58.016 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:58.012+0000 7f2ecb7fe700 1 -- 172.21.15.62:0/3483288149 >> v1:172.21.15.62:6789/0 conn(0x7f2ecc070060 legacy=0x7f2ecc0ccf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:58.017 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:58.012+0000 7f2ecb7fe700 1 -- 172.21.15.62:0/3483288149 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ecc164140 con 0x7f2ecc0cd630 2023-06-09T04:40:58.017 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:58.012+0000 7f2ecb7fe700 1 --2- 172.21.15.62:0/3483288149 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ecc0cd630 0x7f2ecc0cabf0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc0719c0 tx=0x7f2ec400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=add87e32092acff7 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:58.017 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:58.012+0000 7f2ec9ffb700 1 -- 172.21.15.62:0/3483288149 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec400e070 con 0x7f2ecc0cd630 2023-06-09T04:40:58.017 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:58.012+0000 7f2ec9ffb700 1 -- 172.21.15.62:0/3483288149 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ec400b910 con 0x7f2ecc0cd630 2023-06-09T04:40:58.017 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:58.012+0000 7f2ec9ffb700 1 -- 172.21.15.62:0/3483288149 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec400bcc0 con 0x7f2ecc0cd630 2023-06-09T04:40:58.018 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:58.012+0000 7f2ed14d8700 1 -- 172.21.15.62:0/3483288149 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ecc0cd630 msgr2=0x7f2ecc0cabf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:58.018 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:58.012+0000 7f2ed14d8700 1 --2- 172.21.15.62:0/3483288149 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ecc0cd630 0x7f2ecc0cabf0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc0719c0 tx=0x7f2ec400b330 comp rx=0 tx=0).stop 2023-06-09T04:40:58.018 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:58.012+0000 7f2ed14d8700 1 -- 172.21.15.62:0/3483288149 shutdown_connections 2023-06-09T04:40:58.018 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:58.012+0000 7f2ed14d8700 1 --2- 172.21.15.62:0/3483288149 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ecc0cd630 0x7f2ecc0cabf0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:58.018 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:58.012+0000 7f2ed14d8700 1 --2- 172.21.15.62:0/3483288149 >> v2:172.21.15.89:3300/0 conn(0x7f2ecc1604c0 0x7f2ecc06f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:58.019 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:58.012+0000 7f2ed14d8700 1 -- 172.21.15.62:0/3483288149 >> 172.21.15.62:0/3483288149 conn(0x7f2ecc06dbe0 msgr2=0x7f2ecc06dfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:40:58.019 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:58.012+0000 7f2ed14d8700 1 -- 172.21.15.62:0/3483288149 shutdown_connections 2023-06-09T04:40:58.019 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:58.012+0000 7f2ed14d8700 1 -- 172.21.15.62:0/3483288149 wait complete. 2023-06-09T04:40:58.019 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:58.016+0000 7f2ed14d8700 1 Processor -- start 2023-06-09T04:40:58.020 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:58.016+0000 7f2ed14d8700 1 -- start start 2023-06-09T04:40:58.021 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:58.016+0000 7f2ed14d8700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ecc070060 0x7f2ecc1f58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:58.021 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:58.016+0000 7f2ed14d8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ecc0cd630 0x7f2ecc15cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:58.021 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:58.016+0000 7f2ed14d8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2ecc1604c0 0x7f2ecc0b55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:58.021 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:58.016+0000 7f2ed14d8700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ecc0b5040 con 0x7f2ecc0cd630 2023-06-09T04:40:58.021 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:58.016+0000 7f2ed14d8700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ecc15d1d0 con 0x7f2ecc070060 2023-06-09T04:40:58.021 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:58.016+0000 7f2ed14d8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ecc0c52d0 con 0x7f2ecc1604c0 2023-06-09T04:40:58.022 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:58.016+0000 7f2eca7fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ecc0cd630 0x7f2ecc15cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:58.022 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:58.016+0000 7f2eca7fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ecc0cd630 0x7f2ecc15cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53122/0 (socket says 172.21.15.62:53122) 2023-06-09T04:40:58.023 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:58.016+0000 7f2eca7fc700 1 -- 172.21.15.62:0/216605119 learned_addr learned my addr 172.21.15.62:0/216605119 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:40:58.023 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:58.016+0000 7f2ecaffd700 1 --2- 172.21.15.62:0/216605119 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ecc070060 0x7f2ecc1f58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:58.023 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:58.016+0000 7f2ecb7fe700 1 --2- 172.21.15.62:0/216605119 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2ecc1604c0 0x7f2ecc0b55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:58.023 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:58.016+0000 7f2eca7fc700 1 -- 172.21.15.62:0/216605119 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2ecc1604c0 msgr2=0x7f2ecc0b55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:58.023 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:58.016+0000 7f2eca7fc700 1 --2- 172.21.15.62:0/216605119 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2ecc1604c0 0x7f2ecc0b55f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:58.023 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:58.016+0000 7f2eca7fc700 1 -- 172.21.15.62:0/216605119 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ecc070060 msgr2=0x7f2ecc1f58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:58.023 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:58.016+0000 7f2eca7fc700 1 --2- 172.21.15.62:0/216605119 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ecc070060 0x7f2ecc1f58f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:58.024 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:58.016+0000 7f2eca7fc700 1 -- 172.21.15.62:0/216605119 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ec4009b30 con 0x7f2ecc0cd630 2023-06-09T04:40:58.024 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:58.016+0000 7f2eca7fc700 1 --2- 172.21.15.62:0/216605119 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ecc0cd630 0x7f2ecc15cc90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2ec000c500 tx=0x7f2ec000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:58.024 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:58.016+0000 7f2eb37fe700 1 -- 172.21.15.62:0/216605119 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec00052d0 con 0x7f2ecc0cd630 2023-06-09T04:40:58.024 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:58.016+0000 7f2eb37fe700 1 -- 172.21.15.62:0/216605119 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ec0005430 con 0x7f2ecc0cd630 2023-06-09T04:40:58.024 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:58.016+0000 7f2eb37fe700 1 -- 172.21.15.62:0/216605119 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec00055a0 con 0x7f2ecc0cd630 2023-06-09T04:40:58.024 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:58.016+0000 7f2ed14d8700 1 -- 172.21.15.62:0/216605119 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ecc0c55b0 con 0x7f2ecc0cd630 2023-06-09T04:40:58.025 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:58.020+0000 7f2ed14d8700 1 -- 172.21.15.62:0/216605119 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ecc0c5b70 con 0x7f2ecc0cd630 2023-06-09T04:40:58.025 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:58.020+0000 7f2ed14d8700 1 -- 172.21.15.62:0/216605119 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ecc066bb0 con 0x7f2ecc0cd630 2023-06-09T04:40:58.025 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:58.020+0000 7f2eb37fe700 1 -- 172.21.15.62:0/216605119 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2ec00038e0 con 0x7f2ecc0cd630 2023-06-09T04:40:58.026 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:58.020+0000 7f2eb37fe700 1 --2- 172.21.15.62:0/216605119 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f2eb80662f0 0x7f2eb80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:40:58.026 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:58.020+0000 7f2eb37fe700 1 -- 172.21.15.62:0/216605119 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6288+0+0 (secure 0 0 0) 0x7f2ec0083190 con 0x7f2ecc0cd630 2023-06-09T04:40:58.027 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:58.024+0000 7f2ecaffd700 1 --2- 172.21.15.62:0/216605119 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f2eb80662f0 0x7f2eb80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:40:58.027 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:58.024+0000 7f2ecaffd700 1 --2- 172.21.15.62:0/216605119 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f2eb80662f0 0x7f2eb80687a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc009bf0 tx=0x7f2ebc009240 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:40:58.034 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:58.028+0000 7f2eb37fe700 1 -- 172.21.15.62:0/216605119 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2ec0050530 con 0x7f2ecc0cd630 2023-06-09T04:40:58.210 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:58.204+0000 7f2ed14d8700 1 -- 172.21.15.62:0/216605119 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f2ecc0b6520 con 0x7f2ecc0cd630 2023-06-09T04:40:59.795 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:59.788+0000 7f2eb37fe700 1 -- 172.21.15.62:0/216605119 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v26) v1 ==== 228+0+0 (secure 0 0 0) 0x7f2ec0053b50 con 0x7f2ecc0cd630 2023-06-09T04:40:59.807 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:59.804+0000 7f2ed14d8700 1 -- 172.21.15.62:0/216605119 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f2eb80662f0 msgr2=0x7f2eb80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:59.807 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:59.804+0000 7f2ed14d8700 1 --2- 172.21.15.62:0/216605119 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f2eb80662f0 0x7f2eb80687a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc009bf0 tx=0x7f2ebc009240 comp rx=0 tx=0).stop 2023-06-09T04:40:59.807 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:59.804+0000 7f2ed14d8700 1 -- 172.21.15.62:0/216605119 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ecc0cd630 msgr2=0x7f2ecc15cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:40:59.807 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:59.804+0000 7f2ed14d8700 1 --2- 172.21.15.62:0/216605119 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ecc0cd630 0x7f2ecc15cc90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2ec000c500 tx=0x7f2ec000c810 comp rx=0 tx=0).stop 2023-06-09T04:40:59.808 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:59.804+0000 7f2ed14d8700 1 -- 172.21.15.62:0/216605119 shutdown_connections 2023-06-09T04:40:59.808 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:59.804+0000 7f2ed14d8700 1 --2- 172.21.15.62:0/216605119 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f2eb80662f0 0x7f2eb80687a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:59.808 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:59.804+0000 7f2ed14d8700 1 --2- 172.21.15.62:0/216605119 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2ecc1604c0 0x7f2ecc0b55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:59.808 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:59.804+0000 7f2ed14d8700 1 --2- 172.21.15.62:0/216605119 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2ecc0cd630 0x7f2ecc15cc90 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:59.808 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:59.804+0000 7f2ed14d8700 1 --2- 172.21.15.62:0/216605119 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2ecc070060 0x7f2ecc1f58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:40:59.808 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:59.804+0000 7f2ed14d8700 1 -- 172.21.15.62:0/216605119 >> 172.21.15.62:0/216605119 conn(0x7f2ecc06dbe0 msgr2=0x7f2ecc0b3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:40:59.809 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:59.804+0000 7f2ed14d8700 1 -- 172.21.15.62:0/216605119 shutdown_connections 2023-06-09T04:40:59.809 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:40:59.804+0000 7f2ed14d8700 1 -- 172.21.15.62:0/216605119 wait complete. 2023-06-09T04:40:59.812 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_data_ec' created 2023-06-09T04:40:59.831 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-06-09T04:41:00.017 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:00.012+0000 7fb04ade3700 1 Processor -- start 2023-06-09T04:41:00.017 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:00.012+0000 7fb04ade3700 1 -- start start 2023-06-09T04:41:00.020 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:00.016+0000 7fb04ade3700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb044160030 0x7fb0440b0710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:00.020 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:00.016+0000 7fb04ade3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb044160400 0x7fb0440cbd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:00.020 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:00.016+0000 7fb04ade3700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0440c8a30 con 0x7fb0440cab30 2023-06-09T04:41:00.020 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:00.016+0000 7fb04ade3700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0440cb0b0 con 0x7fb044160030 2023-06-09T04:41:00.021 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:00.016+0000 7fb04ade3700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0440cb390 con 0x7fb044160400 2023-06-09T04:41:00.021 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:00.016+0000 7fb049de1700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb044160030 0x7fb0440b0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:00.021 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:00.016+0000 7fb04a5e2700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fb0440cab30 0x7fb044163d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:45756/0 (socket says 172.21.15.62:45756) 2023-06-09T04:41:00.021 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:00.016+0000 7fb04a5e2700 1 -- 172.21.15.62:0/2200844818 learned_addr learned my addr 172.21.15.62:0/2200844818 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:41:00.021 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:00.016+0000 7fb0495e0700 1 --2- 172.21.15.62:0/2200844818 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb044160400 0x7fb0440cbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:00.022 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:00.016+0000 7fb048ddf700 1 -- 172.21.15.62:0/2200844818 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2343567071 0 0) 0x7fb0440c8a30 con 0x7fb0440cab30 2023-06-09T04:41:00.022 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:00.016+0000 7fb048ddf700 1 -- 172.21.15.62:0/2200844818 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0300035d0 con 0x7fb0440cab30 2023-06-09T04:41:00.022 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:00.016+0000 7fb049de1700 1 -- 172.21.15.62:0/2200844818 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb044160400 msgr2=0x7fb0440cbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:00.022 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:00.016+0000 7fb049de1700 1 --2- 172.21.15.62:0/2200844818 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb044160400 0x7fb0440cbd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:00.023 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:00.016+0000 7fb049de1700 1 -- 172.21.15.62:0/2200844818 >> v1:172.21.15.62:6789/0 conn(0x7fb0440cab30 legacy=0x7fb044163d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:00.023 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:00.016+0000 7fb049de1700 1 -- 172.21.15.62:0/2200844818 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb04406f870 con 0x7fb044160030 2023-06-09T04:41:00.023 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:00.016+0000 7fb049de1700 1 --2- 172.21.15.62:0/2200844818 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb044160030 0x7fb0440b0710 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb040009850 tx=0x7fb040009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5651f1c2e295aff server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:00.023 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:00.020+0000 7fb048ddf700 1 -- 172.21.15.62:0/2200844818 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb040011830 con 0x7fb044160030 2023-06-09T04:41:00.023 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:00.020+0000 7fb048ddf700 1 -- 172.21.15.62:0/2200844818 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb040011990 con 0x7fb044160030 2023-06-09T04:41:00.024 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:00.020+0000 7fb048ddf700 1 -- 172.21.15.62:0/2200844818 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb040011d40 con 0x7fb044160030 2023-06-09T04:41:00.024 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:00.020+0000 7fb04ade3700 1 -- 172.21.15.62:0/2200844818 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb044160030 msgr2=0x7fb0440b0710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:00.024 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:00.020+0000 7fb04ade3700 1 --2- 172.21.15.62:0/2200844818 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb044160030 0x7fb0440b0710 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb040009850 tx=0x7fb040009b60 comp rx=0 tx=0).stop 2023-06-09T04:41:00.024 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:00.020+0000 7fb04ade3700 1 -- 172.21.15.62:0/2200844818 shutdown_connections 2023-06-09T04:41:00.025 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:00.020+0000 7fb04ade3700 1 --2- 172.21.15.62:0/2200844818 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb044160400 0x7fb0440cbd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:00.025 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:00.020+0000 7fb04ade3700 1 --2- 172.21.15.62:0/2200844818 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb044160030 0x7fb0440b0710 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:00.025 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:00.020+0000 7fb04ade3700 1 -- 172.21.15.62:0/2200844818 >> 172.21.15.62:0/2200844818 conn(0x7fb0440657d0 msgr2=0x7fb0440697f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:00.025 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:00.020+0000 7fb04ade3700 1 -- 172.21.15.62:0/2200844818 shutdown_connections 2023-06-09T04:41:00.025 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:00.020+0000 7fb04ade3700 1 -- 172.21.15.62:0/2200844818 wait complete. 2023-06-09T04:41:00.027 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:00.024+0000 7fb04ade3700 1 Processor -- start 2023-06-09T04:41:00.027 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:00.024+0000 7fb04ade3700 1 -- start start 2023-06-09T04:41:00.029 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:00.024+0000 7fb04ade3700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0440cab30 0x7fb0441632b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:00.029 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:00.024+0000 7fb04ade3700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb044160030 0x7fb04415cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:00.029 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:00.024+0000 7fb04ade3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb044160400 0x7fb0440c7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:00.029 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:00.024+0000 7fb04ade3700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0440c8120 con 0x7fb0440cab30 2023-06-09T04:41:00.029 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:00.024+0000 7fb04ade3700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb044162210 con 0x7fb044160030 2023-06-09T04:41:00.030 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:00.024+0000 7fb04ade3700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0441624f0 con 0x7fb044160400 2023-06-09T04:41:00.030 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:00.024+0000 7fb049de1700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0440cab30 0x7fb0441632b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:00.030 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:00.024+0000 7fb049de1700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0440cab30 0x7fb0441632b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53144/0 (socket says 172.21.15.62:53144) 2023-06-09T04:41:00.031 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:00.024+0000 7fb049de1700 1 -- 172.21.15.62:0/1061932219 learned_addr learned my addr 172.21.15.62:0/1061932219 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:00.031 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:00.024+0000 7fb04a5e2700 1 --2- 172.21.15.62:0/1061932219 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb044160400 0x7fb0440c7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:00.031 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:00.024+0000 7fb0495e0700 1 --2- 172.21.15.62:0/1061932219 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb044160030 0x7fb04415cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:00.031 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:00.024+0000 7fb049de1700 1 -- 172.21.15.62:0/1061932219 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb044160400 msgr2=0x7fb0440c7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:00.031 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:00.024+0000 7fb049de1700 1 --2- 172.21.15.62:0/1061932219 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb044160400 0x7fb0440c7be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:00.031 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:00.024+0000 7fb049de1700 1 -- 172.21.15.62:0/1061932219 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb044160030 msgr2=0x7fb04415cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:00.031 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:00.024+0000 7fb049de1700 1 --2- 172.21.15.62:0/1061932219 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb044160030 0x7fb04415cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:00.032 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:00.024+0000 7fb049de1700 1 -- 172.21.15.62:0/1061932219 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0400094b0 con 0x7fb0440cab30 2023-06-09T04:41:00.032 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:00.024+0000 7fb049de1700 1 --2- 172.21.15.62:0/1061932219 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0440cab30 0x7fb0441632b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb04406dae0 tx=0x7fb040004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:00.032 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:00.028+0000 7fb03a7fc700 1 -- 172.21.15.62:0/1061932219 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb040004480 con 0x7fb0440cab30 2023-06-09T04:41:00.033 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:00.028+0000 7fb03a7fc700 1 -- 172.21.15.62:0/1061932219 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb04001f070 con 0x7fb0440cab30 2023-06-09T04:41:00.033 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:00.028+0000 7fb03a7fc700 1 -- 172.21.15.62:0/1061932219 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0400038e0 con 0x7fb0440cab30 2023-06-09T04:41:00.033 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:00.028+0000 7fb04ade3700 1 -- 172.21.15.62:0/1061932219 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0441627d0 con 0x7fb0440cab30 2023-06-09T04:41:00.033 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:00.028+0000 7fb04ade3700 1 -- 172.21.15.62:0/1061932219 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb044162d90 con 0x7fb0440cab30 2023-06-09T04:41:00.033 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:00.028+0000 7fb04ade3700 1 -- 172.21.15.62:0/1061932219 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb04404db30 con 0x7fb0440cab30 2023-06-09T04:41:00.035 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:00.032+0000 7fb03a7fc700 1 -- 172.21.15.62:0/1061932219 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb040021030 con 0x7fb0440cab30 2023-06-09T04:41:00.037 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:00.032+0000 7fb03a7fc700 1 --2- 172.21.15.62:0/1061932219 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fb0280662f0 0x7fb0280687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:00.037 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:00.032+0000 7fb03a7fc700 1 -- 172.21.15.62:0/1061932219 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6781+0+0 (secure 0 0 0) 0x7fb040085550 con 0x7fb0440cab30 2023-06-09T04:41:00.037 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:00.032+0000 7fb0495e0700 1 --2- 172.21.15.62:0/1061932219 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fb0280662f0 0x7fb0280687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:00.039 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:00.036+0000 7fb0495e0700 1 --2- 172.21.15.62:0/1061932219 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fb0280662f0 0x7fb0280687a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb04406c6a0 tx=0x7fb034008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:00.044 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:00.040+0000 7fb03a7fc700 1 -- 172.21.15.62:0/1061932219 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb040052810 con 0x7fb0440cab30 2023-06-09T04:41:00.222 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:00.216+0000 7fb04ade3700 1 -- 172.21.15.62:0/1061932219 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7fb0440c9c50 con 0x7fb0440cab30 2023-06-09T04:41:00.801 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:00.796+0000 7fb03a7fc700 1 -- 172.21.15.62:0/1061932219 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 5 allow_ec_overwrites to true v27) v1 ==== 169+0+0 (secure 0 0 0) 0x7fb040006ce0 con 0x7fb0440cab30 2023-06-09T04:41:00.820 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:00.816+0000 7fb04ade3700 1 -- 172.21.15.62:0/1061932219 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fb0280662f0 msgr2=0x7fb0280687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:00.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:00.816+0000 7fb04ade3700 1 --2- 172.21.15.62:0/1061932219 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fb0280662f0 0x7fb0280687a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb04406c6a0 tx=0x7fb034008040 comp rx=0 tx=0).stop 2023-06-09T04:41:00.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:00.816+0000 7fb04ade3700 1 -- 172.21.15.62:0/1061932219 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0440cab30 msgr2=0x7fb0441632b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:00.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:00.816+0000 7fb04ade3700 1 --2- 172.21.15.62:0/1061932219 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0440cab30 0x7fb0441632b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb04406dae0 tx=0x7fb040004770 comp rx=0 tx=0).stop 2023-06-09T04:41:00.823 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:00.816+0000 7fb04ade3700 1 -- 172.21.15.62:0/1061932219 shutdown_connections 2023-06-09T04:41:00.823 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:00.816+0000 7fb04ade3700 1 --2- 172.21.15.62:0/1061932219 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fb0280662f0 0x7fb0280687a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:00.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:00.816+0000 7fb04ade3700 1 --2- 172.21.15.62:0/1061932219 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb044160400 0x7fb0440c7be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:00.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:00.816+0000 7fb04ade3700 1 --2- 172.21.15.62:0/1061932219 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb044160030 0x7fb04415cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:00.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:00.816+0000 7fb04ade3700 1 --2- 172.21.15.62:0/1061932219 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0440cab30 0x7fb0441632b0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:00.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:00.816+0000 7fb04ade3700 1 -- 172.21.15.62:0/1061932219 >> 172.21.15.62:0/1061932219 conn(0x7fb0440657d0 msgr2=0x7fb0440ce940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:00.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:00.820+0000 7fb04ade3700 1 -- 172.21.15.62:0/1061932219 shutdown_connections 2023-06-09T04:41:00.826 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:00.820+0000 7fb04ade3700 1 -- 172.21.15.62:0/1061932219 wait complete. 2023-06-09T04:41:00.830 INFO:teuthology.orchestra.run.smithi062.stderr:set pool 5 allow_ec_overwrites to true 2023-06-09T04:41:00.856 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-06-09T04:41:01.034 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.028+0000 7f8f54d48700 1 Processor -- start 2023-06-09T04:41:01.034 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.028+0000 7f8f54d48700 1 -- start start 2023-06-09T04:41:01.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.032+0000 7f8f54d48700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8f500cc7e0 0x7f8f5015e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:01.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.032+0000 7f8f54d48700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f500ca700 con 0x7f8f50159920 2023-06-09T04:41:01.037 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.032+0000 7f8f54d48700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f5015e5c0 con 0x7f8f50159cf0 2023-06-09T04:41:01.037 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.032+0000 7f8f54d48700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f5015d670 con 0x7f8f500cc7e0 2023-06-09T04:41:01.037 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.032+0000 7f8f4f7fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f8f50159920 0x7f8f5006df30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:38530/0 (socket says 172.21.15.62:38530) 2023-06-09T04:41:01.037 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.032+0000 7f8f4f7fe700 1 -- 172.21.15.62:0/1420175643 learned_addr learned my addr 172.21.15.62:0/1420175643 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:41:01.038 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.032+0000 7f8f4effd700 1 --2- 172.21.15.62:0/1420175643 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8f500cc7e0 0x7f8f5015e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:01.038 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.032+0000 7f8f4effd700 1 -- 172.21.15.62:0/1420175643 >> v1:172.21.15.89:6789/0 conn(0x7f8f50159cf0 legacy=0x7f8f500b1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:01.038 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.032+0000 7f8f4effd700 1 -- 172.21.15.62:0/1420175643 >> v1:172.21.15.62:6789/0 conn(0x7f8f50159920 legacy=0x7f8f5006df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:01.039 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.032+0000 7f8f4effd700 1 -- 172.21.15.62:0/1420175643 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f5015dbf0 con 0x7f8f500cc7e0 2023-06-09T04:41:01.039 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.032+0000 7f8f4e7fc700 1 -- 172.21.15.62:0/1420175643 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3945710703 0 0) 0x7f8f500ca700 con 0x7f8f50159920 2023-06-09T04:41:01.039 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.032+0000 7f8f4effd700 1 --2- 172.21.15.62:0/1420175643 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8f500cc7e0 0x7f8f5015e080 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8f44009880 tx=0x7f8f44009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a91e7f5b7e20725 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:01.039 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.032+0000 7f8f4e7fc700 1 -- 172.21.15.62:0/1420175643 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f44011830 con 0x7f8f500cc7e0 2023-06-09T04:41:01.039 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.032+0000 7f8f4e7fc700 1 -- 172.21.15.62:0/1420175643 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f44011990 con 0x7f8f500cc7e0 2023-06-09T04:41:01.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.036+0000 7f8f4e7fc700 1 -- 172.21.15.62:0/1420175643 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f44011d20 con 0x7f8f500cc7e0 2023-06-09T04:41:01.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.036+0000 7f8f54d48700 1 -- 172.21.15.62:0/1420175643 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8f500cc7e0 msgr2=0x7f8f5015e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:01.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.036+0000 7f8f54d48700 1 --2- 172.21.15.62:0/1420175643 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8f500cc7e0 0x7f8f5015e080 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8f44009880 tx=0x7f8f44009b90 comp rx=0 tx=0).stop 2023-06-09T04:41:01.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.036+0000 7f8f54d48700 1 -- 172.21.15.62:0/1420175643 shutdown_connections 2023-06-09T04:41:01.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.036+0000 7f8f54d48700 1 --2- 172.21.15.62:0/1420175643 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8f500cc7e0 0x7f8f5015e080 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:01.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.036+0000 7f8f54d48700 1 -- 172.21.15.62:0/1420175643 >> 172.21.15.62:0/1420175643 conn(0x7f8f500ccce0 msgr2=0x7f8f500cd0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:01.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.036+0000 7f8f54d48700 1 -- 172.21.15.62:0/1420175643 shutdown_connections 2023-06-09T04:41:01.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.036+0000 7f8f54d48700 1 -- 172.21.15.62:0/1420175643 wait complete. 2023-06-09T04:41:01.043 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.040+0000 7f8f54d48700 1 Processor -- start 2023-06-09T04:41:01.044 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.040+0000 7f8f54d48700 1 -- start start 2023-06-09T04:41:01.045 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.040+0000 7f8f54d48700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f500cc7e0 0x7f8f500c6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:01.046 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.040+0000 7f8f54d48700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f50159920 0x7f8f500d0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:01.046 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.040+0000 7f8f54d48700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8f50159cf0 0x7f8f501f4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:01.046 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.040+0000 7f8f54d48700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f501f5560 con 0x7f8f50159920 2023-06-09T04:41:01.046 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.040+0000 7f8f54d48700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f500c43f0 con 0x7f8f500cc7e0 2023-06-09T04:41:01.046 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.040+0000 7f8f54d48700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f500c46d0 con 0x7f8f50159cf0 2023-06-09T04:41:01.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.040+0000 7f8f4effd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f50159920 0x7f8f500d0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:01.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.040+0000 7f8f4effd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f50159920 0x7f8f500d0820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:41106/0 (socket says 172.21.15.62:41106) 2023-06-09T04:41:01.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.040+0000 7f8f4effd700 1 -- 172.21.15.62:0/3798730115 learned_addr learned my addr 172.21.15.62:0/3798730115 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:01.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.040+0000 7f8f4ffff700 1 --2- 172.21.15.62:0/3798730115 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8f50159cf0 0x7f8f501f4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:01.048 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.040+0000 7f8f4f7fe700 1 --2- 172.21.15.62:0/3798730115 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f500cc7e0 0x7f8f500c6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:01.048 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.044+0000 7f8f4effd700 1 -- 172.21.15.62:0/3798730115 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8f50159cf0 msgr2=0x7f8f501f4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:01.048 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.044+0000 7f8f4effd700 1 --2- 172.21.15.62:0/3798730115 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8f50159cf0 0x7f8f501f4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:01.048 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.044+0000 7f8f4effd700 1 -- 172.21.15.62:0/3798730115 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f500cc7e0 msgr2=0x7f8f500c6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:01.048 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.044+0000 7f8f4effd700 1 --2- 172.21.15.62:0/3798730115 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f500cc7e0 0x7f8f500c6ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:01.048 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.044+0000 7f8f4effd700 1 -- 172.21.15.62:0/3798730115 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f440094b0 con 0x7f8f50159920 2023-06-09T04:41:01.048 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.044+0000 7f8f4f7fe700 1 --2- 172.21.15.62:0/3798730115 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f500cc7e0 0x7f8f500c6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:41:01.049 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.044+0000 7f8f4effd700 1 --2- 172.21.15.62:0/3798730115 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f50159920 0x7f8f500d0820 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8f440090b0 tx=0x7f8f44004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:01.049 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.044+0000 7f8f37fff700 1 -- 172.21.15.62:0/3798730115 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f4400bb60 con 0x7f8f50159920 2023-06-09T04:41:01.049 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.044+0000 7f8f37fff700 1 -- 172.21.15.62:0/3798730115 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f4401f070 con 0x7f8f50159920 2023-06-09T04:41:01.050 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.044+0000 7f8f37fff700 1 -- 172.21.15.62:0/3798730115 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f4401a430 con 0x7f8f50159920 2023-06-09T04:41:01.050 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.044+0000 7f8f54d48700 1 -- 172.21.15.62:0/3798730115 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f500c49b0 con 0x7f8f50159920 2023-06-09T04:41:01.050 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.044+0000 7f8f54d48700 1 -- 172.21.15.62:0/3798730115 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f500c4f70 con 0x7f8f50159920 2023-06-09T04:41:01.050 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.044+0000 7f8f54d48700 1 -- 172.21.15.62:0/3798730115 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f500739c0 con 0x7f8f50159920 2023-06-09T04:41:01.051 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.048+0000 7f8f37fff700 1 -- 172.21.15.62:0/3798730115 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8f4401a590 con 0x7f8f50159920 2023-06-09T04:41:01.052 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.048+0000 7f8f37fff700 1 --2- 172.21.15.62:0/3798730115 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f8f3c0662f0 0x7f8f3c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:01.052 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.048+0000 7f8f37fff700 1 -- 172.21.15.62:0/3798730115 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6781+0+0 (secure 0 0 0) 0x7f8f44021070 con 0x7f8f50159920 2023-06-09T04:41:01.053 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.048+0000 7f8f4f7fe700 1 --2- 172.21.15.62:0/3798730115 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f8f3c0662f0 0x7f8f3c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:01.054 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.048+0000 7f8f4f7fe700 1 --2- 172.21.15.62:0/3798730115 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f8f3c0662f0 0x7f8f3c0687a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8f40000f60 tx=0x7f8f40007d00 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:01.060 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.056+0000 7f8f37fff700 1 -- 172.21.15.62:0/3798730115 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8f440525f0 con 0x7f8f50159920 2023-06-09T04:41:01.271 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.268+0000 7f8f54d48700 1 -- 172.21.15.62:0/3798730115 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f8f5006dd10 con 0x7f8f50159920 2023-06-09T04:41:01.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.280+0000 7f8f37fff700 1 -- 172.21.15.62:0/3798730115 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 5 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7f8f44055c10 con 0x7f8f50159920 2023-06-09T04:41:01.286 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.280+0000 7f8f54d48700 1 -- 172.21.15.62:0/3798730115 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f8f3c0662f0 msgr2=0x7f8f3c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:01.286 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.280+0000 7f8f54d48700 1 --2- 172.21.15.62:0/3798730115 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f8f3c0662f0 0x7f8f3c0687a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8f40000f60 tx=0x7f8f40007d00 comp rx=0 tx=0).stop 2023-06-09T04:41:01.287 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.280+0000 7f8f54d48700 1 -- 172.21.15.62:0/3798730115 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f50159920 msgr2=0x7f8f500d0820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:01.287 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.280+0000 7f8f54d48700 1 --2- 172.21.15.62:0/3798730115 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f50159920 0x7f8f500d0820 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8f440090b0 tx=0x7f8f44004770 comp rx=0 tx=0).stop 2023-06-09T04:41:01.287 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.280+0000 7f8f54d48700 1 -- 172.21.15.62:0/3798730115 shutdown_connections 2023-06-09T04:41:01.287 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.280+0000 7f8f54d48700 1 --2- 172.21.15.62:0/3798730115 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f8f3c0662f0 0x7f8f3c0687a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:01.287 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.280+0000 7f8f54d48700 1 --2- 172.21.15.62:0/3798730115 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8f50159cf0 0x7f8f501f4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:01.287 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.280+0000 7f8f54d48700 1 --2- 172.21.15.62:0/3798730115 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f50159920 0x7f8f500d0820 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:01.287 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.280+0000 7f8f54d48700 1 --2- 172.21.15.62:0/3798730115 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f500cc7e0 0x7f8f500c6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:01.288 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.280+0000 7f8f54d48700 1 -- 172.21.15.62:0/3798730115 >> 172.21.15.62:0/3798730115 conn(0x7f8f500ccce0 msgr2=0x7f8f500cbdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:01.288 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.284+0000 7f8f54d48700 1 -- 172.21.15.62:0/3798730115 shutdown_connections 2023-06-09T04:41:01.288 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.284+0000 7f8f54d48700 1 -- 172.21.15.62:0/3798730115 wait complete. 2023-06-09T04:41:01.289 INFO:teuthology.orchestra.run.smithi062.stderr:added data pool 5 to fsmap 2023-06-09T04:41:01.308 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-09T04:41:01.481 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.476+0000 7feecb57e700 1 Processor -- start 2023-06-09T04:41:01.481 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.476+0000 7feecb57e700 1 -- start start 2023-06-09T04:41:01.485 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.480+0000 7feecb57e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feec415bc60 0x7feec415c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:01.485 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.480+0000 7feecb57e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feec406b120 con 0x7feec40653e0 2023-06-09T04:41:01.485 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.480+0000 7feecb57e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feec40c9f80 con 0x7feec40657b0 2023-06-09T04:41:01.485 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.480+0000 7feecb57e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feec406a5f0 con 0x7feec415bc60 2023-06-09T04:41:01.486 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.480+0000 7feeca57c700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7feec40653e0 0x7feec406aa10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:38534/0 (socket says 172.21.15.62:38534) 2023-06-09T04:41:01.486 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.480+0000 7feeca57c700 1 -- 172.21.15.62:0/200231007 learned_addr learned my addr 172.21.15.62:0/200231007 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:41:01.486 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.480+0000 7feecad7d700 1 --2- 172.21.15.62:0/200231007 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feec415bc60 0x7feec415c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:01.487 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.480+0000 7feec957a700 1 -- 172.21.15.62:0/200231007 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2519337599 0 0) 0x7feec40c9f80 con 0x7feec40657b0 2023-06-09T04:41:01.487 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.480+0000 7feec957a700 1 -- 172.21.15.62:0/200231007 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feeb00035d0 con 0x7feec40657b0 2023-06-09T04:41:01.487 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.480+0000 7feec957a700 1 -- 172.21.15.62:0/200231007 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2175422178 0 0) 0x7feec406b120 con 0x7feec40653e0 2023-06-09T04:41:01.487 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.480+0000 7feec957a700 1 -- 172.21.15.62:0/200231007 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feec40c9f80 con 0x7feec40653e0 2023-06-09T04:41:01.487 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.480+0000 7feecad7d700 1 -- 172.21.15.62:0/200231007 >> v1:172.21.15.89:6789/0 conn(0x7feec40657b0 legacy=0x7feec40c9870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:01.488 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.480+0000 7feecad7d700 1 -- 172.21.15.62:0/200231007 >> v1:172.21.15.62:6789/0 conn(0x7feec40653e0 legacy=0x7feec406aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:01.488 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.480+0000 7feecad7d700 1 -- 172.21.15.62:0/200231007 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec4069970 con 0x7feec415bc60 2023-06-09T04:41:01.488 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.484+0000 7feecad7d700 1 --2- 172.21.15.62:0/200231007 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feec415bc60 0x7feec415c0e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7feebc009dc0 tx=0x7feebc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f7db6104e826a68 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:01.488 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.484+0000 7feec957a700 1 -- 172.21.15.62:0/200231007 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feebc00e070 con 0x7feec415bc60 2023-06-09T04:41:01.489 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.484+0000 7feec957a700 1 -- 172.21.15.62:0/200231007 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feebc00bb20 con 0x7feec415bc60 2023-06-09T04:41:01.489 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.484+0000 7feec957a700 1 -- 172.21.15.62:0/200231007 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feebc012430 con 0x7feec415bc60 2023-06-09T04:41:01.489 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.484+0000 7feecb57e700 1 -- 172.21.15.62:0/200231007 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feec415bc60 msgr2=0x7feec415c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:01.489 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.484+0000 7feecb57e700 1 --2- 172.21.15.62:0/200231007 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feec415bc60 0x7feec415c0e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7feebc009dc0 tx=0x7feebc00b330 comp rx=0 tx=0).stop 2023-06-09T04:41:01.489 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.484+0000 7feecb57e700 1 -- 172.21.15.62:0/200231007 shutdown_connections 2023-06-09T04:41:01.490 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.484+0000 7feecb57e700 1 --2- 172.21.15.62:0/200231007 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feec415bc60 0x7feec415c0e0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:01.490 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.484+0000 7feecb57e700 1 -- 172.21.15.62:0/200231007 >> 172.21.15.62:0/200231007 conn(0x7feec40cf500 msgr2=0x7feec40cb330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:01.490 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.484+0000 7feecb57e700 1 -- 172.21.15.62:0/200231007 shutdown_connections 2023-06-09T04:41:01.490 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.484+0000 7feecb57e700 1 -- 172.21.15.62:0/200231007 wait complete. 2023-06-09T04:41:01.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.488+0000 7feecb57e700 1 Processor -- start 2023-06-09T04:41:01.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.488+0000 7feecb57e700 1 -- start start 2023-06-09T04:41:01.492 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.488+0000 7feecb57e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feec40653e0 0x7feec40b1a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:01.492 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.488+0000 7feecb57e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feec40657b0 0x7feec4156ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:01.493 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.488+0000 7feecb57e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feec415bc60 0x7feec4157620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:01.493 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.488+0000 7feecb57e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec4158150 con 0x7feec415bc60 2023-06-09T04:41:01.493 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.488+0000 7feecb57e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec4157e70 con 0x7feec40657b0 2023-06-09T04:41:01.493 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.488+0000 7feecb57e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feec41563c0 con 0x7feec40653e0 2023-06-09T04:41:01.494 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.488+0000 7feecad7d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feec415bc60 0x7feec4157620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:01.494 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.488+0000 7feecad7d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feec415bc60 0x7feec4157620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:41110/0 (socket says 172.21.15.62:41110) 2023-06-09T04:41:01.494 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.488+0000 7feecad7d700 1 -- 172.21.15.62:0/1626124136 learned_addr learned my addr 172.21.15.62:0/1626124136 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:01.495 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.488+0000 7feec9d7b700 1 --2- 172.21.15.62:0/1626124136 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feec40657b0 0x7feec4156ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:01.495 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.488+0000 7feeca57c700 1 --2- 172.21.15.62:0/1626124136 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feec40653e0 0x7feec40b1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:01.495 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.488+0000 7feecad7d700 1 -- 172.21.15.62:0/1626124136 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feec40653e0 msgr2=0x7feec40b1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:01.495 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.488+0000 7feecad7d700 1 --2- 172.21.15.62:0/1626124136 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feec40653e0 0x7feec40b1a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:01.495 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.488+0000 7feecad7d700 1 -- 172.21.15.62:0/1626124136 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feec40657b0 msgr2=0x7feec4156ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:01.495 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.488+0000 7feecad7d700 1 --2- 172.21.15.62:0/1626124136 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feec40657b0 0x7feec4156ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:01.495 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.488+0000 7feecad7d700 1 -- 172.21.15.62:0/1626124136 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feebc009a70 con 0x7feec415bc60 2023-06-09T04:41:01.495 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.488+0000 7feec9d7b700 1 --2- 172.21.15.62:0/1626124136 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feec40657b0 0x7feec4156ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:41:01.496 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.488+0000 7feecad7d700 1 --2- 172.21.15.62:0/1626124136 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feec415bc60 0x7feec4157620 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7feebc00b370 tx=0x7feebc004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:01.496 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.488+0000 7feebaffd700 1 -- 172.21.15.62:0/1626124136 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feebc01b810 con 0x7feec415bc60 2023-06-09T04:41:01.496 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.488+0000 7feebaffd700 1 -- 172.21.15.62:0/1626124136 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feebc020070 con 0x7feec415bc60 2023-06-09T04:41:01.497 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.488+0000 7feecb57e700 1 -- 172.21.15.62:0/1626124136 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feec41566a0 con 0x7feec415bc60 2023-06-09T04:41:01.497 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.488+0000 7feebaffd700 1 -- 172.21.15.62:0/1626124136 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feebc01bbf0 con 0x7feec415bc60 2023-06-09T04:41:01.497 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.492+0000 7feecb57e700 1 -- 172.21.15.62:0/1626124136 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feec4157b60 con 0x7feec415bc60 2023-06-09T04:41:01.497 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.492+0000 7feecb57e700 1 -- 172.21.15.62:0/1626124136 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feec4156bc0 con 0x7feec415bc60 2023-06-09T04:41:01.498 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.492+0000 7feebaffd700 1 -- 172.21.15.62:0/1626124136 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7feebc01bd50 con 0x7feec415bc60 2023-06-09T04:41:01.499 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.496+0000 7feebaffd700 1 --2- 172.21.15.62:0/1626124136 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7feea8066320 0x7feea80687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:01.500 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.496+0000 7feebaffd700 1 -- 172.21.15.62:0/1626124136 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7feebc022070 con 0x7feec415bc60 2023-06-09T04:41:01.500 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.496+0000 7feeca57c700 1 --2- 172.21.15.62:0/1626124136 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7feea8066320 0x7feea80687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:01.501 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.496+0000 7feeca57c700 1 --2- 172.21.15.62:0/1626124136 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7feea8066320 0x7feea80687d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7feec00011e0 tx=0x7feec0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:01.506 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.500+0000 7feebaffd700 1 -- 172.21.15.62:0/1626124136 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7feec4156bc0 con 0x7feec415bc60 2023-06-09T04:41:01.717 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.712+0000 7feecb57e700 1 -- 172.21.15.62:0/1626124136 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feec4156bc0 con 0x7feec415bc60 2023-06-09T04:41:01.718 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.712+0000 7feebaffd700 1 -- 172.21.15.62:0/1626124136 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4664 (secure 0 0 0) 0x7feec4156bc0 con 0x7feec415bc60 2023-06-09T04:41:01.719 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:41:01.719 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4256,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/2242182358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2242182358},{"type":"v1","addr":"172.21.15.89:6836","nonce":2242182358}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6834/326702802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":326702802},{"type":"v1","addr":"172.21.15.62:6834","nonce":326702802}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4296,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/3851882562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":3851882562},{"type":"v1","addr":"172.21.15.62:6835","nonce":3851882562}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-09T04:40:56.758756+0000","modified":"2023-06-09T04:41:01.272405+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4312},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4312":{"gid":4312,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6837/1496954959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1496954959},{"type":"v1","addr":"172.21.15.89:6837","nonce":1496954959}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-06-09T04:41:01.721 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.716+0000 7feecb57e700 1 -- 172.21.15.62:0/1626124136 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7feea8066320 msgr2=0x7feea80687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:01.721 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.716+0000 7feecb57e700 1 --2- 172.21.15.62:0/1626124136 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7feea8066320 0x7feea80687d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7feec00011e0 tx=0x7feec0009040 comp rx=0 tx=0).stop 2023-06-09T04:41:01.721 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.716+0000 7feecb57e700 1 -- 172.21.15.62:0/1626124136 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feec415bc60 msgr2=0x7feec4157620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:01.722 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.716+0000 7feecb57e700 1 --2- 172.21.15.62:0/1626124136 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feec415bc60 0x7feec4157620 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7feebc00b370 tx=0x7feebc004af0 comp rx=0 tx=0).stop 2023-06-09T04:41:01.722 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.716+0000 7feecb57e700 1 -- 172.21.15.62:0/1626124136 shutdown_connections 2023-06-09T04:41:01.722 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.716+0000 7feecb57e700 1 --2- 172.21.15.62:0/1626124136 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7feea8066320 0x7feea80687d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:01.722 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.716+0000 7feecb57e700 1 --2- 172.21.15.62:0/1626124136 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7feec415bc60 0x7feec4157620 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:01.723 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.716+0000 7feecb57e700 1 --2- 172.21.15.62:0/1626124136 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feec40657b0 0x7feec4156ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:01.723 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.716+0000 7feecb57e700 1 --2- 172.21.15.62:0/1626124136 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7feec40653e0 0x7feec40b1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:01.723 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.716+0000 7feecb57e700 1 -- 172.21.15.62:0/1626124136 >> 172.21.15.62:0/1626124136 conn(0x7feec40cf500 msgr2=0x7feec415aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:01.723 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.716+0000 7feecb57e700 1 -- 172.21.15.62:0/1626124136 shutdown_connections 2023-06-09T04:41:01.723 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.716+0000 7feecb57e700 1 -- 172.21.15.62:0/1626124136 wait complete. 2023-06-09T04:41:01.724 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 7 2023-06-09T04:41:01.744 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:41:01.921 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.916+0000 7fe14d5c1700 1 Processor -- start 2023-06-09T04:41:01.921 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.916+0000 7fe14d5c1700 1 -- start start 2023-06-09T04:41:01.924 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.920+0000 7fe14d5c1700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe148159910 0x7fe1480c8680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:01.924 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.920+0000 7fe14d5c1700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe1480ad1a0 0x7fe1480ca5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:01.924 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.920+0000 7fe14d5c1700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1480cbf30 con 0x7fe1480cab20 2023-06-09T04:41:01.925 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.920+0000 7fe14d5c1700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe14815d1c0 con 0x7fe1480ad1a0 2023-06-09T04:41:01.925 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.920+0000 7fe14d5c1700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1480cafa0 con 0x7fe148159910 2023-06-09T04:41:01.925 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.920+0000 7fe146ffd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe148159910 0x7fe1480c8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:01.925 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.920+0000 7fe146ffd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe148159910 0x7fe1480c8680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.62:53382/0 (socket says 172.21.15.62:53382) 2023-06-09T04:41:01.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.920+0000 7fe146ffd700 1 -- 172.21.15.62:0/623452110 learned_addr learned my addr 172.21.15.62:0/623452110 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:01.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.920+0000 7fe13e7fc700 1 --2- 172.21.15.62:0/623452110 >> v2:172.21.15.89:3300/0 conn(0x7fe1480ad1a0 0x7fe1480ca5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:01.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.920+0000 7fe146ffd700 1 -- 172.21.15.62:0/623452110 >> v2:172.21.15.89:3300/0 conn(0x7fe1480ad1a0 msgr2=0x7fe1480ca5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:01.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.920+0000 7fe146ffd700 1 --2- 172.21.15.62:0/623452110 >> v2:172.21.15.89:3300/0 conn(0x7fe1480ad1a0 0x7fe1480ca5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:01.927 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.920+0000 7fe146ffd700 1 -- 172.21.15.62:0/623452110 >> v1:172.21.15.89:6789/0 conn(0x7fe1480cab20 legacy=0x7fe14815fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:01.927 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.920+0000 7fe146ffd700 1 -- 172.21.15.62:0/623452110 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe14815c640 con 0x7fe148159910 2023-06-09T04:41:01.927 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.920+0000 7fe146ffd700 1 --2- 172.21.15.62:0/623452110 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe148159910 0x7fe1480c8680 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe138009910 tx=0x7fe138009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4065fa3f4c89dbdd server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:01.927 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.924+0000 7fe1467fc700 1 -- 172.21.15.62:0/623452110 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe138011830 con 0x7fe148159910 2023-06-09T04:41:01.928 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.924+0000 7fe1467fc700 1 -- 172.21.15.62:0/623452110 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe138011990 con 0x7fe148159910 2023-06-09T04:41:01.928 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.924+0000 7fe1467fc700 1 -- 172.21.15.62:0/623452110 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe138011d40 con 0x7fe148159910 2023-06-09T04:41:01.928 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.924+0000 7fe14d5c1700 1 -- 172.21.15.62:0/623452110 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe148159910 msgr2=0x7fe1480c8680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:01.929 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.924+0000 7fe14d5c1700 1 --2- 172.21.15.62:0/623452110 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe148159910 0x7fe1480c8680 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe138009910 tx=0x7fe138009c20 comp rx=0 tx=0).stop 2023-06-09T04:41:01.929 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.924+0000 7fe14d5c1700 1 -- 172.21.15.62:0/623452110 shutdown_connections 2023-06-09T04:41:01.929 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.924+0000 7fe14d5c1700 1 --2- 172.21.15.62:0/623452110 >> v2:172.21.15.89:3300/0 conn(0x7fe1480ad1a0 0x7fe1480ca5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:01.929 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.924+0000 7fe14d5c1700 1 --2- 172.21.15.62:0/623452110 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe148159910 0x7fe1480c8680 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:01.929 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.924+0000 7fe14d5c1700 1 -- 172.21.15.62:0/623452110 >> 172.21.15.62:0/623452110 conn(0x7fe14806a420 msgr2=0x7fe1480afc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:01.929 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.924+0000 7fe14d5c1700 1 -- 172.21.15.62:0/623452110 shutdown_connections 2023-06-09T04:41:01.930 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.924+0000 7fe14d5c1700 1 -- 172.21.15.62:0/623452110 wait complete. 2023-06-09T04:41:01.932 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.928+0000 7fe14d5c1700 1 Processor -- start 2023-06-09T04:41:01.933 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.928+0000 7fe14d5c1700 1 -- start start 2023-06-09T04:41:01.935 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.928+0000 7fe14d5c1700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1480cab20 0x7fe148157dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:01.935 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.932+0000 7fe14d5c1700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe148159910 0x7fe148154c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:01.935 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.932+0000 7fe14d5c1700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe14815d300 0x7fe148070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:01.935 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.932+0000 7fe14d5c1700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe14815e380 con 0x7fe148159910 2023-06-09T04:41:01.935 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.932+0000 7fe14d5c1700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe148155150 con 0x7fe1480cab20 2023-06-09T04:41:01.935 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.932+0000 7fe14d5c1700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe14815dae0 con 0x7fe14815d300 2023-06-09T04:41:01.936 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.932+0000 7fe13e7fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe148159910 0x7fe148154c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:01.937 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.932+0000 7fe13e7fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe148159910 0x7fe148154c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:41118/0 (socket says 172.21.15.62:41118) 2023-06-09T04:41:01.937 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.932+0000 7fe13e7fc700 1 -- 172.21.15.62:0/1870992527 learned_addr learned my addr 172.21.15.62:0/1870992527 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:01.937 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.932+0000 7fe146ffd700 1 --2- 172.21.15.62:0/1870992527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1480cab20 0x7fe148157dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:01.937 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.932+0000 7fe1477fe700 1 --2- 172.21.15.62:0/1870992527 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe14815d300 0x7fe148070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:01.937 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.932+0000 7fe13e7fc700 1 -- 172.21.15.62:0/1870992527 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe14815d300 msgr2=0x7fe148070ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:01.937 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.932+0000 7fe13e7fc700 1 --2- 172.21.15.62:0/1870992527 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe14815d300 0x7fe148070ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:01.937 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.932+0000 7fe13e7fc700 1 -- 172.21.15.62:0/1870992527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1480cab20 msgr2=0x7fe148157dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:01.937 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.932+0000 7fe13e7fc700 1 --2- 172.21.15.62:0/1870992527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1480cab20 0x7fe148157dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:01.938 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.932+0000 7fe13e7fc700 1 -- 172.21.15.62:0/1870992527 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe138009570 con 0x7fe148159910 2023-06-09T04:41:01.938 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.932+0000 7fe13e7fc700 1 --2- 172.21.15.62:0/1870992527 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe148159910 0x7fe148154c10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe13000efc0 tx=0x7fe13000c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:01.938 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.932+0000 7fe13ffff700 1 -- 172.21.15.62:0/1870992527 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13000cb50 con 0x7fe148159910 2023-06-09T04:41:01.938 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.932+0000 7fe13ffff700 1 -- 172.21.15.62:0/1870992527 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe13000f040 con 0x7fe148159910 2023-06-09T04:41:01.939 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.932+0000 7fe14d5c1700 1 -- 172.21.15.62:0/1870992527 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe14815ddc0 con 0x7fe148159910 2023-06-09T04:41:01.939 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.932+0000 7fe13ffff700 1 -- 172.21.15.62:0/1870992527 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe130014480 con 0x7fe148159910 2023-06-09T04:41:01.939 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.932+0000 7fe14d5c1700 1 -- 172.21.15.62:0/1870992527 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1480c5c80 con 0x7fe148159910 2023-06-09T04:41:01.939 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.936+0000 7fe14d5c1700 1 -- 172.21.15.62:0/1870992527 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1480c5ac0 con 0x7fe148159910 2023-06-09T04:41:01.940 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.936+0000 7fe13ffff700 1 -- 172.21.15.62:0/1870992527 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe1300145e0 con 0x7fe148159910 2023-06-09T04:41:01.942 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.936+0000 7fe13ffff700 1 --2- 172.21.15.62:0/1870992527 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fe1280662f0 0x7fe1280687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:01.942 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.936+0000 7fe13ffff700 1 -- 172.21.15.62:0/1870992527 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe130084b40 con 0x7fe148159910 2023-06-09T04:41:01.943 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.940+0000 7fe146ffd700 1 --2- 172.21.15.62:0/1870992527 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fe1280662f0 0x7fe1280687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:01.944 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.940+0000 7fe146ffd700 1 --2- 172.21.15.62:0/1870992527 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fe1280662f0 0x7fe1280687a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe138000c00 tx=0x7fe138008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:01.948 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:01.944+0000 7fe13ffff700 1 -- 172.21.15.62:0/1870992527 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe130051c30 con 0x7fe148159910 2023-06-09T04:41:02.125 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.120+0000 7fe14d5c1700 1 -- 172.21.15.62:0/1870992527 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe14815cbd0 con 0x7fe148159910 2023-06-09T04:41:02.129 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.124+0000 7fe13ffff700 1 -- 172.21.15.62:0/1870992527 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20084 (secure 0 0 0) 0x7fe130055250 con 0x7fe148159910 2023-06-09T04:41:02.129 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:41:02.130 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":28,"fsid":"f7998a1e-e5a9-4202-abaa-70c0eaae1047","created":"2023-06-09T04:40:30.469588+0000","modified":"2023-06-09T04:41:01.271858+0000","last_up_change":"2023-06-09T04:40:43.120747+0000","last_in_change":"2023-06-09T04:40:33.568221+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:40:44.646921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:40:50.006643+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:40:55.031273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:40:55.773517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-09T04:40:58.845383+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bc50bbc0-dd08-42ed-804c-ec3029e36c19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6802","nonce":1295788017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6807","nonce":1295788017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6815","nonce":1295788017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6809","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6811","nonce":1295788017}]},"public_addr":"172.21.15.62:6802/1295788017","cluster_addr":"172.21.15.62:6807/1295788017","heartbeat_back_addr":"172.21.15.62:6815/1295788017","heartbeat_front_addr":"172.21.15.62:6811/1295788017","state":["exists","up"]},{"osd":1,"uuid":"8230b12d-e22f-4985-a584-4cc64404cdbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6825","nonce":4120692006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6827","nonce":4120692006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6831","nonce":4120692006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6829","nonce":4120692006}]},"public_addr":"172.21.15.62:6825/4120692006","cluster_addr":"172.21.15.62:6827/4120692006","heartbeat_back_addr":"172.21.15.62:6831/4120692006","heartbeat_front_addr":"172.21.15.62:6829/4120692006","state":["exists","up"]},{"osd":2,"uuid":"d0202506-dbe9-4e3c-9271-687929abf96a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6801","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6803","nonce":4169607876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6805","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6806","nonce":4169607876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6814","nonce":4169607876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6810","nonce":4169607876}]},"public_addr":"172.21.15.62:6803/4169607876","cluster_addr":"172.21.15.62:6806/4169607876","heartbeat_back_addr":"172.21.15.62:6814/4169607876","heartbeat_front_addr":"172.21.15.62:6810/4169607876","state":["exists","up"]},{"osd":3,"uuid":"f3c0298a-b075-4411-af50-e16cd74fdddb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6817","nonce":3268438986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6819","nonce":3268438986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6823","nonce":3268438986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6821","nonce":3268438986}]},"public_addr":"172.21.15.62:6817/3268438986","cluster_addr":"172.21.15.62:6819/3268438986","heartbeat_back_addr":"172.21.15.62:6823/3268438986","heartbeat_front_addr":"172.21.15.62:6821/3268438986","state":["exists","up"]},{"osd":4,"uuid":"1ab5c5ca-e74f-475a-a309-683cc0029928","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6817","nonce":3139617628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6819","nonce":3139617628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6823","nonce":3139617628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6821","nonce":3139617628}]},"public_addr":"172.21.15.89:6817/3139617628","cluster_addr":"172.21.15.89:6819/3139617628","heartbeat_back_addr":"172.21.15.89:6823/3139617628","heartbeat_front_addr":"172.21.15.89:6821/3139617628","state":["exists","up"]},{"osd":5,"uuid":"a933e184-bd8f-4369-a1ba-a68de53c578c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6825","nonce":2681723596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6827","nonce":2681723596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6831","nonce":2681723596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6829","nonce":2681723596}]},"public_addr":"172.21.15.89:6825/2681723596","cluster_addr":"172.21.15.89:6827/2681723596","heartbeat_back_addr":"172.21.15.89:6831/2681723596","heartbeat_front_addr":"172.21.15.89:6829/2681723596","state":["exists","up"]},{"osd":6,"uuid":"1ed7ad37-2eee-49a6-954c-b537e2b7f0ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6809","nonce":1657136033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6811","nonce":1657136033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6815","nonce":1657136033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6813","nonce":1657136033}]},"public_addr":"172.21.15.89:6809/1657136033","cluster_addr":"172.21.15.89:6811/1657136033","heartbeat_back_addr":"172.21.15.89:6815/1657136033","heartbeat_front_addr":"172.21.15.89:6813/1657136033","state":["exists","up"]},{"osd":7,"uuid":"6ed732e9-33ff-40df-9038-a9f1d1622671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6801","nonce":1710561686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6803","nonce":1710561686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6807","nonce":1710561686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6805","nonce":1710561686}]},"public_addr":"172.21.15.89:6801/1710561686","cluster_addr":"172.21.15.89:6803/1710561686","heartbeat_back_addr":"172.21.15.89:6807/1710561686","heartbeat_front_addr":"172.21.15.89:6805/1710561686","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.335803+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.419788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.179334+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.263310+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.071846+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.375627+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.282277+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.315997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:41:02.134 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.128+0000 7fe14d5c1700 1 -- 172.21.15.62:0/1870992527 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fe1280662f0 msgr2=0x7fe1280687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:02.134 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.128+0000 7fe14d5c1700 1 --2- 172.21.15.62:0/1870992527 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fe1280662f0 0x7fe1280687a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe138000c00 tx=0x7fe138008030 comp rx=0 tx=0).stop 2023-06-09T04:41:02.134 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.128+0000 7fe14d5c1700 1 -- 172.21.15.62:0/1870992527 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe148159910 msgr2=0x7fe148154c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:02.134 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.128+0000 7fe14d5c1700 1 --2- 172.21.15.62:0/1870992527 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe148159910 0x7fe148154c10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe13000efc0 tx=0x7fe13000c0c0 comp rx=0 tx=0).stop 2023-06-09T04:41:02.135 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.128+0000 7fe14d5c1700 1 -- 172.21.15.62:0/1870992527 shutdown_connections 2023-06-09T04:41:02.135 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.128+0000 7fe14d5c1700 1 --2- 172.21.15.62:0/1870992527 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fe1280662f0 0x7fe1280687a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:02.135 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.128+0000 7fe14d5c1700 1 --2- 172.21.15.62:0/1870992527 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe14815d300 0x7fe148070ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:02.135 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.128+0000 7fe14d5c1700 1 --2- 172.21.15.62:0/1870992527 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe148159910 0x7fe148154c10 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:02.135 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.128+0000 7fe14d5c1700 1 --2- 172.21.15.62:0/1870992527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe1480cab20 0x7fe148157dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:02.135 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.128+0000 7fe14d5c1700 1 -- 172.21.15.62:0/1870992527 >> 172.21.15.62:0/1870992527 conn(0x7fe1480ad1a0 msgr2=0x7fe14806b880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:02.136 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.128+0000 7fe14d5c1700 1 -- 172.21.15.62:0/1870992527 shutdown_connections 2023-06-09T04:41:02.136 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.128+0000 7fe14d5c1700 1 -- 172.21.15.62:0/1870992527 wait complete. 2023-06-09T04:41:02.156 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:41:02.332 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.328+0000 7f179b59e700 1 Processor -- start 2023-06-09T04:41:02.332 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.328+0000 7f179b59e700 1 -- start start 2023-06-09T04:41:02.334 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.328+0000 7f179b59e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f179c0ce9c0 0x7f179c0cc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:02.334 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.328+0000 7f179b59e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f179c0d1ac0 0x7f179c0ced90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:02.335 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.328+0000 7f179b59e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f179c0b51e0 con 0x7f179c0ccf20 2023-06-09T04:41:02.335 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.328+0000 7f179b59e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f179c0d0190 con 0x7f179c0ce9c0 2023-06-09T04:41:02.335 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.328+0000 7f179b59e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f179c0d29f0 con 0x7f179c0d1ac0 2023-06-09T04:41:02.336 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.332+0000 7f179a59c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f179c0ce9c0 0x7f179c0cc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:02.336 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.332+0000 7f179ad9d700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f179c0ccf20 0x7f179c0d0620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:38548/0 (socket says 172.21.15.62:38548) 2023-06-09T04:41:02.336 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.332+0000 7f179ad9d700 1 -- 172.21.15.62:0/1109517615 learned_addr learned my addr 172.21.15.62:0/1109517615 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:41:02.336 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.332+0000 7f1799d9b700 1 --2- 172.21.15.62:0/1109517615 >> v2:172.21.15.89:3300/0 conn(0x7f179c0d1ac0 0x7f179c0ced90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:02.337 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.332+0000 7f179a59c700 1 -- 172.21.15.62:0/1109517615 >> v2:172.21.15.89:3300/0 conn(0x7f179c0d1ac0 msgr2=0x7f179c0ced90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:02.337 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.332+0000 7f179a59c700 1 --2- 172.21.15.62:0/1109517615 >> v2:172.21.15.89:3300/0 conn(0x7f179c0d1ac0 0x7f179c0ced90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:02.337 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.332+0000 7f179a59c700 1 -- 172.21.15.62:0/1109517615 >> v1:172.21.15.62:6789/0 conn(0x7f179c0ccf20 legacy=0x7f179c0d0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:02.337 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.332+0000 7f179a59c700 1 -- 172.21.15.62:0/1109517615 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f179c0d2cd0 con 0x7f179c0ce9c0 2023-06-09T04:41:02.337 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.332+0000 7f179959a700 1 -- 172.21.15.62:0/1109517615 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3074801866 0 0) 0x7f179c0b51e0 con 0x7f179c0ccf20 2023-06-09T04:41:02.337 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.332+0000 7f179a59c700 1 --2- 172.21.15.62:0/1109517615 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f179c0ce9c0 0x7f179c0cc9e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f179c0b1dc0 tx=0x7f178c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46097e639a6cc1b3 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:02.338 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.332+0000 7f179959a700 1 -- 172.21.15.62:0/1109517615 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f178c011830 con 0x7f179c0ce9c0 2023-06-09T04:41:02.338 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.332+0000 7f179959a700 1 -- 172.21.15.62:0/1109517615 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f178c011990 con 0x7f179c0ce9c0 2023-06-09T04:41:02.338 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.332+0000 7f179959a700 1 -- 172.21.15.62:0/1109517615 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f178c011d20 con 0x7f179c0ce9c0 2023-06-09T04:41:02.339 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.332+0000 7f179b59e700 1 -- 172.21.15.62:0/1109517615 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f179c0ce9c0 msgr2=0x7f179c0cc9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:02.339 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.332+0000 7f179b59e700 1 --2- 172.21.15.62:0/1109517615 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f179c0ce9c0 0x7f179c0cc9e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f179c0b1dc0 tx=0x7f178c009b30 comp rx=0 tx=0).stop 2023-06-09T04:41:02.339 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.332+0000 7f179b59e700 1 -- 172.21.15.62:0/1109517615 shutdown_connections 2023-06-09T04:41:02.339 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.332+0000 7f179b59e700 1 --2- 172.21.15.62:0/1109517615 >> v2:172.21.15.89:3300/0 conn(0x7f179c0d1ac0 0x7f179c0ced90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:02.339 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.332+0000 7f179b59e700 1 --2- 172.21.15.62:0/1109517615 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f179c0ce9c0 0x7f179c0cc9e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:02.340 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.332+0000 7f179b59e700 1 -- 172.21.15.62:0/1109517615 >> 172.21.15.62:0/1109517615 conn(0x7f179c070f20 msgr2=0x7f179c0712f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:02.340 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.332+0000 7f179b59e700 1 -- 172.21.15.62:0/1109517615 shutdown_connections 2023-06-09T04:41:02.340 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.332+0000 7f179b59e700 1 -- 172.21.15.62:0/1109517615 wait complete. 2023-06-09T04:41:02.341 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.336+0000 7f179b59e700 1 Processor -- start 2023-06-09T04:41:02.341 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.336+0000 7f179b59e700 1 -- start start 2023-06-09T04:41:02.342 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.336+0000 7f179b59e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f179c0ce9c0 0x7f179c158c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:02.342 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.336+0000 7f179b59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f179c1f1400 0x7f179c0b5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:02.343 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.336+0000 7f179b59e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f179c0c5ea0 0x7f179c0c6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:02.343 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.336+0000 7f179b59e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f179c0c6860 con 0x7f179c1f1400 2023-06-09T04:41:02.343 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.336+0000 7f179b59e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f179c0b7770 con 0x7f179c0c5ea0 2023-06-09T04:41:02.343 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.336+0000 7f179b59e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f179c0b66d0 con 0x7f179c0ce9c0 2023-06-09T04:41:02.344 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.340+0000 7f1799d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f179c1f1400 0x7f179c0b5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:02.344 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.340+0000 7f1799d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f179c1f1400 0x7f179c0b5dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:41134/0 (socket says 172.21.15.62:41134) 2023-06-09T04:41:02.344 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.340+0000 7f1799d9b700 1 -- 172.21.15.62:0/3021695490 learned_addr learned my addr 172.21.15.62:0/3021695490 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:02.345 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.340+0000 7f179a59c700 1 --2- 172.21.15.62:0/3021695490 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f179c0ce9c0 0x7f179c158c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:02.345 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.340+0000 7f179ad9d700 1 --2- 172.21.15.62:0/3021695490 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f179c0c5ea0 0x7f179c0c6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:02.345 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.340+0000 7f1799d9b700 1 -- 172.21.15.62:0/3021695490 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f179c0ce9c0 msgr2=0x7f179c158c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:02.345 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.340+0000 7f1799d9b700 1 --2- 172.21.15.62:0/3021695490 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f179c0ce9c0 0x7f179c158c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:02.345 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.340+0000 7f1799d9b700 1 -- 172.21.15.62:0/3021695490 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f179c0c5ea0 msgr2=0x7f179c0c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:02.346 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.340+0000 7f1799d9b700 1 --2- 172.21.15.62:0/3021695490 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f179c0c5ea0 0x7f179c0c6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:02.346 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.340+0000 7f1799d9b700 1 -- 172.21.15.62:0/3021695490 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f178c0094b0 con 0x7f179c1f1400 2023-06-09T04:41:02.346 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.340+0000 7f179ad9d700 1 --2- 172.21.15.62:0/3021695490 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f179c0c5ea0 0x7f179c0c6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:41:02.346 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.340+0000 7f1799d9b700 1 --2- 172.21.15.62:0/3021695490 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f179c1f1400 0x7f179c0b5dd0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f179000e9d0 tx=0x7f179000ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:02.346 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.340+0000 7f178affd700 1 -- 172.21.15.62:0/3021695490 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1790009720 con 0x7f179c1f1400 2023-06-09T04:41:02.346 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.340+0000 7f179b59e700 1 -- 172.21.15.62:0/3021695490 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f179c0b69b0 con 0x7f179c1f1400 2023-06-09T04:41:02.346 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.340+0000 7f178affd700 1 -- 172.21.15.62:0/3021695490 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f179000c7f0 con 0x7f179c1f1400 2023-06-09T04:41:02.347 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.340+0000 7f178affd700 1 -- 172.21.15.62:0/3021695490 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f179000cb60 con 0x7f179c1f1400 2023-06-09T04:41:02.347 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.340+0000 7f179b59e700 1 -- 172.21.15.62:0/3021695490 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f179c0b6f70 con 0x7f179c1f1400 2023-06-09T04:41:02.347 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.340+0000 7f179b59e700 1 -- 172.21.15.62:0/3021695490 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f179c0cf6c0 con 0x7f179c1f1400 2023-06-09T04:41:02.347 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.344+0000 7f178affd700 1 -- 172.21.15.62:0/3021695490 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f179000ccc0 con 0x7f179c1f1400 2023-06-09T04:41:02.349 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.344+0000 7f178affd700 1 --2- 172.21.15.62:0/3021695490 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f177c0662f0 0x7f177c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:02.349 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.344+0000 7f178affd700 1 -- 172.21.15.62:0/3021695490 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f17900840c0 con 0x7f179c1f1400 2023-06-09T04:41:02.349 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.344+0000 7f179a59c700 1 --2- 172.21.15.62:0/3021695490 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f177c0662f0 0x7f177c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:02.350 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.344+0000 7f179a59c700 1 --2- 172.21.15.62:0/3021695490 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f177c0662f0 0x7f177c0687a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f178c009fd0 tx=0x7f178c008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:02.356 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.352+0000 7f178affd700 1 -- 172.21.15.62:0/3021695490 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1790054d70 con 0x7f179c1f1400 2023-06-09T04:41:02.431 INFO:tasks.ceph.mds.d.smithi089.stderr:2023-06-09T04:41:02.429+0000 7f0643603700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-06-09T04:41:02.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.528+0000 7f179b59e700 1 -- 172.21.15.62:0/3021695490 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f179c0739c0 con 0x7f179c1f1400 2023-06-09T04:41:02.536 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.532+0000 7f178affd700 1 -- 172.21.15.62:0/3021695490 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20084 (secure 0 0 0) 0x7f1790054900 con 0x7f179c1f1400 2023-06-09T04:41:02.537 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:41:02.537 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":28,"fsid":"f7998a1e-e5a9-4202-abaa-70c0eaae1047","created":"2023-06-09T04:40:30.469588+0000","modified":"2023-06-09T04:41:01.271858+0000","last_up_change":"2023-06-09T04:40:43.120747+0000","last_in_change":"2023-06-09T04:40:33.568221+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:40:44.646921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:40:50.006643+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:40:55.031273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:40:55.773517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-09T04:40:58.845383+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bc50bbc0-dd08-42ed-804c-ec3029e36c19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6802","nonce":1295788017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6807","nonce":1295788017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6815","nonce":1295788017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6809","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6811","nonce":1295788017}]},"public_addr":"172.21.15.62:6802/1295788017","cluster_addr":"172.21.15.62:6807/1295788017","heartbeat_back_addr":"172.21.15.62:6815/1295788017","heartbeat_front_addr":"172.21.15.62:6811/1295788017","state":["exists","up"]},{"osd":1,"uuid":"8230b12d-e22f-4985-a584-4cc64404cdbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6825","nonce":4120692006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6827","nonce":4120692006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6831","nonce":4120692006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6829","nonce":4120692006}]},"public_addr":"172.21.15.62:6825/4120692006","cluster_addr":"172.21.15.62:6827/4120692006","heartbeat_back_addr":"172.21.15.62:6831/4120692006","heartbeat_front_addr":"172.21.15.62:6829/4120692006","state":["exists","up"]},{"osd":2,"uuid":"d0202506-dbe9-4e3c-9271-687929abf96a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6801","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6803","nonce":4169607876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6805","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6806","nonce":4169607876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6814","nonce":4169607876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6810","nonce":4169607876}]},"public_addr":"172.21.15.62:6803/4169607876","cluster_addr":"172.21.15.62:6806/4169607876","heartbeat_back_addr":"172.21.15.62:6814/4169607876","heartbeat_front_addr":"172.21.15.62:6810/4169607876","state":["exists","up"]},{"osd":3,"uuid":"f3c0298a-b075-4411-af50-e16cd74fdddb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6817","nonce":3268438986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6819","nonce":3268438986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6823","nonce":3268438986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6821","nonce":3268438986}]},"public_addr":"172.21.15.62:6817/3268438986","cluster_addr":"172.21.15.62:6819/3268438986","heartbeat_back_addr":"172.21.15.62:6823/3268438986","heartbeat_front_addr":"172.21.15.62:6821/3268438986","state":["exists","up"]},{"osd":4,"uuid":"1ab5c5ca-e74f-475a-a309-683cc0029928","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6817","nonce":3139617628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6819","nonce":3139617628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6823","nonce":3139617628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6821","nonce":3139617628}]},"public_addr":"172.21.15.89:6817/3139617628","cluster_addr":"172.21.15.89:6819/3139617628","heartbeat_back_addr":"172.21.15.89:6823/3139617628","heartbeat_front_addr":"172.21.15.89:6821/3139617628","state":["exists","up"]},{"osd":5,"uuid":"a933e184-bd8f-4369-a1ba-a68de53c578c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6825","nonce":2681723596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6827","nonce":2681723596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6831","nonce":2681723596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6829","nonce":2681723596}]},"public_addr":"172.21.15.89:6825/2681723596","cluster_addr":"172.21.15.89:6827/2681723596","heartbeat_back_addr":"172.21.15.89:6831/2681723596","heartbeat_front_addr":"172.21.15.89:6829/2681723596","state":["exists","up"]},{"osd":6,"uuid":"1ed7ad37-2eee-49a6-954c-b537e2b7f0ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6809","nonce":1657136033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6811","nonce":1657136033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6815","nonce":1657136033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6813","nonce":1657136033}]},"public_addr":"172.21.15.89:6809/1657136033","cluster_addr":"172.21.15.89:6811/1657136033","heartbeat_back_addr":"172.21.15.89:6815/1657136033","heartbeat_front_addr":"172.21.15.89:6813/1657136033","state":["exists","up"]},{"osd":7,"uuid":"6ed732e9-33ff-40df-9038-a9f1d1622671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6801","nonce":1710561686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6803","nonce":1710561686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6807","nonce":1710561686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6805","nonce":1710561686}]},"public_addr":"172.21.15.89:6801/1710561686","cluster_addr":"172.21.15.89:6803/1710561686","heartbeat_back_addr":"172.21.15.89:6807/1710561686","heartbeat_front_addr":"172.21.15.89:6805/1710561686","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.335803+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.419788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.179334+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.263310+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.071846+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.375627+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.282277+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.315997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:41:02.539 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.536+0000 7f179b59e700 1 -- 172.21.15.62:0/3021695490 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f177c0662f0 msgr2=0x7f177c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:02.540 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.536+0000 7f179b59e700 1 --2- 172.21.15.62:0/3021695490 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f177c0662f0 0x7f177c0687a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f178c009fd0 tx=0x7f178c008030 comp rx=0 tx=0).stop 2023-06-09T04:41:02.540 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.536+0000 7f179b59e700 1 -- 172.21.15.62:0/3021695490 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f179c1f1400 msgr2=0x7f179c0b5dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:02.540 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.536+0000 7f179b59e700 1 --2- 172.21.15.62:0/3021695490 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f179c1f1400 0x7f179c0b5dd0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f179000e9d0 tx=0x7f179000ed90 comp rx=0 tx=0).stop 2023-06-09T04:41:02.540 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.536+0000 7f179b59e700 1 -- 172.21.15.62:0/3021695490 shutdown_connections 2023-06-09T04:41:02.540 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.536+0000 7f179b59e700 1 --2- 172.21.15.62:0/3021695490 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f177c0662f0 0x7f177c0687a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:02.540 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.536+0000 7f179b59e700 1 --2- 172.21.15.62:0/3021695490 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f179c0c5ea0 0x7f179c0c6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:02.541 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.536+0000 7f179b59e700 1 --2- 172.21.15.62:0/3021695490 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f179c1f1400 0x7f179c0b5dd0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:02.541 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.536+0000 7f179b59e700 1 --2- 172.21.15.62:0/3021695490 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f179c0ce9c0 0x7f179c158c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:02.541 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.536+0000 7f179b59e700 1 -- 172.21.15.62:0/3021695490 >> 172.21.15.62:0/3021695490 conn(0x7f179c070f20 msgr2=0x7f179c072220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:02.541 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.536+0000 7f179b59e700 1 -- 172.21.15.62:0/3021695490 shutdown_connections 2023-06-09T04:41:02.541 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.536+0000 7f179b59e700 1 -- 172.21.15.62:0/3021695490 wait complete. 2023-06-09T04:41:02.577 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-09T04:41:02.753 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.748+0000 7fc705276700 1 Processor -- start 2023-06-09T04:41:02.753 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.748+0000 7fc705276700 1 -- start start 2023-06-09T04:41:02.754 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.748+0000 7fc705276700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc7000b1b40 0x7fc7000cc420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:02.754 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.748+0000 7fc705276700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc7000697f0 0x7fc7000cc960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:02.754 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.748+0000 7fc705276700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7000cbf90 con 0x7fc700159d30 2023-06-09T04:41:02.754 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.748+0000 7fc705276700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7000b2420 con 0x7fc7000697f0 2023-06-09T04:41:02.755 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.748+0000 7fc705276700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7000cb6a0 con 0x7fc7000b1b40 2023-06-09T04:41:02.755 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.748+0000 7fc6feffd700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fc700159d30 0x7fc7000b1430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:38564/0 (socket says 172.21.15.62:38564) 2023-06-09T04:41:02.755 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.748+0000 7fc6feffd700 1 -- 172.21.15.62:0/3915716681 learned_addr learned my addr 172.21.15.62:0/3915716681 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:41:02.755 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.752+0000 7fc6fffff700 1 --2- 172.21.15.62:0/3915716681 >> v2:172.21.15.89:3300/0 conn(0x7fc7000697f0 0x7fc7000cc960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:02.756 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.752+0000 7fc6fe7fc700 1 --2- 172.21.15.62:0/3915716681 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc7000b1b40 0x7fc7000cc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:02.756 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.752+0000 7fc6fdffb700 1 -- 172.21.15.62:0/3915716681 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2588962605 0 0) 0x7fc7000cbf90 con 0x7fc700159d30 2023-06-09T04:41:02.756 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.752+0000 7fc6fdffb700 1 -- 172.21.15.62:0/3915716681 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6e80035d0 con 0x7fc700159d30 2023-06-09T04:41:02.757 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.752+0000 7fc6fdffb700 1 -- 172.21.15.62:0/3915716681 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2286669910 0 0) 0x7fc6e80035d0 con 0x7fc700159d30 2023-06-09T04:41:02.757 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.752+0000 7fc6fdffb700 1 -- 172.21.15.62:0/3915716681 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc7000b1b40 msgr2=0x7fc7000cc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:02.757 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.752+0000 7fc6fdffb700 1 --2- 172.21.15.62:0/3915716681 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc7000b1b40 0x7fc7000cc420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:02.757 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.752+0000 7fc6fdffb700 1 -- 172.21.15.62:0/3915716681 >> v2:172.21.15.89:3300/0 conn(0x7fc7000697f0 msgr2=0x7fc7000cc960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:02.758 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.752+0000 7fc6fdffb700 1 --2- 172.21.15.62:0/3915716681 >> v2:172.21.15.89:3300/0 conn(0x7fc7000697f0 0x7fc7000cc960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:02.758 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.752+0000 7fc6fdffb700 1 -- 172.21.15.62:0/3915716681 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7000aeb70 con 0x7fc700159d30 2023-06-09T04:41:02.758 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.752+0000 7fc6fdffb700 1 -- 172.21.15.62:0/3915716681 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 540845019 0 0) 0x7fc6f0001670 con 0x7fc700159d30 2023-06-09T04:41:02.758 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.752+0000 7fc6fdffb700 1 -- 172.21.15.62:0/3915716681 >> v1:172.21.15.62:6789/0 conn(0x7fc700159d30 legacy=0x7fc7000b1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:02.758 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.752+0000 7fc6fdffb700 1 --2- 172.21.15.62:0/3915716681 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc7000b1b40 0x7fc6e8003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:02.758 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.752+0000 7fc6fdffb700 1 --2- 172.21.15.62:0/3915716681 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6e8003fa0 0x7fc6e8004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:02.758 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.752+0000 7fc6fdffb700 1 --2- 172.21.15.62:0/3915716681 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6e8004db0 0x7fc6e8005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:02.758 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.752+0000 7fc6fdffb700 1 -- 172.21.15.62:0/3915716681 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7000b2420 con 0x7fc6e8003fa0 2023-06-09T04:41:02.759 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.752+0000 7fc6fdffb700 1 -- 172.21.15.62:0/3915716681 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7000cb6a0 con 0x7fc6e8004db0 2023-06-09T04:41:02.759 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.752+0000 7fc6fdffb700 1 -- 172.21.15.62:0/3915716681 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e800ba60 con 0x7fc7000b1b40 2023-06-09T04:41:02.759 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.752+0000 7fc6fffff700 1 --2- 172.21.15.62:0/3915716681 >> v2:172.21.15.89:3300/0 conn(0x7fc7000697f0 0x7fc7000cc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:41:02.759 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.752+0000 7fc6fe7fc700 1 --2- 172.21.15.62:0/3915716681 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6e8003fa0 0x7fc6e8004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:02.759 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.752+0000 7fc6feffd700 1 --2- 172.21.15.62:0/3915716681 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc7000b1b40 0x7fc6e8003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:02.759 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.752+0000 7fc6fffff700 1 --2- 172.21.15.62:0/3915716681 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6e8004db0 0x7fc6e8005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:02.759 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.752+0000 7fc6fe7fc700 1 -- 172.21.15.62:0/3915716681 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc7000b1b40 msgr2=0x7fc6e8003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:02.760 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.752+0000 7fc6fe7fc700 1 --2- 172.21.15.62:0/3915716681 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc7000b1b40 0x7fc6e8003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:02.760 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.752+0000 7fc6fe7fc700 1 -- 172.21.15.62:0/3915716681 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6e8004db0 msgr2=0x7fc6e8005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:02.760 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.752+0000 7fc6fe7fc700 1 --2- 172.21.15.62:0/3915716681 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6e8004db0 0x7fc6e8005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:02.760 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.752+0000 7fc6fe7fc700 1 -- 172.21.15.62:0/3915716681 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e80035d0 con 0x7fc6e8003fa0 2023-06-09T04:41:02.761 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.752+0000 7fc6fe7fc700 1 --2- 172.21.15.62:0/3915716681 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6e8003fa0 0x7fc6e8004870 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc6f4009b40 tx=0x7fc6e80058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b49bc4566a81caf4 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:02.761 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.752+0000 7fc6fdffb700 1 -- 172.21.15.62:0/3915716681 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f400e6c0 con 0x7fc6e8003fa0 2023-06-09T04:41:02.761 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.752+0000 7fc6fdffb700 1 -- 172.21.15.62:0/3915716681 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6f400e820 con 0x7fc6e8003fa0 2023-06-09T04:41:02.761 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.752+0000 7fc6fdffb700 1 -- 172.21.15.62:0/3915716681 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f400eb90 con 0x7fc6e8003fa0 2023-06-09T04:41:02.761 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.756+0000 7fc705276700 1 -- 172.21.15.62:0/3915716681 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6e8003fa0 msgr2=0x7fc6e8004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:02.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.756+0000 7fc705276700 1 --2- 172.21.15.62:0/3915716681 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6e8003fa0 0x7fc6e8004870 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc6f4009b40 tx=0x7fc6e80058a0 comp rx=0 tx=0).stop 2023-06-09T04:41:02.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.756+0000 7fc6fffff700 1 -- 172.21.15.62:0/3915716681 reap_dead start 2023-06-09T04:41:02.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.756+0000 7fc705276700 1 -- 172.21.15.62:0/3915716681 shutdown_connections 2023-06-09T04:41:02.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.756+0000 7fc705276700 1 -- 172.21.15.62:0/3915716681 >> 172.21.15.62:0/3915716681 conn(0x7fc70006cf70 msgr2=0x7fc70006d370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:02.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.756+0000 7fc705276700 1 -- 172.21.15.62:0/3915716681 shutdown_connections 2023-06-09T04:41:02.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.756+0000 7fc705276700 1 -- 172.21.15.62:0/3915716681 wait complete. 2023-06-09T04:41:02.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.760+0000 7fc705276700 1 Processor -- start 2023-06-09T04:41:02.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.760+0000 7fc705276700 1 -- start start 2023-06-09T04:41:02.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.760+0000 7fc705276700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6e8003fa0 0x7fc7000acd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:02.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.760+0000 7fc705276700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7000ad8a0 0x7fc7000adcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:02.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.760+0000 7fc705276700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc700150cf0 0x7fc700151160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:02.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.760+0000 7fc705276700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7000b27e0 con 0x7fc7000ad8a0 2023-06-09T04:41:02.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.760+0000 7fc705276700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7000b2ac0 con 0x7fc6e8003fa0 2023-06-09T04:41:02.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.760+0000 7fc705276700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7000b2da0 con 0x7fc700150cf0 2023-06-09T04:41:02.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.760+0000 7fc6fe7fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7000ad8a0 0x7fc7000adcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:02.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.760+0000 7fc6fe7fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7000ad8a0 0x7fc7000adcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:41150/0 (socket says 172.21.15.62:41150) 2023-06-09T04:41:02.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.760+0000 7fc6fe7fc700 1 -- 172.21.15.62:0/2227780877 learned_addr learned my addr 172.21.15.62:0/2227780877 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:02.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.760+0000 7fc6fffff700 1 --2- 172.21.15.62:0/2227780877 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc700150cf0 0x7fc700151160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:02.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.760+0000 7fc6feffd700 1 --2- 172.21.15.62:0/2227780877 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6e8003fa0 0x7fc7000acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:02.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.760+0000 7fc6fe7fc700 1 -- 172.21.15.62:0/2227780877 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc700150cf0 msgr2=0x7fc700151160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:02.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.760+0000 7fc6fe7fc700 1 --2- 172.21.15.62:0/2227780877 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc700150cf0 0x7fc700151160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:02.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.760+0000 7fc6fe7fc700 1 -- 172.21.15.62:0/2227780877 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6e8003fa0 msgr2=0x7fc7000acd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:02.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.760+0000 7fc6fe7fc700 1 --2- 172.21.15.62:0/2227780877 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6e8003fa0 0x7fc7000acd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:02.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.760+0000 7fc6fe7fc700 1 -- 172.21.15.62:0/2227780877 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7000b3080 con 0x7fc7000ad8a0 2023-06-09T04:41:02.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.760+0000 7fc6fe7fc700 1 --2- 172.21.15.62:0/2227780877 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7000ad8a0 0x7fc7000adcd0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc6e8004780 tx=0x7fc6f40047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:02.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.760+0000 7fc6e77fe700 1 -- 172.21.15.62:0/2227780877 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f400e6c0 con 0x7fc7000ad8a0 2023-06-09T04:41:02.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.760+0000 7fc6e77fe700 1 -- 172.21.15.62:0/2227780877 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6f4013d30 con 0x7fc7000ad8a0 2023-06-09T04:41:02.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.760+0000 7fc705276700 1 -- 172.21.15.62:0/2227780877 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7000b3360 con 0x7fc7000ad8a0 2023-06-09T04:41:02.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.760+0000 7fc6e77fe700 1 -- 172.21.15.62:0/2227780877 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f4013ea0 con 0x7fc7000ad8a0 2023-06-09T04:41:02.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.764+0000 7fc705276700 1 -- 172.21.15.62:0/2227780877 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7001516a0 con 0x7fc7000ad8a0 2023-06-09T04:41:02.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.764+0000 7fc705276700 1 -- 172.21.15.62:0/2227780877 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc70004db30 con 0x7fc7000ad8a0 2023-06-09T04:41:02.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.764+0000 7fc6e77fe700 1 -- 172.21.15.62:0/2227780877 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc6f4004270 con 0x7fc7000ad8a0 2023-06-09T04:41:02.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.768+0000 7fc6e77fe700 1 --2- 172.21.15.62:0/2227780877 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fc6ec0662f0 0x7fc6ec0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:02.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.768+0000 7fc6e77fe700 1 -- 172.21.15.62:0/2227780877 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc6f40859f0 con 0x7fc7000ad8a0 2023-06-09T04:41:02.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.768+0000 7fc6feffd700 1 --2- 172.21.15.62:0/2227780877 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fc6ec0662f0 0x7fc6ec0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:02.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.768+0000 7fc6feffd700 1 --2- 172.21.15.62:0/2227780877 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fc6ec0662f0 0x7fc6ec0687a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc6f0000c00 tx=0x7fc6f00079a0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:02.776 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.772+0000 7fc6e77fe700 1 -- 172.21.15.62:0/2227780877 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc6f4052cd0 con 0x7fc7000ad8a0 2023-06-09T04:41:02.984 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.980+0000 7fc705276700 1 -- 172.21.15.62:0/2227780877 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc7000ca690 con 0x7fc7000ad8a0 2023-06-09T04:41:02.985 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.980+0000 7fc6e77fe700 1 -- 172.21.15.62:0/2227780877 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4664 (secure 0 0 0) 0x7fc6f40562f0 con 0x7fc7000ad8a0 2023-06-09T04:41:02.985 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:41:02.986 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4256,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/2242182358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2242182358},{"type":"v1","addr":"172.21.15.89:6836","nonce":2242182358}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6834/326702802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":326702802},{"type":"v1","addr":"172.21.15.62:6834","nonce":326702802}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4296,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/3851882562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":3851882562},{"type":"v1","addr":"172.21.15.62:6835","nonce":3851882562}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-09T04:40:56.758756+0000","modified":"2023-06-09T04:41:01.272405+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4312},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4312":{"gid":4312,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6837/1496954959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1496954959},{"type":"v1","addr":"172.21.15.89:6837","nonce":1496954959}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-06-09T04:41:02.988 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.984+0000 7fc705276700 1 -- 172.21.15.62:0/2227780877 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fc6ec0662f0 msgr2=0x7fc6ec0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:02.988 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.984+0000 7fc705276700 1 --2- 172.21.15.62:0/2227780877 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fc6ec0662f0 0x7fc6ec0687a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc6f0000c00 tx=0x7fc6f00079a0 comp rx=0 tx=0).stop 2023-06-09T04:41:02.988 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.984+0000 7fc705276700 1 -- 172.21.15.62:0/2227780877 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7000ad8a0 msgr2=0x7fc7000adcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:02.988 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.984+0000 7fc705276700 1 --2- 172.21.15.62:0/2227780877 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7000ad8a0 0x7fc7000adcd0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc6e8004780 tx=0x7fc6f40047e0 comp rx=0 tx=0).stop 2023-06-09T04:41:02.989 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.984+0000 7fc705276700 1 -- 172.21.15.62:0/2227780877 shutdown_connections 2023-06-09T04:41:02.989 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.984+0000 7fc705276700 1 --2- 172.21.15.62:0/2227780877 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fc6ec0662f0 0x7fc6ec0687a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:02.989 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.984+0000 7fc705276700 1 --2- 172.21.15.62:0/2227780877 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc700150cf0 0x7fc700151160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:02.989 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.984+0000 7fc705276700 1 --2- 172.21.15.62:0/2227780877 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7000ad8a0 0x7fc7000adcd0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:02.990 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.984+0000 7fc705276700 1 --2- 172.21.15.62:0/2227780877 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6e8003fa0 0x7fc7000acd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:02.990 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.984+0000 7fc705276700 1 -- 172.21.15.62:0/2227780877 >> 172.21.15.62:0/2227780877 conn(0x7fc70006cf70 msgr2=0x7fc7000af3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:02.990 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.984+0000 7fc705276700 1 -- 172.21.15.62:0/2227780877 shutdown_connections 2023-06-09T04:41:02.990 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:02.984+0000 7fc705276700 1 -- 172.21.15.62:0/2227780877 wait complete. 2023-06-09T04:41:02.991 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 7 2023-06-09T04:41:03.011 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:41:03.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:03.180+0000 7fba25ca6700 1 Processor -- start 2023-06-09T04:41:03.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:03.180+0000 7fba25ca6700 1 -- start start 2023-06-09T04:41:03.189 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:03.184+0000 7fba25ca6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fba200ce9c0 0x7fba200cc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:03.189 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:03.184+0000 7fba25ca6700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba200b51e0 con 0x7fba200ccf20 2023-06-09T04:41:03.190 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:03.184+0000 7fba25ca6700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba200d0190 con 0x7fba200d1ac0 2023-06-09T04:41:03.190 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:03.184+0000 7fba25ca6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba200d29f0 con 0x7fba200ce9c0 2023-06-09T04:41:03.190 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:03.184+0000 7fba254a5700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fba200ccf20 0x7fba20165730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:38566/0 (socket says 172.21.15.62:38566) 2023-06-09T04:41:03.190 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:03.184+0000 7fba254a5700 1 -- 172.21.15.62:0/44447146 learned_addr learned my addr 172.21.15.62:0/44447146 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:41:03.191 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:03.184+0000 7fba24ca4700 1 --2- 172.21.15.62:0/44447146 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fba200ce9c0 0x7fba200cc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:03.191 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:03.184+0000 7fba1f7fe700 1 -- 172.21.15.62:0/44447146 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2179481727 0 0) 0x7fba200b51e0 con 0x7fba200ccf20 2023-06-09T04:41:03.191 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:03.188+0000 7fba1f7fe700 1 -- 172.21.15.62:0/44447146 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba100035d0 con 0x7fba200ccf20 2023-06-09T04:41:03.192 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:03.188+0000 7fba1f7fe700 1 -- 172.21.15.62:0/44447146 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3428074868 0 0) 0x7fba200d0190 con 0x7fba200d1ac0 2023-06-09T04:41:03.192 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:03.188+0000 7fba1f7fe700 1 -- 172.21.15.62:0/44447146 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba200b51e0 con 0x7fba200d1ac0 2023-06-09T04:41:03.192 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:03.188+0000 7fba24ca4700 1 -- 172.21.15.62:0/44447146 >> v1:172.21.15.89:6789/0 conn(0x7fba200d1ac0 legacy=0x7fba200ced90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:03.192 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:03.188+0000 7fba24ca4700 1 -- 172.21.15.62:0/44447146 >> v1:172.21.15.62:6789/0 conn(0x7fba200ccf20 legacy=0x7fba20165730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:03.192 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:03.188+0000 7fba24ca4700 1 -- 172.21.15.62:0/44447146 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba200d2cd0 con 0x7fba200ce9c0 2023-06-09T04:41:03.193 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:03.188+0000 7fba24ca4700 1 --2- 172.21.15.62:0/44447146 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fba200ce9c0 0x7fba200cc9e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fba14009880 tx=0x7fba14009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39c48ac245d26247 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:03.193 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:03.188+0000 7fba1f7fe700 1 -- 172.21.15.62:0/44447146 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba14011830 con 0x7fba200ce9c0 2023-06-09T04:41:03.193 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:03.188+0000 7fba1f7fe700 1 -- 172.21.15.62:0/44447146 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba14011990 con 0x7fba200ce9c0 2023-06-09T04:41:03.193 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:03.188+0000 7fba1f7fe700 1 -- 172.21.15.62:0/44447146 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba14011d20 con 0x7fba200ce9c0 2023-06-09T04:41:03.194 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:03.188+0000 7fba25ca6700 1 -- 172.21.15.62:0/44447146 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fba200ce9c0 msgr2=0x7fba200cc9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:03.194 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:03.188+0000 7fba25ca6700 1 --2- 172.21.15.62:0/44447146 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fba200ce9c0 0x7fba200cc9e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fba14009880 tx=0x7fba14009b90 comp rx=0 tx=0).stop 2023-06-09T04:41:03.194 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:03.188+0000 7fba25ca6700 1 -- 172.21.15.62:0/44447146 shutdown_connections 2023-06-09T04:41:03.194 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:03.188+0000 7fba25ca6700 1 --2- 172.21.15.62:0/44447146 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fba200ce9c0 0x7fba200cc9e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:03.195 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:03.188+0000 7fba25ca6700 1 -- 172.21.15.62:0/44447146 >> 172.21.15.62:0/44447146 conn(0x7fba20070f20 msgr2=0x7fba200712f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:03.195 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:03.188+0000 7fba25ca6700 1 -- 172.21.15.62:0/44447146 shutdown_connections 2023-06-09T04:41:03.195 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:03.188+0000 7fba25ca6700 1 -- 172.21.15.62:0/44447146 wait complete. 2023-06-09T04:41:03.197 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:03.192+0000 7fba25ca6700 1 Processor -- start 2023-06-09T04:41:03.198 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:03.192+0000 7fba25ca6700 1 -- start start 2023-06-09T04:41:03.200 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:03.196+0000 7fba25ca6700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba200ce9c0 0x7fba201521b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:03.201 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:03.196+0000 7fba25ca6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fba200cb4a0 0x7fba201528e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:03.201 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:03.196+0000 7fba25ca6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba200b6da0 0x7fba200b7220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:03.201 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:03.196+0000 7fba25ca6700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba200c6260 con 0x7fba200b6da0 2023-06-09T04:41:03.201 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:03.196+0000 7fba25ca6700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba200b7760 con 0x7fba200ce9c0 2023-06-09T04:41:03.201 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:03.196+0000 7fba25ca6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba200c9460 con 0x7fba200cb4a0 2023-06-09T04:41:03.202 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:03.196+0000 7fba254a5700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba200b6da0 0x7fba200b7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:03.202 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:03.196+0000 7fba24ca4700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba200ce9c0 0x7fba201521b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:03.202 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:03.196+0000 7fba254a5700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba200b6da0 0x7fba200b7220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:41162/0 (socket says 172.21.15.62:41162) 2023-06-09T04:41:03.202 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:03.196+0000 7fba254a5700 1 -- 172.21.15.62:0/2686739340 learned_addr learned my addr 172.21.15.62:0/2686739340 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:03.203 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:03.196+0000 7fba1ffff700 1 --2- 172.21.15.62:0/2686739340 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fba200cb4a0 0x7fba201528e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:03.203 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:03.196+0000 7fba254a5700 1 -- 172.21.15.62:0/2686739340 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fba200cb4a0 msgr2=0x7fba201528e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:03.203 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:03.196+0000 7fba254a5700 1 --2- 172.21.15.62:0/2686739340 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fba200cb4a0 0x7fba201528e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:03.203 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:03.196+0000 7fba254a5700 1 -- 172.21.15.62:0/2686739340 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba200ce9c0 msgr2=0x7fba201521b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:03.203 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:03.196+0000 7fba254a5700 1 --2- 172.21.15.62:0/2686739340 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba200ce9c0 0x7fba201521b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:03.203 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:03.196+0000 7fba254a5700 1 -- 172.21.15.62:0/2686739340 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba140094b0 con 0x7fba200b6da0 2023-06-09T04:41:03.204 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:03.196+0000 7fba254a5700 1 --2- 172.21.15.62:0/2686739340 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba200b6da0 0x7fba200b7220 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fba1800caa0 tx=0x7fba1800cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:03.204 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:03.200+0000 7fba1d7fa700 1 -- 172.21.15.62:0/2686739340 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba18007480 con 0x7fba200b6da0 2023-06-09T04:41:03.204 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:03.200+0000 7fba1d7fa700 1 -- 172.21.15.62:0/2686739340 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba180075e0 con 0x7fba200b6da0 2023-06-09T04:41:03.204 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:03.200+0000 7fba25ca6700 1 -- 172.21.15.62:0/2686739340 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba201526f0 con 0x7fba200b6da0 2023-06-09T04:41:03.205 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:03.200+0000 7fba1d7fa700 1 -- 172.21.15.62:0/2686739340 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba18007970 con 0x7fba200b6da0 2023-06-09T04:41:03.205 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:03.200+0000 7fba25ca6700 1 -- 172.21.15.62:0/2686739340 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba201531e0 con 0x7fba200b6da0 2023-06-09T04:41:03.205 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:03.200+0000 7fba25ca6700 1 -- 172.21.15.62:0/2686739340 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba200739c0 con 0x7fba200b6da0 2023-06-09T04:41:03.207 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:03.204+0000 7fba1d7fa700 1 -- 172.21.15.62:0/2686739340 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fba1801b3b0 con 0x7fba200b6da0 2023-06-09T04:41:03.208 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:03.204+0000 7fba1d7fa700 1 --2- 172.21.15.62:0/2686739340 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fba04066320 0x7fba040687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:03.209 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:03.204+0000 7fba1d7fa700 1 -- 172.21.15.62:0/2686739340 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fba18083850 con 0x7fba200b6da0 2023-06-09T04:41:03.209 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:03.204+0000 7fba24ca4700 1 --2- 172.21.15.62:0/2686739340 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fba04066320 0x7fba040687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:03.210 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:03.204+0000 7fba24ca4700 1 --2- 172.21.15.62:0/2686739340 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fba04066320 0x7fba040687d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fba140090b0 tx=0x7fba1401c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:03.214 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:03.208+0000 7fba1d7fa700 1 -- 172.21.15.62:0/2686739340 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fba180509d0 con 0x7fba200b6da0 2023-06-09T04:41:03.386 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:03.380+0000 7fba25ca6700 1 -- 172.21.15.62:0/2686739340 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fba200c95a0 con 0x7fba200b6da0 2023-06-09T04:41:03.389 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:03.384+0000 7fba1d7fa700 1 -- 172.21.15.62:0/2686739340 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20084 (secure 0 0 0) 0x7fba18053ff0 con 0x7fba200b6da0 2023-06-09T04:41:03.390 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:41:03.390 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":28,"fsid":"f7998a1e-e5a9-4202-abaa-70c0eaae1047","created":"2023-06-09T04:40:30.469588+0000","modified":"2023-06-09T04:41:01.271858+0000","last_up_change":"2023-06-09T04:40:43.120747+0000","last_in_change":"2023-06-09T04:40:33.568221+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:40:44.646921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:40:50.006643+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:40:55.031273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:40:55.773517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-09T04:40:58.845383+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bc50bbc0-dd08-42ed-804c-ec3029e36c19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6802","nonce":1295788017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6807","nonce":1295788017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6815","nonce":1295788017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6809","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6811","nonce":1295788017}]},"public_addr":"172.21.15.62:6802/1295788017","cluster_addr":"172.21.15.62:6807/1295788017","heartbeat_back_addr":"172.21.15.62:6815/1295788017","heartbeat_front_addr":"172.21.15.62:6811/1295788017","state":["exists","up"]},{"osd":1,"uuid":"8230b12d-e22f-4985-a584-4cc64404cdbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6825","nonce":4120692006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6827","nonce":4120692006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6831","nonce":4120692006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6829","nonce":4120692006}]},"public_addr":"172.21.15.62:6825/4120692006","cluster_addr":"172.21.15.62:6827/4120692006","heartbeat_back_addr":"172.21.15.62:6831/4120692006","heartbeat_front_addr":"172.21.15.62:6829/4120692006","state":["exists","up"]},{"osd":2,"uuid":"d0202506-dbe9-4e3c-9271-687929abf96a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6801","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6803","nonce":4169607876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6805","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6806","nonce":4169607876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6814","nonce":4169607876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6810","nonce":4169607876}]},"public_addr":"172.21.15.62:6803/4169607876","cluster_addr":"172.21.15.62:6806/4169607876","heartbeat_back_addr":"172.21.15.62:6814/4169607876","heartbeat_front_addr":"172.21.15.62:6810/4169607876","state":["exists","up"]},{"osd":3,"uuid":"f3c0298a-b075-4411-af50-e16cd74fdddb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6817","nonce":3268438986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6819","nonce":3268438986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6823","nonce":3268438986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6821","nonce":3268438986}]},"public_addr":"172.21.15.62:6817/3268438986","cluster_addr":"172.21.15.62:6819/3268438986","heartbeat_back_addr":"172.21.15.62:6823/3268438986","heartbeat_front_addr":"172.21.15.62:6821/3268438986","state":["exists","up"]},{"osd":4,"uuid":"1ab5c5ca-e74f-475a-a309-683cc0029928","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6817","nonce":3139617628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6819","nonce":3139617628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6823","nonce":3139617628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6821","nonce":3139617628}]},"public_addr":"172.21.15.89:6817/3139617628","cluster_addr":"172.21.15.89:6819/3139617628","heartbeat_back_addr":"172.21.15.89:6823/3139617628","heartbeat_front_addr":"172.21.15.89:6821/3139617628","state":["exists","up"]},{"osd":5,"uuid":"a933e184-bd8f-4369-a1ba-a68de53c578c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6825","nonce":2681723596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6827","nonce":2681723596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6831","nonce":2681723596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6829","nonce":2681723596}]},"public_addr":"172.21.15.89:6825/2681723596","cluster_addr":"172.21.15.89:6827/2681723596","heartbeat_back_addr":"172.21.15.89:6831/2681723596","heartbeat_front_addr":"172.21.15.89:6829/2681723596","state":["exists","up"]},{"osd":6,"uuid":"1ed7ad37-2eee-49a6-954c-b537e2b7f0ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6809","nonce":1657136033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6811","nonce":1657136033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6815","nonce":1657136033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6813","nonce":1657136033}]},"public_addr":"172.21.15.89:6809/1657136033","cluster_addr":"172.21.15.89:6811/1657136033","heartbeat_back_addr":"172.21.15.89:6815/1657136033","heartbeat_front_addr":"172.21.15.89:6813/1657136033","state":["exists","up"]},{"osd":7,"uuid":"6ed732e9-33ff-40df-9038-a9f1d1622671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6801","nonce":1710561686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6803","nonce":1710561686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6807","nonce":1710561686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6805","nonce":1710561686}]},"public_addr":"172.21.15.89:6801/1710561686","cluster_addr":"172.21.15.89:6803/1710561686","heartbeat_back_addr":"172.21.15.89:6807/1710561686","heartbeat_front_addr":"172.21.15.89:6805/1710561686","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.335803+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.419788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.179334+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.263310+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.071846+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.375627+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.282277+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.315997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:41:03.393 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:03.388+0000 7fba25ca6700 1 -- 172.21.15.62:0/2686739340 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fba04066320 msgr2=0x7fba040687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:03.393 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:03.388+0000 7fba25ca6700 1 --2- 172.21.15.62:0/2686739340 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fba04066320 0x7fba040687d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fba140090b0 tx=0x7fba1401c040 comp rx=0 tx=0).stop 2023-06-09T04:41:03.393 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:03.388+0000 7fba25ca6700 1 -- 172.21.15.62:0/2686739340 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba200b6da0 msgr2=0x7fba200b7220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:03.393 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:03.388+0000 7fba25ca6700 1 --2- 172.21.15.62:0/2686739340 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba200b6da0 0x7fba200b7220 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fba1800caa0 tx=0x7fba1800cad0 comp rx=0 tx=0).stop 2023-06-09T04:41:03.394 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:03.388+0000 7fba25ca6700 1 -- 172.21.15.62:0/2686739340 shutdown_connections 2023-06-09T04:41:03.394 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:03.388+0000 7fba25ca6700 1 --2- 172.21.15.62:0/2686739340 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fba04066320 0x7fba040687d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:03.394 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:03.388+0000 7fba25ca6700 1 --2- 172.21.15.62:0/2686739340 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba200b6da0 0x7fba200b7220 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:03.394 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:03.388+0000 7fba25ca6700 1 --2- 172.21.15.62:0/2686739340 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fba200cb4a0 0x7fba201528e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:03.394 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:03.388+0000 7fba25ca6700 1 --2- 172.21.15.62:0/2686739340 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba200ce9c0 0x7fba201521b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:03.394 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:03.388+0000 7fba25ca6700 1 -- 172.21.15.62:0/2686739340 >> 172.21.15.62:0/2686739340 conn(0x7fba20070f20 msgr2=0x7fba200b1510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:03.395 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:03.388+0000 7fba25ca6700 1 -- 172.21.15.62:0/2686739340 shutdown_connections 2023-06-09T04:41:03.395 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:03.388+0000 7fba25ca6700 1 -- 172.21.15.62:0/2686739340 wait complete. 2023-06-09T04:41:03.819 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-06-09T04:40:56.758756+0000', 'modified': '2023-06-09T04:41:01.272405+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4312}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4312': {'gid': 4312, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.89:6837/1496954959', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6835', 'nonce': 1496954959}, {'type': 'v1', 'addr': '172.21.15.89:6837', 'nonce': 1496954959}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-06-09T04:41:03.819 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-06-09T04:41:03.819 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-06-09T04:41:04.001 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:03.996+0000 7fc9d0f45700 1 Processor -- start 2023-06-09T04:41:04.001 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:03.996+0000 7fc9d0f45700 1 -- start start 2023-06-09T04:41:04.003 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.000+0000 7fc9d0f45700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc9cc0ce970 0x7fc9cc0cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:04.003 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.000+0000 7fc9d0f45700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc9cc0cd230 0x7fc9cc0b1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:04.004 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.000+0000 7fc9d0f45700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9cc0ce4e0 con 0x7fc9cc0d0270 2023-06-09T04:41:04.004 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.000+0000 7fc9d0f45700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9cc0cd6b0 con 0x7fc9cc0ce970 2023-06-09T04:41:04.004 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.000+0000 7fc9d0f45700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9cc0d25e0 con 0x7fc9cc0cd230 2023-06-09T04:41:04.004 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.000+0000 7fc9c9d9b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc9cc0ce970 0x7fc9cc0cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:04.005 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.000+0000 7fc9c9d9b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc9cc0ce970 0x7fc9cc0cccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:41166/0 (socket says 172.21.15.62:41166) 2023-06-09T04:41:04.005 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.000+0000 7fc9c9d9b700 1 -- 172.21.15.62:0/1627023006 learned_addr learned my addr 172.21.15.62:0/1627023006 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:04.005 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.000+0000 7fc9cad9d700 1 --2- 172.21.15.62:0/1627023006 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc9cc0cd230 0x7fc9cc0b1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:04.005 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.000+0000 7fc9c9d9b700 1 -- 172.21.15.62:0/1627023006 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc9cc0cd230 msgr2=0x7fc9cc0b1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:04.006 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.000+0000 7fc9c9d9b700 1 --2- 172.21.15.62:0/1627023006 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc9cc0cd230 0x7fc9cc0b1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:04.006 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.000+0000 7fc9c9d9b700 1 -- 172.21.15.62:0/1627023006 >> v1:172.21.15.62:6789/0 conn(0x7fc9cc0d0270 legacy=0x7fc9cc0d0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:04.006 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.000+0000 7fc9c9d9b700 1 -- 172.21.15.62:0/1627023006 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9cc0cd8d0 con 0x7fc9cc0ce970 2023-06-09T04:41:04.006 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.000+0000 7fc9c9d9b700 1 --2- 172.21.15.62:0/1627023006 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9cc0ce970 0x7fc9cc0cccf0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc9c0009910 tx=0x7fc9c0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=314709e418993dc0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:04.006 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.000+0000 7fc9c959a700 1 -- 172.21.15.62:0/1627023006 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c000ba60 con 0x7fc9cc0ce970 2023-06-09T04:41:04.007 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.000+0000 7fc9c959a700 1 -- 172.21.15.62:0/1627023006 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9c000bbc0 con 0x7fc9cc0ce970 2023-06-09T04:41:04.007 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.000+0000 7fc9c959a700 1 -- 172.21.15.62:0/1627023006 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c0009e60 con 0x7fc9cc0ce970 2023-06-09T04:41:04.007 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.004+0000 7fc9d0f45700 1 -- 172.21.15.62:0/1627023006 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9cc0ce970 msgr2=0x7fc9cc0cccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:04.007 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.004+0000 7fc9d0f45700 1 --2- 172.21.15.62:0/1627023006 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9cc0ce970 0x7fc9cc0cccf0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc9c0009910 tx=0x7fc9c0009c20 comp rx=0 tx=0).stop 2023-06-09T04:41:04.008 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.004+0000 7fc9d0f45700 1 -- 172.21.15.62:0/1627023006 shutdown_connections 2023-06-09T04:41:04.008 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.004+0000 7fc9d0f45700 1 --2- 172.21.15.62:0/1627023006 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc9cc0cd230 0x7fc9cc0b1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:04.008 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.004+0000 7fc9d0f45700 1 --2- 172.21.15.62:0/1627023006 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9cc0ce970 0x7fc9cc0cccf0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:04.008 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.004+0000 7fc9d0f45700 1 -- 172.21.15.62:0/1627023006 >> 172.21.15.62:0/1627023006 conn(0x7fc9cc071840 msgr2=0x7fc9cc09b970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:04.008 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.004+0000 7fc9d0f45700 1 -- 172.21.15.62:0/1627023006 shutdown_connections 2023-06-09T04:41:04.009 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.004+0000 7fc9d0f45700 1 -- 172.21.15.62:0/1627023006 wait complete. 2023-06-09T04:41:04.012 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.008+0000 7fc9d0f45700 1 Processor -- start 2023-06-09T04:41:04.012 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.008+0000 7fc9d0f45700 1 -- start start 2023-06-09T04:41:04.014 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.008+0000 7fc9d0f45700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9cc0cd230 0x7fc9cc153e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:04.014 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.008+0000 7fc9d0f45700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9cc0ce970 0x7fc9cc0b1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:04.014 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.008+0000 7fc9d0f45700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc9cc0d0270 0x7fc9cc0af820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:04.014 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.008+0000 7fc9d0f45700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9cc0b3620 con 0x7fc9cc0ce970 2023-06-09T04:41:04.014 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.008+0000 7fc9d0f45700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9cc1543a0 con 0x7fc9cc0cd230 2023-06-09T04:41:04.014 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.008+0000 7fc9d0f45700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9cc0b2a10 con 0x7fc9cc0d0270 2023-06-09T04:41:04.015 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.008+0000 7fc9c9d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9cc0ce970 0x7fc9cc0b1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:04.015 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.008+0000 7fc9c9d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9cc0ce970 0x7fc9cc0b1fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:41168/0 (socket says 172.21.15.62:41168) 2023-06-09T04:41:04.016 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.008+0000 7fc9c9d9b700 1 -- 172.21.15.62:0/2482815015 learned_addr learned my addr 172.21.15.62:0/2482815015 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:04.016 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.008+0000 7fc9cad9d700 1 --2- 172.21.15.62:0/2482815015 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc9cc0d0270 0x7fc9cc0af820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:04.016 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.012+0000 7fc9ca59c700 1 --2- 172.21.15.62:0/2482815015 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9cc0cd230 0x7fc9cc153e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:04.016 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.012+0000 7fc9c9d9b700 1 -- 172.21.15.62:0/2482815015 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc9cc0d0270 msgr2=0x7fc9cc0af820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:04.016 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.012+0000 7fc9c9d9b700 1 --2- 172.21.15.62:0/2482815015 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc9cc0d0270 0x7fc9cc0af820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:04.016 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.012+0000 7fc9c9d9b700 1 -- 172.21.15.62:0/2482815015 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9cc0cd230 msgr2=0x7fc9cc153e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:04.016 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.012+0000 7fc9c9d9b700 1 --2- 172.21.15.62:0/2482815015 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9cc0cd230 0x7fc9cc153e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:04.016 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.012+0000 7fc9c9d9b700 1 -- 172.21.15.62:0/2482815015 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c0009570 con 0x7fc9cc0ce970 2023-06-09T04:41:04.017 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.012+0000 7fc9ca59c700 1 --2- 172.21.15.62:0/2482815015 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9cc0cd230 0x7fc9cc153e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:41:04.017 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.012+0000 7fc9c9d9b700 1 --2- 172.21.15.62:0/2482815015 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9cc0ce970 0x7fc9cc0b1fc0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc0d0220 tx=0x7fc9c0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:04.017 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.012+0000 7fc9baffd700 1 -- 172.21.15.62:0/2482815015 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c0004510 con 0x7fc9cc0ce970 2023-06-09T04:41:04.018 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.012+0000 7fc9baffd700 1 -- 172.21.15.62:0/2482815015 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9c001f070 con 0x7fc9cc0ce970 2023-06-09T04:41:04.018 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.012+0000 7fc9d0f45700 1 -- 172.21.15.62:0/2482815015 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9cc0b2cf0 con 0x7fc9cc0ce970 2023-06-09T04:41:04.018 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.012+0000 7fc9baffd700 1 -- 172.21.15.62:0/2482815015 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c0003900 con 0x7fc9cc0ce970 2023-06-09T04:41:04.018 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.012+0000 7fc9d0f45700 1 -- 172.21.15.62:0/2482815015 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9cc0b32b0 con 0x7fc9cc0ce970 2023-06-09T04:41:04.020 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.016+0000 7fc9baffd700 1 -- 172.21.15.62:0/2482815015 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc9c0003a60 con 0x7fc9cc0ce970 2023-06-09T04:41:04.022 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.016+0000 7fc9baffd700 1 --2- 172.21.15.62:0/2482815015 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fc9ac0662f0 0x7fc9ac0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:04.022 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.016+0000 7fc9baffd700 1 -- 172.21.15.62:0/2482815015 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc9c0021070 con 0x7fc9cc0ce970 2023-06-09T04:41:04.023 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.020+0000 7fc9ca59c700 1 --2- 172.21.15.62:0/2482815015 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fc9ac0662f0 0x7fc9ac0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:04.024 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.020+0000 7fc9d41c5740 1 Processor -- start 2023-06-09T04:41:04.024 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.020+0000 7fc9ca59c700 1 --2- 172.21.15.62:0/2482815015 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fc9ac0662f0 0x7fc9ac0687a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc000fd0 tx=0x7fc9bc009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:04.024 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.020+0000 7fc9d41c5740 1 -- start start 2023-06-09T04:41:04.026 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.020+0000 7fc9d41c5740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x16a8eb0 0x19614d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:04.026 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.020+0000 7fc9d41c5740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x16a8ae0 0x1917ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:04.026 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.020+0000 7fc9d41c5740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x16a8710 0x1918420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:04.026 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.020+0000 7fc9d41c5740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x18a7ee0 con 0x16a8eb0 2023-06-09T04:41:04.026 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.020+0000 7fc9d41c5740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x1835690 con 0x16a8710 2023-06-09T04:41:04.026 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.020+0000 7fc9d41c5740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x1888340 con 0x16a8ae0 2023-06-09T04:41:04.027 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.020+0000 7fc9ca59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x16a8eb0 0x19614d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:04.027 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.020+0000 7fc9ca59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x16a8eb0 0x19614d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:41176/0 (socket says 172.21.15.62:41176) 2023-06-09T04:41:04.028 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.020+0000 7fc9ca59c700 1 -- 172.21.15.62:0/838206308 learned_addr learned my addr 172.21.15.62:0/838206308 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:04.028 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.020+0000 7fc9cad9d700 1 --2- 172.21.15.62:0/838206308 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x16a8710 0x1918420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:04.028 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.020+0000 7fc9c9d9b700 1 --2- 172.21.15.62:0/838206308 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x16a8ae0 0x1917ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:04.028 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.020+0000 7fc9ca59c700 1 -- 172.21.15.62:0/838206308 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x16a8ae0 msgr2=0x1917ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:04.028 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.020+0000 7fc9ca59c700 1 --2- 172.21.15.62:0/838206308 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x16a8ae0 0x1917ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:04.028 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.024+0000 7fc9ca59c700 1 -- 172.21.15.62:0/838206308 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x16a8710 msgr2=0x1918420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:04.028 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.024+0000 7fc9ca59c700 1 --2- 172.21.15.62:0/838206308 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x16a8710 0x1918420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:04.029 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.024+0000 7fc9ca59c700 1 -- 172.21.15.62:0/838206308 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x18339a0 con 0x16a8eb0 2023-06-09T04:41:04.029 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.024+0000 7fc9cad9d700 1 --2- 172.21.15.62:0/838206308 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x16a8710 0x1918420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:41:04.029 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.024+0000 7fc9ca59c700 1 --2- 172.21.15.62:0/838206308 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x16a8eb0 0x19614d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc005260 tx=0x7fc9bc011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c3fb3962351002b server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:04.029 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.024+0000 7fc9abfff700 1 -- 172.21.15.62:0/838206308 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9bc001d60 con 0x16a8eb0 2023-06-09T04:41:04.029 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.024+0000 7fc9abfff700 1 -- 172.21.15.62:0/838206308 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9bc003d40 con 0x16a8eb0 2023-06-09T04:41:04.029 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.024+0000 7fc9abfff700 1 -- 172.21.15.62:0/838206308 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9bc00e850 con 0x16a8eb0 2023-06-09T04:41:04.030 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.024+0000 7fc9d41c5740 1 -- 172.21.15.62:0/838206308 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x16a8eb0 msgr2=0x19614d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:04.030 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.024+0000 7fc9d41c5740 1 --2- 172.21.15.62:0/838206308 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x16a8eb0 0x19614d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc005260 tx=0x7fc9bc011000 comp rx=0 tx=0).stop 2023-06-09T04:41:04.030 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.024+0000 7fc9d41c5740 1 -- 172.21.15.62:0/838206308 shutdown_connections 2023-06-09T04:41:04.030 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.024+0000 7fc9d41c5740 1 --2- 172.21.15.62:0/838206308 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x16a8710 0x1918420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:04.031 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.024+0000 7fc9d41c5740 1 --2- 172.21.15.62:0/838206308 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x16a8ae0 0x1917ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:04.031 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.024+0000 7fc9d41c5740 1 --2- 172.21.15.62:0/838206308 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x16a8eb0 0x19614d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:04.031 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.024+0000 7fc9d41c5740 1 -- 172.21.15.62:0/838206308 >> 172.21.15.62:0/838206308 conn(0x1912d10 msgr2=0x1944f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:04.031 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.024+0000 7fc9d41c5740 1 -- 172.21.15.62:0/838206308 shutdown_connections 2023-06-09T04:41:04.031 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.024+0000 7fc9d41c5740 1 -- 172.21.15.62:0/838206308 wait complete. 2023-06-09T04:41:04.031 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.024+0000 7fc9d41c5740 1 -- start start 2023-06-09T04:41:04.031 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.024+0000 7fc9d41c5740 1 Processor -- start 2023-06-09T04:41:04.032 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.028+0000 7fc9d41c5740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x16a8710 0x1942410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:04.032 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.028+0000 7fc9d41c5740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x16a8ae0 0x195db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:04.032 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.028+0000 7fc9d41c5740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x16a8eb0 0x191c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:04.033 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.028+0000 7fc9d41c5740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x18815a0 con 0x16a8710 2023-06-09T04:41:04.033 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.028+0000 7fc9d41c5740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x1843f20 con 0x16a8eb0 2023-06-09T04:41:04.033 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.028+0000 7fc9d41c5740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x1842890 con 0x16a8ae0 2023-06-09T04:41:04.033 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.028+0000 7fc9d41c5740 10 client.0 _ll_register_callbacks cb 0x18d47d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-09T04:41:04.033 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.028+0000 7fc9ca59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x16a8710 0x1942410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:04.033 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.028+0000 7fc9ca59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x16a8710 0x1942410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:41186/0 (socket says 172.21.15.62:41186) 2023-06-09T04:41:04.033 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.028+0000 7fc9ca59c700 1 -- 172.21.15.62:0/2336826058 learned_addr learned my addr 172.21.15.62:0/2336826058 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:04.035 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.028+0000 7fc9cad9d700 1 --2- 172.21.15.62:0/2336826058 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x16a8eb0 0x191c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:04.035 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.028+0000 7fc9c9d9b700 1 --2- 172.21.15.62:0/2336826058 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x16a8ae0 0x195db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:04.035 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.028+0000 7fc9ca59c700 1 -- 172.21.15.62:0/2336826058 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x16a8ae0 msgr2=0x195db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:04.035 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.028+0000 7fc9ca59c700 1 --2- 172.21.15.62:0/2336826058 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x16a8ae0 0x195db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:04.035 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.028+0000 7fc9ca59c700 1 -- 172.21.15.62:0/2336826058 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x16a8eb0 msgr2=0x191c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:04.035 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.028+0000 7fc9ca59c700 1 --2- 172.21.15.62:0/2336826058 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x16a8eb0 0x191c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:04.035 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.028+0000 7fc9ca59c700 1 -- 172.21.15.62:0/2336826058 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9bc00f040 con 0x16a8710 2023-06-09T04:41:04.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.028+0000 7fc9cad9d700 1 --2- 172.21.15.62:0/2336826058 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x16a8eb0 0x191c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:41:04.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.028+0000 7fc9ca59c700 1 --2- 172.21.15.62:0/2336826058 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x16a8710 0x1942410 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc0014f0 tx=0x7fc9bc013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6f5c351a6013b29 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:04.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.028+0000 7fc9a97fa700 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2023-06-09T04:41:04.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.028+0000 7fc9a97fa700 1 -- 172.21.15.62:0/2336826058 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9bc00e960 con 0x16a8710 2023-06-09T04:41:04.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.028+0000 7fc9a97fa700 1 -- 172.21.15.62:0/2336826058 <== mon.0 v2:172.21.15.62:3300/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc9bc00eac0 con 0x16a8710 2023-06-09T04:41:04.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.028+0000 7fc9d41c5740 1 -- 172.21.15.62:0/2336826058 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x187a580 con 0x16a8710 2023-06-09T04:41:04.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.032+0000 7fc9a97fa700 1 -- 172.21.15.62:0/2336826058 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc9bc00ec80 con 0x16a8710 2023-06-09T04:41:04.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.032+0000 7fc9d41c5740 10 client.4437 fetch_fsmap learned FSMap version 7 2023-06-09T04:41:04.037 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.032+0000 7fc9d41c5740 1 -- 172.21.15.62:0/2336826058 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x16f49e0 con 0x16a8710 2023-06-09T04:41:04.037 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.032+0000 7fc9a97fa700 1 -- 172.21.15.62:0/2336826058 <== mon.0 v2:172.21.15.62:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x187a580 con 0x16a8710 2023-06-09T04:41:04.038 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.032+0000 7fc9a97fa700 1 -- 172.21.15.62:0/2336826058 <== mon.0 v2:172.21.15.62:3300/0 5 ==== fsmap(e 7) v1 ==== 3122+0+0 (secure 0 0 0) 0x7fc9bc02b330 con 0x16a8710 2023-06-09T04:41:04.038 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.032+0000 7fc9d41c5740 10 client.4437 fetch_fsmap finished waiting for FSMap version 7 2023-06-09T04:41:04.038 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.032+0000 7fc9d41c5740 10 client.4437 resolve_mds: resolved name 'd' to daemon mds.d 2023-06-09T04:41:04.038 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.032+0000 7fc9d41c5740 20 client.4437 populate_metadata read hostname 'smithi062' 2023-06-09T04:41:04.038 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.032+0000 7fc9d41c5740 1 --2- 172.21.15.62:0/2336826058 >> [v2:172.21.15.89:6835/1496954959,v1:172.21.15.89:6837/1496954959] conn(0x16f3790 0x19616e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:04.038 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.032+0000 7fc9d41c5740 4 client.4437 mds_command: new command op to 4312 tid=0[{"prefix": "get_command_descriptions"}] 2023-06-09T04:41:04.038 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.032+0000 7fc9d41c5740 1 -- 172.21.15.62:0/2336826058 --> [v2:172.21.15.89:6835/1496954959,v1:172.21.15.89:6837/1496954959] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x187a2a0 con 0x16f3790 2023-06-09T04:41:04.039 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.032+0000 7fc9c9d9b700 1 --2- 172.21.15.62:0/2336826058 >> [v2:172.21.15.89:6835/1496954959,v1:172.21.15.89:6837/1496954959] conn(0x16f3790 0x19616e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:04.039 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.032+0000 7fc9c9d9b700 1 --2- 172.21.15.62:0/2336826058 >> [v2:172.21.15.89:6835/1496954959,v1:172.21.15.89:6837/1496954959] conn(0x16f3790 0x19616e0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6440fba0bb8d8cf9 server_cookie=3dacbaafb776c970 in_seq=0 out_seq=0 2023-06-09T04:41:04.039 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.032+0000 7fc9a97fa700 10 client.4437 ms_handle_connect on v2:172.21.15.89:6835/1496954959 2023-06-09T04:41:04.039 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.032+0000 7fc9a97fa700 1 -- 172.21.15.62:0/2336826058 <== mds.0 v2:172.21.15.89:6835/1496954959 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x187a2a0 con 0x16f3790 2023-06-09T04:41:04.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.032+0000 7fc9a97fa700 10 client.4437 handle_command_reply: tid=0 2023-06-09T04:41:04.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.036+0000 7fc9d41c5740 1 client.4437 shutdown 2023-06-09T04:41:04.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.036+0000 7fc9d41c5740 1 -- 172.21.15.62:0/2336826058 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x16a8710 msgr2=0x1942410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:04.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.036+0000 7fc9d41c5740 1 --2- 172.21.15.62:0/2336826058 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x16a8710 0x1942410 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc0014f0 tx=0x7fc9bc013000 comp rx=0 tx=0).stop 2023-06-09T04:41:04.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.036+0000 7fc9d41c5740 1 -- 172.21.15.62:0/2336826058 shutdown_connections 2023-06-09T04:41:04.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.036+0000 7fc9d41c5740 1 --2- 172.21.15.62:0/2336826058 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x16a8eb0 0x191c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:04.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.036+0000 7fc9d41c5740 1 --2- 172.21.15.62:0/2336826058 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x16a8ae0 0x195db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:04.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.036+0000 7fc9d41c5740 1 --2- 172.21.15.62:0/2336826058 >> [v2:172.21.15.89:6835/1496954959,v1:172.21.15.89:6837/1496954959] conn(0x16f3790 0x19616e0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:04.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.036+0000 7fc9d41c5740 1 --2- 172.21.15.62:0/2336826058 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x16a8710 0x1942410 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:04.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.036+0000 7fc9a97fa700 0 client.4437 ms_handle_reset on v2:172.21.15.89:6835/1496954959 2023-06-09T04:41:04.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.036+0000 7fc9d41c5740 1 -- 172.21.15.62:0/2336826058 >> 172.21.15.62:0/2336826058 conn(0x1912d10 msgr2=0x19175d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:04.042 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.036+0000 7fc9d41c5740 1 -- 172.21.15.62:0/2336826058 shutdown_connections 2023-06-09T04:41:04.042 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.036+0000 7fc9d41c5740 1 -- 172.21.15.62:0/2336826058 wait complete. 2023-06-09T04:41:04.042 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.036+0000 7fc9d41c5740 20 client.4437 trim_cache size 0 max 16384 2023-06-09T04:41:04.061 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.056+0000 7fc9d41c5740 1 Processor -- start 2023-06-09T04:41:04.061 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.056+0000 7fc9d41c5740 1 -- start start 2023-06-09T04:41:04.064 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.060+0000 7fc9d41c5740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x1912d10 0x1969510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:04.064 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.060+0000 7fc9d41c5740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x16a8710 0x1969a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:04.064 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.060+0000 7fc9d41c5740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x16a8ae0 0x196a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:04.064 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.060+0000 7fc9d41c5740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x172db20 con 0x1912d10 2023-06-09T04:41:04.064 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.060+0000 7fc9d41c5740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x183bb40 con 0x16a8ae0 2023-06-09T04:41:04.064 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.060+0000 7fc9d41c5740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x1884100 con 0x16a8710 2023-06-09T04:41:04.065 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.060+0000 7fc9ca59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x1912d10 0x1969510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:04.066 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.060+0000 7fc9ca59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x1912d10 0x1969510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:41200/0 (socket says 172.21.15.62:41200) 2023-06-09T04:41:04.066 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.060+0000 7fc9ca59c700 1 -- 172.21.15.62:0/1912044061 learned_addr learned my addr 172.21.15.62:0/1912044061 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:04.066 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.060+0000 7fc9cad9d700 1 --2- 172.21.15.62:0/1912044061 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x16a8ae0 0x196a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:04.066 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.060+0000 7fc9c9d9b700 1 --2- 172.21.15.62:0/1912044061 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x16a8710 0x1969a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:04.066 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.060+0000 7fc9ca59c700 1 -- 172.21.15.62:0/1912044061 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x16a8710 msgr2=0x1969a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:04.066 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.060+0000 7fc9ca59c700 1 --2- 172.21.15.62:0/1912044061 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x16a8710 0x1969a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:04.066 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.060+0000 7fc9ca59c700 1 -- 172.21.15.62:0/1912044061 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x16a8ae0 msgr2=0x196a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:04.067 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.060+0000 7fc9ca59c700 1 --2- 172.21.15.62:0/1912044061 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x16a8ae0 0x196a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:04.067 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.060+0000 7fc9ca59c700 1 -- 172.21.15.62:0/1912044061 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9cc0b00c0 con 0x1912d10 2023-06-09T04:41:04.067 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.060+0000 7fc9c9d9b700 1 --2- 172.21.15.62:0/1912044061 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x16a8710 0x1969a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:41:04.067 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.060+0000 7fc9ca59c700 1 --2- 172.21.15.62:0/1912044061 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x1912d10 0x1969510 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc00e6d0 tx=0x7fc9bc01d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5a26a829d7658b9 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:04.068 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.060+0000 7fc9b8ff9700 1 -- 172.21.15.62:0/1912044061 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9bc005090 con 0x1912d10 2023-06-09T04:41:04.068 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.060+0000 7fc9b8ff9700 1 -- 172.21.15.62:0/1912044061 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9bc019040 con 0x1912d10 2023-06-09T04:41:04.068 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.060+0000 7fc9b8ff9700 1 -- 172.21.15.62:0/1912044061 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9bc003980 con 0x1912d10 2023-06-09T04:41:04.068 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.064+0000 7fc9d41c5740 1 -- 172.21.15.62:0/1912044061 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x1912d10 msgr2=0x1969510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:04.068 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.064+0000 7fc9d41c5740 1 --2- 172.21.15.62:0/1912044061 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x1912d10 0x1969510 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc00e6d0 tx=0x7fc9bc01d000 comp rx=0 tx=0).stop 2023-06-09T04:41:04.069 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.064+0000 7fc9d41c5740 1 -- 172.21.15.62:0/1912044061 shutdown_connections 2023-06-09T04:41:04.069 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.064+0000 7fc9d41c5740 1 --2- 172.21.15.62:0/1912044061 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x16a8ae0 0x196a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:04.069 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.064+0000 7fc9d41c5740 1 --2- 172.21.15.62:0/1912044061 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x16a8710 0x1969a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:04.069 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.064+0000 7fc9d41c5740 1 --2- 172.21.15.62:0/1912044061 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x1912d10 0x1969510 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:04.069 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.064+0000 7fc9d41c5740 1 -- 172.21.15.62:0/1912044061 >> 172.21.15.62:0/1912044061 conn(0x1942580 msgr2=0x191c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:04.069 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.064+0000 7fc9d41c5740 1 -- 172.21.15.62:0/1912044061 shutdown_connections 2023-06-09T04:41:04.069 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.064+0000 7fc9d41c5740 1 -- 172.21.15.62:0/1912044061 wait complete. 2023-06-09T04:41:04.070 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.064+0000 7fc9d41c5740 1 -- start start 2023-06-09T04:41:04.070 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.064+0000 7fc9d41c5740 1 Processor -- start 2023-06-09T04:41:04.072 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.068+0000 7fc9d41c5740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x16a8710 0x19753f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:04.072 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.068+0000 7fc9d41c5740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x16a8ae0 0x1976f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:04.072 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.068+0000 7fc9d41c5740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1912d10 0x19765e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:04.072 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.068+0000 7fc9d41c5740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x1945820 con 0x16a8ae0 2023-06-09T04:41:04.072 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.068+0000 7fc9d41c5740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x19138b0 con 0x1912d10 2023-06-09T04:41:04.072 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.068+0000 7fc9d41c5740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x1840f10 con 0x16a8710 2023-06-09T04:41:04.072 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.068+0000 7fc9d41c5740 10 client.0 _ll_register_callbacks cb 0x1880170 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-09T04:41:04.074 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.068+0000 7fc9c9d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x16a8ae0 0x1976f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:04.074 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.068+0000 7fc9c9d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x16a8ae0 0x1976f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:41202/0 (socket says 172.21.15.62:41202) 2023-06-09T04:41:04.074 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.068+0000 7fc9c9d9b700 1 -- 172.21.15.62:0/2543759354 learned_addr learned my addr 172.21.15.62:0/2543759354 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:04.074 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.068+0000 7fc9cad9d700 1 --2- 172.21.15.62:0/2543759354 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1912d10 0x19765e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:04.074 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.068+0000 7fc9ca59c700 1 --2- 172.21.15.62:0/2543759354 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x16a8710 0x19753f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:04.074 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.068+0000 7fc9c9d9b700 1 -- 172.21.15.62:0/2543759354 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x16a8710 msgr2=0x19753f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:04.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.068+0000 7fc9c9d9b700 1 --2- 172.21.15.62:0/2543759354 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x16a8710 0x19753f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:04.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.068+0000 7fc9c9d9b700 1 -- 172.21.15.62:0/2543759354 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1912d10 msgr2=0x19765e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:04.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.068+0000 7fc9c9d9b700 1 --2- 172.21.15.62:0/2543759354 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1912d10 0x19765e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:04.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.068+0000 7fc9c9d9b700 1 -- 172.21.15.62:0/2543759354 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x16f49e0 con 0x16a8ae0 2023-06-09T04:41:04.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.068+0000 7fc9ca59c700 1 --2- 172.21.15.62:0/2543759354 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x16a8710 0x19753f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:41:04.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.068+0000 7fc9cad9d700 1 --2- 172.21.15.62:0/2543759354 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1912d10 0x19765e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:41:04.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.068+0000 7fc9c9d9b700 1 --2- 172.21.15.62:0/2543759354 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x16a8ae0 0x1976f80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc9c0000c00 tx=0x7fc9c005eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38d2fac963525855 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:04.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.068+0000 7fc9a97fa700 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2023-06-09T04:41:04.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.068+0000 7fc9a97fa700 1 -- 172.21.15.62:0/2543759354 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c0054af0 con 0x16a8ae0 2023-06-09T04:41:04.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.068+0000 7fc9d41c5740 1 -- 172.21.15.62:0/2543759354 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc9bc003d40 con 0x16a8ae0 2023-06-09T04:41:04.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.068+0000 7fc9a97fa700 1 -- 172.21.15.62:0/2543759354 <== mon.0 v2:172.21.15.62:3300/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc9c005e550 con 0x16a8ae0 2023-06-09T04:41:04.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.068+0000 7fc9a97fa700 1 -- 172.21.15.62:0/2543759354 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc9c005e750 con 0x16a8ae0 2023-06-09T04:41:04.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.068+0000 7fc9d41c5740 10 client.4443 fetch_fsmap learned FSMap version 7 2023-06-09T04:41:04.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.068+0000 7fc9d41c5740 1 -- 172.21.15.62:0/2543759354 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x1847670 con 0x16a8ae0 2023-06-09T04:41:04.078 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.068+0000 7fc9a97fa700 1 -- 172.21.15.62:0/2543759354 <== mon.0 v2:172.21.15.62:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9bc003d40 con 0x16a8ae0 2023-06-09T04:41:04.078 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.068+0000 7fc9a97fa700 1 -- 172.21.15.62:0/2543759354 <== mon.0 v2:172.21.15.62:3300/0 5 ==== fsmap(e 7) v1 ==== 3122+0+0 (secure 0 0 0) 0x7fc9c005a120 con 0x16a8ae0 2023-06-09T04:41:04.078 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.068+0000 7fc9d41c5740 10 client.4443 fetch_fsmap finished waiting for FSMap version 7 2023-06-09T04:41:04.078 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.068+0000 7fc9d41c5740 10 client.4443 resolve_mds: resolved name 'd' to daemon mds.d 2023-06-09T04:41:04.078 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.068+0000 7fc9d41c5740 20 client.4443 populate_metadata read hostname 'smithi062' 2023-06-09T04:41:04.078 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.068+0000 7fc9d41c5740 1 --2- 172.21.15.62:0/2543759354 >> [v2:172.21.15.89:6835/1496954959,v1:172.21.15.89:6837/1496954959] conn(0x16a8eb0 0x19417c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:04.078 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.068+0000 7fc9d41c5740 4 client.4443 mds_command: new command op to 4312 tid=0[{"prefix": "status"}] 2023-06-09T04:41:04.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.068+0000 7fc9d41c5740 1 -- 172.21.15.62:0/2543759354 --> [v2:172.21.15.89:6835/1496954959,v1:172.21.15.89:6837/1496954959] -- command(tid 0: {"prefix": "status"}) v1 -- 0x17004e0 con 0x16a8eb0 2023-06-09T04:41:04.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.072+0000 7fc9ca59c700 1 --2- 172.21.15.62:0/2543759354 >> [v2:172.21.15.89:6835/1496954959,v1:172.21.15.89:6837/1496954959] conn(0x16a8eb0 0x19417c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:04.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.072+0000 7fc9ca59c700 1 --2- 172.21.15.62:0/2543759354 >> [v2:172.21.15.89:6835/1496954959,v1:172.21.15.89:6837/1496954959] conn(0x16a8eb0 0x19417c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75a29d5f378b1d04 server_cookie=97fa3844f921fa61 in_seq=0 out_seq=0 2023-06-09T04:41:04.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.072+0000 7fc9a97fa700 10 client.4443 ms_handle_connect on v2:172.21.15.89:6835/1496954959 2023-06-09T04:41:04.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.072+0000 7fc9a97fa700 1 -- 172.21.15.62:0/2543759354 <== mds.0 v2:172.21.15.89:6835/1496954959 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x17004e0 con 0x16a8eb0 2023-06-09T04:41:04.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.072+0000 7fc9a97fa700 10 client.4443 handle_command_reply: tid=0 2023-06-09T04:41:04.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.072+0000 7fc9d41c5740 1 client.4443 shutdown 2023-06-09T04:41:04.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.072+0000 7fc9d41c5740 1 -- 172.21.15.62:0/2543759354 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x16a8ae0 msgr2=0x1976f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:04.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.072+0000 7fc9d41c5740 1 --2- 172.21.15.62:0/2543759354 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x16a8ae0 0x1976f80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc9c0000c00 tx=0x7fc9c005eb60 comp rx=0 tx=0).stop 2023-06-09T04:41:04.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.072+0000 7fc9d41c5740 1 -- 172.21.15.62:0/2543759354 shutdown_connections 2023-06-09T04:41:04.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.072+0000 7fc9d41c5740 1 --2- 172.21.15.62:0/2543759354 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x1912d10 0x19765e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:04.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.072+0000 7fc9d41c5740 1 --2- 172.21.15.62:0/2543759354 >> [v2:172.21.15.89:6835/1496954959,v1:172.21.15.89:6837/1496954959] conn(0x16a8eb0 0x19417c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:04.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.072+0000 7fc9d41c5740 1 --2- 172.21.15.62:0/2543759354 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x16a8ae0 0x1976f80 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:04.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.072+0000 7fc9d41c5740 1 --2- 172.21.15.62:0/2543759354 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x16a8710 0x19753f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:04.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.072+0000 7fc9a97fa700 0 client.4443 ms_handle_reset on v2:172.21.15.89:6835/1496954959 2023-06-09T04:41:04.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.072+0000 7fc9d41c5740 1 -- 172.21.15.62:0/2543759354 >> 172.21.15.62:0/2543759354 conn(0x1942580 msgr2=0x1970ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:04.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.072+0000 7fc9d41c5740 1 -- 172.21.15.62:0/2543759354 shutdown_connections 2023-06-09T04:41:04.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.072+0000 7fc9d41c5740 1 -- 172.21.15.62:0/2543759354 wait complete. 2023-06-09T04:41:04.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.072+0000 7fc9d41c5740 20 client.4443 trim_cache size 0 max 16384 2023-06-09T04:41:04.081 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2023-06-09T04:41:04.082 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_fsid": "f7998a1e-e5a9-4202-abaa-70c0eaae1047", 2023-06-09T04:41:04.082 INFO:teuthology.orchestra.run.smithi062.stdout: "whoami": 0, 2023-06-09T04:41:04.082 INFO:teuthology.orchestra.run.smithi062.stdout: "id": 4312, 2023-06-09T04:41:04.082 INFO:teuthology.orchestra.run.smithi062.stdout: "want_state": "up:active", 2023-06-09T04:41:04.082 INFO:teuthology.orchestra.run.smithi062.stdout: "state": "up:active", 2023-06-09T04:41:04.082 INFO:teuthology.orchestra.run.smithi062.stdout: "fs_name": "cephfs", 2023-06-09T04:41:04.082 INFO:teuthology.orchestra.run.smithi062.stdout: "rank_uptime": 7.3094015859999999, 2023-06-09T04:41:04.082 INFO:teuthology.orchestra.run.smithi062.stdout: "mdsmap_epoch": 7, 2023-06-09T04:41:04.083 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_epoch": 28, 2023-06-09T04:41:04.083 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_epoch_barrier": 27, 2023-06-09T04:41:04.083 INFO:teuthology.orchestra.run.smithi062.stdout: "uptime": 12.669958558999999 2023-06-09T04:41:04.083 INFO:teuthology.orchestra.run.smithi062.stdout:} 2023-06-09T04:41:04.084 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.072+0000 7fc9d0f45700 1 -- 172.21.15.62:0/2482815015 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fc9ac0662f0 msgr2=0x7fc9ac0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:04.084 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.076+0000 7fc9d0f45700 1 --2- 172.21.15.62:0/2482815015 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fc9ac0662f0 0x7fc9ac0687a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc000fd0 tx=0x7fc9bc009040 comp rx=0 tx=0).stop 2023-06-09T04:41:04.084 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.076+0000 7fc9d0f45700 1 -- 172.21.15.62:0/2482815015 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9cc0ce970 msgr2=0x7fc9cc0b1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:04.084 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.076+0000 7fc9d0f45700 1 --2- 172.21.15.62:0/2482815015 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9cc0ce970 0x7fc9cc0b1fc0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc0d0220 tx=0x7fc9c0004770 comp rx=0 tx=0).stop 2023-06-09T04:41:04.084 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.076+0000 7fc9d0f45700 1 -- 172.21.15.62:0/2482815015 shutdown_connections 2023-06-09T04:41:04.084 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.076+0000 7fc9d0f45700 1 --2- 172.21.15.62:0/2482815015 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fc9ac0662f0 0x7fc9ac0687a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:04.085 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.076+0000 7fc9d0f45700 1 --2- 172.21.15.62:0/2482815015 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc9cc0d0270 0x7fc9cc0af820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:04.085 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.076+0000 7fc9d0f45700 1 --2- 172.21.15.62:0/2482815015 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9cc0ce970 0x7fc9cc0b1fc0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:04.085 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.076+0000 7fc9d0f45700 1 --2- 172.21.15.62:0/2482815015 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9cc0cd230 0x7fc9cc153e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:04.085 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.076+0000 7fc9d0f45700 1 -- 172.21.15.62:0/2482815015 >> 172.21.15.62:0/2482815015 conn(0x7fc9cc071840 msgr2=0x7fc9cc06bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:04.085 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.076+0000 7fc9d0f45700 1 -- 172.21.15.62:0/2482815015 shutdown_connections 2023-06-09T04:41:04.085 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.076+0000 7fc9d0f45700 1 -- 172.21.15.62:0/2482815015 wait complete. 2023-06-09T04:41:04.102 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-06-09T04:41:04.103 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-06-09T04:41:04.103 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-09T04:41:04.278 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.272+0000 7ffa45a91700 1 Processor -- start 2023-06-09T04:41:04.279 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.272+0000 7ffa45a91700 1 -- start start 2023-06-09T04:41:04.281 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.276+0000 7ffa45a91700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ffa400cb1f0 0x7ffa400cbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:04.281 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.276+0000 7ffa45a91700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa4015fa30 con 0x7ffa400ad480 2023-06-09T04:41:04.281 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.276+0000 7ffa45a91700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa400ad920 con 0x7ffa4015c0f0 2023-06-09T04:41:04.281 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.276+0000 7ffa45a91700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa400cc300 con 0x7ffa400cb1f0 2023-06-09T04:41:04.282 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.276+0000 7ffa36ffd700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7ffa400ad480 0x7ffa400c8840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:38588/0 (socket says 172.21.15.62:38588) 2023-06-09T04:41:04.282 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.276+0000 7ffa36ffd700 1 -- 172.21.15.62:0/1454900828 learned_addr learned my addr 172.21.15.62:0/1454900828 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:41:04.282 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.276+0000 7ffa3ffff700 1 --2- 172.21.15.62:0/1454900828 >> v2:172.21.15.89:3300/0 conn(0x7ffa400cb1f0 0x7ffa400cbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:04.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.276+0000 7ffa3effd700 1 -- 172.21.15.62:0/1454900828 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 349934883 0 0) 0x7ffa4015fa30 con 0x7ffa400ad480 2023-06-09T04:41:04.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.276+0000 7ffa3effd700 1 -- 172.21.15.62:0/1454900828 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa2c0035d0 con 0x7ffa400ad480 2023-06-09T04:41:04.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.276+0000 7ffa3effd700 1 -- 172.21.15.62:0/1454900828 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 226366894 0 0) 0x7ffa400ad920 con 0x7ffa4015c0f0 2023-06-09T04:41:04.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.276+0000 7ffa3effd700 1 -- 172.21.15.62:0/1454900828 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa4015fa30 con 0x7ffa4015c0f0 2023-06-09T04:41:04.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.280+0000 7ffa3ffff700 1 -- 172.21.15.62:0/1454900828 >> v1:172.21.15.89:6789/0 conn(0x7ffa4015c0f0 legacy=0x7ffa400caae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:04.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.280+0000 7ffa3ffff700 1 -- 172.21.15.62:0/1454900828 >> v1:172.21.15.62:6789/0 conn(0x7ffa400ad480 legacy=0x7ffa400c8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:04.284 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.280+0000 7ffa3ffff700 1 -- 172.21.15.62:0/1454900828 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa4015fc80 con 0x7ffa400cb1f0 2023-06-09T04:41:04.284 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.280+0000 7ffa3ffff700 1 --2- 172.21.15.62:0/1454900828 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffa400cb1f0 0x7ffa400cbdc0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ffa38009850 tx=0x7ffa38009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5bae395d27b8d22b server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:04.284 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.280+0000 7ffa3effd700 1 -- 172.21.15.62:0/1454900828 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa38011830 con 0x7ffa400cb1f0 2023-06-09T04:41:04.284 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.280+0000 7ffa3effd700 1 -- 172.21.15.62:0/1454900828 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa38011990 con 0x7ffa400cb1f0 2023-06-09T04:41:04.285 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.280+0000 7ffa3effd700 1 -- 172.21.15.62:0/1454900828 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa38011d40 con 0x7ffa400cb1f0 2023-06-09T04:41:04.285 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.280+0000 7ffa45a91700 1 -- 172.21.15.62:0/1454900828 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffa400cb1f0 msgr2=0x7ffa400cbdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:04.285 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.280+0000 7ffa45a91700 1 --2- 172.21.15.62:0/1454900828 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffa400cb1f0 0x7ffa400cbdc0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ffa38009850 tx=0x7ffa38009b60 comp rx=0 tx=0).stop 2023-06-09T04:41:04.285 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.280+0000 7ffa45a91700 1 -- 172.21.15.62:0/1454900828 shutdown_connections 2023-06-09T04:41:04.286 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.280+0000 7ffa45a91700 1 --2- 172.21.15.62:0/1454900828 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffa400cb1f0 0x7ffa400cbdc0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:04.286 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.280+0000 7ffa45a91700 1 -- 172.21.15.62:0/1454900828 >> 172.21.15.62:0/1454900828 conn(0x7ffa4006a410 msgr2=0x7ffa400afd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:04.286 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.280+0000 7ffa45a91700 1 -- 172.21.15.62:0/1454900828 shutdown_connections 2023-06-09T04:41:04.286 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.280+0000 7ffa45a91700 1 -- 172.21.15.62:0/1454900828 wait complete. 2023-06-09T04:41:04.287 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.284+0000 7ffa45a91700 1 Processor -- start 2023-06-09T04:41:04.288 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.284+0000 7ffa45a91700 1 -- start start 2023-06-09T04:41:04.289 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.284+0000 7ffa45a91700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffa400ad480 0x7ffa401480c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:04.289 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.284+0000 7ffa45a91700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa400cb1f0 0x7ffa4015e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:04.289 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.284+0000 7ffa45a91700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffa4015c0f0 0x7ffa4015c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:04.289 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.284+0000 7ffa45a91700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa4015f850 con 0x7ffa400cb1f0 2023-06-09T04:41:04.290 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.284+0000 7ffa45a91700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa400b22a0 con 0x7ffa4015c0f0 2023-06-09T04:41:04.290 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.284+0000 7ffa45a91700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa4015efb0 con 0x7ffa400ad480 2023-06-09T04:41:04.290 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.284+0000 7ffa36ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa400cb1f0 0x7ffa4015e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:04.291 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.284+0000 7ffa36ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa400cb1f0 0x7ffa4015e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:41214/0 (socket says 172.21.15.62:41214) 2023-06-09T04:41:04.291 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.284+0000 7ffa36ffd700 1 -- 172.21.15.62:0/3368716352 learned_addr learned my addr 172.21.15.62:0/3368716352 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:04.291 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.284+0000 7ffa3ffff700 1 --2- 172.21.15.62:0/3368716352 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffa4015c0f0 0x7ffa4015c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:04.291 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.284+0000 7ffa3f7fe700 1 --2- 172.21.15.62:0/3368716352 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffa400ad480 0x7ffa401480c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:04.291 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.284+0000 7ffa36ffd700 1 -- 172.21.15.62:0/3368716352 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffa400ad480 msgr2=0x7ffa401480c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:04.291 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.284+0000 7ffa36ffd700 1 --2- 172.21.15.62:0/3368716352 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffa400ad480 0x7ffa401480c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:04.292 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.284+0000 7ffa36ffd700 1 -- 172.21.15.62:0/3368716352 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffa4015c0f0 msgr2=0x7ffa4015c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:04.292 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.284+0000 7ffa36ffd700 1 --2- 172.21.15.62:0/3368716352 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffa4015c0f0 0x7ffa4015c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:04.292 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.284+0000 7ffa36ffd700 1 -- 172.21.15.62:0/3368716352 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa380094b0 con 0x7ffa400cb1f0 2023-06-09T04:41:04.292 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.288+0000 7ffa36ffd700 1 --2- 172.21.15.62:0/3368716352 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa400cb1f0 0x7ffa4015e560 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ffa2800c560 tx=0x7ffa2800c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:04.293 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.288+0000 7ffa3cff9700 1 -- 172.21.15.62:0/3368716352 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa28005d90 con 0x7ffa400cb1f0 2023-06-09T04:41:04.293 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.288+0000 7ffa3cff9700 1 -- 172.21.15.62:0/3368716352 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa280070d0 con 0x7ffa400cb1f0 2023-06-09T04:41:04.293 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.288+0000 7ffa45a91700 1 -- 172.21.15.62:0/3368716352 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa4015f290 con 0x7ffa400cb1f0 2023-06-09T04:41:04.293 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.288+0000 7ffa3cff9700 1 -- 172.21.15.62:0/3368716352 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa28007460 con 0x7ffa400cb1f0 2023-06-09T04:41:04.293 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.288+0000 7ffa45a91700 1 -- 172.21.15.62:0/3368716352 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa4015eaa0 con 0x7ffa400cb1f0 2023-06-09T04:41:04.294 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.288+0000 7ffa45a91700 1 -- 172.21.15.62:0/3368716352 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa400b2450 con 0x7ffa400cb1f0 2023-06-09T04:41:04.295 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.292+0000 7ffa3cff9700 1 -- 172.21.15.62:0/3368716352 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ffa280075c0 con 0x7ffa400cb1f0 2023-06-09T04:41:04.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.292+0000 7ffa3cff9700 1 --2- 172.21.15.62:0/3368716352 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7ffa200662f0 0x7ffa200687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:04.297 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.292+0000 7ffa3cff9700 1 -- 172.21.15.62:0/3368716352 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ffa28083510 con 0x7ffa400cb1f0 2023-06-09T04:41:04.297 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.292+0000 7ffa3f7fe700 1 --2- 172.21.15.62:0/3368716352 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7ffa200662f0 0x7ffa200687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:04.298 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.292+0000 7ffa3f7fe700 1 --2- 172.21.15.62:0/3368716352 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7ffa200662f0 0x7ffa200687a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ffa30001560 tx=0x7ffa30009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:04.302 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.296+0000 7ffa3cff9700 1 -- 172.21.15.62:0/3368716352 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ffa400b2450 con 0x7ffa400cb1f0 2023-06-09T04:41:04.516 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.512+0000 7ffa45a91700 1 -- 172.21.15.62:0/3368716352 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ffa400b2410 con 0x7ffa400cb1f0 2023-06-09T04:41:04.517 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.512+0000 7ffa3cff9700 1 -- 172.21.15.62:0/3368716352 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7ffa28050600 con 0x7ffa400cb1f0 2023-06-09T04:41:04.517 INFO:teuthology.orchestra.run.smithi062.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-06-09T04:41:04.519 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.516+0000 7ffa45a91700 1 -- 172.21.15.62:0/3368716352 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7ffa200662f0 msgr2=0x7ffa200687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:04.519 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.516+0000 7ffa45a91700 1 --2- 172.21.15.62:0/3368716352 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7ffa200662f0 0x7ffa200687a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ffa30001560 tx=0x7ffa30009040 comp rx=0 tx=0).stop 2023-06-09T04:41:04.520 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.516+0000 7ffa45a91700 1 -- 172.21.15.62:0/3368716352 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa400cb1f0 msgr2=0x7ffa4015e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:04.520 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.516+0000 7ffa45a91700 1 --2- 172.21.15.62:0/3368716352 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa400cb1f0 0x7ffa4015e560 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ffa2800c560 tx=0x7ffa2800c870 comp rx=0 tx=0).stop 2023-06-09T04:41:04.520 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.516+0000 7ffa45a91700 1 -- 172.21.15.62:0/3368716352 shutdown_connections 2023-06-09T04:41:04.521 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.516+0000 7ffa45a91700 1 --2- 172.21.15.62:0/3368716352 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7ffa200662f0 0x7ffa200687a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:04.521 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.516+0000 7ffa45a91700 1 --2- 172.21.15.62:0/3368716352 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffa4015c0f0 0x7ffa4015c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:04.521 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.516+0000 7ffa45a91700 1 --2- 172.21.15.62:0/3368716352 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ffa400cb1f0 0x7ffa4015e560 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:04.521 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.516+0000 7ffa45a91700 1 --2- 172.21.15.62:0/3368716352 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ffa400ad480 0x7ffa401480c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:04.521 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.516+0000 7ffa45a91700 1 -- 172.21.15.62:0/3368716352 >> 172.21.15.62:0/3368716352 conn(0x7ffa4006a410 msgr2=0x7ffa400701d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:04.521 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.516+0000 7ffa45a91700 1 -- 172.21.15.62:0/3368716352 shutdown_connections 2023-06-09T04:41:04.521 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:04.516+0000 7ffa45a91700 1 -- 172.21.15.62:0/3368716352 wait complete. 2023-06-09T04:41:04.540 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-06-09T04:41:04.541 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-09T04:41:04.541 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi062.front.sepia.ceph.com 2023-06-09T04:41:04.541 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-06-09T04:41:04.542 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-06-09T04:41:04.542 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-06-09T04:41:04.542 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-09T04:41:04.542 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-09T04:41:04.542 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-06-09T04:41:04.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:04.543 DEBUG:teuthology.orchestra.run.smithi062:> ip addr 2023-06-09T04:41:04.561 INFO:teuthology.orchestra.run.smithi062.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-09T04:41:04.562 INFO:teuthology.orchestra.run.smithi062.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-09T04:41:04.562 INFO:teuthology.orchestra.run.smithi062.stdout: inet 127.0.0.1/8 scope host lo 2023-06-09T04:41:04.562 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:41:04.562 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 ::1/128 scope host 2023-06-09T04:41:04.562 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:41:04.562 INFO:teuthology.orchestra.run.smithi062.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-09T04:41:04.563 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:a9:aa:14 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:41:04.563 INFO:teuthology.orchestra.run.smithi062.stdout: altname enp7s0f0 2023-06-09T04:41:04.563 INFO:teuthology.orchestra.run.smithi062.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-09T04:41:04.563 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:a9:aa:15 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:41:04.563 INFO:teuthology.orchestra.run.smithi062.stdout: altname enp7s0f1 2023-06-09T04:41:04.563 INFO:teuthology.orchestra.run.smithi062.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-09T04:41:04.563 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:bb:d1:c2 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:41:04.563 INFO:teuthology.orchestra.run.smithi062.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-09T04:41:04.564 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:bb:d1:c3 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:41:04.564 INFO:teuthology.orchestra.run.smithi062.stdout: inet 172.21.15.62/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-06-09T04:41:04.564 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft 42442sec preferred_lft 42442sec 2023-06-09T04:41:04.564 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 fe80::ec4:7aff:febb:d1c3/64 scope link 2023-06-09T04:41:04.564 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:41:04.564 INFO:teuthology.orchestra.run.smithi062.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-06-09T04:41:04.564 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 02:42:bd:2a:61:d1 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:41:04.565 INFO:teuthology.orchestra.run.smithi062.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-06-09T04:41:04.565 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:41:04.566 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-06-09T04:41:04.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:04.566 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec bash -c ' 2023-06-09T04:41:04.567 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2023-06-09T04:41:04.567 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link add name ceph-brx type bridge 2023-06-09T04:41:04.567 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip addr flush dev ceph-brx 2023-06-09T04:41:04.567 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link set ceph-brx up 2023-06-09T04:41:04.568 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-06-09T04:41:04.568 DEBUG:teuthology.orchestra.run.smithi062:> ') 2023-06-09T04:41:04.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:04.721 DEBUG:teuthology.orchestra.run.smithi062:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-09T04:41:04.757 INFO:teuthology.orchestra.run.smithi062.stdout:1 2023-06-09T04:41:04.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:04.760 DEBUG:teuthology.orchestra.run.smithi062:> route 2023-06-09T04:41:04.848 INFO:teuthology.orchestra.run.smithi062.stdout:Kernel IP routing table 2023-06-09T04:41:04.849 INFO:teuthology.orchestra.run.smithi062.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-09T04:41:04.849 INFO:teuthology.orchestra.run.smithi062.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-06-09T04:41:04.849 INFO:teuthology.orchestra.run.smithi062.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-06-09T04:41:04.849 INFO:teuthology.orchestra.run.smithi062.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-06-09T04:41:04.849 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-06-09T04:41:04.849 INFO:teuthology.orchestra.run.smithi062.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-09T04:41:04.849 INFO:teuthology.orchestra.run.smithi062.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-09T04:41:04.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:04.851 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec bash -c ' 2023-06-09T04:41:04.851 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2023-06-09T04:41:04.851 DEBUG:teuthology.orchestra.run.smithi062:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-06-09T04:41:04.852 DEBUG:teuthology.orchestra.run.smithi062:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-06-09T04:41:04.852 DEBUG:teuthology.orchestra.run.smithi062:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-06-09T04:41:04.852 DEBUG:teuthology.orchestra.run.smithi062:> ') 2023-06-09T04:41:04.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:04.995 DEBUG:teuthology.orchestra.run.smithi062:> ip netns list 2023-06-09T04:41:05.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:05.014 DEBUG:teuthology.orchestra.run.smithi062:> ip netns list-id 2023-06-09T04:41:05.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:05.072 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec bash -c ' 2023-06-09T04:41:05.073 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2023-06-09T04:41:05.073 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-06-09T04:41:05.073 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-06-09T04:41:05.074 DEBUG:teuthology.orchestra.run.smithi062:> ') 2023-06-09T04:41:05.187 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-06-09T04:41:05.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:05.188 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec bash -c ' 2023-06-09T04:41:05.188 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2023-06-09T04:41:05.188 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-06-09T04:41:05.189 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-06-09T04:41:05.189 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-06-09T04:41:05.189 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-06-09T04:41:05.189 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-06-09T04:41:05.190 DEBUG:teuthology.orchestra.run.smithi062:> ') 2023-06-09T04:41:05.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:05.362 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec bash -c ' 2023-06-09T04:41:05.362 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2023-06-09T04:41:05.362 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link set brx.0 up 2023-06-09T04:41:05.363 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link set dev brx.0 master ceph-brx 2023-06-09T04:41:05.363 DEBUG:teuthology.orchestra.run.smithi062:> ') 2023-06-09T04:41:05.431 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-06-09T04:41:05.432 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-09T04:41:05.432 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-06-09T04:41:05.447 INFO:teuthology.orchestra.run.smithi062.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-06-09T04:41:05.448 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-09T04:41:05.448 DEBUG:teuthology.orchestra.run.smithi062:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-06-09T04:41:05.510 DEBUG:teuthology.orchestra.run.smithi062:> sudo modprobe fuse 2023-06-09T04:41:05.594 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-09T04:41:05.594 DEBUG:teuthology.orchestra.run.smithi062:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-09T04:41:05.670 INFO:teuthology.orchestra.run.smithi062.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-09T04:41:05.673 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-09T04:41:05.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:05.674 DEBUG:teuthology.orchestra.run.smithi062:> ls /sys/fs/fuse/connections 2023-06-09T04:41:05.732 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-06-09T04:41:05.733 DEBUG:teuthology.orchestra.run.smithi062:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-06-09T04:41:05.780 DEBUG:teuthology.orchestra.run.smithi062:> sudo modprobe fuse 2023-06-09T04:41:05.814 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-09T04:41:05.814 DEBUG:teuthology.orchestra.run.smithi062:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-09T04:41:05.891 INFO:teuthology.orchestra.run.smithi062.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-09T04:41:05.894 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-09T04:41:05.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:05.895 DEBUG:teuthology.orchestra.run.smithi062:> ls /sys/fs/fuse/connections 2023-06-09T04:41:05.925 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi062.stderr:2023-06-09T04:41:05.920+0000 7fce7d036640 -1 init, newargv = 0x55d08a0ac240 newargc=15 2023-06-09T04:41:05.925 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi062.stderr:ceph-fuse[40370]: starting ceph client 2023-06-09T04:41:05.941 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi062.stderr:ceph-fuse[40370]: starting fuse 2023-06-09T04:41:07.040 DEBUG:teuthology.orchestra.run.smithi062:> sudo modprobe fuse 2023-06-09T04:41:07.078 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-09T04:41:07.078 DEBUG:teuthology.orchestra.run.smithi062:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-09T04:41:07.156 INFO:teuthology.orchestra.run.smithi062.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-09T04:41:07.159 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-09T04:41:07.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:07.160 DEBUG:teuthology.orchestra.run.smithi062:> ls /sys/fs/fuse/connections 2023-06-09T04:41:07.221 INFO:teuthology.orchestra.run.smithi062.stdout:48 2023-06-09T04:41:07.221 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [48] 2023-06-09T04:41:07.222 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-06-09T04:41:07.222 DEBUG:teuthology.orchestra.run.smithi062:> import glob 2023-06-09T04:41:07.222 DEBUG:teuthology.orchestra.run.smithi062:> import re 2023-06-09T04:41:07.223 DEBUG:teuthology.orchestra.run.smithi062:> import os 2023-06-09T04:41:07.223 DEBUG:teuthology.orchestra.run.smithi062:> import subprocess 2023-06-09T04:41:07.223 DEBUG:teuthology.orchestra.run.smithi062:> 2023-06-09T04:41:07.223 DEBUG:teuthology.orchestra.run.smithi062:> def _find_admin_socket(client_name): 2023-06-09T04:41:07.224 DEBUG:teuthology.orchestra.run.smithi062:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-06-09T04:41:07.224 DEBUG:teuthology.orchestra.run.smithi062:> files = glob.glob(asok_path) 2023-06-09T04:41:07.224 DEBUG:teuthology.orchestra.run.smithi062:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-06-09T04:41:07.225 DEBUG:teuthology.orchestra.run.smithi062:> 2023-06-09T04:41:07.225 DEBUG:teuthology.orchestra.run.smithi062:> # Given a non-glob path, it better be there 2023-06-09T04:41:07.225 DEBUG:teuthology.orchestra.run.smithi062:> if "*" not in asok_path: 2023-06-09T04:41:07.225 DEBUG:teuthology.orchestra.run.smithi062:> assert(len(files) == 1) 2023-06-09T04:41:07.226 DEBUG:teuthology.orchestra.run.smithi062:> return files[0] 2023-06-09T04:41:07.226 DEBUG:teuthology.orchestra.run.smithi062:> 2023-06-09T04:41:07.226 DEBUG:teuthology.orchestra.run.smithi062:> for f in files: 2023-06-09T04:41:07.226 DEBUG:teuthology.orchestra.run.smithi062:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-06-09T04:41:07.227 DEBUG:teuthology.orchestra.run.smithi062:> if os.path.exists("/proc/{0}".format(pid)): 2023-06-09T04:41:07.227 DEBUG:teuthology.orchestra.run.smithi062:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-06-09T04:41:07.227 DEBUG:teuthology.orchestra.run.smithi062:> contents = proc_f.read() 2023-06-09T04:41:07.227 DEBUG:teuthology.orchestra.run.smithi062:> if mountpoint in contents: 2023-06-09T04:41:07.228 DEBUG:teuthology.orchestra.run.smithi062:> return f 2023-06-09T04:41:07.228 DEBUG:teuthology.orchestra.run.smithi062:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-06-09T04:41:07.228 DEBUG:teuthology.orchestra.run.smithi062:> 2023-06-09T04:41:07.228 DEBUG:teuthology.orchestra.run.smithi062:> print(_find_admin_socket("client.admin")) 2023-06-09T04:41:07.229 DEBUG:teuthology.orchestra.run.smithi062:> ' 2023-06-09T04:41:07.377 INFO:teuthology.orchestra.run.smithi062.stdout:/var/run/ceph/ceph-client.admin.40370.asok 2023-06-09T04:41:07.562 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.40370.asok 2023-06-09T04:41:07.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:07.563 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.40370.asok status 2023-06-09T04:41:07.757 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2023-06-09T04:41:07.757 INFO:teuthology.orchestra.run.smithi062.stdout: "metadata": { 2023-06-09T04:41:07.757 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph_sha1": "a02638f808b8fe11bccdd01222c0e6e2eb71120b", 2023-06-09T04:41:07.757 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph_version": "ceph version 18.0.0-4313-ga02638f8 (a02638f808b8fe11bccdd01222c0e6e2eb71120b) reef (dev)", 2023-06-09T04:41:07.758 INFO:teuthology.orchestra.run.smithi062.stdout: "entity_id": "admin", 2023-06-09T04:41:07.758 INFO:teuthology.orchestra.run.smithi062.stdout: "hostname": "smithi062", 2023-06-09T04:41:07.758 INFO:teuthology.orchestra.run.smithi062.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-06-09T04:41:07.758 INFO:teuthology.orchestra.run.smithi062.stdout: "pid": "40370", 2023-06-09T04:41:07.758 INFO:teuthology.orchestra.run.smithi062.stdout: "root": "/" 2023-06-09T04:41:07.758 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-06-09T04:41:07.758 INFO:teuthology.orchestra.run.smithi062.stdout: "dentry_count": 0, 2023-06-09T04:41:07.759 INFO:teuthology.orchestra.run.smithi062.stdout: "dentry_pinned_count": 0, 2023-06-09T04:41:07.759 INFO:teuthology.orchestra.run.smithi062.stdout: "id": 4458, 2023-06-09T04:41:07.759 INFO:teuthology.orchestra.run.smithi062.stdout: "inst": { 2023-06-09T04:41:07.759 INFO:teuthology.orchestra.run.smithi062.stdout: "name": { 2023-06-09T04:41:07.759 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "client", 2023-06-09T04:41:07.759 INFO:teuthology.orchestra.run.smithi062.stdout: "num": 4458 2023-06-09T04:41:07.759 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-06-09T04:41:07.759 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": { 2023-06-09T04:41:07.760 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2023-06-09T04:41:07.760 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "192.168.0.1:0", 2023-06-09T04:41:07.760 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 123618526 2023-06-09T04:41:07.760 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-06-09T04:41:07.760 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-06-09T04:41:07.760 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": { 2023-06-09T04:41:07.760 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "v1", 2023-06-09T04:41:07.761 INFO:teuthology.orchestra.run.smithi062.stdout: "addr": "192.168.0.1:0", 2023-06-09T04:41:07.761 INFO:teuthology.orchestra.run.smithi062.stdout: "nonce": 123618526 2023-06-09T04:41:07.761 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-06-09T04:41:07.761 INFO:teuthology.orchestra.run.smithi062.stdout: "inst_str": "client.4458 192.168.0.1:0/123618526", 2023-06-09T04:41:07.761 INFO:teuthology.orchestra.run.smithi062.stdout: "addr_str": "192.168.0.1:0/123618526", 2023-06-09T04:41:07.761 INFO:teuthology.orchestra.run.smithi062.stdout: "inode_count": 1, 2023-06-09T04:41:07.761 INFO:teuthology.orchestra.run.smithi062.stdout: "mds_epoch": 7, 2023-06-09T04:41:07.761 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_epoch": 28, 2023-06-09T04:41:07.762 INFO:teuthology.orchestra.run.smithi062.stdout: "osd_epoch_barrier": 0, 2023-06-09T04:41:07.762 INFO:teuthology.orchestra.run.smithi062.stdout: "blocklisted": false, 2023-06-09T04:41:07.762 INFO:teuthology.orchestra.run.smithi062.stdout: "fs_name": "cephfs" 2023-06-09T04:41:07.762 INFO:teuthology.orchestra.run.smithi062.stdout:} 2023-06-09T04:41:07.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:07.770 DEBUG:teuthology.orchestra.run.smithi062:> stat --file-system '--printf=%T 2023-06-09T04:41:07.771 DEBUG:teuthology.orchestra.run.smithi062:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-06-09T04:41:07.789 INFO:teuthology.orchestra.run.smithi062.stdout:fuseblk 2023-06-09T04:41:07.790 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-06-09T04:41:07.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:07.790 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-06-09T04:41:07.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:07.866 DEBUG:teuthology.orchestra.run.smithi062:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-06-09T04:41:08.420 INFO:teuthology.orchestra.run.smithi062.stdout:# file: . 2023-06-09T04:41:08.420 INFO:teuthology.orchestra.run.smithi062.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-06-09T04:41:08.420 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:41:08.421 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-06-09T04:41:08.421 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:41:08.437 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:41:08.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:08.652+0000 7f8e15a34700 1 Processor -- start 2023-06-09T04:41:08.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:08.652+0000 7f8e15a34700 1 -- start start 2023-06-09T04:41:08.660 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:08.656+0000 7f8e15a34700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8e100cd4f0 0x7f8e100cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:08.661 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:08.656+0000 7f8e15a34700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e100c9ea0 0x7f8e100ca320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:08.661 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:08.656+0000 7f8e15a34700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e10071180 con 0x7f8e10159a40 2023-06-09T04:41:08.661 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:08.656+0000 7f8e15a34700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e100cbc00 con 0x7f8e100cd4f0 2023-06-09T04:41:08.661 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:08.656+0000 7f8e15a34700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e100ca860 con 0x7f8e100c9ea0 2023-06-09T04:41:08.662 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:08.656+0000 7f8e0effd700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f8e10159a40 0x7f8e10070a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:38600/0 (socket says 172.21.15.62:38600) 2023-06-09T04:41:08.662 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:08.656+0000 7f8e0effd700 1 -- 172.21.15.62:0/2468049360 learned_addr learned my addr 172.21.15.62:0/2468049360 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:41:08.662 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:08.656+0000 7f8e0f7fe700 1 --2- 172.21.15.62:0/2468049360 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e100c9ea0 0x7f8e100ca320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:08.662 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:08.656+0000 7f8e067fc700 1 --2- 172.21.15.62:0/2468049360 >> v2:172.21.15.89:3300/0 conn(0x7f8e100cd4f0 0x7f8e100cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:08.663 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:08.656+0000 7f8e0f7fe700 1 -- 172.21.15.62:0/2468049360 >> v2:172.21.15.89:3300/0 conn(0x7f8e100cd4f0 msgr2=0x7f8e100cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:08.663 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:08.656+0000 7f8e0f7fe700 1 --2- 172.21.15.62:0/2468049360 >> v2:172.21.15.89:3300/0 conn(0x7f8e100cd4f0 0x7f8e100cc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:08.663 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:08.656+0000 7f8e0e7fc700 1 -- 172.21.15.62:0/2468049360 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3017587805 0 0) 0x7f8e00001110 con 0x7f8e10159a40 2023-06-09T04:41:08.663 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:08.656+0000 7f8e0f7fe700 1 -- 172.21.15.62:0/2468049360 >> v1:172.21.15.62:6789/0 conn(0x7f8e10159a40 legacy=0x7f8e10070a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:08.663 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:08.656+0000 7f8e0f7fe700 1 -- 172.21.15.62:0/2468049360 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e100cc180 con 0x7f8e100c9ea0 2023-06-09T04:41:08.663 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:08.660+0000 7f8e0f7fe700 1 --2- 172.21.15.62:0/2468049360 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e100c9ea0 0x7f8e100ca320 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8e08009d90 tx=0x7f8e0800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=878ac4f7b0e9ec9e server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:08.664 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:08.660+0000 7f8e0e7fc700 1 -- 172.21.15.62:0/2468049360 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0800e070 con 0x7f8e100c9ea0 2023-06-09T04:41:08.664 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:08.660+0000 7f8e0e7fc700 1 -- 172.21.15.62:0/2468049360 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e0800bb20 con 0x7f8e100c9ea0 2023-06-09T04:41:08.664 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:08.660+0000 7f8e0e7fc700 1 -- 172.21.15.62:0/2468049360 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e08012430 con 0x7f8e100c9ea0 2023-06-09T04:41:08.665 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:08.660+0000 7f8e15a34700 1 -- 172.21.15.62:0/2468049360 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e100c9ea0 msgr2=0x7f8e100ca320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:08.665 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:08.660+0000 7f8e15a34700 1 --2- 172.21.15.62:0/2468049360 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e100c9ea0 0x7f8e100ca320 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8e08009d90 tx=0x7f8e0800b330 comp rx=0 tx=0).stop 2023-06-09T04:41:08.665 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:08.660+0000 7f8e15a34700 1 -- 172.21.15.62:0/2468049360 shutdown_connections 2023-06-09T04:41:08.665 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:08.660+0000 7f8e15a34700 1 --2- 172.21.15.62:0/2468049360 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e100c9ea0 0x7f8e100ca320 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:08.665 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:08.660+0000 7f8e15a34700 1 --2- 172.21.15.62:0/2468049360 >> v2:172.21.15.89:3300/0 conn(0x7f8e100cd4f0 0x7f8e100cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:08.665 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:08.660+0000 7f8e15a34700 1 -- 172.21.15.62:0/2468049360 >> 172.21.15.62:0/2468049360 conn(0x7f8e1006a420 msgr2=0x7f8e100afc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:08.666 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:08.660+0000 7f8e15a34700 1 -- 172.21.15.62:0/2468049360 shutdown_connections 2023-06-09T04:41:08.666 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:08.660+0000 7f8e15a34700 1 -- 172.21.15.62:0/2468049360 wait complete. 2023-06-09T04:41:08.668 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:08.664+0000 7f8e15a34700 1 Processor -- start 2023-06-09T04:41:08.668 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:08.664+0000 7f8e15a34700 1 -- start start 2023-06-09T04:41:08.670 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:08.664+0000 7f8e15a34700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e100cd4f0 0x7f8e10150c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:08.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:08.664+0000 7f8e15a34700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e10159a40 0x7f8e1014cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:08.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:08.664+0000 7f8e15a34700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e100b38a0 0x7f8e101568d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:08.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:08.664+0000 7f8e15a34700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e10151160 con 0x7f8e10159a40 2023-06-09T04:41:08.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:08.664+0000 7f8e15a34700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e100b2b70 con 0x7f8e100cd4f0 2023-06-09T04:41:08.672 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:08.664+0000 7f8e15a34700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1015cac0 con 0x7f8e100b38a0 2023-06-09T04:41:08.672 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:08.668+0000 7f8e067fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e10159a40 0x7f8e1014cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:08.672 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:08.668+0000 7f8e067fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e10159a40 0x7f8e1014cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:41228/0 (socket says 172.21.15.62:41228) 2023-06-09T04:41:08.672 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:08.668+0000 7f8e067fc700 1 -- 172.21.15.62:0/1120912856 learned_addr learned my addr 172.21.15.62:0/1120912856 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:08.672 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:08.668+0000 7f8e0f7fe700 1 --2- 172.21.15.62:0/1120912856 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e100b38a0 0x7f8e101568d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:08.673 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:08.668+0000 7f8e0effd700 1 --2- 172.21.15.62:0/1120912856 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e100cd4f0 0x7f8e10150c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:08.673 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:08.668+0000 7f8e067fc700 1 -- 172.21.15.62:0/1120912856 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e100b38a0 msgr2=0x7f8e101568d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:08.673 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:08.668+0000 7f8e067fc700 1 --2- 172.21.15.62:0/1120912856 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e100b38a0 0x7f8e101568d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:08.673 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:08.668+0000 7f8e067fc700 1 -- 172.21.15.62:0/1120912856 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e100cd4f0 msgr2=0x7f8e10150c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:08.673 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:08.668+0000 7f8e067fc700 1 --2- 172.21.15.62:0/1120912856 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e100cd4f0 0x7f8e10150c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:08.673 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:08.668+0000 7f8e067fc700 1 -- 172.21.15.62:0/1120912856 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e08009a70 con 0x7f8e10159a40 2023-06-09T04:41:08.673 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:08.668+0000 7f8e0effd700 1 --2- 172.21.15.62:0/1120912856 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e100cd4f0 0x7f8e10150c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:41:08.674 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:08.668+0000 7f8e067fc700 1 --2- 172.21.15.62:0/1120912856 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e10159a40 0x7f8e1014cd80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8df800e9d0 tx=0x7f8df800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:08.674 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:08.668+0000 7f8e0cff9700 1 -- 172.21.15.62:0/1120912856 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df8009720 con 0x7f8e10159a40 2023-06-09T04:41:08.674 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:08.668+0000 7f8e0cff9700 1 -- 172.21.15.62:0/1120912856 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8df800c850 con 0x7f8e10159a40 2023-06-09T04:41:08.674 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:08.668+0000 7f8e0cff9700 1 -- 172.21.15.62:0/1120912856 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df800cbc0 con 0x7f8e10159a40 2023-06-09T04:41:08.675 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:08.668+0000 7f8e15a34700 1 -- 172.21.15.62:0/1120912856 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e100b2dc0 con 0x7f8e10159a40 2023-06-09T04:41:08.675 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:08.668+0000 7f8e15a34700 1 -- 172.21.15.62:0/1120912856 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e100b3380 con 0x7f8e10159a40 2023-06-09T04:41:08.675 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:08.672+0000 7f8e15a34700 1 -- 172.21.15.62:0/1120912856 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e100739c0 con 0x7f8e10159a40 2023-06-09T04:41:08.677 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:08.672+0000 7f8e0cff9700 1 -- 172.21.15.62:0/1120912856 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8df800cd20 con 0x7f8e10159a40 2023-06-09T04:41:08.679 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:08.676+0000 7f8e0cff9700 1 --2- 172.21.15.62:0/1120912856 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f8df0066320 0x7f8df00687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:08.679 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:08.676+0000 7f8e0cff9700 1 -- 172.21.15.62:0/1120912856 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8df80844e0 con 0x7f8e10159a40 2023-06-09T04:41:08.680 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:08.676+0000 7f8e0effd700 1 --2- 172.21.15.62:0/1120912856 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f8df0066320 0x7f8df00687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:08.681 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:08.676+0000 7f8e0effd700 1 --2- 172.21.15.62:0/1120912856 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f8df0066320 0x7f8df00687d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8e00000f60 tx=0x7f8e00007b00 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:08.686 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:08.680+0000 7f8e0cff9700 1 -- 172.21.15.62:0/1120912856 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8df8051540 con 0x7f8e10159a40 2023-06-09T04:41:08.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:08.860+0000 7f8e15a34700 1 -- 172.21.15.62:0/1120912856 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8e100cd0a0 con 0x7f8e10159a40 2023-06-09T04:41:08.869 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:08.864+0000 7f8e0cff9700 1 -- 172.21.15.62:0/1120912856 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20084 (secure 0 0 0) 0x7f8df8054b60 con 0x7f8e10159a40 2023-06-09T04:41:08.869 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:41:08.869 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":28,"fsid":"f7998a1e-e5a9-4202-abaa-70c0eaae1047","created":"2023-06-09T04:40:30.469588+0000","modified":"2023-06-09T04:41:01.271858+0000","last_up_change":"2023-06-09T04:40:43.120747+0000","last_in_change":"2023-06-09T04:40:33.568221+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:40:44.646921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:40:50.006643+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:40:55.031273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:40:55.773517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-09T04:40:58.845383+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bc50bbc0-dd08-42ed-804c-ec3029e36c19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6802","nonce":1295788017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6807","nonce":1295788017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6815","nonce":1295788017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6809","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6811","nonce":1295788017}]},"public_addr":"172.21.15.62:6802/1295788017","cluster_addr":"172.21.15.62:6807/1295788017","heartbeat_back_addr":"172.21.15.62:6815/1295788017","heartbeat_front_addr":"172.21.15.62:6811/1295788017","state":["exists","up"]},{"osd":1,"uuid":"8230b12d-e22f-4985-a584-4cc64404cdbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6825","nonce":4120692006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6827","nonce":4120692006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6831","nonce":4120692006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6829","nonce":4120692006}]},"public_addr":"172.21.15.62:6825/4120692006","cluster_addr":"172.21.15.62:6827/4120692006","heartbeat_back_addr":"172.21.15.62:6831/4120692006","heartbeat_front_addr":"172.21.15.62:6829/4120692006","state":["exists","up"]},{"osd":2,"uuid":"d0202506-dbe9-4e3c-9271-687929abf96a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6801","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6803","nonce":4169607876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6805","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6806","nonce":4169607876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6814","nonce":4169607876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6810","nonce":4169607876}]},"public_addr":"172.21.15.62:6803/4169607876","cluster_addr":"172.21.15.62:6806/4169607876","heartbeat_back_addr":"172.21.15.62:6814/4169607876","heartbeat_front_addr":"172.21.15.62:6810/4169607876","state":["exists","up"]},{"osd":3,"uuid":"f3c0298a-b075-4411-af50-e16cd74fdddb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6817","nonce":3268438986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6819","nonce":3268438986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6823","nonce":3268438986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6821","nonce":3268438986}]},"public_addr":"172.21.15.62:6817/3268438986","cluster_addr":"172.21.15.62:6819/3268438986","heartbeat_back_addr":"172.21.15.62:6823/3268438986","heartbeat_front_addr":"172.21.15.62:6821/3268438986","state":["exists","up"]},{"osd":4,"uuid":"1ab5c5ca-e74f-475a-a309-683cc0029928","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6817","nonce":3139617628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6819","nonce":3139617628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6823","nonce":3139617628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6821","nonce":3139617628}]},"public_addr":"172.21.15.89:6817/3139617628","cluster_addr":"172.21.15.89:6819/3139617628","heartbeat_back_addr":"172.21.15.89:6823/3139617628","heartbeat_front_addr":"172.21.15.89:6821/3139617628","state":["exists","up"]},{"osd":5,"uuid":"a933e184-bd8f-4369-a1ba-a68de53c578c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6825","nonce":2681723596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6827","nonce":2681723596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6831","nonce":2681723596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6829","nonce":2681723596}]},"public_addr":"172.21.15.89:6825/2681723596","cluster_addr":"172.21.15.89:6827/2681723596","heartbeat_back_addr":"172.21.15.89:6831/2681723596","heartbeat_front_addr":"172.21.15.89:6829/2681723596","state":["exists","up"]},{"osd":6,"uuid":"1ed7ad37-2eee-49a6-954c-b537e2b7f0ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6809","nonce":1657136033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6811","nonce":1657136033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6815","nonce":1657136033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6813","nonce":1657136033}]},"public_addr":"172.21.15.89:6809/1657136033","cluster_addr":"172.21.15.89:6811/1657136033","heartbeat_back_addr":"172.21.15.89:6815/1657136033","heartbeat_front_addr":"172.21.15.89:6813/1657136033","state":["exists","up"]},{"osd":7,"uuid":"6ed732e9-33ff-40df-9038-a9f1d1622671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6801","nonce":1710561686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6803","nonce":1710561686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6807","nonce":1710561686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6805","nonce":1710561686}]},"public_addr":"172.21.15.89:6801/1710561686","cluster_addr":"172.21.15.89:6803/1710561686","heartbeat_back_addr":"172.21.15.89:6807/1710561686","heartbeat_front_addr":"172.21.15.89:6805/1710561686","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.335803+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.419788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.179334+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.263310+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.071846+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.375627+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.282277+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.315997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:41:08.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:08.868+0000 7f8e15a34700 1 -- 172.21.15.62:0/1120912856 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f8df0066320 msgr2=0x7f8df00687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:08.872 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:08.868+0000 7f8e15a34700 1 --2- 172.21.15.62:0/1120912856 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f8df0066320 0x7f8df00687d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8e00000f60 tx=0x7f8e00007b00 comp rx=0 tx=0).stop 2023-06-09T04:41:08.872 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:08.868+0000 7f8e15a34700 1 -- 172.21.15.62:0/1120912856 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e10159a40 msgr2=0x7f8e1014cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:08.872 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:08.868+0000 7f8e15a34700 1 --2- 172.21.15.62:0/1120912856 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e10159a40 0x7f8e1014cd80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8df800e9d0 tx=0x7f8df800ece0 comp rx=0 tx=0).stop 2023-06-09T04:41:08.872 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:08.868+0000 7f8e15a34700 1 -- 172.21.15.62:0/1120912856 shutdown_connections 2023-06-09T04:41:08.872 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:08.868+0000 7f8e15a34700 1 --2- 172.21.15.62:0/1120912856 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f8df0066320 0x7f8df00687d0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:08.872 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:08.868+0000 7f8e15a34700 1 --2- 172.21.15.62:0/1120912856 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8e100b38a0 0x7f8e101568d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:08.872 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:08.868+0000 7f8e15a34700 1 --2- 172.21.15.62:0/1120912856 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e10159a40 0x7f8e1014cd80 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:08.873 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:08.868+0000 7f8e15a34700 1 --2- 172.21.15.62:0/1120912856 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8e100cd4f0 0x7f8e10150c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:08.873 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:08.868+0000 7f8e15a34700 1 -- 172.21.15.62:0/1120912856 >> 172.21.15.62:0/1120912856 conn(0x7f8e100c9ea0 msgr2=0x7f8e1006b880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:08.873 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:08.868+0000 7f8e15a34700 1 -- 172.21.15.62:0/1120912856 shutdown_connections 2023-06-09T04:41:08.873 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:08.868+0000 7f8e15a34700 1 -- 172.21.15.62:0/1120912856 wait complete. 2023-06-09T04:41:08.892 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:40:44.646921+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:40:50.006643+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T04:40:55.031273+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T04:40:55.773517+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-09T04:40:58.845383+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-09T04:41:08.893 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:41:09.074 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.068+0000 7fab4919e700 1 Processor -- start 2023-06-09T04:41:09.074 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.068+0000 7fab4919e700 1 -- start start 2023-06-09T04:41:09.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.072+0000 7fab4919e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fab4406f610 0x7fab440afb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:09.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.072+0000 7fab4919e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fab440b0090 0x7fab440c8720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:09.077 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.072+0000 7fab4919e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab440b04f0 con 0x7fab44071730 2023-06-09T04:41:09.077 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.072+0000 7fab4919e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab4415d860 con 0x7fab440b0090 2023-06-09T04:41:09.077 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.072+0000 7fab4919e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab44071b00 con 0x7fab4406f610 2023-06-09T04:41:09.077 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.072+0000 7fab4899d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fab440b0090 0x7fab440c8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:09.077 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.072+0000 7fab437fe700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fab4406f610 0x7fab440afb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:09.078 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.072+0000 7fab4899d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fab440b0090 0x7fab440c8720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:41238/0 (socket says 172.21.15.62:41238) 2023-06-09T04:41:09.078 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.072+0000 7fab4899d700 1 -- 172.21.15.62:0/1065471629 learned_addr learned my addr 172.21.15.62:0/1065471629 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:09.078 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.072+0000 7fab4899d700 1 -- 172.21.15.62:0/1065471629 >> v2:172.21.15.89:3300/0 conn(0x7fab4406f610 msgr2=0x7fab440afb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:09.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.072+0000 7fab4899d700 1 --2- 172.21.15.62:0/1065471629 >> v2:172.21.15.89:3300/0 conn(0x7fab4406f610 0x7fab440afb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:09.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.072+0000 7fab4899d700 1 -- 172.21.15.62:0/1065471629 >> v1:172.21.15.89:6789/0 conn(0x7fab44071730 legacy=0x7fab440ca1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:09.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.072+0000 7fab4899d700 1 -- 172.21.15.62:0/1065471629 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab4415dab0 con 0x7fab440b0090 2023-06-09T04:41:09.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.076+0000 7fab4899d700 1 --2- 172.21.15.62:0/1065471629 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab440b0090 0x7fab440c8720 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fab4406f110 tx=0x7fab3c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=336ba0a7f053209b server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:09.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.076+0000 7fab42ffd700 1 -- 172.21.15.62:0/1065471629 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab3c00e070 con 0x7fab440b0090 2023-06-09T04:41:09.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.076+0000 7fab42ffd700 1 -- 172.21.15.62:0/1065471629 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab3c00b910 con 0x7fab440b0090 2023-06-09T04:41:09.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.076+0000 7fab42ffd700 1 -- 172.21.15.62:0/1065471629 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab3c00bcc0 con 0x7fab440b0090 2023-06-09T04:41:09.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.076+0000 7fab4919e700 1 -- 172.21.15.62:0/1065471629 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab440b0090 msgr2=0x7fab440c8720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:09.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.076+0000 7fab4919e700 1 --2- 172.21.15.62:0/1065471629 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab440b0090 0x7fab440c8720 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fab4406f110 tx=0x7fab3c00b330 comp rx=0 tx=0).stop 2023-06-09T04:41:09.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.076+0000 7fab4919e700 1 -- 172.21.15.62:0/1065471629 shutdown_connections 2023-06-09T04:41:09.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.076+0000 7fab4919e700 1 --2- 172.21.15.62:0/1065471629 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab440b0090 0x7fab440c8720 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:09.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.076+0000 7fab4919e700 1 --2- 172.21.15.62:0/1065471629 >> v2:172.21.15.89:3300/0 conn(0x7fab4406f610 0x7fab440afb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:09.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.076+0000 7fab4919e700 1 -- 172.21.15.62:0/1065471629 >> 172.21.15.62:0/1065471629 conn(0x7fab440cab50 msgr2=0x7fab440caf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:09.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.076+0000 7fab4919e700 1 -- 172.21.15.62:0/1065471629 shutdown_connections 2023-06-09T04:41:09.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.076+0000 7fab4919e700 1 -- 172.21.15.62:0/1065471629 wait complete. 2023-06-09T04:41:09.084 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.080+0000 7fab4919e700 1 Processor -- start 2023-06-09T04:41:09.084 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.080+0000 7fab4919e700 1 -- start start 2023-06-09T04:41:09.086 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.080+0000 7fab4919e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab4406f610 0x7fab440ac2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:09.086 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.080+0000 7fab4919e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fab44071730 0x7fab44157220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:09.086 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.080+0000 7fab4919e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab440b0090 0x7fab4406c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:09.087 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.080+0000 7fab4919e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab440acba0 con 0x7fab4406f610 2023-06-09T04:41:09.087 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.080+0000 7fab4919e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab440ace80 con 0x7fab440b0090 2023-06-09T04:41:09.087 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.080+0000 7fab4919e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab440ad160 con 0x7fab44071730 2023-06-09T04:41:09.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.080+0000 7fab43fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab4406f610 0x7fab440ac2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:09.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.084+0000 7fab43fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab4406f610 0x7fab440ac2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:41244/0 (socket says 172.21.15.62:41244) 2023-06-09T04:41:09.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.084+0000 7fab43fff700 1 -- 172.21.15.62:0/2691647298 learned_addr learned my addr 172.21.15.62:0/2691647298 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:09.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.084+0000 7fab4899d700 1 --2- 172.21.15.62:0/2691647298 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab440b0090 0x7fab4406c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:09.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.084+0000 7fab437fe700 1 --2- 172.21.15.62:0/2691647298 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fab44071730 0x7fab44157220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:09.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.084+0000 7fab4899d700 1 -- 172.21.15.62:0/2691647298 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fab44071730 msgr2=0x7fab44157220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:09.089 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.084+0000 7fab4899d700 1 --2- 172.21.15.62:0/2691647298 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fab44071730 0x7fab44157220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:09.089 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.084+0000 7fab4899d700 1 -- 172.21.15.62:0/2691647298 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab4406f610 msgr2=0x7fab440ac2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:09.089 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.084+0000 7fab4899d700 1 --2- 172.21.15.62:0/2691647298 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab4406f610 0x7fab440ac2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:09.089 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.084+0000 7fab4899d700 1 -- 172.21.15.62:0/2691647298 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab3c009b30 con 0x7fab440b0090 2023-06-09T04:41:09.089 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.084+0000 7fab43fff700 1 --2- 172.21.15.62:0/2691647298 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab4406f610 0x7fab440ac2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:41:09.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.084+0000 7fab4899d700 1 --2- 172.21.15.62:0/2691647298 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab440b0090 0x7fab4406c9a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fab3c015000 tx=0x7fab3c004af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:09.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.084+0000 7fab40ff9700 1 -- 172.21.15.62:0/2691647298 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab3c004880 con 0x7fab440b0090 2023-06-09T04:41:09.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.084+0000 7fab40ff9700 1 -- 172.21.15.62:0/2691647298 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab3c0099b0 con 0x7fab440b0090 2023-06-09T04:41:09.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.084+0000 7fab4919e700 1 -- 172.21.15.62:0/2691647298 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab4415b5e0 con 0x7fab440b0090 2023-06-09T04:41:09.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.084+0000 7fab40ff9700 1 -- 172.21.15.62:0/2691647298 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab3c01c680 con 0x7fab440b0090 2023-06-09T04:41:09.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.084+0000 7fab4919e700 1 -- 172.21.15.62:0/2691647298 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab44157760 con 0x7fab440b0090 2023-06-09T04:41:09.091 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.084+0000 7fab4919e700 1 -- 172.21.15.62:0/2691647298 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab4415b820 con 0x7fab440b0090 2023-06-09T04:41:09.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.088+0000 7fab40ff9700 1 -- 172.21.15.62:0/2691647298 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fab3c01c7e0 con 0x7fab440b0090 2023-06-09T04:41:09.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.092+0000 7fab40ff9700 1 --2- 172.21.15.62:0/2691647298 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fab300662f0 0x7fab300687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:09.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.092+0000 7fab40ff9700 1 -- 172.21.15.62:0/2691647298 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fab3c085a90 con 0x7fab440b0090 2023-06-09T04:41:09.096 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.092+0000 7fab43fff700 1 --2- 172.21.15.62:0/2691647298 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fab300662f0 0x7fab300687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:09.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.092+0000 7fab43fff700 1 --2- 172.21.15.62:0/2691647298 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fab300662f0 0x7fab300687a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fab34001d30 tx=0x7fab34009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:09.102 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.096+0000 7fab40ff9700 1 -- 172.21.15.62:0/2691647298 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fab3c052c90 con 0x7fab440b0090 2023-06-09T04:41:09.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.272+0000 7fab4919e700 1 -- 172.21.15.62:0/2691647298 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fab440739c0 con 0x7fab440b0090 2023-06-09T04:41:09.276 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.272+0000 7fab40ff9700 1 -- 172.21.15.62:0/2691647298 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fab3c0562b0 con 0x7fab440b0090 2023-06-09T04:41:09.277 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2023-06-09T04:41:09.281 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.276+0000 7fab4919e700 1 -- 172.21.15.62:0/2691647298 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fab300662f0 msgr2=0x7fab300687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:09.282 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.276+0000 7fab4919e700 1 --2- 172.21.15.62:0/2691647298 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fab300662f0 0x7fab300687a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fab34001d30 tx=0x7fab34009040 comp rx=0 tx=0).stop 2023-06-09T04:41:09.282 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.276+0000 7fab4919e700 1 -- 172.21.15.62:0/2691647298 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab440b0090 msgr2=0x7fab4406c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:09.282 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.276+0000 7fab4919e700 1 --2- 172.21.15.62:0/2691647298 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab440b0090 0x7fab4406c9a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fab3c015000 tx=0x7fab3c004af0 comp rx=0 tx=0).stop 2023-06-09T04:41:09.282 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.276+0000 7fab4919e700 1 -- 172.21.15.62:0/2691647298 shutdown_connections 2023-06-09T04:41:09.282 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.276+0000 7fab4919e700 1 --2- 172.21.15.62:0/2691647298 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fab300662f0 0x7fab300687a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:09.282 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.276+0000 7fab4919e700 1 --2- 172.21.15.62:0/2691647298 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab440b0090 0x7fab4406c9a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:09.282 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.276+0000 7fab4919e700 1 --2- 172.21.15.62:0/2691647298 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fab44071730 0x7fab44157220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:09.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.276+0000 7fab4919e700 1 --2- 172.21.15.62:0/2691647298 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab4406f610 0x7fab440ac2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:09.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.276+0000 7fab4919e700 1 -- 172.21.15.62:0/2691647298 >> 172.21.15.62:0/2691647298 conn(0x7fab440cab50 msgr2=0x7fab44159660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:09.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.276+0000 7fab4919e700 1 -- 172.21.15.62:0/2691647298 shutdown_connections 2023-06-09T04:41:09.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.276+0000 7fab4919e700 1 -- 172.21.15.62:0/2691647298 wait complete. 2023-06-09T04:41:09.305 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:41:09.484 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.480+0000 7f4161468700 1 Processor -- start 2023-06-09T04:41:09.484 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.480+0000 7f4161468700 1 -- start start 2023-06-09T04:41:09.487 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.480+0000 7f4161468700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f415c06e250 0x7f415c160280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:09.487 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.480+0000 7f4161468700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f415c069f00 0x7f415c0cd0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:09.487 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.480+0000 7f4161468700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f415c071030 con 0x7f415c0c9830 2023-06-09T04:41:09.487 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.484+0000 7f4161468700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f415c15f8a0 con 0x7f415c069f00 2023-06-09T04:41:09.487 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.484+0000 7f4161468700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f415c1607c0 con 0x7f415c06e250 2023-06-09T04:41:09.488 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.484+0000 7f4160c67700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f415c069f00 0x7f415c0cd0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:09.488 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.484+0000 7f4160c67700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f415c069f00 0x7f415c0cd0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:41246/0 (socket says 172.21.15.62:41246) 2023-06-09T04:41:09.488 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.484+0000 7f4160c67700 1 -- 172.21.15.62:0/3884589741 learned_addr learned my addr 172.21.15.62:0/3884589741 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:09.488 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.484+0000 7f415bfff700 1 --2- 172.21.15.62:0/3884589741 >> v2:172.21.15.89:3300/0 conn(0x7f415c06e250 0x7f415c160280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:09.489 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.484+0000 7f4160c67700 1 -- 172.21.15.62:0/3884589741 >> v2:172.21.15.89:3300/0 conn(0x7f415c06e250 msgr2=0x7f415c160280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:09.489 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.484+0000 7f4160c67700 1 --2- 172.21.15.62:0/3884589741 >> v2:172.21.15.89:3300/0 conn(0x7f415c06e250 0x7f415c160280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:09.489 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.484+0000 7f4160c67700 1 -- 172.21.15.62:0/3884589741 >> v1:172.21.15.89:6789/0 conn(0x7f415c0c9830 legacy=0x7f415c0697f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:09.489 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.484+0000 7f4160c67700 1 -- 172.21.15.62:0/3884589741 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f415c071280 con 0x7f415c069f00 2023-06-09T04:41:09.490 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.484+0000 7f4160c67700 1 --2- 172.21.15.62:0/3884589741 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f415c069f00 0x7f415c0cd0e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f415c0cbbc0 tx=0x7f4154009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b7972cbd6da5346 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:09.490 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.484+0000 7f415affd700 1 -- 172.21.15.62:0/3884589741 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f415400b8a0 con 0x7f415c069f00 2023-06-09T04:41:09.490 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.484+0000 7f415affd700 1 -- 172.21.15.62:0/3884589741 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f415400ba00 con 0x7f415c069f00 2023-06-09T04:41:09.490 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.484+0000 7f415affd700 1 -- 172.21.15.62:0/3884589741 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f415400bd90 con 0x7f415c069f00 2023-06-09T04:41:09.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.484+0000 7f4161468700 1 -- 172.21.15.62:0/3884589741 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f415c069f00 msgr2=0x7f415c0cd0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:09.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.484+0000 7f4161468700 1 --2- 172.21.15.62:0/3884589741 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f415c069f00 0x7f415c0cd0e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f415c0cbbc0 tx=0x7f4154009bf0 comp rx=0 tx=0).stop 2023-06-09T04:41:09.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.484+0000 7f4161468700 1 -- 172.21.15.62:0/3884589741 shutdown_connections 2023-06-09T04:41:09.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.484+0000 7f4161468700 1 --2- 172.21.15.62:0/3884589741 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f415c069f00 0x7f415c0cd0e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:09.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.484+0000 7f4161468700 1 --2- 172.21.15.62:0/3884589741 >> v2:172.21.15.89:3300/0 conn(0x7f415c06e250 0x7f415c160280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:09.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.484+0000 7f4161468700 1 -- 172.21.15.62:0/3884589741 >> 172.21.15.62:0/3884589741 conn(0x7f415c0cbc60 msgr2=0x7f415c0cc030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:09.492 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.488+0000 7f4161468700 1 -- 172.21.15.62:0/3884589741 shutdown_connections 2023-06-09T04:41:09.492 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.488+0000 7f4161468700 1 -- 172.21.15.62:0/3884589741 wait complete. 2023-06-09T04:41:09.494 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.488+0000 7f4161468700 1 Processor -- start 2023-06-09T04:41:09.494 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.488+0000 7f4161468700 1 -- start start 2023-06-09T04:41:09.496 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.492+0000 7f4161468700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f415c069f00 0x7f415c14e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:09.496 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.492+0000 7f4161468700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f415c06e250 0x7f415c0b2a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:09.497 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.492+0000 7f4161468700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f415c0c9830 0x7f415c15bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:09.497 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.492+0000 7f4161468700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f415c14e1d0 con 0x7f415c0c9830 2023-06-09T04:41:09.497 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.492+0000 7f4161468700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f415c0b2f60 con 0x7f415c06e250 2023-06-09T04:41:09.497 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.492+0000 7f4161468700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f415c15c530 con 0x7f415c069f00 2023-06-09T04:41:09.498 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.492+0000 7f4160c67700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f415c0c9830 0x7f415c15bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:09.498 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.492+0000 7f4160c67700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f415c0c9830 0x7f415c15bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:41256/0 (socket says 172.21.15.62:41256) 2023-06-09T04:41:09.498 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.492+0000 7f4160c67700 1 -- 172.21.15.62:0/3911436142 learned_addr learned my addr 172.21.15.62:0/3911436142 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:09.498 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.492+0000 7f415b7fe700 1 --2- 172.21.15.62:0/3911436142 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f415c06e250 0x7f415c0b2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:09.498 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.492+0000 7f415bfff700 1 --2- 172.21.15.62:0/3911436142 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f415c069f00 0x7f415c14e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:09.499 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.492+0000 7f4160c67700 1 -- 172.21.15.62:0/3911436142 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f415c069f00 msgr2=0x7f415c14e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:09.499 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.492+0000 7f4160c67700 1 --2- 172.21.15.62:0/3911436142 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f415c069f00 0x7f415c14e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:09.499 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.492+0000 7f4160c67700 1 -- 172.21.15.62:0/3911436142 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f415c06e250 msgr2=0x7f415c0b2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:09.499 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.492+0000 7f4160c67700 1 --2- 172.21.15.62:0/3911436142 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f415c06e250 0x7f415c0b2a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:09.499 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.492+0000 7f4160c67700 1 -- 172.21.15.62:0/3911436142 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4154009570 con 0x7f415c0c9830 2023-06-09T04:41:09.499 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.492+0000 7f415b7fe700 1 --2- 172.21.15.62:0/3911436142 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f415c06e250 0x7f415c0b2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:41:09.499 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.492+0000 7f415bfff700 1 --2- 172.21.15.62:0/3911436142 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f415c069f00 0x7f415c14e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:41:09.500 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.492+0000 7f4160c67700 1 --2- 172.21.15.62:0/3911436142 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f415c0c9830 0x7f415c15bff0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f415c0b1dd0 tx=0x7f4154004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:09.500 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.492+0000 7f4158ff9700 1 -- 172.21.15.62:0/3911436142 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41540038c0 con 0x7f415c0c9830 2023-06-09T04:41:09.500 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.492+0000 7f4158ff9700 1 -- 172.21.15.62:0/3911436142 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f415401f070 con 0x7f415c0c9830 2023-06-09T04:41:09.501 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.492+0000 7f4161468700 1 -- 172.21.15.62:0/3911436142 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f415c0afda0 con 0x7f415c0c9830 2023-06-09T04:41:09.501 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.492+0000 7f4158ff9700 1 -- 172.21.15.62:0/3911436142 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4154003c60 con 0x7f415c0c9830 2023-06-09T04:41:09.501 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.496+0000 7f4161468700 1 -- 172.21.15.62:0/3911436142 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f415c0b0040 con 0x7f415c0c9830 2023-06-09T04:41:09.501 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.496+0000 7f4161468700 1 -- 172.21.15.62:0/3911436142 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f415c0739c0 con 0x7f415c0c9830 2023-06-09T04:41:09.502 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.496+0000 7f4158ff9700 1 -- 172.21.15.62:0/3911436142 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f415401a430 con 0x7f415c0c9830 2023-06-09T04:41:09.503 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.500+0000 7f4158ff9700 1 --2- 172.21.15.62:0/3911436142 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f413c0662f0 0x7f413c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:09.504 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.500+0000 7f4158ff9700 1 -- 172.21.15.62:0/3911436142 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4154021070 con 0x7f415c0c9830 2023-06-09T04:41:09.504 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.500+0000 7f415bfff700 1 --2- 172.21.15.62:0/3911436142 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f413c0662f0 0x7f413c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:09.505 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.500+0000 7f415bfff700 1 --2- 172.21.15.62:0/3911436142 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f413c0662f0 0x7f413c0687a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4144009a10 tx=0x7f4144008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:09.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.508+0000 7f4158ff9700 1 -- 172.21.15.62:0/3911436142 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4154052cd0 con 0x7f415c0c9830 2023-06-09T04:41:09.685 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.680+0000 7f4161468700 1 -- 172.21.15.62:0/3911436142 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f415c06eea0 con 0x7f415c0c9830 2023-06-09T04:41:09.686 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.680+0000 7f4158ff9700 1 -- 172.21.15.62:0/3911436142 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7f41540562f0 con 0x7f415c0c9830 2023-06-09T04:41:09.686 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2023-06-09T04:41:09.690 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.684+0000 7f4161468700 1 -- 172.21.15.62:0/3911436142 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f413c0662f0 msgr2=0x7f413c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:09.690 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.684+0000 7f4161468700 1 --2- 172.21.15.62:0/3911436142 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f413c0662f0 0x7f413c0687a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4144009a10 tx=0x7f4144008040 comp rx=0 tx=0).stop 2023-06-09T04:41:09.690 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.684+0000 7f4161468700 1 -- 172.21.15.62:0/3911436142 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f415c0c9830 msgr2=0x7f415c15bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:09.690 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.684+0000 7f4161468700 1 --2- 172.21.15.62:0/3911436142 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f415c0c9830 0x7f415c15bff0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f415c0b1dd0 tx=0x7f4154004770 comp rx=0 tx=0).stop 2023-06-09T04:41:09.691 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.684+0000 7f4161468700 1 -- 172.21.15.62:0/3911436142 shutdown_connections 2023-06-09T04:41:09.691 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.684+0000 7f4161468700 1 --2- 172.21.15.62:0/3911436142 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f413c0662f0 0x7f413c0687a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:09.691 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.684+0000 7f4161468700 1 --2- 172.21.15.62:0/3911436142 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f415c0c9830 0x7f415c15bff0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:09.692 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.684+0000 7f4161468700 1 --2- 172.21.15.62:0/3911436142 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f415c06e250 0x7f415c0b2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:09.692 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.684+0000 7f4161468700 1 --2- 172.21.15.62:0/3911436142 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f415c069f00 0x7f415c14e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:09.692 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.684+0000 7f4161468700 1 -- 172.21.15.62:0/3911436142 >> 172.21.15.62:0/3911436142 conn(0x7f415c0cbc60 msgr2=0x7f415c0697f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:09.692 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.688+0000 7f4161468700 1 -- 172.21.15.62:0/3911436142 shutdown_connections 2023-06-09T04:41:09.692 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.688+0000 7f4161468700 1 -- 172.21.15.62:0/3911436142 wait complete. 2023-06-09T04:41:09.712 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T04:41:09.885 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.880+0000 7f92a00c3700 1 Processor -- start 2023-06-09T04:41:09.885 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.880+0000 7f92a00c3700 1 -- start start 2023-06-09T04:41:09.887 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.884+0000 7f92a00c3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f929806ac50 0x7f92980d2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:09.887 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.884+0000 7f92a00c3700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f92980cd320 0x7f92980cd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:09.887 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.884+0000 7f92a00c3700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92980cce90 con 0x7f92980d0270 2023-06-09T04:41:09.887 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.884+0000 7f92a00c3700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f929815c720 con 0x7f92980cd320 2023-06-09T04:41:09.888 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.884+0000 7f92a00c3700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f929806b0a0 con 0x7f929806ac50 2023-06-09T04:41:09.888 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.884+0000 7f929e660700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f92980cd320 0x7f92980cd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:09.889 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.884+0000 7f929e660700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f92980cd320 0x7f92980cd7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:41270/0 (socket says 172.21.15.62:41270) 2023-06-09T04:41:09.889 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.884+0000 7f929e660700 1 -- 172.21.15.62:0/2559722747 learned_addr learned my addr 172.21.15.62:0/2559722747 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:09.889 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.884+0000 7f929d65e700 1 --2- 172.21.15.62:0/2559722747 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f929806ac50 0x7f92980d2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:09.889 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.884+0000 7f929e660700 1 -- 172.21.15.62:0/2559722747 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f929806ac50 msgr2=0x7f92980d2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:09.889 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.884+0000 7f929e660700 1 --2- 172.21.15.62:0/2559722747 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f929806ac50 0x7f92980d2220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:09.889 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.884+0000 7f929e660700 1 -- 172.21.15.62:0/2559722747 >> v1:172.21.15.89:6789/0 conn(0x7f92980d0270 legacy=0x7f92980d0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:09.889 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.884+0000 7f929e660700 1 -- 172.21.15.62:0/2559722747 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f929806bb60 con 0x7f92980cd320 2023-06-09T04:41:09.889 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.884+0000 7f929d65e700 1 --2- 172.21.15.62:0/2559722747 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f929806ac50 0x7f92980d2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:41:09.890 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.884+0000 7f929e660700 1 --2- 172.21.15.62:0/2559722747 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92980cd320 0x7f92980cd7a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9290009e80 tx=0x7f929000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57e4c7eb7a71f5a server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:09.891 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.884+0000 7f929ce5d700 1 -- 172.21.15.62:0/2559722747 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f929000e070 con 0x7f92980cd320 2023-06-09T04:41:09.891 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.884+0000 7f929ce5d700 1 -- 172.21.15.62:0/2559722747 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f929000b980 con 0x7f92980cd320 2023-06-09T04:41:09.891 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.884+0000 7f929ce5d700 1 -- 172.21.15.62:0/2559722747 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f929000bd30 con 0x7f92980cd320 2023-06-09T04:41:09.891 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.884+0000 7f92a00c3700 1 -- 172.21.15.62:0/2559722747 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92980cd320 msgr2=0x7f92980cd7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:09.891 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.884+0000 7f92a00c3700 1 --2- 172.21.15.62:0/2559722747 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92980cd320 0x7f92980cd7a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9290009e80 tx=0x7f929000b330 comp rx=0 tx=0).stop 2023-06-09T04:41:09.891 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.884+0000 7f92a00c3700 1 -- 172.21.15.62:0/2559722747 shutdown_connections 2023-06-09T04:41:09.891 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.884+0000 7f92a00c3700 1 --2- 172.21.15.62:0/2559722747 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92980cd320 0x7f92980cd7a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:09.892 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.884+0000 7f92a00c3700 1 --2- 172.21.15.62:0/2559722747 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f929806ac50 0x7f92980d2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:09.892 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.884+0000 7f92a00c3700 1 -- 172.21.15.62:0/2559722747 >> 172.21.15.62:0/2559722747 conn(0x7f9298089fc0 msgr2=0x7f929809b950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:09.892 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.884+0000 7f92a00c3700 1 -- 172.21.15.62:0/2559722747 shutdown_connections 2023-06-09T04:41:09.892 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.884+0000 7f92a00c3700 1 -- 172.21.15.62:0/2559722747 wait complete. 2023-06-09T04:41:09.893 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.888+0000 7f92a00c3700 1 Processor -- start 2023-06-09T04:41:09.894 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.888+0000 7f92a00c3700 1 -- start start 2023-06-09T04:41:09.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.892+0000 7f92a00c3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f929806ac50 0x7f929809fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:09.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.892+0000 7f92a00c3700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92980cd320 0x7f929809c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:09.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.892+0000 7f92a00c3700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92980d0270 0x7f929814b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:09.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.892+0000 7f92a00c3700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f929814f680 con 0x7f92980d0270 2023-06-09T04:41:09.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.892+0000 7f92a00c3700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f929814bf40 con 0x7f92980cd320 2023-06-09T04:41:09.897 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.892+0000 7f92a00c3700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f929814c220 con 0x7f929806ac50 2023-06-09T04:41:09.897 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.892+0000 7f929e660700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92980d0270 0x7f929814b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:09.897 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.892+0000 7f929e660700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92980d0270 0x7f929814b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:41278/0 (socket says 172.21.15.62:41278) 2023-06-09T04:41:09.898 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.892+0000 7f929e660700 1 -- 172.21.15.62:0/3003075522 learned_addr learned my addr 172.21.15.62:0/3003075522 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:09.898 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.892+0000 7f929d65e700 1 --2- 172.21.15.62:0/3003075522 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92980cd320 0x7f929809c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:09.898 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.892+0000 7f929de5f700 1 --2- 172.21.15.62:0/3003075522 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f929806ac50 0x7f929809fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:09.898 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.892+0000 7f929e660700 1 -- 172.21.15.62:0/3003075522 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f929806ac50 msgr2=0x7f929809fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:09.898 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.892+0000 7f929e660700 1 --2- 172.21.15.62:0/3003075522 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f929806ac50 0x7f929809fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:09.898 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.892+0000 7f929e660700 1 -- 172.21.15.62:0/3003075522 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92980cd320 msgr2=0x7f929809c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:09.898 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.892+0000 7f929e660700 1 --2- 172.21.15.62:0/3003075522 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92980cd320 0x7f929809c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:09.899 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.892+0000 7f929e660700 1 -- 172.21.15.62:0/3003075522 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9290009b30 con 0x7f92980d0270 2023-06-09T04:41:09.899 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.892+0000 7f929e660700 1 --2- 172.21.15.62:0/3003075522 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92980d0270 0x7f929814b3d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f929000b370 tx=0x7f9290004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:09.899 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.892+0000 7f928e7fc700 1 -- 172.21.15.62:0/3003075522 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9290004800 con 0x7f92980d0270 2023-06-09T04:41:09.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.892+0000 7f928e7fc700 1 -- 172.21.15.62:0/3003075522 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9290004980 con 0x7f92980d0270 2023-06-09T04:41:09.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.892+0000 7f92a00c3700 1 -- 172.21.15.62:0/3003075522 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92980b3a80 con 0x7f92980d0270 2023-06-09T04:41:09.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.892+0000 7f928e7fc700 1 -- 172.21.15.62:0/3003075522 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f929001c680 con 0x7f92980d0270 2023-06-09T04:41:09.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.892+0000 7f92a00c3700 1 -- 172.21.15.62:0/3003075522 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92980b4040 con 0x7f92980d0270 2023-06-09T04:41:09.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.896+0000 7f92a00c3700 1 -- 172.21.15.62:0/3003075522 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92980b4260 con 0x7f92980d0270 2023-06-09T04:41:09.902 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.896+0000 7f928e7fc700 1 -- 172.21.15.62:0/3003075522 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f929001c7e0 con 0x7f92980d0270 2023-06-09T04:41:09.904 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.900+0000 7f928e7fc700 1 --2- 172.21.15.62:0/3003075522 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f927c0662f0 0x7f927c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:09.904 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.900+0000 7f928e7fc700 1 -- 172.21.15.62:0/3003075522 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f92900858c0 con 0x7f92980d0270 2023-06-09T04:41:09.905 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.900+0000 7f929de5f700 1 --2- 172.21.15.62:0/3003075522 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f927c0662f0 0x7f927c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:09.906 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.900+0000 7f929de5f700 1 --2- 172.21.15.62:0/3003075522 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f927c0662f0 0x7f927c0687a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9294000fb0 tx=0x7f9294009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:09.909 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:09.904+0000 7f928e7fc700 1 -- 172.21.15.62:0/3003075522 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f92900529c0 con 0x7f92980d0270 2023-06-09T04:41:10.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.076+0000 7f92a00c3700 1 -- 172.21.15.62:0/3003075522 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f92980739c0 con 0x7f92980d0270 2023-06-09T04:41:10.083 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.080+0000 7f928e7fc700 1 -- 172.21.15.62:0/3003075522 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9290055fe0 con 0x7f92980d0270 2023-06-09T04:41:10.084 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-06-09T04:41:10.089 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.084+0000 7f92a00c3700 1 -- 172.21.15.62:0/3003075522 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f927c0662f0 msgr2=0x7f927c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:10.089 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.084+0000 7f92a00c3700 1 --2- 172.21.15.62:0/3003075522 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f927c0662f0 0x7f927c0687a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9294000fb0 tx=0x7f9294009040 comp rx=0 tx=0).stop 2023-06-09T04:41:10.089 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.084+0000 7f92a00c3700 1 -- 172.21.15.62:0/3003075522 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92980d0270 msgr2=0x7f929814b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:10.089 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.084+0000 7f92a00c3700 1 --2- 172.21.15.62:0/3003075522 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92980d0270 0x7f929814b3d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f929000b370 tx=0x7f9290004af0 comp rx=0 tx=0).stop 2023-06-09T04:41:10.089 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.084+0000 7f92a00c3700 1 -- 172.21.15.62:0/3003075522 shutdown_connections 2023-06-09T04:41:10.089 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.084+0000 7f92a00c3700 1 --2- 172.21.15.62:0/3003075522 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f927c0662f0 0x7f927c0687a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:10.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.084+0000 7f92a00c3700 1 --2- 172.21.15.62:0/3003075522 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92980d0270 0x7f929814b3d0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:10.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.084+0000 7f92a00c3700 1 --2- 172.21.15.62:0/3003075522 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f92980cd320 0x7f929809c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:10.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.084+0000 7f92a00c3700 1 --2- 172.21.15.62:0/3003075522 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f929806ac50 0x7f929809fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:10.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.084+0000 7f92a00c3700 1 -- 172.21.15.62:0/3003075522 >> 172.21.15.62:0/3003075522 conn(0x7f9298089fc0 msgr2=0x7f929815ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:10.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.084+0000 7f92a00c3700 1 -- 172.21.15.62:0/3003075522 shutdown_connections 2023-06-09T04:41:10.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.084+0000 7f92a00c3700 1 -- 172.21.15.62:0/3003075522 wait complete. 2023-06-09T04:41:10.110 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T04:41:10.289 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.284+0000 7ff78b59e700 1 Processor -- start 2023-06-09T04:41:10.289 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.284+0000 7ff78b59e700 1 -- start start 2023-06-09T04:41:10.292 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.288+0000 7ff78b59e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff78c06b880 0x7ff78c1603f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:10.292 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.288+0000 7ff78b59e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff78c0b0260 0x7ff78c165d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:10.292 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.288+0000 7ff78b59e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff78c15cd90 con 0x7ff78c1562c0 2023-06-09T04:41:10.292 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.288+0000 7ff78b59e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff78c160930 con 0x7ff78c06b880 2023-06-09T04:41:10.292 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.288+0000 7ff78b59e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff78c06bd10 con 0x7ff78c0b0260 2023-06-09T04:41:10.293 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.288+0000 7ff789d9b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff78c06b880 0x7ff78c1603f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:10.293 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.288+0000 7ff78a59c700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7ff78c1562c0 0x7ff78c0afb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:38616/0 (socket says 172.21.15.62:38616) 2023-06-09T04:41:10.294 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.288+0000 7ff78a59c700 1 -- 172.21.15.62:0/598649227 learned_addr learned my addr 172.21.15.62:0/598649227 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:41:10.294 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.288+0000 7ff78ad9d700 1 --2- 172.21.15.62:0/598649227 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff78c0b0260 0x7ff78c165d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:10.294 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.288+0000 7ff789d9b700 1 -- 172.21.15.62:0/598649227 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff78c0b0260 msgr2=0x7ff78c165d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:10.294 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.288+0000 7ff789d9b700 1 --2- 172.21.15.62:0/598649227 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff78c0b0260 0x7ff78c165d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:10.294 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.288+0000 7ff789d9b700 1 -- 172.21.15.62:0/598649227 >> v1:172.21.15.62:6789/0 conn(0x7ff78c1562c0 legacy=0x7ff78c0afb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:10.294 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.288+0000 7ff78959a700 1 -- 172.21.15.62:0/598649227 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4283781174 0 0) 0x7ff78c15cd90 con 0x7ff78c1562c0 2023-06-09T04:41:10.294 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.288+0000 7ff789d9b700 1 -- 172.21.15.62:0/598649227 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff78c15c740 con 0x7ff78c06b880 2023-06-09T04:41:10.295 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.288+0000 7ff789d9b700 1 --2- 172.21.15.62:0/598649227 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff78c06b880 0x7ff78c1603f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff780009850 tx=0x7ff780009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88a39eafb98204ee server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:10.295 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.288+0000 7ff78959a700 1 -- 172.21.15.62:0/598649227 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff780011830 con 0x7ff78c06b880 2023-06-09T04:41:10.295 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.288+0000 7ff78959a700 1 -- 172.21.15.62:0/598649227 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff780011990 con 0x7ff78c06b880 2023-06-09T04:41:10.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.288+0000 7ff78959a700 1 -- 172.21.15.62:0/598649227 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff780011d40 con 0x7ff78c06b880 2023-06-09T04:41:10.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.292+0000 7ff78b59e700 1 -- 172.21.15.62:0/598649227 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff78c06b880 msgr2=0x7ff78c1603f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:10.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.292+0000 7ff78b59e700 1 --2- 172.21.15.62:0/598649227 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff78c06b880 0x7ff78c1603f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff780009850 tx=0x7ff780009b60 comp rx=0 tx=0).stop 2023-06-09T04:41:10.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.292+0000 7ff78b59e700 1 -- 172.21.15.62:0/598649227 shutdown_connections 2023-06-09T04:41:10.297 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.292+0000 7ff78b59e700 1 --2- 172.21.15.62:0/598649227 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff78c0b0260 0x7ff78c165d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:10.297 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.292+0000 7ff78b59e700 1 --2- 172.21.15.62:0/598649227 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff78c06b880 0x7ff78c1603f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:10.297 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.292+0000 7ff78b59e700 1 -- 172.21.15.62:0/598649227 >> 172.21.15.62:0/598649227 conn(0x7ff78c0cab50 msgr2=0x7ff78c0caf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:10.297 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.292+0000 7ff78b59e700 1 -- 172.21.15.62:0/598649227 shutdown_connections 2023-06-09T04:41:10.297 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.292+0000 7ff78b59e700 1 -- 172.21.15.62:0/598649227 wait complete. 2023-06-09T04:41:10.299 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.296+0000 7ff78b59e700 1 Processor -- start 2023-06-09T04:41:10.299 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.296+0000 7ff78b59e700 1 -- start start 2023-06-09T04:41:10.300 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.296+0000 7ff78b59e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff78c06b880 0x7ff78c15f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:10.301 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.296+0000 7ff78b59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff78c0b0260 0x7ff78c0b1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:10.301 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.296+0000 7ff78b59e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff78c1562c0 0x7ff78c15d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:10.301 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.296+0000 7ff78b59e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff78c15da30 con 0x7ff78c0b0260 2023-06-09T04:41:10.301 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.296+0000 7ff78b59e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff78c0c2f80 con 0x7ff78c1562c0 2023-06-09T04:41:10.301 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.296+0000 7ff78b59e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff78c0c3260 con 0x7ff78c06b880 2023-06-09T04:41:10.302 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.296+0000 7ff789d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff78c0b0260 0x7ff78c0b1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:10.302 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.296+0000 7ff789d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff78c0b0260 0x7ff78c0b1dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:41294/0 (socket says 172.21.15.62:41294) 2023-06-09T04:41:10.302 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.296+0000 7ff789d9b700 1 -- 172.21.15.62:0/534067782 learned_addr learned my addr 172.21.15.62:0/534067782 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:10.302 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.296+0000 7ff78ad9d700 1 --2- 172.21.15.62:0/534067782 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff78c1562c0 0x7ff78c15d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:10.303 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.296+0000 7ff78a59c700 1 --2- 172.21.15.62:0/534067782 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff78c06b880 0x7ff78c15f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:10.303 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.296+0000 7ff789d9b700 1 -- 172.21.15.62:0/534067782 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff78c06b880 msgr2=0x7ff78c15f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:10.303 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.296+0000 7ff789d9b700 1 --2- 172.21.15.62:0/534067782 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff78c06b880 0x7ff78c15f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:10.303 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.296+0000 7ff789d9b700 1 -- 172.21.15.62:0/534067782 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff78c1562c0 msgr2=0x7ff78c15d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:10.303 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.296+0000 7ff789d9b700 1 --2- 172.21.15.62:0/534067782 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff78c1562c0 0x7ff78c15d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:10.303 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.296+0000 7ff789d9b700 1 -- 172.21.15.62:0/534067782 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7800094b0 con 0x7ff78c0b0260 2023-06-09T04:41:10.304 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.296+0000 7ff789d9b700 1 --2- 172.21.15.62:0/534067782 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff78c0b0260 0x7ff78c0b1dd0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff780000c00 tx=0x7ff780004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:10.308 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.304+0000 7ff77affd700 1 -- 172.21.15.62:0/534067782 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff78001aa10 con 0x7ff78c0b0260 2023-06-09T04:41:10.308 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.304+0000 7ff77affd700 1 -- 172.21.15.62:0/534067782 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff78001f070 con 0x7ff78c0b0260 2023-06-09T04:41:10.308 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.304+0000 7ff77affd700 1 -- 172.21.15.62:0/534067782 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff78001adb0 con 0x7ff78c0b0260 2023-06-09T04:41:10.308 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.304+0000 7ff78b59e700 1 -- 172.21.15.62:0/534067782 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff78c0c3540 con 0x7ff78c0b0260 2023-06-09T04:41:10.309 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.304+0000 7ff78b59e700 1 -- 172.21.15.62:0/534067782 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff78c0c3b00 con 0x7ff78c0b0260 2023-06-09T04:41:10.310 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.304+0000 7ff78b59e700 1 -- 172.21.15.62:0/534067782 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff78c15d200 con 0x7ff78c0b0260 2023-06-09T04:41:10.311 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.308+0000 7ff77affd700 1 -- 172.21.15.62:0/534067782 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff78001b430 con 0x7ff78c0b0260 2023-06-09T04:41:10.312 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.308+0000 7ff77affd700 1 --2- 172.21.15.62:0/534067782 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7ff76c0662f0 0x7ff76c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:10.312 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.308+0000 7ff77affd700 1 -- 172.21.15.62:0/534067782 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff7800850f0 con 0x7ff78c0b0260 2023-06-09T04:41:10.313 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.308+0000 7ff78a59c700 1 --2- 172.21.15.62:0/534067782 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7ff76c0662f0 0x7ff76c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:10.314 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.308+0000 7ff78a59c700 1 --2- 172.21.15.62:0/534067782 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7ff76c0662f0 0x7ff76c0687a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff77c000f60 tx=0x7ff77c007cb0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:10.320 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.316+0000 7ff77affd700 1 -- 172.21.15.62:0/534067782 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff78c15d200 con 0x7ff78c0b0260 2023-06-09T04:41:10.494 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.488+0000 7ff78b59e700 1 -- 172.21.15.62:0/534067782 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff78c15d200 con 0x7ff78c0b0260 2023-06-09T04:41:10.495 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.492+0000 7ff77affd700 1 -- 172.21.15.62:0/534067782 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff78c15d200 con 0x7ff78c0b0260 2023-06-09T04:41:10.495 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 64 2023-06-09T04:41:10.499 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.496+0000 7ff78b59e700 1 -- 172.21.15.62:0/534067782 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7ff76c0662f0 msgr2=0x7ff76c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:10.499 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.496+0000 7ff78b59e700 1 --2- 172.21.15.62:0/534067782 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7ff76c0662f0 0x7ff76c0687a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff77c000f60 tx=0x7ff77c007cb0 comp rx=0 tx=0).stop 2023-06-09T04:41:10.500 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.496+0000 7ff78b59e700 1 -- 172.21.15.62:0/534067782 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff78c0b0260 msgr2=0x7ff78c0b1dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:10.500 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.496+0000 7ff78b59e700 1 --2- 172.21.15.62:0/534067782 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff78c0b0260 0x7ff78c0b1dd0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff780000c00 tx=0x7ff780004770 comp rx=0 tx=0).stop 2023-06-09T04:41:10.500 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.496+0000 7ff78b59e700 1 -- 172.21.15.62:0/534067782 shutdown_connections 2023-06-09T04:41:10.500 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.496+0000 7ff78b59e700 1 --2- 172.21.15.62:0/534067782 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7ff76c0662f0 0x7ff76c0687a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:10.500 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.496+0000 7ff78b59e700 1 --2- 172.21.15.62:0/534067782 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff78c1562c0 0x7ff78c15d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:10.500 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.496+0000 7ff78b59e700 1 --2- 172.21.15.62:0/534067782 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff78c0b0260 0x7ff78c0b1dd0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:10.500 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.496+0000 7ff78b59e700 1 --2- 172.21.15.62:0/534067782 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff78c06b880 0x7ff78c15f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:10.501 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.496+0000 7ff78b59e700 1 -- 172.21.15.62:0/534067782 >> 172.21.15.62:0/534067782 conn(0x7ff78c0cab50 msgr2=0x7ff78c0ab8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:10.501 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.496+0000 7ff78b59e700 1 -- 172.21.15.62:0/534067782 shutdown_connections 2023-06-09T04:41:10.501 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.496+0000 7ff78b59e700 1 -- 172.21.15.62:0/534067782 wait complete. 2023-06-09T04:41:10.522 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-09T04:41:10.711 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.708+0000 7f847bfff700 1 Processor -- start 2023-06-09T04:41:10.712 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.708+0000 7f847bfff700 1 -- start start 2023-06-09T04:41:10.715 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.712+0000 7f847bfff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f847c0d1090 0x7f847c0ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:10.715 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.712+0000 7f847bfff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f847c0cf0e0 0x7f847c0b52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:10.716 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.712+0000 7f847bfff700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f847c0d0c00 con 0x7f847c0b3ed0 2023-06-09T04:41:10.716 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.712+0000 7f847bfff700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f847c0b1b30 con 0x7f847c0cf0e0 2023-06-09T04:41:10.716 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.712+0000 7f847bfff700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f847c0cf940 con 0x7f847c0d1090 2023-06-09T04:41:10.716 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.712+0000 7f847affd700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f847c0b3ed0 0x7f847c0b42a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:52262/0 (socket says 172.21.15.62:52262) 2023-06-09T04:41:10.717 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.712+0000 7f847b7fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f847c0cf0e0 0x7f847c0b52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:10.717 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.712+0000 7f847affd700 1 -- 172.21.15.62:0/2328476011 learned_addr learned my addr 172.21.15.62:0/2328476011 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:41:10.717 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.712+0000 7f847a7fc700 1 --2- 172.21.15.62:0/2328476011 >> v2:172.21.15.89:3300/0 conn(0x7f847c0d1090 0x7f847c0ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:10.717 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.712+0000 7f847b7fe700 1 -- 172.21.15.62:0/2328476011 >> v2:172.21.15.89:3300/0 conn(0x7f847c0d1090 msgr2=0x7f847c0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:10.717 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.712+0000 7f847b7fe700 1 --2- 172.21.15.62:0/2328476011 >> v2:172.21.15.89:3300/0 conn(0x7f847c0d1090 0x7f847c0ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:10.717 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.712+0000 7f847b7fe700 1 -- 172.21.15.62:0/2328476011 >> v1:172.21.15.62:6789/0 conn(0x7f847c0b3ed0 legacy=0x7f847c0b42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:10.718 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.712+0000 7f847b7fe700 1 -- 172.21.15.62:0/2328476011 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f847c0d02d0 con 0x7f847c0cf0e0 2023-06-09T04:41:10.718 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.712+0000 7f847a7fc700 1 --2- 172.21.15.62:0/2328476011 >> v2:172.21.15.89:3300/0 conn(0x7f847c0d1090 0x7f847c0ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:41:10.718 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.712+0000 7f847b7fe700 1 --2- 172.21.15.62:0/2328476011 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f847c0cf0e0 0x7f847c0b52a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f847c0b8540 tx=0x7f847400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=298d00baaa225354 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:10.719 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.712+0000 7f8479ffb700 1 -- 172.21.15.62:0/2328476011 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f847400e070 con 0x7f847c0cf0e0 2023-06-09T04:41:10.719 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.712+0000 7f8479ffb700 1 -- 172.21.15.62:0/2328476011 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f847400bbd0 con 0x7f847c0cf0e0 2023-06-09T04:41:10.719 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.712+0000 7f8479ffb700 1 -- 172.21.15.62:0/2328476011 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8474012430 con 0x7f847c0cf0e0 2023-06-09T04:41:10.719 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.712+0000 7f847bfff700 1 -- 172.21.15.62:0/2328476011 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f847c0cf0e0 msgr2=0x7f847c0b52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:10.719 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.712+0000 7f847bfff700 1 --2- 172.21.15.62:0/2328476011 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f847c0cf0e0 0x7f847c0b52a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f847c0b8540 tx=0x7f847400b330 comp rx=0 tx=0).stop 2023-06-09T04:41:10.720 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.716+0000 7f847bfff700 1 -- 172.21.15.62:0/2328476011 shutdown_connections 2023-06-09T04:41:10.720 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.716+0000 7f847bfff700 1 --2- 172.21.15.62:0/2328476011 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f847c0cf0e0 0x7f847c0b52a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:10.720 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.716+0000 7f847bfff700 1 --2- 172.21.15.62:0/2328476011 >> v2:172.21.15.89:3300/0 conn(0x7f847c0d1090 0x7f847c0ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:10.720 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.716+0000 7f847bfff700 1 -- 172.21.15.62:0/2328476011 >> 172.21.15.62:0/2328476011 conn(0x7f847c06a500 msgr2=0x7f847c06a900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:10.720 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.716+0000 7f847bfff700 1 -- 172.21.15.62:0/2328476011 shutdown_connections 2023-06-09T04:41:10.720 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.716+0000 7f847bfff700 1 -- 172.21.15.62:0/2328476011 wait complete. 2023-06-09T04:41:10.723 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.720+0000 7f847bfff700 1 Processor -- start 2023-06-09T04:41:10.723 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.720+0000 7f847bfff700 1 -- start start 2023-06-09T04:41:10.725 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.720+0000 7f847bfff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f847c0b3ed0 0x7f847c1f1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:10.725 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.720+0000 7f847bfff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f847c0cf0e0 0x7f847c1f4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:10.725 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.720+0000 7f847bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f847c0d1090 0x7f847c154110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:10.726 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.720+0000 7f847bfff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f847c1f4cf0 con 0x7f847c0d1090 2023-06-09T04:41:10.726 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.720+0000 7f847bfff700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f847c1f4fd0 con 0x7f847c0b3ed0 2023-06-09T04:41:10.726 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.720+0000 7f847bfff700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f847c1f52b0 con 0x7f847c0cf0e0 2023-06-09T04:41:10.727 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.720+0000 7f847b7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f847c0d1090 0x7f847c154110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:10.727 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.720+0000 7f847b7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f847c0d1090 0x7f847c154110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54500/0 (socket says 172.21.15.62:54500) 2023-06-09T04:41:10.727 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.720+0000 7f847b7fe700 1 -- 172.21.15.62:0/388653525 learned_addr learned my addr 172.21.15.62:0/388653525 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:10.727 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.720+0000 7f847affd700 1 --2- 172.21.15.62:0/388653525 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f847c0b3ed0 0x7f847c1f1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:10.727 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.720+0000 7f847a7fc700 1 --2- 172.21.15.62:0/388653525 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f847c0cf0e0 0x7f847c1f4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:10.727 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.720+0000 7f847b7fe700 1 -- 172.21.15.62:0/388653525 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f847c0cf0e0 msgr2=0x7f847c1f4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:10.727 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.720+0000 7f847b7fe700 1 --2- 172.21.15.62:0/388653525 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f847c0cf0e0 0x7f847c1f4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:10.728 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.720+0000 7f847b7fe700 1 -- 172.21.15.62:0/388653525 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f847c0b3ed0 msgr2=0x7f847c1f1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:10.728 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.720+0000 7f847b7fe700 1 --2- 172.21.15.62:0/388653525 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f847c0b3ed0 0x7f847c1f1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:10.728 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.720+0000 7f847b7fe700 1 -- 172.21.15.62:0/388653525 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8474009a70 con 0x7f847c0d1090 2023-06-09T04:41:10.728 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.724+0000 7f847b7fe700 1 --2- 172.21.15.62:0/388653525 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f847c0d1090 0x7f847c154110 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8474014040 tx=0x7f8474004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:10.729 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.724+0000 7f8463fff700 1 -- 172.21.15.62:0/388653525 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8474012430 con 0x7f847c0d1090 2023-06-09T04:41:10.729 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.724+0000 7f8463fff700 1 -- 172.21.15.62:0/388653525 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8474020070 con 0x7f847c0d1090 2023-06-09T04:41:10.729 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.724+0000 7f847bfff700 1 -- 172.21.15.62:0/388653525 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f847c1f5590 con 0x7f847c0d1090 2023-06-09T04:41:10.729 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.724+0000 7f8463fff700 1 -- 172.21.15.62:0/388653525 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8474004280 con 0x7f847c0d1090 2023-06-09T04:41:10.729 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.724+0000 7f847bfff700 1 -- 172.21.15.62:0/388653525 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f847c1f4540 con 0x7f847c0d1090 2023-06-09T04:41:10.730 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.724+0000 7f847bfff700 1 -- 172.21.15.62:0/388653525 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f847c152560 con 0x7f847c0d1090 2023-06-09T04:41:10.731 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.728+0000 7f8463fff700 1 -- 172.21.15.62:0/388653525 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f84740043e0 con 0x7f847c0d1090 2023-06-09T04:41:10.732 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.728+0000 7f8463fff700 1 --2- 172.21.15.62:0/388653525 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f84680662f0 0x7f84680687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:10.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.728+0000 7f8463fff700 1 -- 172.21.15.62:0/388653525 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8474022070 con 0x7f847c0d1090 2023-06-09T04:41:10.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.728+0000 7f847affd700 1 --2- 172.21.15.62:0/388653525 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f84680662f0 0x7f84680687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:10.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.728+0000 7f847affd700 1 --2- 172.21.15.62:0/388653525 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f84680662f0 0x7f84680687a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f846c005930 tx=0x7f846c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:10.740 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.736+0000 7f8463fff700 1 -- 172.21.15.62:0/388653525 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f847c152560 con 0x7f847c0d1090 2023-06-09T04:41:10.914 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.908+0000 7f847bfff700 1 -- 172.21.15.62:0/388653525 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f847c152560 con 0x7f847c0d1090 2023-06-09T04:41:10.915 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.912+0000 7f8463fff700 1 -- 172.21.15.62:0/388653525 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f847402c020 con 0x7f847c0d1090 2023-06-09T04:41:10.915 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-06-09T04:41:10.919 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.916+0000 7f847bfff700 1 -- 172.21.15.62:0/388653525 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f84680662f0 msgr2=0x7f84680687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:10.919 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.916+0000 7f847bfff700 1 --2- 172.21.15.62:0/388653525 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f84680662f0 0x7f84680687a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f846c005930 tx=0x7f846c009040 comp rx=0 tx=0).stop 2023-06-09T04:41:10.919 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.916+0000 7f847bfff700 1 -- 172.21.15.62:0/388653525 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f847c0d1090 msgr2=0x7f847c154110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:10.919 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.916+0000 7f847bfff700 1 --2- 172.21.15.62:0/388653525 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f847c0d1090 0x7f847c154110 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8474014040 tx=0x7f8474004af0 comp rx=0 tx=0).stop 2023-06-09T04:41:10.920 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.916+0000 7f847bfff700 1 -- 172.21.15.62:0/388653525 shutdown_connections 2023-06-09T04:41:10.920 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.916+0000 7f847bfff700 1 --2- 172.21.15.62:0/388653525 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f84680662f0 0x7f84680687a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:10.920 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.916+0000 7f847bfff700 1 --2- 172.21.15.62:0/388653525 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f847c0d1090 0x7f847c154110 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:10.921 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.916+0000 7f847bfff700 1 --2- 172.21.15.62:0/388653525 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f847c0cf0e0 0x7f847c1f4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:10.921 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.916+0000 7f847bfff700 1 --2- 172.21.15.62:0/388653525 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f847c0b3ed0 0x7f847c1f1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:10.921 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.916+0000 7f847bfff700 1 -- 172.21.15.62:0/388653525 >> 172.21.15.62:0/388653525 conn(0x7f847c06a500 msgr2=0x7f847c15b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:10.921 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.916+0000 7f847bfff700 1 -- 172.21.15.62:0/388653525 shutdown_connections 2023-06-09T04:41:10.921 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:10.916+0000 7f847bfff700 1 -- 172.21.15.62:0/388653525 wait complete. 2023-06-09T04:41:10.941 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-09T04:41:11.118 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.112+0000 7fa004b8d700 1 Processor -- start 2023-06-09T04:41:11.118 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.112+0000 7fa004b8d700 1 -- start start 2023-06-09T04:41:11.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.116+0000 7fa004b8d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa0000b08d0 0x7fa0000ca870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:11.120 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.116+0000 7fa004b8d700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa00006f9b0 con 0x7fa0000cb850 2023-06-09T04:41:11.120 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.116+0000 7fa004b8d700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa00015a060 con 0x7fa000159c90 2023-06-09T04:41:11.120 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.116+0000 7fa004b8d700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa00006b960 con 0x7fa0000b08d0 2023-06-09T04:41:11.120 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.116+0000 7f9ff7fff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fa0000cb850 0x7fa0000ca160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:52272/0 (socket says 172.21.15.62:52272) 2023-06-09T04:41:11.121 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.116+0000 7f9ff7fff700 1 -- 172.21.15.62:0/2860098774 learned_addr learned my addr 172.21.15.62:0/2860098774 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:41:11.121 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.116+0000 7f9ffed9d700 1 --2- 172.21.15.62:0/2860098774 >> v2:172.21.15.89:3300/0 conn(0x7fa0000b08d0 0x7fa0000ca870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:11.122 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.116+0000 7f9ffdd9b700 1 -- 172.21.15.62:0/2860098774 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1981997555 0 0) 0x7fa00015a060 con 0x7fa000159c90 2023-06-09T04:41:11.122 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.116+0000 7f9ffdd9b700 1 -- 172.21.15.62:0/2860098774 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fec0035d0 con 0x7fa000159c90 2023-06-09T04:41:11.122 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.116+0000 7f9ffdd9b700 1 -- 172.21.15.62:0/2860098774 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3958559357 0 0) 0x7fa00006f9b0 con 0x7fa0000cb850 2023-06-09T04:41:11.122 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.116+0000 7f9ffdd9b700 1 -- 172.21.15.62:0/2860098774 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa00015a060 con 0x7fa0000cb850 2023-06-09T04:41:11.122 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.116+0000 7f9ffed9d700 1 -- 172.21.15.62:0/2860098774 >> v1:172.21.15.89:6789/0 conn(0x7fa000159c90 legacy=0x7fa000070e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:11.122 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.116+0000 7f9ffed9d700 1 -- 172.21.15.62:0/2860098774 >> v1:172.21.15.62:6789/0 conn(0x7fa0000cb850 legacy=0x7fa0000ca160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:11.122 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.116+0000 7f9ffed9d700 1 -- 172.21.15.62:0/2860098774 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0000c89e0 con 0x7fa0000b08d0 2023-06-09T04:41:11.123 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.116+0000 7f9ffed9d700 1 --2- 172.21.15.62:0/2860098774 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0000b08d0 0x7fa0000ca870 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9ff8009d90 tx=0x7f9ff800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4fda6b35da3755a server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:11.123 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.120+0000 7f9ffdd9b700 1 -- 172.21.15.62:0/2860098774 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff800e070 con 0x7fa0000b08d0 2023-06-09T04:41:11.123 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.120+0000 7f9ffdd9b700 1 -- 172.21.15.62:0/2860098774 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ff800bb20 con 0x7fa0000b08d0 2023-06-09T04:41:11.124 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.120+0000 7f9ffdd9b700 1 -- 172.21.15.62:0/2860098774 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff8012430 con 0x7fa0000b08d0 2023-06-09T04:41:11.124 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.120+0000 7fa004b8d700 1 -- 172.21.15.62:0/2860098774 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0000b08d0 msgr2=0x7fa0000ca870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:11.124 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.120+0000 7fa004b8d700 1 --2- 172.21.15.62:0/2860098774 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0000b08d0 0x7fa0000ca870 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9ff8009d90 tx=0x7f9ff800b330 comp rx=0 tx=0).stop 2023-06-09T04:41:11.125 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.120+0000 7fa004b8d700 1 -- 172.21.15.62:0/2860098774 shutdown_connections 2023-06-09T04:41:11.125 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.120+0000 7fa004b8d700 1 --2- 172.21.15.62:0/2860098774 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0000b08d0 0x7fa0000ca870 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:11.125 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.120+0000 7fa004b8d700 1 -- 172.21.15.62:0/2860098774 >> 172.21.15.62:0/2860098774 conn(0x7fa00006a410 msgr2=0x7fa0000afd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:11.125 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.120+0000 7fa004b8d700 1 -- 172.21.15.62:0/2860098774 shutdown_connections 2023-06-09T04:41:11.125 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.120+0000 7fa004b8d700 1 -- 172.21.15.62:0/2860098774 wait complete. 2023-06-09T04:41:11.127 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.124+0000 7fa004b8d700 1 Processor -- start 2023-06-09T04:41:11.128 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.124+0000 7fa004b8d700 1 -- start start 2023-06-09T04:41:11.130 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.124+0000 7fa004b8d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa0000b08d0 0x7fa0001545d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:11.130 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.124+0000 7fa004b8d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0000cb850 0x7fa0000c26f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:11.130 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.124+0000 7fa004b8d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa000159c90 0x7fa000147720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:11.130 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.124+0000 7fa004b8d700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0000b1020 con 0x7fa000159c90 2023-06-09T04:41:11.130 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.124+0000 7fa004b8d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0000c5c30 con 0x7fa0000cb850 2023-06-09T04:41:11.131 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.124+0000 7fa004b8d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0000c5f10 con 0x7fa0000b08d0 2023-06-09T04:41:11.131 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.124+0000 7f9ffed9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa000159c90 0x7fa000147720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:11.131 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.124+0000 7f9ffed9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa000159c90 0x7fa000147720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54508/0 (socket says 172.21.15.62:54508) 2023-06-09T04:41:11.131 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.124+0000 7f9ffed9d700 1 -- 172.21.15.62:0/2944358042 learned_addr learned my addr 172.21.15.62:0/2944358042 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:11.132 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.124+0000 7f9ffe59c700 1 --2- 172.21.15.62:0/2944358042 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa0000b08d0 0x7fa0001545d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:11.132 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.124+0000 7f9ff7fff700 1 --2- 172.21.15.62:0/2944358042 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0000cb850 0x7fa0000c26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:11.132 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.124+0000 7f9ffed9d700 1 -- 172.21.15.62:0/2944358042 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa0000b08d0 msgr2=0x7fa0001545d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:11.133 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.128+0000 7f9ffed9d700 1 --2- 172.21.15.62:0/2944358042 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa0000b08d0 0x7fa0001545d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:11.133 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.128+0000 7f9ffed9d700 1 -- 172.21.15.62:0/2944358042 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0000cb850 msgr2=0x7fa0000c26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:11.133 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.128+0000 7f9ffed9d700 1 --2- 172.21.15.62:0/2944358042 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0000cb850 0x7fa0000c26f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:11.133 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.128+0000 7f9ffed9d700 1 -- 172.21.15.62:0/2944358042 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff8009a70 con 0x7fa000159c90 2023-06-09T04:41:11.133 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.128+0000 7f9ffe59c700 1 --2- 172.21.15.62:0/2944358042 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa0000b08d0 0x7fa0001545d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:41:11.133 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.128+0000 7f9ff7fff700 1 --2- 172.21.15.62:0/2944358042 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0000cb850 0x7fa0000c26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:41:11.133 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.128+0000 7f9ffed9d700 1 --2- 172.21.15.62:0/2944358042 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa000159c90 0x7fa000147720 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9ff8014040 tx=0x7f9ff8004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:11.134 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.128+0000 7f9ff6ffd700 1 -- 172.21.15.62:0/2944358042 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff80048e0 con 0x7fa000159c90 2023-06-09T04:41:11.134 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.128+0000 7f9ff6ffd700 1 -- 172.21.15.62:0/2944358042 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ff8020070 con 0x7fa000159c90 2023-06-09T04:41:11.134 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.128+0000 7fa004b8d700 1 -- 172.21.15.62:0/2944358042 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0000adcf0 con 0x7fa000159c90 2023-06-09T04:41:11.134 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.128+0000 7f9ff6ffd700 1 -- 172.21.15.62:0/2944358042 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff80276c0 con 0x7fa000159c90 2023-06-09T04:41:11.134 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.128+0000 7fa004b8d700 1 -- 172.21.15.62:0/2944358042 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa000154cb0 con 0x7fa000159c90 2023-06-09T04:41:11.134 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.128+0000 7fa004b8d700 1 -- 172.21.15.62:0/2944358042 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0000ae210 con 0x7fa000159c90 2023-06-09T04:41:11.135 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.132+0000 7f9ff6ffd700 1 -- 172.21.15.62:0/2944358042 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9ff8012430 con 0x7fa000159c90 2023-06-09T04:41:11.137 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.132+0000 7f9ff6ffd700 1 --2- 172.21.15.62:0/2944358042 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f9fe00662f0 0x7f9fe00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:11.137 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.132+0000 7f9ff6ffd700 1 -- 172.21.15.62:0/2944358042 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9ff8022070 con 0x7fa000159c90 2023-06-09T04:41:11.138 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.132+0000 7f9ffe59c700 1 --2- 172.21.15.62:0/2944358042 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f9fe00662f0 0x7f9fe00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:11.138 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.132+0000 7f9ffe59c700 1 --2- 172.21.15.62:0/2944358042 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f9fe00662f0 0x7f9fe00687a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa0000c7c00 tx=0x7f9ff0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:11.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.140+0000 7f9ff6ffd700 1 -- 172.21.15.62:0/2944358042 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa0000ae210 con 0x7fa000159c90 2023-06-09T04:41:11.329 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.324+0000 7fa004b8d700 1 -- 172.21.15.62:0/2944358042 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa0000ae210 con 0x7fa000159c90 2023-06-09T04:41:11.330 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.324+0000 7f9ff6ffd700 1 -- 172.21.15.62:0/2944358042 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa0000ae210 con 0x7fa000159c90 2023-06-09T04:41:11.334 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.328+0000 7fa004b8d700 1 -- 172.21.15.62:0/2944358042 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f9fe00662f0 msgr2=0x7f9fe00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:11.334 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.328+0000 7fa004b8d700 1 --2- 172.21.15.62:0/2944358042 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f9fe00662f0 0x7f9fe00687a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa0000c7c00 tx=0x7f9ff0009040 comp rx=0 tx=0).stop 2023-06-09T04:41:11.334 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.328+0000 7fa004b8d700 1 -- 172.21.15.62:0/2944358042 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa000159c90 msgr2=0x7fa000147720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:11.335 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.328+0000 7fa004b8d700 1 --2- 172.21.15.62:0/2944358042 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa000159c90 0x7fa000147720 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9ff8014040 tx=0x7f9ff8004af0 comp rx=0 tx=0).stop 2023-06-09T04:41:11.335 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.328+0000 7fa004b8d700 1 -- 172.21.15.62:0/2944358042 shutdown_connections 2023-06-09T04:41:11.335 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.328+0000 7fa004b8d700 1 --2- 172.21.15.62:0/2944358042 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f9fe00662f0 0x7f9fe00687a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:11.336 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.328+0000 7fa004b8d700 1 --2- 172.21.15.62:0/2944358042 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa000159c90 0x7fa000147720 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:11.336 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.328+0000 7fa004b8d700 1 --2- 172.21.15.62:0/2944358042 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0000cb850 0x7fa0000c26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:11.336 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.328+0000 7fa004b8d700 1 --2- 172.21.15.62:0/2944358042 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa0000b08d0 0x7fa0001545d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:11.336 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.328+0000 7fa004b8d700 1 -- 172.21.15.62:0/2944358042 >> 172.21.15.62:0/2944358042 conn(0x7fa00006a410 msgr2=0x7fa0001585f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:11.336 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.332+0000 7fa004b8d700 1 -- 172.21.15.62:0/2944358042 shutdown_connections 2023-06-09T04:41:11.336 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.332+0000 7fa004b8d700 1 -- 172.21.15.62:0/2944358042 wait complete. 2023-06-09T04:41:11.338 INFO:teuthology.orchestra.run.smithi062.stderr:listed 0 entries 2023-06-09T04:41:11.356 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-06-09T04:41:11.357 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:41:11.375 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:41:11.596 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.592+0000 7f979b59e700 1 Processor -- start 2023-06-09T04:41:11.596 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.592+0000 7f979b59e700 1 -- start start 2023-06-09T04:41:11.599 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.596+0000 7f979b59e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f979c159910 0x7f979c0c8680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:11.599 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.596+0000 7f979b59e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f979c0cbf30 con 0x7f979c0ad1a0 2023-06-09T04:41:11.600 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.596+0000 7f979b59e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f979c15c640 con 0x7f979c0cacf0 2023-06-09T04:41:11.600 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.596+0000 7f979b59e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f979c15d1c0 con 0x7f979c159910 2023-06-09T04:41:11.600 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.596+0000 7f9793fff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f979c0ad1a0 0x7f979c0ca5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:52274/0 (socket says 172.21.15.62:52274) 2023-06-09T04:41:11.601 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.596+0000 7f9793fff700 1 -- 172.21.15.62:0/3130435771 learned_addr learned my addr 172.21.15.62:0/3130435771 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:41:11.601 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.596+0000 7f979a59c700 1 --2- 172.21.15.62:0/3130435771 >> v2:172.21.15.89:3300/0 conn(0x7f979c159910 0x7f979c0c8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:11.601 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.596+0000 7f9799d9b700 1 -- 172.21.15.62:0/3130435771 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 748802173 0 0) 0x7f979c0cbf30 con 0x7f979c0ad1a0 2023-06-09T04:41:11.602 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.596+0000 7f9799d9b700 1 -- 172.21.15.62:0/3130435771 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97880035d0 con 0x7f979c0ad1a0 2023-06-09T04:41:11.602 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.596+0000 7f9799d9b700 1 -- 172.21.15.62:0/3130435771 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3484058898 0 0) 0x7f97880035d0 con 0x7f979c0ad1a0 2023-06-09T04:41:11.602 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.596+0000 7f979a59c700 1 -- 172.21.15.62:0/3130435771 >> v1:172.21.15.89:6789/0 conn(0x7f979c0cacf0 legacy=0x7f979c15fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:11.602 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.596+0000 7f979a59c700 1 -- 172.21.15.62:0/3130435771 >> v1:172.21.15.62:6789/0 conn(0x7f979c0ad1a0 legacy=0x7f979c0ca5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:11.602 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.596+0000 7f979a59c700 1 -- 172.21.15.62:0/3130435771 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f979c15c920 con 0x7f979c159910 2023-06-09T04:41:11.603 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.596+0000 7f979a59c700 1 --2- 172.21.15.62:0/3130435771 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f979c159910 0x7f979c0c8680 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f978c009850 tx=0x7f978c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d860b6980967fe60 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:11.603 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.596+0000 7f9799d9b700 1 -- 172.21.15.62:0/3130435771 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9784001670 con 0x7f979c159910 2023-06-09T04:41:11.603 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.600+0000 7f9799d9b700 1 -- 172.21.15.62:0/3130435771 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f978c004030 con 0x7f979c159910 2023-06-09T04:41:11.603 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.600+0000 7f9799d9b700 1 -- 172.21.15.62:0/3130435771 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978c0043a0 con 0x7f979c159910 2023-06-09T04:41:11.604 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.600+0000 7f979b59e700 1 -- 172.21.15.62:0/3130435771 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f979c159910 msgr2=0x7f979c0c8680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:11.604 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.600+0000 7f979b59e700 1 --2- 172.21.15.62:0/3130435771 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f979c159910 0x7f979c0c8680 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f978c009850 tx=0x7f978c009b60 comp rx=0 tx=0).stop 2023-06-09T04:41:11.604 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.600+0000 7f979b59e700 1 -- 172.21.15.62:0/3130435771 shutdown_connections 2023-06-09T04:41:11.604 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.600+0000 7f979b59e700 1 --2- 172.21.15.62:0/3130435771 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f979c159910 0x7f979c0c8680 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:11.605 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.600+0000 7f979b59e700 1 -- 172.21.15.62:0/3130435771 >> 172.21.15.62:0/3130435771 conn(0x7f979c06a420 msgr2=0x7f979c0afc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:11.605 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.600+0000 7f979b59e700 1 -- 172.21.15.62:0/3130435771 shutdown_connections 2023-06-09T04:41:11.605 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.600+0000 7f979b59e700 1 -- 172.21.15.62:0/3130435771 wait complete. 2023-06-09T04:41:11.607 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.604+0000 7f979b59e700 1 Processor -- start 2023-06-09T04:41:11.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.604+0000 7f979b59e700 1 -- start start 2023-06-09T04:41:11.609 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.604+0000 7f979b59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f979c0cacf0 0x7f979c0b1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:11.610 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.604+0000 7f979b59e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f979c159910 0x7f979c1f0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:11.610 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.604+0000 7f979b59e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f979c0708d0 0x7f979c0b1c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:11.610 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.604+0000 7f979b59e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f979c0ada90 con 0x7f979c0cacf0 2023-06-09T04:41:11.610 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.604+0000 7f979b59e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f979c070dd0 con 0x7f979c159910 2023-06-09T04:41:11.610 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.604+0000 7f979b59e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f979c0710b0 con 0x7f979c0708d0 2023-06-09T04:41:11.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.604+0000 7f979a59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f979c0cacf0 0x7f979c0b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:11.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.604+0000 7f979a59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f979c0cacf0 0x7f979c0b1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54520/0 (socket says 172.21.15.62:54520) 2023-06-09T04:41:11.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.604+0000 7f979a59c700 1 -- 172.21.15.62:0/2476397994 learned_addr learned my addr 172.21.15.62:0/2476397994 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:11.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.604+0000 7f979a59c700 1 -- 172.21.15.62:0/2476397994 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f979c0708d0 msgr2=0x7f979c0b1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:11.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.604+0000 7f979a59c700 1 --2- 172.21.15.62:0/2476397994 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f979c0708d0 0x7f979c0b1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:11.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.604+0000 7f979a59c700 1 -- 172.21.15.62:0/2476397994 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f979c159910 msgr2=0x7f979c1f0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:11.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.604+0000 7f9793fff700 1 --2- 172.21.15.62:0/2476397994 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f979c159910 0x7f979c1f0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:11.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.604+0000 7f979a59c700 1 --2- 172.21.15.62:0/2476397994 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f979c159910 0x7f979c1f0ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:11.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.604+0000 7f979a59c700 1 -- 172.21.15.62:0/2476397994 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f978c0094b0 con 0x7f979c0cacf0 2023-06-09T04:41:11.613 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.604+0000 7f9793fff700 1 --2- 172.21.15.62:0/2476397994 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f979c159910 0x7f979c1f0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:41:11.613 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.608+0000 7f979a59c700 1 --2- 172.21.15.62:0/2476397994 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f979c0cacf0 0x7f979c0b1130 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f978c0090b0 tx=0x7f978c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:11.613 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.608+0000 7f9792ffd700 1 -- 172.21.15.62:0/2476397994 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978c003ea0 con 0x7f979c0cacf0 2023-06-09T04:41:11.613 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.608+0000 7f9792ffd700 1 -- 172.21.15.62:0/2476397994 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f978c01f070 con 0x7f979c0cacf0 2023-06-09T04:41:11.613 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.608+0000 7f979b59e700 1 -- 172.21.15.62:0/2476397994 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f979c071390 con 0x7f979c0cacf0 2023-06-09T04:41:11.613 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.608+0000 7f9792ffd700 1 -- 172.21.15.62:0/2476397994 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978c011a90 con 0x7f979c0cacf0 2023-06-09T04:41:11.613 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.608+0000 7f979b59e700 1 -- 172.21.15.62:0/2476397994 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f979c0b18c0 con 0x7f979c0cacf0 2023-06-09T04:41:11.614 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.608+0000 7f979b59e700 1 -- 172.21.15.62:0/2476397994 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f979c0c1990 con 0x7f979c0cacf0 2023-06-09T04:41:11.614 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.608+0000 7f9792ffd700 1 -- 172.21.15.62:0/2476397994 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f978c011bf0 con 0x7f979c0cacf0 2023-06-09T04:41:11.616 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.612+0000 7f9792ffd700 1 --2- 172.21.15.62:0/2476397994 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f977c0662f0 0x7f977c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:11.616 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.612+0000 7f9792ffd700 1 -- 172.21.15.62:0/2476397994 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f978c021070 con 0x7f979c0cacf0 2023-06-09T04:41:11.616 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.612+0000 7f9793fff700 1 --2- 172.21.15.62:0/2476397994 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f977c0662f0 0x7f977c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:11.617 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.612+0000 7f9793fff700 1 --2- 172.21.15.62:0/2476397994 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f977c0662f0 0x7f977c0687a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f979c0ca8a0 tx=0x7f9784009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:11.622 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.616+0000 7f9792ffd700 1 -- 172.21.15.62:0/2476397994 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f978c052c60 con 0x7f979c0cacf0 2023-06-09T04:41:11.801 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.796+0000 7f979b59e700 1 -- 172.21.15.62:0/2476397994 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f979c0739c0 con 0x7f979c0cacf0 2023-06-09T04:41:11.804 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.800+0000 7f9792ffd700 1 -- 172.21.15.62:0/2476397994 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20084 (secure 0 0 0) 0x7f978c056280 con 0x7f979c0cacf0 2023-06-09T04:41:11.805 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:41:11.805 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":28,"fsid":"f7998a1e-e5a9-4202-abaa-70c0eaae1047","created":"2023-06-09T04:40:30.469588+0000","modified":"2023-06-09T04:41:01.271858+0000","last_up_change":"2023-06-09T04:40:43.120747+0000","last_in_change":"2023-06-09T04:40:33.568221+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:40:44.646921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:40:50.006643+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:40:55.031273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:40:55.773517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-09T04:40:58.845383+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bc50bbc0-dd08-42ed-804c-ec3029e36c19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6802","nonce":1295788017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6807","nonce":1295788017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6815","nonce":1295788017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6809","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6811","nonce":1295788017}]},"public_addr":"172.21.15.62:6802/1295788017","cluster_addr":"172.21.15.62:6807/1295788017","heartbeat_back_addr":"172.21.15.62:6815/1295788017","heartbeat_front_addr":"172.21.15.62:6811/1295788017","state":["exists","up"]},{"osd":1,"uuid":"8230b12d-e22f-4985-a584-4cc64404cdbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6825","nonce":4120692006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6827","nonce":4120692006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6831","nonce":4120692006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6829","nonce":4120692006}]},"public_addr":"172.21.15.62:6825/4120692006","cluster_addr":"172.21.15.62:6827/4120692006","heartbeat_back_addr":"172.21.15.62:6831/4120692006","heartbeat_front_addr":"172.21.15.62:6829/4120692006","state":["exists","up"]},{"osd":2,"uuid":"d0202506-dbe9-4e3c-9271-687929abf96a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6801","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6803","nonce":4169607876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6805","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6806","nonce":4169607876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6814","nonce":4169607876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6810","nonce":4169607876}]},"public_addr":"172.21.15.62:6803/4169607876","cluster_addr":"172.21.15.62:6806/4169607876","heartbeat_back_addr":"172.21.15.62:6814/4169607876","heartbeat_front_addr":"172.21.15.62:6810/4169607876","state":["exists","up"]},{"osd":3,"uuid":"f3c0298a-b075-4411-af50-e16cd74fdddb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6817","nonce":3268438986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6819","nonce":3268438986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6823","nonce":3268438986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6821","nonce":3268438986}]},"public_addr":"172.21.15.62:6817/3268438986","cluster_addr":"172.21.15.62:6819/3268438986","heartbeat_back_addr":"172.21.15.62:6823/3268438986","heartbeat_front_addr":"172.21.15.62:6821/3268438986","state":["exists","up"]},{"osd":4,"uuid":"1ab5c5ca-e74f-475a-a309-683cc0029928","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6817","nonce":3139617628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6819","nonce":3139617628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6823","nonce":3139617628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6821","nonce":3139617628}]},"public_addr":"172.21.15.89:6817/3139617628","cluster_addr":"172.21.15.89:6819/3139617628","heartbeat_back_addr":"172.21.15.89:6823/3139617628","heartbeat_front_addr":"172.21.15.89:6821/3139617628","state":["exists","up"]},{"osd":5,"uuid":"a933e184-bd8f-4369-a1ba-a68de53c578c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6825","nonce":2681723596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6827","nonce":2681723596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6831","nonce":2681723596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6829","nonce":2681723596}]},"public_addr":"172.21.15.89:6825/2681723596","cluster_addr":"172.21.15.89:6827/2681723596","heartbeat_back_addr":"172.21.15.89:6831/2681723596","heartbeat_front_addr":"172.21.15.89:6829/2681723596","state":["exists","up"]},{"osd":6,"uuid":"1ed7ad37-2eee-49a6-954c-b537e2b7f0ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6809","nonce":1657136033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6811","nonce":1657136033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6815","nonce":1657136033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6813","nonce":1657136033}]},"public_addr":"172.21.15.89:6809/1657136033","cluster_addr":"172.21.15.89:6811/1657136033","heartbeat_back_addr":"172.21.15.89:6815/1657136033","heartbeat_front_addr":"172.21.15.89:6813/1657136033","state":["exists","up"]},{"osd":7,"uuid":"6ed732e9-33ff-40df-9038-a9f1d1622671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6801","nonce":1710561686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6803","nonce":1710561686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6807","nonce":1710561686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6805","nonce":1710561686}]},"public_addr":"172.21.15.89:6801/1710561686","cluster_addr":"172.21.15.89:6803/1710561686","heartbeat_back_addr":"172.21.15.89:6807/1710561686","heartbeat_front_addr":"172.21.15.89:6805/1710561686","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.335803+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.419788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.179334+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.263310+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.071846+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.375627+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.282277+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.315997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:41:11.807 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.804+0000 7f979b59e700 1 -- 172.21.15.62:0/2476397994 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f977c0662f0 msgr2=0x7f977c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:11.808 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.804+0000 7f979b59e700 1 --2- 172.21.15.62:0/2476397994 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f977c0662f0 0x7f977c0687a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f979c0ca8a0 tx=0x7f9784009040 comp rx=0 tx=0).stop 2023-06-09T04:41:11.808 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.804+0000 7f979b59e700 1 -- 172.21.15.62:0/2476397994 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f979c0cacf0 msgr2=0x7f979c0b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:11.808 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.804+0000 7f979b59e700 1 --2- 172.21.15.62:0/2476397994 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f979c0cacf0 0x7f979c0b1130 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f978c0090b0 tx=0x7f978c004770 comp rx=0 tx=0).stop 2023-06-09T04:41:11.808 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.804+0000 7f979b59e700 1 -- 172.21.15.62:0/2476397994 shutdown_connections 2023-06-09T04:41:11.809 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.804+0000 7f979b59e700 1 --2- 172.21.15.62:0/2476397994 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f977c0662f0 0x7f977c0687a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:11.809 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.804+0000 7f979b59e700 1 --2- 172.21.15.62:0/2476397994 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f979c0708d0 0x7f979c0b1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:11.809 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.804+0000 7f979b59e700 1 --2- 172.21.15.62:0/2476397994 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f979c159910 0x7f979c1f0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:11.809 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.804+0000 7f979b59e700 1 --2- 172.21.15.62:0/2476397994 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f979c0cacf0 0x7f979c0b1130 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:11.809 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.804+0000 7f979b59e700 1 -- 172.21.15.62:0/2476397994 >> 172.21.15.62:0/2476397994 conn(0x7f979c0ad1a0 msgr2=0x7f979c0afdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:11.809 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.804+0000 7f979b59e700 1 -- 172.21.15.62:0/2476397994 shutdown_connections 2023-06-09T04:41:11.809 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:11.804+0000 7f979b59e700 1 -- 172.21.15.62:0/2476397994 wait complete. 2023-06-09T04:41:11.828 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:40:44.646921+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:40:50.006643+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T04:40:55.031273+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T04:40:55.773517+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-09T04:40:58.845383+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-09T04:41:11.829 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:41:12.017 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.012+0000 7fc9648eb700 1 Processor -- start 2023-06-09T04:41:12.017 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.012+0000 7fc9648eb700 1 -- start start 2023-06-09T04:41:12.020 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.016+0000 7fc9648eb700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc9600b3b20 0x7fc9600cebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:12.020 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.016+0000 7fc9648eb700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9600b4d50 con 0x7fc9600d1f80 2023-06-09T04:41:12.020 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.016+0000 7fc9648eb700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9600b4140 con 0x7fc9600cd2e0 2023-06-09T04:41:12.020 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.016+0000 7fc9648eb700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9600b3f40 con 0x7fc9600b3b20 2023-06-09T04:41:12.021 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.016+0000 7fc95f7fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fc9600d1f80 0x7fc9600ccbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:52288/0 (socket says 172.21.15.62:52288) 2023-06-09T04:41:12.021 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.016+0000 7fc95f7fe700 1 -- 172.21.15.62:0/154804116 learned_addr learned my addr 172.21.15.62:0/154804116 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:41:12.021 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.016+0000 7fc95ffff700 1 --2- 172.21.15.62:0/154804116 >> v2:172.21.15.89:3300/0 conn(0x7fc9600b3b20 0x7fc9600cebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:12.022 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.016+0000 7fc95effd700 1 -- 172.21.15.62:0/154804116 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3286400667 0 0) 0x7fc9600b4d50 con 0x7fc9600d1f80 2023-06-09T04:41:12.022 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.016+0000 7fc95effd700 1 -- 172.21.15.62:0/154804116 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc94c0035d0 con 0x7fc9600d1f80 2023-06-09T04:41:12.022 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.016+0000 7fc95ffff700 1 -- 172.21.15.62:0/154804116 >> v1:172.21.15.89:6789/0 conn(0x7fc9600cd2e0 legacy=0x7fc9600d0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:12.022 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.016+0000 7fc95ffff700 1 -- 172.21.15.62:0/154804116 >> v1:172.21.15.62:6789/0 conn(0x7fc9600d1f80 legacy=0x7fc9600ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:12.022 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.016+0000 7fc95ffff700 1 -- 172.21.15.62:0/154804116 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9600b4420 con 0x7fc9600b3b20 2023-06-09T04:41:12.023 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.016+0000 7fc95ffff700 1 --2- 172.21.15.62:0/154804116 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9600b3b20 0x7fc9600cebf0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc958009d90 tx=0x7fc95800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb061da810f6961 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:12.023 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.020+0000 7fc95effd700 1 -- 172.21.15.62:0/154804116 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95800e070 con 0x7fc9600b3b20 2023-06-09T04:41:12.023 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.020+0000 7fc95effd700 1 -- 172.21.15.62:0/154804116 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc95800bb20 con 0x7fc9600b3b20 2023-06-09T04:41:12.023 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.020+0000 7fc95effd700 1 -- 172.21.15.62:0/154804116 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc958012430 con 0x7fc9600b3b20 2023-06-09T04:41:12.024 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.020+0000 7fc9648eb700 1 -- 172.21.15.62:0/154804116 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9600b3b20 msgr2=0x7fc9600cebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:12.024 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.020+0000 7fc9648eb700 1 --2- 172.21.15.62:0/154804116 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9600b3b20 0x7fc9600cebf0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc958009d90 tx=0x7fc95800b330 comp rx=0 tx=0).stop 2023-06-09T04:41:12.024 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.020+0000 7fc9648eb700 1 -- 172.21.15.62:0/154804116 shutdown_connections 2023-06-09T04:41:12.025 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.020+0000 7fc9648eb700 1 --2- 172.21.15.62:0/154804116 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9600b3b20 0x7fc9600cebf0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:12.025 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.020+0000 7fc9648eb700 1 -- 172.21.15.62:0/154804116 >> 172.21.15.62:0/154804116 conn(0x7fc960071840 msgr2=0x7fc96009b760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:12.025 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.020+0000 7fc9648eb700 1 -- 172.21.15.62:0/154804116 shutdown_connections 2023-06-09T04:41:12.025 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.020+0000 7fc9648eb700 1 -- 172.21.15.62:0/154804116 wait complete. 2023-06-09T04:41:12.026 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.020+0000 7fc9648eb700 1 Processor -- start 2023-06-09T04:41:12.026 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.020+0000 7fc9648eb700 1 -- start start 2023-06-09T04:41:12.027 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.024+0000 7fc9648eb700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9600b3b20 0x7fc9601f4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:12.028 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.024+0000 7fc9648eb700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9600cd2e0 0x7fc9600b7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:12.028 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.024+0000 7fc9648eb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc9600d1f80 0x7fc9601f3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:12.028 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.024+0000 7fc9648eb700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9600b6f70 con 0x7fc9600b3b20 2023-06-09T04:41:12.028 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.024+0000 7fc9648eb700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9600b7210 con 0x7fc9600cd2e0 2023-06-09T04:41:12.028 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.024+0000 7fc9648eb700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9600b74f0 con 0x7fc9600d1f80 2023-06-09T04:41:12.029 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.024+0000 7fc95f7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9600b3b20 0x7fc9601f4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:12.029 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.024+0000 7fc95f7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9600b3b20 0x7fc9601f4ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54536/0 (socket says 172.21.15.62:54536) 2023-06-09T04:41:12.029 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.024+0000 7fc95f7fe700 1 -- 172.21.15.62:0/282509121 learned_addr learned my addr 172.21.15.62:0/282509121 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:12.030 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.024+0000 7fc957fff700 1 --2- 172.21.15.62:0/282509121 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9600cd2e0 0x7fc9600b7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:12.030 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.024+0000 7fc95ffff700 1 --2- 172.21.15.62:0/282509121 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc9600d1f80 0x7fc9601f3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:12.030 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.024+0000 7fc95f7fe700 1 -- 172.21.15.62:0/282509121 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc9600d1f80 msgr2=0x7fc9601f3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:12.030 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.024+0000 7fc95f7fe700 1 --2- 172.21.15.62:0/282509121 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc9600d1f80 0x7fc9601f3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:12.030 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.024+0000 7fc95f7fe700 1 -- 172.21.15.62:0/282509121 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9600cd2e0 msgr2=0x7fc9600b7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:12.030 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.024+0000 7fc95f7fe700 1 --2- 172.21.15.62:0/282509121 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9600cd2e0 0x7fc9600b7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:12.030 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.024+0000 7fc95f7fe700 1 -- 172.21.15.62:0/282509121 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc958009a70 con 0x7fc9600b3b20 2023-06-09T04:41:12.030 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.024+0000 7fc95f7fe700 1 --2- 172.21.15.62:0/282509121 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9600b3b20 0x7fc9601f4ea0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc950001260 tx=0x7fc95000c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:12.032 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.024+0000 7fc95cff9700 1 -- 172.21.15.62:0/282509121 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9500074e0 con 0x7fc9600b3b20 2023-06-09T04:41:12.032 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.024+0000 7fc95cff9700 1 -- 172.21.15.62:0/282509121 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc950007640 con 0x7fc9600b3b20 2023-06-09T04:41:12.032 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.024+0000 7fc9648eb700 1 -- 172.21.15.62:0/282509121 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9600b77d0 con 0x7fc9600b3b20 2023-06-09T04:41:12.032 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.024+0000 7fc95cff9700 1 -- 172.21.15.62:0/282509121 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc950005a50 con 0x7fc9600b3b20 2023-06-09T04:41:12.032 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.024+0000 7fc9648eb700 1 -- 172.21.15.62:0/282509121 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9601f3fe0 con 0x7fc9600b3b20 2023-06-09T04:41:12.032 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.028+0000 7fc9648eb700 1 -- 172.21.15.62:0/282509121 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9600b7cf0 con 0x7fc9600b3b20 2023-06-09T04:41:12.033 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.028+0000 7fc95cff9700 1 -- 172.21.15.62:0/282509121 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc950005bb0 con 0x7fc9600b3b20 2023-06-09T04:41:12.035 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.032+0000 7fc95cff9700 1 --2- 172.21.15.62:0/282509121 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fc940066320 0x7fc9400687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:12.035 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.032+0000 7fc95cff9700 1 -- 172.21.15.62:0/282509121 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc9500833d0 con 0x7fc9600b3b20 2023-06-09T04:41:12.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.032+0000 7fc957fff700 1 --2- 172.21.15.62:0/282509121 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fc940066320 0x7fc9400687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:12.037 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.032+0000 7fc957fff700 1 --2- 172.21.15.62:0/282509121 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fc940066320 0x7fc9400687d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc96015c420 tx=0x7fc948009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:12.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.036+0000 7fc95cff9700 1 -- 172.21.15.62:0/282509121 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc9600b7cf0 con 0x7fc9600b3b20 2023-06-09T04:41:12.210 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.204+0000 7fc9648eb700 1 -- 172.21.15.62:0/282509121 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc9600b7cf0 con 0x7fc9600b3b20 2023-06-09T04:41:12.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.208+0000 7fc95cff9700 1 -- 172.21.15.62:0/282509121 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc9600b7cf0 con 0x7fc9600b3b20 2023-06-09T04:41:12.212 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2023-06-09T04:41:12.214 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.208+0000 7fc9648eb700 1 -- 172.21.15.62:0/282509121 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fc940066320 msgr2=0x7fc9400687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:12.214 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.208+0000 7fc9648eb700 1 --2- 172.21.15.62:0/282509121 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fc940066320 0x7fc9400687d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc96015c420 tx=0x7fc948009040 comp rx=0 tx=0).stop 2023-06-09T04:41:12.214 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.208+0000 7fc9648eb700 1 -- 172.21.15.62:0/282509121 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9600b3b20 msgr2=0x7fc9601f4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:12.214 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.208+0000 7fc9648eb700 1 --2- 172.21.15.62:0/282509121 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9600b3b20 0x7fc9601f4ea0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc950001260 tx=0x7fc95000c9e0 comp rx=0 tx=0).stop 2023-06-09T04:41:12.214 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.208+0000 7fc9648eb700 1 -- 172.21.15.62:0/282509121 shutdown_connections 2023-06-09T04:41:12.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.208+0000 7fc9648eb700 1 --2- 172.21.15.62:0/282509121 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fc940066320 0x7fc9400687d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:12.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.208+0000 7fc9648eb700 1 --2- 172.21.15.62:0/282509121 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc9600d1f80 0x7fc9601f3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:12.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.208+0000 7fc9648eb700 1 --2- 172.21.15.62:0/282509121 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9600cd2e0 0x7fc9600b7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:12.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.208+0000 7fc9648eb700 1 --2- 172.21.15.62:0/282509121 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc9600b3b20 0x7fc9601f4ea0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:12.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.208+0000 7fc9648eb700 1 -- 172.21.15.62:0/282509121 >> 172.21.15.62:0/282509121 conn(0x7fc960071840 msgr2=0x7fc96009b760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:12.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.208+0000 7fc9648eb700 1 -- 172.21.15.62:0/282509121 shutdown_connections 2023-06-09T04:41:12.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.208+0000 7fc9648eb700 1 -- 172.21.15.62:0/282509121 wait complete. 2023-06-09T04:41:12.238 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:41:12.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.412+0000 7f390359e700 1 Processor -- start 2023-06-09T04:41:12.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.412+0000 7f390359e700 1 -- start start 2023-06-09T04:41:12.418 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.412+0000 7f390359e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3904071730 0x7f390406f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:12.419 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.412+0000 7f390359e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f39040ca1c0 0x7f39040afb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:12.419 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.412+0000 7f390359e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f39040b0090 0x7f39040cbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:12.419 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.412+0000 7f390359e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39040b0510 con 0x7f39040ca1c0 2023-06-09T04:41:12.419 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.412+0000 7f390359e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f390415d860 con 0x7f39040b0090 2023-06-09T04:41:12.419 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.412+0000 7f390359e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3904071b00 con 0x7f3904071730 2023-06-09T04:41:12.420 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.416+0000 7f3901d9b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f39040ca1c0 0x7f39040afb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:12.420 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.416+0000 7f3901d9b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f39040ca1c0 0x7f39040afb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54544/0 (socket says 172.21.15.62:54544) 2023-06-09T04:41:12.420 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.416+0000 7f3901d9b700 1 -- 172.21.15.62:0/835421209 learned_addr learned my addr 172.21.15.62:0/835421209 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:12.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.416+0000 7f390259c700 1 --2- 172.21.15.62:0/835421209 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3904071730 0x7f390406f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:12.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.416+0000 7f3902d9d700 1 --2- 172.21.15.62:0/835421209 >> v2:172.21.15.89:3300/0 conn(0x7f39040b0090 0x7f39040cbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:12.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.416+0000 7f3901d9b700 1 -- 172.21.15.62:0/835421209 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3904071730 msgr2=0x7f390406f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:12.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.416+0000 7f3901d9b700 1 --2- 172.21.15.62:0/835421209 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3904071730 0x7f390406f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:12.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.416+0000 7f3901d9b700 1 -- 172.21.15.62:0/835421209 >> v2:172.21.15.89:3300/0 conn(0x7f39040b0090 msgr2=0x7f39040cbfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:12.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.416+0000 7f3901d9b700 1 --2- 172.21.15.62:0/835421209 >> v2:172.21.15.89:3300/0 conn(0x7f39040b0090 0x7f39040cbfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:12.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.416+0000 7f3901d9b700 1 -- 172.21.15.62:0/835421209 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f390415dab0 con 0x7f39040ca1c0 2023-06-09T04:41:12.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.416+0000 7f390259c700 1 --2- 172.21.15.62:0/835421209 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3904071730 0x7f390406f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:41:12.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.416+0000 7f3902d9d700 1 --2- 172.21.15.62:0/835421209 >> v2:172.21.15.89:3300/0 conn(0x7f39040b0090 0x7f39040cbfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:41:12.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.416+0000 7f3901d9b700 1 --2- 172.21.15.62:0/835421209 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39040ca1c0 0x7f39040afb50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f39040cdb70 tx=0x7f38f8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57e4d58c016dbf39 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:12.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.416+0000 7f390159a700 1 -- 172.21.15.62:0/835421209 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f800b8a0 con 0x7f39040ca1c0 2023-06-09T04:41:12.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.416+0000 7f390159a700 1 -- 172.21.15.62:0/835421209 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38f800ba00 con 0x7f39040ca1c0 2023-06-09T04:41:12.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.416+0000 7f390159a700 1 -- 172.21.15.62:0/835421209 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f800bd90 con 0x7f39040ca1c0 2023-06-09T04:41:12.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.416+0000 7f390359e700 1 -- 172.21.15.62:0/835421209 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39040ca1c0 msgr2=0x7f39040afb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:12.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.416+0000 7f390359e700 1 --2- 172.21.15.62:0/835421209 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39040ca1c0 0x7f39040afb50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f39040cdb70 tx=0x7f38f8009bf0 comp rx=0 tx=0).stop 2023-06-09T04:41:12.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.416+0000 7f390359e700 1 -- 172.21.15.62:0/835421209 shutdown_connections 2023-06-09T04:41:12.424 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.416+0000 7f390359e700 1 --2- 172.21.15.62:0/835421209 >> v2:172.21.15.89:3300/0 conn(0x7f39040b0090 0x7f39040cbfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:12.424 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.416+0000 7f390359e700 1 --2- 172.21.15.62:0/835421209 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39040ca1c0 0x7f39040afb50 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:12.424 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.416+0000 7f390359e700 1 --2- 172.21.15.62:0/835421209 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3904071730 0x7f390406f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:12.424 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.416+0000 7f390359e700 1 -- 172.21.15.62:0/835421209 >> 172.21.15.62:0/835421209 conn(0x7f39040cab50 msgr2=0x7f39040caf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:12.424 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.416+0000 7f390359e700 1 -- 172.21.15.62:0/835421209 shutdown_connections 2023-06-09T04:41:12.424 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.416+0000 7f390359e700 1 -- 172.21.15.62:0/835421209 wait complete. 2023-06-09T04:41:12.425 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.420+0000 7f390359e700 1 Processor -- start 2023-06-09T04:41:12.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.420+0000 7f390359e700 1 -- start start 2023-06-09T04:41:12.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.424+0000 7f390359e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3904071730 0x7f39040ad100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:12.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.424+0000 7f390359e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39040b0090 0x7f39041f46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:12.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.424+0000 7f390359e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39040ca1c0 0x7f390406d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:12.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.424+0000 7f390359e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3904153090 con 0x7f3904071730 2023-06-09T04:41:12.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.424+0000 7f390359e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39041f4c10 con 0x7f39040ca1c0 2023-06-09T04:41:12.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.424+0000 7f390359e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f390406d5b0 con 0x7f39040b0090 2023-06-09T04:41:12.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.424+0000 7f390259c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3904071730 0x7f39040ad100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:12.430 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.424+0000 7f390259c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3904071730 0x7f39040ad100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54560/0 (socket says 172.21.15.62:54560) 2023-06-09T04:41:12.430 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.424+0000 7f390259c700 1 -- 172.21.15.62:0/4283287766 learned_addr learned my addr 172.21.15.62:0/4283287766 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:12.430 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.424+0000 7f3902d9d700 1 --2- 172.21.15.62:0/4283287766 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39040ca1c0 0x7f390406d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:12.430 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.424+0000 7f3901d9b700 1 --2- 172.21.15.62:0/4283287766 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39040b0090 0x7f39041f46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:12.430 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.424+0000 7f390259c700 1 -- 172.21.15.62:0/4283287766 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39040b0090 msgr2=0x7f39041f46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:12.430 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.424+0000 7f390259c700 1 --2- 172.21.15.62:0/4283287766 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39040b0090 0x7f39041f46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:12.430 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.424+0000 7f390259c700 1 -- 172.21.15.62:0/4283287766 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39040ca1c0 msgr2=0x7f390406d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:12.430 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.424+0000 7f390259c700 1 --2- 172.21.15.62:0/4283287766 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39040ca1c0 0x7f390406d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:12.431 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.424+0000 7f390259c700 1 -- 172.21.15.62:0/4283287766 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38f8009570 con 0x7f3904071730 2023-06-09T04:41:12.431 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.424+0000 7f390259c700 1 --2- 172.21.15.62:0/4283287766 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3904071730 0x7f39040ad100 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f38f400c7f0 tx=0x7f38f400cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:12.431 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.424+0000 7f38f2ffd700 1 -- 172.21.15.62:0/4283287766 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f4011800 con 0x7f3904071730 2023-06-09T04:41:12.432 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.424+0000 7f38f2ffd700 1 -- 172.21.15.62:0/4283287766 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38f4011960 con 0x7f3904071730 2023-06-09T04:41:12.432 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.424+0000 7f390359e700 1 -- 172.21.15.62:0/4283287766 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39041f4e20 con 0x7f3904071730 2023-06-09T04:41:12.432 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.424+0000 7f38f2ffd700 1 -- 172.21.15.62:0/4283287766 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f4011d10 con 0x7f3904071730 2023-06-09T04:41:12.432 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.428+0000 7f390359e700 1 -- 172.21.15.62:0/4283287766 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39041f53e0 con 0x7f3904071730 2023-06-09T04:41:12.432 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.428+0000 7f390359e700 1 -- 172.21.15.62:0/4283287766 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39041f55d0 con 0x7f3904071730 2023-06-09T04:41:12.433 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.428+0000 7f38f2ffd700 1 -- 172.21.15.62:0/4283287766 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f38f4018360 con 0x7f3904071730 2023-06-09T04:41:12.435 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.432+0000 7f38f2ffd700 1 --2- 172.21.15.62:0/4283287766 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f38e40662f0 0x7f38e40687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:12.435 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.432+0000 7f38f2ffd700 1 -- 172.21.15.62:0/4283287766 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f38f4083f60 con 0x7f3904071730 2023-06-09T04:41:12.435 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.432+0000 7f3901d9b700 1 --2- 172.21.15.62:0/4283287766 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f38e40662f0 0x7f38e40687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:12.437 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.432+0000 7f3901d9b700 1 --2- 172.21.15.62:0/4283287766 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f38e40662f0 0x7f38e40687a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f38f8000c00 tx=0x7f38f8008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:12.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.436+0000 7f38f2ffd700 1 -- 172.21.15.62:0/4283287766 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f38f4054a50 con 0x7f3904071730 2023-06-09T04:41:12.616 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.612+0000 7f390359e700 1 -- 172.21.15.62:0/4283287766 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f39040739c0 con 0x7f3904071730 2023-06-09T04:41:12.616 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.612+0000 7f38f2ffd700 1 -- 172.21.15.62:0/4283287766 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7f38f401f020 con 0x7f3904071730 2023-06-09T04:41:12.617 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2023-06-09T04:41:12.619 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.616+0000 7f390359e700 1 -- 172.21.15.62:0/4283287766 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f38e40662f0 msgr2=0x7f38e40687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:12.619 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.616+0000 7f390359e700 1 --2- 172.21.15.62:0/4283287766 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f38e40662f0 0x7f38e40687a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f38f8000c00 tx=0x7f38f8008030 comp rx=0 tx=0).stop 2023-06-09T04:41:12.619 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.616+0000 7f390359e700 1 -- 172.21.15.62:0/4283287766 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3904071730 msgr2=0x7f39040ad100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:12.620 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.616+0000 7f390359e700 1 --2- 172.21.15.62:0/4283287766 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3904071730 0x7f39040ad100 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f38f400c7f0 tx=0x7f38f400cb00 comp rx=0 tx=0).stop 2023-06-09T04:41:12.620 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.616+0000 7f390359e700 1 -- 172.21.15.62:0/4283287766 shutdown_connections 2023-06-09T04:41:12.620 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.616+0000 7f390359e700 1 --2- 172.21.15.62:0/4283287766 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f38e40662f0 0x7f38e40687a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:12.620 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.616+0000 7f390359e700 1 --2- 172.21.15.62:0/4283287766 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39040ca1c0 0x7f390406d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:12.621 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.616+0000 7f390359e700 1 --2- 172.21.15.62:0/4283287766 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39040b0090 0x7f39041f46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:12.621 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.616+0000 7f390359e700 1 --2- 172.21.15.62:0/4283287766 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3904071730 0x7f39040ad100 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:12.621 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.616+0000 7f390359e700 1 -- 172.21.15.62:0/4283287766 >> 172.21.15.62:0/4283287766 conn(0x7f39040cab50 msgr2=0x7f39040caf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:12.621 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.616+0000 7f390359e700 1 -- 172.21.15.62:0/4283287766 shutdown_connections 2023-06-09T04:41:12.621 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.616+0000 7f390359e700 1 -- 172.21.15.62:0/4283287766 wait complete. 2023-06-09T04:41:12.640 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T04:41:12.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.820+0000 7f651dad8700 1 Processor -- start 2023-06-09T04:41:12.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.820+0000 7f651dad8700 1 -- start start 2023-06-09T04:41:12.826 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.820+0000 7f651dad8700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f65180d1090 0x7f65180ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:12.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.820+0000 7f651dad8700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65180d0c00 con 0x7f65180b3ed0 2023-06-09T04:41:12.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.820+0000 7f651dad8700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65180b1b30 con 0x7f65180cf0e0 2023-06-09T04:41:12.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.820+0000 7f651dad8700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65180cf940 con 0x7f65180d1090 2023-06-09T04:41:12.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.824+0000 7f651cad6700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f65180b3ed0 0x7f65180b42a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:52298/0 (socket says 172.21.15.62:52298) 2023-06-09T04:41:12.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.824+0000 7f651cad6700 1 -- 172.21.15.62:0/79233474 learned_addr learned my addr 172.21.15.62:0/79233474 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:41:12.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.824+0000 7f6517fff700 1 --2- 172.21.15.62:0/79233474 >> v2:172.21.15.62:3300/0 conn(0x7f65180d1090 0x7f65180ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:12.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.824+0000 7f65177fe700 1 -- 172.21.15.62:0/79233474 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1899068569 0 0) 0x7f65180d0c00 con 0x7f65180b3ed0 2023-06-09T04:41:12.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.824+0000 7f65177fe700 1 -- 172.21.15.62:0/79233474 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65080035d0 con 0x7f65180b3ed0 2023-06-09T04:41:12.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.824+0000 7f65177fe700 1 -- 172.21.15.62:0/79233474 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2050918095 0 0) 0x7f65180b1b30 con 0x7f65180cf0e0 2023-06-09T04:41:12.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.824+0000 7f65177fe700 1 -- 172.21.15.62:0/79233474 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65180d0c00 con 0x7f65180cf0e0 2023-06-09T04:41:12.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.824+0000 7f6517fff700 1 -- 172.21.15.62:0/79233474 >> v1:172.21.15.89:6789/0 conn(0x7f65180cf0e0 legacy=0x7f65180b52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:12.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.824+0000 7f6517fff700 1 -- 172.21.15.62:0/79233474 >> v1:172.21.15.62:6789/0 conn(0x7f65180b3ed0 legacy=0x7f65180b42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:12.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.824+0000 7f6517fff700 1 -- 172.21.15.62:0/79233474 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65180d02d0 con 0x7f65180d1090 2023-06-09T04:41:12.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.824+0000 7f6517fff700 1 --2- 172.21.15.62:0/79233474 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65180d1090 0x7f65180ceba0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6504009850 tx=0x7f6504009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c14005ed9fa1d82 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:12.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.824+0000 7f65177fe700 1 -- 172.21.15.62:0/79233474 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6504011830 con 0x7f65180d1090 2023-06-09T04:41:12.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.824+0000 7f65177fe700 1 -- 172.21.15.62:0/79233474 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6504011990 con 0x7f65180d1090 2023-06-09T04:41:12.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.824+0000 7f65177fe700 1 -- 172.21.15.62:0/79233474 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6504011d40 con 0x7f65180d1090 2023-06-09T04:41:12.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.824+0000 7f651dad8700 1 -- 172.21.15.62:0/79233474 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65180d1090 msgr2=0x7f65180ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:12.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.824+0000 7f651dad8700 1 --2- 172.21.15.62:0/79233474 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65180d1090 0x7f65180ceba0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6504009850 tx=0x7f6504009b60 comp rx=0 tx=0).stop 2023-06-09T04:41:12.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.824+0000 7f651dad8700 1 -- 172.21.15.62:0/79233474 shutdown_connections 2023-06-09T04:41:12.832 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.828+0000 7f651dad8700 1 --2- 172.21.15.62:0/79233474 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65180d1090 0x7f65180ceba0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:12.832 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.828+0000 7f651dad8700 1 -- 172.21.15.62:0/79233474 >> 172.21.15.62:0/79233474 conn(0x7f651806a500 msgr2=0x7f651806a900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:12.832 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.828+0000 7f651dad8700 1 -- 172.21.15.62:0/79233474 shutdown_connections 2023-06-09T04:41:12.832 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.828+0000 7f651dad8700 1 -- 172.21.15.62:0/79233474 wait complete. 2023-06-09T04:41:12.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.828+0000 7f651dad8700 1 Processor -- start 2023-06-09T04:41:12.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.828+0000 7f651dad8700 1 -- start start 2023-06-09T04:41:12.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.832+0000 7f651dad8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65180b3ed0 0x7f65180b1030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:12.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.832+0000 7f651dad8700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65180cf0e0 0x7f65180c9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:12.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.832+0000 7f651dad8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65180d1090 0x7f65180a9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:12.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.832+0000 7f651dad8700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65180c9fc0 con 0x7f65180d1090 2023-06-09T04:41:12.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.832+0000 7f651dad8700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65180ca2a0 con 0x7f65180cf0e0 2023-06-09T04:41:12.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.832+0000 7f651dad8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65180ca580 con 0x7f65180b3ed0 2023-06-09T04:41:12.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.832+0000 7f651d2d7700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65180d1090 0x7f65180a9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:12.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.832+0000 7f651d2d7700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65180d1090 0x7f65180a9660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54586/0 (socket says 172.21.15.62:54586) 2023-06-09T04:41:12.837 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.832+0000 7f651d2d7700 1 -- 172.21.15.62:0/202612012 learned_addr learned my addr 172.21.15.62:0/202612012 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:12.837 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.832+0000 7f6517fff700 1 --2- 172.21.15.62:0/202612012 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65180cf0e0 0x7f65180c9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:12.837 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.832+0000 7f651cad6700 1 --2- 172.21.15.62:0/202612012 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65180b3ed0 0x7f65180b1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:12.837 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.832+0000 7f651d2d7700 1 -- 172.21.15.62:0/202612012 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65180b3ed0 msgr2=0x7f65180b1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:12.837 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.832+0000 7f651d2d7700 1 --2- 172.21.15.62:0/202612012 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65180b3ed0 0x7f65180b1030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:12.837 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.832+0000 7f651d2d7700 1 -- 172.21.15.62:0/202612012 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65180cf0e0 msgr2=0x7f65180c9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:12.837 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.832+0000 7f651d2d7700 1 --2- 172.21.15.62:0/202612012 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65180cf0e0 0x7f65180c9520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:12.838 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.832+0000 7f651d2d7700 1 -- 172.21.15.62:0/202612012 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65040094b0 con 0x7f65180d1090 2023-06-09T04:41:12.838 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.832+0000 7f651cad6700 1 --2- 172.21.15.62:0/202612012 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65180b3ed0 0x7f65180b1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:41:12.838 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.832+0000 7f651d2d7700 1 --2- 172.21.15.62:0/202612012 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65180d1090 0x7f65180a9660 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f651000cc20 tx=0x7f651000cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:12.838 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.832+0000 7f65157fa700 1 -- 172.21.15.62:0/202612012 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6510003c20 con 0x7f65180d1090 2023-06-09T04:41:12.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.832+0000 7f65157fa700 1 -- 172.21.15.62:0/202612012 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6510003d80 con 0x7f65180d1090 2023-06-09T04:41:12.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.832+0000 7f65157fa700 1 -- 172.21.15.62:0/202612012 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f651000ab90 con 0x7f65180d1090 2023-06-09T04:41:12.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.832+0000 7f651dad8700 1 -- 172.21.15.62:0/202612012 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65180ca860 con 0x7f65180d1090 2023-06-09T04:41:12.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.832+0000 7f651dad8700 1 -- 172.21.15.62:0/202612012 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65181f16d0 con 0x7f65180d1090 2023-06-09T04:41:12.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.836+0000 7f651dad8700 1 -- 172.21.15.62:0/202612012 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65180739c0 con 0x7f65180d1090 2023-06-09T04:41:12.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.836+0000 7f65157fa700 1 -- 172.21.15.62:0/202612012 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f651000acf0 con 0x7f65180d1090 2023-06-09T04:41:12.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.836+0000 7f65157fa700 1 --2- 172.21.15.62:0/202612012 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f64fc0662f0 0x7f64fc0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:12.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.840+0000 7f65157fa700 1 -- 172.21.15.62:0/202612012 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f65100840f0 con 0x7f65180d1090 2023-06-09T04:41:12.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.840+0000 7f651cad6700 1 --2- 172.21.15.62:0/202612012 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f64fc0662f0 0x7f64fc0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:12.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.840+0000 7f651cad6700 1 --2- 172.21.15.62:0/202612012 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f64fc0662f0 0x7f64fc0687a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f650c0011e0 tx=0x7f650c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:12.849 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:12.844+0000 7f65157fa700 1 -- 172.21.15.62:0/202612012 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6510051270 con 0x7f65180d1090 2023-06-09T04:41:13.024 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.020+0000 7f651dad8700 1 -- 172.21.15.62:0/202612012 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f651808a330 con 0x7f65180d1090 2023-06-09T04:41:13.024 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.020+0000 7f65157fa700 1 -- 172.21.15.62:0/202612012 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6510054890 con 0x7f65180d1090 2023-06-09T04:41:13.025 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-06-09T04:41:13.027 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.024+0000 7f651dad8700 1 -- 172.21.15.62:0/202612012 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f64fc0662f0 msgr2=0x7f64fc0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:13.027 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.024+0000 7f651dad8700 1 --2- 172.21.15.62:0/202612012 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f64fc0662f0 0x7f64fc0687a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f650c0011e0 tx=0x7f650c009040 comp rx=0 tx=0).stop 2023-06-09T04:41:13.027 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.024+0000 7f651dad8700 1 -- 172.21.15.62:0/202612012 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65180d1090 msgr2=0x7f65180a9660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:13.027 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.024+0000 7f651dad8700 1 --2- 172.21.15.62:0/202612012 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65180d1090 0x7f65180a9660 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f651000cc20 tx=0x7f651000cf30 comp rx=0 tx=0).stop 2023-06-09T04:41:13.028 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.024+0000 7f651dad8700 1 -- 172.21.15.62:0/202612012 shutdown_connections 2023-06-09T04:41:13.028 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.024+0000 7f651dad8700 1 --2- 172.21.15.62:0/202612012 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f64fc0662f0 0x7f64fc0687a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:13.029 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.024+0000 7f651dad8700 1 --2- 172.21.15.62:0/202612012 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65180d1090 0x7f65180a9660 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:13.029 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.024+0000 7f651dad8700 1 --2- 172.21.15.62:0/202612012 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65180cf0e0 0x7f65180c9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:13.029 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.024+0000 7f651dad8700 1 --2- 172.21.15.62:0/202612012 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f65180b3ed0 0x7f65180b1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:13.029 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.024+0000 7f651dad8700 1 -- 172.21.15.62:0/202612012 >> 172.21.15.62:0/202612012 conn(0x7f651806a500 msgr2=0x7f65180b42a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:13.029 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.024+0000 7f651dad8700 1 -- 172.21.15.62:0/202612012 shutdown_connections 2023-06-09T04:41:13.029 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.024+0000 7f651dad8700 1 -- 172.21.15.62:0/202612012 wait complete. 2023-06-09T04:41:13.049 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T04:41:13.236 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.232+0000 7f3dc2098700 1 Processor -- start 2023-06-09T04:41:13.237 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.232+0000 7f3dc2098700 1 -- start start 2023-06-09T04:41:13.240 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.236+0000 7f3dc2098700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3dbc15f400 0x7f3dbc15d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:13.240 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.236+0000 7f3dc2098700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3dbc0697f0 0x7f3dbc069be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:13.241 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.236+0000 7f3dc2098700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dbc071c40 con 0x7f3dbc15c3f0 2023-06-09T04:41:13.241 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.236+0000 7f3dc2098700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dbc15f7d0 con 0x7f3dbc15f400 2023-06-09T04:41:13.241 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.236+0000 7f3dc2098700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dbc06a120 con 0x7f3dbc0697f0 2023-06-09T04:41:13.242 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.236+0000 7f3dbaffd700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f3dbc15c3f0 0x7f3dbc071530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:52302/0 (socket says 172.21.15.62:52302) 2023-06-09T04:41:13.242 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.236+0000 7f3dbaffd700 1 -- 172.21.15.62:0/3489165212 learned_addr learned my addr 172.21.15.62:0/3489165212 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:41:13.242 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.236+0000 7f3dbb7fe700 1 --2- 172.21.15.62:0/3489165212 >> v2:172.21.15.62:3300/0 conn(0x7f3dbc15f400 0x7f3dbc15d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:13.242 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.236+0000 7f3dbbfff700 1 --2- 172.21.15.62:0/3489165212 >> v2:172.21.15.89:3300/0 conn(0x7f3dbc0697f0 0x7f3dbc069be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:13.242 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.236+0000 7f3dba7fc700 1 -- 172.21.15.62:0/3489165212 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2208936190 0 0) 0x7f3dbc071c40 con 0x7f3dbc15c3f0 2023-06-09T04:41:13.242 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.236+0000 7f3dba7fc700 1 -- 172.21.15.62:0/3489165212 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3da40035d0 con 0x7f3dbc15c3f0 2023-06-09T04:41:13.243 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.236+0000 7f3dbb7fe700 1 -- 172.21.15.62:0/3489165212 >> v2:172.21.15.89:3300/0 conn(0x7f3dbc0697f0 msgr2=0x7f3dbc069be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:13.243 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.236+0000 7f3dbb7fe700 1 --2- 172.21.15.62:0/3489165212 >> v2:172.21.15.89:3300/0 conn(0x7f3dbc0697f0 0x7f3dbc069be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:13.243 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.236+0000 7f3dbb7fe700 1 -- 172.21.15.62:0/3489165212 >> v1:172.21.15.62:6789/0 conn(0x7f3dbc15c3f0 legacy=0x7f3dbc071530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:13.243 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.236+0000 7f3dbb7fe700 1 -- 172.21.15.62:0/3489165212 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dbc15c8f0 con 0x7f3dbc15f400 2023-06-09T04:41:13.243 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.236+0000 7f3dbbfff700 1 --2- 172.21.15.62:0/3489165212 >> v2:172.21.15.89:3300/0 conn(0x7f3dbc0697f0 0x7f3dbc069be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:41:13.244 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.236+0000 7f3dbb7fe700 1 --2- 172.21.15.62:0/3489165212 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3dbc15f400 0x7f3dbc15d5b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc06f370 tx=0x7f3dac009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=454493681d4221b6 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:13.244 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.240+0000 7f3dba7fc700 1 -- 172.21.15.62:0/3489165212 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dac011830 con 0x7f3dbc15f400 2023-06-09T04:41:13.244 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.240+0000 7f3dba7fc700 1 -- 172.21.15.62:0/3489165212 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dac011990 con 0x7f3dbc15f400 2023-06-09T04:41:13.244 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.240+0000 7f3dba7fc700 1 -- 172.21.15.62:0/3489165212 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dac011d20 con 0x7f3dbc15f400 2023-06-09T04:41:13.245 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.240+0000 7f3dc2098700 1 -- 172.21.15.62:0/3489165212 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3dbc15f400 msgr2=0x7f3dbc15d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:13.245 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.240+0000 7f3dc2098700 1 --2- 172.21.15.62:0/3489165212 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3dbc15f400 0x7f3dbc15d5b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc06f370 tx=0x7f3dac009b30 comp rx=0 tx=0).stop 2023-06-09T04:41:13.245 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.240+0000 7f3dc2098700 1 -- 172.21.15.62:0/3489165212 shutdown_connections 2023-06-09T04:41:13.245 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.240+0000 7f3dc2098700 1 --2- 172.21.15.62:0/3489165212 >> v2:172.21.15.89:3300/0 conn(0x7f3dbc0697f0 0x7f3dbc069be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:13.245 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.240+0000 7f3dc2098700 1 --2- 172.21.15.62:0/3489165212 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3dbc15f400 0x7f3dbc15d5b0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:13.245 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.240+0000 7f3dc2098700 1 -- 172.21.15.62:0/3489165212 >> 172.21.15.62:0/3489165212 conn(0x7f3dbc06c5d0 msgr2=0x7f3dbc0cad60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:13.246 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.240+0000 7f3dc2098700 1 -- 172.21.15.62:0/3489165212 shutdown_connections 2023-06-09T04:41:13.246 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.240+0000 7f3dc2098700 1 -- 172.21.15.62:0/3489165212 wait complete. 2023-06-09T04:41:13.248 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.244+0000 7f3dc2098700 1 Processor -- start 2023-06-09T04:41:13.248 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.244+0000 7f3dc2098700 1 -- start start 2023-06-09T04:41:13.250 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.244+0000 7f3dc2098700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3dbc0697f0 0x7f3dbc14e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:13.250 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.244+0000 7f3dc2098700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3dbc15c3f0 0x7f3dbc1f6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:13.251 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.244+0000 7f3dc2098700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3dbc15f400 0x7f3dbc1f5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:13.251 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.244+0000 7f3dc2098700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dbc14ccd0 con 0x7f3dbc15c3f0 2023-06-09T04:41:13.251 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.244+0000 7f3dc2098700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dbc14ea80 con 0x7f3dbc15f400 2023-06-09T04:41:13.251 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.244+0000 7f3dc2098700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dbc14c910 con 0x7f3dbc0697f0 2023-06-09T04:41:13.252 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.248+0000 7f3dbaffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3dbc15c3f0 0x7f3dbc1f6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:13.252 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.248+0000 7f3dbaffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3dbc15c3f0 0x7f3dbc1f6a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54592/0 (socket says 172.21.15.62:54592) 2023-06-09T04:41:13.252 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.248+0000 7f3dbaffd700 1 -- 172.21.15.62:0/247553886 learned_addr learned my addr 172.21.15.62:0/247553886 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:13.252 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.248+0000 7f3dbb7fe700 1 --2- 172.21.15.62:0/247553886 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3dbc0697f0 0x7f3dbc14e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:13.252 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.248+0000 7f3dbbfff700 1 --2- 172.21.15.62:0/247553886 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3dbc15f400 0x7f3dbc1f5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:13.253 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.248+0000 7f3dbaffd700 1 -- 172.21.15.62:0/247553886 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3dbc0697f0 msgr2=0x7f3dbc14e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:13.253 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.248+0000 7f3dbaffd700 1 --2- 172.21.15.62:0/247553886 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3dbc0697f0 0x7f3dbc14e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:13.253 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.248+0000 7f3dbaffd700 1 -- 172.21.15.62:0/247553886 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3dbc15f400 msgr2=0x7f3dbc1f5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:13.253 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.248+0000 7f3dbaffd700 1 --2- 172.21.15.62:0/247553886 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3dbc15f400 0x7f3dbc1f5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:13.253 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.248+0000 7f3dbaffd700 1 -- 172.21.15.62:0/247553886 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dac0094b0 con 0x7f3dbc15c3f0 2023-06-09T04:41:13.254 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.248+0000 7f3dbaffd700 1 --2- 172.21.15.62:0/247553886 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3dbc15c3f0 0x7f3dbc1f6a00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3db000c700 tx=0x7f3db000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:13.254 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.248+0000 7f3da3fff700 1 -- 172.21.15.62:0/247553886 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db0005d90 con 0x7f3dbc15c3f0 2023-06-09T04:41:13.254 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.248+0000 7f3da3fff700 1 -- 172.21.15.62:0/247553886 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3db00070d0 con 0x7f3dbc15c3f0 2023-06-09T04:41:13.254 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.248+0000 7f3da3fff700 1 -- 172.21.15.62:0/247553886 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db0007480 con 0x7f3dbc15c3f0 2023-06-09T04:41:13.254 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.248+0000 7f3dc2098700 1 -- 172.21.15.62:0/247553886 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dbc1f6300 con 0x7f3dbc15c3f0 2023-06-09T04:41:13.254 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.248+0000 7f3dc2098700 1 -- 172.21.15.62:0/247553886 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dbc0b3430 con 0x7f3dbc15c3f0 2023-06-09T04:41:13.255 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.248+0000 7f3dc2098700 1 -- 172.21.15.62:0/247553886 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dbc1f6820 con 0x7f3dbc15c3f0 2023-06-09T04:41:13.255 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.252+0000 7f3da3fff700 1 -- 172.21.15.62:0/247553886 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3db00075e0 con 0x7f3dbc15c3f0 2023-06-09T04:41:13.257 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.252+0000 7f3da3fff700 1 --2- 172.21.15.62:0/247553886 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f3da80662f0 0x7f3da80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:13.257 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.252+0000 7f3da3fff700 1 -- 172.21.15.62:0/247553886 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3db00833a0 con 0x7f3dbc15c3f0 2023-06-09T04:41:13.258 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.252+0000 7f3dbb7fe700 1 --2- 172.21.15.62:0/247553886 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f3da80662f0 0x7f3da80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:13.259 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.256+0000 7f3dbb7fe700 1 --2- 172.21.15.62:0/247553886 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f3da80662f0 0x7f3da80687a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3dac000c00 tx=0x7f3dac008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:13.264 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.260+0000 7f3da3fff700 1 -- 172.21.15.62:0/247553886 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3db00505c0 con 0x7f3dbc15c3f0 2023-06-09T04:41:13.437 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.432+0000 7f3dc2098700 1 -- 172.21.15.62:0/247553886 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3dbc0739c0 con 0x7f3dbc15c3f0 2023-06-09T04:41:13.438 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.432+0000 7f3da3fff700 1 -- 172.21.15.62:0/247553886 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3db0053be0 con 0x7f3dbc15c3f0 2023-06-09T04:41:13.438 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 64 2023-06-09T04:41:13.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.436+0000 7f3dc2098700 1 -- 172.21.15.62:0/247553886 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f3da80662f0 msgr2=0x7f3da80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:13.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.436+0000 7f3dc2098700 1 --2- 172.21.15.62:0/247553886 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f3da80662f0 0x7f3da80687a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3dac000c00 tx=0x7f3dac008030 comp rx=0 tx=0).stop 2023-06-09T04:41:13.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.436+0000 7f3dc2098700 1 -- 172.21.15.62:0/247553886 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3dbc15c3f0 msgr2=0x7f3dbc1f6a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:13.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.436+0000 7f3dc2098700 1 --2- 172.21.15.62:0/247553886 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3dbc15c3f0 0x7f3dbc1f6a00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3db000c700 tx=0x7f3db000ca10 comp rx=0 tx=0).stop 2023-06-09T04:41:13.442 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.436+0000 7f3dc2098700 1 -- 172.21.15.62:0/247553886 shutdown_connections 2023-06-09T04:41:13.442 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.436+0000 7f3dc2098700 1 --2- 172.21.15.62:0/247553886 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f3da80662f0 0x7f3da80687a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:13.442 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.436+0000 7f3dc2098700 1 --2- 172.21.15.62:0/247553886 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3dbc15f400 0x7f3dbc1f5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:13.442 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.436+0000 7f3dc2098700 1 --2- 172.21.15.62:0/247553886 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3dbc15c3f0 0x7f3dbc1f6a00 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:13.442 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.436+0000 7f3dc2098700 1 --2- 172.21.15.62:0/247553886 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3dbc0697f0 0x7f3dbc14e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:13.442 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.436+0000 7f3dc2098700 1 -- 172.21.15.62:0/247553886 >> 172.21.15.62:0/247553886 conn(0x7f3dbc06c5d0 msgr2=0x7f3dbc0acff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:13.443 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.436+0000 7f3dc2098700 1 -- 172.21.15.62:0/247553886 shutdown_connections 2023-06-09T04:41:13.443 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.436+0000 7f3dc2098700 1 -- 172.21.15.62:0/247553886 wait complete. 2023-06-09T04:41:13.463 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-09T04:41:13.641 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.636+0000 7faf8b076700 1 Processor -- start 2023-06-09T04:41:13.642 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.636+0000 7faf8b076700 1 -- start start 2023-06-09T04:41:13.644 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.640+0000 7faf8b076700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7faf840b3b20 0x7faf840cebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:13.644 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.640+0000 7faf8b076700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf840b4d50 con 0x7faf840cd2e0 2023-06-09T04:41:13.645 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.640+0000 7faf8b076700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf840b4140 con 0x7faf840d1f80 2023-06-09T04:41:13.645 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.640+0000 7faf8b076700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf840b3f40 con 0x7faf840b3b20 2023-06-09T04:41:13.645 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.640+0000 7faf8a875700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7faf840b3b20 0x7faf840cebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:13.646 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.640+0000 7faf8a875700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7faf840b3b20 0x7faf840cebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54598/0 (socket says 172.21.15.62:54598) 2023-06-09T04:41:13.646 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.640+0000 7faf8a875700 1 -- 172.21.15.62:0/4239206510 learned_addr learned my addr 172.21.15.62:0/4239206510 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:13.646 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.640+0000 7faf8a875700 1 -- 172.21.15.62:0/4239206510 >> v1:172.21.15.89:6789/0 conn(0x7faf840d1f80 legacy=0x7faf840ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:13.646 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.640+0000 7faf8a875700 1 -- 172.21.15.62:0/4239206510 >> v1:172.21.15.62:6789/0 conn(0x7faf840cd2e0 legacy=0x7faf840d0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:13.646 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.640+0000 7faf8a875700 1 -- 172.21.15.62:0/4239206510 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf840b4420 con 0x7faf840b3b20 2023-06-09T04:41:13.647 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.640+0000 7faf8a875700 1 --2- 172.21.15.62:0/4239206510 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf840b3b20 0x7faf840cebf0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7faf7c009e50 tx=0x7faf7c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9bb65c6f5440269 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:13.647 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.644+0000 7faf89072700 1 -- 172.21.15.62:0/4239206510 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf7c00e070 con 0x7faf840b3b20 2023-06-09T04:41:13.647 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.644+0000 7faf89072700 1 -- 172.21.15.62:0/4239206510 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf7c00b9c0 con 0x7faf840b3b20 2023-06-09T04:41:13.647 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.644+0000 7faf89072700 1 -- 172.21.15.62:0/4239206510 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf7c00bd70 con 0x7faf840b3b20 2023-06-09T04:41:13.647 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.644+0000 7faf8b076700 1 -- 172.21.15.62:0/4239206510 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf840b3b20 msgr2=0x7faf840cebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:13.648 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.644+0000 7faf8b076700 1 --2- 172.21.15.62:0/4239206510 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf840b3b20 0x7faf840cebf0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7faf7c009e50 tx=0x7faf7c00b330 comp rx=0 tx=0).stop 2023-06-09T04:41:13.648 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.644+0000 7faf8b076700 1 -- 172.21.15.62:0/4239206510 shutdown_connections 2023-06-09T04:41:13.648 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.644+0000 7faf8b076700 1 --2- 172.21.15.62:0/4239206510 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf840b3b20 0x7faf840cebf0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:13.649 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.644+0000 7faf8b076700 1 -- 172.21.15.62:0/4239206510 >> 172.21.15.62:0/4239206510 conn(0x7faf84071840 msgr2=0x7faf8409b760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:13.649 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.644+0000 7faf8b076700 1 -- 172.21.15.62:0/4239206510 shutdown_connections 2023-06-09T04:41:13.649 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.644+0000 7faf8b076700 1 -- 172.21.15.62:0/4239206510 wait complete. 2023-06-09T04:41:13.650 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.644+0000 7faf8b076700 1 Processor -- start 2023-06-09T04:41:13.650 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.644+0000 7faf8b076700 1 -- start start 2023-06-09T04:41:13.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.648+0000 7faf8b076700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf840b3b20 0x7faf8415afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:13.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.648+0000 7faf8b076700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf840cd2e0 0x7faf8415e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:13.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.648+0000 7faf8b076700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf840d1f80 0x7faf8415e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:13.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.648+0000 7faf8b076700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf840b5f80 con 0x7faf840cd2e0 2023-06-09T04:41:13.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.648+0000 7faf8b076700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf840c9af0 con 0x7faf840d1f80 2023-06-09T04:41:13.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.648+0000 7faf8b076700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf840b5300 con 0x7faf840b3b20 2023-06-09T04:41:13.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.648+0000 7faf89873700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf840cd2e0 0x7faf8415e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:13.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.648+0000 7faf89873700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf840cd2e0 0x7faf8415e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54608/0 (socket says 172.21.15.62:54608) 2023-06-09T04:41:13.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.648+0000 7faf89873700 1 -- 172.21.15.62:0/3758412475 learned_addr learned my addr 172.21.15.62:0/3758412475 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:13.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.648+0000 7faf8a875700 1 --2- 172.21.15.62:0/3758412475 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf840d1f80 0x7faf8415e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:13.654 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.648+0000 7faf8a074700 1 --2- 172.21.15.62:0/3758412475 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf840b3b20 0x7faf8415afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:13.654 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.648+0000 7faf89873700 1 -- 172.21.15.62:0/3758412475 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf840b3b20 msgr2=0x7faf8415afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:13.654 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.648+0000 7faf89873700 1 --2- 172.21.15.62:0/3758412475 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf840b3b20 0x7faf8415afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:13.654 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.648+0000 7faf89873700 1 -- 172.21.15.62:0/3758412475 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf840d1f80 msgr2=0x7faf8415e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:13.654 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.648+0000 7faf89873700 1 --2- 172.21.15.62:0/3758412475 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf840d1f80 0x7faf8415e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:13.654 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.648+0000 7faf89873700 1 -- 172.21.15.62:0/3758412475 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf7c009b30 con 0x7faf840cd2e0 2023-06-09T04:41:13.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.648+0000 7faf89873700 1 --2- 172.21.15.62:0/3758412475 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf840cd2e0 0x7faf8415e310 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7faf7400c500 tx=0x7faf7400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:13.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.648+0000 7faf7affd700 1 -- 172.21.15.62:0/3758412475 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf740052d0 con 0x7faf840cd2e0 2023-06-09T04:41:13.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.648+0000 7faf7affd700 1 -- 172.21.15.62:0/3758412475 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf74005430 con 0x7faf840cd2e0 2023-06-09T04:41:13.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.648+0000 7faf8b076700 1 -- 172.21.15.62:0/3758412475 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf840b55e0 con 0x7faf840cd2e0 2023-06-09T04:41:13.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.648+0000 7faf7affd700 1 -- 172.21.15.62:0/3758412475 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf740055a0 con 0x7faf840cd2e0 2023-06-09T04:41:13.656 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.648+0000 7faf8b076700 1 -- 172.21.15.62:0/3758412475 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf840b5ba0 con 0x7faf840cd2e0 2023-06-09T04:41:13.656 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.652+0000 7faf8b076700 1 -- 172.21.15.62:0/3758412475 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf840b60c0 con 0x7faf840cd2e0 2023-06-09T04:41:13.657 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.652+0000 7faf7affd700 1 -- 172.21.15.62:0/3758412475 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7faf740038e0 con 0x7faf840cd2e0 2023-06-09T04:41:13.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.652+0000 7faf7affd700 1 --2- 172.21.15.62:0/3758412475 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7faf680662f0 0x7faf680687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:13.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.652+0000 7faf7affd700 1 -- 172.21.15.62:0/3758412475 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7faf74083400 con 0x7faf840cd2e0 2023-06-09T04:41:13.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.656+0000 7faf8a074700 1 --2- 172.21.15.62:0/3758412475 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7faf680662f0 0x7faf680687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:13.660 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.656+0000 7faf8a074700 1 --2- 172.21.15.62:0/3758412475 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7faf680662f0 0x7faf680687a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7faf80000fb0 tx=0x7faf80009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:13.665 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.660+0000 7faf7affd700 1 -- 172.21.15.62:0/3758412475 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7faf840b60c0 con 0x7faf840cd2e0 2023-06-09T04:41:13.837 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.832+0000 7faf8b076700 1 -- 172.21.15.62:0/3758412475 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7faf840b60c0 con 0x7faf840cd2e0 2023-06-09T04:41:13.838 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.832+0000 7faf7affd700 1 -- 172.21.15.62:0/3758412475 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7faf840b60c0 con 0x7faf840cd2e0 2023-06-09T04:41:13.838 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-06-09T04:41:13.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.836+0000 7faf8b076700 1 -- 172.21.15.62:0/3758412475 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7faf680662f0 msgr2=0x7faf680687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:13.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.836+0000 7faf8b076700 1 --2- 172.21.15.62:0/3758412475 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7faf680662f0 0x7faf680687a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7faf80000fb0 tx=0x7faf80009040 comp rx=0 tx=0).stop 2023-06-09T04:41:13.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.836+0000 7faf8b076700 1 -- 172.21.15.62:0/3758412475 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf840cd2e0 msgr2=0x7faf8415e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:13.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.836+0000 7faf8b076700 1 --2- 172.21.15.62:0/3758412475 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf840cd2e0 0x7faf8415e310 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7faf7400c500 tx=0x7faf7400c810 comp rx=0 tx=0).stop 2023-06-09T04:41:13.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.836+0000 7faf8b076700 1 -- 172.21.15.62:0/3758412475 shutdown_connections 2023-06-09T04:41:13.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.836+0000 7faf8b076700 1 --2- 172.21.15.62:0/3758412475 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7faf680662f0 0x7faf680687a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:13.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.836+0000 7faf8b076700 1 --2- 172.21.15.62:0/3758412475 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf840d1f80 0x7faf8415e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:13.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.836+0000 7faf8b076700 1 --2- 172.21.15.62:0/3758412475 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faf840cd2e0 0x7faf8415e310 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:13.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.836+0000 7faf8b076700 1 --2- 172.21.15.62:0/3758412475 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7faf840b3b20 0x7faf8415afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:13.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.836+0000 7faf8b076700 1 -- 172.21.15.62:0/3758412475 >> 172.21.15.62:0/3758412475 conn(0x7faf84071840 msgr2=0x7faf840b0600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:13.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.836+0000 7faf8b076700 1 -- 172.21.15.62:0/3758412475 shutdown_connections 2023-06-09T04:41:13.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:13.836+0000 7faf8b076700 1 -- 172.21.15.62:0/3758412475 wait complete. 2023-06-09T04:41:13.863 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-09T04:41:14.037 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:14.032+0000 7f73ab59e700 1 Processor -- start 2023-06-09T04:41:14.038 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:14.032+0000 7f73ab59e700 1 -- start start 2023-06-09T04:41:14.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:14.036+0000 7f73ab59e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f73ac1581b0 0x7f73ac0ca5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:14.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:14.036+0000 7f73ab59e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73ac0cc310 con 0x7f73ac06b880 2023-06-09T04:41:14.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:14.036+0000 7f73ab59e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73ac06c060 con 0x7f73ac0c8680 2023-06-09T04:41:14.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:14.036+0000 7f73ab59e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73ac06c340 con 0x7f73ac1581b0 2023-06-09T04:41:14.042 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:14.036+0000 7f73aa59c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f73ac1581b0 0x7f73ac0ca5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:14.042 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:14.036+0000 7f73aa59c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f73ac1581b0 0x7f73ac0ca5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54614/0 (socket says 172.21.15.62:54614) 2023-06-09T04:41:14.042 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:14.036+0000 7f73a3fff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f73ac06b880 0x7f73ac0cbc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:52322/0 (socket says 172.21.15.62:52322) 2023-06-09T04:41:14.042 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:14.036+0000 7f73aa59c700 1 -- 172.21.15.62:0/2463194884 learned_addr learned my addr 172.21.15.62:0/2463194884 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:14.043 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:14.036+0000 7f73a9d9b700 1 -- 172.21.15.62:0/2463194884 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 531313396 0 0) 0x7f73ac06c060 con 0x7f73ac0c8680 2023-06-09T04:41:14.043 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:14.036+0000 7f73aa59c700 1 -- 172.21.15.62:0/2463194884 >> v1:172.21.15.89:6789/0 conn(0x7f73ac0c8680 legacy=0x7f73ac0c8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:14.043 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:14.036+0000 7f73aa59c700 1 -- 172.21.15.62:0/2463194884 >> v1:172.21.15.62:6789/0 conn(0x7f73ac06b880 legacy=0x7f73ac0cbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:14.043 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:14.036+0000 7f73aa59c700 1 -- 172.21.15.62:0/2463194884 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73ac06c620 con 0x7f73ac1581b0 2023-06-09T04:41:14.044 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:14.040+0000 7f73aa59c700 1 --2- 172.21.15.62:0/2463194884 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f73ac1581b0 0x7f73ac0ca5c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f739c009910 tx=0x7f739c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74e24efb97d74756 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:14.044 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:14.040+0000 7f73a9d9b700 1 -- 172.21.15.62:0/2463194884 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f739c004230 con 0x7f73ac1581b0 2023-06-09T04:41:14.044 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:14.040+0000 7f73a9d9b700 1 -- 172.21.15.62:0/2463194884 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f739c004390 con 0x7f73ac1581b0 2023-06-09T04:41:14.044 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:14.040+0000 7f73a9d9b700 1 -- 172.21.15.62:0/2463194884 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f739c009e60 con 0x7f73ac1581b0 2023-06-09T04:41:14.045 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:14.040+0000 7f73ab59e700 1 -- 172.21.15.62:0/2463194884 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f73ac1581b0 msgr2=0x7f73ac0ca5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:14.045 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:14.040+0000 7f73ab59e700 1 --2- 172.21.15.62:0/2463194884 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f73ac1581b0 0x7f73ac0ca5c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f739c009910 tx=0x7f739c009c20 comp rx=0 tx=0).stop 2023-06-09T04:41:14.045 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:14.040+0000 7f73ab59e700 1 -- 172.21.15.62:0/2463194884 shutdown_connections 2023-06-09T04:41:14.045 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:14.040+0000 7f73ab59e700 1 --2- 172.21.15.62:0/2463194884 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f73ac1581b0 0x7f73ac0ca5c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:14.046 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:14.040+0000 7f73ab59e700 1 -- 172.21.15.62:0/2463194884 >> 172.21.15.62:0/2463194884 conn(0x7f73ac06a420 msgr2=0x7f73ac0afc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:14.046 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:14.040+0000 7f73ab59e700 1 -- 172.21.15.62:0/2463194884 shutdown_connections 2023-06-09T04:41:14.046 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:14.040+0000 7f73ab59e700 1 -- 172.21.15.62:0/2463194884 wait complete. 2023-06-09T04:41:14.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:14.044+0000 7f73ab59e700 1 Processor -- start 2023-06-09T04:41:14.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:14.044+0000 7f73ab59e700 1 -- start start 2023-06-09T04:41:14.048 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:14.044+0000 7f73ab59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f73ac0c8680 0x7f73ac150480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:14.049 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:14.044+0000 7f73ab59e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f73ac1581b0 0x7f73ac0c1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:14.049 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:14.044+0000 7f73ab59e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f73ac0ac900 0x7f73ac0acd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:14.049 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:14.044+0000 7f73ab59e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73ac0ad2c0 con 0x7f73ac0c8680 2023-06-09T04:41:14.049 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:14.044+0000 7f73ab59e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73ac15ab60 con 0x7f73ac1581b0 2023-06-09T04:41:14.049 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:14.044+0000 7f73ab59e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73ac15a880 con 0x7f73ac0ac900 2023-06-09T04:41:14.050 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:14.044+0000 7f73aa59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f73ac0c8680 0x7f73ac150480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:14.050 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:14.044+0000 7f73aa59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f73ac0c8680 0x7f73ac150480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54628/0 (socket says 172.21.15.62:54628) 2023-06-09T04:41:14.051 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:14.044+0000 7f73aa59c700 1 -- 172.21.15.62:0/2953870180 learned_addr learned my addr 172.21.15.62:0/2953870180 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:14.051 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:14.044+0000 7f73a3fff700 1 --2- 172.21.15.62:0/2953870180 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f73ac1581b0 0x7f73ac0c1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:14.051 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:14.044+0000 7f73aa59c700 1 -- 172.21.15.62:0/2953870180 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f73ac0ac900 msgr2=0x7f73ac0acd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:14.051 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:14.044+0000 7f73aa59c700 1 --2- 172.21.15.62:0/2953870180 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f73ac0ac900 0x7f73ac0acd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:14.051 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:14.044+0000 7f73aa59c700 1 -- 172.21.15.62:0/2953870180 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f73ac1581b0 msgr2=0x7f73ac0c1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:14.051 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:14.044+0000 7f73aa59c700 1 --2- 172.21.15.62:0/2953870180 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f73ac1581b0 0x7f73ac0c1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:14.051 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:14.044+0000 7f73aa59c700 1 -- 172.21.15.62:0/2953870180 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f739c009570 con 0x7f73ac0c8680 2023-06-09T04:41:14.052 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:14.044+0000 7f73a3fff700 1 --2- 172.21.15.62:0/2953870180 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f73ac1581b0 0x7f73ac0c1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:41:14.052 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:14.044+0000 7f73aa59c700 1 --2- 172.21.15.62:0/2953870180 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f73ac0c8680 0x7f73ac150480 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f739c004000 tx=0x7f739c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:14.052 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:14.044+0000 7f73a2ffd700 1 -- 172.21.15.62:0/2953870180 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f739c0036c0 con 0x7f73ac0c8680 2023-06-09T04:41:14.052 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:14.044+0000 7f73a2ffd700 1 -- 172.21.15.62:0/2953870180 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f739c003840 con 0x7f73ac0c8680 2023-06-09T04:41:14.052 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:14.044+0000 7f73a2ffd700 1 -- 172.21.15.62:0/2953870180 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f739c003bf0 con 0x7f73ac0c8680 2023-06-09T04:41:14.052 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:14.044+0000 7f73ab59e700 1 -- 172.21.15.62:0/2953870180 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73ac0c5e30 con 0x7f73ac0c8680 2023-06-09T04:41:14.053 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:14.048+0000 7f73ab59e700 1 -- 172.21.15.62:0/2953870180 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73ac0c63f0 con 0x7f73ac0c8680 2023-06-09T04:41:14.053 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:14.048+0000 7f73ab59e700 1 -- 172.21.15.62:0/2953870180 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73ac0c6630 con 0x7f73ac0c8680 2023-06-09T04:41:14.054 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:14.048+0000 7f73a2ffd700 1 -- 172.21.15.62:0/2953870180 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f739c021070 con 0x7f73ac0c8680 2023-06-09T04:41:14.055 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:14.052+0000 7f73a2ffd700 1 --2- 172.21.15.62:0/2953870180 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f73900662f0 0x7f73900687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:14.055 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:14.052+0000 7f73a2ffd700 1 -- 172.21.15.62:0/2953870180 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f739c085920 con 0x7f73ac0c8680 2023-06-09T04:41:14.056 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:14.052+0000 7f73a3fff700 1 --2- 172.21.15.62:0/2953870180 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f73900662f0 0x7f73900687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:14.057 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:14.052+0000 7f73a3fff700 1 --2- 172.21.15.62:0/2953870180 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f73900662f0 0x7f73900687a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f73ac071530 tx=0x7f7394009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:14.063 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:14.060+0000 7f73a2ffd700 1 -- 172.21.15.62:0/2953870180 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f73ac0c6630 con 0x7f73ac0c8680 2023-06-09T04:41:14.248 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:14.244+0000 7f73ab59e700 1 -- 172.21.15.62:0/2953870180 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f73ac0c6630 con 0x7f73ac0c8680 2023-06-09T04:41:14.249 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:14.244+0000 7f73a2ffd700 1 -- 172.21.15.62:0/2953870180 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f73ac0c6630 con 0x7f73ac0c8680 2023-06-09T04:41:14.252 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:14.248+0000 7f73ab59e700 1 -- 172.21.15.62:0/2953870180 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f73900662f0 msgr2=0x7f73900687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:14.252 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:14.248+0000 7f73ab59e700 1 --2- 172.21.15.62:0/2953870180 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f73900662f0 0x7f73900687a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f73ac071530 tx=0x7f7394009040 comp rx=0 tx=0).stop 2023-06-09T04:41:14.252 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:14.248+0000 7f73ab59e700 1 -- 172.21.15.62:0/2953870180 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f73ac0c8680 msgr2=0x7f73ac150480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:14.253 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:14.248+0000 7f73ab59e700 1 --2- 172.21.15.62:0/2953870180 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f73ac0c8680 0x7f73ac150480 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f739c004000 tx=0x7f739c004770 comp rx=0 tx=0).stop 2023-06-09T04:41:14.253 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:14.248+0000 7f73ab59e700 1 -- 172.21.15.62:0/2953870180 shutdown_connections 2023-06-09T04:41:14.253 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:14.248+0000 7f73ab59e700 1 --2- 172.21.15.62:0/2953870180 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f73900662f0 0x7f73900687a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:14.253 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:14.248+0000 7f73ab59e700 1 --2- 172.21.15.62:0/2953870180 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f73ac0ac900 0x7f73ac0acd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:14.253 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:14.248+0000 7f73ab59e700 1 --2- 172.21.15.62:0/2953870180 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f73ac1581b0 0x7f73ac0c1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:14.254 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:14.248+0000 7f73ab59e700 1 --2- 172.21.15.62:0/2953870180 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f73ac0c8680 0x7f73ac150480 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:14.254 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:14.248+0000 7f73ab59e700 1 -- 172.21.15.62:0/2953870180 >> 172.21.15.62:0/2953870180 conn(0x7f73ac06b880 msgr2=0x7f73ac0cb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:14.254 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:14.248+0000 7f73ab59e700 1 -- 172.21.15.62:0/2953870180 shutdown_connections 2023-06-09T04:41:14.254 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:14.248+0000 7f73ab59e700 1 -- 172.21.15.62:0/2953870180 wait complete. 2023-06-09T04:41:14.255 INFO:teuthology.orchestra.run.smithi062.stderr:listed 0 entries 2023-06-09T04:41:14.274 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi062.front.sepia.ceph.com... 2023-06-09T04:41:14.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:14.275 DEBUG:teuthology.orchestra.run.smithi062:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-06-09T04:41:14.316 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi062.stderr:ceph-fuse[40370]: fuse finished with error 0 and tester_r 0 2023-06-09T04:41:14.320 INFO:teuthology.orchestra.run:waiting for 300 2023-06-09T04:41:20.380 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:41:20.387 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:41:20.421 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi062.front.sepia.ceph.com 2023-06-09T04:41:20.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:20.422 DEBUG:teuthology.orchestra.run.smithi062:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-06-09T04:41:20.453 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:41:20.676 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:20.672+0000 7ff89e4df700 1 Processor -- start 2023-06-09T04:41:20.676 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:20.672+0000 7ff89e4df700 1 -- start start 2023-06-09T04:41:20.679 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:20.676+0000 7ff89e4df700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff8980cb1f0 0x7ff8980cbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:20.680 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:20.676+0000 7ff89e4df700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff89815fa30 con 0x7ff8980ad480 2023-06-09T04:41:20.680 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:20.676+0000 7ff89e4df700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8980ad920 con 0x7ff89815c0f0 2023-06-09T04:41:20.680 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:20.676+0000 7ff89e4df700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8980cc300 con 0x7ff8980cb1f0 2023-06-09T04:41:20.680 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:20.676+0000 7ff89ca7c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff8980cb1f0 0x7ff8980cbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:20.681 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:20.676+0000 7ff8977fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7ff8980ad480 0x7ff8980c8840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:44870/0 (socket says 172.21.15.62:44870) 2023-06-09T04:41:20.681 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:20.676+0000 7ff897fff700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7ff89815c0f0 0x7ff8980caae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.62:44446/0 (socket says 172.21.15.62:44446) 2023-06-09T04:41:20.681 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:20.676+0000 7ff8977fe700 1 -- 172.21.15.62:0/3124864393 learned_addr learned my addr 172.21.15.62:0/3124864393 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:41:20.681 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:20.676+0000 7ff89ca7c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff8980cb1f0 0x7ff8980cbdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40134/0 (socket says 172.21.15.62:40134) 2023-06-09T04:41:20.681 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:20.676+0000 7ff89ca7c700 1 -- 172.21.15.62:0/3124864393 >> v1:172.21.15.89:6789/0 conn(0x7ff89815c0f0 legacy=0x7ff8980caae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:20.682 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:20.676+0000 7ff89ca7c700 1 -- 172.21.15.62:0/3124864393 >> v1:172.21.15.62:6789/0 conn(0x7ff8980ad480 legacy=0x7ff8980c8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:20.682 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:20.676+0000 7ff89ca7c700 1 -- 172.21.15.62:0/3124864393 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff89815fc80 con 0x7ff8980cb1f0 2023-06-09T04:41:20.682 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:20.676+0000 7ff896ffd700 1 -- 172.21.15.62:0/3124864393 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4108970416 0 0) 0x7ff8980ad920 con 0x7ff89815c0f0 2023-06-09T04:41:20.682 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:20.676+0000 7ff89ca7c700 1 --2- 172.21.15.62:0/3124864393 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8980cb1f0 0x7ff8980cbdc0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff890009d90 tx=0x7ff89000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d800c01cd2940f6 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:20.683 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:20.676+0000 7ff896ffd700 1 -- 172.21.15.62:0/3124864393 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89000e070 con 0x7ff8980cb1f0 2023-06-09T04:41:20.683 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:20.676+0000 7ff896ffd700 1 -- 172.21.15.62:0/3124864393 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff89000bad0 con 0x7ff8980cb1f0 2023-06-09T04:41:20.683 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:20.676+0000 7ff896ffd700 1 -- 172.21.15.62:0/3124864393 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff89000be80 con 0x7ff8980cb1f0 2023-06-09T04:41:20.683 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:20.680+0000 7ff89e4df700 1 -- 172.21.15.62:0/3124864393 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8980cb1f0 msgr2=0x7ff8980cbdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:20.684 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:20.680+0000 7ff89e4df700 1 --2- 172.21.15.62:0/3124864393 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8980cb1f0 0x7ff8980cbdc0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff890009d90 tx=0x7ff89000b330 comp rx=0 tx=0).stop 2023-06-09T04:41:20.684 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:20.680+0000 7ff89e4df700 1 -- 172.21.15.62:0/3124864393 shutdown_connections 2023-06-09T04:41:20.684 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:20.680+0000 7ff89e4df700 1 --2- 172.21.15.62:0/3124864393 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8980cb1f0 0x7ff8980cbdc0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:20.684 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:20.680+0000 7ff89e4df700 1 -- 172.21.15.62:0/3124864393 >> 172.21.15.62:0/3124864393 conn(0x7ff89806a410 msgr2=0x7ff8980afd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:20.684 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:20.680+0000 7ff89e4df700 1 -- 172.21.15.62:0/3124864393 shutdown_connections 2023-06-09T04:41:20.684 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:20.680+0000 7ff89e4df700 1 -- 172.21.15.62:0/3124864393 wait complete. 2023-06-09T04:41:20.686 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:20.680+0000 7ff89e4df700 1 Processor -- start 2023-06-09T04:41:20.686 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:20.680+0000 7ff89e4df700 1 -- start start 2023-06-09T04:41:20.688 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:20.684+0000 7ff89e4df700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8980ad480 0x7ff89815a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:20.688 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:20.684+0000 7ff89e4df700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff8980cb1f0 0x7ff89815a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:20.688 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:20.684+0000 7ff89e4df700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff89815c0f0 0x7ff8980b1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:20.688 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:20.684+0000 7ff89e4df700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8980b2e20 con 0x7ff8980ad480 2023-06-09T04:41:20.688 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:20.684+0000 7ff89e4df700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8981f5160 con 0x7ff89815c0f0 2023-06-09T04:41:20.688 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:20.684+0000 7ff89e4df700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8980b1f50 con 0x7ff8980cb1f0 2023-06-09T04:41:20.689 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:20.684+0000 7ff897fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8980ad480 0x7ff89815a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:20.690 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:20.684+0000 7ff897fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8980ad480 0x7ff89815a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40144/0 (socket says 172.21.15.62:40144) 2023-06-09T04:41:20.690 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:20.684+0000 7ff897fff700 1 -- 172.21.15.62:0/379875661 learned_addr learned my addr 172.21.15.62:0/379875661 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:20.690 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:20.684+0000 7ff89ca7c700 1 --2- 172.21.15.62:0/379875661 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff89815c0f0 0x7ff8980b1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:20.690 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:20.684+0000 7ff8977fe700 1 --2- 172.21.15.62:0/379875661 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff8980cb1f0 0x7ff89815a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:20.690 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:20.684+0000 7ff897fff700 1 -- 172.21.15.62:0/379875661 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff8980cb1f0 msgr2=0x7ff89815a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:20.690 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:20.684+0000 7ff897fff700 1 --2- 172.21.15.62:0/379875661 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff8980cb1f0 0x7ff89815a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:20.691 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:20.684+0000 7ff897fff700 1 -- 172.21.15.62:0/379875661 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff89815c0f0 msgr2=0x7ff8980b1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:20.691 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:20.684+0000 7ff897fff700 1 --2- 172.21.15.62:0/379875661 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff89815c0f0 0x7ff8980b1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:20.691 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:20.684+0000 7ff897fff700 1 -- 172.21.15.62:0/379875661 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff890009a70 con 0x7ff8980ad480 2023-06-09T04:41:20.691 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:20.684+0000 7ff8977fe700 1 --2- 172.21.15.62:0/379875661 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff8980cb1f0 0x7ff89815a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:41:20.691 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:20.684+0000 7ff897fff700 1 --2- 172.21.15.62:0/379875661 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8980ad480 0x7ff89815a160 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff88800c4d0 tx=0x7ff88800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:20.692 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:20.684+0000 7ff894ff9700 1 -- 172.21.15.62:0/379875661 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff888004ca0 con 0x7ff8980ad480 2023-06-09T04:41:20.692 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:20.684+0000 7ff894ff9700 1 -- 172.21.15.62:0/379875661 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff888004e00 con 0x7ff8980ad480 2023-06-09T04:41:20.692 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:20.684+0000 7ff894ff9700 1 -- 172.21.15.62:0/379875661 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff888007310 con 0x7ff8980ad480 2023-06-09T04:41:20.692 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:20.684+0000 7ff89e4df700 1 -- 172.21.15.62:0/379875661 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8980b1c70 con 0x7ff8980ad480 2023-06-09T04:41:20.692 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:20.684+0000 7ff89e4df700 1 -- 172.21.15.62:0/379875661 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8980b2a40 con 0x7ff8980ad480 2023-06-09T04:41:20.692 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:20.688+0000 7ff89e4df700 1 -- 172.21.15.62:0/379875661 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff89804db30 con 0x7ff8980ad480 2023-06-09T04:41:20.693 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:20.688+0000 7ff894ff9700 1 -- 172.21.15.62:0/379875661 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff888007470 con 0x7ff8980ad480 2023-06-09T04:41:20.695 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:20.692+0000 7ff894ff9700 1 --2- 172.21.15.62:0/379875661 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7ff8840662f0 0x7ff8840687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:20.695 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:20.692+0000 7ff894ff9700 1 -- 172.21.15.62:0/379875661 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff888083c20 con 0x7ff8980ad480 2023-06-09T04:41:20.696 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:20.692+0000 7ff8977fe700 1 --2- 172.21.15.62:0/379875661 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7ff8840662f0 0x7ff8840687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:20.697 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:20.692+0000 7ff8977fe700 1 --2- 172.21.15.62:0/379875661 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7ff8840662f0 0x7ff8840687a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff89815c6e0 tx=0x7ff88c007e50 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:20.703 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:20.700+0000 7ff894ff9700 1 -- 172.21.15.62:0/379875661 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff888050da0 con 0x7ff8980ad480 2023-06-09T04:41:20.884 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:20.880+0000 7ff89e4df700 1 -- 172.21.15.62:0/379875661 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff8980ce6b0 con 0x7ff8980ad480 2023-06-09T04:41:20.887 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:20.884+0000 7ff894ff9700 1 -- 172.21.15.62:0/379875661 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20084 (secure 0 0 0) 0x7ff888007720 con 0x7ff8980ad480 2023-06-09T04:41:20.888 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:41:20.888 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":28,"fsid":"f7998a1e-e5a9-4202-abaa-70c0eaae1047","created":"2023-06-09T04:40:30.469588+0000","modified":"2023-06-09T04:41:01.271858+0000","last_up_change":"2023-06-09T04:40:43.120747+0000","last_in_change":"2023-06-09T04:40:33.568221+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:40:44.646921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:40:50.006643+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:40:55.031273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:40:55.773517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-09T04:40:58.845383+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bc50bbc0-dd08-42ed-804c-ec3029e36c19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6802","nonce":1295788017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6807","nonce":1295788017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6815","nonce":1295788017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6809","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6811","nonce":1295788017}]},"public_addr":"172.21.15.62:6802/1295788017","cluster_addr":"172.21.15.62:6807/1295788017","heartbeat_back_addr":"172.21.15.62:6815/1295788017","heartbeat_front_addr":"172.21.15.62:6811/1295788017","state":["exists","up"]},{"osd":1,"uuid":"8230b12d-e22f-4985-a584-4cc64404cdbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6825","nonce":4120692006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6827","nonce":4120692006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6831","nonce":4120692006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6829","nonce":4120692006}]},"public_addr":"172.21.15.62:6825/4120692006","cluster_addr":"172.21.15.62:6827/4120692006","heartbeat_back_addr":"172.21.15.62:6831/4120692006","heartbeat_front_addr":"172.21.15.62:6829/4120692006","state":["exists","up"]},{"osd":2,"uuid":"d0202506-dbe9-4e3c-9271-687929abf96a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6801","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6803","nonce":4169607876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6805","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6806","nonce":4169607876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6814","nonce":4169607876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6810","nonce":4169607876}]},"public_addr":"172.21.15.62:6803/4169607876","cluster_addr":"172.21.15.62:6806/4169607876","heartbeat_back_addr":"172.21.15.62:6814/4169607876","heartbeat_front_addr":"172.21.15.62:6810/4169607876","state":["exists","up"]},{"osd":3,"uuid":"f3c0298a-b075-4411-af50-e16cd74fdddb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6817","nonce":3268438986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6819","nonce":3268438986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6823","nonce":3268438986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6821","nonce":3268438986}]},"public_addr":"172.21.15.62:6817/3268438986","cluster_addr":"172.21.15.62:6819/3268438986","heartbeat_back_addr":"172.21.15.62:6823/3268438986","heartbeat_front_addr":"172.21.15.62:6821/3268438986","state":["exists","up"]},{"osd":4,"uuid":"1ab5c5ca-e74f-475a-a309-683cc0029928","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6817","nonce":3139617628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6819","nonce":3139617628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6823","nonce":3139617628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6821","nonce":3139617628}]},"public_addr":"172.21.15.89:6817/3139617628","cluster_addr":"172.21.15.89:6819/3139617628","heartbeat_back_addr":"172.21.15.89:6823/3139617628","heartbeat_front_addr":"172.21.15.89:6821/3139617628","state":["exists","up"]},{"osd":5,"uuid":"a933e184-bd8f-4369-a1ba-a68de53c578c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6825","nonce":2681723596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6827","nonce":2681723596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6831","nonce":2681723596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6829","nonce":2681723596}]},"public_addr":"172.21.15.89:6825/2681723596","cluster_addr":"172.21.15.89:6827/2681723596","heartbeat_back_addr":"172.21.15.89:6831/2681723596","heartbeat_front_addr":"172.21.15.89:6829/2681723596","state":["exists","up"]},{"osd":6,"uuid":"1ed7ad37-2eee-49a6-954c-b537e2b7f0ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6809","nonce":1657136033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6811","nonce":1657136033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6815","nonce":1657136033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6813","nonce":1657136033}]},"public_addr":"172.21.15.89:6809/1657136033","cluster_addr":"172.21.15.89:6811/1657136033","heartbeat_back_addr":"172.21.15.89:6815/1657136033","heartbeat_front_addr":"172.21.15.89:6813/1657136033","state":["exists","up"]},{"osd":7,"uuid":"6ed732e9-33ff-40df-9038-a9f1d1622671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6801","nonce":1710561686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6803","nonce":1710561686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6807","nonce":1710561686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6805","nonce":1710561686}]},"public_addr":"172.21.15.89:6801/1710561686","cluster_addr":"172.21.15.89:6803/1710561686","heartbeat_back_addr":"172.21.15.89:6807/1710561686","heartbeat_front_addr":"172.21.15.89:6805/1710561686","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.335803+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.419788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.179334+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.263310+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.071846+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.375627+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.282277+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.315997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:41:20.892 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:20.888+0000 7ff89e4df700 1 -- 172.21.15.62:0/379875661 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7ff8840662f0 msgr2=0x7ff8840687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:20.892 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:20.888+0000 7ff89e4df700 1 --2- 172.21.15.62:0/379875661 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7ff8840662f0 0x7ff8840687a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff89815c6e0 tx=0x7ff88c007e50 comp rx=0 tx=0).stop 2023-06-09T04:41:20.893 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:20.888+0000 7ff89e4df700 1 -- 172.21.15.62:0/379875661 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8980ad480 msgr2=0x7ff89815a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:20.893 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:20.888+0000 7ff89e4df700 1 --2- 172.21.15.62:0/379875661 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8980ad480 0x7ff89815a160 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff88800c4d0 tx=0x7ff88800c7e0 comp rx=0 tx=0).stop 2023-06-09T04:41:20.893 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:20.888+0000 7ff89e4df700 1 -- 172.21.15.62:0/379875661 shutdown_connections 2023-06-09T04:41:20.894 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:20.888+0000 7ff89e4df700 1 --2- 172.21.15.62:0/379875661 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7ff8840662f0 0x7ff8840687a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:20.894 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:20.888+0000 7ff89e4df700 1 --2- 172.21.15.62:0/379875661 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff89815c0f0 0x7ff8980b1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:20.894 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:20.888+0000 7ff89e4df700 1 --2- 172.21.15.62:0/379875661 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff8980cb1f0 0x7ff89815a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:20.894 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:20.888+0000 7ff89e4df700 1 --2- 172.21.15.62:0/379875661 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8980ad480 0x7ff89815a160 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:20.894 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:20.888+0000 7ff89e4df700 1 -- 172.21.15.62:0/379875661 >> 172.21.15.62:0/379875661 conn(0x7ff89806a410 msgr2=0x7ff8980709f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:20.894 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:20.888+0000 7ff89e4df700 1 -- 172.21.15.62:0/379875661 shutdown_connections 2023-06-09T04:41:20.894 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:20.888+0000 7ff89e4df700 1 -- 172.21.15.62:0/379875661 wait complete. 2023-06-09T04:41:20.914 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:41:21.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.084+0000 7f4f1d9ca700 1 Processor -- start 2023-06-09T04:41:21.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.084+0000 7f4f1d9ca700 1 -- start start 2023-06-09T04:41:21.092 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.088+0000 7f4f1d9ca700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4f180cc1a0 0x7f4f1806c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:21.092 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.088+0000 7f4f1d9ca700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4f1806ce90 0x7f4f180c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:21.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.088+0000 7f4f1d9ca700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f1806c4c0 con 0x7f4f18158890 2023-06-09T04:41:21.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.088+0000 7f4f1d9ca700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f1806b920 con 0x7f4f1806ce90 2023-06-09T04:41:21.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.088+0000 7f4f1d9ca700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f1806bb90 con 0x7f4f180cc1a0 2023-06-09T04:41:21.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.088+0000 7f4f1d1c9700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4f1806ce90 0x7f4f180c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:21.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.088+0000 7f4f1d1c9700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4f1806ce90 0x7f4f180c8e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40156/0 (socket says 172.21.15.62:40156) 2023-06-09T04:41:21.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.088+0000 7f4f1d1c9700 1 -- 172.21.15.62:0/719398208 learned_addr learned my addr 172.21.15.62:0/719398208 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:21.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.088+0000 7f4f0ffff700 1 --2- 172.21.15.62:0/719398208 >> v2:172.21.15.89:3300/0 conn(0x7f4f180cc1a0 0x7f4f1806c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:21.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.088+0000 7f4f1d1c9700 1 -- 172.21.15.62:0/719398208 >> v2:172.21.15.89:3300/0 conn(0x7f4f180cc1a0 msgr2=0x7f4f1806c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:21.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.088+0000 7f4f1d1c9700 1 --2- 172.21.15.62:0/719398208 >> v2:172.21.15.89:3300/0 conn(0x7f4f180cc1a0 0x7f4f1806c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:21.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.088+0000 7f4f1d1c9700 1 -- 172.21.15.62:0/719398208 >> v1:172.21.15.89:6789/0 conn(0x7f4f18158890 legacy=0x7f4f180cd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:21.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.088+0000 7f4f1d1c9700 1 -- 172.21.15.62:0/719398208 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f1806be70 con 0x7f4f1806ce90 2023-06-09T04:41:21.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.088+0000 7f4f1d1c9700 1 --2- 172.21.15.62:0/719398208 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f1806ce90 0x7f4f180c8e50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4f180c5030 tx=0x7f4f1000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3241b6a027736119 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:21.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.088+0000 7f4f0f7fe700 1 -- 172.21.15.62:0/719398208 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1000e070 con 0x7f4f1806ce90 2023-06-09T04:41:21.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.088+0000 7f4f0f7fe700 1 -- 172.21.15.62:0/719398208 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f1000b9c0 con 0x7f4f1806ce90 2023-06-09T04:41:21.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.088+0000 7f4f0f7fe700 1 -- 172.21.15.62:0/719398208 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1000bd70 con 0x7f4f1806ce90 2023-06-09T04:41:21.096 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.092+0000 7f4f1d9ca700 1 -- 172.21.15.62:0/719398208 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f1806ce90 msgr2=0x7f4f180c8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:21.096 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.092+0000 7f4f1d9ca700 1 --2- 172.21.15.62:0/719398208 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f1806ce90 0x7f4f180c8e50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4f180c5030 tx=0x7f4f1000b330 comp rx=0 tx=0).stop 2023-06-09T04:41:21.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.092+0000 7f4f1d9ca700 1 -- 172.21.15.62:0/719398208 shutdown_connections 2023-06-09T04:41:21.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.092+0000 7f4f1d9ca700 1 --2- 172.21.15.62:0/719398208 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f1806ce90 0x7f4f180c8e50 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:21.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.092+0000 7f4f1d9ca700 1 --2- 172.21.15.62:0/719398208 >> v2:172.21.15.89:3300/0 conn(0x7f4f180cc1a0 0x7f4f1806c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:21.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.092+0000 7f4f1d9ca700 1 -- 172.21.15.62:0/719398208 >> 172.21.15.62:0/719398208 conn(0x7f4f1806a420 msgr2=0x7f4f180afc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:21.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.092+0000 7f4f1d9ca700 1 -- 172.21.15.62:0/719398208 shutdown_connections 2023-06-09T04:41:21.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.092+0000 7f4f1d9ca700 1 -- 172.21.15.62:0/719398208 wait complete. 2023-06-09T04:41:21.098 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.092+0000 7f4f1d9ca700 1 Processor -- start 2023-06-09T04:41:21.099 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.096+0000 7f4f1d9ca700 1 -- start start 2023-06-09T04:41:21.100 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.096+0000 7f4f1d9ca700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f180cc1a0 0x7f4f18158de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:21.101 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.096+0000 7f4f1d9ca700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4f18158890 0x7f4f1814dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:21.101 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.096+0000 7f4f1d9ca700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f1814e510 0x7f4f181571e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:21.101 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.096+0000 7f4f1d9ca700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f180c2ed0 con 0x7f4f1814e510 2023-06-09T04:41:21.101 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.096+0000 7f4f1d9ca700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f180b3730 con 0x7f4f180cc1a0 2023-06-09T04:41:21.101 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.096+0000 7f4f1d9ca700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f180b3a10 con 0x7f4f18158890 2023-06-09T04:41:21.102 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.096+0000 7f4f1d1c9700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f1814e510 0x7f4f181571e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:21.102 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.096+0000 7f4f1d1c9700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f1814e510 0x7f4f181571e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40166/0 (socket says 172.21.15.62:40166) 2023-06-09T04:41:21.102 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.096+0000 7f4f1d1c9700 1 -- 172.21.15.62:0/2643893585 learned_addr learned my addr 172.21.15.62:0/2643893585 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:21.102 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.096+0000 7f4f0ffff700 1 --2- 172.21.15.62:0/2643893585 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4f18158890 0x7f4f1814dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:21.103 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.096+0000 7f4f1c9c8700 1 --2- 172.21.15.62:0/2643893585 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f180cc1a0 0x7f4f18158de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:21.103 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.096+0000 7f4f1d1c9700 1 -- 172.21.15.62:0/2643893585 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4f18158890 msgr2=0x7f4f1814dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:21.103 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.096+0000 7f4f1d1c9700 1 --2- 172.21.15.62:0/2643893585 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4f18158890 0x7f4f1814dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:21.103 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.096+0000 7f4f1d1c9700 1 -- 172.21.15.62:0/2643893585 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f180cc1a0 msgr2=0x7f4f18158de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:21.103 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.096+0000 7f4f1d1c9700 1 --2- 172.21.15.62:0/2643893585 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f180cc1a0 0x7f4f18158de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:21.103 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.096+0000 7f4f1d1c9700 1 -- 172.21.15.62:0/2643893585 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f10009b30 con 0x7f4f1814e510 2023-06-09T04:41:21.103 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.096+0000 7f4f0ffff700 1 --2- 172.21.15.62:0/2643893585 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4f18158890 0x7f4f1814dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:41:21.104 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.096+0000 7f4f1d1c9700 1 --2- 172.21.15.62:0/2643893585 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f1814e510 0x7f4f181571e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4f1806d5f0 tx=0x7f4f10004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:21.104 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.096+0000 7f4f0d7fa700 1 -- 172.21.15.62:0/2643893585 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f10004930 con 0x7f4f1814e510 2023-06-09T04:41:21.104 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.096+0000 7f4f0d7fa700 1 -- 172.21.15.62:0/2643893585 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f100092e0 con 0x7f4f1814e510 2023-06-09T04:41:21.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.096+0000 7f4f1d9ca700 1 -- 172.21.15.62:0/2643893585 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f180b3cf0 con 0x7f4f1814e510 2023-06-09T04:41:21.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.096+0000 7f4f0d7fa700 1 -- 172.21.15.62:0/2643893585 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1001c660 con 0x7f4f1814e510 2023-06-09T04:41:21.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.100+0000 7f4f1d9ca700 1 -- 172.21.15.62:0/2643893585 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f18159320 con 0x7f4f1814e510 2023-06-09T04:41:21.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.100+0000 7f4f1d9ca700 1 -- 172.21.15.62:0/2643893585 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f180c32f0 con 0x7f4f1814e510 2023-06-09T04:41:21.106 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.100+0000 7f4f0d7fa700 1 -- 172.21.15.62:0/2643893585 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4f1001c7c0 con 0x7f4f1814e510 2023-06-09T04:41:21.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.104+0000 7f4f0d7fa700 1 --2- 172.21.15.62:0/2643893585 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f4f040662f0 0x7f4f040687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:21.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.104+0000 7f4f0d7fa700 1 -- 172.21.15.62:0/2643893585 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4f10085c10 con 0x7f4f1814e510 2023-06-09T04:41:21.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.104+0000 7f4f1c9c8700 1 --2- 172.21.15.62:0/2643893585 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f4f040662f0 0x7f4f040687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:21.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.104+0000 7f4f1c9c8700 1 --2- 172.21.15.62:0/2643893585 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f4f040662f0 0x7f4f040687a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4f18151380 tx=0x7f4f14009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:21.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.108+0000 7f4f0d7fa700 1 -- 172.21.15.62:0/2643893585 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4f180c32f0 con 0x7f4f1814e510 2023-06-09T04:41:21.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.276+0000 7f4f1d9ca700 1 -- 172.21.15.62:0/2643893585 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4f180c32f0 con 0x7f4f1814e510 2023-06-09T04:41:21.284 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.280+0000 7f4f0d7fa700 1 -- 172.21.15.62:0/2643893585 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20084 (secure 0 0 0) 0x7f4f180c32f0 con 0x7f4f1814e510 2023-06-09T04:41:21.285 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:41:21.285 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":28,"fsid":"f7998a1e-e5a9-4202-abaa-70c0eaae1047","created":"2023-06-09T04:40:30.469588+0000","modified":"2023-06-09T04:41:01.271858+0000","last_up_change":"2023-06-09T04:40:43.120747+0000","last_in_change":"2023-06-09T04:40:33.568221+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:40:44.646921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:40:50.006643+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:40:55.031273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:40:55.773517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-09T04:40:58.845383+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bc50bbc0-dd08-42ed-804c-ec3029e36c19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6802","nonce":1295788017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6807","nonce":1295788017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6815","nonce":1295788017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6809","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6811","nonce":1295788017}]},"public_addr":"172.21.15.62:6802/1295788017","cluster_addr":"172.21.15.62:6807/1295788017","heartbeat_back_addr":"172.21.15.62:6815/1295788017","heartbeat_front_addr":"172.21.15.62:6811/1295788017","state":["exists","up"]},{"osd":1,"uuid":"8230b12d-e22f-4985-a584-4cc64404cdbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6825","nonce":4120692006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6827","nonce":4120692006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6831","nonce":4120692006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6829","nonce":4120692006}]},"public_addr":"172.21.15.62:6825/4120692006","cluster_addr":"172.21.15.62:6827/4120692006","heartbeat_back_addr":"172.21.15.62:6831/4120692006","heartbeat_front_addr":"172.21.15.62:6829/4120692006","state":["exists","up"]},{"osd":2,"uuid":"d0202506-dbe9-4e3c-9271-687929abf96a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6801","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6803","nonce":4169607876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6805","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6806","nonce":4169607876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6814","nonce":4169607876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6810","nonce":4169607876}]},"public_addr":"172.21.15.62:6803/4169607876","cluster_addr":"172.21.15.62:6806/4169607876","heartbeat_back_addr":"172.21.15.62:6814/4169607876","heartbeat_front_addr":"172.21.15.62:6810/4169607876","state":["exists","up"]},{"osd":3,"uuid":"f3c0298a-b075-4411-af50-e16cd74fdddb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6817","nonce":3268438986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6819","nonce":3268438986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6823","nonce":3268438986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6821","nonce":3268438986}]},"public_addr":"172.21.15.62:6817/3268438986","cluster_addr":"172.21.15.62:6819/3268438986","heartbeat_back_addr":"172.21.15.62:6823/3268438986","heartbeat_front_addr":"172.21.15.62:6821/3268438986","state":["exists","up"]},{"osd":4,"uuid":"1ab5c5ca-e74f-475a-a309-683cc0029928","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6817","nonce":3139617628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6819","nonce":3139617628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6823","nonce":3139617628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6821","nonce":3139617628}]},"public_addr":"172.21.15.89:6817/3139617628","cluster_addr":"172.21.15.89:6819/3139617628","heartbeat_back_addr":"172.21.15.89:6823/3139617628","heartbeat_front_addr":"172.21.15.89:6821/3139617628","state":["exists","up"]},{"osd":5,"uuid":"a933e184-bd8f-4369-a1ba-a68de53c578c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6825","nonce":2681723596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6827","nonce":2681723596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6831","nonce":2681723596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6829","nonce":2681723596}]},"public_addr":"172.21.15.89:6825/2681723596","cluster_addr":"172.21.15.89:6827/2681723596","heartbeat_back_addr":"172.21.15.89:6831/2681723596","heartbeat_front_addr":"172.21.15.89:6829/2681723596","state":["exists","up"]},{"osd":6,"uuid":"1ed7ad37-2eee-49a6-954c-b537e2b7f0ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6809","nonce":1657136033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6811","nonce":1657136033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6815","nonce":1657136033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6813","nonce":1657136033}]},"public_addr":"172.21.15.89:6809/1657136033","cluster_addr":"172.21.15.89:6811/1657136033","heartbeat_back_addr":"172.21.15.89:6815/1657136033","heartbeat_front_addr":"172.21.15.89:6813/1657136033","state":["exists","up"]},{"osd":7,"uuid":"6ed732e9-33ff-40df-9038-a9f1d1622671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6801","nonce":1710561686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6803","nonce":1710561686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6807","nonce":1710561686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6805","nonce":1710561686}]},"public_addr":"172.21.15.89:6801/1710561686","cluster_addr":"172.21.15.89:6803/1710561686","heartbeat_back_addr":"172.21.15.89:6807/1710561686","heartbeat_front_addr":"172.21.15.89:6805/1710561686","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.335803+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.419788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.179334+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.263310+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.071846+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.375627+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.282277+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.315997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:41:21.287 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.284+0000 7f4f1d9ca700 1 -- 172.21.15.62:0/2643893585 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f4f040662f0 msgr2=0x7f4f040687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:21.287 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.284+0000 7f4f1d9ca700 1 --2- 172.21.15.62:0/2643893585 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f4f040662f0 0x7f4f040687a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4f18151380 tx=0x7f4f14009040 comp rx=0 tx=0).stop 2023-06-09T04:41:21.288 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.284+0000 7f4f1d9ca700 1 -- 172.21.15.62:0/2643893585 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f1814e510 msgr2=0x7f4f181571e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:21.288 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.284+0000 7f4f1d9ca700 1 --2- 172.21.15.62:0/2643893585 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f1814e510 0x7f4f181571e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4f1806d5f0 tx=0x7f4f10004af0 comp rx=0 tx=0).stop 2023-06-09T04:41:21.289 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.284+0000 7f4f1d9ca700 1 -- 172.21.15.62:0/2643893585 shutdown_connections 2023-06-09T04:41:21.289 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.284+0000 7f4f1d9ca700 1 --2- 172.21.15.62:0/2643893585 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f4f040662f0 0x7f4f040687a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:21.289 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.284+0000 7f4f1d9ca700 1 --2- 172.21.15.62:0/2643893585 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f1814e510 0x7f4f181571e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:21.289 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.284+0000 7f4f1d9ca700 1 --2- 172.21.15.62:0/2643893585 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4f18158890 0x7f4f1814dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:21.289 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.284+0000 7f4f1d9ca700 1 --2- 172.21.15.62:0/2643893585 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f180cc1a0 0x7f4f18158de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:21.289 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.284+0000 7f4f1d9ca700 1 -- 172.21.15.62:0/2643893585 >> 172.21.15.62:0/2643893585 conn(0x7f4f1806ce90 msgr2=0x7f4f180cdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:21.290 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.284+0000 7f4f1d9ca700 1 -- 172.21.15.62:0/2643893585 shutdown_connections 2023-06-09T04:41:21.290 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.284+0000 7f4f1d9ca700 1 -- 172.21.15.62:0/2643893585 wait complete. 2023-06-09T04:41:21.312 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-06-09T04:41:21.498 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.492+0000 7fbfddd25700 1 Processor -- start 2023-06-09T04:41:21.498 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.492+0000 7fbfddd25700 1 -- start start 2023-06-09T04:41:21.501 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.496+0000 7fbfddd25700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbfd80af240 0x7fbfd80af650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:21.501 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.496+0000 7fbfddd25700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbfd80b0e50 0x7fbfd80b12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:21.501 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.496+0000 7fbfddd25700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfd80b09c0 con 0x7fbfd80d0270 2023-06-09T04:41:21.502 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.496+0000 7fbfddd25700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfd80afb90 con 0x7fbfd80af240 2023-06-09T04:41:21.502 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.496+0000 7fbfddd25700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd80afdb0 con 0x7fbfd80b0e50 2023-06-09T04:41:21.502 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.496+0000 7fbfd6ffd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbfd80af240 0x7fbfd80af650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:21.503 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.496+0000 7fbfd6ffd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbfd80af240 0x7fbfd80af650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40178/0 (socket says 172.21.15.62:40178) 2023-06-09T04:41:21.503 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.496+0000 7fbfd6ffd700 1 -- 172.21.15.62:0/1421443596 learned_addr learned my addr 172.21.15.62:0/1421443596 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:21.503 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.496+0000 7fbfd7fff700 1 --2- 172.21.15.62:0/1421443596 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbfd80b0e50 0x7fbfd80b12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:21.503 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.496+0000 7fbfd6ffd700 1 -- 172.21.15.62:0/1421443596 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbfd80b0e50 msgr2=0x7fbfd80b12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:21.503 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.496+0000 7fbfd6ffd700 1 --2- 172.21.15.62:0/1421443596 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbfd80b0e50 0x7fbfd80b12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:21.503 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.496+0000 7fbfd6ffd700 1 -- 172.21.15.62:0/1421443596 >> v1:172.21.15.89:6789/0 conn(0x7fbfd80d0270 legacy=0x7fbfd80d0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:21.503 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.496+0000 7fbfd6ffd700 1 -- 172.21.15.62:0/1421443596 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd80b0090 con 0x7fbfd80af240 2023-06-09T04:41:21.504 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.500+0000 7fbfd6ffd700 1 --2- 172.21.15.62:0/1421443596 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbfd80af240 0x7fbfd80af650 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc009910 tx=0x7fbfcc009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6953539395dc576b server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:21.504 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.500+0000 7fbfd67fc700 1 -- 172.21.15.62:0/1421443596 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfcc011830 con 0x7fbfd80af240 2023-06-09T04:41:21.504 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.500+0000 7fbfd67fc700 1 -- 172.21.15.62:0/1421443596 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfcc011990 con 0x7fbfd80af240 2023-06-09T04:41:21.504 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.500+0000 7fbfd67fc700 1 -- 172.21.15.62:0/1421443596 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfcc011d40 con 0x7fbfd80af240 2023-06-09T04:41:21.505 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.500+0000 7fbfddd25700 1 -- 172.21.15.62:0/1421443596 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbfd80af240 msgr2=0x7fbfd80af650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:21.505 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.500+0000 7fbfddd25700 1 --2- 172.21.15.62:0/1421443596 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbfd80af240 0x7fbfd80af650 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc009910 tx=0x7fbfcc009c20 comp rx=0 tx=0).stop 2023-06-09T04:41:21.505 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.500+0000 7fbfddd25700 1 -- 172.21.15.62:0/1421443596 shutdown_connections 2023-06-09T04:41:21.506 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.500+0000 7fbfddd25700 1 --2- 172.21.15.62:0/1421443596 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbfd80af240 0x7fbfd80af650 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:21.506 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.500+0000 7fbfddd25700 1 --2- 172.21.15.62:0/1421443596 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbfd80b0e50 0x7fbfd80b12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:21.506 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.500+0000 7fbfddd25700 1 -- 172.21.15.62:0/1421443596 >> 172.21.15.62:0/1421443596 conn(0x7fbfd8089fc0 msgr2=0x7fbfd809b950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:21.506 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.500+0000 7fbfddd25700 1 -- 172.21.15.62:0/1421443596 shutdown_connections 2023-06-09T04:41:21.506 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.500+0000 7fbfddd25700 1 -- 172.21.15.62:0/1421443596 wait complete. 2023-06-09T04:41:21.509 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.504+0000 7fbfddd25700 1 Processor -- start 2023-06-09T04:41:21.509 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.504+0000 7fbfddd25700 1 -- start start 2023-06-09T04:41:21.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.504+0000 7fbfddd25700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbfd80af240 0x7fbfd81e6800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:21.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.504+0000 7fbfddd25700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbfd80b0e50 0x7fbfd80c8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:21.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.504+0000 7fbfddd25700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbfd80d0270 0x7fbfd80b42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:21.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.504+0000 7fbfddd25700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd80c61d0 con 0x7fbfd80d0270 2023-06-09T04:41:21.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.504+0000 7fbfddd25700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd80c90d0 con 0x7fbfd80b0e50 2023-06-09T04:41:21.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.504+0000 7fbfddd25700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd81e6de0 con 0x7fbfd80af240 2023-06-09T04:41:21.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.508+0000 7fbfd7fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbfd80d0270 0x7fbfd80b42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:21.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.508+0000 7fbfd7fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbfd80d0270 0x7fbfd80b42b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40180/0 (socket says 172.21.15.62:40180) 2023-06-09T04:41:21.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.508+0000 7fbfd7fff700 1 -- 172.21.15.62:0/1726608449 learned_addr learned my addr 172.21.15.62:0/1726608449 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:21.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.508+0000 7fbfd6ffd700 1 --2- 172.21.15.62:0/1726608449 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbfd80b0e50 0x7fbfd80c8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:21.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.508+0000 7fbfd77fe700 1 --2- 172.21.15.62:0/1726608449 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbfd80af240 0x7fbfd81e6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:21.513 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.508+0000 7fbfd77fe700 1 -- 172.21.15.62:0/1726608449 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbfd80b0e50 msgr2=0x7fbfd80c8b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:21.513 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.508+0000 7fbfd77fe700 1 --2- 172.21.15.62:0/1726608449 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbfd80b0e50 0x7fbfd80c8b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:21.514 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.508+0000 7fbfd77fe700 1 -- 172.21.15.62:0/1726608449 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbfd80d0270 msgr2=0x7fbfd80b42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:21.514 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.508+0000 7fbfd77fe700 1 --2- 172.21.15.62:0/1726608449 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbfd80d0270 0x7fbfd80b42b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:21.514 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.508+0000 7fbfd77fe700 1 -- 172.21.15.62:0/1726608449 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfcc009570 con 0x7fbfd80af240 2023-06-09T04:41:21.514 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.508+0000 7fbfd7fff700 1 --2- 172.21.15.62:0/1726608449 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbfd80d0270 0x7fbfd80b42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:41:21.514 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.508+0000 7fbfd6ffd700 1 --2- 172.21.15.62:0/1726608449 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbfd80b0e50 0x7fbfd80c8b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:41:21.514 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.508+0000 7fbfd77fe700 1 --2- 172.21.15.62:0/1726608449 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbfd80af240 0x7fbfd81e6800 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fbfc800c480 tx=0x7fbfc800c790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:21.514 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.508+0000 7fbfbffff700 1 -- 172.21.15.62:0/1726608449 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc80052d0 con 0x7fbfd80af240 2023-06-09T04:41:21.515 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.508+0000 7fbfbffff700 1 -- 172.21.15.62:0/1726608449 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfc8005430 con 0x7fbfd80af240 2023-06-09T04:41:21.515 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.508+0000 7fbfddd25700 1 -- 172.21.15.62:0/1726608449 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfd81e70c0 con 0x7fbfd80af240 2023-06-09T04:41:21.515 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.508+0000 7fbfbffff700 1 -- 172.21.15.62:0/1726608449 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc80055a0 con 0x7fbfd80af240 2023-06-09T04:41:21.515 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.508+0000 7fbfddd25700 1 -- 172.21.15.62:0/1726608449 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfd80b23c0 con 0x7fbfd80af240 2023-06-09T04:41:21.515 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.512+0000 7fbfddd25700 1 -- 172.21.15.62:0/1726608449 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfd80739c0 con 0x7fbfd80af240 2023-06-09T04:41:21.518 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.512+0000 7fbfbffff700 1 -- 172.21.15.62:0/1726608449 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbfc80038e0 con 0x7fbfd80af240 2023-06-09T04:41:21.519 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.516+0000 7fbfbffff700 1 --2- 172.21.15.62:0/1726608449 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fbfc40662f0 0x7fbfc40687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:21.519 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.516+0000 7fbfbffff700 1 -- 172.21.15.62:0/1726608449 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fbfc80832d0 con 0x7fbfd80af240 2023-06-09T04:41:21.520 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.516+0000 7fbfd6ffd700 1 --2- 172.21.15.62:0/1726608449 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fbfc40662f0 0x7fbfc40687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:21.520 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.516+0000 7fbfd6ffd700 1 --2- 172.21.15.62:0/1726608449 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fbfc40662f0 0x7fbfc40687a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc000c00 tx=0x7fbfcc008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:21.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.524+0000 7fbfbffff700 1 -- 172.21.15.62:0/1726608449 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbfc8050460 con 0x7fbfd80af240 2023-06-09T04:41:21.741 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:21.736+0000 7fbfddd25700 1 -- 172.21.15.62:0/1726608449 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fbfd806c360 con 0x7fbfd80af240 2023-06-09T04:41:22.385 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:22.380+0000 7fbfbffff700 1 -- 172.21.15.62:0/1726608449 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7fbfc8053a80 con 0x7fbfd80af240 2023-06-09T04:41:22.389 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:22.384+0000 7fbfddd25700 1 -- 172.21.15.62:0/1726608449 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fbfc40662f0 msgr2=0x7fbfc40687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:22.390 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:22.384+0000 7fbfddd25700 1 --2- 172.21.15.62:0/1726608449 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fbfc40662f0 0x7fbfc40687a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbfcc000c00 tx=0x7fbfcc008030 comp rx=0 tx=0).stop 2023-06-09T04:41:22.390 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:22.384+0000 7fbfddd25700 1 -- 172.21.15.62:0/1726608449 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbfd80af240 msgr2=0x7fbfd81e6800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:22.390 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:22.384+0000 7fbfddd25700 1 --2- 172.21.15.62:0/1726608449 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbfd80af240 0x7fbfd81e6800 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fbfc800c480 tx=0x7fbfc800c790 comp rx=0 tx=0).stop 2023-06-09T04:41:22.390 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:22.384+0000 7fbfddd25700 1 -- 172.21.15.62:0/1726608449 shutdown_connections 2023-06-09T04:41:22.390 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:22.384+0000 7fbfddd25700 1 --2- 172.21.15.62:0/1726608449 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fbfc40662f0 0x7fbfc40687a0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:22.390 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:22.384+0000 7fbfddd25700 1 --2- 172.21.15.62:0/1726608449 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbfd80d0270 0x7fbfd80b42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:22.390 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:22.384+0000 7fbfddd25700 1 --2- 172.21.15.62:0/1726608449 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbfd80b0e50 0x7fbfd80c8b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:22.390 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:22.384+0000 7fbfddd25700 1 --2- 172.21.15.62:0/1726608449 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbfd80af240 0x7fbfd81e6800 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:22.391 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:22.384+0000 7fbfddd25700 1 -- 172.21.15.62:0/1726608449 >> 172.21.15.62:0/1726608449 conn(0x7fbfd8089fc0 msgr2=0x7fbfd80b6d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:22.391 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:22.384+0000 7fbfddd25700 1 -- 172.21.15.62:0/1726608449 shutdown_connections 2023-06-09T04:41:22.391 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:22.384+0000 7fbfddd25700 1 -- 172.21.15.62:0/1726608449 wait complete. 2023-06-09T04:41:22.415 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2023-06-09T04:41:22.415 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-06-09T04:41:22.603 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:22.600+0000 7f889951a700 1 Processor -- start 2023-06-09T04:41:22.604 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:22.600+0000 7f889951a700 1 -- start start 2023-06-09T04:41:22.607 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:22.600+0000 7f889951a700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8894160360 0x7f88940ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:22.607 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:22.604+0000 7f889951a700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8894160730 con 0x7f88940b0260 2023-06-09T04:41:22.607 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:22.604+0000 7f889951a700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88940ca860 con 0x7f88940c8800 2023-06-09T04:41:22.607 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:22.604+0000 7f889951a700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88940ca580 con 0x7f8894160360 2023-06-09T04:41:22.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:22.604+0000 7f8892ffd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8894160360 0x7f88940ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:22.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:22.604+0000 7f88937fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f88940b0260 0x7f88940705b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:44882/0 (socket says 172.21.15.62:44882) 2023-06-09T04:41:22.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:22.604+0000 7f88937fe700 1 -- 172.21.15.62:0/320515678 learned_addr learned my addr 172.21.15.62:0/320515678 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:41:22.609 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:22.604+0000 7f8892ffd700 1 -- 172.21.15.62:0/320515678 >> v1:172.21.15.89:6789/0 conn(0x7f88940c8800 legacy=0x7f88940afb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:22.609 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:22.604+0000 7f8892ffd700 1 -- 172.21.15.62:0/320515678 >> v1:172.21.15.62:6789/0 conn(0x7f88940b0260 legacy=0x7f88940705b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:22.609 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:22.604+0000 7f8892ffd700 1 -- 172.21.15.62:0/320515678 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88940cc070 con 0x7f8894160360 2023-06-09T04:41:22.609 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:22.604+0000 7f8891ffb700 1 -- 172.21.15.62:0/320515678 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1669017007 0 0) 0x7f8894160730 con 0x7f88940b0260 2023-06-09T04:41:22.610 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:22.604+0000 7f8892ffd700 1 --2- 172.21.15.62:0/320515678 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8894160360 0x7f88940ccb50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8884009850 tx=0x7f8884009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7108a04616afbc5 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:22.610 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:22.604+0000 7f8891ffb700 1 -- 172.21.15.62:0/320515678 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8884011830 con 0x7f8894160360 2023-06-09T04:41:22.610 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:22.604+0000 7f8891ffb700 1 -- 172.21.15.62:0/320515678 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8884011990 con 0x7f8894160360 2023-06-09T04:41:22.610 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:22.604+0000 7f8891ffb700 1 -- 172.21.15.62:0/320515678 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8884011d20 con 0x7f8894160360 2023-06-09T04:41:22.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:22.604+0000 7f889951a700 1 -- 172.21.15.62:0/320515678 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8894160360 msgr2=0x7f88940ccb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:22.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:22.604+0000 7f889951a700 1 --2- 172.21.15.62:0/320515678 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8894160360 0x7f88940ccb50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8884009850 tx=0x7f8884009b60 comp rx=0 tx=0).stop 2023-06-09T04:41:22.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:22.604+0000 7f889951a700 1 -- 172.21.15.62:0/320515678 shutdown_connections 2023-06-09T04:41:22.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:22.604+0000 7f889951a700 1 --2- 172.21.15.62:0/320515678 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8894160360 0x7f88940ccb50 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:22.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:22.604+0000 7f889951a700 1 -- 172.21.15.62:0/320515678 >> 172.21.15.62:0/320515678 conn(0x7f88940cab50 msgr2=0x7f88940caf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:22.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:22.604+0000 7f889951a700 1 -- 172.21.15.62:0/320515678 shutdown_connections 2023-06-09T04:41:22.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:22.604+0000 7f889951a700 1 -- 172.21.15.62:0/320515678 wait complete. 2023-06-09T04:41:22.613 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:22.608+0000 7f889951a700 1 Processor -- start 2023-06-09T04:41:22.613 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:22.608+0000 7f889951a700 1 -- start start 2023-06-09T04:41:22.614 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:22.608+0000 7f889951a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88940b0260 0x7f88940b1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:22.614 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:22.608+0000 7f889951a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88940c8800 0x7f889415c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:22.614 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:22.608+0000 7f889951a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8894160360 0x7f8894161cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:22.614 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:22.608+0000 7f889951a700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f889415cb90 con 0x7f8894160360 2023-06-09T04:41:22.615 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:22.608+0000 7f889951a700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88940b3ea0 con 0x7f88940c8800 2023-06-09T04:41:22.615 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:22.608+0000 7f889951a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88940c3400 con 0x7f88940b0260 2023-06-09T04:41:22.616 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:22.608+0000 7f88937fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8894160360 0x7f8894161cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:22.616 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:22.612+0000 7f88937fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8894160360 0x7f8894161cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40192/0 (socket says 172.21.15.62:40192) 2023-06-09T04:41:22.616 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:22.612+0000 7f88937fe700 1 -- 172.21.15.62:0/2884718276 learned_addr learned my addr 172.21.15.62:0/2884718276 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:22.616 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:22.612+0000 7f8892ffd700 1 --2- 172.21.15.62:0/2884718276 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88940b0260 0x7f88940b1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:22.616 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:22.612+0000 7f88927fc700 1 --2- 172.21.15.62:0/2884718276 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88940c8800 0x7f889415c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:22.616 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:22.612+0000 7f88937fe700 1 -- 172.21.15.62:0/2884718276 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88940b0260 msgr2=0x7f88940b1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:22.616 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:22.612+0000 7f88937fe700 1 --2- 172.21.15.62:0/2884718276 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88940b0260 0x7f88940b1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:22.617 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:22.612+0000 7f88937fe700 1 -- 172.21.15.62:0/2884718276 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88940c8800 msgr2=0x7f889415c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:22.617 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:22.612+0000 7f88937fe700 1 --2- 172.21.15.62:0/2884718276 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88940c8800 0x7f889415c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:22.617 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:22.612+0000 7f88937fe700 1 -- 172.21.15.62:0/2884718276 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88840094b0 con 0x7f8894160360 2023-06-09T04:41:22.617 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:22.612+0000 7f88937fe700 1 --2- 172.21.15.62:0/2884718276 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8894160360 0x7f8894161cb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f888c00cb60 tx=0x7f888c00ce70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:22.618 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:22.612+0000 7f887b7fe700 1 -- 172.21.15.62:0/2884718276 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888c00a9e0 con 0x7f8894160360 2023-06-09T04:41:22.618 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:22.612+0000 7f887b7fe700 1 -- 172.21.15.62:0/2884718276 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f888c00ab40 con 0x7f8894160360 2023-06-09T04:41:22.618 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:22.612+0000 7f889951a700 1 -- 172.21.15.62:0/2884718276 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88941621f0 con 0x7f8894160360 2023-06-09T04:41:22.618 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:22.612+0000 7f887b7fe700 1 -- 172.21.15.62:0/2884718276 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888c0070d0 con 0x7f8894160360 2023-06-09T04:41:22.618 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:22.612+0000 7f889951a700 1 -- 172.21.15.62:0/2884718276 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88940c2db0 con 0x7f8894160360 2023-06-09T04:41:22.619 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:22.612+0000 7f889951a700 1 -- 172.21.15.62:0/2884718276 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88940c2c10 con 0x7f8894160360 2023-06-09T04:41:22.620 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:22.616+0000 7f887b7fe700 1 -- 172.21.15.62:0/2884718276 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f888c007230 con 0x7f8894160360 2023-06-09T04:41:22.621 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:22.616+0000 7f887b7fe700 1 --2- 172.21.15.62:0/2884718276 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f8880066320 0x7f88800687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:22.622 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:22.616+0000 7f887b7fe700 1 -- 172.21.15.62:0/2884718276 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f888c083d50 con 0x7f8894160360 2023-06-09T04:41:22.622 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:22.616+0000 7f8892ffd700 1 --2- 172.21.15.62:0/2884718276 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f8880066320 0x7f88800687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:22.623 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:22.620+0000 7f8892ffd700 1 --2- 172.21.15.62:0/2884718276 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f8880066320 0x7f88800687d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8884000c00 tx=0x7f8884008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:22.627 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:22.624+0000 7f887b7fe700 1 -- 172.21.15.62:0/2884718276 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f88940c2c10 con 0x7f8894160360 2023-06-09T04:41:22.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:22.832+0000 7f889951a700 1 -- 172.21.15.62:0/2884718276 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f88940c2c10 con 0x7f8894160360 2023-06-09T04:41:23.398 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.392+0000 7f887b7fe700 1 -- 172.21.15.62:0/2884718276 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7f88940c2c10 con 0x7f8894160360 2023-06-09T04:41:23.402 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.396+0000 7f889951a700 1 -- 172.21.15.62:0/2884718276 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f8880066320 msgr2=0x7f88800687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:23.403 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.396+0000 7f889951a700 1 --2- 172.21.15.62:0/2884718276 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f8880066320 0x7f88800687d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8884000c00 tx=0x7f8884008030 comp rx=0 tx=0).stop 2023-06-09T04:41:23.403 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.396+0000 7f889951a700 1 -- 172.21.15.62:0/2884718276 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8894160360 msgr2=0x7f8894161cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:23.403 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.396+0000 7f889951a700 1 --2- 172.21.15.62:0/2884718276 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8894160360 0x7f8894161cb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f888c00cb60 tx=0x7f888c00ce70 comp rx=0 tx=0).stop 2023-06-09T04:41:23.403 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.396+0000 7f889951a700 1 -- 172.21.15.62:0/2884718276 shutdown_connections 2023-06-09T04:41:23.403 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.396+0000 7f889951a700 1 --2- 172.21.15.62:0/2884718276 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f8880066320 0x7f88800687d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:23.404 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.396+0000 7f889951a700 1 --2- 172.21.15.62:0/2884718276 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8894160360 0x7f8894161cb0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:23.404 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.396+0000 7f889951a700 1 --2- 172.21.15.62:0/2884718276 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f88940c8800 0x7f889415c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:23.404 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.396+0000 7f889951a700 1 --2- 172.21.15.62:0/2884718276 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f88940b0260 0x7f88940b1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:23.404 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.396+0000 7f889951a700 1 -- 172.21.15.62:0/2884718276 >> 172.21.15.62:0/2884718276 conn(0x7f88940cab50 msgr2=0x7f88940afac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:23.404 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.396+0000 7f889951a700 1 -- 172.21.15.62:0/2884718276 shutdown_connections 2023-06-09T04:41:23.404 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.400+0000 7f889951a700 1 -- 172.21.15.62:0/2884718276 wait complete. 2023-06-09T04:41:23.425 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-06-09T04:41:23.426 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-09T04:41:23.599 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.592+0000 7f6f712b8700 1 Processor -- start 2023-06-09T04:41:23.615 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.596+0000 7f6f712b8700 1 -- start start 2023-06-09T04:41:23.618 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.596+0000 7f6f712b8700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6f6c0cd4f0 0x7f6f6c0cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:23.618 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.596+0000 7f6f712b8700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f6c071180 con 0x7f6f6c0c9ea0 2023-06-09T04:41:23.618 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.596+0000 7f6f712b8700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f6c0cc180 con 0x7f6f6c159a40 2023-06-09T04:41:23.618 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.596+0000 7f6f712b8700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f6c0cbc00 con 0x7f6f6c0cd4f0 2023-06-09T04:41:23.618 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.596+0000 7f6f70ab7700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f6f6c0c9ea0 0x7f6f6c15d6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:44896/0 (socket says 172.21.15.62:44896) 2023-06-09T04:41:23.619 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.596+0000 7f6f6b7fe700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f6f6c0cd4f0 0x7f6f6c0cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:23.619 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.596+0000 7f6f70ab7700 1 -- 172.21.15.62:0/922112234 learned_addr learned my addr 172.21.15.62:0/922112234 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:41:23.619 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.596+0000 7f6f6affd700 1 -- 172.21.15.62:0/922112234 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3613113506 0 0) 0x7f6f6c0cc180 con 0x7f6f6c159a40 2023-06-09T04:41:23.619 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.596+0000 7f6f6affd700 1 -- 172.21.15.62:0/922112234 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f540035d0 con 0x7f6f6c159a40 2023-06-09T04:41:23.619 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.596+0000 7f6f6b7fe700 1 -- 172.21.15.62:0/922112234 >> v1:172.21.15.89:6789/0 conn(0x7f6f6c159a40 legacy=0x7f6f6c070a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:23.619 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.596+0000 7f6f6affd700 1 -- 172.21.15.62:0/922112234 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2321196670 0 0) 0x7f6f64001490 con 0x7f6f6c0c9ea0 2023-06-09T04:41:23.619 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.596+0000 7f6f6b7fe700 1 -- 172.21.15.62:0/922112234 >> v1:172.21.15.62:6789/0 conn(0x7f6f6c0c9ea0 legacy=0x7f6f6c15d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:23.620 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.596+0000 7f6f6b7fe700 1 -- 172.21.15.62:0/922112234 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f6c0713c0 con 0x7f6f6c0cd4f0 2023-06-09T04:41:23.620 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.600+0000 7f6f6b7fe700 1 --2- 172.21.15.62:0/922112234 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f6c0cd4f0 0x7f6f6c0cc610 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6f60009850 tx=0x7f6f60009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5c3bb81738ae3b1 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:23.620 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.600+0000 7f6f6affd700 1 -- 172.21.15.62:0/922112234 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f60011830 con 0x7f6f6c0cd4f0 2023-06-09T04:41:23.620 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.600+0000 7f6f6affd700 1 -- 172.21.15.62:0/922112234 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f60011990 con 0x7f6f6c0cd4f0 2023-06-09T04:41:23.620 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.600+0000 7f6f6affd700 1 -- 172.21.15.62:0/922112234 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f60011d40 con 0x7f6f6c0cd4f0 2023-06-09T04:41:23.620 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.600+0000 7f6f712b8700 1 -- 172.21.15.62:0/922112234 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f6c0cd4f0 msgr2=0x7f6f6c0cc610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:23.620 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.600+0000 7f6f712b8700 1 --2- 172.21.15.62:0/922112234 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f6c0cd4f0 0x7f6f6c0cc610 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6f60009850 tx=0x7f6f60009b60 comp rx=0 tx=0).stop 2023-06-09T04:41:23.620 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.600+0000 7f6f712b8700 1 -- 172.21.15.62:0/922112234 shutdown_connections 2023-06-09T04:41:23.621 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.600+0000 7f6f712b8700 1 --2- 172.21.15.62:0/922112234 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f6c0cd4f0 0x7f6f6c0cc610 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:23.621 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.600+0000 7f6f712b8700 1 -- 172.21.15.62:0/922112234 >> 172.21.15.62:0/922112234 conn(0x7f6f6c06a420 msgr2=0x7f6f6c0afc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:23.621 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.600+0000 7f6f712b8700 1 -- 172.21.15.62:0/922112234 shutdown_connections 2023-06-09T04:41:23.621 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.600+0000 7f6f712b8700 1 -- 172.21.15.62:0/922112234 wait complete. 2023-06-09T04:41:23.621 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.604+0000 7f6f712b8700 1 Processor -- start 2023-06-09T04:41:23.621 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.604+0000 7f6f712b8700 1 -- start start 2023-06-09T04:41:23.621 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.604+0000 7f6f712b8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6f6c0cd4f0 0x7f6f6c14d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:23.622 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.604+0000 7f6f712b8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6f6c159a40 0x7f6f6c15b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:23.622 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.604+0000 7f6f712b8700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f6c15b700 0x7f6f6c0a7650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:23.622 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.604+0000 7f6f712b8700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f6c15bba0 con 0x7f6f6c0cd4f0 2023-06-09T04:41:23.622 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.604+0000 7f6f712b8700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f6c1582c0 con 0x7f6f6c15b700 2023-06-09T04:41:23.622 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.604+0000 7f6f712b8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f6c157220 con 0x7f6f6c159a40 2023-06-09T04:41:23.622 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.608+0000 7f6f6bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6f6c0cd4f0 0x7f6f6c14d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:23.622 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.608+0000 7f6f6bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6f6c0cd4f0 0x7f6f6c14d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40208/0 (socket says 172.21.15.62:40208) 2023-06-09T04:41:23.622 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.608+0000 7f6f6bfff700 1 -- 172.21.15.62:0/2920348695 learned_addr learned my addr 172.21.15.62:0/2920348695 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:23.623 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.608+0000 7f6f6b7fe700 1 --2- 172.21.15.62:0/2920348695 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6f6c159a40 0x7f6f6c15b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:23.623 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.608+0000 7f6f70ab7700 1 --2- 172.21.15.62:0/2920348695 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f6c15b700 0x7f6f6c0a7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:23.623 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.608+0000 7f6f6bfff700 1 -- 172.21.15.62:0/2920348695 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6f6c159a40 msgr2=0x7f6f6c15b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:23.623 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.608+0000 7f6f6bfff700 1 --2- 172.21.15.62:0/2920348695 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6f6c159a40 0x7f6f6c15b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:23.623 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.608+0000 7f6f6bfff700 1 -- 172.21.15.62:0/2920348695 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f6c15b700 msgr2=0x7f6f6c0a7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:23.623 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.608+0000 7f6f6bfff700 1 --2- 172.21.15.62:0/2920348695 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f6c15b700 0x7f6f6c0a7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:23.623 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.608+0000 7f6f6bfff700 1 -- 172.21.15.62:0/2920348695 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f600094b0 con 0x7f6f6c0cd4f0 2023-06-09T04:41:23.623 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.608+0000 7f6f6b7fe700 1 --2- 172.21.15.62:0/2920348695 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6f6c159a40 0x7f6f6c15b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:41:23.624 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.608+0000 7f6f6bfff700 1 --2- 172.21.15.62:0/2920348695 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6f6c0cd4f0 0x7f6f6c14d4a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c00c730 tx=0x7f6f5c00ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:23.624 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.608+0000 7f6f68ff9700 1 -- 172.21.15.62:0/2920348695 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c0052d0 con 0x7f6f6c0cd4f0 2023-06-09T04:41:23.624 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.608+0000 7f6f68ff9700 1 -- 172.21.15.62:0/2920348695 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f5c005450 con 0x7f6f6c0cd4f0 2023-06-09T04:41:23.624 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.608+0000 7f6f68ff9700 1 -- 172.21.15.62:0/2920348695 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c0038e0 con 0x7f6f6c0cd4f0 2023-06-09T04:41:23.624 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.608+0000 7f6f712b8700 1 -- 172.21.15.62:0/2920348695 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f6c157500 con 0x7f6f6c0cd4f0 2023-06-09T04:41:23.624 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.608+0000 7f6f712b8700 1 -- 172.21.15.62:0/2920348695 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f6c157ac0 con 0x7f6f6c0cd4f0 2023-06-09T04:41:23.624 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.612+0000 7f6f712b8700 1 -- 172.21.15.62:0/2920348695 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f6c0739c0 con 0x7f6f6c0cd4f0 2023-06-09T04:41:23.625 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.612+0000 7f6f68ff9700 1 -- 172.21.15.62:0/2920348695 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6f5c003a40 con 0x7f6f6c0cd4f0 2023-06-09T04:41:23.625 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.612+0000 7f6f68ff9700 1 --2- 172.21.15.62:0/2920348695 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f6f58066320 0x7f6f580687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:23.625 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.612+0000 7f6f68ff9700 1 -- 172.21.15.62:0/2920348695 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6f5c0834e0 con 0x7f6f6c0cd4f0 2023-06-09T04:41:23.626 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.616+0000 7f6f6b7fe700 1 --2- 172.21.15.62:0/2920348695 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f6f58066320 0x7f6f580687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:23.626 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.616+0000 7f6f6b7fe700 1 --2- 172.21.15.62:0/2920348695 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f6f58066320 0x7f6f580687d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6f600090b0 tx=0x7f6f6001c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:23.626 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.620+0000 7f6f68ff9700 1 -- 172.21.15.62:0/2920348695 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6f5c0505d0 con 0x7f6f6c0cd4f0 2023-06-09T04:41:23.832 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.828+0000 7f6f712b8700 1 -- 172.21.15.62:0/2920348695 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6f6c06d870 con 0x7f6f6c0cd4f0 2023-06-09T04:41:23.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.828+0000 7f6f68ff9700 1 -- 172.21.15.62:0/2920348695 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4664 (secure 0 0 0) 0x7f6f5c053bf0 con 0x7f6f6c0cd4f0 2023-06-09T04:41:23.834 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:41:23.834 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4256,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/2242182358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2242182358},{"type":"v1","addr":"172.21.15.89:6836","nonce":2242182358}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6834/326702802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":326702802},{"type":"v1","addr":"172.21.15.62:6834","nonce":326702802}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4296,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/3851882562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":3851882562},{"type":"v1","addr":"172.21.15.62:6835","nonce":3851882562}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-09T04:40:56.758756+0000","modified":"2023-06-09T04:41:23.381650+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4312},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4312":{"gid":4312,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6837/1496954959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1496954959},{"type":"v1","addr":"172.21.15.89:6837","nonce":1496954959}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-09T04:41:23.837 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.832+0000 7f6f712b8700 1 -- 172.21.15.62:0/2920348695 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f6f58066320 msgr2=0x7f6f580687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:23.837 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.832+0000 7f6f712b8700 1 --2- 172.21.15.62:0/2920348695 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f6f58066320 0x7f6f580687d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6f600090b0 tx=0x7f6f6001c040 comp rx=0 tx=0).stop 2023-06-09T04:41:23.837 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.832+0000 7f6f712b8700 1 -- 172.21.15.62:0/2920348695 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6f6c0cd4f0 msgr2=0x7f6f6c14d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:23.837 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.832+0000 7f6f712b8700 1 --2- 172.21.15.62:0/2920348695 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6f6c0cd4f0 0x7f6f6c14d4a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c00c730 tx=0x7f6f5c00ca40 comp rx=0 tx=0).stop 2023-06-09T04:41:23.838 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.832+0000 7f6f712b8700 1 -- 172.21.15.62:0/2920348695 shutdown_connections 2023-06-09T04:41:23.838 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.832+0000 7f6f712b8700 1 --2- 172.21.15.62:0/2920348695 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f6f58066320 0x7f6f580687d0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:23.838 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.832+0000 7f6f712b8700 1 --2- 172.21.15.62:0/2920348695 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f6c15b700 0x7f6f6c0a7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:23.838 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.832+0000 7f6f712b8700 1 --2- 172.21.15.62:0/2920348695 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6f6c159a40 0x7f6f6c15b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:23.838 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.832+0000 7f6f712b8700 1 --2- 172.21.15.62:0/2920348695 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6f6c0cd4f0 0x7f6f6c14d4a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:23.838 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.832+0000 7f6f712b8700 1 -- 172.21.15.62:0/2920348695 >> 172.21.15.62:0/2920348695 conn(0x7f6f6c0c9ea0 msgr2=0x7f6f6c0b33f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:23.838 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.832+0000 7f6f712b8700 1 -- 172.21.15.62:0/2920348695 shutdown_connections 2023-06-09T04:41:23.838 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:23.832+0000 7f6f712b8700 1 -- 172.21.15.62:0/2920348695 wait complete. 2023-06-09T04:41:23.839 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 9 2023-06-09T04:41:23.861 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:41:24.038 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.032+0000 7f23e6777700 1 Processor -- start 2023-06-09T04:41:24.039 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.036+0000 7f23e6777700 1 -- start start 2023-06-09T04:41:24.042 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.036+0000 7f23e6777700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23d803e9a0 0x7f23d8055260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:24.042 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.036+0000 7f23e6777700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f23d803b240 0x7f23d8056c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:24.042 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.036+0000 7f23e6777700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23d8053df0 con 0x7f23d8058b60 2023-06-09T04:41:24.043 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.036+0000 7f23e6777700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23d8053830 con 0x7f23d803b240 2023-06-09T04:41:24.043 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.036+0000 7f23e6777700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23d8053b10 con 0x7f23d803e9a0 2023-06-09T04:41:24.043 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.036+0000 7f23e5f76700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f23d803b240 0x7f23d8056c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:24.043 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.036+0000 7f23e5775700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23d803e9a0 0x7f23d8055260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:24.043 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.036+0000 7f23e5f76700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f23d803b240 0x7f23d8056c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40212/0 (socket says 172.21.15.62:40212) 2023-06-09T04:41:24.043 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.036+0000 7f23e5f76700 1 -- 172.21.15.62:0/911922578 learned_addr learned my addr 172.21.15.62:0/911922578 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:24.043 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.036+0000 7f23e4f74700 1 --1- 172.21.15.62:0/911922578 >> v1:172.21.15.89:6789/0 conn(0x7f23d8058b60 0x7f23d803ab30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.62:44500/0 (socket says 172.21.15.62:44500) 2023-06-09T04:41:24.044 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.040+0000 7f23e5f76700 1 -- 172.21.15.62:0/911922578 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23d803e9a0 msgr2=0x7f23d8055260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:24.044 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.040+0000 7f23e5f76700 1 --2- 172.21.15.62:0/911922578 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23d803e9a0 0x7f23d8055260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:24.044 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.040+0000 7f23e5f76700 1 -- 172.21.15.62:0/911922578 >> v1:172.21.15.89:6789/0 conn(0x7f23d8058b60 legacy=0x7f23d803ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:24.045 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.040+0000 7f23e5f76700 1 -- 172.21.15.62:0/911922578 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23d8006e40 con 0x7f23d803b240 2023-06-09T04:41:24.045 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.040+0000 7f23e5f76700 1 --2- 172.21.15.62:0/911922578 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23d803b240 0x7f23d8056c80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f23e0078b50 tx=0x7f23e0073380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35cd654ca8362819 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:24.045 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.040+0000 7f23d7fff700 1 -- 172.21.15.62:0/911922578 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e006b980 con 0x7f23d803b240 2023-06-09T04:41:24.045 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.040+0000 7f23d7fff700 1 -- 172.21.15.62:0/911922578 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23e006bb20 con 0x7f23d803b240 2023-06-09T04:41:24.045 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.040+0000 7f23d7fff700 1 -- 172.21.15.62:0/911922578 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e0066760 con 0x7f23d803b240 2023-06-09T04:41:24.046 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.040+0000 7f23e6777700 1 -- 172.21.15.62:0/911922578 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23d803b240 msgr2=0x7f23d8056c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:24.046 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.040+0000 7f23e6777700 1 --2- 172.21.15.62:0/911922578 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23d803b240 0x7f23d8056c80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f23e0078b50 tx=0x7f23e0073380 comp rx=0 tx=0).stop 2023-06-09T04:41:24.046 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.040+0000 7f23e6777700 1 -- 172.21.15.62:0/911922578 shutdown_connections 2023-06-09T04:41:24.046 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.040+0000 7f23e6777700 1 --2- 172.21.15.62:0/911922578 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23d803b240 0x7f23d8056c80 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:24.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.040+0000 7f23e6777700 1 --2- 172.21.15.62:0/911922578 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23d803e9a0 0x7f23d8055260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:24.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.040+0000 7f23e6777700 1 -- 172.21.15.62:0/911922578 >> 172.21.15.62:0/911922578 conn(0x7f23d800f300 msgr2=0x7f23d8055b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:24.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.040+0000 7f23e6777700 1 -- 172.21.15.62:0/911922578 shutdown_connections 2023-06-09T04:41:24.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.040+0000 7f23e6777700 1 -- 172.21.15.62:0/911922578 wait complete. 2023-06-09T04:41:24.048 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.044+0000 7f23e6777700 1 Processor -- start 2023-06-09T04:41:24.048 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.044+0000 7f23e6777700 1 -- start start 2023-06-09T04:41:24.049 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.044+0000 7f23e6777700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23d803b240 0x7f23d817be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:24.050 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.044+0000 7f23e6777700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23d803e9a0 0x7f23d80d70e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:24.050 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.044+0000 7f23e6777700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23d8058b60 0x7f23d80dde70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:24.050 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.044+0000 7f23e6777700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23d80dca70 con 0x7f23d803e9a0 2023-06-09T04:41:24.050 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.044+0000 7f23e6777700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23d80dc5e0 con 0x7f23d803b240 2023-06-09T04:41:24.050 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.044+0000 7f23e6777700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23d817c3a0 con 0x7f23d8058b60 2023-06-09T04:41:24.051 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.044+0000 7f23e4f74700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23d803e9a0 0x7f23d80d70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:24.051 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.044+0000 7f23e4f74700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23d803e9a0 0x7f23d80d70e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40220/0 (socket says 172.21.15.62:40220) 2023-06-09T04:41:24.051 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.044+0000 7f23e4f74700 1 -- 172.21.15.62:0/1740668855 learned_addr learned my addr 172.21.15.62:0/1740668855 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:24.051 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.044+0000 7f23e5f76700 1 --2- 172.21.15.62:0/1740668855 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23d8058b60 0x7f23d80dde70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:24.052 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.044+0000 7f23e5775700 1 --2- 172.21.15.62:0/1740668855 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23d803b240 0x7f23d817be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:24.052 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.048+0000 7f23e4f74700 1 -- 172.21.15.62:0/1740668855 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23d8058b60 msgr2=0x7f23d80dde70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:24.052 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.048+0000 7f23e4f74700 1 --2- 172.21.15.62:0/1740668855 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23d8058b60 0x7f23d80dde70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:24.052 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.048+0000 7f23e4f74700 1 -- 172.21.15.62:0/1740668855 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23d803b240 msgr2=0x7f23d817be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:24.052 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.048+0000 7f23e4f74700 1 --2- 172.21.15.62:0/1740668855 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23d803b240 0x7f23d817be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:24.052 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.048+0000 7f23e4f74700 1 -- 172.21.15.62:0/1740668855 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23e004e0a0 con 0x7f23d803e9a0 2023-06-09T04:41:24.053 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.048+0000 7f23e4f74700 1 --2- 172.21.15.62:0/1740668855 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23d803e9a0 0x7f23d80d70e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f23d000c410 tx=0x7f23d000c720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:24.053 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.048+0000 7f23d5ffb700 1 -- 172.21.15.62:0/1740668855 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d0005cd0 con 0x7f23d803e9a0 2023-06-09T04:41:24.053 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.048+0000 7f23d5ffb700 1 -- 172.21.15.62:0/1740668855 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23d0005e30 con 0x7f23d803e9a0 2023-06-09T04:41:24.053 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.048+0000 7f23d5ffb700 1 -- 172.21.15.62:0/1740668855 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d00072f0 con 0x7f23d803e9a0 2023-06-09T04:41:24.054 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.048+0000 7f23e6777700 1 -- 172.21.15.62:0/1740668855 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23d80d7620 con 0x7f23d803e9a0 2023-06-09T04:41:24.054 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.048+0000 7f23e6777700 1 -- 172.21.15.62:0/1740668855 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23d80dbcb0 con 0x7f23d803e9a0 2023-06-09T04:41:24.054 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.048+0000 7f23e6777700 1 -- 172.21.15.62:0/1740668855 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23d8005460 con 0x7f23d803e9a0 2023-06-09T04:41:24.055 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.052+0000 7f23d5ffb700 1 -- 172.21.15.62:0/1740668855 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f23d0007450 con 0x7f23d803e9a0 2023-06-09T04:41:24.057 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.052+0000 7f23d5ffb700 1 --2- 172.21.15.62:0/1740668855 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f23c4066320 0x7f23c40687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:24.057 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.052+0000 7f23d5ffb700 1 -- 172.21.15.62:0/1740668855 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f23d0083400 con 0x7f23d803e9a0 2023-06-09T04:41:24.058 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.052+0000 7f23e5775700 1 --2- 172.21.15.62:0/1740668855 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f23c4066320 0x7f23c40687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:24.059 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.056+0000 7f23e5775700 1 --2- 172.21.15.62:0/1740668855 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f23c4066320 0x7f23c40687d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f23dc009b80 tx=0x7f23dc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:24.063 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.060+0000 7f23d5ffb700 1 -- 172.21.15.62:0/1740668855 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f23d00504f0 con 0x7f23d803e9a0 2023-06-09T04:41:24.243 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.236+0000 7f23e6777700 1 -- 172.21.15.62:0/1740668855 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f23d8054180 con 0x7f23d803e9a0 2023-06-09T04:41:24.246 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.240+0000 7f23d5ffb700 1 -- 172.21.15.62:0/1740668855 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20084 (secure 0 0 0) 0x7f23d0053b10 con 0x7f23d803e9a0 2023-06-09T04:41:24.246 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:41:24.246 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":28,"fsid":"f7998a1e-e5a9-4202-abaa-70c0eaae1047","created":"2023-06-09T04:40:30.469588+0000","modified":"2023-06-09T04:41:01.271858+0000","last_up_change":"2023-06-09T04:40:43.120747+0000","last_in_change":"2023-06-09T04:40:33.568221+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:40:44.646921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:40:50.006643+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:40:55.031273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:40:55.773517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-09T04:40:58.845383+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bc50bbc0-dd08-42ed-804c-ec3029e36c19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6802","nonce":1295788017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6807","nonce":1295788017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6815","nonce":1295788017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6809","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6811","nonce":1295788017}]},"public_addr":"172.21.15.62:6802/1295788017","cluster_addr":"172.21.15.62:6807/1295788017","heartbeat_back_addr":"172.21.15.62:6815/1295788017","heartbeat_front_addr":"172.21.15.62:6811/1295788017","state":["exists","up"]},{"osd":1,"uuid":"8230b12d-e22f-4985-a584-4cc64404cdbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6825","nonce":4120692006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6827","nonce":4120692006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6831","nonce":4120692006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6829","nonce":4120692006}]},"public_addr":"172.21.15.62:6825/4120692006","cluster_addr":"172.21.15.62:6827/4120692006","heartbeat_back_addr":"172.21.15.62:6831/4120692006","heartbeat_front_addr":"172.21.15.62:6829/4120692006","state":["exists","up"]},{"osd":2,"uuid":"d0202506-dbe9-4e3c-9271-687929abf96a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6801","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6803","nonce":4169607876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6805","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6806","nonce":4169607876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6814","nonce":4169607876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6810","nonce":4169607876}]},"public_addr":"172.21.15.62:6803/4169607876","cluster_addr":"172.21.15.62:6806/4169607876","heartbeat_back_addr":"172.21.15.62:6814/4169607876","heartbeat_front_addr":"172.21.15.62:6810/4169607876","state":["exists","up"]},{"osd":3,"uuid":"f3c0298a-b075-4411-af50-e16cd74fdddb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6817","nonce":3268438986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6819","nonce":3268438986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6823","nonce":3268438986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6821","nonce":3268438986}]},"public_addr":"172.21.15.62:6817/3268438986","cluster_addr":"172.21.15.62:6819/3268438986","heartbeat_back_addr":"172.21.15.62:6823/3268438986","heartbeat_front_addr":"172.21.15.62:6821/3268438986","state":["exists","up"]},{"osd":4,"uuid":"1ab5c5ca-e74f-475a-a309-683cc0029928","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6817","nonce":3139617628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6819","nonce":3139617628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6823","nonce":3139617628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6821","nonce":3139617628}]},"public_addr":"172.21.15.89:6817/3139617628","cluster_addr":"172.21.15.89:6819/3139617628","heartbeat_back_addr":"172.21.15.89:6823/3139617628","heartbeat_front_addr":"172.21.15.89:6821/3139617628","state":["exists","up"]},{"osd":5,"uuid":"a933e184-bd8f-4369-a1ba-a68de53c578c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6825","nonce":2681723596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6827","nonce":2681723596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6831","nonce":2681723596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6829","nonce":2681723596}]},"public_addr":"172.21.15.89:6825/2681723596","cluster_addr":"172.21.15.89:6827/2681723596","heartbeat_back_addr":"172.21.15.89:6831/2681723596","heartbeat_front_addr":"172.21.15.89:6829/2681723596","state":["exists","up"]},{"osd":6,"uuid":"1ed7ad37-2eee-49a6-954c-b537e2b7f0ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6809","nonce":1657136033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6811","nonce":1657136033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6815","nonce":1657136033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6813","nonce":1657136033}]},"public_addr":"172.21.15.89:6809/1657136033","cluster_addr":"172.21.15.89:6811/1657136033","heartbeat_back_addr":"172.21.15.89:6815/1657136033","heartbeat_front_addr":"172.21.15.89:6813/1657136033","state":["exists","up"]},{"osd":7,"uuid":"6ed732e9-33ff-40df-9038-a9f1d1622671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6801","nonce":1710561686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6803","nonce":1710561686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6807","nonce":1710561686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6805","nonce":1710561686}]},"public_addr":"172.21.15.89:6801/1710561686","cluster_addr":"172.21.15.89:6803/1710561686","heartbeat_back_addr":"172.21.15.89:6807/1710561686","heartbeat_front_addr":"172.21.15.89:6805/1710561686","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.335803+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.419788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.179334+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.263310+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.071846+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.375627+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.282277+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.315997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:41:24.248 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.244+0000 7f23e6777700 1 -- 172.21.15.62:0/1740668855 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f23c4066320 msgr2=0x7f23c40687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:24.249 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.244+0000 7f23e6777700 1 --2- 172.21.15.62:0/1740668855 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f23c4066320 0x7f23c40687d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f23dc009b80 tx=0x7f23dc008040 comp rx=0 tx=0).stop 2023-06-09T04:41:24.249 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.244+0000 7f23e6777700 1 -- 172.21.15.62:0/1740668855 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23d803e9a0 msgr2=0x7f23d80d70e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:24.249 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.244+0000 7f23e6777700 1 --2- 172.21.15.62:0/1740668855 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23d803e9a0 0x7f23d80d70e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f23d000c410 tx=0x7f23d000c720 comp rx=0 tx=0).stop 2023-06-09T04:41:24.249 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.244+0000 7f23e6777700 1 -- 172.21.15.62:0/1740668855 shutdown_connections 2023-06-09T04:41:24.249 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.244+0000 7f23e6777700 1 --2- 172.21.15.62:0/1740668855 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f23c4066320 0x7f23c40687d0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:24.250 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.244+0000 7f23e6777700 1 --2- 172.21.15.62:0/1740668855 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f23d8058b60 0x7f23d80dde70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:24.250 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.244+0000 7f23e6777700 1 --2- 172.21.15.62:0/1740668855 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23d803e9a0 0x7f23d80d70e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:24.250 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.244+0000 7f23e6777700 1 --2- 172.21.15.62:0/1740668855 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23d803b240 0x7f23d817be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:24.250 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.244+0000 7f23e6777700 1 -- 172.21.15.62:0/1740668855 >> 172.21.15.62:0/1740668855 conn(0x7f23d800f300 msgr2=0x7f23d804f770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:24.250 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.244+0000 7f23e6777700 1 -- 172.21.15.62:0/1740668855 shutdown_connections 2023-06-09T04:41:24.250 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.244+0000 7f23e6777700 1 -- 172.21.15.62:0/1740668855 wait complete. 2023-06-09T04:41:24.272 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-06-09T04:41:24.272 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-09T04:41:24.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.448+0000 7f1ad6614700 1 Processor -- start 2023-06-09T04:41:24.452 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.448+0000 7f1ad6614700 1 -- start start 2023-06-09T04:41:24.455 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.452+0000 7f1ad6614700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1ad00ce9c0 0x7f1ad00cc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:24.455 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.452+0000 7f1ad6614700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ad00d1ac0 0x7f1ad00ced90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:24.456 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.452+0000 7f1ad6614700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ad00b51e0 con 0x7f1ad00ccf20 2023-06-09T04:41:24.456 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.452+0000 7f1ad6614700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ad00d0190 con 0x7f1ad00ce9c0 2023-06-09T04:41:24.456 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.452+0000 7f1ad6614700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad00d29f0 con 0x7f1ad00d1ac0 2023-06-09T04:41:24.457 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.452+0000 7f1ad5612700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1ad00ce9c0 0x7f1ad00cc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:24.457 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.452+0000 7f1ad5612700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1ad00ce9c0 0x7f1ad00cc9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40224/0 (socket says 172.21.15.62:40224) 2023-06-09T04:41:24.457 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.452+0000 7f1ad5612700 1 -- 172.21.15.62:0/3604978348 learned_addr learned my addr 172.21.15.62:0/3604978348 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:24.457 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.452+0000 7f1ad4e11700 1 --2- 172.21.15.62:0/3604978348 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ad00d1ac0 0x7f1ad00ced90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:24.457 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.452+0000 7f1ad5612700 1 -- 172.21.15.62:0/3604978348 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ad00d1ac0 msgr2=0x7f1ad00ced90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:24.457 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.452+0000 7f1ad5612700 1 --2- 172.21.15.62:0/3604978348 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ad00d1ac0 0x7f1ad00ced90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:24.458 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.452+0000 7f1ad5612700 1 -- 172.21.15.62:0/3604978348 >> v1:172.21.15.89:6789/0 conn(0x7f1ad00ccf20 legacy=0x7f1ad00d0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:24.458 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.452+0000 7f1ad5612700 1 -- 172.21.15.62:0/3604978348 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad00d2cd0 con 0x7f1ad00ce9c0 2023-06-09T04:41:24.458 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.452+0000 7f1ad5612700 1 --2- 172.21.15.62:0/3604978348 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ad00ce9c0 0x7f1ad00cc9e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1acc009910 tx=0x7f1acc009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44104ed4050e91b2 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:24.458 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.452+0000 7f1ac7fff700 1 -- 172.21.15.62:0/3604978348 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1acc011830 con 0x7f1ad00ce9c0 2023-06-09T04:41:24.459 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.452+0000 7f1ac7fff700 1 -- 172.21.15.62:0/3604978348 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1acc011990 con 0x7f1ad00ce9c0 2023-06-09T04:41:24.459 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.452+0000 7f1ac7fff700 1 -- 172.21.15.62:0/3604978348 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1acc011d40 con 0x7f1ad00ce9c0 2023-06-09T04:41:24.459 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.452+0000 7f1ad6614700 1 -- 172.21.15.62:0/3604978348 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ad00ce9c0 msgr2=0x7f1ad00cc9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:24.459 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.452+0000 7f1ad6614700 1 --2- 172.21.15.62:0/3604978348 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ad00ce9c0 0x7f1ad00cc9e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1acc009910 tx=0x7f1acc009c20 comp rx=0 tx=0).stop 2023-06-09T04:41:24.460 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.456+0000 7f1ad6614700 1 -- 172.21.15.62:0/3604978348 shutdown_connections 2023-06-09T04:41:24.460 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.456+0000 7f1ad6614700 1 --2- 172.21.15.62:0/3604978348 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ad00d1ac0 0x7f1ad00ced90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:24.460 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.456+0000 7f1ad6614700 1 --2- 172.21.15.62:0/3604978348 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ad00ce9c0 0x7f1ad00cc9e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:24.460 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.456+0000 7f1ad6614700 1 -- 172.21.15.62:0/3604978348 >> 172.21.15.62:0/3604978348 conn(0x7f1ad0070f20 msgr2=0x7f1ad00712f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:24.460 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.456+0000 7f1ad6614700 1 -- 172.21.15.62:0/3604978348 shutdown_connections 2023-06-09T04:41:24.460 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.456+0000 7f1ad6614700 1 -- 172.21.15.62:0/3604978348 wait complete. 2023-06-09T04:41:24.461 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.456+0000 7f1ad6614700 1 Processor -- start 2023-06-09T04:41:24.462 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.456+0000 7f1ad6614700 1 -- start start 2023-06-09T04:41:24.463 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.460+0000 7f1ad6614700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ad00ce9c0 0x7f1ad00c5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:24.463 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.460+0000 7f1ad6614700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ad01f21d0 0x7f1ad014d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:24.463 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.460+0000 7f1ad6614700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ad015da70 0x7f1ad015def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:24.464 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.460+0000 7f1ad6614700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad015e430 con 0x7f1ad01f21d0 2023-06-09T04:41:24.464 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.460+0000 7f1ad6614700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad00c7300 con 0x7f1ad00ce9c0 2023-06-09T04:41:24.464 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.460+0000 7f1ad6614700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad00c66f0 con 0x7f1ad015da70 2023-06-09T04:41:24.465 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.460+0000 7f1ad4e11700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ad01f21d0 0x7f1ad014d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:24.465 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.460+0000 7f1ad4e11700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ad01f21d0 0x7f1ad014d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40238/0 (socket says 172.21.15.62:40238) 2023-06-09T04:41:24.465 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.460+0000 7f1ad4e11700 1 -- 172.21.15.62:0/3940632661 learned_addr learned my addr 172.21.15.62:0/3940632661 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:24.465 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.460+0000 7f1ad5612700 1 --2- 172.21.15.62:0/3940632661 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ad00ce9c0 0x7f1ad00c5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:24.465 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.460+0000 7f1ad5e13700 1 --2- 172.21.15.62:0/3940632661 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ad015da70 0x7f1ad015def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:24.466 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.460+0000 7f1ad4e11700 1 -- 172.21.15.62:0/3940632661 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ad015da70 msgr2=0x7f1ad015def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:24.466 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.460+0000 7f1ad4e11700 1 --2- 172.21.15.62:0/3940632661 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ad015da70 0x7f1ad015def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:24.466 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.460+0000 7f1ad4e11700 1 -- 172.21.15.62:0/3940632661 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ad00ce9c0 msgr2=0x7f1ad00c5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:24.466 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.460+0000 7f1ad4e11700 1 --2- 172.21.15.62:0/3940632661 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ad00ce9c0 0x7f1ad00c5ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:24.466 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.460+0000 7f1ad4e11700 1 -- 172.21.15.62:0/3940632661 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1acc009570 con 0x7f1ad01f21d0 2023-06-09T04:41:24.466 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.460+0000 7f1ad4e11700 1 --2- 172.21.15.62:0/3940632661 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ad01f21d0 0x7f1ad014d770 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1ac000e840 tx=0x7f1ac000eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:24.467 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.460+0000 7f1ac5ffb700 1 -- 172.21.15.62:0/3940632661 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac00095a0 con 0x7f1ad01f21d0 2023-06-09T04:41:24.467 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.460+0000 7f1ac5ffb700 1 -- 172.21.15.62:0/3940632661 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ac0013680 con 0x7f1ad01f21d0 2023-06-09T04:41:24.467 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.460+0000 7f1ac5ffb700 1 -- 172.21.15.62:0/3940632661 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac00139f0 con 0x7f1ad01f21d0 2023-06-09T04:41:24.467 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.460+0000 7f1ad6614700 1 -- 172.21.15.62:0/3940632661 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ad00c69d0 con 0x7f1ad01f21d0 2023-06-09T04:41:24.467 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.460+0000 7f1ad6614700 1 -- 172.21.15.62:0/3940632661 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ad00c6f90 con 0x7f1ad01f21d0 2023-06-09T04:41:24.468 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.464+0000 7f1ad6614700 1 -- 172.21.15.62:0/3940632661 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ad00739c0 con 0x7f1ad01f21d0 2023-06-09T04:41:24.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.464+0000 7f1ac5ffb700 1 -- 172.21.15.62:0/3940632661 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1ac0013b50 con 0x7f1ad01f21d0 2023-06-09T04:41:24.470 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.464+0000 7f1ac5ffb700 1 --2- 172.21.15.62:0/3940632661 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f1ab4066320 0x7f1ab40687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:24.470 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.464+0000 7f1ac5ffb700 1 -- 172.21.15.62:0/3940632661 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1ac0083f40 con 0x7f1ad01f21d0 2023-06-09T04:41:24.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.468+0000 7f1ad5612700 1 --2- 172.21.15.62:0/3940632661 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f1ab4066320 0x7f1ab40687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:24.472 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.468+0000 7f1ad5612700 1 --2- 172.21.15.62:0/3940632661 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f1ab4066320 0x7f1ab40687d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1acc000c00 tx=0x7f1acc008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:24.477 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.472+0000 7f1ac5ffb700 1 -- 172.21.15.62:0/3940632661 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1ac0051030 con 0x7f1ad01f21d0 2023-06-09T04:41:24.646 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.640+0000 7f1ad6614700 1 -- 172.21.15.62:0/3940632661 --> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1ad00d2fb0 con 0x7f1ab4066320 2023-06-09T04:41:24.668 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.664+0000 7f1ac5ffb700 1 -- 172.21.15.62:0/3940632661 <== mgr.4106 v2:172.21.15.89:6832/3073446405 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367086 (secure 0 0 0) 0x7f1acc011c30 con 0x7f1ab4066320 2023-06-09T04:41:24.674 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:41:24.676 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.672+0000 7f1ad6614700 1 -- 172.21.15.62:0/3940632661 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f1ab4066320 msgr2=0x7f1ab40687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:24.676 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.672+0000 7f1ad6614700 1 --2- 172.21.15.62:0/3940632661 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f1ab4066320 0x7f1ab40687d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f1acc000c00 tx=0x7f1acc008030 comp rx=0 tx=0).stop 2023-06-09T04:41:24.676 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.672+0000 7f1ad6614700 1 -- 172.21.15.62:0/3940632661 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ad01f21d0 msgr2=0x7f1ad014d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:24.676 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.672+0000 7f1ad6614700 1 --2- 172.21.15.62:0/3940632661 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ad01f21d0 0x7f1ad014d770 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1ac000e840 tx=0x7f1ac000eb50 comp rx=0 tx=0).stop 2023-06-09T04:41:24.676 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.672+0000 7f1ad6614700 1 -- 172.21.15.62:0/3940632661 shutdown_connections 2023-06-09T04:41:24.676 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.672+0000 7f1ad6614700 1 --2- 172.21.15.62:0/3940632661 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f1ab4066320 0x7f1ab40687d0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:24.677 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.672+0000 7f1ad6614700 1 --2- 172.21.15.62:0/3940632661 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1ad015da70 0x7f1ad015def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:24.677 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.672+0000 7f1ad6614700 1 --2- 172.21.15.62:0/3940632661 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ad01f21d0 0x7f1ad014d770 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:24.677 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.672+0000 7f1ad6614700 1 --2- 172.21.15.62:0/3940632661 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1ad00ce9c0 0x7f1ad00c5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:24.677 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.672+0000 7f1ad6614700 1 -- 172.21.15.62:0/3940632661 >> 172.21.15.62:0/3940632661 conn(0x7f1ad0070f20 msgr2=0x7f1ad00b7970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:24.677 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.672+0000 7f1ad6614700 1 -- 172.21.15.62:0/3940632661 shutdown_connections 2023-06-09T04:41:24.677 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.672+0000 7f1ad6614700 1 -- 172.21.15.62:0/3940632661 wait complete. 2023-06-09T04:41:24.678 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2023-06-09T04:41:24.698 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2023-06-09T04:41:24.573302+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594959,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219208,"kb_used_data":3592,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755512,"statfs":{"total":773094113280,"available":772869644288,"internally_reserved":0,"allocated":3678208,"data_stored":2186494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005324"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.421613+0000","last_change":"2023-06-09T04:41:00.837443+0000","last_active":"2023-06-09T04:41:01.421613+0000","last_peered":"2023-06-09T04:41:01.421613+0000","last_clean":"2023-06-09T04:41:01.421613+0000","last_became_active":"2023-06-09T04:41:00.837056+0000","last_became_peered":"2023-06-09T04:41:00.837056+0000","last_unstale":"2023-06-09T04:41:01.421613+0000","last_undegraded":"2023-06-09T04:41:01.421613+0000","last_fullsized":"2023-06-09T04:41:01.421613+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:12:34.351708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.283099+0000","last_change":"2023-06-09T04:40:56.317710+0000","last_active":"2023-06-09T04:41:01.283099+0000","last_peered":"2023-06-09T04:41:01.283099+0000","last_clean":"2023-06-09T04:41:01.283099+0000","last_became_active":"2023-06-09T04:40:56.317367+0000","last_became_peered":"2023-06-09T04:40:56.317367+0000","last_unstale":"2023-06-09T04:41:01.283099+0000","last_undegraded":"2023-06-09T04:41:01.283099+0000","last_fullsized":"2023-06-09T04:41:01.283099+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:08:05.189610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.285106+0000","last_change":"2023-06-09T04:40:56.786880+0000","last_active":"2023-06-09T04:41:01.285106+0000","last_peered":"2023-06-09T04:41:01.285106+0000","last_clean":"2023-06-09T04:41:01.285106+0000","last_became_active":"2023-06-09T04:40:56.786577+0000","last_became_peered":"2023-06-09T04:40:56.786577+0000","last_unstale":"2023-06-09T04:41:01.285106+0000","last_undegraded":"2023-06-09T04:41:01.285106+0000","last_fullsized":"2023-06-09T04:41:01.285106+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:08:26.522608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.284846+0000","last_change":"2023-06-09T04:41:00.821962+0000","last_active":"2023-06-09T04:41:01.284846+0000","last_peered":"2023-06-09T04:41:01.284846+0000","last_clean":"2023-06-09T04:41:01.284846+0000","last_became_active":"2023-06-09T04:41:00.821590+0000","last_became_peered":"2023-06-09T04:41:00.821590+0000","last_unstale":"2023-06-09T04:41:01.284846+0000","last_undegraded":"2023-06-09T04:41:01.284846+0000","last_fullsized":"2023-06-09T04:41:01.284846+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:24:19.683717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.438875+0000","last_change":"2023-06-09T04:40:56.309042+0000","last_active":"2023-06-09T04:41:01.438875+0000","last_peered":"2023-06-09T04:41:01.438875+0000","last_clean":"2023-06-09T04:41:01.438875+0000","last_became_active":"2023-06-09T04:40:56.308672+0000","last_became_peered":"2023-06-09T04:40:56.308672+0000","last_unstale":"2023-06-09T04:41:01.438875+0000","last_undegraded":"2023-06-09T04:41:01.438875+0000","last_fullsized":"2023-06-09T04:41:01.438875+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:24:15.161832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.436648+0000","last_change":"2023-06-09T04:40:56.792828+0000","last_active":"2023-06-09T04:41:01.436648+0000","last_peered":"2023-06-09T04:41:01.436648+0000","last_clean":"2023-06-09T04:41:01.436648+0000","last_became_active":"2023-06-09T04:40:56.788328+0000","last_became_peered":"2023-06-09T04:40:56.788328+0000","last_unstale":"2023-06-09T04:41:01.436648+0000","last_undegraded":"2023-06-09T04:41:01.436648+0000","last_fullsized":"2023-06-09T04:41:01.436648+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:52:44.006009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.438852+0000","last_change":"2023-06-09T04:41:00.839470+0000","last_active":"2023-06-09T04:41:01.438852+0000","last_peered":"2023-06-09T04:41:01.438852+0000","last_clean":"2023-06-09T04:41:01.438852+0000","last_became_active":"2023-06-09T04:41:00.839052+0000","last_became_peered":"2023-06-09T04:41:00.839052+0000","last_unstale":"2023-06-09T04:41:01.438852+0000","last_undegraded":"2023-06-09T04:41:01.438852+0000","last_fullsized":"2023-06-09T04:41:01.438852+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:49:49.299980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.439510+0000","last_change":"2023-06-09T04:40:56.321454+0000","last_active":"2023-06-09T04:41:01.439510+0000","last_peered":"2023-06-09T04:41:01.439510+0000","last_clean":"2023-06-09T04:41:01.439510+0000","last_became_active":"2023-06-09T04:40:56.321031+0000","last_became_peered":"2023-06-09T04:40:56.321031+0000","last_unstale":"2023-06-09T04:41:01.439510+0000","last_undegraded":"2023-06-09T04:41:01.439510+0000","last_fullsized":"2023-06-09T04:41:01.439510+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:25:05.608273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.285103+0000","last_change":"2023-06-09T04:40:56.803877+0000","last_active":"2023-06-09T04:41:01.285103+0000","last_peered":"2023-06-09T04:41:01.285103+0000","last_clean":"2023-06-09T04:41:01.285103+0000","last_became_active":"2023-06-09T04:40:56.798582+0000","last_became_peered":"2023-06-09T04:40:56.798582+0000","last_unstale":"2023-06-09T04:41:01.285103+0000","last_undegraded":"2023-06-09T04:41:01.285103+0000","last_fullsized":"2023-06-09T04:41:01.285103+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:21:53.601425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.439153+0000","last_change":"2023-06-09T04:41:00.836245+0000","last_active":"2023-06-09T04:41:01.439153+0000","last_peered":"2023-06-09T04:41:01.439153+0000","last_clean":"2023-06-09T04:41:01.439153+0000","last_became_active":"2023-06-09T04:41:00.835686+0000","last_became_peered":"2023-06-09T04:41:00.835686+0000","last_unstale":"2023-06-09T04:41:01.439153+0000","last_undegraded":"2023-06-09T04:41:01.439153+0000","last_fullsized":"2023-06-09T04:41:01.439153+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:03:10.253378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.440020+0000","last_change":"2023-06-09T04:40:56.321489+0000","last_active":"2023-06-09T04:41:01.440020+0000","last_peered":"2023-06-09T04:41:01.440020+0000","last_clean":"2023-06-09T04:41:01.440020+0000","last_became_active":"2023-06-09T04:40:56.321100+0000","last_became_peered":"2023-06-09T04:40:56.321100+0000","last_unstale":"2023-06-09T04:41:01.440020+0000","last_undegraded":"2023-06-09T04:41:01.440020+0000","last_fullsized":"2023-06-09T04:41:01.440020+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:17:49.593978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.285507+0000","last_change":"2023-06-09T04:40:56.794715+0000","last_active":"2023-06-09T04:41:01.285507+0000","last_peered":"2023-06-09T04:41:01.285507+0000","last_clean":"2023-06-09T04:41:01.285507+0000","last_became_active":"2023-06-09T04:40:56.794493+0000","last_became_peered":"2023-06-09T04:40:56.794493+0000","last_unstale":"2023-06-09T04:41:01.285507+0000","last_undegraded":"2023-06-09T04:41:01.285507+0000","last_fullsized":"2023-06-09T04:41:01.285507+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:08:24.838920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.422791+0000","last_change":"2023-06-09T04:41:00.828797+0000","last_active":"2023-06-09T04:41:01.422791+0000","last_peered":"2023-06-09T04:41:01.422791+0000","last_clean":"2023-06-09T04:41:01.422791+0000","last_became_active":"2023-06-09T04:41:00.828438+0000","last_became_peered":"2023-06-09T04:41:00.828438+0000","last_unstale":"2023-06-09T04:41:01.422791+0000","last_undegraded":"2023-06-09T04:41:01.422791+0000","last_fullsized":"2023-06-09T04:41:01.422791+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:24:29.997250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.282480+0000","last_change":"2023-06-09T04:40:56.317253+0000","last_active":"2023-06-09T04:41:01.282480+0000","last_peered":"2023-06-09T04:41:01.282480+0000","last_clean":"2023-06-09T04:41:01.282480+0000","last_became_active":"2023-06-09T04:40:56.316877+0000","last_became_peered":"2023-06-09T04:40:56.316877+0000","last_unstale":"2023-06-09T04:41:01.282480+0000","last_undegraded":"2023-06-09T04:41:01.282480+0000","last_fullsized":"2023-06-09T04:41:01.282480+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:25:25.277964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.437522+0000","last_change":"2023-06-09T04:40:56.797830+0000","last_active":"2023-06-09T04:41:01.437522+0000","last_peered":"2023-06-09T04:41:01.437522+0000","last_clean":"2023-06-09T04:41:01.437522+0000","last_became_active":"2023-06-09T04:40:56.797556+0000","last_became_peered":"2023-06-09T04:40:56.797556+0000","last_unstale":"2023-06-09T04:41:01.437522+0000","last_undegraded":"2023-06-09T04:41:01.437522+0000","last_fullsized":"2023-06-09T04:41:01.437522+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:43:46.753266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.286268+0000","last_change":"2023-06-09T04:41:00.825865+0000","last_active":"2023-06-09T04:41:01.286268+0000","last_peered":"2023-06-09T04:41:01.286268+0000","last_clean":"2023-06-09T04:41:01.286268+0000","last_became_active":"2023-06-09T04:41:00.825477+0000","last_became_peered":"2023-06-09T04:41:00.825477+0000","last_unstale":"2023-06-09T04:41:01.286268+0000","last_undegraded":"2023-06-09T04:41:01.286268+0000","last_fullsized":"2023-06-09T04:41:01.286268+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:51:30.775136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.285644+0000","last_change":"2023-06-09T04:40:56.315320+0000","last_active":"2023-06-09T04:41:01.285644+0000","last_peered":"2023-06-09T04:41:01.285644+0000","last_clean":"2023-06-09T04:41:01.285644+0000","last_became_active":"2023-06-09T04:40:56.314967+0000","last_became_peered":"2023-06-09T04:40:56.314967+0000","last_unstale":"2023-06-09T04:41:01.285644+0000","last_undegraded":"2023-06-09T04:41:01.285644+0000","last_fullsized":"2023-06-09T04:41:01.285644+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:01:49.680802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.438480+0000","last_change":"2023-06-09T04:40:56.798062+0000","last_active":"2023-06-09T04:41:01.438480+0000","last_peered":"2023-06-09T04:41:01.438480+0000","last_clean":"2023-06-09T04:41:01.438480+0000","last_became_active":"2023-06-09T04:40:56.795892+0000","last_became_peered":"2023-06-09T04:40:56.795892+0000","last_unstale":"2023-06-09T04:41:01.438480+0000","last_undegraded":"2023-06-09T04:41:01.438480+0000","last_fullsized":"2023-06-09T04:41:01.438480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:48:05.320971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.287250+0000","last_change":"2023-06-09T04:41:00.829272+0000","last_active":"2023-06-09T04:41:01.287250+0000","last_peered":"2023-06-09T04:41:01.287250+0000","last_clean":"2023-06-09T04:41:01.287250+0000","last_became_active":"2023-06-09T04:41:00.828913+0000","last_became_peered":"2023-06-09T04:41:00.828913+0000","last_unstale":"2023-06-09T04:41:01.287250+0000","last_undegraded":"2023-06-09T04:41:01.287250+0000","last_fullsized":"2023-06-09T04:41:01.287250+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:36:54.747824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.423032+0000","last_change":"2023-06-09T04:40:56.320610+0000","last_active":"2023-06-09T04:41:01.423032+0000","last_peered":"2023-06-09T04:41:01.423032+0000","last_clean":"2023-06-09T04:41:01.423032+0000","last_became_active":"2023-06-09T04:40:56.320210+0000","last_became_peered":"2023-06-09T04:40:56.320210+0000","last_unstale":"2023-06-09T04:41:01.423032+0000","last_undegraded":"2023-06-09T04:41:01.423032+0000","last_fullsized":"2023-06-09T04:41:01.423032+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:43:30.487796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.282810+0000","last_change":"2023-06-09T04:40:56.800181+0000","last_active":"2023-06-09T04:41:01.282810+0000","last_peered":"2023-06-09T04:41:01.282810+0000","last_clean":"2023-06-09T04:41:01.282810+0000","last_became_active":"2023-06-09T04:40:56.798880+0000","last_became_peered":"2023-06-09T04:40:56.798880+0000","last_unstale":"2023-06-09T04:41:01.282810+0000","last_undegraded":"2023-06-09T04:41:01.282810+0000","last_fullsized":"2023-06-09T04:41:01.282810+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:43:31.500509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.282532+0000","last_change":"2023-06-09T04:41:00.841825+0000","last_active":"2023-06-09T04:41:01.282532+0000","last_peered":"2023-06-09T04:41:01.282532+0000","last_clean":"2023-06-09T04:41:01.282532+0000","last_became_active":"2023-06-09T04:41:00.841441+0000","last_became_peered":"2023-06-09T04:41:00.841441+0000","last_unstale":"2023-06-09T04:41:01.282532+0000","last_undegraded":"2023-06-09T04:41:01.282532+0000","last_fullsized":"2023-06-09T04:41:01.282532+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:24:29.997250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.436487+0000","last_change":"2023-06-09T04:40:56.314387+0000","last_active":"2023-06-09T04:41:01.436487+0000","last_peered":"2023-06-09T04:41:01.436487+0000","last_clean":"2023-06-09T04:41:01.436487+0000","last_became_active":"2023-06-09T04:40:56.314056+0000","last_became_peered":"2023-06-09T04:40:56.314056+0000","last_unstale":"2023-06-09T04:41:01.436487+0000","last_undegraded":"2023-06-09T04:41:01.436487+0000","last_fullsized":"2023-06-09T04:41:01.436487+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:03:05.731493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.287409+0000","last_change":"2023-06-09T04:40:56.799527+0000","last_active":"2023-06-09T04:41:01.287409+0000","last_peered":"2023-06-09T04:41:01.287409+0000","last_clean":"2023-06-09T04:41:01.287409+0000","last_became_active":"2023-06-09T04:40:56.799215+0000","last_became_peered":"2023-06-09T04:40:56.799215+0000","last_unstale":"2023-06-09T04:41:01.287409+0000","last_undegraded":"2023-06-09T04:41:01.287409+0000","last_fullsized":"2023-06-09T04:41:01.287409+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:34:05.634982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.436197+0000","last_change":"2023-06-09T04:40:56.785429+0000","last_active":"2023-06-09T04:41:01.436197+0000","last_peered":"2023-06-09T04:41:01.436197+0000","last_clean":"2023-06-09T04:41:01.436197+0000","last_became_active":"2023-06-09T04:40:56.785114+0000","last_became_peered":"2023-06-09T04:40:56.785114+0000","last_unstale":"2023-06-09T04:41:01.436197+0000","last_undegraded":"2023-06-09T04:41:01.436197+0000","last_fullsized":"2023-06-09T04:41:01.436197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:06:43.179689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.283223+0000","last_change":"2023-06-09T04:40:56.317391+0000","last_active":"2023-06-09T04:41:01.283223+0000","last_peered":"2023-06-09T04:41:01.283223+0000","last_clean":"2023-06-09T04:41:01.283223+0000","last_became_active":"2023-06-09T04:40:56.317009+0000","last_became_peered":"2023-06-09T04:40:56.317009+0000","last_unstale":"2023-06-09T04:41:01.283223+0000","last_undegraded":"2023-06-09T04:41:01.283223+0000","last_fullsized":"2023-06-09T04:41:01.283223+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:52:42.993296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.285830+0000","last_change":"2023-06-09T04:41:00.835405+0000","last_active":"2023-06-09T04:41:01.285830+0000","last_peered":"2023-06-09T04:41:01.285830+0000","last_clean":"2023-06-09T04:41:01.285830+0000","last_became_active":"2023-06-09T04:41:00.834994+0000","last_became_peered":"2023-06-09T04:41:00.834994+0000","last_unstale":"2023-06-09T04:41:01.285830+0000","last_undegraded":"2023-06-09T04:41:01.285830+0000","last_fullsized":"2023-06-09T04:41:01.285830+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:47:36.457098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.436354+0000","last_change":"2023-06-09T04:40:56.796887+0000","last_active":"2023-06-09T04:41:01.436354+0000","last_peered":"2023-06-09T04:41:01.436354+0000","last_clean":"2023-06-09T04:41:01.436354+0000","last_became_active":"2023-06-09T04:40:56.796261+0000","last_became_peered":"2023-06-09T04:40:56.796261+0000","last_unstale":"2023-06-09T04:41:01.436354+0000","last_undegraded":"2023-06-09T04:41:01.436354+0000","last_fullsized":"2023-06-09T04:41:01.436354+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:04:45.938545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.440403+0000","last_change":"2023-06-09T04:40:56.316780+0000","last_active":"2023-06-09T04:41:01.440403+0000","last_peered":"2023-06-09T04:41:01.440403+0000","last_clean":"2023-06-09T04:41:01.440403+0000","last_became_active":"2023-06-09T04:40:56.315706+0000","last_became_peered":"2023-06-09T04:40:56.315706+0000","last_unstale":"2023-06-09T04:41:01.440403+0000","last_undegraded":"2023-06-09T04:41:01.440403+0000","last_fullsized":"2023-06-09T04:41:01.440403+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:24:25.475365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.438087+0000","last_change":"2023-06-09T04:41:00.831457+0000","last_active":"2023-06-09T04:41:01.438087+0000","last_peered":"2023-06-09T04:41:01.438087+0000","last_clean":"2023-06-09T04:41:01.438087+0000","last_became_active":"2023-06-09T04:41:00.830962+0000","last_became_peered":"2023-06-09T04:41:00.830962+0000","last_unstale":"2023-06-09T04:41:01.438087+0000","last_undegraded":"2023-06-09T04:41:01.438087+0000","last_fullsized":"2023-06-09T04:41:01.438087+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:20:23.212298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.439608+0000","last_change":"2023-06-09T04:40:56.322126+0000","last_active":"2023-06-09T04:41:01.439608+0000","last_peered":"2023-06-09T04:41:01.439608+0000","last_clean":"2023-06-09T04:41:01.439608+0000","last_became_active":"2023-06-09T04:40:56.321833+0000","last_became_peered":"2023-06-09T04:40:56.321833+0000","last_unstale":"2023-06-09T04:41:01.439608+0000","last_undegraded":"2023-06-09T04:41:01.439608+0000","last_fullsized":"2023-06-09T04:41:01.439608+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:52:42.993296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.422084+0000","last_change":"2023-06-09T04:40:56.810607+0000","last_active":"2023-06-09T04:41:01.422084+0000","last_peered":"2023-06-09T04:41:01.422084+0000","last_clean":"2023-06-09T04:41:01.422084+0000","last_became_active":"2023-06-09T04:40:56.806121+0000","last_became_peered":"2023-06-09T04:40:56.806121+0000","last_unstale":"2023-06-09T04:41:01.422084+0000","last_undegraded":"2023-06-09T04:41:01.422084+0000","last_fullsized":"2023-06-09T04:41:01.422084+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:17:50.606690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.436321+0000","last_change":"2023-06-09T04:41:00.825055+0000","last_active":"2023-06-09T04:41:01.436321+0000","last_peered":"2023-06-09T04:41:01.436321+0000","last_clean":"2023-06-09T04:41:01.436321+0000","last_became_active":"2023-06-09T04:41:00.824544+0000","last_became_peered":"2023-06-09T04:41:00.824544+0000","last_unstale":"2023-06-09T04:41:01.436321+0000","last_undegraded":"2023-06-09T04:41:01.436321+0000","last_fullsized":"2023-06-09T04:41:01.436321+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:43:35.009681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"28'10","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:14.324470+0000","last_change":"2023-06-09T04:40:56.314806+0000","last_active":"2023-06-09T04:41:14.324470+0000","last_peered":"2023-06-09T04:41:14.324470+0000","last_clean":"2023-06-09T04:41:14.324470+0000","last_became_active":"2023-06-09T04:40:56.312677+0000","last_became_peered":"2023-06-09T04:40:56.312677+0000","last_unstale":"2023-06-09T04:41:14.324470+0000","last_undegraded":"2023-06-09T04:41:14.324470+0000","last_fullsized":"2023-06-09T04:41:14.324470+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:50:18.781041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3793,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.285588+0000","last_change":"2023-06-09T04:40:56.787806+0000","last_active":"2023-06-09T04:41:01.285588+0000","last_peered":"2023-06-09T04:41:01.285588+0000","last_clean":"2023-06-09T04:41:01.285588+0000","last_became_active":"2023-06-09T04:40:56.787509+0000","last_became_peered":"2023-06-09T04:40:56.787509+0000","last_unstale":"2023-06-09T04:41:01.285588+0000","last_undegraded":"2023-06-09T04:41:01.285588+0000","last_fullsized":"2023-06-09T04:41:01.285588+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T04:54:37.254871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.421967+0000","last_change":"2023-06-09T04:41:00.837111+0000","last_active":"2023-06-09T04:41:01.421967+0000","last_peered":"2023-06-09T04:41:01.421967+0000","last_clean":"2023-06-09T04:41:01.421967+0000","last_became_active":"2023-06-09T04:41:00.836434+0000","last_became_peered":"2023-06-09T04:41:00.836434+0000","last_unstale":"2023-06-09T04:41:01.421967+0000","last_undegraded":"2023-06-09T04:41:01.421967+0000","last_fullsized":"2023-06-09T04:41:01.421967+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:47:47.084156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.285632+0000","last_change":"2023-06-09T04:40:56.798290+0000","last_active":"2023-06-09T04:41:01.285632+0000","last_peered":"2023-06-09T04:41:01.285632+0000","last_clean":"2023-06-09T04:41:01.285632+0000","last_became_active":"2023-06-09T04:40:56.797577+0000","last_became_peered":"2023-06-09T04:40:56.797577+0000","last_unstale":"2023-06-09T04:41:01.285632+0000","last_undegraded":"2023-06-09T04:41:01.285632+0000","last_fullsized":"2023-06-09T04:41:01.285632+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:40:42.697633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.287520+0000","last_change":"2023-06-09T04:40:51.254956+0000","last_active":"2023-06-09T04:41:01.287520+0000","last_peered":"2023-06-09T04:41:01.287520+0000","last_clean":"2023-06-09T04:41:01.287520+0000","last_became_active":"2023-06-09T04:40:51.254627+0000","last_became_peered":"2023-06-09T04:40:51.254627+0000","last_unstale":"2023-06-09T04:41:01.287520+0000","last_undegraded":"2023-06-09T04:41:01.287520+0000","last_fullsized":"2023-06-09T04:41:01.287520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_clean_scrub_stamp":"2023-06-09T04:40:50.211713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:44:56.996665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"28'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.283072+0000","last_change":"2023-06-09T04:40:56.315263+0000","last_active":"2023-06-09T04:41:01.283072+0000","last_peered":"2023-06-09T04:41:01.283072+0000","last_clean":"2023-06-09T04:41:01.283072+0000","last_became_active":"2023-06-09T04:40:56.314747+0000","last_became_peered":"2023-06-09T04:40:56.314747+0000","last_unstale":"2023-06-09T04:41:01.283072+0000","last_undegraded":"2023-06-09T04:41:01.283072+0000","last_fullsized":"2023-06-09T04:41:01.283072+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:03:05.731493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.436011+0000","last_change":"2023-06-09T04:41:00.833888+0000","last_active":"2023-06-09T04:41:01.436011+0000","last_peered":"2023-06-09T04:41:01.436011+0000","last_clean":"2023-06-09T04:41:01.436011+0000","last_became_active":"2023-06-09T04:41:00.833442+0000","last_became_peered":"2023-06-09T04:41:00.833442+0000","last_unstale":"2023-06-09T04:41:01.436011+0000","last_undegraded":"2023-06-09T04:41:01.436011+0000","last_fullsized":"2023-06-09T04:41:01.436011+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:24:29.997250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.436508+0000","last_change":"2023-06-09T04:40:56.802424+0000","last_active":"2023-06-09T04:41:01.436508+0000","last_peered":"2023-06-09T04:41:01.436508+0000","last_clean":"2023-06-09T04:41:01.436508+0000","last_became_active":"2023-06-09T04:40:56.802154+0000","last_became_peered":"2023-06-09T04:40:56.802154+0000","last_unstale":"2023-06-09T04:41:01.436508+0000","last_undegraded":"2023-06-09T04:41:01.436508+0000","last_fullsized":"2023-06-09T04:41:01.436508+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:05:49.158462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.423447+0000","last_change":"2023-06-09T04:40:51.247235+0000","last_active":"2023-06-09T04:41:01.423447+0000","last_peered":"2023-06-09T04:41:01.423447+0000","last_clean":"2023-06-09T04:41:01.423447+0000","last_became_active":"2023-06-09T04:40:51.246657+0000","last_became_peered":"2023-06-09T04:40:51.246657+0000","last_unstale":"2023-06-09T04:41:01.423447+0000","last_undegraded":"2023-06-09T04:41:01.423447+0000","last_fullsized":"2023-06-09T04:41:01.423447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_clean_scrub_stamp":"2023-06-09T04:40:50.211713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:03:00.683016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.438678+0000","last_change":"2023-06-09T04:40:56.308909+0000","last_active":"2023-06-09T04:41:01.438678+0000","last_peered":"2023-06-09T04:41:01.438678+0000","last_clean":"2023-06-09T04:41:01.438678+0000","last_became_active":"2023-06-09T04:40:56.308599+0000","last_became_peered":"2023-06-09T04:40:56.308599+0000","last_unstale":"2023-06-09T04:41:01.438678+0000","last_undegraded":"2023-06-09T04:41:01.438678+0000","last_fullsized":"2023-06-09T04:41:01.438678+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:25:20.124448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.285749+0000","last_change":"2023-06-09T04:41:00.824541+0000","last_active":"2023-06-09T04:41:01.285749+0000","last_peered":"2023-06-09T04:41:01.285749+0000","last_clean":"2023-06-09T04:41:01.285749+0000","last_became_active":"2023-06-09T04:41:00.823837+0000","last_became_peered":"2023-06-09T04:41:00.823837+0000","last_unstale":"2023-06-09T04:41:01.285749+0000","last_undegraded":"2023-06-09T04:41:01.285749+0000","last_fullsized":"2023-06-09T04:41:01.285749+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:38:10.979218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.281976+0000","last_change":"2023-06-09T04:40:56.791325+0000","last_active":"2023-06-09T04:41:01.281976+0000","last_peered":"2023-06-09T04:41:01.281976+0000","last_clean":"2023-06-09T04:41:01.281976+0000","last_became_active":"2023-06-09T04:40:56.791079+0000","last_became_peered":"2023-06-09T04:40:56.791079+0000","last_unstale":"2023-06-09T04:41:01.281976+0000","last_undegraded":"2023-06-09T04:41:01.281976+0000","last_fullsized":"2023-06-09T04:41:01.281976+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:04:20.137918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.439866+0000","last_change":"2023-06-09T04:40:51.254461+0000","last_active":"2023-06-09T04:41:01.439866+0000","last_peered":"2023-06-09T04:41:01.439866+0000","last_clean":"2023-06-09T04:41:01.439866+0000","last_became_active":"2023-06-09T04:40:51.254070+0000","last_became_peered":"2023-06-09T04:40:51.254070+0000","last_unstale":"2023-06-09T04:41:01.439866+0000","last_undegraded":"2023-06-09T04:41:01.439866+0000","last_fullsized":"2023-06-09T04:41:01.439866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_clean_scrub_stamp":"2023-06-09T04:40:50.211713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:14:25.527350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.422675+0000","last_change":"2023-06-09T04:40:56.320311+0000","last_active":"2023-06-09T04:41:01.422675+0000","last_peered":"2023-06-09T04:41:01.422675+0000","last_clean":"2023-06-09T04:41:01.422675+0000","last_became_active":"2023-06-09T04:40:56.320015+0000","last_became_peered":"2023-06-09T04:40:56.320015+0000","last_unstale":"2023-06-09T04:41:01.422675+0000","last_undegraded":"2023-06-09T04:41:01.422675+0000","last_fullsized":"2023-06-09T04:41:01.422675+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:57:28.487285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.285949+0000","last_change":"2023-06-09T04:41:00.822120+0000","last_active":"2023-06-09T04:41:01.285949+0000","last_peered":"2023-06-09T04:41:01.285949+0000","last_clean":"2023-06-09T04:41:01.285949+0000","last_became_active":"2023-06-09T04:41:00.821726+0000","last_became_peered":"2023-06-09T04:41:00.821726+0000","last_unstale":"2023-06-09T04:41:01.285949+0000","last_undegraded":"2023-06-09T04:41:01.285949+0000","last_fullsized":"2023-06-09T04:41:01.285949+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:03:36.736093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.422235+0000","last_change":"2023-06-09T04:40:56.797145+0000","last_active":"2023-06-09T04:41:01.422235+0000","last_peered":"2023-06-09T04:41:01.422235+0000","last_clean":"2023-06-09T04:41:01.422235+0000","last_became_active":"2023-06-09T04:40:56.796400+0000","last_became_peered":"2023-06-09T04:40:56.796400+0000","last_unstale":"2023-06-09T04:41:01.422235+0000","last_undegraded":"2023-06-09T04:41:01.422235+0000","last_fullsized":"2023-06-09T04:41:01.422235+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:13:45.572440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.423177+0000","last_change":"2023-06-09T04:40:51.246536+0000","last_active":"2023-06-09T04:41:01.423177+0000","last_peered":"2023-06-09T04:41:01.423177+0000","last_clean":"2023-06-09T04:41:01.423177+0000","last_became_active":"2023-06-09T04:40:51.245999+0000","last_became_peered":"2023-06-09T04:40:51.245999+0000","last_unstale":"2023-06-09T04:41:01.423177+0000","last_undegraded":"2023-06-09T04:41:01.423177+0000","last_fullsized":"2023-06-09T04:41:01.423177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_clean_scrub_stamp":"2023-06-09T04:40:50.211713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:04:39.877355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.439639+0000","last_change":"2023-06-09T04:40:56.316395+0000","last_active":"2023-06-09T04:41:01.439639+0000","last_peered":"2023-06-09T04:41:01.439639+0000","last_clean":"2023-06-09T04:41:01.439639+0000","last_became_active":"2023-06-09T04:40:56.315695+0000","last_became_peered":"2023-06-09T04:40:56.315695+0000","last_unstale":"2023-06-09T04:41:01.439639+0000","last_undegraded":"2023-06-09T04:41:01.439639+0000","last_fullsized":"2023-06-09T04:41:01.439639+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:12:29.829823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.281994+0000","last_change":"2023-06-09T04:41:00.832153+0000","last_active":"2023-06-09T04:41:01.281994+0000","last_peered":"2023-06-09T04:41:01.281994+0000","last_clean":"2023-06-09T04:41:01.281994+0000","last_became_active":"2023-06-09T04:41:00.831571+0000","last_became_peered":"2023-06-09T04:41:00.831571+0000","last_unstale":"2023-06-09T04:41:01.281994+0000","last_undegraded":"2023-06-09T04:41:01.281994+0000","last_fullsized":"2023-06-09T04:41:01.281994+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:17:54.115862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.422827+0000","last_change":"2023-06-09T04:40:56.794902+0000","last_active":"2023-06-09T04:41:01.422827+0000","last_peered":"2023-06-09T04:41:01.422827+0000","last_clean":"2023-06-09T04:41:01.422827+0000","last_became_active":"2023-06-09T04:40:56.794542+0000","last_became_peered":"2023-06-09T04:40:56.794542+0000","last_unstale":"2023-06-09T04:41:01.422827+0000","last_undegraded":"2023-06-09T04:41:01.422827+0000","last_fullsized":"2023-06-09T04:41:01.422827+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:25:26.290677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.285785+0000","last_change":"2023-06-09T04:40:56.315468+0000","last_active":"2023-06-09T04:41:01.285785+0000","last_peered":"2023-06-09T04:41:01.285785+0000","last_clean":"2023-06-09T04:41:01.285785+0000","last_became_active":"2023-06-09T04:40:56.315183+0000","last_became_peered":"2023-06-09T04:40:56.315183+0000","last_unstale":"2023-06-09T04:41:01.285785+0000","last_undegraded":"2023-06-09T04:41:01.285785+0000","last_fullsized":"2023-06-09T04:41:01.285785+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:34:48.798835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.439610+0000","last_change":"2023-06-09T04:40:51.256393+0000","last_active":"2023-06-09T04:41:01.439610+0000","last_peered":"2023-06-09T04:41:01.439610+0000","last_clean":"2023-06-09T04:41:01.439610+0000","last_became_active":"2023-06-09T04:40:51.255964+0000","last_became_peered":"2023-06-09T04:40:51.255964+0000","last_unstale":"2023-06-09T04:41:01.439610+0000","last_undegraded":"2023-06-09T04:41:01.439610+0000","last_fullsized":"2023-06-09T04:41:01.439610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_clean_scrub_stamp":"2023-06-09T04:40:50.211713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:36:40.725711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.282494+0000","last_change":"2023-06-09T04:41:00.839261+0000","last_active":"2023-06-09T04:41:01.282494+0000","last_peered":"2023-06-09T04:41:01.282494+0000","last_clean":"2023-06-09T04:41:01.282494+0000","last_became_active":"2023-06-09T04:41:00.838867+0000","last_became_peered":"2023-06-09T04:41:00.838867+0000","last_unstale":"2023-06-09T04:41:01.282494+0000","last_undegraded":"2023-06-09T04:41:01.282494+0000","last_fullsized":"2023-06-09T04:41:01.282494+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:57:33.009170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.423610+0000","last_change":"2023-06-09T04:40:56.798090+0000","last_active":"2023-06-09T04:41:01.423610+0000","last_peered":"2023-06-09T04:41:01.423610+0000","last_clean":"2023-06-09T04:41:01.423610+0000","last_became_active":"2023-06-09T04:40:56.797767+0000","last_became_peered":"2023-06-09T04:40:56.797767+0000","last_unstale":"2023-06-09T04:41:01.423610+0000","last_undegraded":"2023-06-09T04:41:01.423610+0000","last_fullsized":"2023-06-09T04:41:01.423610+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:52:44.006009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.422159+0000","last_change":"2023-06-09T04:40:56.320626+0000","last_active":"2023-06-09T04:41:01.422159+0000","last_peered":"2023-06-09T04:41:01.422159+0000","last_clean":"2023-06-09T04:41:01.422159+0000","last_became_active":"2023-06-09T04:40:56.320232+0000","last_became_peered":"2023-06-09T04:40:56.320232+0000","last_unstale":"2023-06-09T04:41:01.422159+0000","last_undegraded":"2023-06-09T04:41:01.422159+0000","last_fullsized":"2023-06-09T04:41:01.422159+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:20:18.690413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.437109+0000","last_change":"2023-06-09T04:40:51.582053+0000","last_active":"2023-06-09T04:41:01.437109+0000","last_peered":"2023-06-09T04:41:01.437109+0000","last_clean":"2023-06-09T04:41:01.437109+0000","last_became_active":"2023-06-09T04:40:51.581476+0000","last_became_peered":"2023-06-09T04:40:51.581476+0000","last_unstale":"2023-06-09T04:41:01.437109+0000","last_undegraded":"2023-06-09T04:41:01.437109+0000","last_fullsized":"2023-06-09T04:41:01.437109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_clean_scrub_stamp":"2023-06-09T04:40:50.211713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:41:20.442998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.437773+0000","last_change":"2023-06-09T04:41:00.823337+0000","last_active":"2023-06-09T04:41:01.437773+0000","last_peered":"2023-06-09T04:41:01.437773+0000","last_clean":"2023-06-09T04:41:01.437773+0000","last_became_active":"2023-06-09T04:41:00.822873+0000","last_became_peered":"2023-06-09T04:41:00.822873+0000","last_unstale":"2023-06-09T04:41:01.437773+0000","last_undegraded":"2023-06-09T04:41:01.437773+0000","last_fullsized":"2023-06-09T04:41:01.437773+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:44:04.904534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.282652+0000","last_change":"2023-06-09T04:40:56.796601+0000","last_active":"2023-06-09T04:41:01.282652+0000","last_peered":"2023-06-09T04:41:01.282652+0000","last_clean":"2023-06-09T04:41:01.282652+0000","last_became_active":"2023-06-09T04:40:56.796341+0000","last_became_peered":"2023-06-09T04:40:56.796341+0000","last_unstale":"2023-06-09T04:41:01.282652+0000","last_undegraded":"2023-06-09T04:41:01.282652+0000","last_fullsized":"2023-06-09T04:41:01.282652+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:06:43.179689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.281540+0000","last_change":"2023-06-09T04:40:56.317205+0000","last_active":"2023-06-09T04:41:01.281540+0000","last_peered":"2023-06-09T04:41:01.281540+0000","last_clean":"2023-06-09T04:41:01.281540+0000","last_became_active":"2023-06-09T04:40:56.316821+0000","last_became_peered":"2023-06-09T04:40:56.316821+0000","last_unstale":"2023-06-09T04:41:01.281540+0000","last_undegraded":"2023-06-09T04:41:01.281540+0000","last_fullsized":"2023-06-09T04:41:01.281540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:36:45.774188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.438350+0000","last_change":"2023-06-09T04:40:51.256342+0000","last_active":"2023-06-09T04:41:01.438350+0000","last_peered":"2023-06-09T04:41:01.438350+0000","last_clean":"2023-06-09T04:41:01.438350+0000","last_became_active":"2023-06-09T04:40:51.256010+0000","last_became_peered":"2023-06-09T04:40:51.256010+0000","last_unstale":"2023-06-09T04:41:01.438350+0000","last_undegraded":"2023-06-09T04:41:01.438350+0000","last_fullsized":"2023-06-09T04:41:01.438350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_clean_scrub_stamp":"2023-06-09T04:40:50.211713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:13:39.511250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.440147+0000","last_change":"2023-06-09T04:41:00.839270+0000","last_active":"2023-06-09T04:41:01.440147+0000","last_peered":"2023-06-09T04:41:01.440147+0000","last_clean":"2023-06-09T04:41:01.440147+0000","last_became_active":"2023-06-09T04:41:00.838641+0000","last_became_peered":"2023-06-09T04:41:00.838641+0000","last_unstale":"2023-06-09T04:41:01.440147+0000","last_undegraded":"2023-06-09T04:41:01.440147+0000","last_fullsized":"2023-06-09T04:41:01.440147+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:20:23.212298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.286778+0000","last_change":"2023-06-09T04:40:56.806412+0000","last_active":"2023-06-09T04:41:01.286778+0000","last_peered":"2023-06-09T04:41:01.286778+0000","last_clean":"2023-06-09T04:41:01.286778+0000","last_became_active":"2023-06-09T04:40:56.806046+0000","last_became_peered":"2023-06-09T04:40:56.806046+0000","last_unstale":"2023-06-09T04:41:01.286778+0000","last_undegraded":"2023-06-09T04:41:01.286778+0000","last_fullsized":"2023-06-09T04:41:01.286778+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:13:32.401045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.437153+0000","last_change":"2023-06-09T04:40:56.316110+0000","last_active":"2023-06-09T04:41:01.437153+0000","last_peered":"2023-06-09T04:41:01.437153+0000","last_clean":"2023-06-09T04:41:01.437153+0000","last_became_active":"2023-06-09T04:40:56.315754+0000","last_became_peered":"2023-06-09T04:40:56.315754+0000","last_unstale":"2023-06-09T04:41:01.437153+0000","last_undegraded":"2023-06-09T04:41:01.437153+0000","last_fullsized":"2023-06-09T04:41:01.437153+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:59:56.484281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.439096+0000","last_change":"2023-06-09T04:40:51.253269+0000","last_active":"2023-06-09T04:41:01.439096+0000","last_peered":"2023-06-09T04:41:01.439096+0000","last_clean":"2023-06-09T04:41:01.439096+0000","last_became_active":"2023-06-09T04:40:51.252908+0000","last_became_peered":"2023-06-09T04:40:51.252908+0000","last_unstale":"2023-06-09T04:41:01.439096+0000","last_undegraded":"2023-06-09T04:41:01.439096+0000","last_fullsized":"2023-06-09T04:41:01.439096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_clean_scrub_stamp":"2023-06-09T04:40:50.211713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:55:48.768194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":183,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.438683+0000","last_change":"2023-06-09T04:40:46.286764+0000","last_active":"2023-06-09T04:41:01.438683+0000","last_peered":"2023-06-09T04:41:01.438683+0000","last_clean":"2023-06-09T04:41:01.438683+0000","last_became_active":"2023-06-09T04:40:46.285285+0000","last_became_peered":"2023-06-09T04:40:46.285285+0000","last_unstale":"2023-06-09T04:41:01.438683+0000","last_undegraded":"2023-06-09T04:41:01.438683+0000","last_fullsized":"2023-06-09T04:41:01.438683+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:45.151406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:45.151406+0000","last_clean_scrub_stamp":"2023-06-09T04:40:45.151406+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:43:20.379013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.438943+0000","last_change":"2023-06-09T04:41:00.830910+0000","last_active":"2023-06-09T04:41:01.438943+0000","last_peered":"2023-06-09T04:41:01.438943+0000","last_clean":"2023-06-09T04:41:01.438943+0000","last_became_active":"2023-06-09T04:41:00.830476+0000","last_became_peered":"2023-06-09T04:41:00.830476+0000","last_unstale":"2023-06-09T04:41:01.438943+0000","last_undegraded":"2023-06-09T04:41:01.438943+0000","last_fullsized":"2023-06-09T04:41:01.438943+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:04:49.447717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.423561+0000","last_change":"2023-06-09T04:40:56.790616+0000","last_active":"2023-06-09T04:41:01.423561+0000","last_peered":"2023-06-09T04:41:01.423561+0000","last_clean":"2023-06-09T04:41:01.423561+0000","last_became_active":"2023-06-09T04:40:56.790340+0000","last_became_peered":"2023-06-09T04:40:56.790340+0000","last_unstale":"2023-06-09T04:41:01.423561+0000","last_undegraded":"2023-06-09T04:41:01.423561+0000","last_fullsized":"2023-06-09T04:41:01.423561+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:08:06.202323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.436613+0000","last_change":"2023-06-09T04:40:56.319906+0000","last_active":"2023-06-09T04:41:01.436613+0000","last_peered":"2023-06-09T04:41:01.436613+0000","last_clean":"2023-06-09T04:41:01.436613+0000","last_became_active":"2023-06-09T04:40:56.319496+0000","last_became_peered":"2023-06-09T04:40:56.319496+0000","last_unstale":"2023-06-09T04:41:01.436613+0000","last_undegraded":"2023-06-09T04:41:01.436613+0000","last_fullsized":"2023-06-09T04:41:01.436613+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:08:05.189610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.288028+0000","last_change":"2023-06-09T04:41:00.825198+0000","last_active":"2023-06-09T04:41:01.288028+0000","last_peered":"2023-06-09T04:41:01.288028+0000","last_clean":"2023-06-09T04:41:01.288028+0000","last_became_active":"2023-06-09T04:41:00.824804+0000","last_became_peered":"2023-06-09T04:41:00.824804+0000","last_unstale":"2023-06-09T04:41:01.288028+0000","last_undegraded":"2023-06-09T04:41:01.288028+0000","last_fullsized":"2023-06-09T04:41:01.288028+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:52:16.020173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.287921+0000","last_change":"2023-06-09T04:40:56.801931+0000","last_active":"2023-06-09T04:41:01.287921+0000","last_peered":"2023-06-09T04:41:01.287921+0000","last_clean":"2023-06-09T04:41:01.287921+0000","last_became_active":"2023-06-09T04:40:56.801667+0000","last_became_peered":"2023-06-09T04:40:56.801667+0000","last_unstale":"2023-06-09T04:41:01.287921+0000","last_undegraded":"2023-06-09T04:41:01.287921+0000","last_fullsized":"2023-06-09T04:41:01.287921+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:52:18.948571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.285847+0000","last_change":"2023-06-09T04:40:56.322597+0000","last_active":"2023-06-09T04:41:01.285847+0000","last_peered":"2023-06-09T04:41:01.285847+0000","last_clean":"2023-06-09T04:41:01.285847+0000","last_became_active":"2023-06-09T04:40:56.322300+0000","last_became_peered":"2023-06-09T04:40:56.322300+0000","last_unstale":"2023-06-09T04:41:01.285847+0000","last_undegraded":"2023-06-09T04:41:01.285847+0000","last_fullsized":"2023-06-09T04:41:01.285847+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:27:36.587609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.439849+0000","last_change":"2023-06-09T04:41:00.832222+0000","last_active":"2023-06-09T04:41:01.439849+0000","last_peered":"2023-06-09T04:41:01.439849+0000","last_clean":"2023-06-09T04:41:01.439849+0000","last_became_active":"2023-06-09T04:41:00.831821+0000","last_became_peered":"2023-06-09T04:41:00.831821+0000","last_unstale":"2023-06-09T04:41:01.439849+0000","last_undegraded":"2023-06-09T04:41:01.439849+0000","last_fullsized":"2023-06-09T04:41:01.439849+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:47:47.084156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.286843+0000","last_change":"2023-06-09T04:40:56.803238+0000","last_active":"2023-06-09T04:41:01.286843+0000","last_peered":"2023-06-09T04:41:01.286843+0000","last_clean":"2023-06-09T04:41:01.286843+0000","last_became_active":"2023-06-09T04:40:56.802659+0000","last_became_peered":"2023-06-09T04:40:56.802659+0000","last_unstale":"2023-06-09T04:41:01.286843+0000","last_undegraded":"2023-06-09T04:41:01.286843+0000","last_fullsized":"2023-06-09T04:41:01.286843+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:18:37.195363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.286230+0000","last_change":"2023-06-09T04:40:56.310427+0000","last_active":"2023-06-09T04:41:01.286230+0000","last_peered":"2023-06-09T04:41:01.286230+0000","last_clean":"2023-06-09T04:41:01.286230+0000","last_became_active":"2023-06-09T04:40:56.309681+0000","last_became_peered":"2023-06-09T04:40:56.309681+0000","last_unstale":"2023-06-09T04:41:01.286230+0000","last_undegraded":"2023-06-09T04:41:01.286230+0000","last_fullsized":"2023-06-09T04:41:01.286230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:32:44.555572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.422209+0000","last_change":"2023-06-09T04:41:00.833572+0000","last_active":"2023-06-09T04:41:01.422209+0000","last_peered":"2023-06-09T04:41:01.422209+0000","last_clean":"2023-06-09T04:41:01.422209+0000","last_became_active":"2023-06-09T04:41:00.833182+0000","last_became_peered":"2023-06-09T04:41:00.833182+0000","last_unstale":"2023-06-09T04:41:01.422209+0000","last_undegraded":"2023-06-09T04:41:01.422209+0000","last_fullsized":"2023-06-09T04:41:01.422209+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:04:23.647090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.285461+0000","last_change":"2023-06-09T04:40:56.805747+0000","last_active":"2023-06-09T04:41:01.285461+0000","last_peered":"2023-06-09T04:41:01.285461+0000","last_clean":"2023-06-09T04:41:01.285461+0000","last_became_active":"2023-06-09T04:40:56.797532+0000","last_became_peered":"2023-06-09T04:40:56.797532+0000","last_unstale":"2023-06-09T04:41:01.285461+0000","last_undegraded":"2023-06-09T04:41:01.285461+0000","last_fullsized":"2023-06-09T04:41:01.285461+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:45:17.466440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.438024+0000","last_change":"2023-06-09T04:40:56.314468+0000","last_active":"2023-06-09T04:41:01.438024+0000","last_peered":"2023-06-09T04:41:01.438024+0000","last_clean":"2023-06-09T04:41:01.438024+0000","last_became_active":"2023-06-09T04:40:56.314110+0000","last_became_peered":"2023-06-09T04:40:56.314110+0000","last_unstale":"2023-06-09T04:41:01.438024+0000","last_undegraded":"2023-06-09T04:41:01.438024+0000","last_fullsized":"2023-06-09T04:41:01.438024+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:39:14.790353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.437486+0000","last_change":"2023-06-09T04:41:00.823352+0000","last_active":"2023-06-09T04:41:01.437486+0000","last_peered":"2023-06-09T04:41:01.437486+0000","last_clean":"2023-06-09T04:41:01.437486+0000","last_became_active":"2023-06-09T04:41:00.822869+0000","last_became_peered":"2023-06-09T04:41:00.822869+0000","last_unstale":"2023-06-09T04:41:01.437486+0000","last_undegraded":"2023-06-09T04:41:01.437486+0000","last_fullsized":"2023-06-09T04:41:01.437486+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:46:17.286998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.281876+0000","last_change":"2023-06-09T04:40:56.790996+0000","last_active":"2023-06-09T04:41:01.281876+0000","last_peered":"2023-06-09T04:41:01.281876+0000","last_clean":"2023-06-09T04:41:01.281876+0000","last_became_active":"2023-06-09T04:40:56.790630+0000","last_became_peered":"2023-06-09T04:40:56.790630+0000","last_unstale":"2023-06-09T04:41:01.281876+0000","last_undegraded":"2023-06-09T04:41:01.281876+0000","last_fullsized":"2023-06-09T04:41:01.281876+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:47:43.574984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.440099+0000","last_change":"2023-06-09T04:40:56.316852+0000","last_active":"2023-06-09T04:41:01.440099+0000","last_peered":"2023-06-09T04:41:01.440099+0000","last_clean":"2023-06-09T04:41:01.440099+0000","last_became_active":"2023-06-09T04:40:56.315795+0000","last_became_peered":"2023-06-09T04:40:56.315795+0000","last_unstale":"2023-06-09T04:41:01.440099+0000","last_undegraded":"2023-06-09T04:41:01.440099+0000","last_fullsized":"2023-06-09T04:41:01.440099+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:04:19.125206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.436964+0000","last_change":"2023-06-09T04:41:00.815347+0000","last_active":"2023-06-09T04:41:01.436964+0000","last_peered":"2023-06-09T04:41:01.436964+0000","last_clean":"2023-06-09T04:41:01.436964+0000","last_became_active":"2023-06-09T04:41:00.814876+0000","last_became_peered":"2023-06-09T04:41:00.814876+0000","last_unstale":"2023-06-09T04:41:01.436964+0000","last_undegraded":"2023-06-09T04:41:01.436964+0000","last_fullsized":"2023-06-09T04:41:01.436964+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:29:48.861218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.286021+0000","last_change":"2023-06-09T04:40:56.797164+0000","last_active":"2023-06-09T04:41:01.286021+0000","last_peered":"2023-06-09T04:41:01.286021+0000","last_clean":"2023-06-09T04:41:01.286021+0000","last_became_active":"2023-06-09T04:40:56.796793+0000","last_became_peered":"2023-06-09T04:40:56.796793+0000","last_unstale":"2023-06-09T04:41:01.286021+0000","last_undegraded":"2023-06-09T04:41:01.286021+0000","last_fullsized":"2023-06-09T04:41:01.286021+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:22:00.092692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.439725+0000","last_change":"2023-06-09T04:40:56.319708+0000","last_active":"2023-06-09T04:41:01.439725+0000","last_peered":"2023-06-09T04:41:01.439725+0000","last_clean":"2023-06-09T04:41:01.439725+0000","last_became_active":"2023-06-09T04:40:56.319239+0000","last_became_peered":"2023-06-09T04:40:56.319239+0000","last_unstale":"2023-06-09T04:41:01.439725+0000","last_undegraded":"2023-06-09T04:41:01.439725+0000","last_fullsized":"2023-06-09T04:41:01.439725+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:59:56.484281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.437517+0000","last_change":"2023-06-09T04:41:00.830023+0000","last_active":"2023-06-09T04:41:01.437517+0000","last_peered":"2023-06-09T04:41:01.437517+0000","last_clean":"2023-06-09T04:41:01.437517+0000","last_became_active":"2023-06-09T04:41:00.829628+0000","last_became_peered":"2023-06-09T04:41:00.829628+0000","last_unstale":"2023-06-09T04:41:01.437517+0000","last_undegraded":"2023-06-09T04:41:01.437517+0000","last_fullsized":"2023-06-09T04:41:01.437517+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:11:01.800202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.285365+0000","last_change":"2023-06-09T04:40:56.802232+0000","last_active":"2023-06-09T04:41:01.285365+0000","last_peered":"2023-06-09T04:41:01.285365+0000","last_clean":"2023-06-09T04:41:01.285365+0000","last_became_active":"2023-06-09T04:40:56.798647+0000","last_became_peered":"2023-06-09T04:40:56.798647+0000","last_unstale":"2023-06-09T04:41:01.285365+0000","last_undegraded":"2023-06-09T04:41:01.285365+0000","last_fullsized":"2023-06-09T04:41:01.285365+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:15:13.824668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.439375+0000","last_change":"2023-06-09T04:40:56.312886+0000","last_active":"2023-06-09T04:41:01.439375+0000","last_peered":"2023-06-09T04:41:01.439375+0000","last_clean":"2023-06-09T04:41:01.439375+0000","last_became_active":"2023-06-09T04:40:56.312638+0000","last_became_peered":"2023-06-09T04:40:56.312638+0000","last_unstale":"2023-06-09T04:41:01.439375+0000","last_undegraded":"2023-06-09T04:41:01.439375+0000","last_fullsized":"2023-06-09T04:41:01.439375+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:05:48.145750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.436906+0000","last_change":"2023-06-09T04:41:00.837079+0000","last_active":"2023-06-09T04:41:01.436906+0000","last_peered":"2023-06-09T04:41:01.436906+0000","last_clean":"2023-06-09T04:41:01.436906+0000","last_became_active":"2023-06-09T04:41:00.836636+0000","last_became_peered":"2023-06-09T04:41:00.836636+0000","last_unstale":"2023-06-09T04:41:01.436906+0000","last_undegraded":"2023-06-09T04:41:01.436906+0000","last_fullsized":"2023-06-09T04:41:01.436906+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:18:24.073415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.438685+0000","last_change":"2023-06-09T04:40:56.802193+0000","last_active":"2023-06-09T04:41:01.438685+0000","last_peered":"2023-06-09T04:41:01.438685+0000","last_clean":"2023-06-09T04:41:01.438685+0000","last_became_active":"2023-06-09T04:40:56.801743+0000","last_became_peered":"2023-06-09T04:40:56.801743+0000","last_unstale":"2023-06-09T04:41:01.438685+0000","last_undegraded":"2023-06-09T04:41:01.438685+0000","last_fullsized":"2023-06-09T04:41:01.438685+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:26:52.030740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.440193+0000","last_change":"2023-06-09T04:40:56.310010+0000","last_active":"2023-06-09T04:41:01.440193+0000","last_peered":"2023-06-09T04:41:01.440193+0000","last_clean":"2023-06-09T04:41:01.440193+0000","last_became_active":"2023-06-09T04:40:56.309735+0000","last_became_peered":"2023-06-09T04:40:56.309735+0000","last_unstale":"2023-06-09T04:41:01.440193+0000","last_undegraded":"2023-06-09T04:41:01.440193+0000","last_fullsized":"2023-06-09T04:41:01.440193+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:39:14.790353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.439938+0000","last_change":"2023-06-09T04:41:00.831076+0000","last_active":"2023-06-09T04:41:01.439938+0000","last_peered":"2023-06-09T04:41:01.439938+0000","last_clean":"2023-06-09T04:41:01.439938+0000","last_became_active":"2023-06-09T04:41:00.828763+0000","last_became_peered":"2023-06-09T04:41:00.828763+0000","last_unstale":"2023-06-09T04:41:01.439938+0000","last_undegraded":"2023-06-09T04:41:01.439938+0000","last_fullsized":"2023-06-09T04:41:01.439938+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:24:30.332035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.440504+0000","last_change":"2023-06-09T04:41:00.839198+0000","last_active":"2023-06-09T04:41:01.440504+0000","last_peered":"2023-06-09T04:41:01.440504+0000","last_clean":"2023-06-09T04:41:01.440504+0000","last_became_active":"2023-06-09T04:41:00.838883+0000","last_became_peered":"2023-06-09T04:41:00.838883+0000","last_unstale":"2023-06-09T04:41:01.440504+0000","last_undegraded":"2023-06-09T04:41:01.440504+0000","last_fullsized":"2023-06-09T04:41:01.440504+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:25:29.799849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.285514+0000","last_change":"2023-06-09T04:40:56.314061+0000","last_active":"2023-06-09T04:41:01.285514+0000","last_peered":"2023-06-09T04:41:01.285514+0000","last_clean":"2023-06-09T04:41:01.285514+0000","last_became_active":"2023-06-09T04:40:56.313675+0000","last_became_peered":"2023-06-09T04:40:56.313675+0000","last_unstale":"2023-06-09T04:41:01.285514+0000","last_undegraded":"2023-06-09T04:41:01.285514+0000","last_fullsized":"2023-06-09T04:41:01.285514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:05:35.369565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.438564+0000","last_change":"2023-06-09T04:40:56.803235+0000","last_active":"2023-06-09T04:41:01.438564+0000","last_peered":"2023-06-09T04:41:01.438564+0000","last_clean":"2023-06-09T04:41:01.438564+0000","last_became_active":"2023-06-09T04:40:56.802719+0000","last_became_peered":"2023-06-09T04:40:56.802719+0000","last_unstale":"2023-06-09T04:41:01.438564+0000","last_undegraded":"2023-06-09T04:41:01.438564+0000","last_fullsized":"2023-06-09T04:41:01.438564+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:13:35.241848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.438353+0000","last_change":"2023-06-09T04:41:00.824712+0000","last_active":"2023-06-09T04:41:01.438353+0000","last_peered":"2023-06-09T04:41:01.438353+0000","last_clean":"2023-06-09T04:41:01.438353+0000","last_became_active":"2023-06-09T04:41:00.824247+0000","last_became_peered":"2023-06-09T04:41:00.824247+0000","last_unstale":"2023-06-09T04:41:01.438353+0000","last_undegraded":"2023-06-09T04:41:01.438353+0000","last_fullsized":"2023-06-09T04:41:01.438353+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:10:26.089852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.438867+0000","last_change":"2023-06-09T04:40:56.318818+0000","last_active":"2023-06-09T04:41:01.438867+0000","last_peered":"2023-06-09T04:41:01.438867+0000","last_clean":"2023-06-09T04:41:01.438867+0000","last_became_active":"2023-06-09T04:40:56.318430+0000","last_became_peered":"2023-06-09T04:40:56.318430+0000","last_unstale":"2023-06-09T04:41:01.438867+0000","last_undegraded":"2023-06-09T04:41:01.438867+0000","last_fullsized":"2023-06-09T04:41:01.438867+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:14:30.287562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.282910+0000","last_change":"2023-06-09T04:40:56.804430+0000","last_active":"2023-06-09T04:41:01.282910+0000","last_peered":"2023-06-09T04:41:01.282910+0000","last_clean":"2023-06-09T04:41:01.282910+0000","last_became_active":"2023-06-09T04:40:56.804135+0000","last_became_peered":"2023-06-09T04:40:56.804135+0000","last_unstale":"2023-06-09T04:41:01.282910+0000","last_undegraded":"2023-06-09T04:41:01.282910+0000","last_fullsized":"2023-06-09T04:41:01.282910+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:04:45.938545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.281917+0000","last_change":"2023-06-09T04:40:56.311175+0000","last_active":"2023-06-09T04:41:01.281917+0000","last_peered":"2023-06-09T04:41:01.281917+0000","last_clean":"2023-06-09T04:41:01.281917+0000","last_became_active":"2023-06-09T04:40:56.310829+0000","last_became_peered":"2023-06-09T04:40:56.310829+0000","last_unstale":"2023-06-09T04:41:01.281917+0000","last_undegraded":"2023-06-09T04:41:01.281917+0000","last_fullsized":"2023-06-09T04:41:01.281917+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:20:18.690413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.439450+0000","last_change":"2023-06-09T04:40:56.809473+0000","last_active":"2023-06-09T04:41:01.439450+0000","last_peered":"2023-06-09T04:41:01.439450+0000","last_clean":"2023-06-09T04:41:01.439450+0000","last_became_active":"2023-06-09T04:40:56.809181+0000","last_became_peered":"2023-06-09T04:40:56.809181+0000","last_unstale":"2023-06-09T04:41:01.439450+0000","last_undegraded":"2023-06-09T04:41:01.439450+0000","last_fullsized":"2023-06-09T04:41:01.439450+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:05:54.167533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.437947+0000","last_change":"2023-06-09T04:41:00.827111+0000","last_active":"2023-06-09T04:41:01.437947+0000","last_peered":"2023-06-09T04:41:01.437947+0000","last_clean":"2023-06-09T04:41:01.437947+0000","last_became_active":"2023-06-09T04:41:00.826707+0000","last_became_peered":"2023-06-09T04:41:00.826707+0000","last_unstale":"2023-06-09T04:41:01.437947+0000","last_undegraded":"2023-06-09T04:41:01.437947+0000","last_fullsized":"2023-06-09T04:41:01.437947+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:24:30.332035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.438574+0000","last_change":"2023-06-09T04:40:56.318716+0000","last_active":"2023-06-09T04:41:01.438574+0000","last_peered":"2023-06-09T04:41:01.438574+0000","last_clean":"2023-06-09T04:41:01.438574+0000","last_became_active":"2023-06-09T04:40:56.318415+0000","last_became_peered":"2023-06-09T04:40:56.318415+0000","last_unstale":"2023-06-09T04:41:01.438574+0000","last_undegraded":"2023-06-09T04:41:01.438574+0000","last_fullsized":"2023-06-09T04:41:01.438574+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:25:25.277964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.438243+0000","last_change":"2023-06-09T04:40:56.795369+0000","last_active":"2023-06-09T04:41:01.438243+0000","last_peered":"2023-06-09T04:41:01.438243+0000","last_clean":"2023-06-09T04:41:01.438243+0000","last_became_active":"2023-06-09T04:40:56.794885+0000","last_became_peered":"2023-06-09T04:40:56.794885+0000","last_unstale":"2023-06-09T04:41:01.438243+0000","last_undegraded":"2023-06-09T04:41:01.438243+0000","last_fullsized":"2023-06-09T04:41:01.438243+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:58:56.783205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.439095+0000","last_change":"2023-06-09T04:41:00.839070+0000","last_active":"2023-06-09T04:41:01.439095+0000","last_peered":"2023-06-09T04:41:01.439095+0000","last_clean":"2023-06-09T04:41:01.439095+0000","last_became_active":"2023-06-09T04:41:00.838603+0000","last_became_peered":"2023-06-09T04:41:00.838603+0000","last_unstale":"2023-06-09T04:41:01.439095+0000","last_undegraded":"2023-06-09T04:41:01.439095+0000","last_fullsized":"2023-06-09T04:41:01.439095+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T04:55:38.240718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.285287+0000","last_change":"2023-06-09T04:40:56.797265+0000","last_active":"2023-06-09T04:41:01.285287+0000","last_peered":"2023-06-09T04:41:01.285287+0000","last_clean":"2023-06-09T04:41:01.285287+0000","last_became_active":"2023-06-09T04:40:56.796952+0000","last_became_peered":"2023-06-09T04:40:56.796952+0000","last_unstale":"2023-06-09T04:41:01.285287+0000","last_undegraded":"2023-06-09T04:41:01.285287+0000","last_fullsized":"2023-06-09T04:41:01.285287+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:48:55.767412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.436310+0000","last_change":"2023-06-09T04:40:56.797095+0000","last_active":"2023-06-09T04:41:01.436310+0000","last_peered":"2023-06-09T04:41:01.436310+0000","last_clean":"2023-06-09T04:41:01.436310+0000","last_became_active":"2023-06-09T04:40:56.796589+0000","last_became_peered":"2023-06-09T04:40:56.796589+0000","last_unstale":"2023-06-09T04:41:01.436310+0000","last_undegraded":"2023-06-09T04:41:01.436310+0000","last_fullsized":"2023-06-09T04:41:01.436310+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:14:31.300275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.285463+0000","last_change":"2023-06-09T04:40:56.798590+0000","last_active":"2023-06-09T04:41:01.285463+0000","last_peered":"2023-06-09T04:41:01.285463+0000","last_clean":"2023-06-09T04:41:01.285463+0000","last_became_active":"2023-06-09T04:40:56.798170+0000","last_became_peered":"2023-06-09T04:40:56.798170+0000","last_unstale":"2023-06-09T04:41:01.285463+0000","last_undegraded":"2023-06-09T04:41:01.285463+0000","last_fullsized":"2023-06-09T04:41:01.285463+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:17:30.494237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.437846+0000","last_change":"2023-06-09T04:40:56.801414+0000","last_active":"2023-06-09T04:41:01.437846+0000","last_peered":"2023-06-09T04:41:01.437846+0000","last_clean":"2023-06-09T04:41:01.437846+0000","last_became_active":"2023-06-09T04:40:56.801141+0000","last_became_peered":"2023-06-09T04:40:56.801141+0000","last_unstale":"2023-06-09T04:41:01.437846+0000","last_undegraded":"2023-06-09T04:41:01.437846+0000","last_fullsized":"2023-06-09T04:41:01.437846+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:14:31.588540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.423026+0000","last_change":"2023-06-09T04:40:56.800046+0000","last_active":"2023-06-09T04:41:01.423026+0000","last_peered":"2023-06-09T04:41:01.423026+0000","last_clean":"2023-06-09T04:41:01.423026+0000","last_became_active":"2023-06-09T04:40:56.798966+0000","last_became_peered":"2023-06-09T04:40:56.798966+0000","last_unstale":"2023-06-09T04:41:01.423026+0000","last_undegraded":"2023-06-09T04:41:01.423026+0000","last_fullsized":"2023-06-09T04:41:01.423026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:06:43.179689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.439250+0000","last_change":"2023-06-09T04:40:56.809685+0000","last_active":"2023-06-09T04:41:01.439250+0000","last_peered":"2023-06-09T04:41:01.439250+0000","last_clean":"2023-06-09T04:41:01.439250+0000","last_became_active":"2023-06-09T04:40:56.809312+0000","last_became_peered":"2023-06-09T04:40:56.809312+0000","last_unstale":"2023-06-09T04:41:01.439250+0000","last_undegraded":"2023-06-09T04:41:01.439250+0000","last_fullsized":"2023-06-09T04:41:01.439250+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:17:07.126456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.423063+0000","last_change":"2023-06-09T04:40:56.795763+0000","last_active":"2023-06-09T04:41:01.423063+0000","last_peered":"2023-06-09T04:41:01.423063+0000","last_clean":"2023-06-09T04:41:01.423063+0000","last_became_active":"2023-06-09T04:40:56.795456+0000","last_became_peered":"2023-06-09T04:40:56.795456+0000","last_unstale":"2023-06-09T04:41:01.423063+0000","last_undegraded":"2023-06-09T04:41:01.423063+0000","last_fullsized":"2023-06-09T04:41:01.423063+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:14:31.300275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.423520+0000","last_change":"2023-06-09T04:40:56.801907+0000","last_active":"2023-06-09T04:41:01.423520+0000","last_peered":"2023-06-09T04:41:01.423520+0000","last_clean":"2023-06-09T04:41:01.423520+0000","last_became_active":"2023-06-09T04:40:56.801549+0000","last_became_peered":"2023-06-09T04:40:56.801549+0000","last_unstale":"2023-06-09T04:41:01.423520+0000","last_undegraded":"2023-06-09T04:41:01.423520+0000","last_fullsized":"2023-06-09T04:41:01.423520+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:05:49.158462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.439471+0000","last_change":"2023-06-09T04:40:56.807671+0000","last_active":"2023-06-09T04:41:01.439471+0000","last_peered":"2023-06-09T04:41:01.439471+0000","last_clean":"2023-06-09T04:41:01.439471+0000","last_became_active":"2023-06-09T04:40:56.807340+0000","last_became_peered":"2023-06-09T04:40:56.807340+0000","last_unstale":"2023-06-09T04:41:01.439471+0000","last_undegraded":"2023-06-09T04:41:01.439471+0000","last_fullsized":"2023-06-09T04:41:01.439471+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:08:06.202323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.436226+0000","last_change":"2023-06-09T04:40:56.788625+0000","last_active":"2023-06-09T04:41:01.436226+0000","last_peered":"2023-06-09T04:41:01.436226+0000","last_clean":"2023-06-09T04:41:01.436226+0000","last_became_active":"2023-06-09T04:40:56.787863+0000","last_became_peered":"2023-06-09T04:40:56.787863+0000","last_unstale":"2023-06-09T04:41:01.436226+0000","last_undegraded":"2023-06-09T04:41:01.436226+0000","last_fullsized":"2023-06-09T04:41:01.436226+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:25:26.290677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.281831+0000","last_change":"2023-06-09T04:40:56.790021+0000","last_active":"2023-06-09T04:41:01.281831+0000","last_peered":"2023-06-09T04:41:01.281831+0000","last_clean":"2023-06-09T04:41:01.281831+0000","last_became_active":"2023-06-09T04:40:56.789701+0000","last_became_peered":"2023-06-09T04:40:56.789701+0000","last_unstale":"2023-06-09T04:41:01.281831+0000","last_undegraded":"2023-06-09T04:41:01.281831+0000","last_fullsized":"2023-06-09T04:41:01.281831+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:12:30.842536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.438484+0000","last_change":"2023-06-09T04:40:56.808367+0000","last_active":"2023-06-09T04:41:01.438484+0000","last_peered":"2023-06-09T04:41:01.438484+0000","last_clean":"2023-06-09T04:41:01.438484+0000","last_became_active":"2023-06-09T04:40:56.807817+0000","last_became_peered":"2023-06-09T04:40:56.807817+0000","last_unstale":"2023-06-09T04:41:01.438484+0000","last_undegraded":"2023-06-09T04:41:01.438484+0000","last_fullsized":"2023-06-09T04:41:01.438484+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:24:26.488078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.285269+0000","last_change":"2023-06-09T04:40:56.790891+0000","last_active":"2023-06-09T04:41:01.285269+0000","last_peered":"2023-06-09T04:41:01.285269+0000","last_clean":"2023-06-09T04:41:01.285269+0000","last_became_active":"2023-06-09T04:40:56.790633+0000","last_became_peered":"2023-06-09T04:40:56.790633+0000","last_unstale":"2023-06-09T04:41:01.285269+0000","last_undegraded":"2023-06-09T04:41:01.285269+0000","last_fullsized":"2023-06-09T04:41:01.285269+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:40:36.160469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.437785+0000","last_change":"2023-06-09T04:40:56.806490+0000","last_active":"2023-06-09T04:41:01.437785+0000","last_peered":"2023-06-09T04:41:01.437785+0000","last_clean":"2023-06-09T04:41:01.437785+0000","last_became_active":"2023-06-09T04:40:56.806147+0000","last_became_peered":"2023-06-09T04:40:56.806147+0000","last_unstale":"2023-06-09T04:41:01.437785+0000","last_undegraded":"2023-06-09T04:41:01.437785+0000","last_fullsized":"2023-06-09T04:41:01.437785+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:26:06.240424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.287737+0000","last_change":"2023-06-09T04:40:56.797924+0000","last_active":"2023-06-09T04:41:01.287737+0000","last_peered":"2023-06-09T04:41:01.287737+0000","last_clean":"2023-06-09T04:41:01.287737+0000","last_became_active":"2023-06-09T04:40:56.794834+0000","last_became_peered":"2023-06-09T04:40:56.794834+0000","last_unstale":"2023-06-09T04:41:01.287737+0000","last_undegraded":"2023-06-09T04:41:01.287737+0000","last_fullsized":"2023-06-09T04:41:01.287737+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:14:40.902021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.283050+0000","last_change":"2023-06-09T04:40:56.792333+0000","last_active":"2023-06-09T04:41:01.283050+0000","last_peered":"2023-06-09T04:41:01.283050+0000","last_clean":"2023-06-09T04:41:01.283050+0000","last_became_active":"2023-06-09T04:40:56.791978+0000","last_became_peered":"2023-06-09T04:40:56.791978+0000","last_unstale":"2023-06-09T04:41:01.283050+0000","last_undegraded":"2023-06-09T04:41:01.283050+0000","last_fullsized":"2023-06-09T04:41:01.283050+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:05:49.158462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.284964+0000","last_change":"2023-06-09T04:40:56.803527+0000","last_active":"2023-06-09T04:41:01.284964+0000","last_peered":"2023-06-09T04:41:01.284964+0000","last_clean":"2023-06-09T04:41:01.284964+0000","last_became_active":"2023-06-09T04:40:56.798138+0000","last_became_peered":"2023-06-09T04:40:56.798138+0000","last_unstale":"2023-06-09T04:41:01.284964+0000","last_undegraded":"2023-06-09T04:41:01.284964+0000","last_fullsized":"2023-06-09T04:41:01.284964+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:50:19.031791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.438636+0000","last_change":"2023-06-09T04:40:56.808104+0000","last_active":"2023-06-09T04:41:01.438636+0000","last_peered":"2023-06-09T04:41:01.438636+0000","last_clean":"2023-06-09T04:41:01.438636+0000","last_became_active":"2023-06-09T04:40:56.807785+0000","last_became_peered":"2023-06-09T04:40:56.807785+0000","last_unstale":"2023-06-09T04:41:01.438636+0000","last_undegraded":"2023-06-09T04:41:01.438636+0000","last_fullsized":"2023-06-09T04:41:01.438636+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:06:43.179689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.439453+0000","last_change":"2023-06-09T04:40:56.793787+0000","last_active":"2023-06-09T04:41:01.439453+0000","last_peered":"2023-06-09T04:41:01.439453+0000","last_clean":"2023-06-09T04:41:01.439453+0000","last_became_active":"2023-06-09T04:40:56.793480+0000","last_became_peered":"2023-06-09T04:40:56.793480+0000","last_unstale":"2023-06-09T04:41:01.439453+0000","last_undegraded":"2023-06-09T04:41:01.439453+0000","last_fullsized":"2023-06-09T04:41:01.439453+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:12:06.677526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.437720+0000","last_change":"2023-06-09T04:40:56.791804+0000","last_active":"2023-06-09T04:41:01.437720+0000","last_peered":"2023-06-09T04:41:01.437720+0000","last_clean":"2023-06-09T04:41:01.437720+0000","last_became_active":"2023-06-09T04:40:56.791541+0000","last_became_peered":"2023-06-09T04:40:56.791541+0000","last_unstale":"2023-06-09T04:41:01.437720+0000","last_undegraded":"2023-06-09T04:41:01.437720+0000","last_fullsized":"2023-06-09T04:41:01.437720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:23:01.827954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.437398+0000","last_change":"2023-06-09T04:40:56.813222+0000","last_active":"2023-06-09T04:41:01.437398+0000","last_peered":"2023-06-09T04:41:01.437398+0000","last_clean":"2023-06-09T04:41:01.437398+0000","last_became_active":"2023-06-09T04:40:56.812972+0000","last_became_peered":"2023-06-09T04:40:56.812972+0000","last_unstale":"2023-06-09T04:41:01.437398+0000","last_undegraded":"2023-06-09T04:41:01.437398+0000","last_fullsized":"2023-06-09T04:41:01.437398+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:43:09.121493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.286724+0000","last_change":"2023-06-09T04:40:56.803077+0000","last_active":"2023-06-09T04:41:01.286724+0000","last_peered":"2023-06-09T04:41:01.286724+0000","last_clean":"2023-06-09T04:41:01.286724+0000","last_became_active":"2023-06-09T04:40:56.802630+0000","last_became_peered":"2023-06-09T04:40:56.802630+0000","last_unstale":"2023-06-09T04:41:01.286724+0000","last_undegraded":"2023-06-09T04:41:01.286724+0000","last_fullsized":"2023-06-09T04:41:01.286724+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:33:17.724459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.440343+0000","last_change":"2023-06-09T04:40:56.795612+0000","last_active":"2023-06-09T04:41:01.440343+0000","last_peered":"2023-06-09T04:41:01.440343+0000","last_clean":"2023-06-09T04:41:01.440343+0000","last_became_active":"2023-06-09T04:40:56.795372+0000","last_became_peered":"2023-06-09T04:40:56.795372+0000","last_unstale":"2023-06-09T04:41:01.440343+0000","last_undegraded":"2023-06-09T04:41:01.440343+0000","last_fullsized":"2023-06-09T04:41:01.440343+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:57:29.499998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.282852+0000","last_change":"2023-06-09T04:40:56.805170+0000","last_active":"2023-06-09T04:41:01.282852+0000","last_peered":"2023-06-09T04:41:01.282852+0000","last_clean":"2023-06-09T04:41:01.282852+0000","last_became_active":"2023-06-09T04:40:56.804824+0000","last_became_peered":"2023-06-09T04:40:56.804824+0000","last_unstale":"2023-06-09T04:41:01.282852+0000","last_undegraded":"2023-06-09T04:41:01.282852+0000","last_fullsized":"2023-06-09T04:41:01.282852+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:14:31.300275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.438522+0000","last_change":"2023-06-09T04:40:56.815327+0000","last_active":"2023-06-09T04:41:01.438522+0000","last_peered":"2023-06-09T04:41:01.438522+0000","last_clean":"2023-06-09T04:41:01.438522+0000","last_became_active":"2023-06-09T04:40:56.815047+0000","last_became_peered":"2023-06-09T04:40:56.815047+0000","last_unstale":"2023-06-09T04:41:01.438522+0000","last_undegraded":"2023-06-09T04:41:01.438522+0000","last_fullsized":"2023-06-09T04:41:01.438522+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:25:21.467588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.438388+0000","last_change":"2023-06-09T04:40:56.808036+0000","last_active":"2023-06-09T04:41:01.438388+0000","last_peered":"2023-06-09T04:41:01.438388+0000","last_clean":"2023-06-09T04:41:01.438388+0000","last_became_active":"2023-06-09T04:40:56.807413+0000","last_became_peered":"2023-06-09T04:40:56.807413+0000","last_unstale":"2023-06-09T04:41:01.438388+0000","last_undegraded":"2023-06-09T04:41:01.438388+0000","last_fullsized":"2023-06-09T04:41:01.438388+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:57:29.499998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.284773+0000","last_change":"2023-06-09T04:40:56.802358+0000","last_active":"2023-06-09T04:41:01.284773+0000","last_peered":"2023-06-09T04:41:01.284773+0000","last_clean":"2023-06-09T04:41:01.284773+0000","last_became_active":"2023-06-09T04:40:56.798262+0000","last_became_peered":"2023-06-09T04:40:56.798262+0000","last_unstale":"2023-06-09T04:41:01.284773+0000","last_undegraded":"2023-06-09T04:41:01.284773+0000","last_fullsized":"2023-06-09T04:41:01.284773+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:44:45.646471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.282293+0000","last_change":"2023-06-09T04:40:56.805149+0000","last_active":"2023-06-09T04:41:01.282293+0000","last_peered":"2023-06-09T04:41:01.282293+0000","last_clean":"2023-06-09T04:41:01.282293+0000","last_became_active":"2023-06-09T04:40:56.804797+0000","last_became_peered":"2023-06-09T04:40:56.804797+0000","last_unstale":"2023-06-09T04:41:01.282293+0000","last_undegraded":"2023-06-09T04:41:01.282293+0000","last_fullsized":"2023-06-09T04:41:01.282293+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:13:45.572440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.287725+0000","last_change":"2023-06-09T04:40:56.798569+0000","last_active":"2023-06-09T04:41:01.287725+0000","last_peered":"2023-06-09T04:41:01.287725+0000","last_clean":"2023-06-09T04:41:01.287725+0000","last_became_active":"2023-06-09T04:40:56.792897+0000","last_became_peered":"2023-06-09T04:40:56.792897+0000","last_unstale":"2023-06-09T04:41:01.287725+0000","last_undegraded":"2023-06-09T04:41:01.287725+0000","last_fullsized":"2023-06-09T04:41:01.287725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:52:36.991160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.286606+0000","last_change":"2023-06-09T04:40:56.803260+0000","last_active":"2023-06-09T04:41:01.286606+0000","last_peered":"2023-06-09T04:41:01.286606+0000","last_clean":"2023-06-09T04:41:01.286606+0000","last_became_active":"2023-06-09T04:40:56.802966+0000","last_became_peered":"2023-06-09T04:40:56.802966+0000","last_unstale":"2023-06-09T04:41:01.286606+0000","last_undegraded":"2023-06-09T04:41:01.286606+0000","last_fullsized":"2023-06-09T04:41:01.286606+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:02:53.168915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.440235+0000","last_change":"2023-06-09T04:40:56.815725+0000","last_active":"2023-06-09T04:41:01.440235+0000","last_peered":"2023-06-09T04:41:01.440235+0000","last_clean":"2023-06-09T04:41:01.440235+0000","last_became_active":"2023-06-09T04:40:56.815369+0000","last_became_peered":"2023-06-09T04:40:56.815369+0000","last_unstale":"2023-06-09T04:41:01.440235+0000","last_undegraded":"2023-06-09T04:41:01.440235+0000","last_fullsized":"2023-06-09T04:41:01.440235+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:13:45.572440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.438161+0000","last_change":"2023-06-09T04:40:56.791652+0000","last_active":"2023-06-09T04:41:01.438161+0000","last_peered":"2023-06-09T04:41:01.438161+0000","last_clean":"2023-06-09T04:41:01.438161+0000","last_became_active":"2023-06-09T04:40:56.791358+0000","last_became_peered":"2023-06-09T04:40:56.791358+0000","last_unstale":"2023-06-09T04:41:01.438161+0000","last_undegraded":"2023-06-09T04:41:01.438161+0000","last_fullsized":"2023-06-09T04:41:01.438161+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:18:56.081370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4591,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":904,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":925696,"data_stored":718949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4379999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.504}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.391}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.181}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.621}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.587}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8220000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":303104,"data_stored":124572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2070000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.252}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0089999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.222}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0429999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":311296,"data_stored":125224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4730000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.173}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.417}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.125}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.534}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3109999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0609999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":323584,"data_stored":128421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.252}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2849999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2150000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.409}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.109}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3109999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":307200,"data_stored":124662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93500000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.415}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4790000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3560000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":303104,"data_stored":124572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2509999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.173}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2070000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.405}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":303104,"data_stored":124572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2350000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4830000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5780000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8080000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6519999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":901120,"data_stored":715522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2969999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.117}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.528}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.147}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.462}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3580000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-09T04:41:24.706 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-09T04:41:24.917 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.912+0000 7f693a491700 1 Processor -- start 2023-06-09T04:41:24.918 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.912+0000 7f693a491700 1 -- start start 2023-06-09T04:41:24.921 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.916+0000 7f693a491700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f693415ff70 0x7f69340c9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:24.921 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.916+0000 7f693a491700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6934160340 0x7f69340caa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:24.921 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.916+0000 7f693a491700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f69340ca210 0x7f69340caf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:24.922 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.916+0000 7f693a491700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69340cdc20 con 0x7f69340ca210 2023-06-09T04:41:24.922 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.916+0000 7f693a491700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69340cd330 con 0x7f693415ff70 2023-06-09T04:41:24.922 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.916+0000 7f693a491700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69340cd5d0 con 0x7f6934160340 2023-06-09T04:41:24.922 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.916+0000 7f6939c90700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f69340ca210 0x7f69340caf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:24.923 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.916+0000 7f693948f700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f693415ff70 0x7f69340c9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:24.923 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.916+0000 7f6939c90700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f69340ca210 0x7f69340caf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40244/0 (socket says 172.21.15.62:40244) 2023-06-09T04:41:24.923 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.916+0000 7f6938c8e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6934160340 0x7f69340caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:24.923 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.916+0000 7f6939c90700 1 -- 172.21.15.62:0/2321258367 learned_addr learned my addr 172.21.15.62:0/2321258367 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:24.924 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.920+0000 7f6938c8e700 1 -- 172.21.15.62:0/2321258367 >> v2:172.21.15.89:3300/0 conn(0x7f693415ff70 msgr2=0x7f69340c9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:24.924 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.920+0000 7f6938c8e700 1 --2- 172.21.15.62:0/2321258367 >> v2:172.21.15.89:3300/0 conn(0x7f693415ff70 0x7f69340c9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:24.924 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.920+0000 7f6938c8e700 1 -- 172.21.15.62:0/2321258367 >> v2:172.21.15.62:3300/0 conn(0x7f69340ca210 msgr2=0x7f69340caf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:24.924 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.920+0000 7f6938c8e700 1 --2- 172.21.15.62:0/2321258367 >> v2:172.21.15.62:3300/0 conn(0x7f69340ca210 0x7f69340caf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:24.924 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.920+0000 7f6938c8e700 1 -- 172.21.15.62:0/2321258367 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69340cd8b0 con 0x7f6934160340 2023-06-09T04:41:24.925 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.920+0000 7f6938c8e700 1 --2- 172.21.15.62:0/2321258367 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6934160340 0x7f69340caa40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6934071bd0 tx=0x7f6924009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8501de1ce7351db6 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:24.925 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.920+0000 7f692bfff700 1 -- 172.21.15.62:0/2321258367 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6924011830 con 0x7f6934160340 2023-06-09T04:41:24.925 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.920+0000 7f692bfff700 1 -- 172.21.15.62:0/2321258367 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6924011990 con 0x7f6934160340 2023-06-09T04:41:24.925 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.920+0000 7f692bfff700 1 -- 172.21.15.62:0/2321258367 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6924011d20 con 0x7f6934160340 2023-06-09T04:41:24.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.920+0000 7f693a491700 1 -- 172.21.15.62:0/2321258367 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6934160340 msgr2=0x7f69340caa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:24.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.920+0000 7f693a491700 1 --2- 172.21.15.62:0/2321258367 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6934160340 0x7f69340caa40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6934071bd0 tx=0x7f6924009b30 comp rx=0 tx=0).stop 2023-06-09T04:41:24.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.920+0000 7f693a491700 1 -- 172.21.15.62:0/2321258367 shutdown_connections 2023-06-09T04:41:24.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.920+0000 7f693a491700 1 --2- 172.21.15.62:0/2321258367 >> v2:172.21.15.62:3300/0 conn(0x7f69340ca210 0x7f69340caf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:24.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.920+0000 7f693a491700 1 --2- 172.21.15.62:0/2321258367 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6934160340 0x7f69340caa40 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:24.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.920+0000 7f693a491700 1 --2- 172.21.15.62:0/2321258367 >> v2:172.21.15.89:3300/0 conn(0x7f693415ff70 0x7f69340c9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:24.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.920+0000 7f693a491700 1 -- 172.21.15.62:0/2321258367 >> 172.21.15.62:0/2321258367 conn(0x7f693406a420 msgr2=0x7f69340afc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:24.927 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.920+0000 7f693a491700 1 -- 172.21.15.62:0/2321258367 shutdown_connections 2023-06-09T04:41:24.927 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.920+0000 7f693a491700 1 -- 172.21.15.62:0/2321258367 wait complete. 2023-06-09T04:41:24.928 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.924+0000 7f693a491700 1 Processor -- start 2023-06-09T04:41:24.928 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.924+0000 7f693a491700 1 -- start start 2023-06-09T04:41:24.930 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.924+0000 7f693a491700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f693415ff70 0x7f6934162c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:24.930 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.924+0000 7f693a491700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6934160340 0x7f69340c51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:24.930 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.924+0000 7f693a491700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f69340c6b60 0x7f69341f8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:24.930 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.924+0000 7f693a491700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69341631c0 con 0x7f6934160340 2023-06-09T04:41:24.930 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.924+0000 7f693a491700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69340c8430 con 0x7f693415ff70 2023-06-09T04:41:24.931 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.924+0000 7f693a491700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69340c7fa0 con 0x7f69340c6b60 2023-06-09T04:41:24.931 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.924+0000 7f6938c8e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6934160340 0x7f69340c51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:24.932 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.924+0000 7f6938c8e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6934160340 0x7f69340c51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40256/0 (socket says 172.21.15.62:40256) 2023-06-09T04:41:24.932 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.924+0000 7f6938c8e700 1 -- 172.21.15.62:0/1586772366 learned_addr learned my addr 172.21.15.62:0/1586772366 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:24.932 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.924+0000 7f6939c90700 1 --2- 172.21.15.62:0/1586772366 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f69340c6b60 0x7f69341f8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:24.932 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.924+0000 7f693948f700 1 --2- 172.21.15.62:0/1586772366 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f693415ff70 0x7f6934162c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:24.932 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.928+0000 7f6938c8e700 1 -- 172.21.15.62:0/1586772366 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f69340c6b60 msgr2=0x7f69341f8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:24.932 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.928+0000 7f6938c8e700 1 --2- 172.21.15.62:0/1586772366 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f69340c6b60 0x7f69341f8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:24.932 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.928+0000 7f6938c8e700 1 -- 172.21.15.62:0/1586772366 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f693415ff70 msgr2=0x7f6934162c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:24.933 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.928+0000 7f6938c8e700 1 --2- 172.21.15.62:0/1586772366 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f693415ff70 0x7f6934162c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:24.933 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.928+0000 7f6938c8e700 1 -- 172.21.15.62:0/1586772366 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69240094b0 con 0x7f6934160340 2023-06-09T04:41:24.933 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.928+0000 7f6939c90700 1 --2- 172.21.15.62:0/1586772366 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f69340c6b60 0x7f69341f8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:41:24.933 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.928+0000 7f693948f700 1 --2- 172.21.15.62:0/1586772366 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f693415ff70 0x7f6934162c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:41:24.933 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.928+0000 7f6938c8e700 1 --2- 172.21.15.62:0/1586772366 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6934160340 0x7f69340c51b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f69240090b0 tx=0x7f6924004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:24.934 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.928+0000 7f6929ffb700 1 -- 172.21.15.62:0/1586772366 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6924004590 con 0x7f6934160340 2023-06-09T04:41:24.934 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.928+0000 7f6929ffb700 1 -- 172.21.15.62:0/1586772366 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f692401e070 con 0x7f6934160340 2023-06-09T04:41:24.934 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.928+0000 7f6929ffb700 1 -- 172.21.15.62:0/1586772366 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6924003900 con 0x7f6934160340 2023-06-09T04:41:24.934 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.928+0000 7f693a491700 1 -- 172.21.15.62:0/1586772366 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69340c56f0 con 0x7f6934160340 2023-06-09T04:41:24.934 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.928+0000 7f693a491700 1 -- 172.21.15.62:0/1586772366 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69340c7670 con 0x7f6934160340 2023-06-09T04:41:24.935 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.928+0000 7f693a491700 1 -- 172.21.15.62:0/1586772366 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69340739c0 con 0x7f6934160340 2023-06-09T04:41:24.935 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.932+0000 7f6929ffb700 1 -- 172.21.15.62:0/1586772366 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6924003a60 con 0x7f6934160340 2023-06-09T04:41:24.938 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.932+0000 7f6929ffb700 1 --2- 172.21.15.62:0/1586772366 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f69180662f0 0x7f69180687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:24.938 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.932+0000 7f6929ffb700 1 -- 172.21.15.62:0/1586772366 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6924084f20 con 0x7f6934160340 2023-06-09T04:41:24.939 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.936+0000 7f693948f700 1 --2- 172.21.15.62:0/1586772366 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f69180662f0 0x7f69180687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:24.940 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.936+0000 7f693948f700 1 --2- 172.21.15.62:0/1586772366 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f69180662f0 0x7f69180687a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6930009bc0 tx=0x7f6930008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:24.943 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:24.940+0000 7f6929ffb700 1 -- 172.21.15.62:0/1586772366 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6924052010 con 0x7f6934160340 2023-06-09T04:41:25.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.108+0000 7f693a491700 1 -- 172.21.15.62:0/1586772366 --> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f69340ca790 con 0x7f69180662f0 2023-06-09T04:41:25.129 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.124+0000 7f6929ffb700 1 -- 172.21.15.62:0/1586772366 <== mgr.4106 v2:172.21.15.89:6832/3073446405 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367086 (secure 0 0 0) 0x7f6930004030 con 0x7f69180662f0 2023-06-09T04:41:25.133 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:41:25.135 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.128+0000 7f693a491700 1 -- 172.21.15.62:0/1586772366 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f69180662f0 msgr2=0x7f69180687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:25.135 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.128+0000 7f693a491700 1 --2- 172.21.15.62:0/1586772366 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f69180662f0 0x7f69180687a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6930009bc0 tx=0x7f6930008040 comp rx=0 tx=0).stop 2023-06-09T04:41:25.135 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.128+0000 7f693a491700 1 -- 172.21.15.62:0/1586772366 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6934160340 msgr2=0x7f69340c51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:25.135 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.128+0000 7f693a491700 1 --2- 172.21.15.62:0/1586772366 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6934160340 0x7f69340c51b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f69240090b0 tx=0x7f6924004770 comp rx=0 tx=0).stop 2023-06-09T04:41:25.136 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.128+0000 7f693a491700 1 -- 172.21.15.62:0/1586772366 shutdown_connections 2023-06-09T04:41:25.136 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.128+0000 7f693a491700 1 --2- 172.21.15.62:0/1586772366 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f69180662f0 0x7f69180687a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:25.136 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.128+0000 7f693a491700 1 --2- 172.21.15.62:0/1586772366 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f69340c6b60 0x7f69341f8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:25.136 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.128+0000 7f693a491700 1 --2- 172.21.15.62:0/1586772366 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6934160340 0x7f69340c51b0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:25.136 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.128+0000 7f693a491700 1 --2- 172.21.15.62:0/1586772366 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f693415ff70 0x7f6934162c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:25.136 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.128+0000 7f693a491700 1 -- 172.21.15.62:0/1586772366 >> 172.21.15.62:0/1586772366 conn(0x7f69340ca210 msgr2=0x7f693406b880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:25.137 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.132+0000 7f693a491700 1 -- 172.21.15.62:0/1586772366 shutdown_connections 2023-06-09T04:41:25.137 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.132+0000 7f693a491700 1 -- 172.21.15.62:0/1586772366 wait complete. 2023-06-09T04:41:25.138 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2023-06-09T04:41:25.156 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2023-06-09T04:41:24.573302+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594959,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219208,"kb_used_data":3592,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755512,"statfs":{"total":773094113280,"available":772869644288,"internally_reserved":0,"allocated":3678208,"data_stored":2186494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005324"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.421613+0000","last_change":"2023-06-09T04:41:00.837443+0000","last_active":"2023-06-09T04:41:01.421613+0000","last_peered":"2023-06-09T04:41:01.421613+0000","last_clean":"2023-06-09T04:41:01.421613+0000","last_became_active":"2023-06-09T04:41:00.837056+0000","last_became_peered":"2023-06-09T04:41:00.837056+0000","last_unstale":"2023-06-09T04:41:01.421613+0000","last_undegraded":"2023-06-09T04:41:01.421613+0000","last_fullsized":"2023-06-09T04:41:01.421613+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:12:34.351708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.283099+0000","last_change":"2023-06-09T04:40:56.317710+0000","last_active":"2023-06-09T04:41:01.283099+0000","last_peered":"2023-06-09T04:41:01.283099+0000","last_clean":"2023-06-09T04:41:01.283099+0000","last_became_active":"2023-06-09T04:40:56.317367+0000","last_became_peered":"2023-06-09T04:40:56.317367+0000","last_unstale":"2023-06-09T04:41:01.283099+0000","last_undegraded":"2023-06-09T04:41:01.283099+0000","last_fullsized":"2023-06-09T04:41:01.283099+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:08:05.189610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.285106+0000","last_change":"2023-06-09T04:40:56.786880+0000","last_active":"2023-06-09T04:41:01.285106+0000","last_peered":"2023-06-09T04:41:01.285106+0000","last_clean":"2023-06-09T04:41:01.285106+0000","last_became_active":"2023-06-09T04:40:56.786577+0000","last_became_peered":"2023-06-09T04:40:56.786577+0000","last_unstale":"2023-06-09T04:41:01.285106+0000","last_undegraded":"2023-06-09T04:41:01.285106+0000","last_fullsized":"2023-06-09T04:41:01.285106+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:08:26.522608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.284846+0000","last_change":"2023-06-09T04:41:00.821962+0000","last_active":"2023-06-09T04:41:01.284846+0000","last_peered":"2023-06-09T04:41:01.284846+0000","last_clean":"2023-06-09T04:41:01.284846+0000","last_became_active":"2023-06-09T04:41:00.821590+0000","last_became_peered":"2023-06-09T04:41:00.821590+0000","last_unstale":"2023-06-09T04:41:01.284846+0000","last_undegraded":"2023-06-09T04:41:01.284846+0000","last_fullsized":"2023-06-09T04:41:01.284846+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:24:19.683717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.438875+0000","last_change":"2023-06-09T04:40:56.309042+0000","last_active":"2023-06-09T04:41:01.438875+0000","last_peered":"2023-06-09T04:41:01.438875+0000","last_clean":"2023-06-09T04:41:01.438875+0000","last_became_active":"2023-06-09T04:40:56.308672+0000","last_became_peered":"2023-06-09T04:40:56.308672+0000","last_unstale":"2023-06-09T04:41:01.438875+0000","last_undegraded":"2023-06-09T04:41:01.438875+0000","last_fullsized":"2023-06-09T04:41:01.438875+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:24:15.161832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.436648+0000","last_change":"2023-06-09T04:40:56.792828+0000","last_active":"2023-06-09T04:41:01.436648+0000","last_peered":"2023-06-09T04:41:01.436648+0000","last_clean":"2023-06-09T04:41:01.436648+0000","last_became_active":"2023-06-09T04:40:56.788328+0000","last_became_peered":"2023-06-09T04:40:56.788328+0000","last_unstale":"2023-06-09T04:41:01.436648+0000","last_undegraded":"2023-06-09T04:41:01.436648+0000","last_fullsized":"2023-06-09T04:41:01.436648+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:52:44.006009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.438852+0000","last_change":"2023-06-09T04:41:00.839470+0000","last_active":"2023-06-09T04:41:01.438852+0000","last_peered":"2023-06-09T04:41:01.438852+0000","last_clean":"2023-06-09T04:41:01.438852+0000","last_became_active":"2023-06-09T04:41:00.839052+0000","last_became_peered":"2023-06-09T04:41:00.839052+0000","last_unstale":"2023-06-09T04:41:01.438852+0000","last_undegraded":"2023-06-09T04:41:01.438852+0000","last_fullsized":"2023-06-09T04:41:01.438852+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:49:49.299980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.439510+0000","last_change":"2023-06-09T04:40:56.321454+0000","last_active":"2023-06-09T04:41:01.439510+0000","last_peered":"2023-06-09T04:41:01.439510+0000","last_clean":"2023-06-09T04:41:01.439510+0000","last_became_active":"2023-06-09T04:40:56.321031+0000","last_became_peered":"2023-06-09T04:40:56.321031+0000","last_unstale":"2023-06-09T04:41:01.439510+0000","last_undegraded":"2023-06-09T04:41:01.439510+0000","last_fullsized":"2023-06-09T04:41:01.439510+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:25:05.608273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.285103+0000","last_change":"2023-06-09T04:40:56.803877+0000","last_active":"2023-06-09T04:41:01.285103+0000","last_peered":"2023-06-09T04:41:01.285103+0000","last_clean":"2023-06-09T04:41:01.285103+0000","last_became_active":"2023-06-09T04:40:56.798582+0000","last_became_peered":"2023-06-09T04:40:56.798582+0000","last_unstale":"2023-06-09T04:41:01.285103+0000","last_undegraded":"2023-06-09T04:41:01.285103+0000","last_fullsized":"2023-06-09T04:41:01.285103+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:21:53.601425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.439153+0000","last_change":"2023-06-09T04:41:00.836245+0000","last_active":"2023-06-09T04:41:01.439153+0000","last_peered":"2023-06-09T04:41:01.439153+0000","last_clean":"2023-06-09T04:41:01.439153+0000","last_became_active":"2023-06-09T04:41:00.835686+0000","last_became_peered":"2023-06-09T04:41:00.835686+0000","last_unstale":"2023-06-09T04:41:01.439153+0000","last_undegraded":"2023-06-09T04:41:01.439153+0000","last_fullsized":"2023-06-09T04:41:01.439153+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:03:10.253378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.440020+0000","last_change":"2023-06-09T04:40:56.321489+0000","last_active":"2023-06-09T04:41:01.440020+0000","last_peered":"2023-06-09T04:41:01.440020+0000","last_clean":"2023-06-09T04:41:01.440020+0000","last_became_active":"2023-06-09T04:40:56.321100+0000","last_became_peered":"2023-06-09T04:40:56.321100+0000","last_unstale":"2023-06-09T04:41:01.440020+0000","last_undegraded":"2023-06-09T04:41:01.440020+0000","last_fullsized":"2023-06-09T04:41:01.440020+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:17:49.593978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.285507+0000","last_change":"2023-06-09T04:40:56.794715+0000","last_active":"2023-06-09T04:41:01.285507+0000","last_peered":"2023-06-09T04:41:01.285507+0000","last_clean":"2023-06-09T04:41:01.285507+0000","last_became_active":"2023-06-09T04:40:56.794493+0000","last_became_peered":"2023-06-09T04:40:56.794493+0000","last_unstale":"2023-06-09T04:41:01.285507+0000","last_undegraded":"2023-06-09T04:41:01.285507+0000","last_fullsized":"2023-06-09T04:41:01.285507+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:08:24.838920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.422791+0000","last_change":"2023-06-09T04:41:00.828797+0000","last_active":"2023-06-09T04:41:01.422791+0000","last_peered":"2023-06-09T04:41:01.422791+0000","last_clean":"2023-06-09T04:41:01.422791+0000","last_became_active":"2023-06-09T04:41:00.828438+0000","last_became_peered":"2023-06-09T04:41:00.828438+0000","last_unstale":"2023-06-09T04:41:01.422791+0000","last_undegraded":"2023-06-09T04:41:01.422791+0000","last_fullsized":"2023-06-09T04:41:01.422791+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:24:29.997250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.282480+0000","last_change":"2023-06-09T04:40:56.317253+0000","last_active":"2023-06-09T04:41:01.282480+0000","last_peered":"2023-06-09T04:41:01.282480+0000","last_clean":"2023-06-09T04:41:01.282480+0000","last_became_active":"2023-06-09T04:40:56.316877+0000","last_became_peered":"2023-06-09T04:40:56.316877+0000","last_unstale":"2023-06-09T04:41:01.282480+0000","last_undegraded":"2023-06-09T04:41:01.282480+0000","last_fullsized":"2023-06-09T04:41:01.282480+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:25:25.277964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.437522+0000","last_change":"2023-06-09T04:40:56.797830+0000","last_active":"2023-06-09T04:41:01.437522+0000","last_peered":"2023-06-09T04:41:01.437522+0000","last_clean":"2023-06-09T04:41:01.437522+0000","last_became_active":"2023-06-09T04:40:56.797556+0000","last_became_peered":"2023-06-09T04:40:56.797556+0000","last_unstale":"2023-06-09T04:41:01.437522+0000","last_undegraded":"2023-06-09T04:41:01.437522+0000","last_fullsized":"2023-06-09T04:41:01.437522+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:43:46.753266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.286268+0000","last_change":"2023-06-09T04:41:00.825865+0000","last_active":"2023-06-09T04:41:01.286268+0000","last_peered":"2023-06-09T04:41:01.286268+0000","last_clean":"2023-06-09T04:41:01.286268+0000","last_became_active":"2023-06-09T04:41:00.825477+0000","last_became_peered":"2023-06-09T04:41:00.825477+0000","last_unstale":"2023-06-09T04:41:01.286268+0000","last_undegraded":"2023-06-09T04:41:01.286268+0000","last_fullsized":"2023-06-09T04:41:01.286268+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:51:30.775136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.285644+0000","last_change":"2023-06-09T04:40:56.315320+0000","last_active":"2023-06-09T04:41:01.285644+0000","last_peered":"2023-06-09T04:41:01.285644+0000","last_clean":"2023-06-09T04:41:01.285644+0000","last_became_active":"2023-06-09T04:40:56.314967+0000","last_became_peered":"2023-06-09T04:40:56.314967+0000","last_unstale":"2023-06-09T04:41:01.285644+0000","last_undegraded":"2023-06-09T04:41:01.285644+0000","last_fullsized":"2023-06-09T04:41:01.285644+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:01:49.680802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.438480+0000","last_change":"2023-06-09T04:40:56.798062+0000","last_active":"2023-06-09T04:41:01.438480+0000","last_peered":"2023-06-09T04:41:01.438480+0000","last_clean":"2023-06-09T04:41:01.438480+0000","last_became_active":"2023-06-09T04:40:56.795892+0000","last_became_peered":"2023-06-09T04:40:56.795892+0000","last_unstale":"2023-06-09T04:41:01.438480+0000","last_undegraded":"2023-06-09T04:41:01.438480+0000","last_fullsized":"2023-06-09T04:41:01.438480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:48:05.320971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.287250+0000","last_change":"2023-06-09T04:41:00.829272+0000","last_active":"2023-06-09T04:41:01.287250+0000","last_peered":"2023-06-09T04:41:01.287250+0000","last_clean":"2023-06-09T04:41:01.287250+0000","last_became_active":"2023-06-09T04:41:00.828913+0000","last_became_peered":"2023-06-09T04:41:00.828913+0000","last_unstale":"2023-06-09T04:41:01.287250+0000","last_undegraded":"2023-06-09T04:41:01.287250+0000","last_fullsized":"2023-06-09T04:41:01.287250+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:36:54.747824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.423032+0000","last_change":"2023-06-09T04:40:56.320610+0000","last_active":"2023-06-09T04:41:01.423032+0000","last_peered":"2023-06-09T04:41:01.423032+0000","last_clean":"2023-06-09T04:41:01.423032+0000","last_became_active":"2023-06-09T04:40:56.320210+0000","last_became_peered":"2023-06-09T04:40:56.320210+0000","last_unstale":"2023-06-09T04:41:01.423032+0000","last_undegraded":"2023-06-09T04:41:01.423032+0000","last_fullsized":"2023-06-09T04:41:01.423032+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:43:30.487796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.282810+0000","last_change":"2023-06-09T04:40:56.800181+0000","last_active":"2023-06-09T04:41:01.282810+0000","last_peered":"2023-06-09T04:41:01.282810+0000","last_clean":"2023-06-09T04:41:01.282810+0000","last_became_active":"2023-06-09T04:40:56.798880+0000","last_became_peered":"2023-06-09T04:40:56.798880+0000","last_unstale":"2023-06-09T04:41:01.282810+0000","last_undegraded":"2023-06-09T04:41:01.282810+0000","last_fullsized":"2023-06-09T04:41:01.282810+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:43:31.500509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.282532+0000","last_change":"2023-06-09T04:41:00.841825+0000","last_active":"2023-06-09T04:41:01.282532+0000","last_peered":"2023-06-09T04:41:01.282532+0000","last_clean":"2023-06-09T04:41:01.282532+0000","last_became_active":"2023-06-09T04:41:00.841441+0000","last_became_peered":"2023-06-09T04:41:00.841441+0000","last_unstale":"2023-06-09T04:41:01.282532+0000","last_undegraded":"2023-06-09T04:41:01.282532+0000","last_fullsized":"2023-06-09T04:41:01.282532+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:24:29.997250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.436487+0000","last_change":"2023-06-09T04:40:56.314387+0000","last_active":"2023-06-09T04:41:01.436487+0000","last_peered":"2023-06-09T04:41:01.436487+0000","last_clean":"2023-06-09T04:41:01.436487+0000","last_became_active":"2023-06-09T04:40:56.314056+0000","last_became_peered":"2023-06-09T04:40:56.314056+0000","last_unstale":"2023-06-09T04:41:01.436487+0000","last_undegraded":"2023-06-09T04:41:01.436487+0000","last_fullsized":"2023-06-09T04:41:01.436487+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:03:05.731493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.287409+0000","last_change":"2023-06-09T04:40:56.799527+0000","last_active":"2023-06-09T04:41:01.287409+0000","last_peered":"2023-06-09T04:41:01.287409+0000","last_clean":"2023-06-09T04:41:01.287409+0000","last_became_active":"2023-06-09T04:40:56.799215+0000","last_became_peered":"2023-06-09T04:40:56.799215+0000","last_unstale":"2023-06-09T04:41:01.287409+0000","last_undegraded":"2023-06-09T04:41:01.287409+0000","last_fullsized":"2023-06-09T04:41:01.287409+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:34:05.634982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.436197+0000","last_change":"2023-06-09T04:40:56.785429+0000","last_active":"2023-06-09T04:41:01.436197+0000","last_peered":"2023-06-09T04:41:01.436197+0000","last_clean":"2023-06-09T04:41:01.436197+0000","last_became_active":"2023-06-09T04:40:56.785114+0000","last_became_peered":"2023-06-09T04:40:56.785114+0000","last_unstale":"2023-06-09T04:41:01.436197+0000","last_undegraded":"2023-06-09T04:41:01.436197+0000","last_fullsized":"2023-06-09T04:41:01.436197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:06:43.179689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.283223+0000","last_change":"2023-06-09T04:40:56.317391+0000","last_active":"2023-06-09T04:41:01.283223+0000","last_peered":"2023-06-09T04:41:01.283223+0000","last_clean":"2023-06-09T04:41:01.283223+0000","last_became_active":"2023-06-09T04:40:56.317009+0000","last_became_peered":"2023-06-09T04:40:56.317009+0000","last_unstale":"2023-06-09T04:41:01.283223+0000","last_undegraded":"2023-06-09T04:41:01.283223+0000","last_fullsized":"2023-06-09T04:41:01.283223+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:52:42.993296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.285830+0000","last_change":"2023-06-09T04:41:00.835405+0000","last_active":"2023-06-09T04:41:01.285830+0000","last_peered":"2023-06-09T04:41:01.285830+0000","last_clean":"2023-06-09T04:41:01.285830+0000","last_became_active":"2023-06-09T04:41:00.834994+0000","last_became_peered":"2023-06-09T04:41:00.834994+0000","last_unstale":"2023-06-09T04:41:01.285830+0000","last_undegraded":"2023-06-09T04:41:01.285830+0000","last_fullsized":"2023-06-09T04:41:01.285830+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:47:36.457098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.436354+0000","last_change":"2023-06-09T04:40:56.796887+0000","last_active":"2023-06-09T04:41:01.436354+0000","last_peered":"2023-06-09T04:41:01.436354+0000","last_clean":"2023-06-09T04:41:01.436354+0000","last_became_active":"2023-06-09T04:40:56.796261+0000","last_became_peered":"2023-06-09T04:40:56.796261+0000","last_unstale":"2023-06-09T04:41:01.436354+0000","last_undegraded":"2023-06-09T04:41:01.436354+0000","last_fullsized":"2023-06-09T04:41:01.436354+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:04:45.938545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.440403+0000","last_change":"2023-06-09T04:40:56.316780+0000","last_active":"2023-06-09T04:41:01.440403+0000","last_peered":"2023-06-09T04:41:01.440403+0000","last_clean":"2023-06-09T04:41:01.440403+0000","last_became_active":"2023-06-09T04:40:56.315706+0000","last_became_peered":"2023-06-09T04:40:56.315706+0000","last_unstale":"2023-06-09T04:41:01.440403+0000","last_undegraded":"2023-06-09T04:41:01.440403+0000","last_fullsized":"2023-06-09T04:41:01.440403+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:24:25.475365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.438087+0000","last_change":"2023-06-09T04:41:00.831457+0000","last_active":"2023-06-09T04:41:01.438087+0000","last_peered":"2023-06-09T04:41:01.438087+0000","last_clean":"2023-06-09T04:41:01.438087+0000","last_became_active":"2023-06-09T04:41:00.830962+0000","last_became_peered":"2023-06-09T04:41:00.830962+0000","last_unstale":"2023-06-09T04:41:01.438087+0000","last_undegraded":"2023-06-09T04:41:01.438087+0000","last_fullsized":"2023-06-09T04:41:01.438087+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:20:23.212298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.439608+0000","last_change":"2023-06-09T04:40:56.322126+0000","last_active":"2023-06-09T04:41:01.439608+0000","last_peered":"2023-06-09T04:41:01.439608+0000","last_clean":"2023-06-09T04:41:01.439608+0000","last_became_active":"2023-06-09T04:40:56.321833+0000","last_became_peered":"2023-06-09T04:40:56.321833+0000","last_unstale":"2023-06-09T04:41:01.439608+0000","last_undegraded":"2023-06-09T04:41:01.439608+0000","last_fullsized":"2023-06-09T04:41:01.439608+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:52:42.993296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.422084+0000","last_change":"2023-06-09T04:40:56.810607+0000","last_active":"2023-06-09T04:41:01.422084+0000","last_peered":"2023-06-09T04:41:01.422084+0000","last_clean":"2023-06-09T04:41:01.422084+0000","last_became_active":"2023-06-09T04:40:56.806121+0000","last_became_peered":"2023-06-09T04:40:56.806121+0000","last_unstale":"2023-06-09T04:41:01.422084+0000","last_undegraded":"2023-06-09T04:41:01.422084+0000","last_fullsized":"2023-06-09T04:41:01.422084+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:17:50.606690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.436321+0000","last_change":"2023-06-09T04:41:00.825055+0000","last_active":"2023-06-09T04:41:01.436321+0000","last_peered":"2023-06-09T04:41:01.436321+0000","last_clean":"2023-06-09T04:41:01.436321+0000","last_became_active":"2023-06-09T04:41:00.824544+0000","last_became_peered":"2023-06-09T04:41:00.824544+0000","last_unstale":"2023-06-09T04:41:01.436321+0000","last_undegraded":"2023-06-09T04:41:01.436321+0000","last_fullsized":"2023-06-09T04:41:01.436321+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:43:35.009681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"28'10","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:14.324470+0000","last_change":"2023-06-09T04:40:56.314806+0000","last_active":"2023-06-09T04:41:14.324470+0000","last_peered":"2023-06-09T04:41:14.324470+0000","last_clean":"2023-06-09T04:41:14.324470+0000","last_became_active":"2023-06-09T04:40:56.312677+0000","last_became_peered":"2023-06-09T04:40:56.312677+0000","last_unstale":"2023-06-09T04:41:14.324470+0000","last_undegraded":"2023-06-09T04:41:14.324470+0000","last_fullsized":"2023-06-09T04:41:14.324470+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:50:18.781041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3793,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.285588+0000","last_change":"2023-06-09T04:40:56.787806+0000","last_active":"2023-06-09T04:41:01.285588+0000","last_peered":"2023-06-09T04:41:01.285588+0000","last_clean":"2023-06-09T04:41:01.285588+0000","last_became_active":"2023-06-09T04:40:56.787509+0000","last_became_peered":"2023-06-09T04:40:56.787509+0000","last_unstale":"2023-06-09T04:41:01.285588+0000","last_undegraded":"2023-06-09T04:41:01.285588+0000","last_fullsized":"2023-06-09T04:41:01.285588+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T04:54:37.254871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.421967+0000","last_change":"2023-06-09T04:41:00.837111+0000","last_active":"2023-06-09T04:41:01.421967+0000","last_peered":"2023-06-09T04:41:01.421967+0000","last_clean":"2023-06-09T04:41:01.421967+0000","last_became_active":"2023-06-09T04:41:00.836434+0000","last_became_peered":"2023-06-09T04:41:00.836434+0000","last_unstale":"2023-06-09T04:41:01.421967+0000","last_undegraded":"2023-06-09T04:41:01.421967+0000","last_fullsized":"2023-06-09T04:41:01.421967+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:47:47.084156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.285632+0000","last_change":"2023-06-09T04:40:56.798290+0000","last_active":"2023-06-09T04:41:01.285632+0000","last_peered":"2023-06-09T04:41:01.285632+0000","last_clean":"2023-06-09T04:41:01.285632+0000","last_became_active":"2023-06-09T04:40:56.797577+0000","last_became_peered":"2023-06-09T04:40:56.797577+0000","last_unstale":"2023-06-09T04:41:01.285632+0000","last_undegraded":"2023-06-09T04:41:01.285632+0000","last_fullsized":"2023-06-09T04:41:01.285632+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:40:42.697633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.287520+0000","last_change":"2023-06-09T04:40:51.254956+0000","last_active":"2023-06-09T04:41:01.287520+0000","last_peered":"2023-06-09T04:41:01.287520+0000","last_clean":"2023-06-09T04:41:01.287520+0000","last_became_active":"2023-06-09T04:40:51.254627+0000","last_became_peered":"2023-06-09T04:40:51.254627+0000","last_unstale":"2023-06-09T04:41:01.287520+0000","last_undegraded":"2023-06-09T04:41:01.287520+0000","last_fullsized":"2023-06-09T04:41:01.287520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_clean_scrub_stamp":"2023-06-09T04:40:50.211713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:44:56.996665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"28'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.283072+0000","last_change":"2023-06-09T04:40:56.315263+0000","last_active":"2023-06-09T04:41:01.283072+0000","last_peered":"2023-06-09T04:41:01.283072+0000","last_clean":"2023-06-09T04:41:01.283072+0000","last_became_active":"2023-06-09T04:40:56.314747+0000","last_became_peered":"2023-06-09T04:40:56.314747+0000","last_unstale":"2023-06-09T04:41:01.283072+0000","last_undegraded":"2023-06-09T04:41:01.283072+0000","last_fullsized":"2023-06-09T04:41:01.283072+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:03:05.731493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.436011+0000","last_change":"2023-06-09T04:41:00.833888+0000","last_active":"2023-06-09T04:41:01.436011+0000","last_peered":"2023-06-09T04:41:01.436011+0000","last_clean":"2023-06-09T04:41:01.436011+0000","last_became_active":"2023-06-09T04:41:00.833442+0000","last_became_peered":"2023-06-09T04:41:00.833442+0000","last_unstale":"2023-06-09T04:41:01.436011+0000","last_undegraded":"2023-06-09T04:41:01.436011+0000","last_fullsized":"2023-06-09T04:41:01.436011+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:24:29.997250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.436508+0000","last_change":"2023-06-09T04:40:56.802424+0000","last_active":"2023-06-09T04:41:01.436508+0000","last_peered":"2023-06-09T04:41:01.436508+0000","last_clean":"2023-06-09T04:41:01.436508+0000","last_became_active":"2023-06-09T04:40:56.802154+0000","last_became_peered":"2023-06-09T04:40:56.802154+0000","last_unstale":"2023-06-09T04:41:01.436508+0000","last_undegraded":"2023-06-09T04:41:01.436508+0000","last_fullsized":"2023-06-09T04:41:01.436508+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:05:49.158462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.423447+0000","last_change":"2023-06-09T04:40:51.247235+0000","last_active":"2023-06-09T04:41:01.423447+0000","last_peered":"2023-06-09T04:41:01.423447+0000","last_clean":"2023-06-09T04:41:01.423447+0000","last_became_active":"2023-06-09T04:40:51.246657+0000","last_became_peered":"2023-06-09T04:40:51.246657+0000","last_unstale":"2023-06-09T04:41:01.423447+0000","last_undegraded":"2023-06-09T04:41:01.423447+0000","last_fullsized":"2023-06-09T04:41:01.423447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_clean_scrub_stamp":"2023-06-09T04:40:50.211713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:03:00.683016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.438678+0000","last_change":"2023-06-09T04:40:56.308909+0000","last_active":"2023-06-09T04:41:01.438678+0000","last_peered":"2023-06-09T04:41:01.438678+0000","last_clean":"2023-06-09T04:41:01.438678+0000","last_became_active":"2023-06-09T04:40:56.308599+0000","last_became_peered":"2023-06-09T04:40:56.308599+0000","last_unstale":"2023-06-09T04:41:01.438678+0000","last_undegraded":"2023-06-09T04:41:01.438678+0000","last_fullsized":"2023-06-09T04:41:01.438678+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:25:20.124448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.285749+0000","last_change":"2023-06-09T04:41:00.824541+0000","last_active":"2023-06-09T04:41:01.285749+0000","last_peered":"2023-06-09T04:41:01.285749+0000","last_clean":"2023-06-09T04:41:01.285749+0000","last_became_active":"2023-06-09T04:41:00.823837+0000","last_became_peered":"2023-06-09T04:41:00.823837+0000","last_unstale":"2023-06-09T04:41:01.285749+0000","last_undegraded":"2023-06-09T04:41:01.285749+0000","last_fullsized":"2023-06-09T04:41:01.285749+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:38:10.979218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.281976+0000","last_change":"2023-06-09T04:40:56.791325+0000","last_active":"2023-06-09T04:41:01.281976+0000","last_peered":"2023-06-09T04:41:01.281976+0000","last_clean":"2023-06-09T04:41:01.281976+0000","last_became_active":"2023-06-09T04:40:56.791079+0000","last_became_peered":"2023-06-09T04:40:56.791079+0000","last_unstale":"2023-06-09T04:41:01.281976+0000","last_undegraded":"2023-06-09T04:41:01.281976+0000","last_fullsized":"2023-06-09T04:41:01.281976+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:04:20.137918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.439866+0000","last_change":"2023-06-09T04:40:51.254461+0000","last_active":"2023-06-09T04:41:01.439866+0000","last_peered":"2023-06-09T04:41:01.439866+0000","last_clean":"2023-06-09T04:41:01.439866+0000","last_became_active":"2023-06-09T04:40:51.254070+0000","last_became_peered":"2023-06-09T04:40:51.254070+0000","last_unstale":"2023-06-09T04:41:01.439866+0000","last_undegraded":"2023-06-09T04:41:01.439866+0000","last_fullsized":"2023-06-09T04:41:01.439866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_clean_scrub_stamp":"2023-06-09T04:40:50.211713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:14:25.527350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.422675+0000","last_change":"2023-06-09T04:40:56.320311+0000","last_active":"2023-06-09T04:41:01.422675+0000","last_peered":"2023-06-09T04:41:01.422675+0000","last_clean":"2023-06-09T04:41:01.422675+0000","last_became_active":"2023-06-09T04:40:56.320015+0000","last_became_peered":"2023-06-09T04:40:56.320015+0000","last_unstale":"2023-06-09T04:41:01.422675+0000","last_undegraded":"2023-06-09T04:41:01.422675+0000","last_fullsized":"2023-06-09T04:41:01.422675+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:57:28.487285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.285949+0000","last_change":"2023-06-09T04:41:00.822120+0000","last_active":"2023-06-09T04:41:01.285949+0000","last_peered":"2023-06-09T04:41:01.285949+0000","last_clean":"2023-06-09T04:41:01.285949+0000","last_became_active":"2023-06-09T04:41:00.821726+0000","last_became_peered":"2023-06-09T04:41:00.821726+0000","last_unstale":"2023-06-09T04:41:01.285949+0000","last_undegraded":"2023-06-09T04:41:01.285949+0000","last_fullsized":"2023-06-09T04:41:01.285949+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:03:36.736093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.422235+0000","last_change":"2023-06-09T04:40:56.797145+0000","last_active":"2023-06-09T04:41:01.422235+0000","last_peered":"2023-06-09T04:41:01.422235+0000","last_clean":"2023-06-09T04:41:01.422235+0000","last_became_active":"2023-06-09T04:40:56.796400+0000","last_became_peered":"2023-06-09T04:40:56.796400+0000","last_unstale":"2023-06-09T04:41:01.422235+0000","last_undegraded":"2023-06-09T04:41:01.422235+0000","last_fullsized":"2023-06-09T04:41:01.422235+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:13:45.572440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.423177+0000","last_change":"2023-06-09T04:40:51.246536+0000","last_active":"2023-06-09T04:41:01.423177+0000","last_peered":"2023-06-09T04:41:01.423177+0000","last_clean":"2023-06-09T04:41:01.423177+0000","last_became_active":"2023-06-09T04:40:51.245999+0000","last_became_peered":"2023-06-09T04:40:51.245999+0000","last_unstale":"2023-06-09T04:41:01.423177+0000","last_undegraded":"2023-06-09T04:41:01.423177+0000","last_fullsized":"2023-06-09T04:41:01.423177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_clean_scrub_stamp":"2023-06-09T04:40:50.211713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:04:39.877355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.439639+0000","last_change":"2023-06-09T04:40:56.316395+0000","last_active":"2023-06-09T04:41:01.439639+0000","last_peered":"2023-06-09T04:41:01.439639+0000","last_clean":"2023-06-09T04:41:01.439639+0000","last_became_active":"2023-06-09T04:40:56.315695+0000","last_became_peered":"2023-06-09T04:40:56.315695+0000","last_unstale":"2023-06-09T04:41:01.439639+0000","last_undegraded":"2023-06-09T04:41:01.439639+0000","last_fullsized":"2023-06-09T04:41:01.439639+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:12:29.829823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.281994+0000","last_change":"2023-06-09T04:41:00.832153+0000","last_active":"2023-06-09T04:41:01.281994+0000","last_peered":"2023-06-09T04:41:01.281994+0000","last_clean":"2023-06-09T04:41:01.281994+0000","last_became_active":"2023-06-09T04:41:00.831571+0000","last_became_peered":"2023-06-09T04:41:00.831571+0000","last_unstale":"2023-06-09T04:41:01.281994+0000","last_undegraded":"2023-06-09T04:41:01.281994+0000","last_fullsized":"2023-06-09T04:41:01.281994+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:17:54.115862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.422827+0000","last_change":"2023-06-09T04:40:56.794902+0000","last_active":"2023-06-09T04:41:01.422827+0000","last_peered":"2023-06-09T04:41:01.422827+0000","last_clean":"2023-06-09T04:41:01.422827+0000","last_became_active":"2023-06-09T04:40:56.794542+0000","last_became_peered":"2023-06-09T04:40:56.794542+0000","last_unstale":"2023-06-09T04:41:01.422827+0000","last_undegraded":"2023-06-09T04:41:01.422827+0000","last_fullsized":"2023-06-09T04:41:01.422827+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:25:26.290677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.285785+0000","last_change":"2023-06-09T04:40:56.315468+0000","last_active":"2023-06-09T04:41:01.285785+0000","last_peered":"2023-06-09T04:41:01.285785+0000","last_clean":"2023-06-09T04:41:01.285785+0000","last_became_active":"2023-06-09T04:40:56.315183+0000","last_became_peered":"2023-06-09T04:40:56.315183+0000","last_unstale":"2023-06-09T04:41:01.285785+0000","last_undegraded":"2023-06-09T04:41:01.285785+0000","last_fullsized":"2023-06-09T04:41:01.285785+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:34:48.798835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.439610+0000","last_change":"2023-06-09T04:40:51.256393+0000","last_active":"2023-06-09T04:41:01.439610+0000","last_peered":"2023-06-09T04:41:01.439610+0000","last_clean":"2023-06-09T04:41:01.439610+0000","last_became_active":"2023-06-09T04:40:51.255964+0000","last_became_peered":"2023-06-09T04:40:51.255964+0000","last_unstale":"2023-06-09T04:41:01.439610+0000","last_undegraded":"2023-06-09T04:41:01.439610+0000","last_fullsized":"2023-06-09T04:41:01.439610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_clean_scrub_stamp":"2023-06-09T04:40:50.211713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:36:40.725711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.282494+0000","last_change":"2023-06-09T04:41:00.839261+0000","last_active":"2023-06-09T04:41:01.282494+0000","last_peered":"2023-06-09T04:41:01.282494+0000","last_clean":"2023-06-09T04:41:01.282494+0000","last_became_active":"2023-06-09T04:41:00.838867+0000","last_became_peered":"2023-06-09T04:41:00.838867+0000","last_unstale":"2023-06-09T04:41:01.282494+0000","last_undegraded":"2023-06-09T04:41:01.282494+0000","last_fullsized":"2023-06-09T04:41:01.282494+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:57:33.009170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.423610+0000","last_change":"2023-06-09T04:40:56.798090+0000","last_active":"2023-06-09T04:41:01.423610+0000","last_peered":"2023-06-09T04:41:01.423610+0000","last_clean":"2023-06-09T04:41:01.423610+0000","last_became_active":"2023-06-09T04:40:56.797767+0000","last_became_peered":"2023-06-09T04:40:56.797767+0000","last_unstale":"2023-06-09T04:41:01.423610+0000","last_undegraded":"2023-06-09T04:41:01.423610+0000","last_fullsized":"2023-06-09T04:41:01.423610+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:52:44.006009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.422159+0000","last_change":"2023-06-09T04:40:56.320626+0000","last_active":"2023-06-09T04:41:01.422159+0000","last_peered":"2023-06-09T04:41:01.422159+0000","last_clean":"2023-06-09T04:41:01.422159+0000","last_became_active":"2023-06-09T04:40:56.320232+0000","last_became_peered":"2023-06-09T04:40:56.320232+0000","last_unstale":"2023-06-09T04:41:01.422159+0000","last_undegraded":"2023-06-09T04:41:01.422159+0000","last_fullsized":"2023-06-09T04:41:01.422159+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:20:18.690413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.437109+0000","last_change":"2023-06-09T04:40:51.582053+0000","last_active":"2023-06-09T04:41:01.437109+0000","last_peered":"2023-06-09T04:41:01.437109+0000","last_clean":"2023-06-09T04:41:01.437109+0000","last_became_active":"2023-06-09T04:40:51.581476+0000","last_became_peered":"2023-06-09T04:40:51.581476+0000","last_unstale":"2023-06-09T04:41:01.437109+0000","last_undegraded":"2023-06-09T04:41:01.437109+0000","last_fullsized":"2023-06-09T04:41:01.437109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_clean_scrub_stamp":"2023-06-09T04:40:50.211713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:41:20.442998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.437773+0000","last_change":"2023-06-09T04:41:00.823337+0000","last_active":"2023-06-09T04:41:01.437773+0000","last_peered":"2023-06-09T04:41:01.437773+0000","last_clean":"2023-06-09T04:41:01.437773+0000","last_became_active":"2023-06-09T04:41:00.822873+0000","last_became_peered":"2023-06-09T04:41:00.822873+0000","last_unstale":"2023-06-09T04:41:01.437773+0000","last_undegraded":"2023-06-09T04:41:01.437773+0000","last_fullsized":"2023-06-09T04:41:01.437773+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:44:04.904534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.282652+0000","last_change":"2023-06-09T04:40:56.796601+0000","last_active":"2023-06-09T04:41:01.282652+0000","last_peered":"2023-06-09T04:41:01.282652+0000","last_clean":"2023-06-09T04:41:01.282652+0000","last_became_active":"2023-06-09T04:40:56.796341+0000","last_became_peered":"2023-06-09T04:40:56.796341+0000","last_unstale":"2023-06-09T04:41:01.282652+0000","last_undegraded":"2023-06-09T04:41:01.282652+0000","last_fullsized":"2023-06-09T04:41:01.282652+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:06:43.179689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.281540+0000","last_change":"2023-06-09T04:40:56.317205+0000","last_active":"2023-06-09T04:41:01.281540+0000","last_peered":"2023-06-09T04:41:01.281540+0000","last_clean":"2023-06-09T04:41:01.281540+0000","last_became_active":"2023-06-09T04:40:56.316821+0000","last_became_peered":"2023-06-09T04:40:56.316821+0000","last_unstale":"2023-06-09T04:41:01.281540+0000","last_undegraded":"2023-06-09T04:41:01.281540+0000","last_fullsized":"2023-06-09T04:41:01.281540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:36:45.774188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.438350+0000","last_change":"2023-06-09T04:40:51.256342+0000","last_active":"2023-06-09T04:41:01.438350+0000","last_peered":"2023-06-09T04:41:01.438350+0000","last_clean":"2023-06-09T04:41:01.438350+0000","last_became_active":"2023-06-09T04:40:51.256010+0000","last_became_peered":"2023-06-09T04:40:51.256010+0000","last_unstale":"2023-06-09T04:41:01.438350+0000","last_undegraded":"2023-06-09T04:41:01.438350+0000","last_fullsized":"2023-06-09T04:41:01.438350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_clean_scrub_stamp":"2023-06-09T04:40:50.211713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:13:39.511250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.440147+0000","last_change":"2023-06-09T04:41:00.839270+0000","last_active":"2023-06-09T04:41:01.440147+0000","last_peered":"2023-06-09T04:41:01.440147+0000","last_clean":"2023-06-09T04:41:01.440147+0000","last_became_active":"2023-06-09T04:41:00.838641+0000","last_became_peered":"2023-06-09T04:41:00.838641+0000","last_unstale":"2023-06-09T04:41:01.440147+0000","last_undegraded":"2023-06-09T04:41:01.440147+0000","last_fullsized":"2023-06-09T04:41:01.440147+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:20:23.212298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.286778+0000","last_change":"2023-06-09T04:40:56.806412+0000","last_active":"2023-06-09T04:41:01.286778+0000","last_peered":"2023-06-09T04:41:01.286778+0000","last_clean":"2023-06-09T04:41:01.286778+0000","last_became_active":"2023-06-09T04:40:56.806046+0000","last_became_peered":"2023-06-09T04:40:56.806046+0000","last_unstale":"2023-06-09T04:41:01.286778+0000","last_undegraded":"2023-06-09T04:41:01.286778+0000","last_fullsized":"2023-06-09T04:41:01.286778+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:13:32.401045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.437153+0000","last_change":"2023-06-09T04:40:56.316110+0000","last_active":"2023-06-09T04:41:01.437153+0000","last_peered":"2023-06-09T04:41:01.437153+0000","last_clean":"2023-06-09T04:41:01.437153+0000","last_became_active":"2023-06-09T04:40:56.315754+0000","last_became_peered":"2023-06-09T04:40:56.315754+0000","last_unstale":"2023-06-09T04:41:01.437153+0000","last_undegraded":"2023-06-09T04:41:01.437153+0000","last_fullsized":"2023-06-09T04:41:01.437153+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:59:56.484281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.439096+0000","last_change":"2023-06-09T04:40:51.253269+0000","last_active":"2023-06-09T04:41:01.439096+0000","last_peered":"2023-06-09T04:41:01.439096+0000","last_clean":"2023-06-09T04:41:01.439096+0000","last_became_active":"2023-06-09T04:40:51.252908+0000","last_became_peered":"2023-06-09T04:40:51.252908+0000","last_unstale":"2023-06-09T04:41:01.439096+0000","last_undegraded":"2023-06-09T04:41:01.439096+0000","last_fullsized":"2023-06-09T04:41:01.439096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_clean_scrub_stamp":"2023-06-09T04:40:50.211713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:55:48.768194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":183,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.438683+0000","last_change":"2023-06-09T04:40:46.286764+0000","last_active":"2023-06-09T04:41:01.438683+0000","last_peered":"2023-06-09T04:41:01.438683+0000","last_clean":"2023-06-09T04:41:01.438683+0000","last_became_active":"2023-06-09T04:40:46.285285+0000","last_became_peered":"2023-06-09T04:40:46.285285+0000","last_unstale":"2023-06-09T04:41:01.438683+0000","last_undegraded":"2023-06-09T04:41:01.438683+0000","last_fullsized":"2023-06-09T04:41:01.438683+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:45.151406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:45.151406+0000","last_clean_scrub_stamp":"2023-06-09T04:40:45.151406+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:43:20.379013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.438943+0000","last_change":"2023-06-09T04:41:00.830910+0000","last_active":"2023-06-09T04:41:01.438943+0000","last_peered":"2023-06-09T04:41:01.438943+0000","last_clean":"2023-06-09T04:41:01.438943+0000","last_became_active":"2023-06-09T04:41:00.830476+0000","last_became_peered":"2023-06-09T04:41:00.830476+0000","last_unstale":"2023-06-09T04:41:01.438943+0000","last_undegraded":"2023-06-09T04:41:01.438943+0000","last_fullsized":"2023-06-09T04:41:01.438943+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:04:49.447717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.423561+0000","last_change":"2023-06-09T04:40:56.790616+0000","last_active":"2023-06-09T04:41:01.423561+0000","last_peered":"2023-06-09T04:41:01.423561+0000","last_clean":"2023-06-09T04:41:01.423561+0000","last_became_active":"2023-06-09T04:40:56.790340+0000","last_became_peered":"2023-06-09T04:40:56.790340+0000","last_unstale":"2023-06-09T04:41:01.423561+0000","last_undegraded":"2023-06-09T04:41:01.423561+0000","last_fullsized":"2023-06-09T04:41:01.423561+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:08:06.202323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.436613+0000","last_change":"2023-06-09T04:40:56.319906+0000","last_active":"2023-06-09T04:41:01.436613+0000","last_peered":"2023-06-09T04:41:01.436613+0000","last_clean":"2023-06-09T04:41:01.436613+0000","last_became_active":"2023-06-09T04:40:56.319496+0000","last_became_peered":"2023-06-09T04:40:56.319496+0000","last_unstale":"2023-06-09T04:41:01.436613+0000","last_undegraded":"2023-06-09T04:41:01.436613+0000","last_fullsized":"2023-06-09T04:41:01.436613+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:08:05.189610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.288028+0000","last_change":"2023-06-09T04:41:00.825198+0000","last_active":"2023-06-09T04:41:01.288028+0000","last_peered":"2023-06-09T04:41:01.288028+0000","last_clean":"2023-06-09T04:41:01.288028+0000","last_became_active":"2023-06-09T04:41:00.824804+0000","last_became_peered":"2023-06-09T04:41:00.824804+0000","last_unstale":"2023-06-09T04:41:01.288028+0000","last_undegraded":"2023-06-09T04:41:01.288028+0000","last_fullsized":"2023-06-09T04:41:01.288028+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:52:16.020173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.287921+0000","last_change":"2023-06-09T04:40:56.801931+0000","last_active":"2023-06-09T04:41:01.287921+0000","last_peered":"2023-06-09T04:41:01.287921+0000","last_clean":"2023-06-09T04:41:01.287921+0000","last_became_active":"2023-06-09T04:40:56.801667+0000","last_became_peered":"2023-06-09T04:40:56.801667+0000","last_unstale":"2023-06-09T04:41:01.287921+0000","last_undegraded":"2023-06-09T04:41:01.287921+0000","last_fullsized":"2023-06-09T04:41:01.287921+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:52:18.948571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.285847+0000","last_change":"2023-06-09T04:40:56.322597+0000","last_active":"2023-06-09T04:41:01.285847+0000","last_peered":"2023-06-09T04:41:01.285847+0000","last_clean":"2023-06-09T04:41:01.285847+0000","last_became_active":"2023-06-09T04:40:56.322300+0000","last_became_peered":"2023-06-09T04:40:56.322300+0000","last_unstale":"2023-06-09T04:41:01.285847+0000","last_undegraded":"2023-06-09T04:41:01.285847+0000","last_fullsized":"2023-06-09T04:41:01.285847+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:27:36.587609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.439849+0000","last_change":"2023-06-09T04:41:00.832222+0000","last_active":"2023-06-09T04:41:01.439849+0000","last_peered":"2023-06-09T04:41:01.439849+0000","last_clean":"2023-06-09T04:41:01.439849+0000","last_became_active":"2023-06-09T04:41:00.831821+0000","last_became_peered":"2023-06-09T04:41:00.831821+0000","last_unstale":"2023-06-09T04:41:01.439849+0000","last_undegraded":"2023-06-09T04:41:01.439849+0000","last_fullsized":"2023-06-09T04:41:01.439849+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:47:47.084156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.286843+0000","last_change":"2023-06-09T04:40:56.803238+0000","last_active":"2023-06-09T04:41:01.286843+0000","last_peered":"2023-06-09T04:41:01.286843+0000","last_clean":"2023-06-09T04:41:01.286843+0000","last_became_active":"2023-06-09T04:40:56.802659+0000","last_became_peered":"2023-06-09T04:40:56.802659+0000","last_unstale":"2023-06-09T04:41:01.286843+0000","last_undegraded":"2023-06-09T04:41:01.286843+0000","last_fullsized":"2023-06-09T04:41:01.286843+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:18:37.195363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.286230+0000","last_change":"2023-06-09T04:40:56.310427+0000","last_active":"2023-06-09T04:41:01.286230+0000","last_peered":"2023-06-09T04:41:01.286230+0000","last_clean":"2023-06-09T04:41:01.286230+0000","last_became_active":"2023-06-09T04:40:56.309681+0000","last_became_peered":"2023-06-09T04:40:56.309681+0000","last_unstale":"2023-06-09T04:41:01.286230+0000","last_undegraded":"2023-06-09T04:41:01.286230+0000","last_fullsized":"2023-06-09T04:41:01.286230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:32:44.555572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.422209+0000","last_change":"2023-06-09T04:41:00.833572+0000","last_active":"2023-06-09T04:41:01.422209+0000","last_peered":"2023-06-09T04:41:01.422209+0000","last_clean":"2023-06-09T04:41:01.422209+0000","last_became_active":"2023-06-09T04:41:00.833182+0000","last_became_peered":"2023-06-09T04:41:00.833182+0000","last_unstale":"2023-06-09T04:41:01.422209+0000","last_undegraded":"2023-06-09T04:41:01.422209+0000","last_fullsized":"2023-06-09T04:41:01.422209+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:04:23.647090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.285461+0000","last_change":"2023-06-09T04:40:56.805747+0000","last_active":"2023-06-09T04:41:01.285461+0000","last_peered":"2023-06-09T04:41:01.285461+0000","last_clean":"2023-06-09T04:41:01.285461+0000","last_became_active":"2023-06-09T04:40:56.797532+0000","last_became_peered":"2023-06-09T04:40:56.797532+0000","last_unstale":"2023-06-09T04:41:01.285461+0000","last_undegraded":"2023-06-09T04:41:01.285461+0000","last_fullsized":"2023-06-09T04:41:01.285461+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:45:17.466440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.438024+0000","last_change":"2023-06-09T04:40:56.314468+0000","last_active":"2023-06-09T04:41:01.438024+0000","last_peered":"2023-06-09T04:41:01.438024+0000","last_clean":"2023-06-09T04:41:01.438024+0000","last_became_active":"2023-06-09T04:40:56.314110+0000","last_became_peered":"2023-06-09T04:40:56.314110+0000","last_unstale":"2023-06-09T04:41:01.438024+0000","last_undegraded":"2023-06-09T04:41:01.438024+0000","last_fullsized":"2023-06-09T04:41:01.438024+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:39:14.790353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.437486+0000","last_change":"2023-06-09T04:41:00.823352+0000","last_active":"2023-06-09T04:41:01.437486+0000","last_peered":"2023-06-09T04:41:01.437486+0000","last_clean":"2023-06-09T04:41:01.437486+0000","last_became_active":"2023-06-09T04:41:00.822869+0000","last_became_peered":"2023-06-09T04:41:00.822869+0000","last_unstale":"2023-06-09T04:41:01.437486+0000","last_undegraded":"2023-06-09T04:41:01.437486+0000","last_fullsized":"2023-06-09T04:41:01.437486+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:46:17.286998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.281876+0000","last_change":"2023-06-09T04:40:56.790996+0000","last_active":"2023-06-09T04:41:01.281876+0000","last_peered":"2023-06-09T04:41:01.281876+0000","last_clean":"2023-06-09T04:41:01.281876+0000","last_became_active":"2023-06-09T04:40:56.790630+0000","last_became_peered":"2023-06-09T04:40:56.790630+0000","last_unstale":"2023-06-09T04:41:01.281876+0000","last_undegraded":"2023-06-09T04:41:01.281876+0000","last_fullsized":"2023-06-09T04:41:01.281876+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:47:43.574984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.440099+0000","last_change":"2023-06-09T04:40:56.316852+0000","last_active":"2023-06-09T04:41:01.440099+0000","last_peered":"2023-06-09T04:41:01.440099+0000","last_clean":"2023-06-09T04:41:01.440099+0000","last_became_active":"2023-06-09T04:40:56.315795+0000","last_became_peered":"2023-06-09T04:40:56.315795+0000","last_unstale":"2023-06-09T04:41:01.440099+0000","last_undegraded":"2023-06-09T04:41:01.440099+0000","last_fullsized":"2023-06-09T04:41:01.440099+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:04:19.125206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.436964+0000","last_change":"2023-06-09T04:41:00.815347+0000","last_active":"2023-06-09T04:41:01.436964+0000","last_peered":"2023-06-09T04:41:01.436964+0000","last_clean":"2023-06-09T04:41:01.436964+0000","last_became_active":"2023-06-09T04:41:00.814876+0000","last_became_peered":"2023-06-09T04:41:00.814876+0000","last_unstale":"2023-06-09T04:41:01.436964+0000","last_undegraded":"2023-06-09T04:41:01.436964+0000","last_fullsized":"2023-06-09T04:41:01.436964+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:29:48.861218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.286021+0000","last_change":"2023-06-09T04:40:56.797164+0000","last_active":"2023-06-09T04:41:01.286021+0000","last_peered":"2023-06-09T04:41:01.286021+0000","last_clean":"2023-06-09T04:41:01.286021+0000","last_became_active":"2023-06-09T04:40:56.796793+0000","last_became_peered":"2023-06-09T04:40:56.796793+0000","last_unstale":"2023-06-09T04:41:01.286021+0000","last_undegraded":"2023-06-09T04:41:01.286021+0000","last_fullsized":"2023-06-09T04:41:01.286021+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:22:00.092692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.439725+0000","last_change":"2023-06-09T04:40:56.319708+0000","last_active":"2023-06-09T04:41:01.439725+0000","last_peered":"2023-06-09T04:41:01.439725+0000","last_clean":"2023-06-09T04:41:01.439725+0000","last_became_active":"2023-06-09T04:40:56.319239+0000","last_became_peered":"2023-06-09T04:40:56.319239+0000","last_unstale":"2023-06-09T04:41:01.439725+0000","last_undegraded":"2023-06-09T04:41:01.439725+0000","last_fullsized":"2023-06-09T04:41:01.439725+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:59:56.484281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.437517+0000","last_change":"2023-06-09T04:41:00.830023+0000","last_active":"2023-06-09T04:41:01.437517+0000","last_peered":"2023-06-09T04:41:01.437517+0000","last_clean":"2023-06-09T04:41:01.437517+0000","last_became_active":"2023-06-09T04:41:00.829628+0000","last_became_peered":"2023-06-09T04:41:00.829628+0000","last_unstale":"2023-06-09T04:41:01.437517+0000","last_undegraded":"2023-06-09T04:41:01.437517+0000","last_fullsized":"2023-06-09T04:41:01.437517+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:11:01.800202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.285365+0000","last_change":"2023-06-09T04:40:56.802232+0000","last_active":"2023-06-09T04:41:01.285365+0000","last_peered":"2023-06-09T04:41:01.285365+0000","last_clean":"2023-06-09T04:41:01.285365+0000","last_became_active":"2023-06-09T04:40:56.798647+0000","last_became_peered":"2023-06-09T04:40:56.798647+0000","last_unstale":"2023-06-09T04:41:01.285365+0000","last_undegraded":"2023-06-09T04:41:01.285365+0000","last_fullsized":"2023-06-09T04:41:01.285365+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:15:13.824668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.439375+0000","last_change":"2023-06-09T04:40:56.312886+0000","last_active":"2023-06-09T04:41:01.439375+0000","last_peered":"2023-06-09T04:41:01.439375+0000","last_clean":"2023-06-09T04:41:01.439375+0000","last_became_active":"2023-06-09T04:40:56.312638+0000","last_became_peered":"2023-06-09T04:40:56.312638+0000","last_unstale":"2023-06-09T04:41:01.439375+0000","last_undegraded":"2023-06-09T04:41:01.439375+0000","last_fullsized":"2023-06-09T04:41:01.439375+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:05:48.145750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.436906+0000","last_change":"2023-06-09T04:41:00.837079+0000","last_active":"2023-06-09T04:41:01.436906+0000","last_peered":"2023-06-09T04:41:01.436906+0000","last_clean":"2023-06-09T04:41:01.436906+0000","last_became_active":"2023-06-09T04:41:00.836636+0000","last_became_peered":"2023-06-09T04:41:00.836636+0000","last_unstale":"2023-06-09T04:41:01.436906+0000","last_undegraded":"2023-06-09T04:41:01.436906+0000","last_fullsized":"2023-06-09T04:41:01.436906+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:18:24.073415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.438685+0000","last_change":"2023-06-09T04:40:56.802193+0000","last_active":"2023-06-09T04:41:01.438685+0000","last_peered":"2023-06-09T04:41:01.438685+0000","last_clean":"2023-06-09T04:41:01.438685+0000","last_became_active":"2023-06-09T04:40:56.801743+0000","last_became_peered":"2023-06-09T04:40:56.801743+0000","last_unstale":"2023-06-09T04:41:01.438685+0000","last_undegraded":"2023-06-09T04:41:01.438685+0000","last_fullsized":"2023-06-09T04:41:01.438685+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:26:52.030740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.440193+0000","last_change":"2023-06-09T04:40:56.310010+0000","last_active":"2023-06-09T04:41:01.440193+0000","last_peered":"2023-06-09T04:41:01.440193+0000","last_clean":"2023-06-09T04:41:01.440193+0000","last_became_active":"2023-06-09T04:40:56.309735+0000","last_became_peered":"2023-06-09T04:40:56.309735+0000","last_unstale":"2023-06-09T04:41:01.440193+0000","last_undegraded":"2023-06-09T04:41:01.440193+0000","last_fullsized":"2023-06-09T04:41:01.440193+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:39:14.790353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.439938+0000","last_change":"2023-06-09T04:41:00.831076+0000","last_active":"2023-06-09T04:41:01.439938+0000","last_peered":"2023-06-09T04:41:01.439938+0000","last_clean":"2023-06-09T04:41:01.439938+0000","last_became_active":"2023-06-09T04:41:00.828763+0000","last_became_peered":"2023-06-09T04:41:00.828763+0000","last_unstale":"2023-06-09T04:41:01.439938+0000","last_undegraded":"2023-06-09T04:41:01.439938+0000","last_fullsized":"2023-06-09T04:41:01.439938+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:24:30.332035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.440504+0000","last_change":"2023-06-09T04:41:00.839198+0000","last_active":"2023-06-09T04:41:01.440504+0000","last_peered":"2023-06-09T04:41:01.440504+0000","last_clean":"2023-06-09T04:41:01.440504+0000","last_became_active":"2023-06-09T04:41:00.838883+0000","last_became_peered":"2023-06-09T04:41:00.838883+0000","last_unstale":"2023-06-09T04:41:01.440504+0000","last_undegraded":"2023-06-09T04:41:01.440504+0000","last_fullsized":"2023-06-09T04:41:01.440504+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:25:29.799849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.285514+0000","last_change":"2023-06-09T04:40:56.314061+0000","last_active":"2023-06-09T04:41:01.285514+0000","last_peered":"2023-06-09T04:41:01.285514+0000","last_clean":"2023-06-09T04:41:01.285514+0000","last_became_active":"2023-06-09T04:40:56.313675+0000","last_became_peered":"2023-06-09T04:40:56.313675+0000","last_unstale":"2023-06-09T04:41:01.285514+0000","last_undegraded":"2023-06-09T04:41:01.285514+0000","last_fullsized":"2023-06-09T04:41:01.285514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:05:35.369565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.438564+0000","last_change":"2023-06-09T04:40:56.803235+0000","last_active":"2023-06-09T04:41:01.438564+0000","last_peered":"2023-06-09T04:41:01.438564+0000","last_clean":"2023-06-09T04:41:01.438564+0000","last_became_active":"2023-06-09T04:40:56.802719+0000","last_became_peered":"2023-06-09T04:40:56.802719+0000","last_unstale":"2023-06-09T04:41:01.438564+0000","last_undegraded":"2023-06-09T04:41:01.438564+0000","last_fullsized":"2023-06-09T04:41:01.438564+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:13:35.241848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.438353+0000","last_change":"2023-06-09T04:41:00.824712+0000","last_active":"2023-06-09T04:41:01.438353+0000","last_peered":"2023-06-09T04:41:01.438353+0000","last_clean":"2023-06-09T04:41:01.438353+0000","last_became_active":"2023-06-09T04:41:00.824247+0000","last_became_peered":"2023-06-09T04:41:00.824247+0000","last_unstale":"2023-06-09T04:41:01.438353+0000","last_undegraded":"2023-06-09T04:41:01.438353+0000","last_fullsized":"2023-06-09T04:41:01.438353+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:10:26.089852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.438867+0000","last_change":"2023-06-09T04:40:56.318818+0000","last_active":"2023-06-09T04:41:01.438867+0000","last_peered":"2023-06-09T04:41:01.438867+0000","last_clean":"2023-06-09T04:41:01.438867+0000","last_became_active":"2023-06-09T04:40:56.318430+0000","last_became_peered":"2023-06-09T04:40:56.318430+0000","last_unstale":"2023-06-09T04:41:01.438867+0000","last_undegraded":"2023-06-09T04:41:01.438867+0000","last_fullsized":"2023-06-09T04:41:01.438867+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:14:30.287562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.282910+0000","last_change":"2023-06-09T04:40:56.804430+0000","last_active":"2023-06-09T04:41:01.282910+0000","last_peered":"2023-06-09T04:41:01.282910+0000","last_clean":"2023-06-09T04:41:01.282910+0000","last_became_active":"2023-06-09T04:40:56.804135+0000","last_became_peered":"2023-06-09T04:40:56.804135+0000","last_unstale":"2023-06-09T04:41:01.282910+0000","last_undegraded":"2023-06-09T04:41:01.282910+0000","last_fullsized":"2023-06-09T04:41:01.282910+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:04:45.938545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.281917+0000","last_change":"2023-06-09T04:40:56.311175+0000","last_active":"2023-06-09T04:41:01.281917+0000","last_peered":"2023-06-09T04:41:01.281917+0000","last_clean":"2023-06-09T04:41:01.281917+0000","last_became_active":"2023-06-09T04:40:56.310829+0000","last_became_peered":"2023-06-09T04:40:56.310829+0000","last_unstale":"2023-06-09T04:41:01.281917+0000","last_undegraded":"2023-06-09T04:41:01.281917+0000","last_fullsized":"2023-06-09T04:41:01.281917+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:20:18.690413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.439450+0000","last_change":"2023-06-09T04:40:56.809473+0000","last_active":"2023-06-09T04:41:01.439450+0000","last_peered":"2023-06-09T04:41:01.439450+0000","last_clean":"2023-06-09T04:41:01.439450+0000","last_became_active":"2023-06-09T04:40:56.809181+0000","last_became_peered":"2023-06-09T04:40:56.809181+0000","last_unstale":"2023-06-09T04:41:01.439450+0000","last_undegraded":"2023-06-09T04:41:01.439450+0000","last_fullsized":"2023-06-09T04:41:01.439450+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:05:54.167533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.437947+0000","last_change":"2023-06-09T04:41:00.827111+0000","last_active":"2023-06-09T04:41:01.437947+0000","last_peered":"2023-06-09T04:41:01.437947+0000","last_clean":"2023-06-09T04:41:01.437947+0000","last_became_active":"2023-06-09T04:41:00.826707+0000","last_became_peered":"2023-06-09T04:41:00.826707+0000","last_unstale":"2023-06-09T04:41:01.437947+0000","last_undegraded":"2023-06-09T04:41:01.437947+0000","last_fullsized":"2023-06-09T04:41:01.437947+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:24:30.332035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.438574+0000","last_change":"2023-06-09T04:40:56.318716+0000","last_active":"2023-06-09T04:41:01.438574+0000","last_peered":"2023-06-09T04:41:01.438574+0000","last_clean":"2023-06-09T04:41:01.438574+0000","last_became_active":"2023-06-09T04:40:56.318415+0000","last_became_peered":"2023-06-09T04:40:56.318415+0000","last_unstale":"2023-06-09T04:41:01.438574+0000","last_undegraded":"2023-06-09T04:41:01.438574+0000","last_fullsized":"2023-06-09T04:41:01.438574+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:25:25.277964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.438243+0000","last_change":"2023-06-09T04:40:56.795369+0000","last_active":"2023-06-09T04:41:01.438243+0000","last_peered":"2023-06-09T04:41:01.438243+0000","last_clean":"2023-06-09T04:41:01.438243+0000","last_became_active":"2023-06-09T04:40:56.794885+0000","last_became_peered":"2023-06-09T04:40:56.794885+0000","last_unstale":"2023-06-09T04:41:01.438243+0000","last_undegraded":"2023-06-09T04:41:01.438243+0000","last_fullsized":"2023-06-09T04:41:01.438243+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:58:56.783205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.439095+0000","last_change":"2023-06-09T04:41:00.839070+0000","last_active":"2023-06-09T04:41:01.439095+0000","last_peered":"2023-06-09T04:41:01.439095+0000","last_clean":"2023-06-09T04:41:01.439095+0000","last_became_active":"2023-06-09T04:41:00.838603+0000","last_became_peered":"2023-06-09T04:41:00.838603+0000","last_unstale":"2023-06-09T04:41:01.439095+0000","last_undegraded":"2023-06-09T04:41:01.439095+0000","last_fullsized":"2023-06-09T04:41:01.439095+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T04:55:38.240718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.285287+0000","last_change":"2023-06-09T04:40:56.797265+0000","last_active":"2023-06-09T04:41:01.285287+0000","last_peered":"2023-06-09T04:41:01.285287+0000","last_clean":"2023-06-09T04:41:01.285287+0000","last_became_active":"2023-06-09T04:40:56.796952+0000","last_became_peered":"2023-06-09T04:40:56.796952+0000","last_unstale":"2023-06-09T04:41:01.285287+0000","last_undegraded":"2023-06-09T04:41:01.285287+0000","last_fullsized":"2023-06-09T04:41:01.285287+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:48:55.767412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.436310+0000","last_change":"2023-06-09T04:40:56.797095+0000","last_active":"2023-06-09T04:41:01.436310+0000","last_peered":"2023-06-09T04:41:01.436310+0000","last_clean":"2023-06-09T04:41:01.436310+0000","last_became_active":"2023-06-09T04:40:56.796589+0000","last_became_peered":"2023-06-09T04:40:56.796589+0000","last_unstale":"2023-06-09T04:41:01.436310+0000","last_undegraded":"2023-06-09T04:41:01.436310+0000","last_fullsized":"2023-06-09T04:41:01.436310+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:14:31.300275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.285463+0000","last_change":"2023-06-09T04:40:56.798590+0000","last_active":"2023-06-09T04:41:01.285463+0000","last_peered":"2023-06-09T04:41:01.285463+0000","last_clean":"2023-06-09T04:41:01.285463+0000","last_became_active":"2023-06-09T04:40:56.798170+0000","last_became_peered":"2023-06-09T04:40:56.798170+0000","last_unstale":"2023-06-09T04:41:01.285463+0000","last_undegraded":"2023-06-09T04:41:01.285463+0000","last_fullsized":"2023-06-09T04:41:01.285463+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:17:30.494237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.437846+0000","last_change":"2023-06-09T04:40:56.801414+0000","last_active":"2023-06-09T04:41:01.437846+0000","last_peered":"2023-06-09T04:41:01.437846+0000","last_clean":"2023-06-09T04:41:01.437846+0000","last_became_active":"2023-06-09T04:40:56.801141+0000","last_became_peered":"2023-06-09T04:40:56.801141+0000","last_unstale":"2023-06-09T04:41:01.437846+0000","last_undegraded":"2023-06-09T04:41:01.437846+0000","last_fullsized":"2023-06-09T04:41:01.437846+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:14:31.588540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.423026+0000","last_change":"2023-06-09T04:40:56.800046+0000","last_active":"2023-06-09T04:41:01.423026+0000","last_peered":"2023-06-09T04:41:01.423026+0000","last_clean":"2023-06-09T04:41:01.423026+0000","last_became_active":"2023-06-09T04:40:56.798966+0000","last_became_peered":"2023-06-09T04:40:56.798966+0000","last_unstale":"2023-06-09T04:41:01.423026+0000","last_undegraded":"2023-06-09T04:41:01.423026+0000","last_fullsized":"2023-06-09T04:41:01.423026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:06:43.179689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.439250+0000","last_change":"2023-06-09T04:40:56.809685+0000","last_active":"2023-06-09T04:41:01.439250+0000","last_peered":"2023-06-09T04:41:01.439250+0000","last_clean":"2023-06-09T04:41:01.439250+0000","last_became_active":"2023-06-09T04:40:56.809312+0000","last_became_peered":"2023-06-09T04:40:56.809312+0000","last_unstale":"2023-06-09T04:41:01.439250+0000","last_undegraded":"2023-06-09T04:41:01.439250+0000","last_fullsized":"2023-06-09T04:41:01.439250+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:17:07.126456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.423063+0000","last_change":"2023-06-09T04:40:56.795763+0000","last_active":"2023-06-09T04:41:01.423063+0000","last_peered":"2023-06-09T04:41:01.423063+0000","last_clean":"2023-06-09T04:41:01.423063+0000","last_became_active":"2023-06-09T04:40:56.795456+0000","last_became_peered":"2023-06-09T04:40:56.795456+0000","last_unstale":"2023-06-09T04:41:01.423063+0000","last_undegraded":"2023-06-09T04:41:01.423063+0000","last_fullsized":"2023-06-09T04:41:01.423063+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:14:31.300275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.423520+0000","last_change":"2023-06-09T04:40:56.801907+0000","last_active":"2023-06-09T04:41:01.423520+0000","last_peered":"2023-06-09T04:41:01.423520+0000","last_clean":"2023-06-09T04:41:01.423520+0000","last_became_active":"2023-06-09T04:40:56.801549+0000","last_became_peered":"2023-06-09T04:40:56.801549+0000","last_unstale":"2023-06-09T04:41:01.423520+0000","last_undegraded":"2023-06-09T04:41:01.423520+0000","last_fullsized":"2023-06-09T04:41:01.423520+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:05:49.158462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.439471+0000","last_change":"2023-06-09T04:40:56.807671+0000","last_active":"2023-06-09T04:41:01.439471+0000","last_peered":"2023-06-09T04:41:01.439471+0000","last_clean":"2023-06-09T04:41:01.439471+0000","last_became_active":"2023-06-09T04:40:56.807340+0000","last_became_peered":"2023-06-09T04:40:56.807340+0000","last_unstale":"2023-06-09T04:41:01.439471+0000","last_undegraded":"2023-06-09T04:41:01.439471+0000","last_fullsized":"2023-06-09T04:41:01.439471+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:08:06.202323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.436226+0000","last_change":"2023-06-09T04:40:56.788625+0000","last_active":"2023-06-09T04:41:01.436226+0000","last_peered":"2023-06-09T04:41:01.436226+0000","last_clean":"2023-06-09T04:41:01.436226+0000","last_became_active":"2023-06-09T04:40:56.787863+0000","last_became_peered":"2023-06-09T04:40:56.787863+0000","last_unstale":"2023-06-09T04:41:01.436226+0000","last_undegraded":"2023-06-09T04:41:01.436226+0000","last_fullsized":"2023-06-09T04:41:01.436226+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:25:26.290677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.281831+0000","last_change":"2023-06-09T04:40:56.790021+0000","last_active":"2023-06-09T04:41:01.281831+0000","last_peered":"2023-06-09T04:41:01.281831+0000","last_clean":"2023-06-09T04:41:01.281831+0000","last_became_active":"2023-06-09T04:40:56.789701+0000","last_became_peered":"2023-06-09T04:40:56.789701+0000","last_unstale":"2023-06-09T04:41:01.281831+0000","last_undegraded":"2023-06-09T04:41:01.281831+0000","last_fullsized":"2023-06-09T04:41:01.281831+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:12:30.842536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.438484+0000","last_change":"2023-06-09T04:40:56.808367+0000","last_active":"2023-06-09T04:41:01.438484+0000","last_peered":"2023-06-09T04:41:01.438484+0000","last_clean":"2023-06-09T04:41:01.438484+0000","last_became_active":"2023-06-09T04:40:56.807817+0000","last_became_peered":"2023-06-09T04:40:56.807817+0000","last_unstale":"2023-06-09T04:41:01.438484+0000","last_undegraded":"2023-06-09T04:41:01.438484+0000","last_fullsized":"2023-06-09T04:41:01.438484+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:24:26.488078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.285269+0000","last_change":"2023-06-09T04:40:56.790891+0000","last_active":"2023-06-09T04:41:01.285269+0000","last_peered":"2023-06-09T04:41:01.285269+0000","last_clean":"2023-06-09T04:41:01.285269+0000","last_became_active":"2023-06-09T04:40:56.790633+0000","last_became_peered":"2023-06-09T04:40:56.790633+0000","last_unstale":"2023-06-09T04:41:01.285269+0000","last_undegraded":"2023-06-09T04:41:01.285269+0000","last_fullsized":"2023-06-09T04:41:01.285269+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:40:36.160469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.437785+0000","last_change":"2023-06-09T04:40:56.806490+0000","last_active":"2023-06-09T04:41:01.437785+0000","last_peered":"2023-06-09T04:41:01.437785+0000","last_clean":"2023-06-09T04:41:01.437785+0000","last_became_active":"2023-06-09T04:40:56.806147+0000","last_became_peered":"2023-06-09T04:40:56.806147+0000","last_unstale":"2023-06-09T04:41:01.437785+0000","last_undegraded":"2023-06-09T04:41:01.437785+0000","last_fullsized":"2023-06-09T04:41:01.437785+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:26:06.240424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.287737+0000","last_change":"2023-06-09T04:40:56.797924+0000","last_active":"2023-06-09T04:41:01.287737+0000","last_peered":"2023-06-09T04:41:01.287737+0000","last_clean":"2023-06-09T04:41:01.287737+0000","last_became_active":"2023-06-09T04:40:56.794834+0000","last_became_peered":"2023-06-09T04:40:56.794834+0000","last_unstale":"2023-06-09T04:41:01.287737+0000","last_undegraded":"2023-06-09T04:41:01.287737+0000","last_fullsized":"2023-06-09T04:41:01.287737+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:14:40.902021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.283050+0000","last_change":"2023-06-09T04:40:56.792333+0000","last_active":"2023-06-09T04:41:01.283050+0000","last_peered":"2023-06-09T04:41:01.283050+0000","last_clean":"2023-06-09T04:41:01.283050+0000","last_became_active":"2023-06-09T04:40:56.791978+0000","last_became_peered":"2023-06-09T04:40:56.791978+0000","last_unstale":"2023-06-09T04:41:01.283050+0000","last_undegraded":"2023-06-09T04:41:01.283050+0000","last_fullsized":"2023-06-09T04:41:01.283050+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:05:49.158462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.284964+0000","last_change":"2023-06-09T04:40:56.803527+0000","last_active":"2023-06-09T04:41:01.284964+0000","last_peered":"2023-06-09T04:41:01.284964+0000","last_clean":"2023-06-09T04:41:01.284964+0000","last_became_active":"2023-06-09T04:40:56.798138+0000","last_became_peered":"2023-06-09T04:40:56.798138+0000","last_unstale":"2023-06-09T04:41:01.284964+0000","last_undegraded":"2023-06-09T04:41:01.284964+0000","last_fullsized":"2023-06-09T04:41:01.284964+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:50:19.031791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.438636+0000","last_change":"2023-06-09T04:40:56.808104+0000","last_active":"2023-06-09T04:41:01.438636+0000","last_peered":"2023-06-09T04:41:01.438636+0000","last_clean":"2023-06-09T04:41:01.438636+0000","last_became_active":"2023-06-09T04:40:56.807785+0000","last_became_peered":"2023-06-09T04:40:56.807785+0000","last_unstale":"2023-06-09T04:41:01.438636+0000","last_undegraded":"2023-06-09T04:41:01.438636+0000","last_fullsized":"2023-06-09T04:41:01.438636+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:06:43.179689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.439453+0000","last_change":"2023-06-09T04:40:56.793787+0000","last_active":"2023-06-09T04:41:01.439453+0000","last_peered":"2023-06-09T04:41:01.439453+0000","last_clean":"2023-06-09T04:41:01.439453+0000","last_became_active":"2023-06-09T04:40:56.793480+0000","last_became_peered":"2023-06-09T04:40:56.793480+0000","last_unstale":"2023-06-09T04:41:01.439453+0000","last_undegraded":"2023-06-09T04:41:01.439453+0000","last_fullsized":"2023-06-09T04:41:01.439453+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:12:06.677526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.437720+0000","last_change":"2023-06-09T04:40:56.791804+0000","last_active":"2023-06-09T04:41:01.437720+0000","last_peered":"2023-06-09T04:41:01.437720+0000","last_clean":"2023-06-09T04:41:01.437720+0000","last_became_active":"2023-06-09T04:40:56.791541+0000","last_became_peered":"2023-06-09T04:40:56.791541+0000","last_unstale":"2023-06-09T04:41:01.437720+0000","last_undegraded":"2023-06-09T04:41:01.437720+0000","last_fullsized":"2023-06-09T04:41:01.437720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:23:01.827954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.437398+0000","last_change":"2023-06-09T04:40:56.813222+0000","last_active":"2023-06-09T04:41:01.437398+0000","last_peered":"2023-06-09T04:41:01.437398+0000","last_clean":"2023-06-09T04:41:01.437398+0000","last_became_active":"2023-06-09T04:40:56.812972+0000","last_became_peered":"2023-06-09T04:40:56.812972+0000","last_unstale":"2023-06-09T04:41:01.437398+0000","last_undegraded":"2023-06-09T04:41:01.437398+0000","last_fullsized":"2023-06-09T04:41:01.437398+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:43:09.121493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.286724+0000","last_change":"2023-06-09T04:40:56.803077+0000","last_active":"2023-06-09T04:41:01.286724+0000","last_peered":"2023-06-09T04:41:01.286724+0000","last_clean":"2023-06-09T04:41:01.286724+0000","last_became_active":"2023-06-09T04:40:56.802630+0000","last_became_peered":"2023-06-09T04:40:56.802630+0000","last_unstale":"2023-06-09T04:41:01.286724+0000","last_undegraded":"2023-06-09T04:41:01.286724+0000","last_fullsized":"2023-06-09T04:41:01.286724+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:33:17.724459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.440343+0000","last_change":"2023-06-09T04:40:56.795612+0000","last_active":"2023-06-09T04:41:01.440343+0000","last_peered":"2023-06-09T04:41:01.440343+0000","last_clean":"2023-06-09T04:41:01.440343+0000","last_became_active":"2023-06-09T04:40:56.795372+0000","last_became_peered":"2023-06-09T04:40:56.795372+0000","last_unstale":"2023-06-09T04:41:01.440343+0000","last_undegraded":"2023-06-09T04:41:01.440343+0000","last_fullsized":"2023-06-09T04:41:01.440343+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:57:29.499998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.282852+0000","last_change":"2023-06-09T04:40:56.805170+0000","last_active":"2023-06-09T04:41:01.282852+0000","last_peered":"2023-06-09T04:41:01.282852+0000","last_clean":"2023-06-09T04:41:01.282852+0000","last_became_active":"2023-06-09T04:40:56.804824+0000","last_became_peered":"2023-06-09T04:40:56.804824+0000","last_unstale":"2023-06-09T04:41:01.282852+0000","last_undegraded":"2023-06-09T04:41:01.282852+0000","last_fullsized":"2023-06-09T04:41:01.282852+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:14:31.300275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.438522+0000","last_change":"2023-06-09T04:40:56.815327+0000","last_active":"2023-06-09T04:41:01.438522+0000","last_peered":"2023-06-09T04:41:01.438522+0000","last_clean":"2023-06-09T04:41:01.438522+0000","last_became_active":"2023-06-09T04:40:56.815047+0000","last_became_peered":"2023-06-09T04:40:56.815047+0000","last_unstale":"2023-06-09T04:41:01.438522+0000","last_undegraded":"2023-06-09T04:41:01.438522+0000","last_fullsized":"2023-06-09T04:41:01.438522+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:25:21.467588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.438388+0000","last_change":"2023-06-09T04:40:56.808036+0000","last_active":"2023-06-09T04:41:01.438388+0000","last_peered":"2023-06-09T04:41:01.438388+0000","last_clean":"2023-06-09T04:41:01.438388+0000","last_became_active":"2023-06-09T04:40:56.807413+0000","last_became_peered":"2023-06-09T04:40:56.807413+0000","last_unstale":"2023-06-09T04:41:01.438388+0000","last_undegraded":"2023-06-09T04:41:01.438388+0000","last_fullsized":"2023-06-09T04:41:01.438388+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:57:29.499998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.284773+0000","last_change":"2023-06-09T04:40:56.802358+0000","last_active":"2023-06-09T04:41:01.284773+0000","last_peered":"2023-06-09T04:41:01.284773+0000","last_clean":"2023-06-09T04:41:01.284773+0000","last_became_active":"2023-06-09T04:40:56.798262+0000","last_became_peered":"2023-06-09T04:40:56.798262+0000","last_unstale":"2023-06-09T04:41:01.284773+0000","last_undegraded":"2023-06-09T04:41:01.284773+0000","last_fullsized":"2023-06-09T04:41:01.284773+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:44:45.646471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.282293+0000","last_change":"2023-06-09T04:40:56.805149+0000","last_active":"2023-06-09T04:41:01.282293+0000","last_peered":"2023-06-09T04:41:01.282293+0000","last_clean":"2023-06-09T04:41:01.282293+0000","last_became_active":"2023-06-09T04:40:56.804797+0000","last_became_peered":"2023-06-09T04:40:56.804797+0000","last_unstale":"2023-06-09T04:41:01.282293+0000","last_undegraded":"2023-06-09T04:41:01.282293+0000","last_fullsized":"2023-06-09T04:41:01.282293+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:13:45.572440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.287725+0000","last_change":"2023-06-09T04:40:56.798569+0000","last_active":"2023-06-09T04:41:01.287725+0000","last_peered":"2023-06-09T04:41:01.287725+0000","last_clean":"2023-06-09T04:41:01.287725+0000","last_became_active":"2023-06-09T04:40:56.792897+0000","last_became_peered":"2023-06-09T04:40:56.792897+0000","last_unstale":"2023-06-09T04:41:01.287725+0000","last_undegraded":"2023-06-09T04:41:01.287725+0000","last_fullsized":"2023-06-09T04:41:01.287725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:52:36.991160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.286606+0000","last_change":"2023-06-09T04:40:56.803260+0000","last_active":"2023-06-09T04:41:01.286606+0000","last_peered":"2023-06-09T04:41:01.286606+0000","last_clean":"2023-06-09T04:41:01.286606+0000","last_became_active":"2023-06-09T04:40:56.802966+0000","last_became_peered":"2023-06-09T04:40:56.802966+0000","last_unstale":"2023-06-09T04:41:01.286606+0000","last_undegraded":"2023-06-09T04:41:01.286606+0000","last_fullsized":"2023-06-09T04:41:01.286606+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:02:53.168915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.440235+0000","last_change":"2023-06-09T04:40:56.815725+0000","last_active":"2023-06-09T04:41:01.440235+0000","last_peered":"2023-06-09T04:41:01.440235+0000","last_clean":"2023-06-09T04:41:01.440235+0000","last_became_active":"2023-06-09T04:40:56.815369+0000","last_became_peered":"2023-06-09T04:40:56.815369+0000","last_unstale":"2023-06-09T04:41:01.440235+0000","last_undegraded":"2023-06-09T04:41:01.440235+0000","last_fullsized":"2023-06-09T04:41:01.440235+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:13:45.572440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.438161+0000","last_change":"2023-06-09T04:40:56.791652+0000","last_active":"2023-06-09T04:41:01.438161+0000","last_peered":"2023-06-09T04:41:01.438161+0000","last_clean":"2023-06-09T04:41:01.438161+0000","last_became_active":"2023-06-09T04:40:56.791358+0000","last_became_peered":"2023-06-09T04:40:56.791358+0000","last_unstale":"2023-06-09T04:41:01.438161+0000","last_undegraded":"2023-06-09T04:41:01.438161+0000","last_fullsized":"2023-06-09T04:41:01.438161+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:18:56.081370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4591,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":904,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":925696,"data_stored":718949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4379999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.504}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.391}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.181}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.621}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.587}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8220000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":303104,"data_stored":124572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2070000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.252}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0089999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.222}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0429999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":311296,"data_stored":125224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4730000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.173}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.417}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.125}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.534}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3109999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0609999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":323584,"data_stored":128421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.252}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2849999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2150000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.409}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.109}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3109999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":307200,"data_stored":124662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93500000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.415}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4790000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3560000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":303104,"data_stored":124572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2509999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.173}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2070000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.405}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":303104,"data_stored":124572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2350000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4830000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5780000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8080000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6519999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":901120,"data_stored":715522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2969999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.117}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.528}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.147}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.462}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3580000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-09T04:41:25.164 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-06-09T04:41:25.164 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-06-09T04:41:25.164 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-06-09T04:41:25.165 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-06-09T04:41:25.165 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-06-09T04:41:25.371 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.364+0000 7f6025a14700 1 Processor -- start 2023-06-09T04:41:25.371 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.368+0000 7f6025a14700 1 -- start start 2023-06-09T04:41:25.373 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.368+0000 7f6025a14700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f60200ce9c0 0x7f60200cc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:25.374 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.368+0000 7f6025a14700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60200b51e0 con 0x7f60200d1ac0 2023-06-09T04:41:25.374 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.368+0000 7f6025a14700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60200d0190 con 0x7f60200ccf20 2023-06-09T04:41:25.374 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.368+0000 7f6025a14700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60200d29f0 con 0x7f60200ce9c0 2023-06-09T04:41:25.374 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.368+0000 7f6017fff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f60200d1ac0 0x7f60200ced90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:44898/0 (socket says 172.21.15.62:44898) 2023-06-09T04:41:25.374 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.368+0000 7f6017fff700 1 -- 172.21.15.62:0/3066641577 learned_addr learned my addr 172.21.15.62:0/3066641577 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:41:25.375 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.368+0000 7f6024a12700 1 --2- 172.21.15.62:0/3066641577 >> v2:172.21.15.89:3300/0 conn(0x7f60200ce9c0 0x7f60200cc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:25.376 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.368+0000 7f60177fe700 1 -- 172.21.15.62:0/3066641577 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3936819073 0 0) 0x7f60200b51e0 con 0x7f60200d1ac0 2023-06-09T04:41:25.376 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.368+0000 7f60177fe700 1 -- 172.21.15.62:0/3066641577 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60080035d0 con 0x7f60200d1ac0 2023-06-09T04:41:25.376 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.372+0000 7f60177fe700 1 -- 172.21.15.62:0/3066641577 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2340754896 0 0) 0x7f60200d0190 con 0x7f60200ccf20 2023-06-09T04:41:25.376 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.372+0000 7f60177fe700 1 -- 172.21.15.62:0/3066641577 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60200b51e0 con 0x7f60200ccf20 2023-06-09T04:41:25.376 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.372+0000 7f60177fe700 1 -- 172.21.15.62:0/3066641577 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1500092466 0 0) 0x7f60080035d0 con 0x7f60200d1ac0 2023-06-09T04:41:25.376 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.372+0000 7f60177fe700 1 -- 172.21.15.62:0/3066641577 >> v2:172.21.15.89:3300/0 conn(0x7f60200ce9c0 msgr2=0x7f60200cc9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:25.376 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.372+0000 7f60177fe700 1 --2- 172.21.15.62:0/3066641577 >> v2:172.21.15.89:3300/0 conn(0x7f60200ce9c0 0x7f60200cc9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:25.377 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.372+0000 7f60177fe700 1 -- 172.21.15.62:0/3066641577 >> v1:172.21.15.89:6789/0 conn(0x7f60200ccf20 legacy=0x7f6020165730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:25.377 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.372+0000 7f60177fe700 1 -- 172.21.15.62:0/3066641577 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60200d2cd0 con 0x7f60200d1ac0 2023-06-09T04:41:25.377 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.372+0000 7f60177fe700 1 -- 172.21.15.62:0/3066641577 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 540845019 0 0) 0x7f6010001670 con 0x7f60200d1ac0 2023-06-09T04:41:25.377 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.372+0000 7f60177fe700 1 -- 172.21.15.62:0/3066641577 >> v1:172.21.15.62:6789/0 conn(0x7f60200d1ac0 legacy=0x7f60200ced90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:25.377 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.372+0000 7f60177fe700 1 --2- 172.21.15.62:0/3066641577 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6008003c00 0x7f6008003ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:25.377 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.372+0000 7f60177fe700 1 --2- 172.21.15.62:0/3066641577 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6008004870 0x7f6008004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:25.377 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.372+0000 7f60177fe700 1 --2- 172.21.15.62:0/3066641577 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6008005270 0x7f600800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:25.377 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.372+0000 7f60177fe700 1 -- 172.21.15.62:0/3066641577 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60200d29f0 con 0x7f6008004870 2023-06-09T04:41:25.378 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.372+0000 7f60177fe700 1 -- 172.21.15.62:0/3066641577 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f600800c180 con 0x7f6008005270 2023-06-09T04:41:25.378 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.372+0000 7f60177fe700 1 -- 172.21.15.62:0/3066641577 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f600800c340 con 0x7f6008003c00 2023-06-09T04:41:25.378 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.372+0000 7f6024a12700 1 --2- 172.21.15.62:0/3066641577 >> v2:172.21.15.89:3300/0 conn(0x7f60200ce9c0 0x7f60200cc9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:41:25.379 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.372+0000 7f6017fff700 1 --2- 172.21.15.62:0/3066641577 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6008004870 0x7f6008004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:25.379 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.372+0000 7f6025213700 1 --2- 172.21.15.62:0/3066641577 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6008005270 0x7f600800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:25.379 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.372+0000 7f6024a12700 1 --2- 172.21.15.62:0/3066641577 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6008003c00 0x7f6008003ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:25.380 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.372+0000 7f6017fff700 1 -- 172.21.15.62:0/3066641577 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6008003c00 msgr2=0x7f6008003ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:25.380 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.372+0000 7f6017fff700 1 --2- 172.21.15.62:0/3066641577 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6008003c00 0x7f6008003ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:25.380 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.372+0000 7f6017fff700 1 -- 172.21.15.62:0/3066641577 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6008005270 msgr2=0x7f600800ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:25.380 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.372+0000 7f6017fff700 1 --2- 172.21.15.62:0/3066641577 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6008005270 0x7f600800ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:25.380 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.372+0000 7f6017fff700 1 -- 172.21.15.62:0/3066641577 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60080035d0 con 0x7f6008004870 2023-06-09T04:41:25.380 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.372+0000 7f6025213700 1 -- 172.21.15.62:0/3066641577 reap_dead start 2023-06-09T04:41:25.380 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.372+0000 7f6017fff700 1 --2- 172.21.15.62:0/3066641577 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6008004870 0x7f6008004ce0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f601000c0e0 tx=0x7f60080058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e22ffdcff0e6a39 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:25.381 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.372+0000 7f60177fe700 1 -- 172.21.15.62:0/3066641577 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601000cc80 con 0x7f6008004870 2023-06-09T04:41:25.381 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.372+0000 7f60177fe700 1 -- 172.21.15.62:0/3066641577 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f601000cde0 con 0x7f6008004870 2023-06-09T04:41:25.381 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.372+0000 7f60177fe700 1 -- 172.21.15.62:0/3066641577 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6010005bc0 con 0x7f6008004870 2023-06-09T04:41:25.381 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.372+0000 7f6025a14700 1 -- 172.21.15.62:0/3066641577 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6008004870 msgr2=0x7f6008004ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:25.381 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.372+0000 7f6025a14700 1 --2- 172.21.15.62:0/3066641577 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6008004870 0x7f6008004ce0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f601000c0e0 tx=0x7f60080058a0 comp rx=0 tx=0).stop 2023-06-09T04:41:25.381 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.376+0000 7f6025a14700 1 -- 172.21.15.62:0/3066641577 shutdown_connections 2023-06-09T04:41:25.381 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.376+0000 7f6025a14700 1 --2- 172.21.15.62:0/3066641577 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6008004870 0x7f6008004ce0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:25.381 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.376+0000 7f6025a14700 1 -- 172.21.15.62:0/3066641577 >> 172.21.15.62:0/3066641577 conn(0x7f6020070f20 msgr2=0x7f60200712f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:25.382 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.376+0000 7f6025a14700 1 -- 172.21.15.62:0/3066641577 shutdown_connections 2023-06-09T04:41:25.382 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.376+0000 7f6025a14700 1 -- 172.21.15.62:0/3066641577 wait complete. 2023-06-09T04:41:25.382 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.376+0000 7f6025a14700 1 Processor -- start 2023-06-09T04:41:25.382 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.376+0000 7f6025a14700 1 -- start start 2023-06-09T04:41:25.383 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.380+0000 7f6025a14700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6008004870 0x7f60201f14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:25.384 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.380+0000 7f6025a14700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60200b06a0 0x7f60200ca130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:25.384 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.380+0000 7f6025a14700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60200b6ab0 0x7f60200b6f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:25.384 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.380+0000 7f6025a14700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60201f2830 con 0x7f6008004870 2023-06-09T04:41:25.384 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.380+0000 7f6025a14700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60200b7460 con 0x7f60200b06a0 2023-06-09T04:41:25.384 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.380+0000 7f6025a14700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60200b0b10 con 0x7f60200b6ab0 2023-06-09T04:41:25.385 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.380+0000 7f6024a12700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6008004870 0x7f60201f14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:25.385 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.380+0000 7f6024a12700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6008004870 0x7f60201f14f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40272/0 (socket says 172.21.15.62:40272) 2023-06-09T04:41:25.386 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.380+0000 7f6024a12700 1 -- 172.21.15.62:0/1401977605 learned_addr learned my addr 172.21.15.62:0/1401977605 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:25.386 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.380+0000 7f6025213700 1 --2- 172.21.15.62:0/1401977605 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60200b6ab0 0x7f60200b6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:25.386 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.380+0000 7f6017fff700 1 --2- 172.21.15.62:0/1401977605 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60200b06a0 0x7f60200ca130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:25.386 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.380+0000 7f6024a12700 1 -- 172.21.15.62:0/1401977605 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60200b6ab0 msgr2=0x7f60200b6f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:25.386 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.380+0000 7f6024a12700 1 --2- 172.21.15.62:0/1401977605 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60200b6ab0 0x7f60200b6f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:25.386 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.380+0000 7f6024a12700 1 -- 172.21.15.62:0/1401977605 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60200b06a0 msgr2=0x7f60200ca130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:25.386 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.380+0000 7f6024a12700 1 --2- 172.21.15.62:0/1401977605 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60200b06a0 0x7f60200ca130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:25.386 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.380+0000 7f6024a12700 1 -- 172.21.15.62:0/1401977605 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60201f1b80 con 0x7f6008004870 2023-06-09T04:41:25.387 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.380+0000 7f6024a12700 1 --2- 172.21.15.62:0/1401977605 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6008004870 0x7f60201f14f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f601c011430 tx=0x7f601c011740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:25.387 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.380+0000 7f60157fa700 1 -- 172.21.15.62:0/1401977605 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601c00e030 con 0x7f6008004870 2023-06-09T04:41:25.387 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.380+0000 7f6025a14700 1 -- 172.21.15.62:0/1401977605 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60201f1e60 con 0x7f6008004870 2023-06-09T04:41:25.388 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.380+0000 7f60157fa700 1 -- 172.21.15.62:0/1401977605 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f601c011e30 con 0x7f6008004870 2023-06-09T04:41:25.388 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.380+0000 7f60157fa700 1 -- 172.21.15.62:0/1401977605 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601c016690 con 0x7f6008004870 2023-06-09T04:41:25.388 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.380+0000 7f6025a14700 1 -- 172.21.15.62:0/1401977605 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60201f2420 con 0x7f6008004870 2023-06-09T04:41:25.388 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.384+0000 7f6025a14700 1 -- 172.21.15.62:0/1401977605 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60201f2970 con 0x7f6008004870 2023-06-09T04:41:25.389 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.384+0000 7f60157fa700 1 -- 172.21.15.62:0/1401977605 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f601c0167f0 con 0x7f6008004870 2023-06-09T04:41:25.391 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.388+0000 7f60157fa700 1 --2- 172.21.15.62:0/1401977605 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f600c0662f0 0x7f600c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:25.391 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.388+0000 7f60157fa700 1 -- 172.21.15.62:0/1401977605 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f601c00f070 con 0x7f6008004870 2023-06-09T04:41:25.392 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.388+0000 7f6017fff700 1 --2- 172.21.15.62:0/1401977605 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f600c0662f0 0x7f600c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:25.393 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.388+0000 7f6017fff700 1 --2- 172.21.15.62:0/1401977605 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f600c0662f0 0x7f600c0687a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6010000c00 tx=0x7f6010007000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:25.397 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.392+0000 7f60157fa700 1 -- 172.21.15.62:0/1401977605 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f60201f2970 con 0x7f6008004870 2023-06-09T04:41:25.609 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.604+0000 7f6025a14700 1 -- 172.21.15.62:0/1401977605 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f60201f2970 con 0x7f6008004870 2023-06-09T04:41:25.616 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.612+0000 7f60157fa700 1 -- 172.21.15.62:0/1401977605 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164242 (secure 0 0 0) 0x7f60201f2970 con 0x7f6008004870 2023-06-09T04:41:25.619 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:41:25.621 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.616+0000 7f6025a14700 1 -- 172.21.15.62:0/1401977605 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f600c0662f0 msgr2=0x7f600c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:25.621 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.616+0000 7f6025a14700 1 --2- 172.21.15.62:0/1401977605 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f600c0662f0 0x7f600c0687a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6010000c00 tx=0x7f6010007000 comp rx=0 tx=0).stop 2023-06-09T04:41:25.621 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.616+0000 7f6025a14700 1 -- 172.21.15.62:0/1401977605 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6008004870 msgr2=0x7f60201f14f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:25.621 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.616+0000 7f6025a14700 1 --2- 172.21.15.62:0/1401977605 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6008004870 0x7f60201f14f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f601c011430 tx=0x7f601c011740 comp rx=0 tx=0).stop 2023-06-09T04:41:25.622 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.616+0000 7f6025a14700 1 -- 172.21.15.62:0/1401977605 shutdown_connections 2023-06-09T04:41:25.622 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.616+0000 7f6025a14700 1 --2- 172.21.15.62:0/1401977605 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f600c0662f0 0x7f600c0687a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:25.622 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.616+0000 7f6025a14700 1 --2- 172.21.15.62:0/1401977605 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f60200b6ab0 0x7f60200b6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:25.622 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.616+0000 7f6025a14700 1 --2- 172.21.15.62:0/1401977605 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f60200b06a0 0x7f60200ca130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:25.622 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.616+0000 7f6025a14700 1 --2- 172.21.15.62:0/1401977605 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6008004870 0x7f60201f14f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:25.622 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.616+0000 7f6025a14700 1 -- 172.21.15.62:0/1401977605 >> 172.21.15.62:0/1401977605 conn(0x7f6020070f20 msgr2=0x7f60200ced90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:25.623 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.616+0000 7f6025a14700 1 -- 172.21.15.62:0/1401977605 shutdown_connections 2023-06-09T04:41:25.623 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.616+0000 7f6025a14700 1 -- 172.21.15.62:0/1401977605 wait complete. 2023-06-09T04:41:25.644 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":5,"active_gid":4106,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6832","nonce":3073446405},{"type":"v1","addr":"172.21.15.89:6833","nonce":3073446405}]},"active_addr":"172.21.15.89:6833/3073446405","active_change":"2023-06-09T04:40:36.533993+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4107,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.89:0","nonce":1945347663}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.89:0","nonce":3550313135}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.89:0","nonce":1539353399}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.89:0","nonce":1397993817}]}]} 2023-06-09T04:41:25.648 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-06-09T04:41:25.648 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-06-09T04:41:25.649 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:41:25.826 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.820+0000 7f565a614700 1 Processor -- start 2023-06-09T04:41:25.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.820+0000 7f565a614700 1 -- start start 2023-06-09T04:41:25.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.824+0000 7f565a614700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5654160340 0x7f56540caa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:25.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.824+0000 7f565a614700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f56540caf80 0x7f5654163df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:25.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.824+0000 7f565a614700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56540cdc20 con 0x7f565415ff70 2023-06-09T04:41:25.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.824+0000 7f565a614700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56540cb400 con 0x7f56540caf80 2023-06-09T04:41:25.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.824+0000 7f565a614700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56540cd330 con 0x7f5654160340 2023-06-09T04:41:25.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.824+0000 7f5659612700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f565415ff70 0x7f56540c9cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:44904/0 (socket says 172.21.15.62:44904) 2023-06-09T04:41:25.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.824+0000 7f5659612700 1 -- 172.21.15.62:0/2183660862 learned_addr learned my addr 172.21.15.62:0/2183660862 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:41:25.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.824+0000 7f5659e13700 1 --2- 172.21.15.62:0/2183660862 >> v2:172.21.15.62:3300/0 conn(0x7f56540caf80 0x7f5654163df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:25.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.824+0000 7f5658e11700 1 --2- 172.21.15.62:0/2183660862 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5654160340 0x7f56540caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:25.832 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.828+0000 7f564bfff700 1 -- 172.21.15.62:0/2183660862 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 383772734 0 0) 0x7f56540cdc20 con 0x7f565415ff70 2023-06-09T04:41:25.832 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.828+0000 7f564bfff700 1 -- 172.21.15.62:0/2183660862 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56400035d0 con 0x7f565415ff70 2023-06-09T04:41:25.832 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.828+0000 7f5659e13700 1 -- 172.21.15.62:0/2183660862 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5654160340 msgr2=0x7f56540caa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:25.832 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.828+0000 7f5659e13700 1 --2- 172.21.15.62:0/2183660862 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5654160340 0x7f56540caa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:25.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.828+0000 7f5659e13700 1 -- 172.21.15.62:0/2183660862 >> v1:172.21.15.62:6789/0 conn(0x7f565415ff70 legacy=0x7f56540c9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:25.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.828+0000 7f5659e13700 1 -- 172.21.15.62:0/2183660862 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56540cd5d0 con 0x7f56540caf80 2023-06-09T04:41:25.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.828+0000 7f5658e11700 1 --2- 172.21.15.62:0/2183660862 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5654160340 0x7f56540caa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:41:25.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.828+0000 7f5659e13700 1 --2- 172.21.15.62:0/2183660862 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56540caf80 0x7f5654163df0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f564c009d90 tx=0x7f564c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d44fe61341d7e668 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:25.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.828+0000 7f564bfff700 1 -- 172.21.15.62:0/2183660862 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564c00e070 con 0x7f56540caf80 2023-06-09T04:41:25.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.828+0000 7f564bfff700 1 -- 172.21.15.62:0/2183660862 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f564c00bb20 con 0x7f56540caf80 2023-06-09T04:41:25.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.828+0000 7f564bfff700 1 -- 172.21.15.62:0/2183660862 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564c012430 con 0x7f56540caf80 2023-06-09T04:41:25.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.828+0000 7f565a614700 1 -- 172.21.15.62:0/2183660862 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56540caf80 msgr2=0x7f5654163df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:25.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.828+0000 7f565a614700 1 --2- 172.21.15.62:0/2183660862 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56540caf80 0x7f5654163df0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f564c009d90 tx=0x7f564c00b330 comp rx=0 tx=0).stop 2023-06-09T04:41:25.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.828+0000 7f565a614700 1 -- 172.21.15.62:0/2183660862 shutdown_connections 2023-06-09T04:41:25.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.828+0000 7f565a614700 1 --2- 172.21.15.62:0/2183660862 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f56540caf80 0x7f5654163df0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:25.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.828+0000 7f565a614700 1 --2- 172.21.15.62:0/2183660862 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5654160340 0x7f56540caa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:25.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.828+0000 7f565a614700 1 -- 172.21.15.62:0/2183660862 >> 172.21.15.62:0/2183660862 conn(0x7f565406a420 msgr2=0x7f56540afc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:25.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.828+0000 7f565a614700 1 -- 172.21.15.62:0/2183660862 shutdown_connections 2023-06-09T04:41:25.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.828+0000 7f565a614700 1 -- 172.21.15.62:0/2183660862 wait complete. 2023-06-09T04:41:25.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.832+0000 7f565a614700 1 Processor -- start 2023-06-09T04:41:25.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.832+0000 7f565a614700 1 -- start start 2023-06-09T04:41:25.837 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.832+0000 7f565a614700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f565415ff70 0x7f56541540e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:25.837 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.832+0000 7f565a614700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5654160340 0x7f56540b1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:25.837 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.832+0000 7f565a614700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56540b1e70 0x7f56541ea050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:25.838 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.832+0000 7f565a614700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56540b3620 con 0x7f5654160340 2023-06-09T04:41:25.838 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.832+0000 7f565a614700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56540c42e0 con 0x7f565415ff70 2023-06-09T04:41:25.838 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.832+0000 7f565a614700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56540b2a10 con 0x7f56540b1e70 2023-06-09T04:41:25.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.832+0000 7f5658e11700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5654160340 0x7f56540b1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:25.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.832+0000 7f5658e11700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5654160340 0x7f56540b1930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40286/0 (socket says 172.21.15.62:40286) 2023-06-09T04:41:25.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.832+0000 7f5658e11700 1 -- 172.21.15.62:0/1470990541 learned_addr learned my addr 172.21.15.62:0/1470990541 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:25.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.832+0000 7f5659e13700 1 --2- 172.21.15.62:0/1470990541 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56540b1e70 0x7f56541ea050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:25.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.832+0000 7f5659612700 1 --2- 172.21.15.62:0/1470990541 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f565415ff70 0x7f56541540e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:25.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.832+0000 7f5658e11700 1 -- 172.21.15.62:0/1470990541 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56540b1e70 msgr2=0x7f56541ea050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:25.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.832+0000 7f5658e11700 1 --2- 172.21.15.62:0/1470990541 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56540b1e70 0x7f56541ea050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:25.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.832+0000 7f5658e11700 1 -- 172.21.15.62:0/1470990541 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f565415ff70 msgr2=0x7f56541540e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:25.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.832+0000 7f5658e11700 1 --2- 172.21.15.62:0/1470990541 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f565415ff70 0x7f56541540e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:25.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.832+0000 7f5658e11700 1 -- 172.21.15.62:0/1470990541 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56440094b0 con 0x7f5654160340 2023-06-09T04:41:25.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.832+0000 7f5659e13700 1 --2- 172.21.15.62:0/1470990541 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56540b1e70 0x7f56541ea050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:41:25.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.832+0000 7f5659612700 1 --2- 172.21.15.62:0/1470990541 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f565415ff70 0x7f56541540e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:41:25.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.832+0000 7f5658e11700 1 --2- 172.21.15.62:0/1470990541 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5654160340 0x7f56540b1930 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f564400e9e0 tx=0x7f564400eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:25.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.836+0000 7f5649ffb700 1 -- 172.21.15.62:0/1470990541 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564400c850 con 0x7f5654160340 2023-06-09T04:41:25.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.836+0000 7f5649ffb700 1 -- 172.21.15.62:0/1470990541 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f564400c9b0 con 0x7f5654160340 2023-06-09T04:41:25.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.836+0000 7f5649ffb700 1 -- 172.21.15.62:0/1470990541 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564400cd60 con 0x7f5654160340 2023-06-09T04:41:25.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.836+0000 7f565a614700 1 -- 172.21.15.62:0/1470990541 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f564c009a70 con 0x7f5654160340 2023-06-09T04:41:25.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.836+0000 7f565a614700 1 -- 172.21.15.62:0/1470990541 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56540b2fd0 con 0x7f5654160340 2023-06-09T04:41:25.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.836+0000 7f565a614700 1 -- 172.21.15.62:0/1470990541 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56540b37d0 con 0x7f5654160340 2023-06-09T04:41:25.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.836+0000 7f5649ffb700 1 -- 172.21.15.62:0/1470990541 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5644013470 con 0x7f5654160340 2023-06-09T04:41:25.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.840+0000 7f5649ffb700 1 --2- 172.21.15.62:0/1470990541 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f56380662f0 0x7f56380687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:25.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.840+0000 7f5649ffb700 1 -- 172.21.15.62:0/1470990541 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5644083e20 con 0x7f5654160340 2023-06-09T04:41:25.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.840+0000 7f5659612700 1 --2- 172.21.15.62:0/1470990541 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f56380662f0 0x7f56380687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:25.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.840+0000 7f5659612700 1 --2- 172.21.15.62:0/1470990541 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f56380662f0 0x7f56380687a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f56500011e0 tx=0x7f5650009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:25.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:25.844+0000 7f5649ffb700 1 -- 172.21.15.62:0/1470990541 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f56540b37d0 con 0x7f5654160340 2023-06-09T04:41:26.021 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.016+0000 7f565a614700 1 -- 172.21.15.62:0/1470990541 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f56540b37d0 con 0x7f5654160340 2023-06-09T04:41:26.024 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.020+0000 7f5649ffb700 1 -- 172.21.15.62:0/1470990541 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20084 (secure 0 0 0) 0x7f56540b37d0 con 0x7f5654160340 2023-06-09T04:41:26.024 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:41:26.025 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":28,"fsid":"f7998a1e-e5a9-4202-abaa-70c0eaae1047","created":"2023-06-09T04:40:30.469588+0000","modified":"2023-06-09T04:41:01.271858+0000","last_up_change":"2023-06-09T04:40:43.120747+0000","last_in_change":"2023-06-09T04:40:33.568221+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:40:44.646921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:40:50.006643+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:40:55.031273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:40:55.773517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-09T04:40:58.845383+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bc50bbc0-dd08-42ed-804c-ec3029e36c19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6802","nonce":1295788017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6807","nonce":1295788017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6815","nonce":1295788017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6809","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6811","nonce":1295788017}]},"public_addr":"172.21.15.62:6802/1295788017","cluster_addr":"172.21.15.62:6807/1295788017","heartbeat_back_addr":"172.21.15.62:6815/1295788017","heartbeat_front_addr":"172.21.15.62:6811/1295788017","state":["exists","up"]},{"osd":1,"uuid":"8230b12d-e22f-4985-a584-4cc64404cdbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6825","nonce":4120692006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6827","nonce":4120692006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6831","nonce":4120692006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6829","nonce":4120692006}]},"public_addr":"172.21.15.62:6825/4120692006","cluster_addr":"172.21.15.62:6827/4120692006","heartbeat_back_addr":"172.21.15.62:6831/4120692006","heartbeat_front_addr":"172.21.15.62:6829/4120692006","state":["exists","up"]},{"osd":2,"uuid":"d0202506-dbe9-4e3c-9271-687929abf96a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6801","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6803","nonce":4169607876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6805","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6806","nonce":4169607876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6814","nonce":4169607876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6810","nonce":4169607876}]},"public_addr":"172.21.15.62:6803/4169607876","cluster_addr":"172.21.15.62:6806/4169607876","heartbeat_back_addr":"172.21.15.62:6814/4169607876","heartbeat_front_addr":"172.21.15.62:6810/4169607876","state":["exists","up"]},{"osd":3,"uuid":"f3c0298a-b075-4411-af50-e16cd74fdddb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6817","nonce":3268438986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6819","nonce":3268438986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6823","nonce":3268438986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6821","nonce":3268438986}]},"public_addr":"172.21.15.62:6817/3268438986","cluster_addr":"172.21.15.62:6819/3268438986","heartbeat_back_addr":"172.21.15.62:6823/3268438986","heartbeat_front_addr":"172.21.15.62:6821/3268438986","state":["exists","up"]},{"osd":4,"uuid":"1ab5c5ca-e74f-475a-a309-683cc0029928","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6817","nonce":3139617628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6819","nonce":3139617628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6823","nonce":3139617628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6821","nonce":3139617628}]},"public_addr":"172.21.15.89:6817/3139617628","cluster_addr":"172.21.15.89:6819/3139617628","heartbeat_back_addr":"172.21.15.89:6823/3139617628","heartbeat_front_addr":"172.21.15.89:6821/3139617628","state":["exists","up"]},{"osd":5,"uuid":"a933e184-bd8f-4369-a1ba-a68de53c578c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6825","nonce":2681723596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6827","nonce":2681723596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6831","nonce":2681723596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6829","nonce":2681723596}]},"public_addr":"172.21.15.89:6825/2681723596","cluster_addr":"172.21.15.89:6827/2681723596","heartbeat_back_addr":"172.21.15.89:6831/2681723596","heartbeat_front_addr":"172.21.15.89:6829/2681723596","state":["exists","up"]},{"osd":6,"uuid":"1ed7ad37-2eee-49a6-954c-b537e2b7f0ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6809","nonce":1657136033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6811","nonce":1657136033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6815","nonce":1657136033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6813","nonce":1657136033}]},"public_addr":"172.21.15.89:6809/1657136033","cluster_addr":"172.21.15.89:6811/1657136033","heartbeat_back_addr":"172.21.15.89:6815/1657136033","heartbeat_front_addr":"172.21.15.89:6813/1657136033","state":["exists","up"]},{"osd":7,"uuid":"6ed732e9-33ff-40df-9038-a9f1d1622671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6801","nonce":1710561686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6803","nonce":1710561686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6807","nonce":1710561686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6805","nonce":1710561686}]},"public_addr":"172.21.15.89:6801/1710561686","cluster_addr":"172.21.15.89:6803/1710561686","heartbeat_back_addr":"172.21.15.89:6807/1710561686","heartbeat_front_addr":"172.21.15.89:6805/1710561686","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.335803+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.419788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.179334+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.263310+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.071846+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.375627+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.282277+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.315997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:41:26.026 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.020+0000 7f565a614700 1 -- 172.21.15.62:0/1470990541 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f56380662f0 msgr2=0x7f56380687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:26.027 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.020+0000 7f565a614700 1 --2- 172.21.15.62:0/1470990541 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f56380662f0 0x7f56380687a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f56500011e0 tx=0x7f5650009040 comp rx=0 tx=0).stop 2023-06-09T04:41:26.027 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.020+0000 7f565a614700 1 -- 172.21.15.62:0/1470990541 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5654160340 msgr2=0x7f56540b1930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:26.027 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.020+0000 7f565a614700 1 --2- 172.21.15.62:0/1470990541 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5654160340 0x7f56540b1930 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f564400e9e0 tx=0x7f564400eda0 comp rx=0 tx=0).stop 2023-06-09T04:41:26.027 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.020+0000 7f565a614700 1 -- 172.21.15.62:0/1470990541 shutdown_connections 2023-06-09T04:41:26.027 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.020+0000 7f565a614700 1 --2- 172.21.15.62:0/1470990541 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f56380662f0 0x7f56380687a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:26.028 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.020+0000 7f565a614700 1 --2- 172.21.15.62:0/1470990541 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f56540b1e70 0x7f56541ea050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:26.028 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.020+0000 7f565a614700 1 --2- 172.21.15.62:0/1470990541 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5654160340 0x7f56540b1930 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:26.028 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.020+0000 7f565a614700 1 --2- 172.21.15.62:0/1470990541 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f565415ff70 0x7f56541540e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:26.028 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.020+0000 7f565a614700 1 -- 172.21.15.62:0/1470990541 >> 172.21.15.62:0/1470990541 conn(0x7f56540caf80 msgr2=0x7f5654155180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:26.028 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.024+0000 7f565a614700 1 -- 172.21.15.62:0/1470990541 shutdown_connections 2023-06-09T04:41:26.028 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.024+0000 7f565a614700 1 -- 172.21.15.62:0/1470990541 wait complete. 2023-06-09T04:41:26.048 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-06-09T04:41:26.048 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:41:26.219 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.216+0000 7ff29877f700 1 Processor -- start 2023-06-09T04:41:26.220 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.216+0000 7ff29877f700 1 -- start start 2023-06-09T04:41:26.223 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.220+0000 7ff29877f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff29015c060 0x7ff2900c9780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:26.223 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.220+0000 7ff29877f700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff2900707f0 0x7ff290070c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:26.223 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.220+0000 7ff29877f700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff29006b5a0 0x7ff29006ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:26.224 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.220+0000 7ff29877f700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff29006bf60 con 0x7ff2900707f0 2023-06-09T04:41:26.224 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.220+0000 7ff29877f700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff29015c430 con 0x7ff29006b5a0 2023-06-09T04:41:26.224 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.220+0000 7ff29877f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2900c9cc0 con 0x7ff29015c060 2023-06-09T04:41:26.224 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.220+0000 7ff296d1c700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff29006b5a0 0x7ff29006ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:26.224 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.220+0000 7ff295d1a700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff2900707f0 0x7ff290070c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:26.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.220+0000 7ff296d1c700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff29006b5a0 0x7ff29006ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.62:44006/0 (socket says 172.21.15.62:44006) 2023-06-09T04:41:26.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.220+0000 7ff296d1c700 1 -- 172.21.15.62:0/3888059356 learned_addr learned my addr 172.21.15.62:0/3888059356 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:26.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.220+0000 7ff29651b700 1 --2- 172.21.15.62:0/3888059356 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff29015c060 0x7ff2900c9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:26.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.220+0000 7ff296d1c700 1 -- 172.21.15.62:0/3888059356 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff29015c060 msgr2=0x7ff2900c9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:26.226 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.220+0000 7ff296d1c700 1 --2- 172.21.15.62:0/3888059356 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff29015c060 0x7ff2900c9780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:26.226 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.220+0000 7ff296d1c700 1 -- 172.21.15.62:0/3888059356 >> v2:172.21.15.62:3300/0 conn(0x7ff2900707f0 msgr2=0x7ff290070c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:26.226 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.220+0000 7ff296d1c700 1 --2- 172.21.15.62:0/3888059356 >> v2:172.21.15.62:3300/0 conn(0x7ff2900707f0 0x7ff290070c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:26.226 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.220+0000 7ff296d1c700 1 -- 172.21.15.62:0/3888059356 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2900c89c0 con 0x7ff29006b5a0 2023-06-09T04:41:26.226 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.220+0000 7ff295d1a700 1 --2- 172.21.15.62:0/3888059356 >> v2:172.21.15.62:3300/0 conn(0x7ff2900707f0 0x7ff290070c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:41:26.226 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.220+0000 7ff296d1c700 1 --2- 172.21.15.62:0/3888059356 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff29006b5a0 0x7ff29006ba20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff2900ada40 tx=0x7ff28800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72776bfc32c9ad8 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:26.227 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.220+0000 7ff295519700 1 -- 172.21.15.62:0/3888059356 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff28800e070 con 0x7ff29006b5a0 2023-06-09T04:41:26.227 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.220+0000 7ff295519700 1 -- 172.21.15.62:0/3888059356 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff28800b910 con 0x7ff29006b5a0 2023-06-09T04:41:26.227 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.220+0000 7ff295519700 1 -- 172.21.15.62:0/3888059356 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff28800bcc0 con 0x7ff29006b5a0 2023-06-09T04:41:26.228 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.224+0000 7ff29877f700 1 -- 172.21.15.62:0/3888059356 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff29006b5a0 msgr2=0x7ff29006ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:26.228 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.224+0000 7ff29877f700 1 --2- 172.21.15.62:0/3888059356 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff29006b5a0 0x7ff29006ba20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff2900ada40 tx=0x7ff28800b330 comp rx=0 tx=0).stop 2023-06-09T04:41:26.228 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.224+0000 7ff29877f700 1 -- 172.21.15.62:0/3888059356 shutdown_connections 2023-06-09T04:41:26.228 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.224+0000 7ff29877f700 1 --2- 172.21.15.62:0/3888059356 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff29006b5a0 0x7ff29006ba20 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:26.228 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.224+0000 7ff29877f700 1 --2- 172.21.15.62:0/3888059356 >> v2:172.21.15.62:3300/0 conn(0x7ff2900707f0 0x7ff290070c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:26.228 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.224+0000 7ff29877f700 1 --2- 172.21.15.62:0/3888059356 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff29015c060 0x7ff2900c9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:26.228 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.224+0000 7ff29877f700 1 -- 172.21.15.62:0/3888059356 >> 172.21.15.62:0/3888059356 conn(0x7ff29006a410 msgr2=0x7ff2900afd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:26.229 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.224+0000 7ff29877f700 1 -- 172.21.15.62:0/3888059356 shutdown_connections 2023-06-09T04:41:26.229 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.224+0000 7ff29877f700 1 -- 172.21.15.62:0/3888059356 wait complete. 2023-06-09T04:41:26.230 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.224+0000 7ff29877f700 1 Processor -- start 2023-06-09T04:41:26.230 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.224+0000 7ff29877f700 1 -- start start 2023-06-09T04:41:26.231 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.228+0000 7ff29877f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff29006b5a0 0x7ff2900b1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:26.232 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.228+0000 7ff29877f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff2900707f0 0x7ff290154260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:26.232 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.228+0000 7ff29877f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff29015c060 0x7ff2900b3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:26.232 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.228+0000 7ff29877f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2900cca60 con 0x7ff29015c060 2023-06-09T04:41:26.232 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.228+0000 7ff29877f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2900b3e20 con 0x7ff2900707f0 2023-06-09T04:41:26.232 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.228+0000 7ff29877f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2900cc410 con 0x7ff29006b5a0 2023-06-09T04:41:26.233 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.228+0000 7ff296d1c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff29015c060 0x7ff2900b3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:26.233 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.228+0000 7ff296d1c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff29015c060 0x7ff2900b3360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40314/0 (socket says 172.21.15.62:40314) 2023-06-09T04:41:26.233 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.228+0000 7ff296d1c700 1 -- 172.21.15.62:0/3149031306 learned_addr learned my addr 172.21.15.62:0/3149031306 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:26.234 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.228+0000 7ff295d1a700 1 --2- 172.21.15.62:0/3149031306 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff2900707f0 0x7ff290154260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:26.234 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.228+0000 7ff29651b700 1 --2- 172.21.15.62:0/3149031306 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff29006b5a0 0x7ff2900b1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:26.234 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.228+0000 7ff296d1c700 1 -- 172.21.15.62:0/3149031306 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff29006b5a0 msgr2=0x7ff2900b1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:26.234 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.228+0000 7ff296d1c700 1 --2- 172.21.15.62:0/3149031306 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff29006b5a0 0x7ff2900b1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:26.234 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.228+0000 7ff296d1c700 1 -- 172.21.15.62:0/3149031306 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff2900707f0 msgr2=0x7ff290154260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:26.234 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.228+0000 7ff296d1c700 1 --2- 172.21.15.62:0/3149031306 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff2900707f0 0x7ff290154260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:26.234 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.228+0000 7ff296d1c700 1 -- 172.21.15.62:0/3149031306 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2800094b0 con 0x7ff29015c060 2023-06-09T04:41:26.235 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.228+0000 7ff296d1c700 1 --2- 172.21.15.62:0/3149031306 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff29015c060 0x7ff2900b3360 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff28800b370 tx=0x7ff288004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:26.235 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.228+0000 7ff286ffd700 1 -- 172.21.15.62:0/3149031306 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2880099b0 con 0x7ff29015c060 2023-06-09T04:41:26.235 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.228+0000 7ff286ffd700 1 -- 172.21.15.62:0/3149031306 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff28800ce80 con 0x7ff29015c060 2023-06-09T04:41:26.235 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.228+0000 7ff29877f700 1 -- 172.21.15.62:0/3149031306 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff288009b30 con 0x7ff29015c060 2023-06-09T04:41:26.236 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.228+0000 7ff286ffd700 1 -- 172.21.15.62:0/3149031306 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff288004470 con 0x7ff29015c060 2023-06-09T04:41:26.236 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.228+0000 7ff29877f700 1 -- 172.21.15.62:0/3149031306 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2900cc090 con 0x7ff29015c060 2023-06-09T04:41:26.236 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.232+0000 7ff29877f700 1 -- 172.21.15.62:0/3149031306 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff29004db30 con 0x7ff29015c060 2023-06-09T04:41:26.237 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.232+0000 7ff286ffd700 1 -- 172.21.15.62:0/3149031306 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff2880045d0 con 0x7ff29015c060 2023-06-09T04:41:26.239 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.236+0000 7ff286ffd700 1 --2- 172.21.15.62:0/3149031306 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7ff2740662f0 0x7ff2740687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:26.239 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.236+0000 7ff286ffd700 1 -- 172.21.15.62:0/3149031306 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff288085350 con 0x7ff29015c060 2023-06-09T04:41:26.240 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.236+0000 7ff29651b700 1 --2- 172.21.15.62:0/3149031306 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7ff2740662f0 0x7ff2740687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:26.241 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.236+0000 7ff29651b700 1 --2- 172.21.15.62:0/3149031306 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7ff2740662f0 0x7ff2740687a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff2900b3310 tx=0x7ff28c009240 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:26.245 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.240+0000 7ff286ffd700 1 -- 172.21.15.62:0/3149031306 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff288052450 con 0x7ff29015c060 2023-06-09T04:41:26.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.416+0000 7ff29877f700 1 -- 172.21.15.62:0/3149031306 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff2900b4170 con 0x7ff29015c060 2023-06-09T04:41:26.424 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.420+0000 7ff286ffd700 1 -- 172.21.15.62:0/3149031306 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20084 (secure 0 0 0) 0x7ff288055a70 con 0x7ff29015c060 2023-06-09T04:41:26.425 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:41:26.425 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":28,"fsid":"f7998a1e-e5a9-4202-abaa-70c0eaae1047","created":"2023-06-09T04:40:30.469588+0000","modified":"2023-06-09T04:41:01.271858+0000","last_up_change":"2023-06-09T04:40:43.120747+0000","last_in_change":"2023-06-09T04:40:33.568221+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:40:44.646921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:40:50.006643+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:40:55.031273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:40:55.773517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-09T04:40:58.845383+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bc50bbc0-dd08-42ed-804c-ec3029e36c19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6802","nonce":1295788017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6807","nonce":1295788017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6815","nonce":1295788017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6809","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6811","nonce":1295788017}]},"public_addr":"172.21.15.62:6802/1295788017","cluster_addr":"172.21.15.62:6807/1295788017","heartbeat_back_addr":"172.21.15.62:6815/1295788017","heartbeat_front_addr":"172.21.15.62:6811/1295788017","state":["exists","up"]},{"osd":1,"uuid":"8230b12d-e22f-4985-a584-4cc64404cdbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6825","nonce":4120692006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6827","nonce":4120692006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6831","nonce":4120692006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6829","nonce":4120692006}]},"public_addr":"172.21.15.62:6825/4120692006","cluster_addr":"172.21.15.62:6827/4120692006","heartbeat_back_addr":"172.21.15.62:6831/4120692006","heartbeat_front_addr":"172.21.15.62:6829/4120692006","state":["exists","up"]},{"osd":2,"uuid":"d0202506-dbe9-4e3c-9271-687929abf96a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6801","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6803","nonce":4169607876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6805","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6806","nonce":4169607876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6814","nonce":4169607876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6810","nonce":4169607876}]},"public_addr":"172.21.15.62:6803/4169607876","cluster_addr":"172.21.15.62:6806/4169607876","heartbeat_back_addr":"172.21.15.62:6814/4169607876","heartbeat_front_addr":"172.21.15.62:6810/4169607876","state":["exists","up"]},{"osd":3,"uuid":"f3c0298a-b075-4411-af50-e16cd74fdddb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6817","nonce":3268438986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6819","nonce":3268438986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6823","nonce":3268438986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6821","nonce":3268438986}]},"public_addr":"172.21.15.62:6817/3268438986","cluster_addr":"172.21.15.62:6819/3268438986","heartbeat_back_addr":"172.21.15.62:6823/3268438986","heartbeat_front_addr":"172.21.15.62:6821/3268438986","state":["exists","up"]},{"osd":4,"uuid":"1ab5c5ca-e74f-475a-a309-683cc0029928","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6817","nonce":3139617628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6819","nonce":3139617628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6823","nonce":3139617628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6821","nonce":3139617628}]},"public_addr":"172.21.15.89:6817/3139617628","cluster_addr":"172.21.15.89:6819/3139617628","heartbeat_back_addr":"172.21.15.89:6823/3139617628","heartbeat_front_addr":"172.21.15.89:6821/3139617628","state":["exists","up"]},{"osd":5,"uuid":"a933e184-bd8f-4369-a1ba-a68de53c578c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6825","nonce":2681723596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6827","nonce":2681723596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6831","nonce":2681723596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6829","nonce":2681723596}]},"public_addr":"172.21.15.89:6825/2681723596","cluster_addr":"172.21.15.89:6827/2681723596","heartbeat_back_addr":"172.21.15.89:6831/2681723596","heartbeat_front_addr":"172.21.15.89:6829/2681723596","state":["exists","up"]},{"osd":6,"uuid":"1ed7ad37-2eee-49a6-954c-b537e2b7f0ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6809","nonce":1657136033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6811","nonce":1657136033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6815","nonce":1657136033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6813","nonce":1657136033}]},"public_addr":"172.21.15.89:6809/1657136033","cluster_addr":"172.21.15.89:6811/1657136033","heartbeat_back_addr":"172.21.15.89:6815/1657136033","heartbeat_front_addr":"172.21.15.89:6813/1657136033","state":["exists","up"]},{"osd":7,"uuid":"6ed732e9-33ff-40df-9038-a9f1d1622671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6801","nonce":1710561686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6803","nonce":1710561686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6807","nonce":1710561686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6805","nonce":1710561686}]},"public_addr":"172.21.15.89:6801/1710561686","cluster_addr":"172.21.15.89:6803/1710561686","heartbeat_back_addr":"172.21.15.89:6807/1710561686","heartbeat_front_addr":"172.21.15.89:6805/1710561686","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.335803+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.419788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.179334+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.263310+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.071846+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.375627+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.282277+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.315997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:41:26.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.424+0000 7ff29877f700 1 -- 172.21.15.62:0/3149031306 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7ff2740662f0 msgr2=0x7ff2740687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:26.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.424+0000 7ff29877f700 1 --2- 172.21.15.62:0/3149031306 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7ff2740662f0 0x7ff2740687a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff2900b3310 tx=0x7ff28c009240 comp rx=0 tx=0).stop 2023-06-09T04:41:26.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.424+0000 7ff29877f700 1 -- 172.21.15.62:0/3149031306 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff29015c060 msgr2=0x7ff2900b3360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:26.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.424+0000 7ff29877f700 1 --2- 172.21.15.62:0/3149031306 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff29015c060 0x7ff2900b3360 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff28800b370 tx=0x7ff288004af0 comp rx=0 tx=0).stop 2023-06-09T04:41:26.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.424+0000 7ff29877f700 1 -- 172.21.15.62:0/3149031306 shutdown_connections 2023-06-09T04:41:26.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.424+0000 7ff29877f700 1 --2- 172.21.15.62:0/3149031306 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7ff2740662f0 0x7ff2740687a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:26.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.424+0000 7ff29877f700 1 --2- 172.21.15.62:0/3149031306 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff29015c060 0x7ff2900b3360 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:26.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.424+0000 7ff29877f700 1 --2- 172.21.15.62:0/3149031306 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff2900707f0 0x7ff290154260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:26.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.424+0000 7ff29877f700 1 --2- 172.21.15.62:0/3149031306 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff29006b5a0 0x7ff2900b1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:26.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.424+0000 7ff29877f700 1 -- 172.21.15.62:0/3149031306 >> 172.21.15.62:0/3149031306 conn(0x7ff29006a410 msgr2=0x7ff2900c52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:26.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.424+0000 7ff29877f700 1 -- 172.21.15.62:0/3149031306 shutdown_connections 2023-06-09T04:41:26.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.424+0000 7ff29877f700 1 -- 172.21.15.62:0/3149031306 wait complete. 2023-06-09T04:41:26.449 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-06-09T04:41:26.450 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-06-09T04:41:26.451 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-06-09T04:41:26.451 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-06-09T04:41:26.451 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-06-09T04:41:26.452 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-06-09T04:41:26.452 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-06-09T04:41:26.453 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-06-09T04:41:26.695 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.692+0000 7f8d7a145700 1 Processor -- start 2023-06-09T04:41:26.697 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.692+0000 7f78148fb700 1 Processor -- start 2023-06-09T04:41:26.697 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.692+0000 7f8d7a145700 1 -- start start 2023-06-09T04:41:26.698 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.692+0000 7f8d7a145700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d740d1ac0 0x7f8d740ced90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:26.698 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.692+0000 7f8d7a145700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d740b51e0 con 0x7f8d740ce9c0 2023-06-09T04:41:26.698 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.692+0000 7f8d7a145700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d740d0190 con 0x7f8d740cf2d0 2023-06-09T04:41:26.698 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.692+0000 7f8d7a145700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d740cd0f0 con 0x7f8d740d1ac0 2023-06-09T04:41:26.698 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.692+0000 7f78148fb700 1 -- start start 2023-06-09T04:41:26.699 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.692+0000 7f8d79143700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f8d740ce9c0 0x7f8d740cc9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:44918/0 (socket says 172.21.15.62:44918) 2023-06-09T04:41:26.699 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.692+0000 7f8d79143700 1 -- 172.21.15.62:0/1588508962 learned_addr learned my addr 172.21.15.62:0/1588508962 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:41:26.699 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.692+0000 7f8d78942700 1 --2- 172.21.15.62:0/1588508962 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d740d1ac0 0x7f8d740ced90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:26.699 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.692+0000 7f8d6bfff700 1 -- 172.21.15.62:0/1588508962 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 355213433 0 0) 0x7f8d740b51e0 con 0x7f8d740ce9c0 2023-06-09T04:41:26.700 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.692+0000 7f8d6bfff700 1 -- 172.21.15.62:0/1588508962 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d600035d0 con 0x7f8d740ce9c0 2023-06-09T04:41:26.700 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.696+0000 7f8d78942700 1 -- 172.21.15.62:0/1588508962 >> v1:172.21.15.89:6789/0 conn(0x7f8d740cf2d0 legacy=0x7f8d74165730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:26.700 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.696+0000 7f8d78942700 1 -- 172.21.15.62:0/1588508962 >> v1:172.21.15.62:6789/0 conn(0x7f8d740ce9c0 legacy=0x7f8d740cc9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:26.700 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.696+0000 7f8d78942700 1 -- 172.21.15.62:0/1588508962 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d740d29f0 con 0x7f8d740d1ac0 2023-06-09T04:41:26.700 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.696+0000 7f78148fb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f781006afc0 0x7f78100ce6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:26.701 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.696+0000 7f78148fb700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f78100b5280 0x7f78100d12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:26.701 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.696+0000 7f78148fb700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78100cec10 con 0x7f78100cee40 2023-06-09T04:41:26.701 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.696+0000 7f78148fb700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78100ccb20 con 0x7f78100b5280 2023-06-09T04:41:26.701 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.696+0000 7f78148fb700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78100cce00 con 0x7f781006afc0 2023-06-09T04:41:26.702 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.696+0000 7f8d78942700 1 --2- 172.21.15.62:0/1588508962 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d740d1ac0 0x7f8d740ced90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8d64009880 tx=0x7f8d64009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=605e08b3f9a4097a server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:26.702 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.696+0000 7f8d6bfff700 1 -- 172.21.15.62:0/1588508962 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d64011830 con 0x7f8d740d1ac0 2023-06-09T04:41:26.702 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.696+0000 7f8d6bfff700 1 -- 172.21.15.62:0/1588508962 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d64011990 con 0x7f8d740d1ac0 2023-06-09T04:41:26.702 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.696+0000 7f780ffff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f78100b5280 0x7f78100d12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:26.702 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.696+0000 7f780ffff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f78100b5280 0x7f78100d12b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40330/0 (socket says 172.21.15.62:40330) 2023-06-09T04:41:26.703 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.696+0000 7f780ffff700 1 -- 172.21.15.62:0/3923216692 learned_addr learned my addr 172.21.15.62:0/3923216692 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:26.703 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.696+0000 7f8d6bfff700 1 -- 172.21.15.62:0/1588508962 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d64011d00 con 0x7f8d740d1ac0 2023-06-09T04:41:26.703 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.696+0000 7f8d7a145700 1 -- 172.21.15.62:0/1588508962 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d740d1ac0 msgr2=0x7f8d740ced90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:26.703 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.696+0000 7f8d7a145700 1 --2- 172.21.15.62:0/1588508962 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d740d1ac0 0x7f8d740ced90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8d64009880 tx=0x7f8d64009b90 comp rx=0 tx=0).stop 2023-06-09T04:41:26.704 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.696+0000 7f780ffff700 1 -- 172.21.15.62:0/3923216692 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f781006afc0 msgr2=0x7f78100ce6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:26.704 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.696+0000 7f780ffff700 1 --2- 172.21.15.62:0/3923216692 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f781006afc0 0x7f78100ce6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:26.704 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.696+0000 7f780ffff700 1 -- 172.21.15.62:0/3923216692 >> v1:172.21.15.62:6789/0 conn(0x7f78100cee40 legacy=0x7f78100cf210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:26.704 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.696+0000 7f780ffff700 1 -- 172.21.15.62:0/3923216692 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78100cd0e0 con 0x7f78100b5280 2023-06-09T04:41:26.704 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.696+0000 7f780e7fc700 1 -- 172.21.15.62:0/3923216692 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2758355089 0 0) 0x7f78100cec10 con 0x7f78100cee40 2023-06-09T04:41:26.705 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.696+0000 7f8d7a145700 1 -- 172.21.15.62:0/1588508962 shutdown_connections 2023-06-09T04:41:26.705 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.696+0000 7f8d7a145700 1 --2- 172.21.15.62:0/1588508962 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d740d1ac0 0x7f8d740ced90 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:26.705 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.696+0000 7f8d7a145700 1 -- 172.21.15.62:0/1588508962 >> 172.21.15.62:0/1588508962 conn(0x7f8d74070f20 msgr2=0x7f8d740712f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:26.705 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.696+0000 7f780ffff700 1 --2- 172.21.15.62:0/3923216692 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78100b5280 0x7f78100d12b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7808009e50 tx=0x7f780800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fd78e17e206b36f server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:26.705 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.696+0000 7f8d7a145700 1 -- 172.21.15.62:0/1588508962 shutdown_connections 2023-06-09T04:41:26.706 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.696+0000 7fe09c8b2700 1 Processor -- start 2023-06-09T04:41:26.706 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.696+0000 7fe09c8b2700 1 -- start start 2023-06-09T04:41:26.706 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.696+0000 7f780e7fc700 1 -- 172.21.15.62:0/3923216692 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780800e070 con 0x7f78100b5280 2023-06-09T04:41:26.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.696+0000 7f780e7fc700 1 -- 172.21.15.62:0/3923216692 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f780800b9c0 con 0x7f78100b5280 2023-06-09T04:41:26.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.696+0000 7f780e7fc700 1 -- 172.21.15.62:0/3923216692 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780800bd70 con 0x7f78100b5280 2023-06-09T04:41:26.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.696+0000 7f8d7a145700 1 -- 172.21.15.62:0/1588508962 wait complete. 2023-06-09T04:41:26.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.700+0000 7f2fcdf4d700 1 Processor -- start 2023-06-09T04:41:26.708 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.700+0000 7f78148fb700 1 -- 172.21.15.62:0/3923216692 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78100b5280 msgr2=0x7f78100d12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:26.708 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.700+0000 7f78148fb700 1 --2- 172.21.15.62:0/3923216692 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78100b5280 0x7f78100d12b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7808009e50 tx=0x7f780800b330 comp rx=0 tx=0).stop 2023-06-09T04:41:26.708 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.700+0000 7f78148fb700 1 -- 172.21.15.62:0/3923216692 shutdown_connections 2023-06-09T04:41:26.708 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.700+0000 7f78148fb700 1 --2- 172.21.15.62:0/3923216692 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78100b5280 0x7f78100d12b0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:26.709 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.700+0000 7f78148fb700 1 --2- 172.21.15.62:0/3923216692 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f781006afc0 0x7f78100ce6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:26.709 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.700+0000 7f78148fb700 1 -- 172.21.15.62:0/3923216692 >> 172.21.15.62:0/3923216692 conn(0x7f781006a4b0 msgr2=0x7f781006a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:26.709 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.700+0000 7f2fcdf4d700 1 -- start start 2023-06-09T04:41:26.709 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.700+0000 7fe09c8b2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe09004faf0 0x7fe090036710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:26.710 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.700+0000 7f8d7a145700 1 Processor -- start 2023-06-09T04:41:26.710 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.700+0000 7fe09c8b2700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe0900c7c20 0x7fe090036c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:26.710 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.700+0000 7fe09c8b2700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe0900c8170 0x7fe090005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:26.710 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.700+0000 7f2fcdf4d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2fc0047c50 0x7f2fc00480a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:26.711 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.700+0000 7f2fcdf4d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2fc0053aa0 0x7f2fc0053ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:26.711 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.700+0000 7f2fcdf4d700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fc004f9f0 con 0x7f2fc00e6f20 2023-06-09T04:41:26.711 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.700+0000 7f78148fb700 1 -- 172.21.15.62:0/3923216692 shutdown_connections 2023-06-09T04:41:26.711 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.700+0000 7f2fcdf4d700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fc00485e0 con 0x7f2fc0047c50 2023-06-09T04:41:26.712 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.700+0000 7f2fcdf4d700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fc0053610 con 0x7f2fc0053aa0 2023-06-09T04:41:26.712 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.700+0000 7f78148fb700 1 -- 172.21.15.62:0/3923216692 wait complete. 2023-06-09T04:41:26.712 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.700+0000 7fe09c8b2700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe09004bbd0 con 0x7fe0900c8170 2023-06-09T04:41:26.713 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.700+0000 7fe09c8b2700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0900e32d0 con 0x7fe0900c7c20 2023-06-09T04:41:26.713 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.700+0000 7fe09c8b2700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe09004fec0 con 0x7fe09004faf0 2023-06-09T04:41:26.713 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.700+0000 7fe0977fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe09004faf0 0x7fe090036710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:26.713 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.700+0000 7fe0977fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe09004faf0 0x7fe090036710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.62:35744/0 (socket says 172.21.15.62:35744) 2023-06-09T04:41:26.713 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.700+0000 7fe0977fe700 1 -- 172.21.15.62:0/1547421908 learned_addr learned my addr 172.21.15.62:0/1547421908 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:26.713 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.700+0000 7fe096ffd700 1 --2- 172.21.15.62:0/1547421908 >> v2:172.21.15.89:3300/0 conn(0x7fe0900c7c20 0x7fe090036c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:26.713 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.700+0000 7fe097fff700 1 --2- 172.21.15.62:0/1547421908 >> v2:172.21.15.62:3300/0 conn(0x7fe0900c8170 0x7fe090005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:26.714 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.700+0000 7f2fc7fff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2fc0053aa0 0x7f2fc0053ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:26.714 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.700+0000 7f2fc77fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f2fc00e6f20 0x7f2fc004f2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:44938/0 (socket says 172.21.15.62:44938) 2023-06-09T04:41:26.714 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.700+0000 7f2fc77fe700 1 -- 172.21.15.62:0/2812842833 learned_addr learned my addr 172.21.15.62:0/2812842833 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:41:26.715 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.700+0000 7f8d7a145700 1 -- start start 2023-06-09T04:41:26.715 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.700+0000 7f8d7a145700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d740ce9c0 0x7f8d741f5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:26.715 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.704+0000 7f8d7a145700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d740cf2d0 0x7f8d7415a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:26.715 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.704+0000 7fe0977fe700 1 -- 172.21.15.62:0/1547421908 >> v2:172.21.15.89:3300/0 conn(0x7fe0900c7c20 msgr2=0x7fe090036c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:26.715 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.704+0000 7fe0977fe700 1 --2- 172.21.15.62:0/1547421908 >> v2:172.21.15.89:3300/0 conn(0x7fe0900c7c20 0x7fe090036c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:26.715 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.704+0000 7fe0977fe700 1 -- 172.21.15.62:0/1547421908 >> v2:172.21.15.62:3300/0 conn(0x7fe0900c8170 msgr2=0x7fe090005fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:26.716 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.704+0000 7fe0977fe700 1 --2- 172.21.15.62:0/1547421908 >> v2:172.21.15.62:3300/0 conn(0x7fe0900c8170 0x7fe090005fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:26.716 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.704+0000 7fe0977fe700 1 -- 172.21.15.62:0/1547421908 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0900e2470 con 0x7fe09004faf0 2023-06-09T04:41:26.716 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.704+0000 7f2fc6ffd700 1 --2- 172.21.15.62:0/2812842833 >> v2:172.21.15.62:3300/0 conn(0x7f2fc0047c50 0x7f2fc00480a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:26.716 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.704+0000 7f2fc7fff700 1 -- 172.21.15.62:0/2812842833 >> v2:172.21.15.62:3300/0 conn(0x7f2fc0047c50 msgr2=0x7f2fc00480a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:26.716 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.704+0000 7f2fc7fff700 1 --2- 172.21.15.62:0/2812842833 >> v2:172.21.15.62:3300/0 conn(0x7f2fc0047c50 0x7f2fc00480a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:26.717 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.704+0000 7f2fc7fff700 1 -- 172.21.15.62:0/2812842833 >> v1:172.21.15.62:6789/0 conn(0x7f2fc00e6f20 legacy=0x7f2fc004f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:26.717 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.704+0000 7f2fc7fff700 1 -- 172.21.15.62:0/2812842833 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fc0052a00 con 0x7f2fc0053aa0 2023-06-09T04:41:26.717 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.704+0000 7f8d79143700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d740ce9c0 0x7f8d741f5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:26.717 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.704+0000 7f8d79143700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d740ce9c0 0x7f8d741f5d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.62:35758/0 (socket says 172.21.15.62:35758) 2023-06-09T04:41:26.717 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.704+0000 7f8d7a145700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d7415d7e0 0x7f8d7415dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:26.718 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.704+0000 7f2824845700 1 Processor -- start 2023-06-09T04:41:26.718 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.704+0000 7f8d78942700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d740cf2d0 0x7f8d7415a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:26.718 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.704+0000 7f8d79143700 1 -- 172.21.15.62:0/1483719610 learned_addr learned my addr 172.21.15.62:0/1483719610 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:26.719 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.704+0000 7f2fc7fff700 1 --2- 172.21.15.62:0/2812842833 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fc0053aa0 0x7f2fc0053ee0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2fc000bed0 tx=0x7f2fb4009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=628f6b626169ddab server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:26.719 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.704+0000 7fe0977fe700 1 --2- 172.21.15.62:0/1547421908 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe09004faf0 0x7fe090036710 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe09000bd40 tx=0x7fe08c009bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=658cabd2d69812c1 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:26.719 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.704+0000 7f8d7a145700 1 -- 172.21.15.62:0/1483719610 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7415ae80 con 0x7f8d7415d7e0 2023-06-09T04:41:26.719 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.704+0000 7f8d79944700 1 --2- 172.21.15.62:0/1483719610 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d7415d7e0 0x7f8d7415dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:26.720 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.704+0000 7f8d7a145700 1 -- 172.21.15.62:0/1483719610 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d740708d0 con 0x7f8d740cf2d0 2023-06-09T04:41:26.720 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.704+0000 7fe0967fc700 1 -- 172.21.15.62:0/1547421908 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08c011830 con 0x7fe09004faf0 2023-06-09T04:41:26.720 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.704+0000 7fe0967fc700 1 -- 172.21.15.62:0/1547421908 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe08c011990 con 0x7fe09004faf0 2023-06-09T04:41:26.720 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.704+0000 7fe0967fc700 1 -- 172.21.15.62:0/1547421908 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08c011d20 con 0x7fe09004faf0 2023-06-09T04:41:26.721 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.704+0000 7f2fc67fc700 1 -- 172.21.15.62:0/2812842833 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb4011830 con 0x7f2fc0053aa0 2023-06-09T04:41:26.721 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.704+0000 7f2fc67fc700 1 -- 172.21.15.62:0/2812842833 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fb4011990 con 0x7f2fc0053aa0 2023-06-09T04:41:26.721 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.704+0000 7f2fc67fc700 1 -- 172.21.15.62:0/2812842833 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb4011d40 con 0x7f2fc0053aa0 2023-06-09T04:41:26.721 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.704+0000 7f8d7a145700 1 -- 172.21.15.62:0/1483719610 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7415e350 con 0x7f8d740ce9c0 2023-06-09T04:41:26.722 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.704+0000 7f78148fb700 1 Processor -- start 2023-06-09T04:41:26.722 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.704+0000 7f78148fb700 1 -- start start 2023-06-09T04:41:26.722 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.704+0000 7fa0e863b700 1 Processor -- start 2023-06-09T04:41:26.723 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.704+0000 7fe09c8b2700 1 -- 172.21.15.62:0/1547421908 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe09004faf0 msgr2=0x7fe090036710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:26.723 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.704+0000 7fe09c8b2700 1 --2- 172.21.15.62:0/1547421908 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe09004faf0 0x7fe090036710 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe09000bd40 tx=0x7fe08c009bf0 comp rx=0 tx=0).stop 2023-06-09T04:41:26.723 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.704+0000 7f2fcdf4d700 1 -- 172.21.15.62:0/2812842833 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fc0053aa0 msgr2=0x7f2fc0053ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:26.723 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.704+0000 7f2fcdf4d700 1 --2- 172.21.15.62:0/2812842833 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fc0053aa0 0x7f2fc0053ee0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2fc000bed0 tx=0x7f2fb4009b30 comp rx=0 tx=0).stop 2023-06-09T04:41:26.724 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.704+0000 7fe09c8b2700 1 -- 172.21.15.62:0/1547421908 shutdown_connections 2023-06-09T04:41:26.724 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.704+0000 7fe09c8b2700 1 --2- 172.21.15.62:0/1547421908 >> v2:172.21.15.62:3300/0 conn(0x7fe0900c8170 0x7fe090005fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:26.724 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.704+0000 7fe09c8b2700 1 --2- 172.21.15.62:0/1547421908 >> v2:172.21.15.89:3300/0 conn(0x7fe0900c7c20 0x7fe090036c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:26.724 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.704+0000 7fe09c8b2700 1 --2- 172.21.15.62:0/1547421908 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe09004faf0 0x7fe090036710 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:26.724 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.704+0000 7fe09c8b2700 1 -- 172.21.15.62:0/1547421908 >> 172.21.15.62:0/1547421908 conn(0x7fe090051710 msgr2=0x7fe090051ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:26.725 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.704+0000 7f2fcdf4d700 1 -- 172.21.15.62:0/2812842833 shutdown_connections 2023-06-09T04:41:26.725 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.704+0000 7f2fcdf4d700 1 --2- 172.21.15.62:0/2812842833 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fc0053aa0 0x7f2fc0053ee0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:26.725 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.704+0000 7f2fcdf4d700 1 --2- 172.21.15.62:0/2812842833 >> v2:172.21.15.62:3300/0 conn(0x7f2fc0047c50 0x7f2fc00480a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:26.725 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.704+0000 7f2fcdf4d700 1 -- 172.21.15.62:0/2812842833 >> 172.21.15.62:0/2812842833 conn(0x7f2fc0051710 msgr2=0x7f2fc0051ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:26.725 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.704+0000 7f2fcdf4d700 1 -- 172.21.15.62:0/2812842833 shutdown_connections 2023-06-09T04:41:26.726 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.704+0000 7f2824845700 1 -- start start 2023-06-09T04:41:26.726 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.704+0000 7fe09c8b2700 1 -- 172.21.15.62:0/1547421908 shutdown_connections 2023-06-09T04:41:26.726 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.704+0000 7f8d79944700 1 -- 172.21.15.62:0/1483719610 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d740ce9c0 msgr2=0x7f8d741f5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:26.726 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.704+0000 7f8d79944700 1 --2- 172.21.15.62:0/1483719610 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d740ce9c0 0x7f8d741f5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:26.727 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.704+0000 7f8d79944700 1 -- 172.21.15.62:0/1483719610 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d740cf2d0 msgr2=0x7f8d7415a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:26.727 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.704+0000 7f8d79944700 1 --2- 172.21.15.62:0/1483719610 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d740cf2d0 0x7f8d7415a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:26.727 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.704+0000 7f8d79944700 1 -- 172.21.15.62:0/1483719610 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d640094b0 con 0x7f8d7415d7e0 2023-06-09T04:41:26.727 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.704+0000 7f8d78942700 1 --2- 172.21.15.62:0/1483719610 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d740cf2d0 0x7f8d7415a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:41:26.727 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.704+0000 7f8d79944700 1 --2- 172.21.15.62:0/1483719610 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d7415d7e0 0x7f8d7415dc80 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c002230 tx=0x7f8d6c00cdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:26.727 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.704+0000 7f8d69ffb700 1 -- 172.21.15.62:0/1483719610 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d6c003c20 con 0x7f8d7415d7e0 2023-06-09T04:41:26.727 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.704+0000 7f8d69ffb700 1 -- 172.21.15.62:0/1483719610 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d6c003d80 con 0x7f8d7415d7e0 2023-06-09T04:41:26.727 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.704+0000 7f8d69ffb700 1 -- 172.21.15.62:0/1483719610 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d6c00aa20 con 0x7f8d7415d7e0 2023-06-09T04:41:26.728 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.708+0000 7f8d7a145700 1 -- 172.21.15.62:0/1483719610 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d741f5250 con 0x7f8d7415d7e0 2023-06-09T04:41:26.728 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.704+0000 7f2fcdf4d700 1 -- 172.21.15.62:0/2812842833 wait complete. 2023-06-09T04:41:26.728 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.708+0000 7f78148fb700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f781006afc0 0x7f7810151bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:26.728 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.708+0000 7f78148fb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f78100b5280 0x7f78101523c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:26.729 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.708+0000 7f78148fb700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78100cee40 0x7f78100b6a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:26.729 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.708+0000 7f78148fb700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78100c6a30 con 0x7f781006afc0 2023-06-09T04:41:26.729 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.704+0000 7f2824845700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f28180e6f80 0x7f2818006960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:26.729 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.704+0000 7f2824845700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2818007b60 con 0x7f2818054c30 2023-06-09T04:41:26.729 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.704+0000 7f2824845700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2818055110 con 0x7f281803ab20 2023-06-09T04:41:26.729 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.704+0000 7f2824845700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2818006230 con 0x7f28180e6f80 2023-06-09T04:41:26.730 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.708+0000 7f8d7a145700 1 -- 172.21.15.62:0/1483719610 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d741f5810 con 0x7f8d7415d7e0 2023-06-09T04:41:26.730 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.704+0000 7fe09c8b2700 1 -- 172.21.15.62:0/1547421908 wait complete. 2023-06-09T04:41:26.730 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.708+0000 7f78148fb700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78100c6fb0 con 0x7f78100cee40 2023-06-09T04:41:26.731 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.708+0000 7f78148fb700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78100c6cd0 con 0x7f78100b5280 2023-06-09T04:41:26.731 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.708+0000 7f780effd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f78100b5280 0x7f78101523c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:26.731 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.708+0000 7f780ffff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78100cee40 0x7f78100b6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:26.731 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.708+0000 7f780effd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f78100b5280 0x7f78101523c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.62:35770/0 (socket says 172.21.15.62:35770) 2023-06-09T04:41:26.731 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.708+0000 7f780effd700 1 -- 172.21.15.62:0/1095017554 learned_addr learned my addr 172.21.15.62:0/1095017554 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:26.731 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.708+0000 7f780f7fe700 1 --2- 172.21.15.62:0/1095017554 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f781006afc0 0x7f7810151bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:26.732 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.708+0000 7f281e59c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f28180e6f80 0x7f2818006960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:26.732 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.708+0000 7f281e59c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f28180e6f80 0x7f2818006960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40382/0 (socket says 172.21.15.62:40382) 2023-06-09T04:41:26.732 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.708+0000 7f281e59c700 1 -- 172.21.15.62:0/312126426 learned_addr learned my addr 172.21.15.62:0/312126426 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:26.732 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.704+0000 7fa0e863b700 1 -- start start 2023-06-09T04:41:26.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.708+0000 7f3966977700 1 Processor -- start 2023-06-09T04:41:26.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.708+0000 7fa0e863b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa0e00d1ac0 0x7fa0e00ced90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:26.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.708+0000 7fa0e863b700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0e00b51e0 con 0x7fa0e00cf2d0 2023-06-09T04:41:26.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.708+0000 7fa0e863b700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0e00d0190 con 0x7fa0e00ce9c0 2023-06-09T04:41:26.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.708+0000 7fa0e863b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e00cd0f0 con 0x7fa0e00d1ac0 2023-06-09T04:41:26.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.708+0000 7f2fcdf4d700 1 Processor -- start 2023-06-09T04:41:26.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.708+0000 7f780ffff700 1 -- 172.21.15.62:0/1095017554 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f78100b5280 msgr2=0x7f78101523c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:26.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.708+0000 7f780ffff700 1 --2- 172.21.15.62:0/1095017554 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f78100b5280 0x7f78101523c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:26.735 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.708+0000 7f780ffff700 1 -- 172.21.15.62:0/1095017554 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f781006afc0 msgr2=0x7f7810151bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:26.735 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.708+0000 7f780ffff700 1 --2- 172.21.15.62:0/1095017554 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f781006afc0 0x7f7810151bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:26.735 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.708+0000 7f780ffff700 1 -- 172.21.15.62:0/1095017554 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7808009b30 con 0x7f78100cee40 2023-06-09T04:41:26.735 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.708+0000 7fa0e63d7700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fa0e00ce9c0 0x7fa0e00cc9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.62:44538/0 (socket says 172.21.15.62:44538) 2023-06-09T04:41:26.735 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.708+0000 7fa0e63d7700 1 -- 172.21.15.62:0/3525198992 learned_addr learned my addr 172.21.15.62:0/3525198992 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:41:26.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.708+0000 7f2fcdf4d700 1 -- start start 2023-06-09T04:41:26.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.708+0000 7f8d7a145700 1 -- 172.21.15.62:0/1483719610 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8d740d2fb0 con 0x7f8d7415d7e0 2023-06-09T04:41:26.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.708+0000 7f281e59c700 1 -- 172.21.15.62:0/312126426 >> v1:172.21.15.89:6789/0 conn(0x7f281803ab20 legacy=0x7f28180ea950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:26.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.708+0000 7fe09c8b2700 1 Processor -- start 2023-06-09T04:41:26.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.708+0000 7f281e59c700 1 -- 172.21.15.62:0/312126426 >> v1:172.21.15.62:6789/0 conn(0x7f2818054c30 legacy=0x7f2818007450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:26.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.708+0000 7f281e59c700 1 -- 172.21.15.62:0/312126426 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28180553f0 con 0x7f28180e6f80 2023-06-09T04:41:26.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.708+0000 7f780ffff700 1 --2- 172.21.15.62:0/1095017554 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78100cee40 0x7f78100b6a70 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7808015000 tx=0x7f7808004af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:26.738 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.708+0000 7fe09c8b2700 1 -- start start 2023-06-09T04:41:26.738 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.708+0000 7fa0e53d5700 1 -- 172.21.15.62:0/3525198992 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3870915296 0 0) 0x7fa0e00d0190 con 0x7fa0e00ce9c0 2023-06-09T04:41:26.738 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.708+0000 7fa0e53d5700 1 -- 172.21.15.62:0/3525198992 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0c80035d0 con 0x7fa0e00ce9c0 2023-06-09T04:41:26.739 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7f2fcdf4d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fc0047c50 0x7f2fc017c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:26.739 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7f2fcdf4d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2fc0053aa0 0x7f2fc004c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:26.739 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7fa0e53d5700 1 -- 172.21.15.62:0/3525198992 <== mon.1 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3286630491 0 0) 0x7fa0c80035d0 con 0x7fa0e00ce9c0 2023-06-09T04:41:26.739 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7fa0e53d5700 1 -- 172.21.15.62:0/3525198992 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa0e00d1ac0 msgr2=0x7fa0e00ced90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-06-09T04:41:26.739 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7fa0e53d5700 1 --2- 172.21.15.62:0/3525198992 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa0e00d1ac0 0x7fa0e00ced90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:26.740 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7fa0e53d5700 1 -- 172.21.15.62:0/3525198992 >> v1:172.21.15.62:6789/0 conn(0x7fa0e00cf2d0 legacy=0x7fa0e0165730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:26.740 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7fa0e53d5700 1 -- 172.21.15.62:0/3525198992 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0e00d29f0 con 0x7fa0e00ce9c0 2023-06-09T04:41:26.740 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7fa0e53d5700 1 -- 172.21.15.62:0/3525198992 <== mon.1 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 540845019 0 0) 0x7fa0d4001670 con 0x7fa0e00ce9c0 2023-06-09T04:41:26.740 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7fa0e53d5700 1 -- 172.21.15.62:0/3525198992 >> v1:172.21.15.89:6789/0 conn(0x7fa0e00ce9c0 legacy=0x7fa0e00cc9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:26.740 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7fa0e53d5700 1 --2- 172.21.15.62:0/3525198992 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0c8003a20 0x7fa0c8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:26.740 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7fa0e53d5700 1 --2- 172.21.15.62:0/3525198992 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0c8004870 0x7fa0c8004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:26.740 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7fa0e53d5700 1 --2- 172.21.15.62:0/3525198992 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa0c8005340 0x7fa0c800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:26.741 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7fa0e53d5700 1 -- 172.21.15.62:0/3525198992 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e00cd0f0 con 0x7fa0c8004870 2023-06-09T04:41:26.741 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7fa0e53d5700 1 -- 172.21.15.62:0/3525198992 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c800c1b0 con 0x7fa0c8003a20 2023-06-09T04:41:26.741 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7fa0e53d5700 1 -- 172.21.15.62:0/3525198992 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0c800c370 con 0x7fa0c8005340 2023-06-09T04:41:26.741 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7f2fcdf4d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2fc00e6f20 0x7f2fc004da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:26.741 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7f2fc77fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fc0047c50 0x7f2fc017c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:26.742 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7f2fc77fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fc0047c50 0x7f2fc017c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.62:44088/0 (socket says 172.21.15.62:44088) 2023-06-09T04:41:26.742 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7fe09c8b2700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe09004faf0 0x7fe090035060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:26.742 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7fe09c8b2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0900c7c20 0x7fe090174ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:26.742 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7fe09c8b2700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe0900c8170 0x7fe0900550a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:26.742 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7fe09c8b2700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe090054570 con 0x7fe0900c8170 2023-06-09T04:41:26.743 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7fe09c8b2700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe09004bd60 con 0x7fe09004faf0 2023-06-09T04:41:26.743 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7fe09c8b2700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe09004bf70 con 0x7fe0900c7c20 2023-06-09T04:41:26.743 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7f2fc77fe700 1 -- 172.21.15.62:0/2610107969 learned_addr learned my addr 172.21.15.62:0/2610107969 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:26.744 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7f2fcdf4d700 1 -- 172.21.15.62:0/2610107969 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc017c590 con 0x7f2fc00e6f20 2023-06-09T04:41:26.744 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7f2fcdf4d700 1 -- 172.21.15.62:0/2610107969 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc00e72f0 con 0x7f2fc0047c50 2023-06-09T04:41:26.744 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7f2fcdf4d700 1 -- 172.21.15.62:0/2610107969 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc004d0a0 con 0x7f2fc0053aa0 2023-06-09T04:41:26.744 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7fa0e6bd8700 1 --2- 172.21.15.62:0/3525198992 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa0c8005340 0x7fa0c800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:26.744 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7fed1305f700 1 Processor -- start 2023-06-09T04:41:26.745 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7fe096ffd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0900c7c20 0x7fe090174ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:26.745 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7fe096ffd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0900c7c20 0x7fe090174ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.62:35806/0 (socket says 172.21.15.62:35806) 2023-06-09T04:41:26.745 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7fe096ffd700 1 -- 172.21.15.62:0/3983114920 learned_addr learned my addr 172.21.15.62:0/3983114920 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:26.745 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7fa0e63d7700 1 --2- 172.21.15.62:0/3525198992 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0c8003a20 0x7fa0c8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:26.746 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7f8d69ffb700 1 -- 172.21.15.62:0/1483719610 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8d6c00ab80 con 0x7f8d7415d7e0 2023-06-09T04:41:26.746 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7fe0977fe700 1 --2- 172.21.15.62:0/3983114920 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe09004faf0 0x7fe090035060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:26.746 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.708+0000 7f77f7fff700 1 -- 172.21.15.62:0/1095017554 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7808004250 con 0x7f78100cee40 2023-06-09T04:41:26.747 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.708+0000 7f77f7fff700 1 -- 172.21.15.62:0/1095017554 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78080043b0 con 0x7f78100cee40 2023-06-09T04:41:26.747 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.708+0000 7f77f7fff700 1 -- 172.21.15.62:0/1095017554 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7808004720 con 0x7f78100cee40 2023-06-09T04:41:26.747 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7f78148fb700 1 -- 172.21.15.62:0/1095017554 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78100c6100 con 0x7f78100cee40 2023-06-09T04:41:26.747 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7f78148fb700 1 -- 172.21.15.62:0/1095017554 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78100b7e60 con 0x7f78100cee40 2023-06-09T04:41:26.747 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.708+0000 7f281e59c700 1 --2- 172.21.15.62:0/312126426 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28180e6f80 0x7f2818006960 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2820078b50 tx=0x7f282004e230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bdf32542547e34c server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:26.747 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7f281d59a700 1 -- 172.21.15.62:0/312126426 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f282006b980 con 0x7f28180e6f80 2023-06-09T04:41:26.748 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7f281d59a700 1 -- 172.21.15.62:0/312126426 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f282006bb20 con 0x7f28180e6f80 2023-06-09T04:41:26.748 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7f281d59a700 1 -- 172.21.15.62:0/312126426 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2820066760 con 0x7f28180e6f80 2023-06-09T04:41:26.748 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7f2824845700 1 -- 172.21.15.62:0/312126426 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28180e6f80 msgr2=0x7f2818006960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:26.748 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7f2824845700 1 --2- 172.21.15.62:0/312126426 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28180e6f80 0x7f2818006960 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2820078b50 tx=0x7f282004e230 comp rx=0 tx=0).stop 2023-06-09T04:41:26.748 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.708+0000 7f3966977700 1 -- start start 2023-06-09T04:41:26.749 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.708+0000 7f3966977700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f39600ce9c0 0x7f39600cc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:26.749 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.708+0000 7f3966977700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f39600d1ac0 0x7f39600ced90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:26.749 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.708+0000 7f3966977700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39600b51e0 con 0x7f39600ccf20 2023-06-09T04:41:26.749 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.708+0000 7f3966977700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39600d0190 con 0x7f39600d1ac0 2023-06-09T04:41:26.749 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.708+0000 7f3966977700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39600d29f0 con 0x7f39600ce9c0 2023-06-09T04:41:26.749 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7f3966176700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f39600ccf20 0x7f39600d0620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.62:44548/0 (socket says 172.21.15.62:44548) 2023-06-09T04:41:26.750 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7f3966176700 1 -- 172.21.15.62:0/3792680486 learned_addr learned my addr 172.21.15.62:0/3792680486 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:41:26.750 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7f3965975700 1 --2- 172.21.15.62:0/3792680486 >> v2:172.21.15.89:3300/0 conn(0x7f39600ce9c0 0x7f39600cc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:26.750 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7f3964973700 1 -- 172.21.15.62:0/3792680486 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 255661692 0 0) 0x7f39600b51e0 con 0x7f39600ccf20 2023-06-09T04:41:26.750 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7f3964973700 1 -- 172.21.15.62:0/3792680486 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f394c0035d0 con 0x7f39600ccf20 2023-06-09T04:41:26.750 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7f78148fb700 1 -- 172.21.15.62:0/1095017554 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f78100d0d90 con 0x7f78100cee40 2023-06-09T04:41:26.751 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7f2824845700 1 -- 172.21.15.62:0/312126426 shutdown_connections 2023-06-09T04:41:26.751 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7f2824845700 1 --2- 172.21.15.62:0/312126426 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28180e6f80 0x7f2818006960 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:26.751 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7f2824845700 1 -- 172.21.15.62:0/312126426 >> 172.21.15.62:0/312126426 conn(0x7f2818055b20 msgr2=0x7f2818055ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:26.751 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7f2fc6ffd700 1 --2- 172.21.15.62:0/2610107969 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2fc0053aa0 0x7f2fc004c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:26.752 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7f2fc77fe700 1 -- 172.21.15.62:0/2610107969 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2fc0053aa0 msgr2=0x7f2fc004c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:26.752 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7f2fc77fe700 1 --2- 172.21.15.62:0/2610107969 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2fc0053aa0 0x7f2fc004c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:26.752 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7f2fc77fe700 1 -- 172.21.15.62:0/2610107969 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2fc00e6f20 msgr2=0x7f2fc004da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:26.752 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7f2fc77fe700 1 --2- 172.21.15.62:0/2610107969 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2fc00e6f20 0x7f2fc004da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:26.752 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7f2fc77fe700 1 -- 172.21.15.62:0/2610107969 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fb40094b0 con 0x7f2fc0047c50 2023-06-09T04:41:26.752 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7f2824845700 1 -- 172.21.15.62:0/312126426 shutdown_connections 2023-06-09T04:41:26.753 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7f2fc6ffd700 1 --2- 172.21.15.62:0/2610107969 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2fc0053aa0 0x7f2fc004c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:41:26.753 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7f3964973700 1 -- 172.21.15.62:0/3792680486 <== mon.1 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1113122245 0 0) 0x7f394c0035d0 con 0x7f39600ccf20 2023-06-09T04:41:26.753 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7fa0e6bd8700 1 -- 172.21.15.62:0/3525198992 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0c8003a20 msgr2=0x7fa0c8003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:26.754 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7fa0e6bd8700 1 --2- 172.21.15.62:0/3525198992 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0c8003a20 0x7fa0c8003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:26.754 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7fa0e6bd8700 1 -- 172.21.15.62:0/3525198992 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0c8004870 msgr2=0x7fa0c8004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:26.754 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7fa0e6bd8700 1 --2- 172.21.15.62:0/3525198992 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0c8004870 0x7fa0c8004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:26.754 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7f3964973700 1 -- 172.21.15.62:0/3792680486 >> v2:172.21.15.89:3300/0 conn(0x7f39600ce9c0 msgr2=0x7f39600cc9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:26.754 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7fa0e6bd8700 1 -- 172.21.15.62:0/3525198992 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0e00d29f0 con 0x7fa0c8005340 2023-06-09T04:41:26.755 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7fe096ffd700 1 -- 172.21.15.62:0/3983114920 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe09004faf0 msgr2=0x7fe090035060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:26.755 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7fe096ffd700 1 --2- 172.21.15.62:0/3983114920 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe09004faf0 0x7fe090035060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:26.755 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7fe096ffd700 1 -- 172.21.15.62:0/3983114920 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe0900c8170 msgr2=0x7fe0900550a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:26.755 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7fe096ffd700 1 --2- 172.21.15.62:0/3983114920 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe0900c8170 0x7fe0900550a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:26.755 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7fe096ffd700 1 -- 172.21.15.62:0/3983114920 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe08c009570 con 0x7fe0900c7c20 2023-06-09T04:41:26.756 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7f2824845700 1 -- 172.21.15.62:0/312126426 wait complete. 2023-06-09T04:41:26.756 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7f3964973700 1 --2- 172.21.15.62:0/3792680486 >> v2:172.21.15.89:3300/0 conn(0x7f39600ce9c0 0x7f39600cc9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:26.756 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7f3964973700 1 -- 172.21.15.62:0/3792680486 >> v2:172.21.15.62:3300/0 conn(0x7f39600d1ac0 msgr2=0x7f39600ced90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:26.756 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7f3964973700 1 --2- 172.21.15.62:0/3792680486 >> v2:172.21.15.62:3300/0 conn(0x7f39600d1ac0 0x7f39600ced90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:26.756 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7f3964973700 1 -- 172.21.15.62:0/3792680486 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39600d2cd0 con 0x7f39600ccf20 2023-06-09T04:41:26.757 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7f3964973700 1 -- 172.21.15.62:0/3792680486 <== mon.1 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 540845019 0 0) 0x7f3950001670 con 0x7f39600ccf20 2023-06-09T04:41:26.757 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7f3964973700 1 -- 172.21.15.62:0/3792680486 >> v1:172.21.15.89:6789/0 conn(0x7f39600ccf20 legacy=0x7f39600d0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:26.757 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7f3964973700 1 --2- 172.21.15.62:0/3792680486 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f394c003a20 0x7f394c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:26.757 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7f3964973700 1 --2- 172.21.15.62:0/3792680486 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f394c004870 0x7f394c004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:26.757 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7f3964973700 1 --2- 172.21.15.62:0/3792680486 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f394c005420 0x7f394c014240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:26.757 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7f3964973700 1 -- 172.21.15.62:0/3792680486 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39600d0190 con 0x7f394c005420 2023-06-09T04:41:26.757 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7f3964973700 1 -- 172.21.15.62:0/3792680486 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39600d29f0 con 0x7f394c004870 2023-06-09T04:41:26.757 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7f3964973700 1 -- 172.21.15.62:0/3792680486 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f394c014b50 con 0x7f394c003a20 2023-06-09T04:41:26.758 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7fe096ffd700 1 --2- 172.21.15.62:0/3983114920 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0900c7c20 0x7fe090174ab0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe08400c830 tx=0x7fe08400cb40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:26.758 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7f2fc77fe700 1 --2- 172.21.15.62:0/2610107969 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fc0047c50 0x7f2fc017c050 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2fc80634f0 tx=0x7f2fc806cc70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:26.758 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7f8d69ffb700 1 --2- 172.21.15.62:0/1483719610 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f8d580663f0 0x7f8d580688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:26.759 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7f8d69ffb700 1 -- 172.21.15.62:0/1483719610 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8d6c0848f0 con 0x7f8d7415d7e0 2023-06-09T04:41:26.759 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7f8d69ffb700 1 --2- 172.21.15.62:0/1483719610 >> [v2:172.21.15.62:6800/1295788017,v1:172.21.15.62:6802/1295788017] conn(0x7f8d580700c0 0x7f8d580724f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:26.759 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7f8d69ffb700 1 -- 172.21.15.62:0/1483719610 --> [v2:172.21.15.62:6800/1295788017,v1:172.21.15.62:6802/1295788017] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8d58072bc0 con 0x7f8d580700c0 2023-06-09T04:41:26.759 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7f8d69ffb700 1 -- 172.21.15.62:0/1483719610 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8d6c084ca0 con 0x7f8d7415d7e0 2023-06-09T04:41:26.759 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7fe083fff700 1 -- 172.21.15.62:0/3983114920 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe084011070 con 0x7fe0900c7c20 2023-06-09T04:41:26.760 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7fa0e6bd8700 1 --2- 172.21.15.62:0/3525198992 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa0c8005340 0x7fa0c800ba30 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa0e00cf730 tx=0x7fa0c80058a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11614358cb945635 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:26.760 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7fe083fff700 1 -- 172.21.15.62:0/3983114920 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe084013520 con 0x7fe0900c7c20 2023-06-09T04:41:26.760 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.712+0000 7fed1305f700 1 -- start start 2023-06-09T04:41:26.761 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.716+0000 7f8d79143700 1 --2- 172.21.15.62:0/1483719610 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f8d580663f0 0x7f8d580688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:26.761 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.716+0000 7fe09c8b2700 1 -- 172.21.15.62:0/3983114920 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe09004c2b0 con 0x7fe0900c7c20 2023-06-09T04:41:26.761 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.716+0000 7fe083fff700 1 -- 172.21.15.62:0/3983114920 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0840138b0 con 0x7fe0900c7c20 2023-06-09T04:41:26.761 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.716+0000 7fe09c8b2700 1 -- 172.21.15.62:0/3983114920 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe09004caf0 con 0x7fe0900c7c20 2023-06-09T04:41:26.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.716+0000 7f3965174700 1 --2- 172.21.15.62:0/3792680486 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f394c004870 0x7f394c004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:26.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.716+0000 7f3966176700 1 --2- 172.21.15.62:0/3792680486 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f394c005420 0x7f394c014240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:26.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.716+0000 7f8d78942700 1 --2- 172.21.15.62:0/1483719610 >> [v2:172.21.15.62:6800/1295788017,v1:172.21.15.62:6802/1295788017] conn(0x7f8d580700c0 0x7f8d580724f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:26.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.716+0000 7f3965975700 1 --2- 172.21.15.62:0/3792680486 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f394c003a20 0x7f394c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:26.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.716+0000 7fa0e53d5700 1 -- 172.21.15.62:0/3525198992 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d8016070 con 0x7fa0c8005340 2023-06-09T04:41:26.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.716+0000 7fa0e53d5700 1 -- 172.21.15.62:0/3525198992 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0d8006880 con 0x7fa0c8005340 2023-06-09T04:41:26.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.716+0000 7fa0e53d5700 1 -- 172.21.15.62:0/3525198992 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d8003990 con 0x7fa0c8005340 2023-06-09T04:41:26.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.716+0000 7f3965174700 1 -- 172.21.15.62:0/3792680486 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f394c003a20 msgr2=0x7f394c003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:26.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.716+0000 7f3965174700 1 --2- 172.21.15.62:0/3792680486 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f394c003a20 0x7f394c003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:26.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.716+0000 7f3965174700 1 -- 172.21.15.62:0/3792680486 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f394c005420 msgr2=0x7f394c014240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:26.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.716+0000 7f3965174700 1 --2- 172.21.15.62:0/3792680486 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f394c005420 0x7f394c014240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:26.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.716+0000 7f3965174700 1 -- 172.21.15.62:0/3792680486 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39600d2cd0 con 0x7f394c004870 2023-06-09T04:41:26.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.716+0000 7f3965975700 1 --2- 172.21.15.62:0/3792680486 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f394c003a20 0x7f394c003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:41:26.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.716+0000 7f8d79143700 1 --2- 172.21.15.62:0/1483719610 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f8d580663f0 0x7f8d580688a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8d700011e0 tx=0x7f8d70009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:26.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.716+0000 7fe09c8b2700 1 -- 172.21.15.62:0/3983114920 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe0900e29a0 con 0x7fe0900c7c20 2023-06-09T04:41:26.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.716+0000 7f3966176700 1 -- 172.21.15.62:0/3792680486 reap_dead start 2023-06-09T04:41:26.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.716+0000 7f3965174700 1 --2- 172.21.15.62:0/3792680486 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f394c004870 0x7f394c004ce0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3958009e40 tx=0x7f394c0058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=13562ff231730770 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:26.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.716+0000 7f8d78942700 1 --2- 172.21.15.62:0/1483719610 >> [v2:172.21.15.62:6800/1295788017,v1:172.21.15.62:6802/1295788017] conn(0x7f8d580700c0 0x7f8d580724f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:26.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.716+0000 7f3964973700 1 -- 172.21.15.62:0/3792680486 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39580098b0 con 0x7f394c004870 2023-06-09T04:41:26.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.716+0000 7f3964973700 1 -- 172.21.15.62:0/3792680486 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3958003c40 con 0x7f394c004870 2023-06-09T04:41:26.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.716+0000 7f3964973700 1 -- 172.21.15.62:0/3792680486 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f395800b8a0 con 0x7f394c004870 2023-06-09T04:41:26.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.716+0000 7fa0e863b700 1 -- 172.21.15.62:0/3525198992 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa0c8005340 msgr2=0x7fa0c800ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:26.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.716+0000 7fa0e863b700 1 --2- 172.21.15.62:0/3525198992 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa0c8005340 0x7fa0c800ba30 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa0e00cf730 tx=0x7fa0c80058a0 comp rx=0 tx=0).stop 2023-06-09T04:41:26.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.716+0000 7fed1305f700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fed0c15db30 0x7fed0c0c55f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:26.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.716+0000 7fed1305f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed0c164780 0x7fed0c0b0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:26.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.716+0000 7fed1305f700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed0c1642f0 con 0x7fed0c0708c0 2023-06-09T04:41:26.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.716+0000 7fa0e6bd8700 1 -- 172.21.15.62:0/3525198992 reap_dead start 2023-06-09T04:41:26.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.716+0000 7fed1305f700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed0c0c6020 con 0x7fed0c15db30 2023-06-09T04:41:26.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.716+0000 7fed1305f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed0c161550 con 0x7fed0c164780 2023-06-09T04:41:26.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.716+0000 7fed1285e700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fed0c0708c0 0x7fed0c0697f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.62:44552/0 (socket says 172.21.15.62:44552) 2023-06-09T04:41:26.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.716+0000 7fed1285e700 1 -- 172.21.15.62:0/3749753595 learned_addr learned my addr 172.21.15.62:0/3749753595 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:41:26.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.716+0000 7fa0e863b700 1 -- 172.21.15.62:0/3525198992 shutdown_connections 2023-06-09T04:41:26.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.716+0000 7fa0e863b700 1 -- 172.21.15.62:0/3525198992 >> 172.21.15.62:0/3525198992 conn(0x7fa0e0070f20 msgr2=0x7fa0e00712f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:26.770 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.716+0000 7f2824845700 1 Processor -- start 2023-06-09T04:41:26.770 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.716+0000 7f2824845700 1 -- start start 2023-06-09T04:41:26.770 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.716+0000 7fa0e863b700 1 -- 172.21.15.62:0/3525198992 shutdown_connections 2023-06-09T04:41:26.770 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.716+0000 7fa0e863b700 1 -- 172.21.15.62:0/3525198992 wait complete. 2023-06-09T04:41:26.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.716+0000 7f2824845700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f281803ab20 0x7f281804ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:26.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.720+0000 7f2824845700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2818054c30 0x7f281803e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:26.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.720+0000 7f2824845700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28180e6f80 0x7f28180d7220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:26.772 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.720+0000 7f2824845700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f281804f220 con 0x7f28180e6f80 2023-06-09T04:41:26.772 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.720+0000 7f281dd9b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2818054c30 0x7f281803e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:26.772 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.720+0000 7f2824845700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f281804ef50 con 0x7f2818054c30 2023-06-09T04:41:26.772 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.720+0000 7f281dd9b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2818054c30 0x7f281803e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.62:44132/0 (socket says 172.21.15.62:44132) 2023-06-09T04:41:26.772 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.720+0000 7f2824845700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2818180150 con 0x7f281803ab20 2023-06-09T04:41:26.772 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.720+0000 7f281dd9b700 1 -- 172.21.15.62:0/1944090287 learned_addr learned my addr 172.21.15.62:0/1944090287 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:26.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.720+0000 7f3966977700 1 -- 172.21.15.62:0/3792680486 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f394c004870 msgr2=0x7f394c004ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:26.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.720+0000 7f3966977700 1 --2- 172.21.15.62:0/3792680486 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f394c004870 0x7f394c004ce0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3958009e40 tx=0x7f394c0058a0 comp rx=0 tx=0).stop 2023-06-09T04:41:26.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.720+0000 7f281ed9d700 1 --2- 172.21.15.62:0/1944090287 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28180e6f80 0x7f28180d7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:26.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.720+0000 7f2fb3fff700 1 -- 172.21.15.62:0/2610107969 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc806ab70 con 0x7f2fc0047c50 2023-06-09T04:41:26.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.720+0000 7f2fb3fff700 1 -- 172.21.15.62:0/2610107969 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fc806ad10 con 0x7f2fc0047c50 2023-06-09T04:41:26.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.720+0000 7f2fcdf4d700 1 -- 172.21.15.62:0/2610107969 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fc00e7540 con 0x7f2fc0047c50 2023-06-09T04:41:26.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.720+0000 7f2fb3fff700 1 -- 172.21.15.62:0/2610107969 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc8067880 con 0x7f2fc0047c50 2023-06-09T04:41:26.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.720+0000 7f2fcdf4d700 1 -- 172.21.15.62:0/2610107969 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fc00e7b00 con 0x7f2fc0047c50 2023-06-09T04:41:26.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.720+0000 7f2fcdf4d700 1 -- 172.21.15.62:0/2610107969 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2fc0052fc0 con 0x7f2fc0047c50 2023-06-09T04:41:26.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.716+0000 7f77f7fff700 1 -- 172.21.15.62:0/1095017554 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f780801c440 con 0x7f78100cee40 2023-06-09T04:41:26.776 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.720+0000 7f77f7fff700 1 --2- 172.21.15.62:0/1095017554 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f77fc0663c0 0x7f77fc068870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:26.776 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.720+0000 7f77f7fff700 1 -- 172.21.15.62:0/1095017554 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7808085ab0 con 0x7f78100cee40 2023-06-09T04:41:26.776 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.720+0000 7f77f7fff700 1 --2- 172.21.15.62:0/1095017554 >> [v2:172.21.15.62:6816/3268438986,v1:172.21.15.62:6817/3268438986] conn(0x7f77fc070090 0x7f77fc0724c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:26.776 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.720+0000 7f77f7fff700 1 -- 172.21.15.62:0/1095017554 --> [v2:172.21.15.62:6816/3268438986,v1:172.21.15.62:6817/3268438986] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f77fc072b90 con 0x7f77fc070090 2023-06-09T04:41:26.776 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.720+0000 7f77f7fff700 1 -- 172.21.15.62:0/1095017554 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7808085e60 con 0x7f78100cee40 2023-06-09T04:41:26.776 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.720+0000 7f780effd700 1 --2- 172.21.15.62:0/1095017554 >> [v2:172.21.15.62:6816/3268438986,v1:172.21.15.62:6817/3268438986] conn(0x7f77fc070090 0x7f77fc0724c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:26.776 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.720+0000 7f780f7fe700 1 --2- 172.21.15.62:0/1095017554 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f77fc0663c0 0x7f77fc068870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:26.777 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.720+0000 7f281dd9b700 1 -- 172.21.15.62:0/1944090287 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f281803ab20 msgr2=0x7f281804ea10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-06-09T04:41:26.777 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.720+0000 7f281dd9b700 1 --2- 172.21.15.62:0/1944090287 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f281803ab20 0x7f281804ea10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:26.777 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.720+0000 7f281dd9b700 1 -- 172.21.15.62:0/1944090287 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28180e6f80 msgr2=0x7f28180d7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:26.777 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.720+0000 7f281dd9b700 1 --2- 172.21.15.62:0/1944090287 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f28180e6f80 0x7f28180d7220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:26.777 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.720+0000 7f281dd9b700 1 -- 172.21.15.62:0/1944090287 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f282004e0a0 con 0x7f2818054c30 2023-06-09T04:41:26.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.720+0000 7fa0e863b700 1 Processor -- start 2023-06-09T04:41:26.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.720+0000 7f3966977700 1 -- 172.21.15.62:0/3792680486 shutdown_connections 2023-06-09T04:41:26.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.720+0000 7f3966977700 1 --2- 172.21.15.62:0/3792680486 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f394c004870 0x7f394c004ce0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:26.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.720+0000 7f3966977700 1 -- 172.21.15.62:0/3792680486 >> 172.21.15.62:0/3792680486 conn(0x7f3960070f20 msgr2=0x7f39600712f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:26.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.720+0000 7f3966977700 1 -- 172.21.15.62:0/3792680486 shutdown_connections 2023-06-09T04:41:26.779 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.720+0000 7f3966977700 1 -- 172.21.15.62:0/3792680486 wait complete. 2023-06-09T04:41:26.779 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.716+0000 7fed1105b700 1 -- 172.21.15.62:0/3749753595 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1928758977 0 0) 0x7fed0c1642f0 con 0x7fed0c0708c0 2023-06-09T04:41:26.779 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.716+0000 7fed1105b700 1 -- 172.21.15.62:0/3749753595 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fecf80035d0 con 0x7fed0c0708c0 2023-06-09T04:41:26.779 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.716+0000 7fed1105b700 1 -- 172.21.15.62:0/3749753595 <== mon.1 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1481171831 0 0) 0x7fecf80035d0 con 0x7fed0c0708c0 2023-06-09T04:41:26.779 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.716+0000 7fed1105b700 1 -- 172.21.15.62:0/3749753595 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed0c164780 msgr2=0x7fed0c0b0d30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-09T04:41:26.780 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.720+0000 7f281dd9b700 1 --2- 172.21.15.62:0/1944090287 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2818054c30 0x7f281803e0f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f281000c4d0 tx=0x7f281000c7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:26.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.716+0000 7fed1105b700 1 --2- 172.21.15.62:0/3749753595 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed0c164780 0x7fed0c0b0d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:26.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.716+0000 7fed1105b700 1 -- 172.21.15.62:0/3749753595 >> v2:172.21.15.89:3300/0 conn(0x7fed0c15db30 msgr2=0x7fed0c0c55f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-06-09T04:41:26.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.716+0000 7fed1105b700 1 --2- 172.21.15.62:0/3749753595 >> v2:172.21.15.89:3300/0 conn(0x7fed0c15db30 0x7fed0c0c55f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:26.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.716+0000 7fed1105b700 1 -- 172.21.15.62:0/3749753595 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed0c0d0080 con 0x7fed0c0708c0 2023-06-09T04:41:26.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.716+0000 7fed1105b700 1 -- 172.21.15.62:0/3749753595 <== mon.1 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 540845019 0 0) 0x7fed04001670 con 0x7fed0c0708c0 2023-06-09T04:41:26.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.716+0000 7fed1105b700 1 -- 172.21.15.62:0/3749753595 >> v1:172.21.15.89:6789/0 conn(0x7fed0c0708c0 legacy=0x7fed0c0697f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:26.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.716+0000 7fed1105b700 1 --2- 172.21.15.62:0/3749753595 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fecf8003a20 0x7fecf8003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:26.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.716+0000 7fed1105b700 1 --2- 172.21.15.62:0/3749753595 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fecf8004870 0x7fecf8004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:26.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.716+0000 7fed1105b700 1 --2- 172.21.15.62:0/3749753595 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fecf80052f0 0x7fecf800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:26.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.716+0000 7fed1105b700 1 -- 172.21.15.62:0/3749753595 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed0c0c6020 con 0x7fecf8004870 2023-06-09T04:41:26.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.716+0000 7fed1105b700 1 -- 172.21.15.62:0/3749753595 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed0c161550 con 0x7fecf80052f0 2023-06-09T04:41:26.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.716+0000 7fed1105b700 1 -- 172.21.15.62:0/3749753595 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecf800c280 con 0x7fecf8003a20 2023-06-09T04:41:26.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.720+0000 7fed1285e700 1 --2- 172.21.15.62:0/3749753595 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fecf80052f0 0x7fecf800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:26.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.720+0000 7fed1285e700 1 -- 172.21.15.62:0/3749753595 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fecf8003a20 msgr2=0x7fecf8003e30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-09T04:41:26.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.720+0000 7fed1285e700 1 --2- 172.21.15.62:0/3749753595 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fecf8003a20 0x7fecf8003e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:26.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.720+0000 7fed1285e700 1 -- 172.21.15.62:0/3749753595 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fecf8004870 msgr2=0x7fecf8004ce0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-09T04:41:26.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.720+0000 7fed1285e700 1 --2- 172.21.15.62:0/3749753595 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fecf8004870 0x7fecf8004ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:26.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.720+0000 7fed1285e700 1 -- 172.21.15.62:0/3749753595 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecf80035d0 con 0x7fecf80052f0 2023-06-09T04:41:26.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.720+0000 7fed1285e700 1 --2- 172.21.15.62:0/3749753595 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fecf80052f0 0x7fecf800ba30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fed0400c370 tx=0x7fecf80058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=446ae8c4fc0564b9 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:26.784 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.720+0000 7fed1105b700 1 -- 172.21.15.62:0/3749753595 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed04005980 con 0x7fecf80052f0 2023-06-09T04:41:26.784 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.720+0000 7fed1105b700 1 -- 172.21.15.62:0/3749753595 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed04005ae0 con 0x7fecf80052f0 2023-06-09T04:41:26.784 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.720+0000 7fed1105b700 1 -- 172.21.15.62:0/3749753595 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed04005e50 con 0x7fecf80052f0 2023-06-09T04:41:26.784 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.720+0000 7fe083fff700 1 -- 172.21.15.62:0/3983114920 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe084013a10 con 0x7fe0900c7c20 2023-06-09T04:41:26.785 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.720+0000 7fe083fff700 1 --2- 172.21.15.62:0/3983114920 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fe07c0663c0 0x7fe07c068870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:26.785 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.720+0000 7fe083fff700 1 -- 172.21.15.62:0/3983114920 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe084083ab0 con 0x7fe0900c7c20 2023-06-09T04:41:26.785 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.720+0000 7fe0977fe700 1 --2- 172.21.15.62:0/3983114920 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fe07c0663c0 0x7fe07c068870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:26.785 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.720+0000 7fe083fff700 1 --2- 172.21.15.62:0/3983114920 >> [v2:172.21.15.62:6824/4120692006,v1:172.21.15.62:6825/4120692006] conn(0x7fe07c070090 0x7fe07c0724c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:26.785 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.720+0000 7fe083fff700 1 -- 172.21.15.62:0/3983114920 --> [v2:172.21.15.62:6824/4120692006,v1:172.21.15.62:6825/4120692006] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe07c072b90 con 0x7fe07c070090 2023-06-09T04:41:26.785 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.720+0000 7fe083fff700 1 -- 172.21.15.62:0/3983114920 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe084083e60 con 0x7fe0900c7c20 2023-06-09T04:41:26.786 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.720+0000 7f280effd700 1 -- 172.21.15.62:0/1944090287 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28100052d0 con 0x7f2818054c30 2023-06-09T04:41:26.786 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.720+0000 7f280effd700 1 -- 172.21.15.62:0/1944090287 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2810005430 con 0x7f2818054c30 2023-06-09T04:41:26.786 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.720+0000 7f280effd700 1 -- 172.21.15.62:0/1944090287 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28100055a0 con 0x7f2818054c30 2023-06-09T04:41:26.786 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.720+0000 7fa0e863b700 1 -- start start 2023-06-09T04:41:26.786 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.720+0000 7f2824845700 1 -- 172.21.15.62:0/1944090287 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2818180430 con 0x7f2818054c30 2023-06-09T04:41:26.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.724+0000 7fe097fff700 1 --2- 172.21.15.62:0/3983114920 >> [v2:172.21.15.62:6824/4120692006,v1:172.21.15.62:6825/4120692006] conn(0x7fe07c070090 0x7fe07c0724c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:26.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.724+0000 7fed1305f700 1 -- 172.21.15.62:0/3749753595 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fecf80052f0 msgr2=0x7fecf800ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:26.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.724+0000 7fed1305f700 1 --2- 172.21.15.62:0/3749753595 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fecf80052f0 0x7fecf800ba30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fed0400c370 tx=0x7fecf80058a0 comp rx=0 tx=0).stop 2023-06-09T04:41:26.788 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.724+0000 7fed1285e700 1 -- 172.21.15.62:0/3749753595 reap_dead start 2023-06-09T04:41:26.788 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.724+0000 7f2824845700 1 -- 172.21.15.62:0/1944090287 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28181809f0 con 0x7f2818054c30 2023-06-09T04:41:26.788 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.724+0000 7fed1305f700 1 -- 172.21.15.62:0/3749753595 shutdown_connections 2023-06-09T04:41:26.788 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.724+0000 7fed1305f700 1 -- 172.21.15.62:0/3749753595 >> 172.21.15.62:0/3749753595 conn(0x7fed0c06a900 msgr2=0x7fed0c06ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:26.789 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.720+0000 7f780effd700 1 --2- 172.21.15.62:0/1095017554 >> [v2:172.21.15.62:6816/3268438986,v1:172.21.15.62:6817/3268438986] conn(0x7f77fc070090 0x7f77fc0724c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:26.789 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.720+0000 7f780f7fe700 1 --2- 172.21.15.62:0/1095017554 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f77fc0663c0 0x7f77fc068870 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f78100c8250 tx=0x7f7800007d40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:26.789 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.724+0000 7f77f7fff700 1 -- 172.21.15.62:0/1095017554 <== osd.3 v2:172.21.15.62:6816/3268438986 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f77fc072b90 con 0x7f77fc070090 2023-06-09T04:41:26.789 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.724+0000 7f8d69ffb700 1 -- 172.21.15.62:0/1483719610 <== osd.0 v2:172.21.15.62:6800/1295788017 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f8d58072bc0 con 0x7f8d580700c0 2023-06-09T04:41:26.790 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.724+0000 7fed1305f700 1 -- 172.21.15.62:0/3749753595 shutdown_connections 2023-06-09T04:41:26.790 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.724+0000 7fed1305f700 1 -- 172.21.15.62:0/3749753595 wait complete. 2023-06-09T04:41:26.790 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.724+0000 7fa0e863b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa0c8005340 0x7fa0e014e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:26.790 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.724+0000 7f3966977700 1 Processor -- start 2023-06-09T04:41:26.791 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.724+0000 7fa0e863b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0e00cc0b0 0x7fa0e00cc500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:26.791 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.724+0000 7fa0e863b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0e015cac0 0x7fa0e015cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:26.791 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.724+0000 7f2fb3fff700 1 -- 172.21.15.62:0/2610107969 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2fc80679e0 con 0x7f2fc0047c50 2023-06-09T04:41:26.792 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.724+0000 7fa0e63d7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa0c8005340 0x7fa0e014e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:26.792 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.724+0000 7fa0e63d7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa0c8005340 0x7fa0e014e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.62:35844/0 (socket says 172.21.15.62:35844) 2023-06-09T04:41:26.792 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.724+0000 7fa0e5bd6700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0e00cc0b0 0x7fa0e00cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:26.792 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.724+0000 7fa0e5bd6700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0e00cc0b0 0x7fa0e00cc500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.62:44134/0 (socket says 172.21.15.62:44134) 2023-06-09T04:41:26.793 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.724+0000 7fa0e6bd8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0e015cac0 0x7fa0e015cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:26.793 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.724+0000 7fa0e6bd8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0e015cac0 0x7fa0e015cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40444/0 (socket says 172.21.15.62:40444) 2023-06-09T04:41:26.793 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.724+0000 7fa0e63d7700 1 -- 172.21.15.62:0/277766435 learned_addr learned my addr 172.21.15.62:0/277766435 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:26.793 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.724+0000 7fa0e863b700 1 -- 172.21.15.62:0/277766435 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e015dab0 con 0x7fa0e015cac0 2023-06-09T04:41:26.793 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.724+0000 7fed1305f700 1 Processor -- start 2023-06-09T04:41:26.794 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.724+0000 7fa0e863b700 1 -- 172.21.15.62:0/277766435 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e00cca40 con 0x7fa0e00cc0b0 2023-06-09T04:41:26.794 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.724+0000 7fa0e863b700 1 -- 172.21.15.62:0/277766435 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e00ca0f0 con 0x7fa0c8005340 2023-06-09T04:41:26.794 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.724+0000 7f3966977700 1 -- start start 2023-06-09T04:41:26.794 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.724+0000 7f3966977700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f394c004870 0x7f39600b7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:26.795 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.724+0000 7f2824845700 1 -- 172.21.15.62:0/1944090287 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2818006440 con 0x7f2818054c30 2023-06-09T04:41:26.795 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.724+0000 7f3966977700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39600cbdd0 0x7f39600cc240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:26.795 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.724+0000 7fed1305f700 1 -- start start 2023-06-09T04:41:26.796 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.724+0000 7f3966977700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39601ef710 0x7f39601efb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:26.796 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.728+0000 7f3965975700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f394c004870 0x7f39600b7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:26.796 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.728+0000 7f3965975700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f394c004870 0x7f39600b7810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.62:35858/0 (socket says 172.21.15.62:35858) 2023-06-09T04:41:26.796 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.728+0000 7f3965975700 1 -- 172.21.15.62:0/3306225756 learned_addr learned my addr 172.21.15.62:0/3306225756 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:26.796 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.728+0000 7f3966977700 1 -- 172.21.15.62:0/3306225756 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39600cb400 con 0x7f39600cbdd0 2023-06-09T04:41:26.796 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.728+0000 7f3966977700 1 -- 172.21.15.62:0/3306225756 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39601f03b0 con 0x7f39601ef710 2023-06-09T04:41:26.797 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.728+0000 7f3965174700 1 --2- 172.21.15.62:0/3306225756 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39600cbdd0 0x7f39600cc240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:26.797 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.728+0000 7f3966176700 1 --2- 172.21.15.62:0/3306225756 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39601ef710 0x7f39601efb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:26.797 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.728+0000 7f3966977700 1 -- 172.21.15.62:0/3306225756 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39601f1210 con 0x7f394c004870 2023-06-09T04:41:26.797 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.724+0000 7f2fb3fff700 1 --2- 172.21.15.62:0/2610107969 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f2fac0663c0 0x7f2fac068870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:26.798 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.728+0000 7f2fb3fff700 1 -- 172.21.15.62:0/2610107969 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2fc80fd800 con 0x7f2fc0047c50 2023-06-09T04:41:26.798 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.728+0000 7f2fb3fff700 1 --2- 172.21.15.62:0/2610107969 >> [v2:172.21.15.62:6801/4169607876,v1:172.21.15.62:6803/4169607876] conn(0x7f2fac070090 0x7f2fac0724c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:26.798 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.728+0000 7f2fb3fff700 1 -- 172.21.15.62:0/2610107969 --> [v2:172.21.15.62:6801/4169607876,v1:172.21.15.62:6803/4169607876] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2fac072b90 con 0x7f2fac070090 2023-06-09T04:41:26.798 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.728+0000 7f2fb3fff700 1 -- 172.21.15.62:0/2610107969 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2fc80fdbb0 con 0x7f2fc0047c50 2023-06-09T04:41:26.798 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.728+0000 7f2fc7fff700 1 --2- 172.21.15.62:0/2610107969 >> [v2:172.21.15.62:6801/4169607876,v1:172.21.15.62:6803/4169607876] conn(0x7f2fac070090 0x7f2fac0724c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:26.798 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.728+0000 7f280effd700 1 -- 172.21.15.62:0/1944090287 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f28100038c0 con 0x7f2818054c30 2023-06-09T04:41:26.799 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.728+0000 7fed1305f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fecf80052f0 0x7fed0c0b15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:26.799 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.728+0000 7fed1305f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fed0c14aef0 0x7fed0c0b4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:26.799 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.728+0000 7fed1305f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed0c0b31e0 0x7fed0c0aed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:26.799 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.728+0000 7fed1305f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed0c0b2d50 con 0x7fed0c14aef0 2023-06-09T04:41:26.799 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.728+0000 7fed1305f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed0c0b2140 con 0x7fed0c0b31e0 2023-06-09T04:41:26.799 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.728+0000 7fed1305f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed0c0b2420 con 0x7fecf80052f0 2023-06-09T04:41:26.800 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.728+0000 7f2fc6ffd700 1 --2- 172.21.15.62:0/2610107969 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f2fac0663c0 0x7f2fac068870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:26.800 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.728+0000 7fed1285e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed0c0b31e0 0x7fed0c0aed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:26.800 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.728+0000 7fed1285e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed0c0b31e0 0x7fed0c0aed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.62:44150/0 (socket says 172.21.15.62:44150) 2023-06-09T04:41:26.800 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.728+0000 7fed1285e700 1 -- 172.21.15.62:0/552153608 learned_addr learned my addr 172.21.15.62:0/552153608 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:26.801 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.724+0000 7fe0977fe700 1 --2- 172.21.15.62:0/3983114920 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fe07c0663c0 0x7fe07c068870 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe08c014040 tx=0x7fe08c008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:26.801 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.728+0000 7f280effd700 1 --2- 172.21.15.62:0/1944090287 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f28000663f0 0x7f28000688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:26.801 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.728+0000 7f280effd700 1 -- 172.21.15.62:0/1944090287 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f28100834d0 con 0x7f2818054c30 2023-06-09T04:41:26.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.728+0000 7f280effd700 1 --2- 172.21.15.62:0/1944090287 >> [v2:172.21.15.89:6816/3139617628,v1:172.21.15.89:6817/3139617628] conn(0x7f28000700c0 0x7f28000724f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:26.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.728+0000 7fed1285e700 1 -- 172.21.15.62:0/552153608 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fecf80052f0 msgr2=0x7fed0c0b15b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-06-09T04:41:26.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.728+0000 7fed1285e700 1 --2- 172.21.15.62:0/552153608 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fecf80052f0 0x7fed0c0b15b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:26.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.728+0000 7fed1285e700 1 -- 172.21.15.62:0/552153608 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fed0c14aef0 msgr2=0x7fed0c0b4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:26.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.728+0000 7fed1285e700 1 --2- 172.21.15.62:0/552153608 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fed0c14aef0 0x7fed0c0b4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:26.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.728+0000 7fed1285e700 1 -- 172.21.15.62:0/552153608 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed0c0b2700 con 0x7fed0c0b31e0 2023-06-09T04:41:26.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.728+0000 7fed1285e700 1 --2- 172.21.15.62:0/552153608 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed0c0b31e0 0x7fed0c0aed10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fed04001930 tx=0x7fed0c164260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:26.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.728+0000 7f2fc6ffd700 1 --2- 172.21.15.62:0/2610107969 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f2fac0663c0 0x7f2fac068870 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2fc0051ed0 tx=0x7f2fbc008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:26.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.728+0000 7f280effd700 1 -- 172.21.15.62:0/1944090287 --> [v2:172.21.15.89:6816/3139617628,v1:172.21.15.89:6817/3139617628] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2800072bc0 con 0x7f28000700c0 2023-06-09T04:41:26.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.728+0000 7f280effd700 1 -- 172.21.15.62:0/1944090287 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2810085af0 con 0x7f2818054c30 2023-06-09T04:41:26.804 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.728+0000 7fa0e5bd6700 1 -- 172.21.15.62:0/277766435 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa0c8005340 msgr2=0x7fa0e014e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:26.804 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.728+0000 7fa0e5bd6700 1 --2- 172.21.15.62:0/277766435 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa0c8005340 0x7fa0e014e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:26.804 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.728+0000 7fa0e5bd6700 1 -- 172.21.15.62:0/277766435 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0e015cac0 msgr2=0x7fa0e015cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:26.805 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.728+0000 7fa0e5bd6700 1 --2- 172.21.15.62:0/277766435 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0e015cac0 0x7fa0e015cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:26.805 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.728+0000 7fa0e5bd6700 1 -- 172.21.15.62:0/277766435 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0e014ed30 con 0x7fa0e00cc0b0 2023-06-09T04:41:26.805 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.728+0000 7fa0e5bd6700 1 --2- 172.21.15.62:0/277766435 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0e00cc0b0 0x7fa0e00cc500 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa0d0009f50 tx=0x7fa0d0009f80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:26.805 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.728+0000 7fa0e6bd8700 1 --2- 172.21.15.62:0/277766435 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0e015cac0 0x7fa0e015cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:41:26.805 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.728+0000 7fa0deffd700 1 -- 172.21.15.62:0/277766435 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d0019710 con 0x7fa0e00cc0b0 2023-06-09T04:41:26.805 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.728+0000 7fa0deffd700 1 -- 172.21.15.62:0/277766435 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0d0017050 con 0x7fa0e00cc0b0 2023-06-09T04:41:26.805 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.728+0000 7fa0deffd700 1 -- 172.21.15.62:0/277766435 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d0019ab0 con 0x7fa0e00cc0b0 2023-06-09T04:41:26.805 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.728+0000 7fa0e863b700 1 -- 172.21.15.62:0/277766435 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0e015d7d0 con 0x7fa0e00cc0b0 2023-06-09T04:41:26.806 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.728+0000 7f2fc7fff700 1 --2- 172.21.15.62:0/2610107969 >> [v2:172.21.15.62:6801/4169607876,v1:172.21.15.62:6803/4169607876] conn(0x7f2fac070090 0x7f2fac0724c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:26.806 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.728+0000 7f281ed9d700 1 --2- 172.21.15.62:0/1944090287 >> [v2:172.21.15.89:6816/3139617628,v1:172.21.15.89:6817/3139617628] conn(0x7f28000700c0 0x7f28000724f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:26.806 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.728+0000 7f281e59c700 1 --2- 172.21.15.62:0/1944090287 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f28000663f0 0x7f28000688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:26.807 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.728+0000 7fe097fff700 1 --2- 172.21.15.62:0/3983114920 >> [v2:172.21.15.62:6824/4120692006,v1:172.21.15.62:6825/4120692006] conn(0x7fe07c070090 0x7fe07c0724c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:26.807 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.732+0000 7fa0e863b700 1 -- 172.21.15.62:0/277766435 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0e00c9d80 con 0x7fa0e00cc0b0 2023-06-09T04:41:26.807 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.728+0000 7fed02ffd700 1 -- 172.21.15.62:0/552153608 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed04001630 con 0x7fed0c0b31e0 2023-06-09T04:41:26.808 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.728+0000 7fed1305f700 1 -- 172.21.15.62:0/552153608 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed0c0b29e0 con 0x7fed0c0b31e0 2023-06-09T04:41:26.808 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.732+0000 7fed1305f700 1 -- 172.21.15.62:0/552153608 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed0c0b48a0 con 0x7fed0c0b31e0 2023-06-09T04:41:26.808 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.732+0000 7fed02ffd700 1 -- 172.21.15.62:0/552153608 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed040070d0 con 0x7fed0c0b31e0 2023-06-09T04:41:26.808 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.732+0000 7fed02ffd700 1 -- 172.21.15.62:0/552153608 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed04007440 con 0x7fed0c0b31e0 2023-06-09T04:41:26.808 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.732+0000 7fe083fff700 1 -- 172.21.15.62:0/3983114920 <== osd.1 v2:172.21.15.62:6824/4120692006 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fe07c072b90 con 0x7fe07c070090 2023-06-09T04:41:26.809 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.732+0000 7f2fb3fff700 1 -- 172.21.15.62:0/2610107969 <== osd.2 v2:172.21.15.62:6801/4169607876 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f2fac072b90 con 0x7f2fac070090 2023-06-09T04:41:26.809 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.732+0000 7f281e59c700 1 --2- 172.21.15.62:0/1944090287 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f28000663f0 0x7f28000688a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2818010060 tx=0x7f2820073380 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:26.809 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.732+0000 7f281ed9d700 1 --2- 172.21.15.62:0/1944090287 >> [v2:172.21.15.89:6816/3139617628,v1:172.21.15.89:6817/3139617628] conn(0x7f28000700c0 0x7f28000724f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:26.809 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.732+0000 7fed1305f700 1 -- 172.21.15.62:0/552153608 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fecf4000fc0 con 0x7fed0c0b31e0 2023-06-09T04:41:26.810 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.728+0000 7f3966176700 1 -- 172.21.15.62:0/3306225756 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f394c004870 msgr2=0x7f39600b7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:26.810 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.728+0000 7f3966176700 1 --2- 172.21.15.62:0/3306225756 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f394c004870 0x7f39600b7810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:26.810 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.728+0000 7f3966176700 1 -- 172.21.15.62:0/3306225756 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39600cbdd0 msgr2=0x7f39600cc240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:26.810 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.728+0000 7f3966176700 1 --2- 172.21.15.62:0/3306225756 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39600cbdd0 0x7f39600cc240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:26.811 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.728+0000 7f3966176700 1 -- 172.21.15.62:0/3306225756 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39601f0600 con 0x7f39601ef710 2023-06-09T04:41:26.811 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.728+0000 7f3966176700 1 --2- 172.21.15.62:0/3306225756 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39601ef710 0x7f39601efb40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f39600cff10 tx=0x7f395000e9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:26.811 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.728+0000 7f39567fc700 1 -- 172.21.15.62:0/3306225756 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3950010450 con 0x7f39601ef710 2023-06-09T04:41:26.811 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.728+0000 7f39567fc700 1 -- 172.21.15.62:0/3306225756 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39500105d0 con 0x7f39601ef710 2023-06-09T04:41:26.811 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.728+0000 7f39567fc700 1 -- 172.21.15.62:0/3306225756 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3950010980 con 0x7f39601ef710 2023-06-09T04:41:26.811 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.732+0000 7f3966977700 1 -- 172.21.15.62:0/3306225756 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39601f08e0 con 0x7f39601ef710 2023-06-09T04:41:26.811 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.732+0000 7f3966977700 1 -- 172.21.15.62:0/3306225756 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39601f0ea0 con 0x7f39601ef710 2023-06-09T04:41:26.812 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.732+0000 7f280effd700 1 -- 172.21.15.62:0/1944090287 <== osd.4 v2:172.21.15.89:6816/3139617628 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f2800072bc0 con 0x7f28000700c0 2023-06-09T04:41:26.812 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.732+0000 7fa0deffd700 1 -- 172.21.15.62:0/277766435 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa0d0019c10 con 0x7fa0e00cc0b0 2023-06-09T04:41:26.812 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.732+0000 7fa0e863b700 1 -- 172.21.15.62:0/277766435 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa0e00d2fb0 con 0x7fa0e00cc0b0 2023-06-09T04:41:26.812 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.736+0000 7fa0deffd700 1 --2- 172.21.15.62:0/277766435 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fa0cc0773d0 0x7fa0cc079880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:26.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.736+0000 7fa0deffd700 1 -- 172.21.15.62:0/277766435 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa0d0010020 con 0x7fa0e00cc0b0 2023-06-09T04:41:26.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.736+0000 7fa0deffd700 1 --2- 172.21.15.62:0/277766435 >> [v2:172.21.15.89:6824/2681723596,v1:172.21.15.89:6825/2681723596] conn(0x7fa0cc081020 0x7fa0cc083450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:26.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.736+0000 7fa0deffd700 1 -- 172.21.15.62:0/277766435 --> [v2:172.21.15.89:6824/2681723596,v1:172.21.15.89:6825/2681723596] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa0cc083b20 con 0x7fa0cc081020 2023-06-09T04:41:26.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.736+0000 7fa0e6bd8700 1 --2- 172.21.15.62:0/277766435 >> [v2:172.21.15.89:6824/2681723596,v1:172.21.15.89:6825/2681723596] conn(0x7fa0cc081020 0x7fa0cc083450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:26.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.736+0000 7fed02ffd700 1 -- 172.21.15.62:0/552153608 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fed040075a0 con 0x7fed0c0b31e0 2023-06-09T04:41:26.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.736+0000 7fed02ffd700 1 --2- 172.21.15.62:0/552153608 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fecf0066310 0x7fecf00687c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:26.814 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.736+0000 7fed02ffd700 1 -- 172.21.15.62:0/552153608 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fed04086030 con 0x7fed0c0b31e0 2023-06-09T04:41:26.814 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.736+0000 7fed02ffd700 1 --2- 172.21.15.62:0/552153608 >> [v2:172.21.15.89:6808/1657136033,v1:172.21.15.89:6809/1657136033] conn(0x7fecf006ffe0 0x7fecf0072410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:26.814 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.736+0000 7fed02ffd700 1 -- 172.21.15.62:0/552153608 --> [v2:172.21.15.89:6808/1657136033,v1:172.21.15.89:6809/1657136033] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fecf0072ae0 con 0x7fecf006ffe0 2023-06-09T04:41:26.814 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.736+0000 7fed02ffd700 1 -- 172.21.15.62:0/552153608 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fed040863e0 con 0x7fed0c0b31e0 2023-06-09T04:41:26.814 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.736+0000 7f39567fc700 1 -- 172.21.15.62:0/3306225756 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3950010ae0 con 0x7f39601ef710 2023-06-09T04:41:26.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.736+0000 7fa0e63d7700 1 --2- 172.21.15.62:0/277766435 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fa0cc0773d0 0x7fa0cc079880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:26.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.736+0000 7fa0deffd700 1 -- 172.21.15.62:0/277766435 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa0d0051720 con 0x7fa0e00cc0b0 2023-06-09T04:41:26.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.736+0000 7fed1205d700 1 --2- 172.21.15.62:0/552153608 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fecf0066310 0x7fecf00687c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:26.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.736+0000 7fed1185c700 1 --2- 172.21.15.62:0/552153608 >> [v2:172.21.15.89:6808/1657136033,v1:172.21.15.89:6809/1657136033] conn(0x7fecf006ffe0 0x7fecf0072410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:26.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.740+0000 7fa0e6bd8700 1 --2- 172.21.15.62:0/277766435 >> [v2:172.21.15.89:6824/2681723596,v1:172.21.15.89:6825/2681723596] conn(0x7fa0cc081020 0x7fa0cc083450 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:26.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.740+0000 7f3966977700 1 -- 172.21.15.62:0/3306225756 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f39600d2fb0 con 0x7f39601ef710 2023-06-09T04:41:26.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.740+0000 7fed1205d700 1 --2- 172.21.15.62:0/552153608 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fecf0066310 0x7fecf00687c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fed0c14fe00 tx=0x7fed08009250 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:26.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.740+0000 7fed1185c700 1 --2- 172.21.15.62:0/552153608 >> [v2:172.21.15.89:6808/1657136033,v1:172.21.15.89:6809/1657136033] conn(0x7fecf006ffe0 0x7fecf0072410 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:26.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.740+0000 7f39567fc700 1 --2- 172.21.15.62:0/3306225756 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f39440662f0 0x7f39440687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:26.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.740+0000 7fa0e63d7700 1 --2- 172.21.15.62:0/277766435 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fa0cc0773d0 0x7fa0cc079880 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa0d4000fd0 tx=0x7fa0d4007040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:26.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.740+0000 7f39567fc700 1 -- 172.21.15.62:0/3306225756 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f39500833a0 con 0x7f39601ef710 2023-06-09T04:41:26.818 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.740+0000 7f39567fc700 1 --2- 172.21.15.62:0/3306225756 >> [v2:172.21.15.89:6800/1710561686,v1:172.21.15.89:6801/1710561686] conn(0x7f394406fe40 0x7f3944072270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:26.818 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.740+0000 7f39567fc700 1 -- 172.21.15.62:0/3306225756 --> [v2:172.21.15.89:6800/1710561686,v1:172.21.15.89:6801/1710561686] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3944072940 con 0x7f394406fe40 2023-06-09T04:41:26.818 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.740+0000 7f39567fc700 1 -- 172.21.15.62:0/3306225756 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f39500504a0 con 0x7f39601ef710 2023-06-09T04:41:26.818 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.740+0000 7f3965975700 1 --2- 172.21.15.62:0/3306225756 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f39440662f0 0x7f39440687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:26.818 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.740+0000 7f3965174700 1 --2- 172.21.15.62:0/3306225756 >> [v2:172.21.15.89:6800/1710561686,v1:172.21.15.89:6801/1710561686] conn(0x7f394406fe40 0x7f3944072270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:26.818 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.740+0000 7fa0deffd700 1 -- 172.21.15.62:0/277766435 <== osd.5 v2:172.21.15.89:6824/2681723596 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fa0cc083b20 con 0x7fa0cc081020 2023-06-09T04:41:26.819 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.740+0000 7fed02ffd700 1 -- 172.21.15.62:0/552153608 <== osd.6 v2:172.21.15.89:6808/1657136033 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fecf0072ae0 con 0x7fecf006ffe0 2023-06-09T04:41:26.819 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.740+0000 7f3965174700 1 --2- 172.21.15.62:0/3306225756 >> [v2:172.21.15.89:6800/1710561686,v1:172.21.15.89:6801/1710561686] conn(0x7f394406fe40 0x7f3944072270 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:26.819 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.740+0000 7f3965975700 1 --2- 172.21.15.62:0/3306225756 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f39440662f0 0x7f39440687a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f395c006fd0 tx=0x7f395c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:26.819 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.744+0000 7f39567fc700 1 -- 172.21.15.62:0/3306225756 <== osd.7 v2:172.21.15.89:6800/1710561686 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f3944072940 con 0x7f394406fe40 2023-06-09T04:41:26.820 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.756+0000 7f78148fb700 1 -- 172.21.15.62:0/1095017554 --> [v2:172.21.15.62:6816/3268438986,v1:172.21.15.62:6817/3268438986] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f78100d0ab0 con 0x7f77fc070090 2023-06-09T04:41:26.820 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.756+0000 7f77f7fff700 1 -- 172.21.15.62:0/1095017554 <== osd.3 v2:172.21.15.62:6816/3268438986 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7804009740 con 0x7f77fc070090 2023-06-09T04:41:26.820 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.760+0000 7fe09c8b2700 1 -- 172.21.15.62:0/3983114920 --> [v2:172.21.15.62:6824/4120692006,v1:172.21.15.62:6825/4120692006] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe0900e26c0 con 0x7fe07c070090 2023-06-09T04:41:26.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.760+0000 7f77f5ffb700 1 -- 172.21.15.62:0/1095017554 >> [v2:172.21.15.62:6816/3268438986,v1:172.21.15.62:6817/3268438986] conn(0x7f77fc070090 msgr2=0x7f77fc0724c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:26.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.760+0000 7f77f5ffb700 1 --2- 172.21.15.62:0/1095017554 >> [v2:172.21.15.62:6816/3268438986,v1:172.21.15.62:6817/3268438986] conn(0x7f77fc070090 0x7f77fc0724c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:26.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.760+0000 7f77f5ffb700 1 -- 172.21.15.62:0/1095017554 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f77fc0663c0 msgr2=0x7f77fc068870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:26.822 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.760+0000 7f77f5ffb700 1 --2- 172.21.15.62:0/1095017554 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f77fc0663c0 0x7f77fc068870 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f78100c8250 tx=0x7f7800007d40 comp rx=0 tx=0).stop 2023-06-09T04:41:26.822 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.760+0000 7f77f5ffb700 1 -- 172.21.15.62:0/1095017554 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78100cee40 msgr2=0x7f78100b6a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:26.822 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.760+0000 7f77f5ffb700 1 --2- 172.21.15.62:0/1095017554 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78100cee40 0x7f78100b6a70 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7808015000 tx=0x7f7808004af0 comp rx=0 tx=0).stop 2023-06-09T04:41:26.822 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.760+0000 7f2fcdf4d700 1 -- 172.21.15.62:0/2610107969 --> [v2:172.21.15.62:6801/4169607876,v1:172.21.15.62:6803/4169607876] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2fc0052ce0 con 0x7f2fac070090 2023-06-09T04:41:26.822 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.760+0000 7f780ffff700 1 -- 172.21.15.62:0/1095017554 reap_dead start 2023-06-09T04:41:26.823 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.760+0000 7fe083fff700 1 -- 172.21.15.62:0/3983114920 <== osd.1 v2:172.21.15.62:6824/4120692006 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe0980008d0 con 0x7fe07c070090 2023-06-09T04:41:26.823 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.760+0000 7f77f5ffb700 1 -- 172.21.15.62:0/1095017554 shutdown_connections 2023-06-09T04:41:26.823 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.760+0000 7f77f5ffb700 1 -- 172.21.15.62:0/1095017554 >> 172.21.15.62:0/1095017554 conn(0x7f781006a4b0 msgr2=0x7f78100cf210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:26.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.760+0000 7f2fb3fff700 1 -- 172.21.15.62:0/2610107969 <== osd.2 v2:172.21.15.62:6801/4169607876 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2fb4011630 con 0x7f2fac070090 2023-06-09T04:41:26.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.764+0000 7f77f5ffb700 1 -- 172.21.15.62:0/1095017554 shutdown_connections 2023-06-09T04:41:26.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.764+0000 7f77f5ffb700 1 -- 172.21.15.62:0/1095017554 wait complete. 2023-06-09T04:41:26.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.764+0000 7f8d7a145700 1 -- 172.21.15.62:0/1483719610 --> [v2:172.21.15.62:6800/1295788017,v1:172.21.15.62:6802/1295788017] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8d740d2cd0 con 0x7f8d580700c0 2023-06-09T04:41:26.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.764+0000 7f2fb1ffb700 1 -- 172.21.15.62:0/2610107969 >> [v2:172.21.15.62:6801/4169607876,v1:172.21.15.62:6803/4169607876] conn(0x7f2fac070090 msgr2=0x7f2fac0724c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:26.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.764+0000 7f2fb1ffb700 1 --2- 172.21.15.62:0/2610107969 >> [v2:172.21.15.62:6801/4169607876,v1:172.21.15.62:6803/4169607876] conn(0x7f2fac070090 0x7f2fac0724c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:26.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.764+0000 7f8d69ffb700 1 -- 172.21.15.62:0/1483719610 <== osd.0 v2:172.21.15.62:6800/1295788017 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8d64011630 con 0x7f8d580700c0 2023-06-09T04:41:26.826 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.764+0000 7f2fb1ffb700 1 -- 172.21.15.62:0/2610107969 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f2fac0663c0 msgr2=0x7f2fac068870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:26.826 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.764+0000 7f2824845700 1 -- 172.21.15.62:0/1944090287 --> [v2:172.21.15.89:6816/3139617628,v1:172.21.15.89:6817/3139617628] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f28180556d0 con 0x7f28000700c0 2023-06-09T04:41:26.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.764+0000 7f2fb1ffb700 1 --2- 172.21.15.62:0/2610107969 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f2fac0663c0 0x7f2fac068870 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2fc0051ed0 tx=0x7f2fbc008040 comp rx=0 tx=0).stop 2023-06-09T04:41:26.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.764+0000 7f2fb1ffb700 1 -- 172.21.15.62:0/2610107969 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fc0047c50 msgr2=0x7f2fc017c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:26.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.764+0000 7f2fb1ffb700 1 --2- 172.21.15.62:0/2610107969 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fc0047c50 0x7f2fc017c050 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2fc80634f0 tx=0x7f2fc806cc70 comp rx=0 tx=0).stop 2023-06-09T04:41:26.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.764+0000 7f2fc7fff700 1 -- 172.21.15.62:0/2610107969 reap_dead start 2023-06-09T04:41:26.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.764+0000 7f8d7a145700 1 -- 172.21.15.62:0/1483719610 >> [v2:172.21.15.62:6800/1295788017,v1:172.21.15.62:6802/1295788017] conn(0x7f8d580700c0 msgr2=0x7f8d580724f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:26.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.764+0000 7f8d7a145700 1 --2- 172.21.15.62:0/1483719610 >> [v2:172.21.15.62:6800/1295788017,v1:172.21.15.62:6802/1295788017] conn(0x7f8d580700c0 0x7f8d580724f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:26.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.764+0000 7f2fb1ffb700 1 -- 172.21.15.62:0/2610107969 shutdown_connections 2023-06-09T04:41:26.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.764+0000 7f2fb1ffb700 1 -- 172.21.15.62:0/2610107969 >> 172.21.15.62:0/2610107969 conn(0x7f2fc0051710 msgr2=0x7f2fc0005ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:26.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.764+0000 7f8d7a145700 1 -- 172.21.15.62:0/1483719610 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f8d580663f0 msgr2=0x7f8d580688a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:26.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.764+0000 7f8d7a145700 1 --2- 172.21.15.62:0/1483719610 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f8d580663f0 0x7f8d580688a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8d700011e0 tx=0x7f8d70009040 comp rx=0 tx=0).stop 2023-06-09T04:41:26.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.764+0000 7f8d7a145700 1 -- 172.21.15.62:0/1483719610 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d7415d7e0 msgr2=0x7f8d7415dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:26.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.764+0000 7f8d7a145700 1 --2- 172.21.15.62:0/1483719610 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d7415d7e0 0x7f8d7415dc80 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c002230 tx=0x7f8d6c00cdc0 comp rx=0 tx=0).stop 2023-06-09T04:41:26.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.764+0000 7f8d79944700 1 -- 172.21.15.62:0/1483719610 reap_dead start 2023-06-09T04:41:26.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.764+0000 7f2fb1ffb700 1 -- 172.21.15.62:0/2610107969 shutdown_connections 2023-06-09T04:41:26.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.764+0000 7f2fb1ffb700 1 -- 172.21.15.62:0/2610107969 wait complete. 2023-06-09T04:41:26.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.764+0000 7f8d7a145700 1 -- 172.21.15.62:0/1483719610 shutdown_connections 2023-06-09T04:41:26.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.764+0000 7f280effd700 1 -- 172.21.15.62:0/1944090287 <== osd.4 v2:172.21.15.89:6816/3139617628 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f28140014a0 con 0x7f28000700c0 2023-06-09T04:41:26.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.764+0000 7f8d7a145700 1 -- 172.21.15.62:0/1483719610 >> 172.21.15.62:0/1483719610 conn(0x7f8d74070f20 msgr2=0x7f8d740b29e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:26.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.764+0000 7f8d7a145700 1 -- 172.21.15.62:0/1483719610 shutdown_connections 2023-06-09T04:41:26.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.764+0000 7f8d7a145700 1 -- 172.21.15.62:0/1483719610 wait complete. 2023-06-09T04:41:26.832 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.764+0000 7f2824845700 1 -- 172.21.15.62:0/1944090287 >> [v2:172.21.15.89:6816/3139617628,v1:172.21.15.89:6817/3139617628] conn(0x7f28000700c0 msgr2=0x7f28000724f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:26.832 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.764+0000 7f2824845700 1 --2- 172.21.15.62:0/1944090287 >> [v2:172.21.15.89:6816/3139617628,v1:172.21.15.89:6817/3139617628] conn(0x7f28000700c0 0x7f28000724f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:26.832 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.768+0000 7f2824845700 1 -- 172.21.15.62:0/1944090287 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f28000663f0 msgr2=0x7f28000688a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:26.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.768+0000 7f2824845700 1 --2- 172.21.15.62:0/1944090287 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f28000663f0 0x7f28000688a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2818010060 tx=0x7f2820073380 comp rx=0 tx=0).stop 2023-06-09T04:41:26.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.768+0000 7f2824845700 1 -- 172.21.15.62:0/1944090287 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2818054c30 msgr2=0x7f281803e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:26.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.768+0000 7f2824845700 1 --2- 172.21.15.62:0/1944090287 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2818054c30 0x7f281803e0f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f281000c4d0 tx=0x7f281000c7e0 comp rx=0 tx=0).stop 2023-06-09T04:41:26.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.768+0000 7f281ed9d700 1 -- 172.21.15.62:0/1944090287 reap_dead start 2023-06-09T04:41:26.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.768+0000 7f3966977700 1 -- 172.21.15.62:0/3306225756 --> [v2:172.21.15.89:6800/1710561686,v1:172.21.15.89:6801/1710561686] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f39600d2fb0 con 0x7f394406fe40 2023-06-09T04:41:26.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.768+0000 7fe09c8b2700 1 -- 172.21.15.62:0/3983114920 >> [v2:172.21.15.62:6824/4120692006,v1:172.21.15.62:6825/4120692006] conn(0x7fe07c070090 msgr2=0x7fe07c0724c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:26.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.768+0000 7f2824845700 1 -- 172.21.15.62:0/1944090287 shutdown_connections 2023-06-09T04:41:26.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.768+0000 7f2824845700 1 -- 172.21.15.62:0/1944090287 >> 172.21.15.62:0/1944090287 conn(0x7f2818055b20 msgr2=0x7f281803bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:26.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.768+0000 7fe09c8b2700 1 --2- 172.21.15.62:0/3983114920 >> [v2:172.21.15.62:6824/4120692006,v1:172.21.15.62:6825/4120692006] conn(0x7fe07c070090 0x7fe07c0724c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:26.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.768+0000 7f2824845700 1 -- 172.21.15.62:0/1944090287 shutdown_connections 2023-06-09T04:41:26.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.768+0000 7f2824845700 1 -- 172.21.15.62:0/1944090287 wait complete. 2023-06-09T04:41:26.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.768+0000 7f39567fc700 1 -- 172.21.15.62:0/3306225756 <== osd.7 v2:172.21.15.89:6800/1710561686 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3958009850 con 0x7f394406fe40 2023-06-09T04:41:26.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.768+0000 7fe09c8b2700 1 -- 172.21.15.62:0/3983114920 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fe07c0663c0 msgr2=0x7fe07c068870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:26.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.768+0000 7fe09c8b2700 1 --2- 172.21.15.62:0/3983114920 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fe07c0663c0 0x7fe07c068870 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe08c014040 tx=0x7fe08c008030 comp rx=0 tx=0).stop 2023-06-09T04:41:26.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.768+0000 7fe09c8b2700 1 -- 172.21.15.62:0/3983114920 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0900c7c20 msgr2=0x7fe090174ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:26.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.768+0000 7fe09c8b2700 1 --2- 172.21.15.62:0/3983114920 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe0900c7c20 0x7fe090174ab0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe08400c830 tx=0x7fe08400cb40 comp rx=0 tx=0).stop 2023-06-09T04:41:26.837 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.768+0000 7fe097fff700 1 -- 172.21.15.62:0/3983114920 reap_dead start 2023-06-09T04:41:26.837 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.768+0000 7fe09c8b2700 1 -- 172.21.15.62:0/3983114920 shutdown_connections 2023-06-09T04:41:26.837 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.768+0000 7fe09c8b2700 1 -- 172.21.15.62:0/3983114920 >> 172.21.15.62:0/3983114920 conn(0x7fe090051710 msgr2=0x7fe0900dc120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:26.837 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.768+0000 7fa0e863b700 1 -- 172.21.15.62:0/277766435 --> [v2:172.21.15.89:6824/2681723596,v1:172.21.15.89:6825/2681723596] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa0e00d2cd0 con 0x7fa0cc081020 2023-06-09T04:41:26.837 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.772+0000 7fe09c8b2700 1 -- 172.21.15.62:0/3983114920 shutdown_connections 2023-06-09T04:41:26.838 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.772+0000 7fe09c8b2700 1 -- 172.21.15.62:0/3983114920 wait complete. 2023-06-09T04:41:26.838 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.772+0000 7fa0deffd700 1 -- 172.21.15.62:0/277766435 <== osd.5 v2:172.21.15.89:6824/2681723596 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa0d8005040 con 0x7fa0cc081020 2023-06-09T04:41:26.838 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.772+0000 7fed1305f700 1 -- 172.21.15.62:0/552153608 --> [v2:172.21.15.89:6808/1657136033,v1:172.21.15.89:6809/1657136033] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fecf4002d60 con 0x7fecf006ffe0 2023-06-09T04:41:26.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.772+0000 7fa0e863b700 1 -- 172.21.15.62:0/277766435 >> [v2:172.21.15.89:6824/2681723596,v1:172.21.15.89:6825/2681723596] conn(0x7fa0cc081020 msgr2=0x7fa0cc083450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:26.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.772+0000 7fa0e863b700 1 --2- 172.21.15.62:0/277766435 >> [v2:172.21.15.89:6824/2681723596,v1:172.21.15.89:6825/2681723596] conn(0x7fa0cc081020 0x7fa0cc083450 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:26.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.772+0000 7fa0e863b700 1 -- 172.21.15.62:0/277766435 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fa0cc0773d0 msgr2=0x7fa0cc079880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:26.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.772+0000 7fa0e863b700 1 --2- 172.21.15.62:0/277766435 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fa0cc0773d0 0x7fa0cc079880 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa0d4000fd0 tx=0x7fa0d4007040 comp rx=0 tx=0).stop 2023-06-09T04:41:26.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.772+0000 7fa0e863b700 1 -- 172.21.15.62:0/277766435 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0e00cc0b0 msgr2=0x7fa0e00cc500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:26.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.772+0000 7fa0e863b700 1 --2- 172.21.15.62:0/277766435 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0e00cc0b0 0x7fa0e00cc500 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa0d0009f50 tx=0x7fa0d0009f80 comp rx=0 tx=0).stop 2023-06-09T04:41:26.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.772+0000 7fa0e6bd8700 1 -- 172.21.15.62:0/277766435 reap_dead start 2023-06-09T04:41:26.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.772+0000 7fa0e863b700 1 -- 172.21.15.62:0/277766435 shutdown_connections 2023-06-09T04:41:26.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.772+0000 7fa0e863b700 1 -- 172.21.15.62:0/277766435 >> 172.21.15.62:0/277766435 conn(0x7fa0e0070f20 msgr2=0x7fa0e00d0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:26.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.772+0000 7fed02ffd700 1 -- 172.21.15.62:0/552153608 <== osd.6 v2:172.21.15.89:6808/1657136033 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fecf4002d60 con 0x7fecf006ffe0 2023-06-09T04:41:26.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.772+0000 7fa0e863b700 1 -- 172.21.15.62:0/277766435 shutdown_connections 2023-06-09T04:41:26.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.772+0000 7fa0e863b700 1 -- 172.21.15.62:0/277766435 wait complete. 2023-06-09T04:41:26.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.772+0000 7f3966977700 1 -- 172.21.15.62:0/3306225756 >> [v2:172.21.15.89:6800/1710561686,v1:172.21.15.89:6801/1710561686] conn(0x7f394406fe40 msgr2=0x7f3944072270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:26.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.772+0000 7f3966977700 1 --2- 172.21.15.62:0/3306225756 >> [v2:172.21.15.89:6800/1710561686,v1:172.21.15.89:6801/1710561686] conn(0x7f394406fe40 0x7f3944072270 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:26.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.776+0000 7f3966977700 1 -- 172.21.15.62:0/3306225756 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f39440662f0 msgr2=0x7f39440687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:26.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.776+0000 7f3966977700 1 --2- 172.21.15.62:0/3306225756 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f39440662f0 0x7f39440687a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f395c006fd0 tx=0x7f395c008040 comp rx=0 tx=0).stop 2023-06-09T04:41:26.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.776+0000 7f3966977700 1 -- 172.21.15.62:0/3306225756 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39601ef710 msgr2=0x7f39601efb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:26.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.776+0000 7f3966977700 1 --2- 172.21.15.62:0/3306225756 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39601ef710 0x7f39601efb40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f39600cff10 tx=0x7f395000e9e0 comp rx=0 tx=0).stop 2023-06-09T04:41:26.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.776+0000 7f3966176700 1 -- 172.21.15.62:0/3306225756 reap_dead start 2023-06-09T04:41:26.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.776+0000 7f3966977700 1 -- 172.21.15.62:0/3306225756 shutdown_connections 2023-06-09T04:41:26.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.776+0000 7f3966977700 1 -- 172.21.15.62:0/3306225756 >> 172.21.15.62:0/3306225756 conn(0x7f3960070f20 msgr2=0x7f396015a010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:26.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.776+0000 7f3966977700 1 -- 172.21.15.62:0/3306225756 shutdown_connections 2023-06-09T04:41:26.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.776+0000 7f3966977700 1 -- 172.21.15.62:0/3306225756 wait complete. 2023-06-09T04:41:26.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.780+0000 7fed1305f700 1 -- 172.21.15.62:0/552153608 >> [v2:172.21.15.89:6808/1657136033,v1:172.21.15.89:6809/1657136033] conn(0x7fecf006ffe0 msgr2=0x7fecf0072410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:26.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.780+0000 7fed1305f700 1 --2- 172.21.15.62:0/552153608 >> [v2:172.21.15.89:6808/1657136033,v1:172.21.15.89:6809/1657136033] conn(0x7fecf006ffe0 0x7fecf0072410 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:26.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.780+0000 7fed1305f700 1 -- 172.21.15.62:0/552153608 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fecf0066310 msgr2=0x7fecf00687c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:26.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.780+0000 7fed1305f700 1 --2- 172.21.15.62:0/552153608 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fecf0066310 0x7fecf00687c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fed0c14fe00 tx=0x7fed08009250 comp rx=0 tx=0).stop 2023-06-09T04:41:26.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.780+0000 7fed1305f700 1 -- 172.21.15.62:0/552153608 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed0c0b31e0 msgr2=0x7fed0c0aed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:26.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.780+0000 7fed1305f700 1 --2- 172.21.15.62:0/552153608 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed0c0b31e0 0x7fed0c0aed10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fed04001930 tx=0x7fed0c164260 comp rx=0 tx=0).stop 2023-06-09T04:41:26.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.780+0000 7fed1285e700 1 -- 172.21.15.62:0/552153608 reap_dead start 2023-06-09T04:41:26.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.780+0000 7fed1305f700 1 -- 172.21.15.62:0/552153608 shutdown_connections 2023-06-09T04:41:26.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.780+0000 7fed1305f700 1 -- 172.21.15.62:0/552153608 >> 172.21.15.62:0/552153608 conn(0x7fed0c06a900 msgr2=0x7fed0c161690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:26.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.780+0000 7fed1305f700 1 -- 172.21.15.62:0/552153608 shutdown_connections 2023-06-09T04:41:26.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:26.780+0000 7fed1305f700 1 -- 172.21.15.62:0/552153608 wait complete. 2023-06-09T04:41:26.846 INFO:teuthology.orchestra.run.smithi062.stdout:55834574860 2023-06-09T04:41:26.847 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-06-09T04:41:26.848 INFO:teuthology.orchestra.run.smithi062.stdout:55834574859 2023-06-09T04:41:26.848 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-06-09T04:41:26.849 INFO:teuthology.orchestra.run.smithi062.stdout:55834574858 2023-06-09T04:41:26.849 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-06-09T04:41:26.850 INFO:teuthology.orchestra.run.smithi062.stdout:55834574860 2023-06-09T04:41:26.850 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-06-09T04:41:26.851 INFO:teuthology.orchestra.run.smithi062.stdout:55834574858 2023-06-09T04:41:26.851 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-06-09T04:41:26.852 INFO:teuthology.orchestra.run.smithi062.stdout:55834574859 2023-06-09T04:41:26.852 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-06-09T04:41:26.853 INFO:teuthology.orchestra.run.smithi062.stdout:55834574859 2023-06-09T04:41:26.853 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-06-09T04:41:26.854 INFO:teuthology.orchestra.run.smithi062.stdout:55834574858 2023-06-09T04:41:26.855 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-06-09T04:41:27.117 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.112+0000 7fd9fc298700 1 Processor -- start 2023-06-09T04:41:27.118 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.112+0000 7fd9fc298700 1 -- start start 2023-06-09T04:41:27.118 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.112+0000 7fd9fc298700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9f40c8680 0x7fd9f40711a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:27.118 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.112+0000 7fd9fc298700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd9f41605d0 0x7fd9f4160a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:27.118 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.112+0000 7fd9fc298700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9f4164ab0 con 0x7fd9f4163c80 2023-06-09T04:41:27.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.112+0000 7fd9fc298700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9f406f980 con 0x7fd9f41605d0 2023-06-09T04:41:27.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.112+0000 7fd9fc298700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f40cbca0 con 0x7fd9f40c8680 2023-06-09T04:41:27.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.116+0000 7fd9fa835700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd9f41605d0 0x7fd9f4160a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:27.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.116+0000 7fd9f9833700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9f40c8680 0x7fd9f40711a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:27.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.116+0000 7fd9fa034700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fd9f4163c80 0x7fd9f4164050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.62:44568/0 (socket says 172.21.15.62:44568) 2023-06-09T04:41:27.120 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.116+0000 7fd9fa034700 1 -- 172.21.15.62:0/3808053462 learned_addr learned my addr 172.21.15.62:0/3808053462 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:41:27.120 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.116+0000 7fd9f9032700 1 -- 172.21.15.62:0/3808053462 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1174244531 0 0) 0x7fd9f4164ab0 con 0x7fd9f4163c80 2023-06-09T04:41:27.120 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.116+0000 7fd9f9032700 1 -- 172.21.15.62:0/3808053462 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9e00035d0 con 0x7fd9f4163c80 2023-06-09T04:41:27.121 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.116+0000 7fd9f9833700 1 -- 172.21.15.62:0/3808053462 >> v2:172.21.15.89:3300/0 conn(0x7fd9f41605d0 msgr2=0x7fd9f4160a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:27.121 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.116+0000 7fd9f9833700 1 --2- 172.21.15.62:0/3808053462 >> v2:172.21.15.89:3300/0 conn(0x7fd9f41605d0 0x7fd9f4160a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:27.121 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.116+0000 7fd9f9833700 1 -- 172.21.15.62:0/3808053462 >> v1:172.21.15.89:6789/0 conn(0x7fd9f4163c80 legacy=0x7fd9f4164050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:27.121 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.116+0000 7fd9f9833700 1 -- 172.21.15.62:0/3808053462 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9f40cbf80 con 0x7fd9f40c8680 2023-06-09T04:41:27.121 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.116+0000 7fd9f9833700 1 --2- 172.21.15.62:0/3808053462 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9f40c8680 0x7fd9f40711a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd9e4009850 tx=0x7fd9e4009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d522c1b2e52e01db server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:27.122 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.116+0000 7fd9f9032700 1 -- 172.21.15.62:0/3808053462 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e4011830 con 0x7fd9f40c8680 2023-06-09T04:41:27.122 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.116+0000 7fd9f9032700 1 -- 172.21.15.62:0/3808053462 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9e4011990 con 0x7fd9f40c8680 2023-06-09T04:41:27.122 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.116+0000 7fd9f9032700 1 -- 172.21.15.62:0/3808053462 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e4011d40 con 0x7fd9f40c8680 2023-06-09T04:41:27.123 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.116+0000 7fd9fc298700 1 -- 172.21.15.62:0/3808053462 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9f40c8680 msgr2=0x7fd9f40711a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:27.123 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.116+0000 7fd9fc298700 1 --2- 172.21.15.62:0/3808053462 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9f40c8680 0x7fd9f40711a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd9e4009850 tx=0x7fd9e4009b60 comp rx=0 tx=0).stop 2023-06-09T04:41:27.123 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.116+0000 7fd9fc298700 1 -- 172.21.15.62:0/3808053462 shutdown_connections 2023-06-09T04:41:27.123 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.116+0000 7fd9fc298700 1 --2- 172.21.15.62:0/3808053462 >> v2:172.21.15.89:3300/0 conn(0x7fd9f41605d0 0x7fd9f4160a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:27.123 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.116+0000 7fd9fc298700 1 --2- 172.21.15.62:0/3808053462 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9f40c8680 0x7fd9f40711a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:27.123 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.116+0000 7fd9fc298700 1 -- 172.21.15.62:0/3808053462 >> 172.21.15.62:0/3808053462 conn(0x7fd9f40b0860 msgr2=0x7fd9f40ce030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:27.123 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.116+0000 7fd9fc298700 1 -- 172.21.15.62:0/3808053462 shutdown_connections 2023-06-09T04:41:27.124 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.116+0000 7fd9fc298700 1 -- 172.21.15.62:0/3808053462 wait complete. 2023-06-09T04:41:27.124 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.120+0000 7fd9fc298700 1 Processor -- start 2023-06-09T04:41:27.125 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.120+0000 7fd9fc298700 1 -- start start 2023-06-09T04:41:27.126 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.120+0000 7fd9fc298700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9f40c8680 0x7fd9f40c4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:27.126 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.120+0000 7fd9fc298700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9f41605d0 0x7fd9f40c7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:27.126 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.120+0000 7fd9fc298700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9f4163c80 0x7fd9f41f50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:27.126 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.120+0000 7fd9fc298700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f40c1fe0 con 0x7fd9f41605d0 2023-06-09T04:41:27.127 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.120+0000 7fd9fc298700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f40c1a20 con 0x7fd9f40c8680 2023-06-09T04:41:27.127 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.120+0000 7fd9fc298700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f40c1d00 con 0x7fd9f4163c80 2023-06-09T04:41:27.127 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.120+0000 7fd9f9833700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9f41605d0 0x7fd9f40c7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:27.127 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.120+0000 7fd9fa034700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9f40c8680 0x7fd9f40c4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:27.128 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.124+0000 7fd9f9833700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9f41605d0 0x7fd9f40c7500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40472/0 (socket says 172.21.15.62:40472) 2023-06-09T04:41:27.128 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.124+0000 7fd9f9833700 1 -- 172.21.15.62:0/271752134 learned_addr learned my addr 172.21.15.62:0/271752134 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:27.128 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.124+0000 7fd9fa835700 1 --2- 172.21.15.62:0/271752134 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9f4163c80 0x7fd9f41f50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:27.128 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.124+0000 7fd9fa034700 1 -- 172.21.15.62:0/271752134 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9f4163c80 msgr2=0x7fd9f41f50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:27.128 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.124+0000 7fd9fa034700 1 --2- 172.21.15.62:0/271752134 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9f4163c80 0x7fd9f41f50f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:27.128 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.124+0000 7fd9fa034700 1 -- 172.21.15.62:0/271752134 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9f41605d0 msgr2=0x7fd9f40c7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:27.128 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.124+0000 7fd9fa034700 1 --2- 172.21.15.62:0/271752134 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9f41605d0 0x7fd9f40c7500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:27.129 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.124+0000 7fd9fa034700 1 -- 172.21.15.62:0/271752134 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9e40094b0 con 0x7fd9f40c8680 2023-06-09T04:41:27.129 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.124+0000 7fd9fa034700 1 --2- 172.21.15.62:0/271752134 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9f40c8680 0x7fd9f40c4620 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec00caa0 tx=0x7fd9ec00cad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:27.129 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.124+0000 7f33d0df2700 1 Processor -- start 2023-06-09T04:41:27.130 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.124+0000 7fd9eaffd700 1 -- 172.21.15.62:0/271752134 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9ec007480 con 0x7fd9f40c8680 2023-06-09T04:41:27.130 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.124+0000 7fd9fc298700 1 -- 172.21.15.62:0/271752134 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9f40c6d00 con 0x7fd9f40c8680 2023-06-09T04:41:27.130 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.124+0000 7fd9eaffd700 1 -- 172.21.15.62:0/271752134 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9ec0075e0 con 0x7fd9f40c8680 2023-06-09T04:41:27.130 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.124+0000 7fd9eaffd700 1 -- 172.21.15.62:0/271752134 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9ec007950 con 0x7fd9f40c8680 2023-06-09T04:41:27.130 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.124+0000 7fd9fc298700 1 -- 172.21.15.62:0/271752134 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9f40c7a40 con 0x7fd9f40c8680 2023-06-09T04:41:27.131 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.124+0000 7f33d0df2700 1 -- start start 2023-06-09T04:41:27.131 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.124+0000 7fd9fc298700 1 -- 172.21.15.62:0/271752134 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9f40c6b60 con 0x7fd9f40c8680 2023-06-09T04:41:27.131 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.124+0000 7f826c970700 1 Processor -- start 2023-06-09T04:41:27.132 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.124+0000 7f33d0df2700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f33cc06f5a0 0x7f33cc06fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:27.132 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.128+0000 7f33c1d9b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f33cc06f5a0 0x7f33cc06fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:27.132 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.128+0000 7f33d0df2700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33cc158120 con 0x7f33cc140b10 2023-06-09T04:41:27.132 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.128+0000 7f33d0df2700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33cc0cc6c0 con 0x7f33cc0ca3b0 2023-06-09T04:41:27.133 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.128+0000 7f00bd80a700 1 Processor -- start 2023-06-09T04:41:27.133 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.128+0000 7f33d0df2700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33cc06ff80 con 0x7f33cc06f5a0 2023-06-09T04:41:27.133 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.128+0000 7f00bd80a700 1 -- start start 2023-06-09T04:41:27.134 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.128+0000 7f33c1d9b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f33cc06f5a0 0x7f33cc06fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40480/0 (socket says 172.21.15.62:40480) 2023-06-09T04:41:27.134 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.128+0000 7f33c1d9b700 1 -- 172.21.15.62:0/2591017749 learned_addr learned my addr 172.21.15.62:0/2591017749 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:27.134 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.124+0000 7f826c970700 1 -- start start 2023-06-09T04:41:27.135 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.128+0000 7f33c1d9b700 1 -- 172.21.15.62:0/2591017749 >> v1:172.21.15.89:6789/0 conn(0x7f33cc0ca3b0 legacy=0x7f33cc0cbc00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-06-09T04:41:27.135 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.128+0000 7f33c1d9b700 1 -- 172.21.15.62:0/2591017749 >> v1:172.21.15.62:6789/0 conn(0x7f33cc140b10 legacy=0x7f33cc140f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:27.135 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.128+0000 7f826c970700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f82680ce9c0 0x7f82680cc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:27.135 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.128+0000 7f826c970700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f82680ccf20 0x7f8268165730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:27.136 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.128+0000 7f826c970700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82680b51e0 con 0x7f82680d1ac0 2023-06-09T04:41:27.136 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.128+0000 7f826c970700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82680d0190 con 0x7f82680ccf20 2023-06-09T04:41:27.136 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.128+0000 7f826c970700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82680d29f0 con 0x7f82680ce9c0 2023-06-09T04:41:27.136 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.128+0000 7f8267fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f82680ccf20 0x7f8268165730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:27.136 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.128+0000 7fd9eaffd700 1 -- 172.21.15.62:0/271752134 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd9ec01b3b0 con 0x7fd9f40c8680 2023-06-09T04:41:27.137 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.128+0000 7f8267fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f82680ccf20 0x7f8268165730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40488/0 (socket says 172.21.15.62:40488) 2023-06-09T04:41:27.137 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.128+0000 7f8267fff700 1 -- 172.21.15.62:0/1318280213 learned_addr learned my addr 172.21.15.62:0/1318280213 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:27.137 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.128+0000 7f82677fe700 1 --2- 172.21.15.62:0/1318280213 >> v2:172.21.15.89:3300/0 conn(0x7f82680ce9c0 0x7f82680cc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:27.137 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.128+0000 7f33c1d9b700 1 -- 172.21.15.62:0/2591017749 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33cc0cc9a0 con 0x7f33cc06f5a0 2023-06-09T04:41:27.138 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.128+0000 7f00bd80a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f00b004faf0 0x7f00b0036710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:27.138 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.128+0000 7f33c1d9b700 1 --2- 172.21.15.62:0/2591017749 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33cc06f5a0 0x7f33cc06fa40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f33b4009940 tx=0x7f33b4009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11c105ebe7d3ce15 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:27.139 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.128+0000 7f00bd80a700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f00b00c7c20 0x7f00b0036c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:27.139 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.128+0000 7f00bd80a700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00b00e32d0 con 0x7f00b00c8170 2023-06-09T04:41:27.139 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.128+0000 7f00bd80a700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00b004bbd0 con 0x7f00b00c7c20 2023-06-09T04:41:27.139 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.128+0000 7f00bd80a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00b004fec0 con 0x7f00b004faf0 2023-06-09T04:41:27.139 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.128+0000 7f8267fff700 1 -- 172.21.15.62:0/1318280213 >> v2:172.21.15.89:3300/0 conn(0x7f82680ce9c0 msgr2=0x7f82680cc9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:27.140 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.128+0000 7f8267fff700 1 --2- 172.21.15.62:0/1318280213 >> v2:172.21.15.89:3300/0 conn(0x7f82680ce9c0 0x7f82680cc9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:27.140 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.128+0000 7f8267fff700 1 -- 172.21.15.62:0/1318280213 >> v1:172.21.15.62:6789/0 conn(0x7f82680d1ac0 legacy=0x7f82680ced90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:27.140 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.128+0000 7f33c9d9b700 1 -- 172.21.15.62:0/2591017749 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b4004230 con 0x7f33cc06f5a0 2023-06-09T04:41:27.140 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.128+0000 7f33c9d9b700 1 -- 172.21.15.62:0/2591017749 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33b4009e90 con 0x7f33cc06f5a0 2023-06-09T04:41:27.140 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.128+0000 7f33c9d9b700 1 -- 172.21.15.62:0/2591017749 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b40045b0 con 0x7f33cc06f5a0 2023-06-09T04:41:27.141 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.132+0000 7fd9eaffd700 1 --2- 172.21.15.62:0/271752134 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fd9d80662f0 0x7fd9d80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:27.141 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.128+0000 7f00b6ffd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f00b004faf0 0x7f00b0036710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:27.141 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.128+0000 7f00b6ffd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f00b004faf0 0x7f00b0036710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.62:35886/0 (socket says 172.21.15.62:35886) 2023-06-09T04:41:27.141 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.128+0000 7f00b6ffd700 1 -- 172.21.15.62:0/119776485 learned_addr learned my addr 172.21.15.62:0/119776485 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:27.142 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.132+0000 7fd9eaffd700 1 -- 172.21.15.62:0/271752134 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd9ec083b00 con 0x7fd9f40c8680 2023-06-09T04:41:27.142 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.132+0000 7f00b67fc700 1 --2- 172.21.15.62:0/119776485 >> v2:172.21.15.89:3300/0 conn(0x7f00b00c7c20 0x7f00b0036c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:27.142 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.132+0000 7fd9f9833700 1 --2- 172.21.15.62:0/271752134 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fd9d80662f0 0x7fd9d80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:27.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.132+0000 7f8267fff700 1 -- 172.21.15.62:0/1318280213 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82680d2cd0 con 0x7f82680ccf20 2023-06-09T04:41:27.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.132+0000 7f8267fff700 1 --2- 172.21.15.62:0/1318280213 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82680ccf20 0x7f8268165730 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f826808b660 tx=0x7f826000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aec0d0d4ae9bdb5e server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:27.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.132+0000 7f00b6ffd700 1 -- 172.21.15.62:0/119776485 >> v2:172.21.15.89:3300/0 conn(0x7f00b00c7c20 msgr2=0x7f00b0036c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:27.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.132+0000 7f00b6ffd700 1 --2- 172.21.15.62:0/119776485 >> v2:172.21.15.89:3300/0 conn(0x7f00b00c7c20 0x7f00b0036c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:27.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.132+0000 7f00b6ffd700 1 -- 172.21.15.62:0/119776485 >> v1:172.21.15.62:6789/0 conn(0x7f00b00c8170 legacy=0x7f00b0005fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:27.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.132+0000 7f00b6ffd700 1 -- 172.21.15.62:0/119776485 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b00e2470 con 0x7f00b004faf0 2023-06-09T04:41:27.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.132+0000 7f00b6ffd700 1 --2- 172.21.15.62:0/119776485 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f00b004faf0 0x7f00b0036710 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f00a8009910 tx=0x7f00a8009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b02d54781f569497 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:27.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.132+0000 7f33d0df2700 1 -- 172.21.15.62:0/2591017749 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33cc06f5a0 msgr2=0x7f33cc06fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:27.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.132+0000 7f33d0df2700 1 --2- 172.21.15.62:0/2591017749 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33cc06f5a0 0x7f33cc06fa40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f33b4009940 tx=0x7f33b4009c50 comp rx=0 tx=0).stop 2023-06-09T04:41:27.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.132+0000 7f33d0df2700 1 -- 172.21.15.62:0/2591017749 shutdown_connections 2023-06-09T04:41:27.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.132+0000 7f33d0df2700 1 --2- 172.21.15.62:0/2591017749 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33cc06f5a0 0x7f33cc06fa40 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:27.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.132+0000 7f33d0df2700 1 -- 172.21.15.62:0/2591017749 >> 172.21.15.62:0/2591017749 conn(0x7f33cc0b0860 msgr2=0x7f33cc0ce030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:27.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.132+0000 7f00b5ffb700 1 -- 172.21.15.62:0/119776485 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a800ba60 con 0x7f00b004faf0 2023-06-09T04:41:27.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.132+0000 7f00b5ffb700 1 -- 172.21.15.62:0/119776485 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00a800bbc0 con 0x7f00b004faf0 2023-06-09T04:41:27.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.132+0000 7f00b5ffb700 1 -- 172.21.15.62:0/119776485 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a8009e60 con 0x7f00b004faf0 2023-06-09T04:41:27.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.132+0000 7f82667fc700 1 -- 172.21.15.62:0/1318280213 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f826000e070 con 0x7f82680ccf20 2023-06-09T04:41:27.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.132+0000 7f82667fc700 1 -- 172.21.15.62:0/1318280213 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8260003a40 con 0x7f82680ccf20 2023-06-09T04:41:27.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.132+0000 7f82667fc700 1 -- 172.21.15.62:0/1318280213 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8260003df0 con 0x7f82680ccf20 2023-06-09T04:41:27.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.132+0000 7f826c970700 1 -- 172.21.15.62:0/1318280213 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82680ccf20 msgr2=0x7f8268165730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:27.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.132+0000 7f826c970700 1 --2- 172.21.15.62:0/1318280213 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82680ccf20 0x7f8268165730 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f826808b660 tx=0x7f826000b330 comp rx=0 tx=0).stop 2023-06-09T04:41:27.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.132+0000 7f33d0df2700 1 -- 172.21.15.62:0/2591017749 shutdown_connections 2023-06-09T04:41:27.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.132+0000 7f33d0df2700 1 -- 172.21.15.62:0/2591017749 wait complete. 2023-06-09T04:41:27.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.132+0000 7f00bd80a700 1 -- 172.21.15.62:0/119776485 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f00b004faf0 msgr2=0x7f00b0036710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:27.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.132+0000 7f00bd80a700 1 --2- 172.21.15.62:0/119776485 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f00b004faf0 0x7f00b0036710 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f00a8009910 tx=0x7f00a8009c20 comp rx=0 tx=0).stop 2023-06-09T04:41:27.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.132+0000 7f00bd80a700 1 -- 172.21.15.62:0/119776485 shutdown_connections 2023-06-09T04:41:27.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.132+0000 7f00bd80a700 1 --2- 172.21.15.62:0/119776485 >> v2:172.21.15.89:3300/0 conn(0x7f00b00c7c20 0x7f00b0036c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:27.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.132+0000 7f00bd80a700 1 --2- 172.21.15.62:0/119776485 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f00b004faf0 0x7f00b0036710 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:27.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.132+0000 7f00bd80a700 1 -- 172.21.15.62:0/119776485 >> 172.21.15.62:0/119776485 conn(0x7f00b0051710 msgr2=0x7f00b0051ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:27.149 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.132+0000 7fd9f9833700 1 --2- 172.21.15.62:0/271752134 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fd9d80662f0 0x7fd9d80687a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd9f40c7d50 tx=0x7fd9e4008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:27.149 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.132+0000 7f826c970700 1 -- 172.21.15.62:0/1318280213 shutdown_connections 2023-06-09T04:41:27.149 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.132+0000 7f826c970700 1 --2- 172.21.15.62:0/1318280213 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82680ccf20 0x7f8268165730 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:27.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.132+0000 7f826c970700 1 --2- 172.21.15.62:0/1318280213 >> v2:172.21.15.89:3300/0 conn(0x7f82680ce9c0 0x7f82680cc9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:27.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.132+0000 7f826c970700 1 -- 172.21.15.62:0/1318280213 >> 172.21.15.62:0/1318280213 conn(0x7f8268070f20 msgr2=0x7f82680712f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:27.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.132+0000 7f00bd80a700 1 -- 172.21.15.62:0/119776485 shutdown_connections 2023-06-09T04:41:27.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.132+0000 7f826c970700 1 -- 172.21.15.62:0/1318280213 shutdown_connections 2023-06-09T04:41:27.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.132+0000 7f00bd80a700 1 -- 172.21.15.62:0/119776485 wait complete. 2023-06-09T04:41:27.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.136+0000 7fab8147b700 1 Processor -- start 2023-06-09T04:41:27.152 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.136+0000 7f33d0df2700 1 Processor -- start 2023-06-09T04:41:27.152 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.132+0000 7f826c970700 1 -- 172.21.15.62:0/1318280213 wait complete. 2023-06-09T04:41:27.152 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.136+0000 7f89a2b01700 1 Processor -- start 2023-06-09T04:41:27.153 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.136+0000 7f00bd80a700 1 Processor -- start 2023-06-09T04:41:27.153 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.136+0000 7fd9eaffd700 1 -- 172.21.15.62:0/271752134 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd9ec0547b0 con 0x7fd9f40c8680 2023-06-09T04:41:27.153 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.136+0000 7f826c970700 1 Processor -- start 2023-06-09T04:41:27.154 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.136+0000 7f826c970700 1 -- start start 2023-06-09T04:41:27.154 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.136+0000 7f00bd80a700 1 -- start start 2023-06-09T04:41:27.154 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.136+0000 7f33d0df2700 1 -- start start 2023-06-09T04:41:27.154 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.136+0000 7f33d0df2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f33cc06f5a0 0x7f33cc0c8070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:27.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.140+0000 7f33d0df2700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33cc0ca3b0 0x7f33cc0c2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:27.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.140+0000 7f33d0df2700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33cc140b10 0x7f33cc0a74a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:27.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.140+0000 7f33d0df2700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33cc0c2eb0 con 0x7f33cc0ca3b0 2023-06-09T04:41:27.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.140+0000 7f33d0df2700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33cc0c39f0 con 0x7f33cc140b10 2023-06-09T04:41:27.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.140+0000 7f33d0df2700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33cc0c30c0 con 0x7f33cc06f5a0 2023-06-09T04:41:27.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.140+0000 7f33c1d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33cc0ca3b0 0x7f33cc0c2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:27.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.140+0000 7f33c1d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33cc0ca3b0 0x7f33cc0c2570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40498/0 (socket says 172.21.15.62:40498) 2023-06-09T04:41:27.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.140+0000 7f33c1d9b700 1 -- 172.21.15.62:0/1054965566 learned_addr learned my addr 172.21.15.62:0/1054965566 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:27.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.136+0000 7f89a2b01700 1 -- start start 2023-06-09T04:41:27.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.136+0000 7fab8147b700 1 -- start start 2023-06-09T04:41:27.157 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.136+0000 7fab8147b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fab74052b30 0x7fab740380c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:27.157 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.136+0000 7fab7a7fc700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fab74052b30 0x7fab740380c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:27.157 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.136+0000 7fab7a7fc700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fab74052b30 0x7fab740380c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40496/0 (socket says 172.21.15.62:40496) 2023-06-09T04:41:27.157 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.136+0000 7fab7affd700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fab740358f0 0x7fab74054eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.62:44594/0 (socket says 172.21.15.62:44594) 2023-06-09T04:41:27.157 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.136+0000 7fab7a7fc700 1 -- 172.21.15.62:0/1436189594 learned_addr learned my addr 172.21.15.62:0/1436189594 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:27.157 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.136+0000 7fab8147b700 1 -- 172.21.15.62:0/1436189594 --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab74054210 con 0x7fab74049560 2023-06-09T04:41:27.158 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.136+0000 7fab8147b700 1 -- 172.21.15.62:0/1436189594 --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab740eb980 con 0x7fab740358f0 2023-06-09T04:41:27.158 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.140+0000 7f826c970700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82680ce9c0 0x7f826815a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:27.158 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.140+0000 7f89a2b01700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f899c0ce9c0 0x7f899c0cc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:27.158 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.140+0000 7f89a2b01700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f899c0d1ac0 0x7f899c0ced90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:27.159 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.140+0000 7f89a2b01700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f899c0ccf20 0x7f899c0d0620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:27.159 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.140+0000 7f89a2b01700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f899c0b51e0 con 0x7f899c0ccf20 2023-06-09T04:41:27.159 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.140+0000 7f89a2b01700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f899c0d0190 con 0x7f899c0ce9c0 2023-06-09T04:41:27.159 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.140+0000 7f89a2b01700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f899c0d29f0 con 0x7f899c0d1ac0 2023-06-09T04:41:27.159 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.140+0000 7f33c1d9b700 1 -- 172.21.15.62:0/1054965566 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f33cc06f5a0 msgr2=0x7f33cc0c8070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:27.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.140+0000 7f33cad9d700 1 --2- 172.21.15.62:0/1054965566 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33cc140b10 0x7f33cc0a74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:27.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.140+0000 7f33c1d9b700 1 --2- 172.21.15.62:0/1054965566 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f33cc06f5a0 0x7f33cc0c8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:27.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.140+0000 7f33c1d9b700 1 -- 172.21.15.62:0/1054965566 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33cc140b10 msgr2=0x7f33cc0a74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:27.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.140+0000 7f826c970700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82681f2060 0x7f82680c6e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:27.161 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.140+0000 7f33c1d9b700 1 --2- 172.21.15.62:0/1054965566 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33cc140b10 0x7f33cc0a74a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:27.161 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.140+0000 7f33c1d9b700 1 -- 172.21.15.62:0/1054965566 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33b4009570 con 0x7f33cc0ca3b0 2023-06-09T04:41:27.161 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.140+0000 7fbf5d38a700 1 Processor -- start 2023-06-09T04:41:27.162 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.140+0000 7f89a109e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f899c0ccf20 0x7f899c0d0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:27.162 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.140+0000 7f89a109e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f899c0ccf20 0x7f899c0d0620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40502/0 (socket says 172.21.15.62:40502) 2023-06-09T04:41:27.162 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.140+0000 7f89a109e700 1 -- 172.21.15.62:0/1344702507 learned_addr learned my addr 172.21.15.62:0/1344702507 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:27.162 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.140+0000 7f826c970700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82681f24d0 0x7f82680c7390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:27.162 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.140+0000 7f82677fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82680ce9c0 0x7f826815a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:27.163 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.140+0000 7f826c970700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82680c5e80 con 0x7f82680ce9c0 2023-06-09T04:41:27.163 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.140+0000 7f82677fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82680ce9c0 0x7f826815a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40512/0 (socket says 172.21.15.62:40512) 2023-06-09T04:41:27.163 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.140+0000 7f82677fe700 1 -- 172.21.15.62:0/2811432818 learned_addr learned my addr 172.21.15.62:0/2811432818 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:27.163 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.140+0000 7f826c970700 1 -- 172.21.15.62:0/2811432818 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82680c6090 con 0x7f82681f2060 2023-06-09T04:41:27.163 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.140+0000 7f826c970700 1 -- 172.21.15.62:0/2811432818 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82680c6370 con 0x7f82681f24d0 2023-06-09T04:41:27.164 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.140+0000 7f00bd80a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f00b004faf0 0x7f00b00c6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:27.164 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.140+0000 7f899bfff700 1 --2- 172.21.15.62:0/1344702507 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f899c0d1ac0 0x7f899c0ced90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:27.164 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.140+0000 7f33cad9d700 1 --2- 172.21.15.62:0/1054965566 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33cc140b10 0x7f33cc0a74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:41:27.165 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.140+0000 7f89a089d700 1 --2- 172.21.15.62:0/1344702507 >> v2:172.21.15.89:3300/0 conn(0x7f899c0ce9c0 0x7f899c0cc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:27.165 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.140+0000 7fab8147b700 1 -- 172.21.15.62:0/1436189594 --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab740eb490 con 0x7fab74052b30 2023-06-09T04:41:27.165 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.140+0000 7f00bd80a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00b00c7c20 0x7f00b00c5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:27.166 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.140+0000 7f8267fff700 1 --2- 172.21.15.62:0/2811432818 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82681f24d0 0x7f82680c7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:27.166 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.140+0000 7f89a109e700 1 -- 172.21.15.62:0/1344702507 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f899c0d1ac0 msgr2=0x7f899c0ced90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:27.166 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.140+0000 7f89a109e700 1 --2- 172.21.15.62:0/1344702507 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f899c0d1ac0 0x7f899c0ced90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:27.166 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.140+0000 7f89a109e700 1 -- 172.21.15.62:0/1344702507 >> v2:172.21.15.89:3300/0 conn(0x7f899c0ce9c0 msgr2=0x7f899c0cc9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:27.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.140+0000 7f00b6ffd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f00b004faf0 0x7f00b00c6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:27.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.140+0000 7f00b6ffd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f00b004faf0 0x7f00b00c6240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.62:35916/0 (socket says 172.21.15.62:35916) 2023-06-09T04:41:27.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.140+0000 7f00b67fc700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00b00c7c20 0x7f00b00c5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:27.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.140+0000 7f00b67fc700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00b00c7c20 0x7f00b00c5970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.62:44206/0 (socket says 172.21.15.62:44206) 2023-06-09T04:41:27.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.140+0000 7f00bd80a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00b00c8170 0x7f00b017bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:27.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.140+0000 7f89a109e700 1 --2- 172.21.15.62:0/1344702507 >> v2:172.21.15.89:3300/0 conn(0x7f899c0ce9c0 0x7f899c0cc9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:27.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.140+0000 7f89a109e700 1 -- 172.21.15.62:0/1344702507 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f899c0d2cd0 con 0x7f899c0ccf20 2023-06-09T04:41:27.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.140+0000 7f89a089d700 1 --2- 172.21.15.62:0/1344702507 >> v2:172.21.15.89:3300/0 conn(0x7f899c0ce9c0 0x7f899c0cc9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:41:27.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.140+0000 7f00bd80a700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b00c75c0 con 0x7f00b00c8170 2023-06-09T04:41:27.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.140+0000 7f00b6ffd700 1 -- 172.21.15.62:0/2050536901 learned_addr learned my addr 172.21.15.62:0/2050536901 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:27.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.140+0000 7f00bd80a700 1 -- 172.21.15.62:0/2050536901 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b00c5eb0 con 0x7f00b00c7c20 2023-06-09T04:41:27.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.140+0000 7f8267fff700 1 -- 172.21.15.62:0/2811432818 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82681f2060 msgr2=0x7f82680c6e50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-06-09T04:41:27.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.140+0000 7f8267fff700 1 --2- 172.21.15.62:0/2811432818 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82681f2060 0x7f82680c6e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:27.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.140+0000 7f8267fff700 1 -- 172.21.15.62:0/2811432818 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82680ce9c0 msgr2=0x7f826815a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:27.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.140+0000 7f8267fff700 1 --2- 172.21.15.62:0/2811432818 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82680ce9c0 0x7f826815a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:27.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.140+0000 7f8267fff700 1 -- 172.21.15.62:0/2811432818 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8260009b30 con 0x7f82681f24d0 2023-06-09T04:41:27.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.140+0000 7f00b77fe700 1 --2- 172.21.15.62:0/2050536901 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00b00c8170 0x7f00b017bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:27.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.140+0000 7f00bd80a700 1 -- 172.21.15.62:0/2050536901 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00b00c79e0 con 0x7f00b004faf0 2023-06-09T04:41:27.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.140+0000 7f8267fff700 1 --2- 172.21.15.62:0/2811432818 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82681f24d0 0x7f82680c7390 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8260014000 tx=0x7f8260004af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:27.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.140+0000 7f824ffff700 1 -- 172.21.15.62:0/2811432818 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8260004440 con 0x7f82681f24d0 2023-06-09T04:41:27.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.140+0000 7f826c970700 1 -- 172.21.15.62:0/2811432818 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82680c6650 con 0x7f82681f24d0 2023-06-09T04:41:27.172 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.140+0000 7f826c970700 1 -- 172.21.15.62:0/2811432818 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f826815a770 con 0x7f82681f24d0 2023-06-09T04:41:27.172 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.144+0000 7f824ffff700 1 -- 172.21.15.62:0/2811432818 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82600045a0 con 0x7f82681f24d0 2023-06-09T04:41:27.172 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.144+0000 7f824ffff700 1 -- 172.21.15.62:0/2811432818 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8260004930 con 0x7f82681f24d0 2023-06-09T04:41:27.172 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.140+0000 7f00b77fe700 1 -- 172.21.15.62:0/2050536901 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f00b004faf0 msgr2=0x7f00b00c6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:27.172 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.140+0000 7f00b77fe700 1 --2- 172.21.15.62:0/2050536901 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f00b004faf0 0x7f00b00c6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:27.173 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.140+0000 7f00b77fe700 1 -- 172.21.15.62:0/2050536901 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00b00c7c20 msgr2=0x7f00b00c5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:27.173 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.140+0000 7f00b77fe700 1 --2- 172.21.15.62:0/2050536901 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00b00c7c20 0x7f00b00c5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:27.173 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.140+0000 7f00b77fe700 1 -- 172.21.15.62:0/2050536901 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00a8009570 con 0x7f00b00c8170 2023-06-09T04:41:27.173 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.140+0000 7f33c1d9b700 1 --2- 172.21.15.62:0/1054965566 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33cc0ca3b0 0x7f33cc0c2570 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f33cc066bc0 tx=0x7f33b4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:27.173 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.144+0000 7f33c37fe700 1 -- 172.21.15.62:0/1054965566 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b400bd50 con 0x7f33cc0ca3b0 2023-06-09T04:41:27.173 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.144+0000 7f33c37fe700 1 -- 172.21.15.62:0/1054965566 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33b401f070 con 0x7f33cc0ca3b0 2023-06-09T04:41:27.174 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.144+0000 7f33d0df2700 1 -- 172.21.15.62:0/1054965566 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33cc0c33a0 con 0x7f33cc0ca3b0 2023-06-09T04:41:27.174 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.144+0000 7f33c37fe700 1 -- 172.21.15.62:0/1054965566 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b4003900 con 0x7f33cc0ca3b0 2023-06-09T04:41:27.174 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.140+0000 7fbf5d38a700 1 -- start start 2023-06-09T04:41:27.174 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.144+0000 7f00b77fe700 1 --2- 172.21.15.62:0/2050536901 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00b00c8170 0x7f00b017bf50 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f00b8069390 tx=0x7f00b8073380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:27.175 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.144+0000 7f33d0df2700 1 -- 172.21.15.62:0/1054965566 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33cc0c2ab0 con 0x7f33cc0ca3b0 2023-06-09T04:41:27.175 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.144+0000 7fbf5d38a700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbf50047c50 0x7fbf500480a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:27.175 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.144+0000 7fbf5d38a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbf50053aa0 0x7fbf50053f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:27.176 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.144+0000 7fbf5d38a700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf5004f9f0 con 0x7fbf500e6f20 2023-06-09T04:41:27.176 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.144+0000 7fbf5d38a700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf500485e0 con 0x7fbf50047c50 2023-06-09T04:41:27.176 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.144+0000 7fbf5d38a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf50053610 con 0x7fbf50053aa0 2023-06-09T04:41:27.176 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.144+0000 7f89a109e700 1 --2- 172.21.15.62:0/1344702507 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f899c0ccf20 0x7f899c0d0620 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f899c08b660 tx=0x7f899400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac3fe989fefdddc4 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:27.176 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.144+0000 7fab79ffb700 1 -- 172.21.15.62:0/1436189594 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 532635724 0 0) 0x7fab740eb980 con 0x7fab740358f0 2023-06-09T04:41:27.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.144+0000 7fab79ffb700 1 -- 172.21.15.62:0/1436189594 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab640035d0 con 0x7fab740358f0 2023-06-09T04:41:27.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.144+0000 7fab79ffb700 1 -- 172.21.15.62:0/1436189594 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2960417274 0 0) 0x7fab74054210 con 0x7fab74049560 2023-06-09T04:41:27.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.144+0000 7fab79ffb700 1 -- 172.21.15.62:0/1436189594 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab740eb980 con 0x7fab74049560 2023-06-09T04:41:27.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.144+0000 7fab7a7fc700 1 -- 172.21.15.62:0/1436189594 >> v1:172.21.15.89:6789/0 conn(0x7fab740358f0 legacy=0x7fab74054eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:27.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.144+0000 7fab7a7fc700 1 -- 172.21.15.62:0/1436189594 >> v1:172.21.15.62:6789/0 conn(0x7fab74049560 legacy=0x7fab74050f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:27.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.144+0000 7fab7a7fc700 1 -- 172.21.15.62:0/1436189594 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab74054460 con 0x7fab74052b30 2023-06-09T04:41:27.178 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.140+0000 7f490c868700 1 Processor -- start 2023-06-09T04:41:27.178 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.140+0000 7f490c868700 1 -- start start 2023-06-09T04:41:27.178 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.144+0000 7f490c868700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49080c8680 0x7f49080711a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:27.178 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.144+0000 7f490c868700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4908164ab0 con 0x7f49081605d0 2023-06-09T04:41:27.178 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.144+0000 7f490c868700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f490806f980 con 0x7f4908163c80 2023-06-09T04:41:27.178 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.144+0000 7f490c868700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49080cbca0 con 0x7f49080c8680 2023-06-09T04:41:27.179 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.144+0000 7fbf5cb89700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbf50053aa0 0x7fbf50053f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:27.179 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.144+0000 7fbf5cb89700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbf50053aa0 0x7fbf50053f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.62:35920/0 (socket says 172.21.15.62:35920) 2023-06-09T04:41:27.179 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.144+0000 7fbf5cb89700 1 -- 172.21.15.62:0/4065756469 learned_addr learned my addr 172.21.15.62:0/4065756469 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:27.179 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.144+0000 7fab7a7fc700 1 --2- 172.21.15.62:0/1436189594 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab74052b30 0x7fab740380c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fab70009940 tx=0x7fab70009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5750f32c29d77087 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:27.180 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.144+0000 7f824dffb700 1 -- 172.21.15.62:0/2811432818 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82680739c0 con 0x7f82681f24d0 2023-06-09T04:41:27.180 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.144+0000 7f009ffff700 1 -- 172.21.15.62:0/2050536901 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b8067640 con 0x7f00b00c8170 2023-06-09T04:41:27.180 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.144+0000 7f009ffff700 1 -- 172.21.15.62:0/2050536901 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00b80677e0 con 0x7f00b00c8170 2023-06-09T04:41:27.180 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.144+0000 7f009ffff700 1 -- 172.21.15.62:0/2050536901 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b8067b90 con 0x7f00b00c8170 2023-06-09T04:41:27.181 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.144+0000 7f00bd80a700 1 -- 172.21.15.62:0/2050536901 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00b00c6940 con 0x7f00b00c8170 2023-06-09T04:41:27.181 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.144+0000 7f00bd80a700 1 -- 172.21.15.62:0/2050536901 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00b00c6f00 con 0x7f00b00c8170 2023-06-09T04:41:27.181 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.144+0000 7f33d0df2700 1 -- 172.21.15.62:0/1054965566 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33cc0739c0 con 0x7f33cc0ca3b0 2023-06-09T04:41:27.181 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.144+0000 7fbf577fe700 1 --2- 172.21.15.62:0/4065756469 >> v2:172.21.15.62:3300/0 conn(0x7fbf50047c50 0x7fbf500480a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:27.181 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.144+0000 7fbf5cb89700 1 -- 172.21.15.62:0/4065756469 >> v2:172.21.15.62:3300/0 conn(0x7fbf50047c50 msgr2=0x7fbf500480a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:27.182 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.144+0000 7fbf5cb89700 1 --2- 172.21.15.62:0/4065756469 >> v2:172.21.15.62:3300/0 conn(0x7fbf50047c50 0x7fbf500480a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:27.182 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.144+0000 7fbf5cb89700 1 -- 172.21.15.62:0/4065756469 >> v1:172.21.15.62:6789/0 conn(0x7fbf500e6f20 legacy=0x7fbf5004f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:27.182 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.144+0000 7fbf5cb89700 1 -- 172.21.15.62:0/4065756469 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf50052a00 con 0x7fbf50053aa0 2023-06-09T04:41:27.182 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.144+0000 7f899b7fe700 1 -- 172.21.15.62:0/1344702507 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f899400e070 con 0x7f899c0ccf20 2023-06-09T04:41:27.182 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.144+0000 7f899b7fe700 1 -- 172.21.15.62:0/1344702507 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f899400b9c0 con 0x7f899c0ccf20 2023-06-09T04:41:27.182 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.144+0000 7f899b7fe700 1 -- 172.21.15.62:0/1344702507 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f899400bd50 con 0x7f899c0ccf20 2023-06-09T04:41:27.183 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.144+0000 7fab79ffb700 1 -- 172.21.15.62:0/1436189594 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab70004230 con 0x7fab74052b30 2023-06-09T04:41:27.183 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.144+0000 7fab79ffb700 1 -- 172.21.15.62:0/1436189594 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab70004390 con 0x7fab74052b30 2023-06-09T04:41:27.183 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.144+0000 7fab79ffb700 1 -- 172.21.15.62:0/1436189594 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab700036c0 con 0x7fab74052b30 2023-06-09T04:41:27.184 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.144+0000 7f49077fe700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f4908163c80 0x7f4908164050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.62:44596/0 (socket says 172.21.15.62:44596) 2023-06-09T04:41:27.184 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.144+0000 7f49077fe700 1 -- 172.21.15.62:0/1164718199 learned_addr learned my addr 172.21.15.62:0/1164718199 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:41:27.184 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.144+0000 7f48fffff700 1 --2- 172.21.15.62:0/1164718199 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49080c8680 0x7f49080711a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:27.184 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.144+0000 7f4906ffd700 1 -- 172.21.15.62:0/1164718199 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1598389537 0 0) 0x7f490806f980 con 0x7f4908163c80 2023-06-09T04:41:27.184 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.144+0000 7f4906ffd700 1 -- 172.21.15.62:0/1164718199 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48f40035d0 con 0x7f4908163c80 2023-06-09T04:41:27.184 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.144+0000 7f48fffff700 1 -- 172.21.15.62:0/1164718199 >> v1:172.21.15.89:6789/0 conn(0x7f4908163c80 legacy=0x7f4908164050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:27.184 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.144+0000 7f48fffff700 1 -- 172.21.15.62:0/1164718199 >> v1:172.21.15.62:6789/0 conn(0x7f49081605d0 legacy=0x7f4908160a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:27.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.144+0000 7f48fffff700 1 -- 172.21.15.62:0/1164718199 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49080cbf80 con 0x7f49080c8680 2023-06-09T04:41:27.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.144+0000 7fbf5cb89700 1 --2- 172.21.15.62:0/4065756469 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbf50053aa0 0x7fbf50053f20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbf58078b50 tx=0x7fbf58073380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ccbfd12ed780e719 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:27.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.144+0000 7f48fffff700 1 --2- 172.21.15.62:0/1164718199 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49080c8680 0x7f49080711a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f48f0009880 tx=0x7f48f0009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96ffb33ffea5f6ee server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:27.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.144+0000 7f89a2b01700 1 -- 172.21.15.62:0/1344702507 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f899c0ccf20 msgr2=0x7f899c0d0620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:27.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.144+0000 7f89a2b01700 1 --2- 172.21.15.62:0/1344702507 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f899c0ccf20 0x7f899c0d0620 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f899c08b660 tx=0x7f899400b330 comp rx=0 tx=0).stop 2023-06-09T04:41:27.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.144+0000 7fab8147b700 1 -- 172.21.15.62:0/1436189594 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab74052b30 msgr2=0x7fab740380c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:27.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.144+0000 7fab8147b700 1 --2- 172.21.15.62:0/1436189594 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab74052b30 0x7fab740380c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fab70009940 tx=0x7fab70009c50 comp rx=0 tx=0).stop 2023-06-09T04:41:27.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.144+0000 7f4906ffd700 1 -- 172.21.15.62:0/1164718199 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f0004230 con 0x7f49080c8680 2023-06-09T04:41:27.187 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.148+0000 7fbf56ffd700 1 -- 172.21.15.62:0/4065756469 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf5806b980 con 0x7fbf50053aa0 2023-06-09T04:41:27.187 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.148+0000 7fbf56ffd700 1 -- 172.21.15.62:0/4065756469 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf5806bb20 con 0x7fbf50053aa0 2023-06-09T04:41:27.187 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.148+0000 7fbf56ffd700 1 -- 172.21.15.62:0/4065756469 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf58066760 con 0x7fbf50053aa0 2023-06-09T04:41:27.187 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.148+0000 7fab8147b700 1 -- 172.21.15.62:0/1436189594 shutdown_connections 2023-06-09T04:41:27.188 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.148+0000 7fab8147b700 1 --2- 172.21.15.62:0/1436189594 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab74052b30 0x7fab740380c0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:27.188 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.148+0000 7fab8147b700 1 -- 172.21.15.62:0/1436189594 >> 172.21.15.62:0/1436189594 conn(0x7fab740530c0 msgr2=0x7fab74053490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:27.188 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.148+0000 7f4906ffd700 1 -- 172.21.15.62:0/1164718199 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48f0004390 con 0x7f49080c8680 2023-06-09T04:41:27.188 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.148+0000 7f4906ffd700 1 -- 172.21.15.62:0/1164718199 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f00036c0 con 0x7f49080c8680 2023-06-09T04:41:27.188 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.148+0000 7f490c868700 1 -- 172.21.15.62:0/1164718199 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49080c8680 msgr2=0x7f49080711a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:27.189 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.148+0000 7f490c868700 1 --2- 172.21.15.62:0/1164718199 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49080c8680 0x7f49080711a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f48f0009880 tx=0x7f48f0009b90 comp rx=0 tx=0).stop 2023-06-09T04:41:27.189 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.148+0000 7fbf5d38a700 1 -- 172.21.15.62:0/4065756469 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbf50053aa0 msgr2=0x7fbf50053f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:27.189 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.148+0000 7fbf5d38a700 1 --2- 172.21.15.62:0/4065756469 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbf50053aa0 0x7fbf50053f20 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbf58078b50 tx=0x7fbf58073380 comp rx=0 tx=0).stop 2023-06-09T04:41:27.189 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.148+0000 7fab8147b700 1 -- 172.21.15.62:0/1436189594 shutdown_connections 2023-06-09T04:41:27.189 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.148+0000 7fab8147b700 1 -- 172.21.15.62:0/1436189594 wait complete. 2023-06-09T04:41:27.190 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.148+0000 7fbf5d38a700 1 -- 172.21.15.62:0/4065756469 shutdown_connections 2023-06-09T04:41:27.190 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.148+0000 7fbf5d38a700 1 --2- 172.21.15.62:0/4065756469 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbf50053aa0 0x7fbf50053f20 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:27.190 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.148+0000 7fbf5d38a700 1 --2- 172.21.15.62:0/4065756469 >> v2:172.21.15.62:3300/0 conn(0x7fbf50047c50 0x7fbf500480a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:27.190 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.148+0000 7fbf5d38a700 1 -- 172.21.15.62:0/4065756469 >> 172.21.15.62:0/4065756469 conn(0x7fbf50051710 msgr2=0x7fbf50051ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:27.191 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.148+0000 7f490c868700 1 -- 172.21.15.62:0/1164718199 shutdown_connections 2023-06-09T04:41:27.191 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.148+0000 7f490c868700 1 --2- 172.21.15.62:0/1164718199 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f49080c8680 0x7f49080711a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:27.191 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.148+0000 7f490c868700 1 -- 172.21.15.62:0/1164718199 >> 172.21.15.62:0/1164718199 conn(0x7f49080b0860 msgr2=0x7f49080ce030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:27.191 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.148+0000 7f89a2b01700 1 -- 172.21.15.62:0/1344702507 shutdown_connections 2023-06-09T04:41:27.191 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.148+0000 7f89a2b01700 1 --2- 172.21.15.62:0/1344702507 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f899c0ccf20 0x7f899c0d0620 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:27.191 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.148+0000 7f89a2b01700 1 --2- 172.21.15.62:0/1344702507 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f899c0d1ac0 0x7f899c0ced90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:27.192 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.148+0000 7f89a2b01700 1 --2- 172.21.15.62:0/1344702507 >> v2:172.21.15.89:3300/0 conn(0x7f899c0ce9c0 0x7f899c0cc9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:27.192 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.148+0000 7f89a2b01700 1 -- 172.21.15.62:0/1344702507 >> 172.21.15.62:0/1344702507 conn(0x7f899c070f20 msgr2=0x7f899c0712f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:27.192 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.148+0000 7f33c37fe700 1 -- 172.21.15.62:0/1054965566 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f33b4021030 con 0x7f33cc0ca3b0 2023-06-09T04:41:27.192 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.148+0000 7f00bd80a700 1 -- 172.21.15.62:0/2050536901 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00b0005460 con 0x7f00b00c8170 2023-06-09T04:41:27.193 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.148+0000 7f824ffff700 1 -- 172.21.15.62:0/2811432818 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8260019030 con 0x7f82681f24d0 2023-06-09T04:41:27.193 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.148+0000 7f490c868700 1 -- 172.21.15.62:0/1164718199 shutdown_connections 2023-06-09T04:41:27.193 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.148+0000 7f33c37fe700 1 --2- 172.21.15.62:0/1054965566 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f33ac066340 0x7f33ac0687f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:27.193 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.148+0000 7f33c37fe700 1 -- 172.21.15.62:0/1054965566 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f33b4085b90 con 0x7f33cc0ca3b0 2023-06-09T04:41:27.194 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.148+0000 7fbf5d38a700 1 -- 172.21.15.62:0/4065756469 shutdown_connections 2023-06-09T04:41:27.194 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.148+0000 7fbf5d38a700 1 -- 172.21.15.62:0/4065756469 wait complete. 2023-06-09T04:41:27.194 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.148+0000 7f824ffff700 1 --2- 172.21.15.62:0/2811432818 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f82540662f0 0x7f82540687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:27.195 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.148+0000 7fab8147b700 1 Processor -- start 2023-06-09T04:41:27.195 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.148+0000 7fab8147b700 1 -- start start 2023-06-09T04:41:27.195 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.148+0000 7f824ffff700 1 -- 172.21.15.62:0/2811432818 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f82600851a0 con 0x7f82681f24d0 2023-06-09T04:41:27.195 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.152+0000 7f82677fe700 1 --2- 172.21.15.62:0/2811432818 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f82540662f0 0x7f82540687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:27.196 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.152+0000 7f33ca59c700 1 --2- 172.21.15.62:0/1054965566 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f33ac066340 0x7f33ac0687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:27.196 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.152+0000 7f89a2b01700 1 -- 172.21.15.62:0/1344702507 shutdown_connections 2023-06-09T04:41:27.196 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.152+0000 7f89a2b01700 1 -- 172.21.15.62:0/1344702507 wait complete. 2023-06-09T04:41:27.196 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.148+0000 7f490c868700 1 -- 172.21.15.62:0/1164718199 wait complete. 2023-06-09T04:41:27.197 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.152+0000 7f490c868700 1 Processor -- start 2023-06-09T04:41:27.197 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.152+0000 7f82677fe700 1 --2- 172.21.15.62:0/2811432818 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f82540662f0 0x7f82540687a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8258009cb0 tx=0x7f8258009240 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:27.197 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.152+0000 7fab8147b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab740358f0 0x7fab740d51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:27.197 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.152+0000 7f33ca59c700 1 --2- 172.21.15.62:0/1054965566 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f33ac066340 0x7f33ac0687f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f33bc009790 tx=0x7f33bc006cf0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:27.198 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.152+0000 7fab8147b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fab74049560 0x7fab74050110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:27.198 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.152+0000 7fab8147b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab74052b30 0x7fab740d7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:27.198 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.152+0000 7fab8147b700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab7417fdb0 con 0x7fab74052b30 2023-06-09T04:41:27.198 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.152+0000 7fab8147b700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab741808f0 con 0x7fab740358f0 2023-06-09T04:41:27.198 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.152+0000 7fab8147b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab74050650 con 0x7fab74049560 2023-06-09T04:41:27.199 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.152+0000 7fbf5d38a700 1 Processor -- start 2023-06-09T04:41:27.199 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.152+0000 7fab7affd700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab740358f0 0x7fab740d51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:27.199 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.152+0000 7fab7affd700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab740358f0 0x7fab740d51a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.62:44218/0 (socket says 172.21.15.62:44218) 2023-06-09T04:41:27.200 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.152+0000 7fab7affd700 1 -- 172.21.15.62:0/2473726439 learned_addr learned my addr 172.21.15.62:0/2473726439 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:27.200 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.152+0000 7fab7a7fc700 1 --2- 172.21.15.62:0/2473726439 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fab74049560 0x7fab74050110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:27.200 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.152+0000 7fab7bfff700 1 --2- 172.21.15.62:0/2473726439 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab74052b30 0x7fab740d7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:27.200 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.152+0000 7fab7a7fc700 1 -- 172.21.15.62:0/2473726439 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab740358f0 msgr2=0x7fab740d51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:27.200 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.152+0000 7fab7a7fc700 1 --2- 172.21.15.62:0/2473726439 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab740358f0 0x7fab740d51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:27.200 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.152+0000 7fab7a7fc700 1 -- 172.21.15.62:0/2473726439 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab74052b30 msgr2=0x7fab740d7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:27.200 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.152+0000 7fab7a7fc700 1 --2- 172.21.15.62:0/2473726439 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab74052b30 0x7fab740d7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:27.201 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.152+0000 7fab7a7fc700 1 -- 172.21.15.62:0/2473726439 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab70009570 con 0x7fab74049560 2023-06-09T04:41:27.201 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.152+0000 7fab7affd700 1 --2- 172.21.15.62:0/2473726439 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab740358f0 0x7fab740d51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:41:27.201 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.152+0000 7f490c868700 1 -- start start 2023-06-09T04:41:27.201 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.152+0000 7f490c868700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49080c8680 0x7f49080b3040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:27.202 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.152+0000 7fbf5d38a700 1 -- start start 2023-06-09T04:41:27.202 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.152+0000 7fab7a7fc700 1 --2- 172.21.15.62:0/2473726439 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fab74049560 0x7fab74050110 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fab70015000 tx=0x7fab70004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:27.202 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.152+0000 7f490c868700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49081605d0 0x7f4908141910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:27.203 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.152+0000 7f49077fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49080c8680 0x7f49080b3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:27.203 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.152+0000 7f49077fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49080c8680 0x7f49080b3040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40540/0 (socket says 172.21.15.62:40540) 2023-06-09T04:41:27.203 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.152+0000 7f49077fe700 1 -- 172.21.15.62:0/2574714007 learned_addr learned my addr 172.21.15.62:0/2574714007 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:27.203 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.152+0000 7f89a2b01700 1 Processor -- start 2023-06-09T04:41:27.204 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.152+0000 7f490c868700 1 --2- 172.21.15.62:0/2574714007 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4908163c80 0x7f4908141e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:27.204 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.152+0000 7f490c868700 1 -- 172.21.15.62:0/2574714007 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f490815b360 con 0x7f49080c8680 2023-06-09T04:41:27.204 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.152+0000 7f490c868700 1 -- 172.21.15.62:0/2574714007 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f490814f690 con 0x7f49081605d0 2023-06-09T04:41:27.204 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.152+0000 7f89a2b01700 1 -- start start 2023-06-09T04:41:27.205 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.152+0000 7f48fffff700 1 --2- 172.21.15.62:0/2574714007 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49081605d0 0x7f4908141910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:27.205 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.152+0000 7f490c868700 1 -- 172.21.15.62:0/2574714007 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f490815a7e0 con 0x7f4908163c80 2023-06-09T04:41:27.205 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.152+0000 7f33c37fe700 1 -- 172.21.15.62:0/1054965566 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f33b4052d90 con 0x7f33cc0ca3b0 2023-06-09T04:41:27.206 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.156+0000 7fbf5d38a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbf50047c50 0x7fbf50048e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:27.206 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.156+0000 7fbf5d38a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbf50053aa0 0x7fbf50047030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:27.206 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.156+0000 7fbf5d38a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbf500e6f20 0x7fbf500345d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:27.206 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.156+0000 7fbf57fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbf50047c50 0x7fbf50048e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:27.206 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.156+0000 7fbf57fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbf50047c50 0x7fbf50048e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40552/0 (socket says 172.21.15.62:40552) 2023-06-09T04:41:27.207 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.156+0000 7fbf57fff700 1 -- 172.21.15.62:0/1509389667 learned_addr learned my addr 172.21.15.62:0/1509389667 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:27.207 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.156+0000 7fbf5d38a700 1 -- 172.21.15.62:0/1509389667 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5004bae0 con 0x7fbf50047c50 2023-06-09T04:41:27.207 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.156+0000 7fbf5d38a700 1 -- 172.21.15.62:0/1509389667 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5004ae60 con 0x7fbf500e6f20 2023-06-09T04:41:27.207 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.156+0000 7fbf5d38a700 1 -- 172.21.15.62:0/1509389667 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5004b140 con 0x7fbf50053aa0 2023-06-09T04:41:27.207 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.156+0000 7f4907fff700 1 --2- 172.21.15.62:0/2574714007 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4908163c80 0x7f4908141e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:27.208 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.156+0000 7f49077fe700 1 -- 172.21.15.62:0/2574714007 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4908163c80 msgr2=0x7f4908141e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:27.208 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.156+0000 7f49077fe700 1 --2- 172.21.15.62:0/2574714007 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4908163c80 0x7f4908141e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:27.208 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.156+0000 7f49077fe700 1 -- 172.21.15.62:0/2574714007 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49081605d0 msgr2=0x7f4908141910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:27.208 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.156+0000 7f49077fe700 1 --2- 172.21.15.62:0/2574714007 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49081605d0 0x7f4908141910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:27.208 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.156+0000 7f49077fe700 1 -- 172.21.15.62:0/2574714007 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48f00094b0 con 0x7f49080c8680 2023-06-09T04:41:27.209 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.156+0000 7fbf577fe700 1 --2- 172.21.15.62:0/1509389667 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbf50053aa0 0x7fbf50047030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:27.209 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.156+0000 7fbf5cb89700 1 --2- 172.21.15.62:0/1509389667 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbf500e6f20 0x7fbf500345d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:27.209 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.156+0000 7f49077fe700 1 --2- 172.21.15.62:0/2574714007 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49080c8680 0x7f49080b3040 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f48f800c4b0 tx=0x7f48f800c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:27.209 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.156+0000 7f4907fff700 1 --2- 172.21.15.62:0/2574714007 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4908163c80 0x7f4908141e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:41:27.210 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.156+0000 7fbf57fff700 1 -- 172.21.15.62:0/1509389667 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbf50053aa0 msgr2=0x7fbf50047030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:27.210 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.156+0000 7fbf57fff700 1 --2- 172.21.15.62:0/1509389667 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbf50053aa0 0x7fbf50047030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:27.210 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.156+0000 7fab637fe700 1 -- 172.21.15.62:0/2473726439 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab70003d10 con 0x7fab74049560 2023-06-09T04:41:27.210 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.156+0000 7fab637fe700 1 -- 172.21.15.62:0/2473726439 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab70003e70 con 0x7fab74049560 2023-06-09T04:41:27.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.156+0000 7fbf57fff700 1 -- 172.21.15.62:0/1509389667 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbf500e6f20 msgr2=0x7fbf500345d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:27.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.156+0000 7fbf57fff700 1 --2- 172.21.15.62:0/1509389667 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbf500e6f20 0x7fbf500345d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:27.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.156+0000 7fbf57fff700 1 -- 172.21.15.62:0/1509389667 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf5804e0a0 con 0x7fbf50047c50 2023-06-09T04:41:27.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.156+0000 7fab637fe700 1 -- 172.21.15.62:0/2473726439 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab70011850 con 0x7fab74049560 2023-06-09T04:41:27.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.156+0000 7fab8147b700 1 -- 172.21.15.62:0/2473726439 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab7417ffc0 con 0x7fab74049560 2023-06-09T04:41:27.212 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.156+0000 7fbf57fff700 1 --2- 172.21.15.62:0/1509389667 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbf50047c50 0x7fbf50048e20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fbf4400c4e0 tx=0x7fbf4400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:27.212 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.156+0000 7fab8147b700 1 -- 172.21.15.62:0/2473726439 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab74180580 con 0x7fab74049560 2023-06-09T04:41:27.212 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.156+0000 7f824ffff700 1 -- 172.21.15.62:0/2811432818 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8260052440 con 0x7f82681f24d0 2023-06-09T04:41:27.213 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.160+0000 7f89a2b01700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f899c0ce9c0 0x7f899c0c5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:27.213 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.160+0000 7f89a2b01700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f899c149160 0x7f899c14def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:27.213 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.160+0000 7f89a089d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f899c0ce9c0 0x7f899c0c5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:27.214 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.160+0000 7f89a089d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f899c0ce9c0 0x7f899c0c5ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.62:35968/0 (socket says 172.21.15.62:35968) 2023-06-09T04:41:27.214 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.160+0000 7f89a089d700 1 -- 172.21.15.62:0/1174659124 learned_addr learned my addr 172.21.15.62:0/1174659124 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:27.214 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.160+0000 7f89a2b01700 1 --2- 172.21.15.62:0/1174659124 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f899c14e430 0x7f899c0c76d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:27.214 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.160+0000 7f899bfff700 1 --2- 172.21.15.62:0/1174659124 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f899c149160 0x7f899c14def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:27.214 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.160+0000 7f89a2b01700 1 -- 172.21.15.62:0/1174659124 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f899c14e8d0 con 0x7f899c14e430 2023-06-09T04:41:27.214 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.160+0000 7f89a2b01700 1 -- 172.21.15.62:0/1174659124 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f899c0c6400 con 0x7f899c149160 2023-06-09T04:41:27.214 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.160+0000 7f89a2b01700 1 -- 172.21.15.62:0/1174659124 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f899c0c6630 con 0x7f899c0ce9c0 2023-06-09T04:41:27.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.160+0000 7fab637fe700 1 -- 172.21.15.62:0/2473726439 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fab70022070 con 0x7fab74049560 2023-06-09T04:41:27.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.160+0000 7fab637fe700 1 --2- 172.21.15.62:0/2473726439 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fab680663c0 0x7fab68068870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:27.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.160+0000 7fab637fe700 1 -- 172.21.15.62:0/2473726439 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fab70085830 con 0x7fab74049560 2023-06-09T04:41:27.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.160+0000 7f89a089d700 1 -- 172.21.15.62:0/1174659124 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f899c149160 msgr2=0x7f899c14def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:27.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.160+0000 7f89a089d700 1 --2- 172.21.15.62:0/1174659124 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f899c149160 0x7f899c14def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:27.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.160+0000 7f89a089d700 1 -- 172.21.15.62:0/1174659124 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f899c14e430 msgr2=0x7f899c0c76d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-06-09T04:41:27.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.160+0000 7fab8147b700 1 -- 172.21.15.62:0/2473726439 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab74006e10 con 0x7fab74049560 2023-06-09T04:41:27.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.160+0000 7f89a089d700 1 --2- 172.21.15.62:0/1174659124 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f899c14e430 0x7f899c0c76d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:27.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.160+0000 7f89a089d700 1 -- 172.21.15.62:0/1174659124 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8994009b30 con 0x7f899c0ce9c0 2023-06-09T04:41:27.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.160+0000 7f009ffff700 1 -- 172.21.15.62:0/2050536901 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f00b8072220 con 0x7f00b00c8170 2023-06-09T04:41:27.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.160+0000 7f009ffff700 1 --2- 172.21.15.62:0/2050536901 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f00a40663c0 0x7f00a4068870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:27.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.160+0000 7f009ffff700 1 -- 172.21.15.62:0/2050536901 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f00b80fd600 con 0x7f00b00c8170 2023-06-09T04:41:27.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.160+0000 7f00b6ffd700 1 --2- 172.21.15.62:0/2050536901 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f00a40663c0 0x7f00a4068870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:27.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.160+0000 7f89a089d700 1 --2- 172.21.15.62:0/1174659124 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f899c0ce9c0 0x7f899c0c5ec0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f898c00c7c0 tx=0x7f898c00cad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:27.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.160+0000 7fab7affd700 1 --2- 172.21.15.62:0/2473726439 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fab680663c0 0x7fab68068870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:27.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.160+0000 7f00b6ffd700 1 --2- 172.21.15.62:0/2050536901 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f00a40663c0 0x7f00a4068870 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f00a8000c00 tx=0x7f00a8014000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:27.219 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.160+0000 7fab7affd700 1 --2- 172.21.15.62:0/2473726439 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fab680663c0 0x7fab68068870 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fab6c0011e0 tx=0x7fab6c007ea0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:27.219 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.164+0000 7fbf54ff9700 1 -- 172.21.15.62:0/1509389667 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf44011790 con 0x7fbf50047c50 2023-06-09T04:41:27.219 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.164+0000 7f4904ff9700 1 -- 172.21.15.62:0/2574714007 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f8004ca0 con 0x7f49080c8680 2023-06-09T04:41:27.220 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.164+0000 7fbf5d38a700 1 -- 172.21.15.62:0/1509389667 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf5004b420 con 0x7fbf50047c50 2023-06-09T04:41:27.220 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.164+0000 7fbf54ff9700 1 -- 172.21.15.62:0/1509389667 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf44011910 con 0x7fbf50047c50 2023-06-09T04:41:27.220 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.164+0000 7fbf5d38a700 1 -- 172.21.15.62:0/1509389667 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf5004aaf0 con 0x7fbf50047c50 2023-06-09T04:41:27.220 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.164+0000 7fbf54ff9700 1 -- 172.21.15.62:0/1509389667 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf44011cc0 con 0x7fbf50047c50 2023-06-09T04:41:27.221 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.164+0000 7f490c868700 1 -- 172.21.15.62:0/2574714007 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f490815aac0 con 0x7f49080c8680 2023-06-09T04:41:27.221 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.164+0000 7f009ffff700 1 -- 172.21.15.62:0/2050536901 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f00b80ca800 con 0x7f00b00c8170 2023-06-09T04:41:27.221 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.164+0000 7f4904ff9700 1 -- 172.21.15.62:0/2574714007 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48f8004e00 con 0x7f49080c8680 2023-06-09T04:41:27.221 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.164+0000 7f4904ff9700 1 -- 172.21.15.62:0/2574714007 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f80072d0 con 0x7f49080c8680 2023-06-09T04:41:27.222 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.164+0000 7f490c868700 1 -- 172.21.15.62:0/2574714007 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f490815b080 con 0x7f49080c8680 2023-06-09T04:41:27.222 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.164+0000 7f89997fa700 1 -- 172.21.15.62:0/1174659124 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f898c011800 con 0x7f899c0ce9c0 2023-06-09T04:41:27.222 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.164+0000 7f89a2b01700 1 -- 172.21.15.62:0/1174659124 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f899c0c6910 con 0x7f899c0ce9c0 2023-06-09T04:41:27.222 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.164+0000 7f89997fa700 1 -- 172.21.15.62:0/1174659124 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f898c011960 con 0x7f899c0ce9c0 2023-06-09T04:41:27.222 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.164+0000 7f89a2b01700 1 -- 172.21.15.62:0/1174659124 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f899c0c6ed0 con 0x7f899c0ce9c0 2023-06-09T04:41:27.223 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.164+0000 7fab637fe700 1 -- 172.21.15.62:0/2473726439 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fab70052a30 con 0x7fab74049560 2023-06-09T04:41:27.223 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.164+0000 7f490c868700 1 -- 172.21.15.62:0/2574714007 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49080739c0 con 0x7f49080c8680 2023-06-09T04:41:27.223 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.164+0000 7f89997fa700 1 -- 172.21.15.62:0/1174659124 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f898c011cf0 con 0x7f899c0ce9c0 2023-06-09T04:41:27.224 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.168+0000 7fbf54ff9700 1 -- 172.21.15.62:0/1509389667 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbf4401c460 con 0x7fbf50047c50 2023-06-09T04:41:27.224 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.168+0000 7f4904ff9700 1 -- 172.21.15.62:0/2574714007 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f48f8007430 con 0x7f49080c8680 2023-06-09T04:41:27.224 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.168+0000 7fbf5d38a700 1 -- 172.21.15.62:0/1509389667 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf5017d050 con 0x7fbf50047c50 2023-06-09T04:41:27.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.168+0000 7f89a2b01700 1 -- 172.21.15.62:0/1174659124 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f897c005310 con 0x7f899c0ce9c0 2023-06-09T04:41:27.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.168+0000 7f4904ff9700 1 --2- 172.21.15.62:0/2574714007 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f48e80662f0 0x7f48e80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:27.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.168+0000 7f4904ff9700 1 -- 172.21.15.62:0/2574714007 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f48f8083b20 con 0x7f49080c8680 2023-06-09T04:41:27.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.168+0000 7f89997fa700 1 -- 172.21.15.62:0/1174659124 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f898c0193f0 con 0x7f899c0ce9c0 2023-06-09T04:41:27.226 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.168+0000 7fbf54ff9700 1 --2- 172.21.15.62:0/1509389667 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fbf3c066320 0x7fbf3c0687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:27.226 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.168+0000 7fbf54ff9700 1 -- 172.21.15.62:0/1509389667 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fbf44083c70 con 0x7fbf50047c50 2023-06-09T04:41:27.226 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.168+0000 7fbf577fe700 1 --2- 172.21.15.62:0/1509389667 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fbf3c066320 0x7fbf3c0687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:27.226 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.168+0000 7f89997fa700 1 --2- 172.21.15.62:0/1174659124 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f89880662f0 0x7f89880687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:27.227 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.168+0000 7f48fffff700 1 --2- 172.21.15.62:0/2574714007 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f48e80662f0 0x7f48e80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:27.227 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.168+0000 7f89997fa700 1 -- 172.21.15.62:0/1174659124 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f898c084310 con 0x7f899c0ce9c0 2023-06-09T04:41:27.227 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.172+0000 7f899bfff700 1 --2- 172.21.15.62:0/1174659124 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f89880662f0 0x7f89880687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:27.228 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.172+0000 7f48fffff700 1 --2- 172.21.15.62:0/2574714007 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f48e80662f0 0x7f48e80687a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f48f0009880 tx=0x7f48f001c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:27.228 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.172+0000 7fbf577fe700 1 --2- 172.21.15.62:0/1509389667 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fbf3c066320 0x7fbf3c0687d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbf5003acd0 tx=0x7fbf4c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:27.228 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.172+0000 7f899bfff700 1 --2- 172.21.15.62:0/1174659124 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f89880662f0 0x7f89880687a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f899c0b1fc0 tx=0x7f8990008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:27.229 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.172+0000 7f89997fa700 1 -- 172.21.15.62:0/1174659124 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f898c054f20 con 0x7f899c0ce9c0 2023-06-09T04:41:27.229 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.188+0000 7fbf54ff9700 1 -- 172.21.15.62:0/1509389667 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbf44050df0 con 0x7fbf50047c50 2023-06-09T04:41:27.229 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.196+0000 7f4904ff9700 1 -- 172.21.15.62:0/2574714007 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f48f8050c10 con 0x7f49080c8680 2023-06-09T04:41:27.488 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.484+0000 7f00bd80a700 1 -- 172.21.15.62:0/2050536901 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f00b00008d0 con 0x7f00b00c8170 2023-06-09T04:41:27.489 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.484+0000 7f009ffff700 1 -- 172.21.15.62:0/2050536901 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f00b80cde20 con 0x7f00b00c8170 2023-06-09T04:41:27.489 INFO:teuthology.orchestra.run.smithi062.stdout:55834574857 2023-06-09T04:41:27.492 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.488+0000 7fd9fc298700 1 -- 172.21.15.62:0/271752134 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd9f40c6b60 con 0x7fd9f40c8680 2023-06-09T04:41:27.492 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.488+0000 7f009dffb700 1 -- 172.21.15.62:0/2050536901 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f00a40663c0 msgr2=0x7f00a4068870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:27.493 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.488+0000 7f009dffb700 1 --2- 172.21.15.62:0/2050536901 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f00a40663c0 0x7f00a4068870 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f00a8000c00 tx=0x7f00a8014000 comp rx=0 tx=0).stop 2023-06-09T04:41:27.493 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.488+0000 7f009dffb700 1 -- 172.21.15.62:0/2050536901 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00b00c8170 msgr2=0x7f00b017bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:27.493 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.488+0000 7f009dffb700 1 --2- 172.21.15.62:0/2050536901 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00b00c8170 0x7f00b017bf50 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f00b8069390 tx=0x7f00b8073380 comp rx=0 tx=0).stop 2023-06-09T04:41:27.494 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.488+0000 7fd9eaffd700 1 -- 172.21.15.62:0/271752134 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd9ec021020 con 0x7fd9f40c8680 2023-06-09T04:41:27.494 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.488+0000 7f009dffb700 1 -- 172.21.15.62:0/2050536901 shutdown_connections 2023-06-09T04:41:27.495 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.488+0000 7f009dffb700 1 --2- 172.21.15.62:0/2050536901 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f00a40663c0 0x7f00a4068870 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:27.495 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.488+0000 7f009dffb700 1 --2- 172.21.15.62:0/2050536901 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f00b00c8170 0x7f00b017bf50 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:27.495 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.488+0000 7f009dffb700 1 --2- 172.21.15.62:0/2050536901 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00b00c7c20 0x7f00b00c5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:27.495 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.488+0000 7f009dffb700 1 --2- 172.21.15.62:0/2050536901 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f00b004faf0 0x7f00b00c6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:27.495 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.488+0000 7f009dffb700 1 -- 172.21.15.62:0/2050536901 >> 172.21.15.62:0/2050536901 conn(0x7f00b0051710 msgr2=0x7f00b0038f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:27.495 INFO:teuthology.orchestra.run.smithi062.stdout:55834574859 2023-06-09T04:41:27.496 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.488+0000 7f009dffb700 1 -- 172.21.15.62:0/2050536901 shutdown_connections 2023-06-09T04:41:27.496 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.488+0000 7f009dffb700 1 -- 172.21.15.62:0/2050536901 wait complete. 2023-06-09T04:41:27.497 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.488+0000 7f33d0df2700 1 -- 172.21.15.62:0/1054965566 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f33cc0739c0 con 0x7f33cc0ca3b0 2023-06-09T04:41:27.497 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.492+0000 7f33c37fe700 1 -- 172.21.15.62:0/1054965566 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f33b40563b0 con 0x7f33cc0ca3b0 2023-06-09T04:41:27.497 INFO:teuthology.orchestra.run.smithi062.stdout:55834574859 2023-06-09T04:41:27.498 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.492+0000 7fd9fc298700 1 -- 172.21.15.62:0/271752134 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fd9d80662f0 msgr2=0x7fd9d80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:27.499 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.492+0000 7fd9fc298700 1 --2- 172.21.15.62:0/271752134 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fd9d80662f0 0x7fd9d80687a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd9f40c7d50 tx=0x7fd9e4008030 comp rx=0 tx=0).stop 2023-06-09T04:41:27.499 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.492+0000 7fd9fc298700 1 -- 172.21.15.62:0/271752134 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9f40c8680 msgr2=0x7fd9f40c4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:27.499 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.492+0000 7fd9fc298700 1 --2- 172.21.15.62:0/271752134 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9f40c8680 0x7fd9f40c4620 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec00caa0 tx=0x7fd9ec00cad0 comp rx=0 tx=0).stop 2023-06-09T04:41:27.499 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.492+0000 7fd9fc298700 1 -- 172.21.15.62:0/271752134 shutdown_connections 2023-06-09T04:41:27.499 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.492+0000 7fd9fc298700 1 --2- 172.21.15.62:0/271752134 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fd9d80662f0 0x7fd9d80687a0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:27.499 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.492+0000 7fd9fc298700 1 --2- 172.21.15.62:0/271752134 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd9f4163c80 0x7fd9f41f50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:27.499 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.492+0000 7fd9fc298700 1 --2- 172.21.15.62:0/271752134 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd9f41605d0 0x7fd9f40c7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:27.500 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.492+0000 7fd9fc298700 1 --2- 172.21.15.62:0/271752134 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9f40c8680 0x7fd9f40c4620 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:27.500 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.492+0000 7fd9fc298700 1 -- 172.21.15.62:0/271752134 >> 172.21.15.62:0/271752134 conn(0x7fd9f40b0860 msgr2=0x7fd9f4164050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:27.500 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.492+0000 7fd9fc298700 1 -- 172.21.15.62:0/271752134 shutdown_connections 2023-06-09T04:41:27.500 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.492+0000 7fd9fc298700 1 -- 172.21.15.62:0/271752134 wait complete. 2023-06-09T04:41:27.500 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.496+0000 7f824dffb700 1 -- 172.21.15.62:0/2811432818 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f82680c61d0 con 0x7f82681f24d0 2023-06-09T04:41:27.501 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.496+0000 7f33d0df2700 1 -- 172.21.15.62:0/1054965566 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f33ac066340 msgr2=0x7f33ac0687f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:27.501 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.496+0000 7f33d0df2700 1 --2- 172.21.15.62:0/1054965566 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f33ac066340 0x7f33ac0687f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f33bc009790 tx=0x7f33bc006cf0 comp rx=0 tx=0).stop 2023-06-09T04:41:27.502 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.496+0000 7f33d0df2700 1 -- 172.21.15.62:0/1054965566 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33cc0ca3b0 msgr2=0x7f33cc0c2570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:27.502 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.496+0000 7f33d0df2700 1 --2- 172.21.15.62:0/1054965566 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33cc0ca3b0 0x7f33cc0c2570 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f33cc066bc0 tx=0x7f33b4004770 comp rx=0 tx=0).stop 2023-06-09T04:41:27.502 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.496+0000 7f33d0df2700 1 -- 172.21.15.62:0/1054965566 shutdown_connections 2023-06-09T04:41:27.502 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.496+0000 7f33d0df2700 1 --2- 172.21.15.62:0/1054965566 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f33ac066340 0x7f33ac0687f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:27.502 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.496+0000 7f33d0df2700 1 --2- 172.21.15.62:0/1054965566 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f33cc140b10 0x7f33cc0a74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:27.503 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.496+0000 7f824ffff700 1 -- 172.21.15.62:0/2811432818 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f82680c61d0 con 0x7f82681f24d0 2023-06-09T04:41:27.503 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.496+0000 7f33d0df2700 1 --2- 172.21.15.62:0/1054965566 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33cc0ca3b0 0x7f33cc0c2570 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:27.503 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.496+0000 7f33d0df2700 1 --2- 172.21.15.62:0/1054965566 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f33cc06f5a0 0x7f33cc0c8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:27.504 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.496+0000 7f33d0df2700 1 -- 172.21.15.62:0/1054965566 >> 172.21.15.62:0/1054965566 conn(0x7f33cc0b0860 msgr2=0x7f33cc140280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:27.504 INFO:teuthology.orchestra.run.smithi062.stdout:55834574858 2023-06-09T04:41:27.504 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.500+0000 7f33d0df2700 1 -- 172.21.15.62:0/1054965566 shutdown_connections 2023-06-09T04:41:27.504 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.500+0000 7f33d0df2700 1 -- 172.21.15.62:0/1054965566 wait complete. 2023-06-09T04:41:27.507 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.500+0000 7f824dffb700 1 -- 172.21.15.62:0/2811432818 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f82540662f0 msgr2=0x7f82540687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:27.507 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.500+0000 7f824dffb700 1 --2- 172.21.15.62:0/2811432818 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f82540662f0 0x7f82540687a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8258009cb0 tx=0x7f8258009240 comp rx=0 tx=0).stop 2023-06-09T04:41:27.507 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.500+0000 7f824dffb700 1 -- 172.21.15.62:0/2811432818 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82681f24d0 msgr2=0x7f82680c7390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:27.507 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.500+0000 7f824dffb700 1 --2- 172.21.15.62:0/2811432818 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82681f24d0 0x7f82680c7390 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8260014000 tx=0x7f8260004af0 comp rx=0 tx=0).stop 2023-06-09T04:41:27.507 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.500+0000 7f824dffb700 1 -- 172.21.15.62:0/2811432818 shutdown_connections 2023-06-09T04:41:27.507 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.500+0000 7f824dffb700 1 --2- 172.21.15.62:0/2811432818 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f82540662f0 0x7f82540687a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:27.508 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.500+0000 7f824dffb700 1 --2- 172.21.15.62:0/2811432818 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82681f24d0 0x7f82680c7390 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:27.508 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.500+0000 7f824dffb700 1 --2- 172.21.15.62:0/2811432818 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82681f2060 0x7f82680c6e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:27.508 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.504+0000 7f824dffb700 1 --2- 172.21.15.62:0/2811432818 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82680ce9c0 0x7f826815a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:27.508 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.504+0000 7f824dffb700 1 -- 172.21.15.62:0/2811432818 >> 172.21.15.62:0/2811432818 conn(0x7f8268070f20 msgr2=0x7f82680cc690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:27.509 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.504+0000 7f824dffb700 1 -- 172.21.15.62:0/2811432818 shutdown_connections 2023-06-09T04:41:27.509 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.504+0000 7f824dffb700 1 -- 172.21.15.62:0/2811432818 wait complete. 2023-06-09T04:41:27.509 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.504+0000 7fab8147b700 1 -- 172.21.15.62:0/2473726439 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fab74180a30 con 0x7fab74049560 2023-06-09T04:41:27.509 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.504+0000 7fab637fe700 1 -- 172.21.15.62:0/2473726439 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fab70056050 con 0x7fab74049560 2023-06-09T04:41:27.510 INFO:teuthology.orchestra.run.smithi062.stdout:55834574858 2023-06-09T04:41:27.515 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.512+0000 7fab8147b700 1 -- 172.21.15.62:0/2473726439 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fab680663c0 msgr2=0x7fab68068870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:27.516 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.512+0000 7fab8147b700 1 --2- 172.21.15.62:0/2473726439 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fab680663c0 0x7fab68068870 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fab6c0011e0 tx=0x7fab6c007ea0 comp rx=0 tx=0).stop 2023-06-09T04:41:27.516 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.512+0000 7fab8147b700 1 -- 172.21.15.62:0/2473726439 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fab74049560 msgr2=0x7fab74050110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:27.516 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.512+0000 7fab8147b700 1 --2- 172.21.15.62:0/2473726439 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fab74049560 0x7fab74050110 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fab70015000 tx=0x7fab70004770 comp rx=0 tx=0).stop 2023-06-09T04:41:27.516 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.512+0000 7fab8147b700 1 -- 172.21.15.62:0/2473726439 shutdown_connections 2023-06-09T04:41:27.516 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.512+0000 7fab8147b700 1 --2- 172.21.15.62:0/2473726439 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fab680663c0 0x7fab68068870 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:27.516 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.512+0000 7fab8147b700 1 --2- 172.21.15.62:0/2473726439 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab74052b30 0x7fab740d7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:27.517 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.512+0000 7fab8147b700 1 --2- 172.21.15.62:0/2473726439 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fab74049560 0x7fab74050110 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:27.517 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.512+0000 7fab8147b700 1 --2- 172.21.15.62:0/2473726439 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fab740358f0 0x7fab740d51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:27.517 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.512+0000 7fab8147b700 1 -- 172.21.15.62:0/2473726439 >> 172.21.15.62:0/2473726439 conn(0x7fab740530c0 msgr2=0x7fab740086f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:27.517 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.512+0000 7fab8147b700 1 -- 172.21.15.62:0/2473726439 shutdown_connections 2023-06-09T04:41:27.517 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.512+0000 7fab8147b700 1 -- 172.21.15.62:0/2473726439 wait complete. 2023-06-09T04:41:27.518 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.512+0000 7f89a2b01700 1 -- 172.21.15.62:0/1174659124 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f897c005890 con 0x7f899c0ce9c0 2023-06-09T04:41:27.519 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.516+0000 7f89997fa700 1 -- 172.21.15.62:0/1174659124 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f898c054ab0 con 0x7f899c0ce9c0 2023-06-09T04:41:27.519 INFO:teuthology.orchestra.run.smithi062.stdout:55834574858 2023-06-09T04:41:27.522 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.2 2023-06-09T04:41:27.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.516+0000 7f8982ffd700 1 -- 172.21.15.62:0/1174659124 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f89880662f0 msgr2=0x7f89880687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:27.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.516+0000 7f8982ffd700 1 --2- 172.21.15.62:0/1174659124 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f89880662f0 0x7f89880687a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f899c0b1fc0 tx=0x7f8990008040 comp rx=0 tx=0).stop 2023-06-09T04:41:27.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.516+0000 7f8982ffd700 1 -- 172.21.15.62:0/1174659124 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f899c0ce9c0 msgr2=0x7f899c0c5ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:27.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.516+0000 7f8982ffd700 1 --2- 172.21.15.62:0/1174659124 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f899c0ce9c0 0x7f899c0c5ec0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f898c00c7c0 tx=0x7f898c00cad0 comp rx=0 tx=0).stop 2023-06-09T04:41:27.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.516+0000 7f8982ffd700 1 -- 172.21.15.62:0/1174659124 shutdown_connections 2023-06-09T04:41:27.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.520+0000 7f8982ffd700 1 --2- 172.21.15.62:0/1174659124 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f89880662f0 0x7f89880687a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:27.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.520+0000 7f8982ffd700 1 --2- 172.21.15.62:0/1174659124 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f899c14e430 0x7f899c0c76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:27.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.520+0000 7f8982ffd700 1 --2- 172.21.15.62:0/1174659124 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f899c149160 0x7f899c14def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:27.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.520+0000 7f8982ffd700 1 --2- 172.21.15.62:0/1174659124 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f899c0ce9c0 0x7f899c0c5ec0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:27.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.520+0000 7f8982ffd700 1 -- 172.21.15.62:0/1174659124 >> 172.21.15.62:0/1174659124 conn(0x7f899c070f20 msgr2=0x7f899c0b13a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:27.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.520+0000 7f8982ffd700 1 -- 172.21.15.62:0/1174659124 shutdown_connections 2023-06-09T04:41:27.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.520+0000 7f8982ffd700 1 -- 172.21.15.62:0/1174659124 wait complete. 2023-06-09T04:41:27.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.520+0000 7fbf5d38a700 1 -- 172.21.15.62:0/1509389667 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbf50005460 con 0x7fbf50047c50 2023-06-09T04:41:27.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.520+0000 7fbf54ff9700 1 -- 172.21.15.62:0/1509389667 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbf44054410 con 0x7fbf50047c50 2023-06-09T04:41:27.526 INFO:teuthology.orchestra.run.smithi062.stdout:55834574857 2023-06-09T04:41:27.527 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574859 for osd.0 2023-06-09T04:41:27.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.524+0000 7fbf5d38a700 1 -- 172.21.15.62:0/1509389667 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fbf3c066320 msgr2=0x7fbf3c0687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:27.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.524+0000 7fbf5d38a700 1 --2- 172.21.15.62:0/1509389667 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fbf3c066320 0x7fbf3c0687d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbf5003acd0 tx=0x7fbf4c008040 comp rx=0 tx=0).stop 2023-06-09T04:41:27.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.524+0000 7fbf5d38a700 1 -- 172.21.15.62:0/1509389667 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbf50047c50 msgr2=0x7fbf50048e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:27.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.524+0000 7fbf5d38a700 1 --2- 172.21.15.62:0/1509389667 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbf50047c50 0x7fbf50048e20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fbf4400c4e0 tx=0x7fbf4400c7f0 comp rx=0 tx=0).stop 2023-06-09T04:41:27.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.524+0000 7fbf5d38a700 1 -- 172.21.15.62:0/1509389667 shutdown_connections 2023-06-09T04:41:27.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.524+0000 7fbf5d38a700 1 --2- 172.21.15.62:0/1509389667 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fbf3c066320 0x7fbf3c0687d0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:27.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.524+0000 7fbf5d38a700 1 --2- 172.21.15.62:0/1509389667 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbf500e6f20 0x7fbf500345d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:27.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.524+0000 7fbf5d38a700 1 --2- 172.21.15.62:0/1509389667 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbf50053aa0 0x7fbf50047030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:27.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.524+0000 7fbf5d38a700 1 --2- 172.21.15.62:0/1509389667 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbf50047c50 0x7fbf50048e20 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:27.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.524+0000 7fbf5d38a700 1 -- 172.21.15.62:0/1509389667 >> 172.21.15.62:0/1509389667 conn(0x7fbf50051710 msgr2=0x7fbf5004f250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:27.531 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574859 for osd.4 2023-06-09T04:41:27.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.524+0000 7fbf5d38a700 1 -- 172.21.15.62:0/1509389667 shutdown_connections 2023-06-09T04:41:27.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.524+0000 7fbf5d38a700 1 -- 172.21.15.62:0/1509389667 wait complete. 2023-06-09T04:41:27.538 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.7 2023-06-09T04:41:27.540 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.3 2023-06-09T04:41:27.541 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.536+0000 7f490c868700 1 -- 172.21.15.62:0/2574714007 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f4908160cd0 con 0x7f49080c8680 2023-06-09T04:41:27.541 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.536+0000 7f4904ff9700 1 -- 172.21.15.62:0/2574714007 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f48f8054230 con 0x7f49080c8680 2023-06-09T04:41:27.541 INFO:teuthology.orchestra.run.smithi062.stdout:55834574857 2023-06-09T04:41:27.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.536+0000 7f490c868700 1 -- 172.21.15.62:0/2574714007 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f48e80662f0 msgr2=0x7f48e80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:27.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.540+0000 7f490c868700 1 --2- 172.21.15.62:0/2574714007 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f48e80662f0 0x7f48e80687a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f48f0009880 tx=0x7f48f001c040 comp rx=0 tx=0).stop 2023-06-09T04:41:27.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.540+0000 7f490c868700 1 -- 172.21.15.62:0/2574714007 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49080c8680 msgr2=0x7f49080b3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:27.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.540+0000 7f490c868700 1 --2- 172.21.15.62:0/2574714007 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49080c8680 0x7f49080b3040 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f48f800c4b0 tx=0x7f48f800c7c0 comp rx=0 tx=0).stop 2023-06-09T04:41:27.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.540+0000 7f490c868700 1 -- 172.21.15.62:0/2574714007 shutdown_connections 2023-06-09T04:41:27.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.540+0000 7f490c868700 1 --2- 172.21.15.62:0/2574714007 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f48e80662f0 0x7f48e80687a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:27.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.540+0000 7f490c868700 1 --2- 172.21.15.62:0/2574714007 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4908163c80 0x7f4908141e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:27.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.540+0000 7f490c868700 1 --2- 172.21.15.62:0/2574714007 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49081605d0 0x7f4908141910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:27.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.540+0000 7f490c868700 1 --2- 172.21.15.62:0/2574714007 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49080c8680 0x7f49080b3040 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:27.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.540+0000 7f490c868700 1 -- 172.21.15.62:0/2574714007 >> 172.21.15.62:0/2574714007 conn(0x7f49080b0860 msgr2=0x7f4908164170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:27.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.540+0000 7f490c868700 1 -- 172.21.15.62:0/2574714007 shutdown_connections 2023-06-09T04:41:27.545 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:27.540+0000 7f490c868700 1 -- 172.21.15.62:0/2574714007 wait complete. 2023-06-09T04:41:27.545 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.5 2023-06-09T04:41:27.548 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.1 2023-06-09T04:41:27.561 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.6 2023-06-09T04:41:28.523 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-06-09T04:41:28.528 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-06-09T04:41:28.532 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-06-09T04:41:28.540 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-06-09T04:41:28.541 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-06-09T04:41:28.546 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-06-09T04:41:28.549 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-06-09T04:41:28.562 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-06-09T04:41:28.746 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.740+0000 7fe388400700 1 Processor -- start 2023-06-09T04:41:28.749 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.744+0000 7fe388400700 1 -- start start 2023-06-09T04:41:28.750 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.744+0000 7fe388400700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe38006f5a0 0x7fe38006fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:28.750 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.744+0000 7fe388400700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fe380140b10 0x7fe380140f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:28.750 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.744+0000 7fe388400700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe380158120 con 0x7fe3800ca3b0 2023-06-09T04:41:28.750 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.744+0000 7fe388400700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe38006ff80 con 0x7fe380140b10 2023-06-09T04:41:28.750 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.744+0000 7fe388400700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3800cc6c0 con 0x7fe38006f5a0 2023-06-09T04:41:28.751 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.744+0000 7fe38619c700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fe3800ca3b0 0x7fe3800cbc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:45000/0 (socket says 172.21.15.62:45000) 2023-06-09T04:41:28.751 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.744+0000 7fe38619c700 1 -- 172.21.15.62:0/1852861068 learned_addr learned my addr 172.21.15.62:0/1852861068 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:41:28.751 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.744+0000 7fe38699d700 1 --2- 172.21.15.62:0/1852861068 >> v2:172.21.15.89:3300/0 conn(0x7fe380140b10 0x7fe380140f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:28.752 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.744+0000 7fe38519a700 1 -- 172.21.15.62:0/1852861068 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1413682402 0 0) 0x7fe380158120 con 0x7fe3800ca3b0 2023-06-09T04:41:28.752 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.748+0000 7fe38519a700 1 -- 172.21.15.62:0/1852861068 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe36c0035d0 con 0x7fe3800ca3b0 2023-06-09T04:41:28.752 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.748+0000 7fe38599b700 1 --2- 172.21.15.62:0/1852861068 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe38006f5a0 0x7fe38006fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:28.752 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.748+0000 7fe38699d700 1 -- 172.21.15.62:0/1852861068 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe38006f5a0 msgr2=0x7fe38006fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:28.752 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.748+0000 7fe38699d700 1 --2- 172.21.15.62:0/1852861068 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe38006f5a0 0x7fe38006fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:28.752 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.748+0000 7fe38699d700 1 -- 172.21.15.62:0/1852861068 >> v1:172.21.15.62:6789/0 conn(0x7fe3800ca3b0 legacy=0x7fe3800cbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:28.753 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.748+0000 7fe38699d700 1 -- 172.21.15.62:0/1852861068 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3800cc9a0 con 0x7fe380140b10 2023-06-09T04:41:28.753 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.748+0000 7fe38599b700 1 --2- 172.21.15.62:0/1852861068 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe38006f5a0 0x7fe38006fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:41:28.753 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.748+0000 7fe38699d700 1 --2- 172.21.15.62:0/1852861068 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe380140b10 0x7fe380140f90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe3780095f0 tx=0x7fe378009900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ac0d66aa9777b7f server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:28.753 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.748+0000 7fe38519a700 1 -- 172.21.15.62:0/1852861068 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe37800ca20 con 0x7fe380140b10 2023-06-09T04:41:28.754 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.748+0000 7fe38519a700 1 -- 172.21.15.62:0/1852861068 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe37800cb80 con 0x7fe380140b10 2023-06-09T04:41:28.754 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.748+0000 7fe388400700 1 -- 172.21.15.62:0/1852861068 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe380140b10 msgr2=0x7fe380140f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:28.754 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.748+0000 7fe388400700 1 --2- 172.21.15.62:0/1852861068 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe380140b10 0x7fe380140f90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe3780095f0 tx=0x7fe378009900 comp rx=0 tx=0).stop 2023-06-09T04:41:28.754 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.748+0000 7fe388400700 1 -- 172.21.15.62:0/1852861068 shutdown_connections 2023-06-09T04:41:28.754 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.748+0000 7fe388400700 1 --2- 172.21.15.62:0/1852861068 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe380140b10 0x7fe380140f90 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:28.755 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.748+0000 7fe388400700 1 --2- 172.21.15.62:0/1852861068 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe38006f5a0 0x7fe38006fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:28.755 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.748+0000 7fe388400700 1 -- 172.21.15.62:0/1852861068 >> 172.21.15.62:0/1852861068 conn(0x7fe3800b0860 msgr2=0x7fe3800ce030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:28.756 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.752+0000 7fe388400700 1 -- 172.21.15.62:0/1852861068 shutdown_connections 2023-06-09T04:41:28.756 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.752+0000 7fe388400700 1 -- 172.21.15.62:0/1852861068 wait complete. 2023-06-09T04:41:28.759 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.752+0000 7fe388400700 1 Processor -- start 2023-06-09T04:41:28.759 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.756+0000 7fe388400700 1 -- start start 2023-06-09T04:41:28.760 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.756+0000 7fe388400700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe38006f5a0 0x7fe3801ded70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:28.761 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.756+0000 7fe388400700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3800ca3b0 0x7fe380146850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:28.761 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.756+0000 7fe388400700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe380140b10 0x7fe3801e1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:28.761 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.756+0000 7fe388400700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3801548b0 con 0x7fe3800ca3b0 2023-06-09T04:41:28.761 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.756+0000 7fe388400700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3801545a0 con 0x7fe38006f5a0 2023-06-09T04:41:28.761 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.756+0000 7fe388400700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3801e16b0 con 0x7fe380140b10 2023-06-09T04:41:28.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.756+0000 7fe38599b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3800ca3b0 0x7fe380146850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:28.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.756+0000 7fe38599b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3800ca3b0 0x7fe380146850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40564/0 (socket says 172.21.15.62:40564) 2023-06-09T04:41:28.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.756+0000 7fe38599b700 1 -- 172.21.15.62:0/1530554869 learned_addr learned my addr 172.21.15.62:0/1530554869 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:28.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.756+0000 7fe38619c700 1 --2- 172.21.15.62:0/1530554869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe38006f5a0 0x7fe3801ded70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:28.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.756+0000 7fe38699d700 1 --2- 172.21.15.62:0/1530554869 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe380140b10 0x7fe3801e1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:28.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.756+0000 7fe38599b700 1 -- 172.21.15.62:0/1530554869 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe380140b10 msgr2=0x7fe3801e1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:28.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.756+0000 7fe38599b700 1 --2- 172.21.15.62:0/1530554869 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe380140b10 0x7fe3801e1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:28.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.756+0000 7fe38599b700 1 -- 172.21.15.62:0/1530554869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe38006f5a0 msgr2=0x7fe3801ded70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:28.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.756+0000 7fe38599b700 1 --2- 172.21.15.62:0/1530554869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe38006f5a0 0x7fe3801ded70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:28.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.756+0000 7fe38599b700 1 -- 172.21.15.62:0/1530554869 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe37800c300 con 0x7fe3800ca3b0 2023-06-09T04:41:28.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.756+0000 7fe38599b700 1 --2- 172.21.15.62:0/1530554869 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3800ca3b0 0x7fe380146850 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe37000c7c0 tx=0x7fe37000cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:28.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.760+0000 7fe376ffd700 1 -- 172.21.15.62:0/1530554869 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe370011800 con 0x7fe3800ca3b0 2023-06-09T04:41:28.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.760+0000 7fe376ffd700 1 -- 172.21.15.62:0/1530554869 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe370011960 con 0x7fe3800ca3b0 2023-06-09T04:41:28.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.760+0000 7fe376ffd700 1 -- 172.21.15.62:0/1530554869 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe370011cd0 con 0x7fe3800ca3b0 2023-06-09T04:41:28.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.760+0000 7fe388400700 1 -- 172.21.15.62:0/1530554869 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3801e1920 con 0x7fe3800ca3b0 2023-06-09T04:41:28.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.760+0000 7fe388400700 1 -- 172.21.15.62:0/1530554869 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3801e1ee0 con 0x7fe3800ca3b0 2023-06-09T04:41:28.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.764+0000 7fe376ffd700 1 -- 172.21.15.62:0/1530554869 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe370021350 con 0x7fe3800ca3b0 2023-06-09T04:41:28.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.764+0000 7fe376ffd700 1 --2- 172.21.15.62:0/1530554869 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fe36c068a30 0x7fe36c06aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:28.770 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.764+0000 7fe376ffd700 1 -- 172.21.15.62:0/1530554869 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe370083d80 con 0x7fe3800ca3b0 2023-06-09T04:41:28.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.768+0000 7fe38619c700 1 --2- 172.21.15.62:0/1530554869 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fe36c068a30 0x7fe36c06aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:28.772 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.768+0000 7fe38619c700 1 --2- 172.21.15.62:0/1530554869 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fe36c068a30 0x7fe36c06aee0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe37c007fd0 tx=0x7fe37c007de0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:28.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.768+0000 7fe388400700 1 -- 172.21.15.62:0/1530554869 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe368005310 con 0x7fe3800ca3b0 2023-06-09T04:41:28.788 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.776+0000 7fe376ffd700 1 -- 172.21.15.62:0/1530554869 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe370058e60 con 0x7fe3800ca3b0 2023-06-09T04:41:28.806 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.800+0000 7f2f919e3700 1 Processor -- start 2023-06-09T04:41:28.809 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.800+0000 7f2f919e3700 1 -- start start 2023-06-09T04:41:28.809 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.804+0000 7f2f919e3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f8c0ca3b0 0x7f2f8c0cbc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:28.809 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.804+0000 7f2f919e3700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2f8c06fcb0 0x7f2f8c140b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:28.809 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.804+0000 7f2f919e3700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f8c158120 con 0x7f2f8c0cc140 2023-06-09T04:41:28.809 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.804+0000 7f2f919e3700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f8c0cc6c0 con 0x7f2f8c06fcb0 2023-06-09T04:41:28.809 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.804+0000 7f2f919e3700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8c0cc9a0 con 0x7f2f8c0ca3b0 2023-06-09T04:41:28.810 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.804+0000 7f2f8bfff700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f2f8c0cc140 0x7f2f8c06f5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.62:44612/0 (socket says 172.21.15.62:44612) 2023-06-09T04:41:28.810 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.804+0000 7f2f8bfff700 1 -- 172.21.15.62:0/1523685662 learned_addr learned my addr 172.21.15.62:0/1523685662 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:41:28.810 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.804+0000 7f2f911e2700 1 --2- 172.21.15.62:0/1523685662 >> v2:172.21.15.62:3300/0 conn(0x7f2f8c06fcb0 0x7f2f8c140b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:28.810 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.804+0000 7f2f909e1700 1 --2- 172.21.15.62:0/1523685662 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f8c0ca3b0 0x7f2f8c0cbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:28.811 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.804+0000 7f2f8b7fe700 1 -- 172.21.15.62:0/1523685662 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1984844020 0 0) 0x7f2f8c158120 con 0x7f2f8c0cc140 2023-06-09T04:41:28.811 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.804+0000 7f2f8b7fe700 1 -- 172.21.15.62:0/1523685662 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f740035d0 con 0x7f2f8c0cc140 2023-06-09T04:41:28.811 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.804+0000 7f7678df6700 1 Processor -- start 2023-06-09T04:41:28.811 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.804+0000 7f7678df6700 1 -- start start 2023-06-09T04:41:28.812 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.804+0000 7f2f8b7fe700 1 -- 172.21.15.62:0/1523685662 <== mon.1 v1:172.21.15.89:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3944148821 0 0) 0x7f2f740035d0 con 0x7f2f8c0cc140 2023-06-09T04:41:28.812 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.808+0000 7f2f8b7fe700 1 -- 172.21.15.62:0/1523685662 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f8c0ca3b0 msgr2=0x7f2f8c0cbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:28.812 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.808+0000 7f2f8b7fe700 1 --2- 172.21.15.62:0/1523685662 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f8c0ca3b0 0x7f2f8c0cbc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:28.812 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.808+0000 7f2f8b7fe700 1 -- 172.21.15.62:0/1523685662 >> v2:172.21.15.62:3300/0 conn(0x7f2f8c06fcb0 msgr2=0x7f2f8c140b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:28.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.808+0000 7f2f8b7fe700 1 --2- 172.21.15.62:0/1523685662 >> v2:172.21.15.62:3300/0 conn(0x7f2f8c06fcb0 0x7f2f8c140b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:28.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.808+0000 7f2f8b7fe700 1 -- 172.21.15.62:0/1523685662 --> v1:172.21.15.89:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f8c0ccc80 con 0x7f2f8c0cc140 2023-06-09T04:41:28.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.808+0000 7f2f8b7fe700 1 -- 172.21.15.62:0/1523685662 <== mon.1 v1:172.21.15.89:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 540845019 0 0) 0x7f2f840019f0 con 0x7f2f8c0cc140 2023-06-09T04:41:28.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.808+0000 7f2f8b7fe700 1 -- 172.21.15.62:0/1523685662 >> v1:172.21.15.89:6789/0 conn(0x7f2f8c0cc140 legacy=0x7f2f8c06f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:28.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.808+0000 7f2f8b7fe700 1 --2- 172.21.15.62:0/1523685662 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f74003a20 0x7f2f74003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:28.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.808+0000 7f2f8b7fe700 1 --2- 172.21.15.62:0/1523685662 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f74004450 0x7f2f74004910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:28.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.808+0000 7f2f8b7fe700 1 --2- 172.21.15.62:0/1523685662 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f8c0ca3b0 0x7f2f74004fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:28.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.808+0000 7f2f8b7fe700 1 -- 172.21.15.62:0/1523685662 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8c0cc6c0 con 0x7f2f74003a20 2023-06-09T04:41:28.814 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.808+0000 7f2f8b7fe700 1 -- 172.21.15.62:0/1523685662 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8c0cc9a0 con 0x7f2f74004450 2023-06-09T04:41:28.814 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.808+0000 7f2f8b7fe700 1 -- 172.21.15.62:0/1523685662 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7400ba30 con 0x7f2f8c0ca3b0 2023-06-09T04:41:28.814 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.808+0000 7f2f8bfff700 1 --2- 172.21.15.62:0/1523685662 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f74004450 0x7f2f74004910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:28.814 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.808+0000 7f2f909e1700 1 --2- 172.21.15.62:0/1523685662 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f74003a20 0x7f2f74003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:28.814 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.808+0000 7f2f8bfff700 1 -- 172.21.15.62:0/1523685662 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f8c0ca3b0 msgr2=0x7f2f74004fe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-09T04:41:28.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.808+0000 7f2f8bfff700 1 --2- 172.21.15.62:0/1523685662 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f8c0ca3b0 0x7f2f74004fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:28.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.808+0000 7f2f8bfff700 1 -- 172.21.15.62:0/1523685662 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f74003a20 msgr2=0x7f2f74003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:28.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.808+0000 7f2f8bfff700 1 --2- 172.21.15.62:0/1523685662 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f74003a20 0x7f2f74003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:28.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.808+0000 7f2f8bfff700 1 -- 172.21.15.62:0/1523685662 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f8c0ccc80 con 0x7f2f74004450 2023-06-09T04:41:28.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.808+0000 7f2f911e2700 1 --2- 172.21.15.62:0/1523685662 >> v2:172.21.15.62:3300/0 conn(0x7f2f8c06fcb0 0x7f2f8c140b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:41:28.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.808+0000 7f7678df6700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f76740ce740 0x7f76740ca140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:28.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.808+0000 7f7678df6700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7674158120 con 0x7f767406fcb0 2023-06-09T04:41:28.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.808+0000 7f7678df6700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76740cc9a0 con 0x7f76740cbc00 2023-06-09T04:41:28.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.808+0000 7f7678df6700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76740ca680 con 0x7f76740ce740 2023-06-09T04:41:28.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.808+0000 7f76737fe700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f76740ce740 0x7f76740ca140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:28.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.808+0000 7f2f8bfff700 1 --2- 172.21.15.62:0/1523685662 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f74004450 0x7f2f74004910 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2f8400a480 tx=0x7f2f740058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a88bce1442f718f server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:28.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.808+0000 7f76737fe700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f76740ce740 0x7f76740ca140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.62:44286/0 (socket says 172.21.15.62:44286) 2023-06-09T04:41:28.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.808+0000 7f76737fe700 1 -- 172.21.15.62:0/3447676998 learned_addr learned my addr 172.21.15.62:0/3447676998 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:28.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.808+0000 7f2f8b7fe700 1 -- 172.21.15.62:0/1523685662 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f84011760 con 0x7f2f74004450 2023-06-09T04:41:28.818 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.808+0000 7f2f8b7fe700 1 -- 172.21.15.62:0/1523685662 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f840118e0 con 0x7f2f74004450 2023-06-09T04:41:28.818 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.808+0000 7f2f8b7fe700 1 -- 172.21.15.62:0/1523685662 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f84011c90 con 0x7f2f74004450 2023-06-09T04:41:28.818 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.808+0000 7f76737fe700 1 -- 172.21.15.62:0/3447676998 >> v1:172.21.15.89:6789/0 conn(0x7f76740cbc00 legacy=0x7f767406f5a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-06-09T04:41:28.818 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.808+0000 7f76737fe700 1 -- 172.21.15.62:0/3447676998 >> v1:172.21.15.62:6789/0 conn(0x7f767406fcb0 legacy=0x7f7674140b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:28.818 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.808+0000 7f76737fe700 1 -- 172.21.15.62:0/3447676998 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f767415fc00 con 0x7f76740ce740 2023-06-09T04:41:28.819 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.808+0000 7f76737fe700 1 --2- 172.21.15.62:0/3447676998 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f76740ce740 0x7f76740ca140 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f766c009e80 tx=0x7f766c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f1a0dae328a5ca0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:28.819 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.808+0000 7f2f919e3700 1 -- 172.21.15.62:0/1523685662 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f74004450 msgr2=0x7f2f74004910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:28.819 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.808+0000 7f2f919e3700 1 --2- 172.21.15.62:0/1523685662 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f74004450 0x7f2f74004910 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2f8400a480 tx=0x7f2f740058a0 comp rx=0 tx=0).stop 2023-06-09T04:41:28.819 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.812+0000 7f2f911e2700 1 -- 172.21.15.62:0/1523685662 reap_dead start 2023-06-09T04:41:28.819 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.812+0000 7f2f919e3700 1 -- 172.21.15.62:0/1523685662 shutdown_connections 2023-06-09T04:41:28.820 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.812+0000 7f2f919e3700 1 -- 172.21.15.62:0/1523685662 >> 172.21.15.62:0/1523685662 conn(0x7f2f8c0b0860 msgr2=0x7f2f8c0ce030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:28.820 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.812+0000 7f76727fc700 1 -- 172.21.15.62:0/3447676998 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766c00e070 con 0x7f76740ce740 2023-06-09T04:41:28.820 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.812+0000 7f2f919e3700 1 -- 172.21.15.62:0/1523685662 shutdown_connections 2023-06-09T04:41:28.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.812+0000 7f76727fc700 1 -- 172.21.15.62:0/3447676998 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f766c003a40 con 0x7f76740ce740 2023-06-09T04:41:28.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.812+0000 7f76727fc700 1 -- 172.21.15.62:0/3447676998 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766c003df0 con 0x7f76740ce740 2023-06-09T04:41:28.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.812+0000 7f7678df6700 1 -- 172.21.15.62:0/3447676998 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f76740ce740 msgr2=0x7f76740ca140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:28.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.812+0000 7f7678df6700 1 --2- 172.21.15.62:0/3447676998 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f76740ce740 0x7f76740ca140 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f766c009e80 tx=0x7f766c00b330 comp rx=0 tx=0).stop 2023-06-09T04:41:28.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.812+0000 7f7678df6700 1 -- 172.21.15.62:0/3447676998 shutdown_connections 2023-06-09T04:41:28.822 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.812+0000 7f7678df6700 1 --2- 172.21.15.62:0/3447676998 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f76740ce740 0x7f76740ca140 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:28.822 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.812+0000 7f7678df6700 1 -- 172.21.15.62:0/3447676998 >> 172.21.15.62:0/3447676998 conn(0x7f76740b0860 msgr2=0x7f76740ce030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:28.822 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.812+0000 7f7678df6700 1 -- 172.21.15.62:0/3447676998 shutdown_connections 2023-06-09T04:41:28.822 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.812+0000 7f2f919e3700 1 -- 172.21.15.62:0/1523685662 wait complete. 2023-06-09T04:41:28.822 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.812+0000 7f2f919e3700 1 Processor -- start 2023-06-09T04:41:28.823 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.812+0000 7f7678df6700 1 -- 172.21.15.62:0/3447676998 wait complete. 2023-06-09T04:41:28.823 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.812+0000 7f2f919e3700 1 -- start start 2023-06-09T04:41:28.823 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.816+0000 7f7678df6700 1 Processor -- start 2023-06-09T04:41:28.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.816+0000 7f7678df6700 1 -- start start 2023-06-09T04:41:28.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.816+0000 7f2f919e3700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f8c150010 0x7f2f8c0c43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:28.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.816+0000 7f2f919e3700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f8c1503e0 0x7f2f8c1f95e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:28.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.816+0000 7f2f8bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f8c1503e0 0x7f2f8c1f95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:28.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.816+0000 7f2f909e1700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f8c150010 0x7f2f8c0c43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:28.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.816+0000 7f2f909e1700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f8c150010 0x7f2f8c0c43c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.62:44302/0 (socket says 172.21.15.62:44302) 2023-06-09T04:41:28.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.816+0000 7f2f8bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f8c1503e0 0x7f2f8c1f95e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40578/0 (socket says 172.21.15.62:40578) 2023-06-09T04:41:28.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.816+0000 7f2f909e1700 1 -- 172.21.15.62:0/2202954369 learned_addr learned my addr 172.21.15.62:0/2202954369 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:28.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.816+0000 7f7678df6700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f767406fcb0 0x7f7674147b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:28.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.816+0000 7f2f919e3700 1 --2- 172.21.15.62:0/2202954369 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f8c06c440 0x7f2f8c06c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:28.826 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.816+0000 7f7678df6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76740cbc00 0x7f76740c4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:28.826 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.816+0000 7f7678df6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76740ce740 0x7f76740c6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:28.826 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.816+0000 7f2f919e3700 1 -- 172.21.15.62:0/2202954369 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8c06cdf0 con 0x7f2f8c1503e0 2023-06-09T04:41:28.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.816+0000 7f2f919e3700 1 -- 172.21.15.62:0/2202954369 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8c1f9b20 con 0x7f2f8c150010 2023-06-09T04:41:28.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.816+0000 7f7678df6700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76740c5230 con 0x7f76740cbc00 2023-06-09T04:41:28.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.816+0000 7f7678df6700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76740c54d0 con 0x7f767406fcb0 2023-06-09T04:41:28.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.816+0000 7f7678df6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76740c57b0 con 0x7f76740ce740 2023-06-09T04:41:28.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.816+0000 7f7672ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76740cbc00 0x7f76740c4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:28.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.816+0000 7f7672ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76740cbc00 0x7f76740c4530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40590/0 (socket says 172.21.15.62:40590) 2023-06-09T04:41:28.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.816+0000 7f7672ffd700 1 -- 172.21.15.62:0/2930376717 learned_addr learned my addr 172.21.15.62:0/2930376717 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:28.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.816+0000 7f76737fe700 1 --2- 172.21.15.62:0/2930376717 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f767406fcb0 0x7f7674147b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:28.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.816+0000 7f2f919e3700 1 -- 172.21.15.62:0/2202954369 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8c0c52a0 con 0x7f2f8c06c440 2023-06-09T04:41:28.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.816+0000 7f2f911e2700 1 --2- 172.21.15.62:0/2202954369 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f8c06c440 0x7f2f8c06c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:28.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.816+0000 7f7673fff700 1 --2- 172.21.15.62:0/2930376717 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76740ce740 0x7f76740c6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:28.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.816+0000 7f7672ffd700 1 -- 172.21.15.62:0/2930376717 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76740ce740 msgr2=0x7f76740c6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:28.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.816+0000 7f7672ffd700 1 --2- 172.21.15.62:0/2930376717 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76740ce740 0x7f76740c6290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:28.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.816+0000 7f7672ffd700 1 -- 172.21.15.62:0/2930376717 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f767406fcb0 msgr2=0x7f7674147b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:28.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.816+0000 7f7672ffd700 1 --2- 172.21.15.62:0/2930376717 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f767406fcb0 0x7f7674147b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:28.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.816+0000 7f7672ffd700 1 -- 172.21.15.62:0/2930376717 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f766c009b30 con 0x7f76740cbc00 2023-06-09T04:41:28.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.820+0000 7f2f8bfff700 1 -- 172.21.15.62:0/2202954369 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f8c06c440 msgr2=0x7f2f8c06c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:28.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.820+0000 7f2f8bfff700 1 --2- 172.21.15.62:0/2202954369 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f8c06c440 0x7f2f8c06c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:28.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.820+0000 7f2f8bfff700 1 -- 172.21.15.62:0/2202954369 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f8c150010 msgr2=0x7f2f8c0c43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:28.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.820+0000 7f2f8bfff700 1 --2- 172.21.15.62:0/2202954369 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f8c150010 0x7f2f8c0c43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:28.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.820+0000 7f2f8bfff700 1 -- 172.21.15.62:0/2202954369 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f8c0c5580 con 0x7f2f8c1503e0 2023-06-09T04:41:28.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.820+0000 7f2f8bfff700 1 --2- 172.21.15.62:0/2202954369 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f8c1503e0 0x7f2f8c1f95e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2f8400a8c0 tx=0x7f2f84001cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:28.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.820+0000 7f7672ffd700 1 --2- 172.21.15.62:0/2930376717 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76740cbc00 0x7f76740c4530 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f766800b520 tx=0x7f766800b830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:28.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.820+0000 7f765bfff700 1 -- 172.21.15.62:0/2930376717 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7668011830 con 0x7f76740cbc00 2023-06-09T04:41:28.832 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.820+0000 7f415759e700 1 Processor -- start 2023-06-09T04:41:28.832 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.820+0000 7f415759e700 1 -- start start 2023-06-09T04:41:28.832 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.820+0000 7f7678df6700 1 -- 172.21.15.62:0/2930376717 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76740c5a90 con 0x7f76740cbc00 2023-06-09T04:41:28.832 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.820+0000 7f7678df6700 1 -- 172.21.15.62:0/2930376717 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76741480c0 con 0x7f76740cbc00 2023-06-09T04:41:28.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.820+0000 7f2f897fa700 1 -- 172.21.15.62:0/2202954369 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f84011e60 con 0x7f2f8c1503e0 2023-06-09T04:41:28.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.820+0000 7f2f897fa700 1 -- 172.21.15.62:0/2202954369 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f84011250 con 0x7f2f8c1503e0 2023-06-09T04:41:28.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.820+0000 7f2f897fa700 1 -- 172.21.15.62:0/2202954369 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f84011600 con 0x7f2f8c1503e0 2023-06-09T04:41:28.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.820+0000 7f2f919e3700 1 -- 172.21.15.62:0/2202954369 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f8c0c5860 con 0x7f2f8c1503e0 2023-06-09T04:41:28.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.820+0000 7f2f919e3700 1 -- 172.21.15.62:0/2202954369 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f8c0c5e20 con 0x7f2f8c1503e0 2023-06-09T04:41:28.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.820+0000 7f2f919e3700 1 -- 172.21.15.62:0/2202954369 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f8c0739c0 con 0x7f2f8c1503e0 2023-06-09T04:41:28.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.820+0000 7fc700d3e700 1 Processor -- start 2023-06-09T04:41:28.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.820+0000 7fc700d3e700 1 -- start start 2023-06-09T04:41:28.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.820+0000 7f7678df6700 1 -- 172.21.15.62:0/2930376717 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76740c5fb0 con 0x7f76740cbc00 2023-06-09T04:41:28.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.824+0000 7f765bfff700 1 -- 172.21.15.62:0/2930376717 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7668011990 con 0x7f76740cbc00 2023-06-09T04:41:28.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.824+0000 7f765bfff700 1 -- 172.21.15.62:0/2930376717 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7668011d40 con 0x7f76740cbc00 2023-06-09T04:41:28.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.824+0000 7f415759e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f41580cb150 0x7f415806c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:28.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.824+0000 7f415759e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f41580ca0c0 0x7f41580cce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:28.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.824+0000 7f415759e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41580ca5a0 con 0x7f4158070c90 2023-06-09T04:41:28.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.824+0000 7f415759e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41580ca880 con 0x7f41580cb150 2023-06-09T04:41:28.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.824+0000 7f415759e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f415806c7d0 con 0x7f41580ca0c0 2023-06-09T04:41:28.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.824+0000 7f415659c700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f4158070c90 0x7f41580caa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.62:44632/0 (socket says 172.21.15.62:44632) 2023-06-09T04:41:28.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.824+0000 7f415659c700 1 -- 172.21.15.62:0/980498244 learned_addr learned my addr 172.21.15.62:0/980498244 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:41:28.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.824+0000 7f4156d9d700 1 --2- 172.21.15.62:0/980498244 >> v2:172.21.15.89:3300/0 conn(0x7f41580ca0c0 0x7f41580cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:28.837 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.824+0000 7fc700d3e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc6f4047c50 0x7fc6f40480a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:28.837 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.824+0000 7fc700d3e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc6f4053aa0 0x7fc6f4053ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:28.837 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.824+0000 7fc700d3e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6f404f9f0 con 0x7fc6f40e6f20 2023-06-09T04:41:28.837 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.824+0000 7fc700d3e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6f40485e0 con 0x7fc6f4053aa0 2023-06-09T04:41:28.837 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.824+0000 7fc700d3e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6f4053610 con 0x7fc6f4047c50 2023-06-09T04:41:28.838 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.824+0000 7f4155d9b700 1 -- 172.21.15.62:0/980498244 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3818883973 0 0) 0x7f41580ca5a0 con 0x7f4158070c90 2023-06-09T04:41:28.838 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.824+0000 7f4155d9b700 1 -- 172.21.15.62:0/980498244 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41440035d0 con 0x7f4158070c90 2023-06-09T04:41:28.838 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.824+0000 7f4156d9d700 1 -- 172.21.15.62:0/980498244 >> v2:172.21.15.62:3300/0 conn(0x7f41580cb150 msgr2=0x7f415806c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:28.838 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.824+0000 7f4156d9d700 1 --2- 172.21.15.62:0/980498244 >> v2:172.21.15.62:3300/0 conn(0x7f41580cb150 0x7f415806c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:28.838 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.824+0000 7f4156d9d700 1 -- 172.21.15.62:0/980498244 >> v1:172.21.15.89:6789/0 conn(0x7f4158070c90 legacy=0x7f41580caa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:28.838 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.824+0000 7f4156d9d700 1 -- 172.21.15.62:0/980498244 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f415815ba80 con 0x7f41580ca0c0 2023-06-09T04:41:28.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.824+0000 7f3f5ffe0700 1 Processor -- start 2023-06-09T04:41:28.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.824+0000 7f4156d9d700 1 --2- 172.21.15.62:0/980498244 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f41580ca0c0 0x7f41580cce20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f415806c9d0 tx=0x7f415000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e4ead7905857de7 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:28.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.824+0000 7f3f5ffe0700 1 -- start start 2023-06-09T04:41:28.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.824+0000 7f4155d9b700 1 -- 172.21.15.62:0/980498244 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f415000e070 con 0x7f41580ca0c0 2023-06-09T04:41:28.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.824+0000 7fa985cee700 1 Processor -- start 2023-06-09T04:41:28.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.824+0000 7f4155d9b700 1 -- 172.21.15.62:0/980498244 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f415000bb20 con 0x7f41580ca0c0 2023-06-09T04:41:28.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.824+0000 7f4155d9b700 1 -- 172.21.15.62:0/980498244 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f415000be90 con 0x7f41580ca0c0 2023-06-09T04:41:28.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.824+0000 7fa985cee700 1 -- start start 2023-06-09T04:41:28.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.824+0000 7f765bfff700 1 -- 172.21.15.62:0/2930376717 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f766801a400 con 0x7f76740cbc00 2023-06-09T04:41:28.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.828+0000 7fc6fb7fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fc6f40e6f20 0x7fc6f404f2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:45024/0 (socket says 172.21.15.62:45024) 2023-06-09T04:41:28.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.828+0000 7fc6fb7fe700 1 -- 172.21.15.62:0/1654551407 learned_addr learned my addr 172.21.15.62:0/1654551407 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:41:28.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.828+0000 7f415759e700 1 -- 172.21.15.62:0/980498244 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f41580ca0c0 msgr2=0x7f41580cce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:28.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.828+0000 7f415759e700 1 --2- 172.21.15.62:0/980498244 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f41580ca0c0 0x7f41580cce20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f415806c9d0 tx=0x7f415000b330 comp rx=0 tx=0).stop 2023-06-09T04:41:28.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.828+0000 7f415759e700 1 -- 172.21.15.62:0/980498244 shutdown_connections 2023-06-09T04:41:28.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.828+0000 7f415759e700 1 --2- 172.21.15.62:0/980498244 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f41580ca0c0 0x7f41580cce20 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:28.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.828+0000 7f415759e700 1 --2- 172.21.15.62:0/980498244 >> v2:172.21.15.62:3300/0 conn(0x7f41580cb150 0x7f415806c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:28.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.828+0000 7f415759e700 1 -- 172.21.15.62:0/980498244 >> 172.21.15.62:0/980498244 conn(0x7f415806a420 msgr2=0x7f41580afc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:28.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.828+0000 7f765bfff700 1 --2- 172.21.15.62:0/2930376717 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f76600662f0 0x7f76600687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:28.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.828+0000 7f3f5ffe0700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3f50036710 0x7f3f50036ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:28.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.828+0000 7f3f5ffe0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f50052860 0x7f3f5004fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:28.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.828+0000 7f3f5ffe0700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f50037020 con 0x7f3f50007240 2023-06-09T04:41:28.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.828+0000 7f3f5ffe0700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f500dfb10 con 0x7f3f50036710 2023-06-09T04:41:28.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.828+0000 7f3f5ffe0700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f50052d60 con 0x7f3f50052860 2023-06-09T04:41:28.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.828+0000 7f765bfff700 1 -- 172.21.15.62:0/2930376717 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7668084460 con 0x7f76740cbc00 2023-06-09T04:41:28.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.828+0000 7fa985cee700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa9780e3d40 0x7fa9780e4c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:28.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.828+0000 7fa985cee700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa978036e20 0x7fa978039640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:28.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.828+0000 7fa985cee700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa97804fc10 con 0x7fa978037ae0 2023-06-09T04:41:28.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.828+0000 7fa985cee700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa978051240 con 0x7fa978036e20 2023-06-09T04:41:28.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.828+0000 7fa985cee700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9780e5140 con 0x7fa9780e3d40 2023-06-09T04:41:28.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.828+0000 7f3f5dd7c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3f50036710 0x7f3f50036ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:28.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.828+0000 7f3f5dd7c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3f50036710 0x7f3f50036ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40612/0 (socket says 172.21.15.62:40612) 2023-06-09T04:41:28.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.828+0000 7f3f5dd7c700 1 -- 172.21.15.62:0/4236993188 learned_addr learned my addr 172.21.15.62:0/4236993188 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:28.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.828+0000 7f415759e700 1 -- 172.21.15.62:0/980498244 shutdown_connections 2023-06-09T04:41:28.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.828+0000 7fa97f7fe700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa9780e3d40 0x7fa9780e4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:28.847 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.828+0000 7fa97f7fe700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa9780e3d40 0x7fa9780e4c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.62:44356/0 (socket says 172.21.15.62:44356) 2023-06-09T04:41:28.847 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.828+0000 7fa97f7fe700 1 -- 172.21.15.62:0/3655227391 learned_addr learned my addr 172.21.15.62:0/3655227391 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:28.847 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.828+0000 7fa97effd700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fa978037ae0 0x7fa978036710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.62:44644/0 (socket says 172.21.15.62:44644) 2023-06-09T04:41:28.847 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.828+0000 7f415759e700 1 -- 172.21.15.62:0/980498244 wait complete. 2023-06-09T04:41:28.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.828+0000 7f76737fe700 1 --2- 172.21.15.62:0/2930376717 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f76600662f0 0x7f76600687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:28.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.828+0000 7f3f5dd7c700 1 -- 172.21.15.62:0/4236993188 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f50052860 msgr2=0x7f3f5004fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:28.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.828+0000 7f3f5dd7c700 1 --2- 172.21.15.62:0/4236993188 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f50052860 0x7f3f5004fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:28.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.828+0000 7f3f5dd7c700 1 -- 172.21.15.62:0/4236993188 >> v1:172.21.15.62:6789/0 conn(0x7f3f50007240 legacy=0x7f3f5004ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:28.849 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.828+0000 7f3f5dd7c700 1 -- 172.21.15.62:0/4236993188 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f50053040 con 0x7f3f50036710 2023-06-09T04:41:28.849 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.828+0000 7fa97ffff700 1 --2- 172.21.15.62:0/3655227391 >> v2:172.21.15.62:3300/0 conn(0x7fa978036e20 0x7fa978039640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:28.849 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.828+0000 7f4f13901700 1 Processor -- start 2023-06-09T04:41:28.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.828+0000 7fa97f7fe700 1 -- 172.21.15.62:0/3655227391 >> v2:172.21.15.62:3300/0 conn(0x7fa978036e20 msgr2=0x7fa978039640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:28.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.828+0000 7fa97f7fe700 1 --2- 172.21.15.62:0/3655227391 >> v2:172.21.15.62:3300/0 conn(0x7fa978036e20 0x7fa978039640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:28.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.828+0000 7fa97f7fe700 1 -- 172.21.15.62:0/3655227391 >> v1:172.21.15.89:6789/0 conn(0x7fa978037ae0 legacy=0x7fa978036710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:28.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.828+0000 7fa97e7fc700 1 -- 172.21.15.62:0/3655227391 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3376784482 0 0) 0x7fa97804fc10 con 0x7fa978037ae0 2023-06-09T04:41:28.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.828+0000 7fa97f7fe700 1 -- 172.21.15.62:0/3655227391 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa978037fe0 con 0x7fa9780e3d40 2023-06-09T04:41:28.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.828+0000 7fa97ffff700 1 --2- 172.21.15.62:0/3655227391 >> v2:172.21.15.62:3300/0 conn(0x7fa978036e20 0x7fa978039640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:41:28.851 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.828+0000 7f3f5dd7c700 1 --2- 172.21.15.62:0/4236993188 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f50036710 0x7f3f50036ae0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3f5400bbb0 tx=0x7f3f5400bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec0f0a3a6e98a8af server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:28.851 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.828+0000 7fa97f7fe700 1 --2- 172.21.15.62:0/3655227391 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa9780e3d40 0x7fa9780e4c00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa97800df80 tx=0x7fa96c009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e20b78e13647241 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:28.851 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.828+0000 7f4f13901700 1 -- start start 2023-06-09T04:41:28.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.828+0000 7f76737fe700 1 --2- 172.21.15.62:0/2930376717 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f76600662f0 0x7f76600687a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f766c000f80 tx=0x7f766c009000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:28.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.832+0000 7fa97e7fc700 1 -- 172.21.15.62:0/3655227391 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa96c00b8a0 con 0x7fa9780e3d40 2023-06-09T04:41:28.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.832+0000 7fa97e7fc700 1 -- 172.21.15.62:0/3655227391 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa96c00ba00 con 0x7fa9780e3d40 2023-06-09T04:41:28.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.832+0000 7fa97e7fc700 1 -- 172.21.15.62:0/3655227391 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa96c00bd90 con 0x7fa9780e3d40 2023-06-09T04:41:28.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.832+0000 7fc6faffd700 1 --2- 172.21.15.62:0/1654551407 >> v2:172.21.15.89:3300/0 conn(0x7fc6f4047c50 0x7fc6f40480a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:28.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.832+0000 7fc6faffd700 1 -- 172.21.15.62:0/1654551407 >> v2:172.21.15.62:3300/0 conn(0x7fc6f4053aa0 msgr2=0x7fc6f4053ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:28.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.832+0000 7fc6faffd700 1 --2- 172.21.15.62:0/1654551407 >> v2:172.21.15.62:3300/0 conn(0x7fc6f4053aa0 0x7fc6f4053ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:28.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.832+0000 7fc6faffd700 1 -- 172.21.15.62:0/1654551407 >> v1:172.21.15.62:6789/0 conn(0x7fc6f40e6f20 legacy=0x7fc6f404f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:28.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.832+0000 7fc6faffd700 1 -- 172.21.15.62:0/1654551407 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6f4052a00 con 0x7fc6f4047c50 2023-06-09T04:41:28.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.832+0000 7f415759e700 1 Processor -- start 2023-06-09T04:41:28.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.832+0000 7fa985cee700 1 -- 172.21.15.62:0/3655227391 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa9780e3d40 msgr2=0x7fa9780e4c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:28.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.832+0000 7fa985cee700 1 --2- 172.21.15.62:0/3655227391 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa9780e3d40 0x7fa9780e4c00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa97800df80 tx=0x7fa96c009bf0 comp rx=0 tx=0).stop 2023-06-09T04:41:28.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.832+0000 7f415759e700 1 -- start start 2023-06-09T04:41:28.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.832+0000 7fa985cee700 1 -- 172.21.15.62:0/3655227391 shutdown_connections 2023-06-09T04:41:28.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.832+0000 7fa985cee700 1 --2- 172.21.15.62:0/3655227391 >> v2:172.21.15.62:3300/0 conn(0x7fa978036e20 0x7fa978039640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:28.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.832+0000 7fa985cee700 1 --2- 172.21.15.62:0/3655227391 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa9780e3d40 0x7fa9780e4c00 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:28.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.832+0000 7fa985cee700 1 -- 172.21.15.62:0/3655227391 >> 172.21.15.62:0/3655227391 conn(0x7fa978051710 msgr2=0x7fa978051ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:28.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.832+0000 7fa985cee700 1 -- 172.21.15.62:0/3655227391 shutdown_connections 2023-06-09T04:41:28.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.832+0000 7f4f13901700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4f0400dd20 0x7f4f0400e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:28.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.832+0000 7f4f13901700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4f04054900 0x7f4f04054d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:28.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.832+0000 7f4f13901700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f04055290 con 0x7f4f04038840 2023-06-09T04:41:28.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.832+0000 7f4f13901700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f040eab30 con 0x7f4f0400dd20 2023-06-09T04:41:28.857 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.832+0000 7f4f13901700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f040361c0 con 0x7f4f04054900 2023-06-09T04:41:28.857 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.832+0000 7f415759e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41580ca0c0 0x7f41580cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:28.857 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.832+0000 7f415759e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f41580cb150 0x7f4158155f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:28.857 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.832+0000 7f4f1169d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4f0400dd20 0x7f4f0400e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:28.857 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.832+0000 7f4f1169d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4f0400dd20 0x7f4f0400e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40624/0 (socket says 172.21.15.62:40624) 2023-06-09T04:41:28.858 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.832+0000 7f4f1169d700 1 -- 172.21.15.62:0/132381140 learned_addr learned my addr 172.21.15.62:0/132381140 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:28.858 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.832+0000 7f415759e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4158145c80 0x7f4158146100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:28.858 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.832+0000 7f415759e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41580cb890 con 0x7f41580ca0c0 2023-06-09T04:41:28.858 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.832+0000 7f415759e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41580cbe10 con 0x7f41580cb150 2023-06-09T04:41:28.859 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.832+0000 7f415759e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4158146740 con 0x7f4158145c80 2023-06-09T04:41:28.859 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.832+0000 7f415659c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41580ca0c0 0x7f41580cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:28.859 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.832+0000 7f4f10e9c700 1 --2- 172.21.15.62:0/132381140 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4f04054900 0x7f4f04054d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:28.859 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.832+0000 7f415659c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41580ca0c0 0x7f41580cc2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40632/0 (socket says 172.21.15.62:40632) 2023-06-09T04:41:28.860 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.832+0000 7f415659c700 1 -- 172.21.15.62:0/601396461 learned_addr learned my addr 172.21.15.62:0/601396461 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:28.860 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.832+0000 7f414dd9b700 1 --2- 172.21.15.62:0/601396461 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f41580cb150 0x7f4158155f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:28.860 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.832+0000 7fa985cee700 1 -- 172.21.15.62:0/3655227391 wait complete. 2023-06-09T04:41:28.860 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.832+0000 7f415659c700 1 -- 172.21.15.62:0/601396461 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4158145c80 msgr2=0x7f4158146100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:28.861 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.832+0000 7f415659c700 1 --2- 172.21.15.62:0/601396461 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4158145c80 0x7f4158146100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:28.861 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.832+0000 7f415659c700 1 -- 172.21.15.62:0/601396461 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f41580cb150 msgr2=0x7f4158155f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:28.861 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.832+0000 7f415659c700 1 --2- 172.21.15.62:0/601396461 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f41580cb150 0x7f4158155f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:28.861 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.832+0000 7f415659c700 1 -- 172.21.15.62:0/601396461 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4150009a70 con 0x7f41580ca0c0 2023-06-09T04:41:28.861 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.832+0000 7f4f10e9c700 1 -- 172.21.15.62:0/132381140 >> v2:172.21.15.62:3300/0 conn(0x7f4f0400dd20 msgr2=0x7f4f0400e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:28.862 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.832+0000 7f4f10e9c700 1 --2- 172.21.15.62:0/132381140 >> v2:172.21.15.62:3300/0 conn(0x7f4f0400dd20 0x7f4f0400e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:28.862 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.832+0000 7f4f10e9c700 1 -- 172.21.15.62:0/132381140 >> v1:172.21.15.62:6789/0 conn(0x7f4f04038840 legacy=0x7f4f04038ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:28.862 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.832+0000 7f4f10e9c700 1 -- 172.21.15.62:0/132381140 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f0400e630 con 0x7f4f04054900 2023-06-09T04:41:28.862 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.832+0000 7f4f10e9c700 1 --2- 172.21.15.62:0/132381140 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4f04054900 0x7f4f04054d50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4f0400e820 tx=0x7f4f08009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc045208cf3dc3c6 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:28.862 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.836+0000 7f415659c700 1 --2- 172.21.15.62:0/601396461 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41580ca0c0 0x7f41580cc2a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f414800c700 tx=0x7f414800ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:28.863 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.836+0000 7f4f03fff700 1 -- 172.21.15.62:0/132381140 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f08004020 con 0x7f4f04054900 2023-06-09T04:41:28.863 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.836+0000 7f4f03fff700 1 -- 172.21.15.62:0/132381140 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f08004180 con 0x7f4f04054900 2023-06-09T04:41:28.863 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.836+0000 7f4f03fff700 1 -- 172.21.15.62:0/132381140 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f08004530 con 0x7f4f04054900 2023-06-09T04:41:28.863 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.836+0000 7fa985cee700 1 Processor -- start 2023-06-09T04:41:28.864 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.836+0000 7f4f13901700 1 -- 172.21.15.62:0/132381140 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4f04054900 msgr2=0x7f4f04054d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:28.864 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.836+0000 7f4f13901700 1 --2- 172.21.15.62:0/132381140 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4f04054900 0x7f4f04054d50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4f0400e820 tx=0x7f4f08009b30 comp rx=0 tx=0).stop 2023-06-09T04:41:28.864 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.836+0000 7f4f13901700 1 -- 172.21.15.62:0/132381140 shutdown_connections 2023-06-09T04:41:28.864 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.836+0000 7f4f13901700 1 --2- 172.21.15.62:0/132381140 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4f04054900 0x7f4f04054d50 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:28.864 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.836+0000 7f4f13901700 1 --2- 172.21.15.62:0/132381140 >> v2:172.21.15.62:3300/0 conn(0x7f4f0400dd20 0x7f4f0400e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:28.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.836+0000 7f4f13901700 1 -- 172.21.15.62:0/132381140 >> 172.21.15.62:0/132381140 conn(0x7f4f0400cf50 msgr2=0x7f4f04056dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:28.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.832+0000 7f2f897fa700 1 -- 172.21.15.62:0/2202954369 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2f84017070 con 0x7f2f8c1503e0 2023-06-09T04:41:28.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.836+0000 7f2f897fa700 1 --2- 172.21.15.62:0/2202954369 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f2f780663c0 0x7f2f78068870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:28.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.836+0000 7f2f897fa700 1 -- 172.21.15.62:0/2202954369 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2f84085910 con 0x7f2f8c1503e0 2023-06-09T04:41:28.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.836+0000 7f2f897fa700 1 -- 172.21.15.62:0/2202954369 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2f840af7a0 con 0x7f2f8c1503e0 2023-06-09T04:41:28.866 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.836+0000 7f4f13901700 1 -- 172.21.15.62:0/132381140 shutdown_connections 2023-06-09T04:41:28.866 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.836+0000 7f2f909e1700 1 --2- 172.21.15.62:0/2202954369 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f2f780663c0 0x7f2f78068870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:28.866 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.836+0000 7f4f13901700 1 -- 172.21.15.62:0/132381140 wait complete. 2023-06-09T04:41:28.866 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.836+0000 7fa985cee700 1 -- start start 2023-06-09T04:41:28.867 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.836+0000 7fc6faffd700 1 --2- 172.21.15.62:0/1654551407 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6f4047c50 0x7fc6f40480a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc6f4050c50 tx=0x7fc6f0009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6984f2c288a96834 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:28.867 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.836+0000 7f2f909e1700 1 --2- 172.21.15.62:0/2202954369 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f2f780663c0 0x7f2f78068870 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c007bb0 tx=0x7f2f7c00c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:28.867 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.836+0000 7fc6fa7fc700 1 -- 172.21.15.62:0/1654551407 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f0011830 con 0x7fc6f4047c50 2023-06-09T04:41:28.868 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.836+0000 7fc6fa7fc700 1 -- 172.21.15.62:0/1654551407 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6f0011990 con 0x7fc6f4047c50 2023-06-09T04:41:28.868 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.836+0000 7fc6fa7fc700 1 -- 172.21.15.62:0/1654551407 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f0011d40 con 0x7fc6f4047c50 2023-06-09T04:41:28.868 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.836+0000 7fa985cee700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa978036e20 0x7fa97804ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:28.868 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.836+0000 7fa985cee700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa978037ae0 0x7fa97804a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:28.869 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.836+0000 7fa985cee700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa9780e3d40 0x7fa97804acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:28.869 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.836+0000 7fa985cee700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9780d2b10 con 0x7fa9780e3d40 2023-06-09T04:41:28.869 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.836+0000 7fa985cee700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9780d7700 con 0x7fa978037ae0 2023-06-09T04:41:28.869 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.836+0000 7fa985cee700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9780e1e30 con 0x7fa978036e20 2023-06-09T04:41:28.869 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.836+0000 7fa97f7fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa978036e20 0x7fa97804ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:28.869 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.836+0000 7fa97f7fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa978036e20 0x7fa97804ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.62:36054/0 (socket says 172.21.15.62:36054) 2023-06-09T04:41:28.870 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.836+0000 7fa97f7fe700 1 -- 172.21.15.62:0/345760227 learned_addr learned my addr 172.21.15.62:0/345760227 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:28.870 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.836+0000 7fa97effd700 1 --2- 172.21.15.62:0/345760227 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa978037ae0 0x7fa97804a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:28.870 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.836+0000 7fa97ffff700 1 --2- 172.21.15.62:0/345760227 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa9780e3d40 0x7fa97804acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:28.870 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.836+0000 7fa97ffff700 1 -- 172.21.15.62:0/345760227 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa978036e20 msgr2=0x7fa97804ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:28.870 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.836+0000 7fa97ffff700 1 --2- 172.21.15.62:0/345760227 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa978036e20 0x7fa97804ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:28.870 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.836+0000 7fc700d3e700 1 -- 172.21.15.62:0/1654551407 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6f4047c50 msgr2=0x7fc6f40480a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:28.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.836+0000 7fc700d3e700 1 --2- 172.21.15.62:0/1654551407 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6f4047c50 0x7fc6f40480a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc6f4050c50 tx=0x7fc6f0009b30 comp rx=0 tx=0).stop 2023-06-09T04:41:28.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.836+0000 7fa97ffff700 1 -- 172.21.15.62:0/345760227 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa978037ae0 msgr2=0x7fa97804a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:28.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.836+0000 7fa97ffff700 1 --2- 172.21.15.62:0/345760227 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa978037ae0 0x7fa97804a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:28.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.836+0000 7fa97ffff700 1 -- 172.21.15.62:0/345760227 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa96c009570 con 0x7fa9780e3d40 2023-06-09T04:41:28.872 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.836+0000 7fa97f7fe700 1 --2- 172.21.15.62:0/345760227 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa978036e20 0x7fa97804ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:41:28.872 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.840+0000 7fc700d3e700 1 -- 172.21.15.62:0/1654551407 shutdown_connections 2023-06-09T04:41:28.872 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.840+0000 7fc700d3e700 1 --2- 172.21.15.62:0/1654551407 >> v2:172.21.15.62:3300/0 conn(0x7fc6f4053aa0 0x7fc6f4053ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:28.872 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.840+0000 7fc700d3e700 1 --2- 172.21.15.62:0/1654551407 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6f4047c50 0x7fc6f40480a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:28.872 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.840+0000 7fc700d3e700 1 -- 172.21.15.62:0/1654551407 >> 172.21.15.62:0/1654551407 conn(0x7fc6f4051710 msgr2=0x7fc6f4051ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:28.873 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.840+0000 7fa97ffff700 1 --2- 172.21.15.62:0/345760227 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa9780e3d40 0x7fa97804acd0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa9800685c0 tx=0x7fa98006cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:28.873 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.840+0000 7fc700d3e700 1 -- 172.21.15.62:0/1654551407 shutdown_connections 2023-06-09T04:41:28.873 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.840+0000 7fc700d3e700 1 -- 172.21.15.62:0/1654551407 wait complete. 2023-06-09T04:41:28.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.840+0000 7f4f13901700 1 Processor -- start 2023-06-09T04:41:28.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.840+0000 7f4f13901700 1 -- start start 2023-06-09T04:41:28.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.840+0000 7fc700d3e700 1 Processor -- start 2023-06-09T04:41:28.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.840+0000 7fc700d3e700 1 -- start start 2023-06-09T04:41:28.875 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.840+0000 7f765bfff700 1 -- 172.21.15.62:0/2930376717 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7668051660 con 0x7f76740cbc00 2023-06-09T04:41:28.875 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.840+0000 7fc700d3e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6f4047c50 0x7fc6f404bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:28.875 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.840+0000 7fc700d3e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6f4053aa0 0x7fc6f417cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:28.875 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.840+0000 7fc700d3e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6f40e6f20 0x7fc6f4049df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:28.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.840+0000 7fc700d3e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f417d490 con 0x7fc6f40e6f20 2023-06-09T04:41:28.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.840+0000 7fc700d3e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f404a330 con 0x7fc6f4047c50 2023-06-09T04:41:28.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.840+0000 7fc700d3e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f404c3d0 con 0x7fc6f4053aa0 2023-06-09T04:41:28.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.840+0000 7fc6fbfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6f40e6f20 0x7fc6f4049df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:28.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.840+0000 7fc6fbfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6f40e6f20 0x7fc6f4049df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40652/0 (socket says 172.21.15.62:40652) 2023-06-09T04:41:28.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.840+0000 7fc6fbfff700 1 -- 172.21.15.62:0/1429163073 learned_addr learned my addr 172.21.15.62:0/1429163073 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:28.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.840+0000 7fc6faffd700 1 --2- 172.21.15.62:0/1429163073 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6f4053aa0 0x7fc6f417cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:28.877 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.840+0000 7f4f13901700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f0400dd20 0x7f4f040e50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:28.877 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.840+0000 7f4f13901700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f04038840 0x7f4f0404de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:28.877 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.840+0000 7f4f13901700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4f04054900 0x7f4f0404e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:28.877 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.840+0000 7f4f13901700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0403a600 con 0x7f4f0400dd20 2023-06-09T04:41:28.877 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.840+0000 7f4f13901700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0403cb10 con 0x7f4f04038840 2023-06-09T04:41:28.877 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.840+0000 7f4f13901700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0404ef10 con 0x7f4f04054900 2023-06-09T04:41:28.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.840+0000 7f4f1169d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f0400dd20 0x7f4f040e50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:28.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.840+0000 7f4f11e9e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4f04054900 0x7f4f0404e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:28.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.840+0000 7f4f1169d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f0400dd20 0x7f4f040e50a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40648/0 (socket says 172.21.15.62:40648) 2023-06-09T04:41:28.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.840+0000 7f4f1169d700 1 -- 172.21.15.62:0/925640956 learned_addr learned my addr 172.21.15.62:0/925640956 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:28.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.840+0000 7fc6fb7fe700 1 --2- 172.21.15.62:0/1429163073 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6f4047c50 0x7fc6f404bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:28.879 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.844+0000 7f4f10e9c700 1 --2- 172.21.15.62:0/925640956 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f04038840 0x7f4f0404de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:28.879 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.844+0000 7f4f11e9e700 1 -- 172.21.15.62:0/925640956 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f04038840 msgr2=0x7f4f0404de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:28.879 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.844+0000 7f3f5cd7a700 1 -- 172.21.15.62:0/4236993188 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f5400dd50 con 0x7f3f50036710 2023-06-09T04:41:28.879 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.844+0000 7f3f5cd7a700 1 -- 172.21.15.62:0/4236993188 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f54004030 con 0x7f3f50036710 2023-06-09T04:41:28.879 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.844+0000 7f3f5cd7a700 1 -- 172.21.15.62:0/4236993188 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f540043c0 con 0x7f3f50036710 2023-06-09T04:41:28.880 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.844+0000 7f414f7fe700 1 -- 172.21.15.62:0/601396461 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4148005d90 con 0x7f41580ca0c0 2023-06-09T04:41:28.880 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.844+0000 7f414f7fe700 1 -- 172.21.15.62:0/601396461 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41480070d0 con 0x7f41580ca0c0 2023-06-09T04:41:28.880 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.844+0000 7f414f7fe700 1 -- 172.21.15.62:0/601396461 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4148007460 con 0x7f41580ca0c0 2023-06-09T04:41:28.880 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.844+0000 7f4f11e9e700 1 --2- 172.21.15.62:0/925640956 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f04038840 0x7f4f0404de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:28.880 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.844+0000 7f4f11e9e700 1 -- 172.21.15.62:0/925640956 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f0400dd20 msgr2=0x7f4f040e50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:28.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.844+0000 7f4f11e9e700 1 --2- 172.21.15.62:0/925640956 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f0400dd20 0x7f4f040e50a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:28.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.844+0000 7f4f11e9e700 1 -- 172.21.15.62:0/925640956 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f080094b0 con 0x7f4f04054900 2023-06-09T04:41:28.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.844+0000 7f4f10e9c700 1 --2- 172.21.15.62:0/925640956 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f04038840 0x7f4f0404de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:41:28.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.844+0000 7fc6fb7fe700 1 -- 172.21.15.62:0/1429163073 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6f4053aa0 msgr2=0x7fc6f417cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:28.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.844+0000 7fc6fb7fe700 1 --2- 172.21.15.62:0/1429163073 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6f4053aa0 0x7fc6f417cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:28.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.844+0000 7fc6fb7fe700 1 -- 172.21.15.62:0/1429163073 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6f40e6f20 msgr2=0x7fc6f4049df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:28.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.844+0000 7f4f11e9e700 1 --2- 172.21.15.62:0/925640956 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4f04054900 0x7f4f0404e340 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4efc00c3a0 tx=0x7f4efc00c6b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:28.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.844+0000 7fc6fb7fe700 1 --2- 172.21.15.62:0/1429163073 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6f40e6f20 0x7fc6f4049df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:28.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.844+0000 7fc6fb7fe700 1 -- 172.21.15.62:0/1429163073 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6f00094b0 con 0x7fc6f4047c50 2023-06-09T04:41:28.883 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.844+0000 7f4f01ffb700 1 -- 172.21.15.62:0/925640956 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4efc0052d0 con 0x7f4f04054900 2023-06-09T04:41:28.883 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.844+0000 7f4f01ffb700 1 -- 172.21.15.62:0/925640956 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4efc005430 con 0x7f4f04054900 2023-06-09T04:41:28.883 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.844+0000 7f4f01ffb700 1 -- 172.21.15.62:0/925640956 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4efc0055a0 con 0x7f4f04054900 2023-06-09T04:41:28.883 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.844+0000 7f3f5ffe0700 1 -- 172.21.15.62:0/4236993188 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f50036710 msgr2=0x7f3f50036ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:28.883 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.844+0000 7f3f5ffe0700 1 --2- 172.21.15.62:0/4236993188 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f50036710 0x7f3f50036ae0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3f5400bbb0 tx=0x7f3f5400bec0 comp rx=0 tx=0).stop 2023-06-09T04:41:28.884 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.844+0000 7f3f5ffe0700 1 -- 172.21.15.62:0/4236993188 shutdown_connections 2023-06-09T04:41:28.884 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.844+0000 7f3f5ffe0700 1 --2- 172.21.15.62:0/4236993188 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f50052860 0x7f3f5004fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:28.884 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.844+0000 7f3f5ffe0700 1 --2- 172.21.15.62:0/4236993188 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f50036710 0x7f3f50036ae0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:28.884 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.844+0000 7f3f5ffe0700 1 -- 172.21.15.62:0/4236993188 >> 172.21.15.62:0/4236993188 conn(0x7f3f50051710 msgr2=0x7f3f50051ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:28.884 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.844+0000 7f415759e700 1 -- 172.21.15.62:0/601396461 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4158146a20 con 0x7f41580ca0c0 2023-06-09T04:41:28.885 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.844+0000 7f415759e700 1 -- 172.21.15.62:0/601396461 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41581585b0 con 0x7f41580ca0c0 2023-06-09T04:41:28.885 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.844+0000 7f415759e700 1 -- 172.21.15.62:0/601396461 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4158146c10 con 0x7f41580ca0c0 2023-06-09T04:41:28.885 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.844+0000 7f3f5ffe0700 1 -- 172.21.15.62:0/4236993188 shutdown_connections 2023-06-09T04:41:28.885 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.844+0000 7f3f5ffe0700 1 -- 172.21.15.62:0/4236993188 wait complete. 2023-06-09T04:41:28.886 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.844+0000 7fc6fb7fe700 1 --2- 172.21.15.62:0/1429163073 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6f4047c50 0x7fc6f404bd60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc6e8000f60 tx=0x7fc6e800c6e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:28.886 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.844+0000 7fc6e7fff700 1 -- 172.21.15.62:0/1429163073 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e8005d90 con 0x7fc6f4047c50 2023-06-09T04:41:28.886 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.844+0000 7fc6e7fff700 1 -- 172.21.15.62:0/1429163073 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6e800ce90 con 0x7fc6f4047c50 2023-06-09T04:41:28.886 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.844+0000 7fc6e7fff700 1 -- 172.21.15.62:0/1429163073 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e80072d0 con 0x7fc6f4047c50 2023-06-09T04:41:28.886 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.844+0000 7fc700d3e700 1 -- 172.21.15.62:0/1429163073 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6f404c6b0 con 0x7fc6f4047c50 2023-06-09T04:41:28.886 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.844+0000 7fc700d3e700 1 -- 172.21.15.62:0/1429163073 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6f404cc70 con 0x7fc6f4047c50 2023-06-09T04:41:28.887 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.848+0000 7f3f5ffe0700 1 Processor -- start 2023-06-09T04:41:28.887 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.848+0000 7f3f5ffe0700 1 -- start start 2023-06-09T04:41:28.887 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.848+0000 7f414f7fe700 1 -- 172.21.15.62:0/601396461 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f41480075c0 con 0x7f41580ca0c0 2023-06-09T04:41:28.888 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.848+0000 7f3f5ffe0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f50007240 0x7f3f5004e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:28.888 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.848+0000 7f3f5ffe0700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f50036710 0x7f3f5004cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:28.888 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.848+0000 7f3f5ffe0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f50052860 0x7f3f5004d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:28.888 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.848+0000 7f3f5ffe0700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5004c060 con 0x7f3f50052860 2023-06-09T04:41:28.888 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.848+0000 7f3f5ffe0700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5004d7f0 con 0x7f3f50036710 2023-06-09T04:41:28.888 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.848+0000 7f3f5ffe0700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f50048860 con 0x7f3f50007240 2023-06-09T04:41:28.889 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.848+0000 7f414f7fe700 1 --2- 172.21.15.62:0/601396461 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f41380662f0 0x7f41380687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:28.889 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.852+0000 7f414f7fe700 1 -- 172.21.15.62:0/601396461 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f41480839e0 con 0x7f41580ca0c0 2023-06-09T04:41:28.889 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.852+0000 7f3f5d57b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f50036710 0x7f3f5004cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:28.890 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.852+0000 7f3f5d57b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f50036710 0x7f3f5004cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.62:44390/0 (socket says 172.21.15.62:44390) 2023-06-09T04:41:28.890 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.852+0000 7f3f5d57b700 1 -- 172.21.15.62:0/2816924931 learned_addr learned my addr 172.21.15.62:0/2816924931 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:28.890 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.852+0000 7f414dd9b700 1 --2- 172.21.15.62:0/601396461 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f41380662f0 0x7f41380687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:28.890 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.852+0000 7f3f5dd7c700 1 --2- 172.21.15.62:0/2816924931 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f50007240 0x7f3f5004e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:28.891 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.852+0000 7f3f5e57d700 1 --2- 172.21.15.62:0/2816924931 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f50052860 0x7f3f5004d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:28.891 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.852+0000 7fa96bfff700 1 -- 172.21.15.62:0/345760227 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa980066bd0 con 0x7fa9780e3d40 2023-06-09T04:41:28.891 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.852+0000 7fa96bfff700 1 -- 172.21.15.62:0/345760227 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa980067640 con 0x7fa9780e3d40 2023-06-09T04:41:28.891 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.852+0000 7fa96bfff700 1 -- 172.21.15.62:0/345760227 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9800679f0 con 0x7fa9780e3d40 2023-06-09T04:41:28.891 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.852+0000 7fa985cee700 1 -- 172.21.15.62:0/345760227 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9780d2300 con 0x7fa9780e3d40 2023-06-09T04:41:28.892 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.852+0000 7fa985cee700 1 -- 172.21.15.62:0/345760227 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9780d2550 con 0x7fa9780e3d40 2023-06-09T04:41:28.892 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.852+0000 7f3f5d57b700 1 -- 172.21.15.62:0/2816924931 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f50007240 msgr2=0x7f3f5004e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:28.892 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.852+0000 7f3f5d57b700 1 --2- 172.21.15.62:0/2816924931 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f50007240 0x7f3f5004e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:28.892 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.852+0000 7f3f5d57b700 1 -- 172.21.15.62:0/2816924931 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f50052860 msgr2=0x7f3f5004d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:28.892 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.852+0000 7f3f5d57b700 1 --2- 172.21.15.62:0/2816924931 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f50052860 0x7f3f5004d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:28.892 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.852+0000 7f3f5d57b700 1 -- 172.21.15.62:0/2816924931 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f5400b810 con 0x7f3f50036710 2023-06-09T04:41:28.893 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.852+0000 7f414dd9b700 1 --2- 172.21.15.62:0/601396461 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f41380662f0 0x7f41380687a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f41580c8190 tx=0x7f4140009110 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:28.893 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.852+0000 7fc6e7fff700 1 -- 172.21.15.62:0/1429163073 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc6e8007430 con 0x7fc6f4047c50 2023-06-09T04:41:28.893 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.852+0000 7fc700d3e700 1 -- 172.21.15.62:0/1429163073 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6f4005460 con 0x7fc6f4047c50 2023-06-09T04:41:28.893 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.852+0000 7f3f5d57b700 1 --2- 172.21.15.62:0/2816924931 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f50036710 0x7f3f5004cc80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3f4800b480 tx=0x7f3f4800b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:28.894 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.852+0000 7fc6e7fff700 1 --2- 172.21.15.62:0/1429163073 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fc6e0066340 0x7fc6e00687f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:28.894 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.852+0000 7fc6e7fff700 1 -- 172.21.15.62:0/1429163073 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc6e8083060 con 0x7fc6f4047c50 2023-06-09T04:41:28.894 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.852+0000 7f4f13901700 1 -- 172.21.15.62:0/925640956 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f0403a7e0 con 0x7f4f04054900 2023-06-09T04:41:28.895 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.852+0000 7fa985cee700 1 -- 172.21.15.62:0/345760227 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa960005310 con 0x7fa9780e3d40 2023-06-09T04:41:28.895 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.852+0000 7f4f13901700 1 -- 172.21.15.62:0/925640956 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f0403ada0 con 0x7f4f04054900 2023-06-09T04:41:28.895 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.852+0000 7fc6faffd700 1 --2- 172.21.15.62:0/1429163073 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fc6e0066340 0x7fc6e00687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:28.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.856+0000 7f414f7fe700 1 -- 172.21.15.62:0/601396461 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4148050d00 con 0x7f41580ca0c0 2023-06-09T04:41:28.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.856+0000 7fc6faffd700 1 --2- 172.21.15.62:0/1429163073 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fc6e0066340 0x7fc6e00687f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc6f00097a0 tx=0x7fc6f001c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:28.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.856+0000 7f4f13901700 1 -- 172.21.15.62:0/925640956 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f04005770 con 0x7f4f04054900 2023-06-09T04:41:28.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.856+0000 7f4f01ffb700 1 -- 172.21.15.62:0/925640956 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4efc006a80 con 0x7f4f04054900 2023-06-09T04:41:28.897 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.856+0000 7fa96bfff700 1 -- 172.21.15.62:0/345760227 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa980067b50 con 0x7fa9780e3d40 2023-06-09T04:41:28.897 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.856+0000 7fa96bfff700 1 --2- 172.21.15.62:0/345760227 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fa964066340 0x7fa9640687f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:28.897 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.856+0000 7fa96bfff700 1 -- 172.21.15.62:0/345760227 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa9800fce50 con 0x7fa9780e3d40 2023-06-09T04:41:28.897 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.856+0000 7f4f01ffb700 1 --2- 172.21.15.62:0/925640956 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f4ef00662f0 0x7f4ef00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:28.898 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.856+0000 7f4f01ffb700 1 -- 172.21.15.62:0/925640956 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4efc0831d0 con 0x7f4f04054900 2023-06-09T04:41:28.898 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.860+0000 7f4f1169d700 1 --2- 172.21.15.62:0/925640956 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f4ef00662f0 0x7f4ef00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:28.898 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.860+0000 7fa97f7fe700 1 --2- 172.21.15.62:0/345760227 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fa964066340 0x7fa9640687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:28.898 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.860+0000 7fa97f7fe700 1 --2- 172.21.15.62:0/345760227 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fa964066340 0x7fa9640687f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa96c009150 tx=0x7fa96c008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:28.899 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.860+0000 7f4f1169d700 1 --2- 172.21.15.62:0/925640956 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f4ef00662f0 0x7f4ef00687a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c0633f0 tx=0x7f4f0c08b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:28.899 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.864+0000 7fa96bfff700 1 -- 172.21.15.62:0/345760227 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa9800ca0c0 con 0x7fa9780e3d40 2023-06-09T04:41:28.899 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.864+0000 7f3f4e7fc700 1 -- 172.21.15.62:0/2816924931 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f48010970 con 0x7f3f50036710 2023-06-09T04:41:28.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.864+0000 7f3f4e7fc700 1 -- 172.21.15.62:0/2816924931 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f4800be90 con 0x7f3f50036710 2023-06-09T04:41:28.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.864+0000 7f3f4e7fc700 1 -- 172.21.15.62:0/2816924931 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f48010d10 con 0x7f3f50036710 2023-06-09T04:41:28.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.864+0000 7f3f5ffe0700 1 -- 172.21.15.62:0/2816924931 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f50048b40 con 0x7f3f50036710 2023-06-09T04:41:28.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.864+0000 7f3f5ffe0700 1 -- 172.21.15.62:0/2816924931 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f50049100 con 0x7f3f50036710 2023-06-09T04:41:28.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.864+0000 7fc6e7fff700 1 -- 172.21.15.62:0/1429163073 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc6e80b3700 con 0x7fc6f4047c50 2023-06-09T04:41:28.901 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.864+0000 7f3f5ffe0700 1 -- 172.21.15.62:0/2816924931 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f50049320 con 0x7f3f50036710 2023-06-09T04:41:28.901 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.868+0000 7f3f4e7fc700 1 -- 172.21.15.62:0/2816924931 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3f480213b0 con 0x7f3f50036710 2023-06-09T04:41:28.901 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.868+0000 7f3f4e7fc700 1 --2- 172.21.15.62:0/2816924931 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f3f3c0663c0 0x7f3f3c068870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:28.901 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.868+0000 7f3f4e7fc700 1 -- 172.21.15.62:0/2816924931 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3f48087800 con 0x7f3f50036710 2023-06-09T04:41:28.901 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.864+0000 7f4f01ffb700 1 -- 172.21.15.62:0/925640956 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4efc0502c0 con 0x7f4f04054900 2023-06-09T04:41:28.902 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.868+0000 7f3f5dd7c700 1 --2- 172.21.15.62:0/2816924931 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f3f3c0663c0 0x7f3f3c068870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:28.902 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.872+0000 7f3f5dd7c700 1 --2- 172.21.15.62:0/2816924931 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f3f3c0663c0 0x7f3f3c068870 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3f54000c00 tx=0x7f3f54008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:28.902 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:28.872+0000 7f3f4e7fc700 1 -- 172.21.15.62:0/2816924931 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3f48054a00 con 0x7f3f50036710 2023-06-09T04:41:29.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.108+0000 7fe388400700 1 -- 172.21.15.62:0/1530554869 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fe3680055c0 con 0x7fe3800ca3b0 2023-06-09T04:41:29.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.112+0000 7fe376ffd700 1 -- 172.21.15.62:0/1530554869 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe37001e070 con 0x7fe3800ca3b0 2023-06-09T04:41:29.115 INFO:teuthology.orchestra.run.smithi062.stdout:55834574857 2023-06-09T04:41:29.118 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.112+0000 7fe374ff9700 1 -- 172.21.15.62:0/1530554869 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fe36c068a30 msgr2=0x7fe36c06aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:29.118 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.112+0000 7fe374ff9700 1 --2- 172.21.15.62:0/1530554869 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fe36c068a30 0x7fe36c06aee0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe37c007fd0 tx=0x7fe37c007de0 comp rx=0 tx=0).stop 2023-06-09T04:41:29.118 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.112+0000 7fe374ff9700 1 -- 172.21.15.62:0/1530554869 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3800ca3b0 msgr2=0x7fe380146850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:29.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.112+0000 7fe374ff9700 1 --2- 172.21.15.62:0/1530554869 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3800ca3b0 0x7fe380146850 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe37000c7c0 tx=0x7fe37000cad0 comp rx=0 tx=0).stop 2023-06-09T04:41:29.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.112+0000 7fe374ff9700 1 -- 172.21.15.62:0/1530554869 shutdown_connections 2023-06-09T04:41:29.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.112+0000 7fe374ff9700 1 --2- 172.21.15.62:0/1530554869 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fe36c068a30 0x7fe36c06aee0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:29.120 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.112+0000 7fe374ff9700 1 --2- 172.21.15.62:0/1530554869 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe380140b10 0x7fe3801e1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:29.120 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.112+0000 7fe374ff9700 1 --2- 172.21.15.62:0/1530554869 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3800ca3b0 0x7fe380146850 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:29.120 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.116+0000 7fe374ff9700 1 --2- 172.21.15.62:0/1530554869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe38006f5a0 0x7fe3801ded70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:29.120 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.116+0000 7fe374ff9700 1 -- 172.21.15.62:0/1530554869 >> 172.21.15.62:0/1530554869 conn(0x7fe3800b0860 msgr2=0x7fe3800b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:29.120 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.116+0000 7fe374ff9700 1 -- 172.21.15.62:0/1530554869 shutdown_connections 2023-06-09T04:41:29.120 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.116+0000 7fe374ff9700 1 -- 172.21.15.62:0/1530554869 wait complete. 2023-06-09T04:41:29.144 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.2 2023-06-09T04:41:29.164 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.160+0000 7f415759e700 1 -- 172.21.15.62:0/601396461 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f4158146c10 con 0x7f41580ca0c0 2023-06-09T04:41:29.164 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.160+0000 7f414f7fe700 1 -- 172.21.15.62:0/601396461 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4158146c10 con 0x7f41580ca0c0 2023-06-09T04:41:29.164 INFO:teuthology.orchestra.run.smithi062.stdout:55834574857 2023-06-09T04:41:29.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.160+0000 7f415759e700 1 -- 172.21.15.62:0/601396461 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f41380662f0 msgr2=0x7f41380687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:29.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.160+0000 7f415759e700 1 --2- 172.21.15.62:0/601396461 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f41380662f0 0x7f41380687a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f41580c8190 tx=0x7f4140009110 comp rx=0 tx=0).stop 2023-06-09T04:41:29.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.160+0000 7f415759e700 1 -- 172.21.15.62:0/601396461 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41580ca0c0 msgr2=0x7f41580cc2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:29.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.160+0000 7f415759e700 1 --2- 172.21.15.62:0/601396461 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41580ca0c0 0x7f41580cc2a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f414800c700 tx=0x7f414800ca10 comp rx=0 tx=0).stop 2023-06-09T04:41:29.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.160+0000 7f415759e700 1 -- 172.21.15.62:0/601396461 shutdown_connections 2023-06-09T04:41:29.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.160+0000 7f415759e700 1 --2- 172.21.15.62:0/601396461 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f41380662f0 0x7f41380687a0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:29.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.160+0000 7f415759e700 1 --2- 172.21.15.62:0/601396461 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4158145c80 0x7f4158146100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:29.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.160+0000 7f415759e700 1 --2- 172.21.15.62:0/601396461 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f41580cb150 0x7f4158155f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:29.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.160+0000 7f415759e700 1 --2- 172.21.15.62:0/601396461 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f41580ca0c0 0x7f41580cc2a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:29.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.160+0000 7f415759e700 1 -- 172.21.15.62:0/601396461 >> 172.21.15.62:0/601396461 conn(0x7f4158070c90 msgr2=0x7f4158157350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:29.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.164+0000 7f415759e700 1 -- 172.21.15.62:0/601396461 shutdown_connections 2023-06-09T04:41:29.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.164+0000 7f415759e700 1 -- 172.21.15.62:0/601396461 wait complete. 2023-06-09T04:41:29.178 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.172+0000 7f2f919e3700 1 -- 172.21.15.62:0/2202954369 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2f8c06d070 con 0x7f2f8c1503e0 2023-06-09T04:41:29.179 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.176+0000 7f2f897fa700 1 -- 172.21.15.62:0/2202954369 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2f84052c30 con 0x7f2f8c1503e0 2023-06-09T04:41:29.179 INFO:teuthology.orchestra.run.smithi062.stdout:55834574859 2023-06-09T04:41:29.182 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.176+0000 7f2f919e3700 1 -- 172.21.15.62:0/2202954369 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f2f780663c0 msgr2=0x7f2f78068870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:29.182 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.176+0000 7f7678df6700 1 -- 172.21.15.62:0/2930376717 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f76740c5fb0 con 0x7f76740cbc00 2023-06-09T04:41:29.183 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.176+0000 7f2f919e3700 1 --2- 172.21.15.62:0/2202954369 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f2f780663c0 0x7f2f78068870 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c007bb0 tx=0x7f2f7c00c040 comp rx=0 tx=0).stop 2023-06-09T04:41:29.183 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.176+0000 7f2f919e3700 1 -- 172.21.15.62:0/2202954369 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f8c1503e0 msgr2=0x7f2f8c1f95e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:29.183 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.176+0000 7f2f919e3700 1 --2- 172.21.15.62:0/2202954369 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f8c1503e0 0x7f2f8c1f95e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2f8400a8c0 tx=0x7f2f84001cb0 comp rx=0 tx=0).stop 2023-06-09T04:41:29.184 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.180+0000 7f2f919e3700 1 -- 172.21.15.62:0/2202954369 shutdown_connections 2023-06-09T04:41:29.184 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.180+0000 7f2f919e3700 1 --2- 172.21.15.62:0/2202954369 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f2f780663c0 0x7f2f78068870 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:29.184 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.180+0000 7f2f919e3700 1 --2- 172.21.15.62:0/2202954369 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2f8c06c440 0x7f2f8c06c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:29.184 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.180+0000 7f765bfff700 1 -- 172.21.15.62:0/2930376717 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f76740c5fb0 con 0x7f76740cbc00 2023-06-09T04:41:29.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.180+0000 7f2f919e3700 1 --2- 172.21.15.62:0/2202954369 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2f8c1503e0 0x7f2f8c1f95e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:29.185 INFO:teuthology.orchestra.run.smithi062.stdout:55834574859 2023-06-09T04:41:29.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.180+0000 7f2f919e3700 1 --2- 172.21.15.62:0/2202954369 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f8c150010 0x7f2f8c0c43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:29.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.180+0000 7f2f919e3700 1 -- 172.21.15.62:0/2202954369 >> 172.21.15.62:0/2202954369 conn(0x7f2f8c0b0860 msgr2=0x7f2f8c0b0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:29.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.180+0000 7f2f919e3700 1 -- 172.21.15.62:0/2202954369 shutdown_connections 2023-06-09T04:41:29.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.180+0000 7f2f919e3700 1 -- 172.21.15.62:0/2202954369 wait complete. 2023-06-09T04:41:29.187 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.1 2023-06-09T04:41:29.187 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.184+0000 7f7678df6700 1 -- 172.21.15.62:0/2930376717 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f76600662f0 msgr2=0x7f76600687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:29.188 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.184+0000 7f7678df6700 1 --2- 172.21.15.62:0/2930376717 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f76600662f0 0x7f76600687a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f766c000f80 tx=0x7f766c009000 comp rx=0 tx=0).stop 2023-06-09T04:41:29.188 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.184+0000 7f7678df6700 1 -- 172.21.15.62:0/2930376717 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76740cbc00 msgr2=0x7f76740c4530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:29.188 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.184+0000 7f7678df6700 1 --2- 172.21.15.62:0/2930376717 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76740cbc00 0x7f76740c4530 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f766800b520 tx=0x7f766800b830 comp rx=0 tx=0).stop 2023-06-09T04:41:29.188 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.184+0000 7f7678df6700 1 -- 172.21.15.62:0/2930376717 shutdown_connections 2023-06-09T04:41:29.189 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.184+0000 7f7678df6700 1 --2- 172.21.15.62:0/2930376717 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f76600662f0 0x7f76600687a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:29.189 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.184+0000 7f7678df6700 1 --2- 172.21.15.62:0/2930376717 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76740ce740 0x7f76740c6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:29.189 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.184+0000 7f7678df6700 1 --2- 172.21.15.62:0/2930376717 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76740cbc00 0x7f76740c4530 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:29.189 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.184+0000 7f7678df6700 1 --2- 172.21.15.62:0/2930376717 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f767406fcb0 0x7f7674147b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:29.189 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.184+0000 7f7678df6700 1 -- 172.21.15.62:0/2930376717 >> 172.21.15.62:0/2930376717 conn(0x7f76740b0860 msgr2=0x7f767406d170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:29.189 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.184+0000 7f7678df6700 1 -- 172.21.15.62:0/2930376717 shutdown_connections 2023-06-09T04:41:29.189 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.184+0000 7f7678df6700 1 -- 172.21.15.62:0/2930376717 wait complete. 2023-06-09T04:41:29.197 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.192+0000 7fa985cee700 1 -- 172.21.15.62:0/345760227 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa960005890 con 0x7fa9780e3d40 2023-06-09T04:41:29.198 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.192+0000 7fa96bfff700 1 -- 172.21.15.62:0/345760227 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa9800d0020 con 0x7fa9780e3d40 2023-06-09T04:41:29.198 INFO:teuthology.orchestra.run.smithi062.stdout:55834574858 2023-06-09T04:41:29.198 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.192+0000 7f3f5ffe0700 1 -- 172.21.15.62:0/2816924931 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f3f50005460 con 0x7f3f50036710 2023-06-09T04:41:29.199 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.196+0000 7f3f4e7fc700 1 -- 172.21.15.62:0/2816924931 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3f48058020 con 0x7f3f50036710 2023-06-09T04:41:29.199 INFO:teuthology.orchestra.run.smithi062.stdout:55834574858 2023-06-09T04:41:29.200 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.196+0000 7fc700d3e700 1 -- 172.21.15.62:0/1429163073 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fc6f404f9f0 con 0x7fc6f4047c50 2023-06-09T04:41:29.201 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.196+0000 7fa985cee700 1 -- 172.21.15.62:0/345760227 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fa964066340 msgr2=0x7fa9640687f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:29.201 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.196+0000 7fa985cee700 1 --2- 172.21.15.62:0/345760227 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fa964066340 0x7fa9640687f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa96c009150 tx=0x7fa96c008030 comp rx=0 tx=0).stop 2023-06-09T04:41:29.201 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.196+0000 7fa985cee700 1 -- 172.21.15.62:0/345760227 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa9780e3d40 msgr2=0x7fa97804acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:29.201 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.196+0000 7fa985cee700 1 --2- 172.21.15.62:0/345760227 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa9780e3d40 0x7fa97804acd0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa9800685c0 tx=0x7fa98006cc70 comp rx=0 tx=0).stop 2023-06-09T04:41:29.202 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.196+0000 7fa985cee700 1 -- 172.21.15.62:0/345760227 shutdown_connections 2023-06-09T04:41:29.202 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.196+0000 7fa985cee700 1 --2- 172.21.15.62:0/345760227 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fa964066340 0x7fa9640687f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:29.202 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.196+0000 7fa985cee700 1 --2- 172.21.15.62:0/345760227 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa9780e3d40 0x7fa97804acd0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:29.202 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.196+0000 7fa985cee700 1 --2- 172.21.15.62:0/345760227 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa978037ae0 0x7fa97804a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:29.202 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.196+0000 7fa985cee700 1 --2- 172.21.15.62:0/345760227 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa978036e20 0x7fa97804ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:29.202 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.196+0000 7fa985cee700 1 -- 172.21.15.62:0/345760227 >> 172.21.15.62:0/345760227 conn(0x7fa978051710 msgr2=0x7fa978039ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:29.203 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.196+0000 7fc6e7fff700 1 -- 172.21.15.62:0/1429163073 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc6f404f9f0 con 0x7fc6f4047c50 2023-06-09T04:41:29.203 INFO:teuthology.orchestra.run.smithi062.stdout:55834574858 2023-06-09T04:41:29.204 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.196+0000 7fa985cee700 1 -- 172.21.15.62:0/345760227 shutdown_connections 2023-06-09T04:41:29.204 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.196+0000 7fa985cee700 1 -- 172.21.15.62:0/345760227 wait complete. 2023-06-09T04:41:29.204 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.196+0000 7f3f5ffe0700 1 -- 172.21.15.62:0/2816924931 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f3f3c0663c0 msgr2=0x7f3f3c068870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:29.205 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.196+0000 7f3f5ffe0700 1 --2- 172.21.15.62:0/2816924931 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f3f3c0663c0 0x7f3f3c068870 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3f54000c00 tx=0x7f3f54008040 comp rx=0 tx=0).stop 2023-06-09T04:41:29.205 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.196+0000 7f3f5ffe0700 1 -- 172.21.15.62:0/2816924931 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f50036710 msgr2=0x7f3f5004cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:29.205 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.196+0000 7f3f5ffe0700 1 --2- 172.21.15.62:0/2816924931 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f50036710 0x7f3f5004cc80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3f4800b480 tx=0x7f3f4800b790 comp rx=0 tx=0).stop 2023-06-09T04:41:29.205 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.196+0000 7f3f5ffe0700 1 -- 172.21.15.62:0/2816924931 shutdown_connections 2023-06-09T04:41:29.205 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.196+0000 7f3f5ffe0700 1 --2- 172.21.15.62:0/2816924931 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f3f3c0663c0 0x7f3f3c068870 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:29.205 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.196+0000 7f3f5ffe0700 1 --2- 172.21.15.62:0/2816924931 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f50052860 0x7f3f5004d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:29.206 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.196+0000 7f3f5ffe0700 1 --2- 172.21.15.62:0/2816924931 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f50036710 0x7f3f5004cc80 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:29.206 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.196+0000 7f3f5ffe0700 1 --2- 172.21.15.62:0/2816924931 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3f50007240 0x7f3f5004e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:29.206 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.196+0000 7f3f5ffe0700 1 -- 172.21.15.62:0/2816924931 >> 172.21.15.62:0/2816924931 conn(0x7f3f50051710 msgr2=0x7f3f500de020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:29.206 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.196+0000 7f3f5ffe0700 1 -- 172.21.15.62:0/2816924931 shutdown_connections 2023-06-09T04:41:29.206 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.200+0000 7f3f5ffe0700 1 -- 172.21.15.62:0/2816924931 wait complete. 2023-06-09T04:41:29.206 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.200+0000 7f4f13901700 1 -- 172.21.15.62:0/925640956 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f4f0404dbc0 con 0x7f4f04054900 2023-06-09T04:41:29.207 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.200+0000 7fc700d3e700 1 -- 172.21.15.62:0/1429163073 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fc6e0066340 msgr2=0x7fc6e00687f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:29.207 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.200+0000 7fc700d3e700 1 --2- 172.21.15.62:0/1429163073 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fc6e0066340 0x7fc6e00687f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc6f00097a0 tx=0x7fc6f001c040 comp rx=0 tx=0).stop 2023-06-09T04:41:29.207 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.200+0000 7fc700d3e700 1 -- 172.21.15.62:0/1429163073 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6f4047c50 msgr2=0x7fc6f404bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:29.208 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.200+0000 7fc700d3e700 1 --2- 172.21.15.62:0/1429163073 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6f4047c50 0x7fc6f404bd60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc6e8000f60 tx=0x7fc6e800c6e0 comp rx=0 tx=0).stop 2023-06-09T04:41:29.208 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.200+0000 7fc700d3e700 1 -- 172.21.15.62:0/1429163073 shutdown_connections 2023-06-09T04:41:29.208 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.200+0000 7fc700d3e700 1 --2- 172.21.15.62:0/1429163073 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fc6e0066340 0x7fc6e00687f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:29.208 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.200+0000 7fc700d3e700 1 --2- 172.21.15.62:0/1429163073 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6f40e6f20 0x7fc6f4049df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:29.208 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.200+0000 7fc700d3e700 1 --2- 172.21.15.62:0/1429163073 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc6f4053aa0 0x7fc6f417cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:29.208 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.200+0000 7fc700d3e700 1 --2- 172.21.15.62:0/1429163073 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc6f4047c50 0x7fc6f404bd60 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:29.208 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.200+0000 7fc700d3e700 1 -- 172.21.15.62:0/1429163073 >> 172.21.15.62:0/1429163073 conn(0x7fc6f4051710 msgr2=0x7fc6f4037da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:29.209 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.200+0000 7fc700d3e700 1 -- 172.21.15.62:0/1429163073 shutdown_connections 2023-06-09T04:41:29.209 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.200+0000 7fc700d3e700 1 -- 172.21.15.62:0/1429163073 wait complete. 2023-06-09T04:41:29.209 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.200+0000 7f4f01ffb700 1 -- 172.21.15.62:0/925640956 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4efc0538e0 con 0x7f4f04054900 2023-06-09T04:41:29.209 INFO:teuthology.orchestra.run.smithi062.stdout:55834574857 2023-06-09T04:41:29.210 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574859 for osd.0 2023-06-09T04:41:29.211 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574859 for osd.4 2023-06-09T04:41:29.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.204+0000 7f4f13901700 1 -- 172.21.15.62:0/925640956 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f4ef00662f0 msgr2=0x7f4ef00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:29.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.204+0000 7f4f13901700 1 --2- 172.21.15.62:0/925640956 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f4ef00662f0 0x7f4ef00687a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c0633f0 tx=0x7f4f0c08b040 comp rx=0 tx=0).stop 2023-06-09T04:41:29.212 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.204+0000 7f4f13901700 1 -- 172.21.15.62:0/925640956 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4f04054900 msgr2=0x7f4f0404e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:29.212 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.204+0000 7f4f13901700 1 --2- 172.21.15.62:0/925640956 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4f04054900 0x7f4f0404e340 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4efc00c3a0 tx=0x7f4efc00c6b0 comp rx=0 tx=0).stop 2023-06-09T04:41:29.212 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.204+0000 7f4f13901700 1 -- 172.21.15.62:0/925640956 shutdown_connections 2023-06-09T04:41:29.212 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.204+0000 7f4f13901700 1 --2- 172.21.15.62:0/925640956 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f4ef00662f0 0x7f4ef00687a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:29.212 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.204+0000 7f4f13901700 1 --2- 172.21.15.62:0/925640956 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4f04054900 0x7f4f0404e340 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:29.212 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.204+0000 7f4f13901700 1 --2- 172.21.15.62:0/925640956 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f04038840 0x7f4f0404de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:29.212 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.204+0000 7f4f13901700 1 --2- 172.21.15.62:0/925640956 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4f0400dd20 0x7f4f040e50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:29.213 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.204+0000 7f4f13901700 1 -- 172.21.15.62:0/925640956 >> 172.21.15.62:0/925640956 conn(0x7f4f0400cf50 msgr2=0x7f4f04036600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:29.213 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.204+0000 7f4f13901700 1 -- 172.21.15.62:0/925640956 shutdown_connections 2023-06-09T04:41:29.213 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:29.204+0000 7f4f13901700 1 -- 172.21.15.62:0/925640956 wait complete. 2023-06-09T04:41:29.222 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.3 2023-06-09T04:41:29.223 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.5 2023-06-09T04:41:29.233 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.7 2023-06-09T04:41:29.234 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.6 2023-06-09T04:41:30.145 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-06-09T04:41:30.188 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-06-09T04:41:30.211 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-06-09T04:41:30.212 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-06-09T04:41:30.223 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-06-09T04:41:30.224 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-06-09T04:41:30.234 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-06-09T04:41:30.234 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-06-09T04:41:30.346 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.339+0000 7f9a10581700 1 Processor -- start 2023-06-09T04:41:30.349 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.339+0000 7f9a10581700 1 -- start start 2023-06-09T04:41:30.350 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.343+0000 7f9a10581700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9a080ca3b0 0x7f9a080cbc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:30.350 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.343+0000 7f9a10581700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9a080cc140 0x7f9a0806f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:30.350 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.343+0000 7f9a10581700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a0806ff40 con 0x7f9a0806fae0 2023-06-09T04:41:30.350 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.343+0000 7f9a10581700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a08158120 con 0x7f9a080cc140 2023-06-09T04:41:30.350 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.343+0000 7f9a10581700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a080cc6c0 con 0x7f9a080ca3b0 2023-06-09T04:41:30.350 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.343+0000 7f9a0db1c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9a080cc140 0x7f9a0806f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:30.350 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.343+0000 7f9a0db1c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9a080cc140 0x7f9a0806f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40656/0 (socket says 172.21.15.62:40656) 2023-06-09T04:41:30.351 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.343+0000 7f9a0db1c700 1 -- 172.21.15.62:0/1265807274 learned_addr learned my addr 172.21.15.62:0/1265807274 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:30.351 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.343+0000 7f9a0e31d700 1 --2- 172.21.15.62:0/1265807274 >> v2:172.21.15.89:3300/0 conn(0x7f9a080ca3b0 0x7f9a080cbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:30.351 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.343+0000 7f9a0db1c700 1 -- 172.21.15.62:0/1265807274 >> v2:172.21.15.89:3300/0 conn(0x7f9a080ca3b0 msgr2=0x7f9a080cbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:30.352 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.343+0000 7f9a0db1c700 1 --2- 172.21.15.62:0/1265807274 >> v2:172.21.15.89:3300/0 conn(0x7f9a080ca3b0 0x7f9a080cbc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.352 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.343+0000 7f9a0db1c700 1 -- 172.21.15.62:0/1265807274 >> v1:172.21.15.62:6789/0 conn(0x7f9a0806fae0 legacy=0x7f9a08140b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:30.352 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.343+0000 7f9a0db1c700 1 -- 172.21.15.62:0/1265807274 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a080cc9a0 con 0x7f9a080cc140 2023-06-09T04:41:30.352 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.343+0000 7f9a0db1c700 1 --2- 172.21.15.62:0/1265807274 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a080cc140 0x7f9a0806f5a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9a00009e50 tx=0x7f9a0000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85664d89e9421a9f server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:30.352 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.347+0000 7f9a0d31b700 1 -- 172.21.15.62:0/1265807274 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a0000e070 con 0x7f9a080cc140 2023-06-09T04:41:30.353 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.347+0000 7f9a0d31b700 1 -- 172.21.15.62:0/1265807274 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a0000b8d0 con 0x7f9a080cc140 2023-06-09T04:41:30.353 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.347+0000 7f9a10581700 1 -- 172.21.15.62:0/1265807274 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a080cc140 msgr2=0x7f9a0806f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:30.353 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.347+0000 7f9a10581700 1 --2- 172.21.15.62:0/1265807274 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a080cc140 0x7f9a0806f5a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9a00009e50 tx=0x7f9a0000b330 comp rx=0 tx=0).stop 2023-06-09T04:41:30.354 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.347+0000 7f9a10581700 1 -- 172.21.15.62:0/1265807274 shutdown_connections 2023-06-09T04:41:30.354 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.347+0000 7f9a10581700 1 --2- 172.21.15.62:0/1265807274 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a080cc140 0x7f9a0806f5a0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.354 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.347+0000 7f9a10581700 1 --2- 172.21.15.62:0/1265807274 >> v2:172.21.15.89:3300/0 conn(0x7f9a080ca3b0 0x7f9a080cbc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.354 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.347+0000 7f9a10581700 1 -- 172.21.15.62:0/1265807274 >> 172.21.15.62:0/1265807274 conn(0x7f9a080b0860 msgr2=0x7f9a080ce030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:30.354 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.347+0000 7f9a10581700 1 -- 172.21.15.62:0/1265807274 shutdown_connections 2023-06-09T04:41:30.356 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.347+0000 7f9a10581700 1 -- 172.21.15.62:0/1265807274 wait complete. 2023-06-09T04:41:30.357 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.351+0000 7f9a10581700 1 Processor -- start 2023-06-09T04:41:30.358 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.351+0000 7f9a10581700 1 -- start start 2023-06-09T04:41:30.359 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.351+0000 7f9a10581700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a0806fae0 0x7f9a08162e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:30.359 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.351+0000 7f9a10581700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a080ca3b0 0x7f9a08141040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:30.359 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.355+0000 7f9a10581700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9a0814f820 0x7f9a0814fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:30.360 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.355+0000 7f9a0e31d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a0806fae0 0x7f9a08162e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:30.360 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.355+0000 7f9a0e31d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a0806fae0 0x7f9a08162e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.62:44398/0 (socket says 172.21.15.62:44398) 2023-06-09T04:41:30.360 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.355+0000 7f9a0e31d700 1 -- 172.21.15.62:0/3856726372 learned_addr learned my addr 172.21.15.62:0/3856726372 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:30.360 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.355+0000 7f9a10581700 1 -- 172.21.15.62:0/3856726372 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a08141580 con 0x7f9a080ca3b0 2023-06-09T04:41:30.360 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.355+0000 7f9a0db1c700 1 --2- 172.21.15.62:0/3856726372 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a080ca3b0 0x7f9a08141040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:30.360 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.355+0000 7f9a10581700 1 -- 172.21.15.62:0/3856726372 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a08161b10 con 0x7f9a0806fae0 2023-06-09T04:41:30.360 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.355+0000 7f9a10581700 1 -- 172.21.15.62:0/3856726372 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a08161db0 con 0x7f9a0814f820 2023-06-09T04:41:30.361 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.355+0000 7f9a0eb1e700 1 --2- 172.21.15.62:0/3856726372 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9a0814f820 0x7f9a0814fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:30.361 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.355+0000 7f9a0db1c700 1 -- 172.21.15.62:0/3856726372 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9a0814f820 msgr2=0x7f9a0814fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:30.361 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.355+0000 7f9a0db1c700 1 --2- 172.21.15.62:0/3856726372 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9a0814f820 0x7f9a0814fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.361 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.355+0000 7f9a0db1c700 1 -- 172.21.15.62:0/3856726372 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a0806fae0 msgr2=0x7f9a08162e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:30.362 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.355+0000 7f9a0db1c700 1 --2- 172.21.15.62:0/3856726372 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a0806fae0 0x7f9a08162e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.362 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.355+0000 7f9a0db1c700 1 -- 172.21.15.62:0/3856726372 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a00009b30 con 0x7f9a080ca3b0 2023-06-09T04:41:30.362 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.355+0000 7f9a0eb1e700 1 --2- 172.21.15.62:0/3856726372 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9a0814f820 0x7f9a0814fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:41:30.362 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.355+0000 7f9a0db1c700 1 --2- 172.21.15.62:0/3856726372 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a080ca3b0 0x7f9a08141040 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9a00015000 tx=0x7f9a00004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:30.363 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.355+0000 7f99feffd700 1 -- 172.21.15.62:0/3856726372 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a000092e0 con 0x7f9a080ca3b0 2023-06-09T04:41:30.363 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.355+0000 7f99feffd700 1 -- 172.21.15.62:0/3856726372 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a000099b0 con 0x7f9a080ca3b0 2023-06-09T04:41:30.363 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.355+0000 7f9a10581700 1 -- 172.21.15.62:0/3856726372 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a08162090 con 0x7f9a080ca3b0 2023-06-09T04:41:30.363 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.355+0000 7f99feffd700 1 -- 172.21.15.62:0/3856726372 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a0001c660 con 0x7f9a080ca3b0 2023-06-09T04:41:30.363 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.355+0000 7f9a10581700 1 -- 172.21.15.62:0/3856726372 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a08162650 con 0x7f9a080ca3b0 2023-06-09T04:41:30.365 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.359+0000 7f99feffd700 1 -- 172.21.15.62:0/3856726372 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9a0000ba10 con 0x7f9a080ca3b0 2023-06-09T04:41:30.367 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.363+0000 7f99feffd700 1 --2- 172.21.15.62:0/3856726372 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f99ec0663f0 0x7f99ec0688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:30.367 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.363+0000 7f99feffd700 1 -- 172.21.15.62:0/3856726372 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9a00085320 con 0x7f9a080ca3b0 2023-06-09T04:41:30.368 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.363+0000 7f9a0e31d700 1 --2- 172.21.15.62:0/3856726372 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f99ec0663f0 0x7f99ec0688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:30.368 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.363+0000 7f9a10581700 1 -- 172.21.15.62:0/3856726372 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a080739c0 con 0x7f9a080ca3b0 2023-06-09T04:41:30.376 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.371+0000 7f9a0e31d700 1 --2- 172.21.15.62:0/3856726372 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f99ec0663f0 0x7f99ec0688a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9a0400a760 tx=0x7f9a0400e040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:30.377 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.371+0000 7f99feffd700 1 -- 172.21.15.62:0/3856726372 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9a00052520 con 0x7f9a080ca3b0 2023-06-09T04:41:30.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.419+0000 7f820e691700 1 Processor -- start 2023-06-09T04:41:30.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.419+0000 7f820e691700 1 -- start start 2023-06-09T04:41:30.430 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.423+0000 7f820e691700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f82080cd4f0 0x7f82080711a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:30.430 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.423+0000 7f820e691700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f820816ca10 0x7f82080cc310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:30.431 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.423+0000 7f820e691700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f820806f5a0 con 0x7f820816c5c0 2023-06-09T04:41:30.432 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.423+0000 7f820e691700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f820806fdb0 con 0x7f82080cd4f0 2023-06-09T04:41:30.432 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.423+0000 7f820e691700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f820806b880 con 0x7f820816ca10 2023-06-09T04:41:30.433 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.423+0000 7f82077fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f820816c5c0 0x7f82080cbc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:45062/0 (socket says 172.21.15.62:45062) 2023-06-09T04:41:30.433 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.423+0000 7f82077fe700 1 -- 172.21.15.62:0/1200297468 learned_addr learned my addr 172.21.15.62:0/1200297468 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:41:30.433 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.423+0000 7f820cc2e700 1 --2- 172.21.15.62:0/1200297468 >> v2:172.21.15.89:3300/0 conn(0x7f820816ca10 0x7f82080cc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:30.434 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.423+0000 7f8207fff700 1 --2- 172.21.15.62:0/1200297468 >> v2:172.21.15.62:3300/0 conn(0x7f82080cd4f0 0x7f82080711a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:30.434 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.423+0000 7f8206ffd700 1 -- 172.21.15.62:0/1200297468 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 174959447 0 0) 0x7f820806f5a0 con 0x7f820816c5c0 2023-06-09T04:41:30.434 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.423+0000 7f8206ffd700 1 -- 172.21.15.62:0/1200297468 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81f00079e0 con 0x7f820816c5c0 2023-06-09T04:41:30.434 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.423+0000 7f8206ffd700 1 -- 172.21.15.62:0/1200297468 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 667468045 0 0) 0x7f81f00079e0 con 0x7f820816c5c0 2023-06-09T04:41:30.435 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.423+0000 7f8206ffd700 1 -- 172.21.15.62:0/1200297468 >> v2:172.21.15.89:3300/0 conn(0x7f820816ca10 msgr2=0x7f82080cc310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:30.435 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.423+0000 7f8206ffd700 1 --2- 172.21.15.62:0/1200297468 >> v2:172.21.15.89:3300/0 conn(0x7f820816ca10 0x7f82080cc310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.435 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.423+0000 7f8206ffd700 1 -- 172.21.15.62:0/1200297468 >> v2:172.21.15.62:3300/0 conn(0x7f82080cd4f0 msgr2=0x7f82080711a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:30.435 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.423+0000 7f8206ffd700 1 --2- 172.21.15.62:0/1200297468 >> v2:172.21.15.62:3300/0 conn(0x7f82080cd4f0 0x7f82080711a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.435 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.423+0000 7f8206ffd700 1 -- 172.21.15.62:0/1200297468 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f820806be00 con 0x7f820816c5c0 2023-06-09T04:41:30.435 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.423+0000 7f8207fff700 1 --2- 172.21.15.62:0/1200297468 >> v2:172.21.15.62:3300/0 conn(0x7f82080cd4f0 0x7f82080711a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:41:30.435 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.423+0000 7f8206ffd700 1 -- 172.21.15.62:0/1200297468 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 540845019 0 0) 0x7f82000019f0 con 0x7f820816c5c0 2023-06-09T04:41:30.437 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.423+0000 7f8206ffd700 1 -- 172.21.15.62:0/1200297468 >> v1:172.21.15.62:6789/0 conn(0x7f820816c5c0 legacy=0x7f82080cbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:30.438 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.423+0000 7f8206ffd700 1 --2- 172.21.15.62:0/1200297468 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81f0007e30 0x7f81f0008240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:30.438 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.423+0000 7f8206ffd700 1 --2- 172.21.15.62:0/1200297468 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81f0008860 0x7f81f0008d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:30.438 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.423+0000 7f8206ffd700 1 --2- 172.21.15.62:0/1200297468 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81f0009260 0x7f81f0009700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:30.438 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.423+0000 7f8206ffd700 1 -- 172.21.15.62:0/1200297468 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f820806fdb0 con 0x7f81f0009260 2023-06-09T04:41:30.438 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.423+0000 7f8206ffd700 1 -- 172.21.15.62:0/1200297468 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f820806b880 con 0x7f81f0007e30 2023-06-09T04:41:30.438 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.423+0000 7f8206ffd700 1 -- 172.21.15.62:0/1200297468 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81f001cff0 con 0x7f81f0008860 2023-06-09T04:41:30.438 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.427+0000 7f820cc2e700 1 --2- 172.21.15.62:0/1200297468 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81f0009260 0x7f81f0009700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:30.438 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.427+0000 7f8207fff700 1 --2- 172.21.15.62:0/1200297468 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81f0007e30 0x7f81f0008240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:30.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.427+0000 7f82077fe700 1 --2- 172.21.15.62:0/1200297468 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81f0008860 0x7f81f0008d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:30.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.427+0000 7f820cc2e700 1 -- 172.21.15.62:0/1200297468 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81f0008860 msgr2=0x7f81f0008d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:30.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.427+0000 7f820cc2e700 1 --2- 172.21.15.62:0/1200297468 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81f0008860 0x7f81f0008d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.427+0000 7f820cc2e700 1 -- 172.21.15.62:0/1200297468 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81f0007e30 msgr2=0x7f81f0008240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:30.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.427+0000 7f820cc2e700 1 --2- 172.21.15.62:0/1200297468 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81f0007e30 0x7f81f0008240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.427+0000 7f820cc2e700 1 -- 172.21.15.62:0/1200297468 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f820806be00 con 0x7f81f0009260 2023-06-09T04:41:30.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.427+0000 7f82077fe700 1 --2- 172.21.15.62:0/1200297468 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81f0008860 0x7f81f0008d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:41:30.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.427+0000 7f820cc2e700 1 -- 172.21.15.62:0/1200297468 reap_dead start 2023-06-09T04:41:30.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.427+0000 7f820cc2e700 1 --2- 172.21.15.62:0/1200297468 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81f0009260 0x7f81f0009700 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f81f8008440 tx=0x7f81f0009cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da02536cb560549f server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:30.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.427+0000 7f8206ffd700 1 -- 172.21.15.62:0/1200297468 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f800f040 con 0x7f81f0009260 2023-06-09T04:41:30.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.427+0000 7f8206ffd700 1 -- 172.21.15.62:0/1200297468 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81f80132d0 con 0x7f81f0009260 2023-06-09T04:41:30.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.427+0000 7f8206ffd700 1 -- 172.21.15.62:0/1200297468 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f8013640 con 0x7f81f0009260 2023-06-09T04:41:30.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.427+0000 7f820e691700 1 -- 172.21.15.62:0/1200297468 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81f0009260 msgr2=0x7f81f0009700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:30.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.427+0000 7f820e691700 1 --2- 172.21.15.62:0/1200297468 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81f0009260 0x7f81f0009700 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f81f8008440 tx=0x7f81f0009cb0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.427+0000 7f820e691700 1 -- 172.21.15.62:0/1200297468 shutdown_connections 2023-06-09T04:41:30.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.427+0000 7f820e691700 1 --2- 172.21.15.62:0/1200297468 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81f0009260 0x7f81f0009700 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.427+0000 7f820e691700 1 -- 172.21.15.62:0/1200297468 >> 172.21.15.62:0/1200297468 conn(0x7f82080b0860 msgr2=0x7f82080ce030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:30.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.431+0000 7f820e691700 1 -- 172.21.15.62:0/1200297468 shutdown_connections 2023-06-09T04:41:30.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.431+0000 7f820e691700 1 -- 172.21.15.62:0/1200297468 wait complete. 2023-06-09T04:41:30.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.435+0000 7f820e691700 1 Processor -- start 2023-06-09T04:41:30.443 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.435+0000 7f820e691700 1 -- start start 2023-06-09T04:41:30.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.439+0000 7f820e691700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81f0009260 0x7f82080c9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:30.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.439+0000 7f820e691700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82080ca430 0x7f82080c3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:30.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.439+0000 7f820e691700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82080ca960 0x7f82080c74a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:30.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.439+0000 7f820e691700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82080c8a00 con 0x7f81f0009260 2023-06-09T04:41:30.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.439+0000 7f820e691700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82080c8ce0 con 0x7f82080ca430 2023-06-09T04:41:30.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.439+0000 7f820e691700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82080c8fc0 con 0x7f82080ca960 2023-06-09T04:41:30.445 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.439+0000 7f8207fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81f0009260 0x7f82080c9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:30.445 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.439+0000 7f8207fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81f0009260 0x7f82080c9aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40688/0 (socket says 172.21.15.62:40688) 2023-06-09T04:41:30.445 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.439+0000 7f8207fff700 1 -- 172.21.15.62:0/3803637252 learned_addr learned my addr 172.21.15.62:0/3803637252 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:30.445 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.439+0000 7f82077fe700 1 --2- 172.21.15.62:0/3803637252 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82080ca430 0x7f82080c3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:30.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.439+0000 7f820cc2e700 1 --2- 172.21.15.62:0/3803637252 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82080ca960 0x7f82080c74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:30.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.439+0000 7f8207fff700 1 -- 172.21.15.62:0/3803637252 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82080ca960 msgr2=0x7f82080c74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:30.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.439+0000 7f8207fff700 1 --2- 172.21.15.62:0/3803637252 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82080ca960 0x7f82080c74a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.439+0000 7f8207fff700 1 -- 172.21.15.62:0/3803637252 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82080ca430 msgr2=0x7f82080c3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:30.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.439+0000 7f8207fff700 1 --2- 172.21.15.62:0/3803637252 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82080ca430 0x7f82080c3f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.439+0000 7f8207fff700 1 -- 172.21.15.62:0/3803637252 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82080c92a0 con 0x7f81f0009260 2023-06-09T04:41:30.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.439+0000 7f8207fff700 1 --2- 172.21.15.62:0/3803637252 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81f0009260 0x7f82080c9aa0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f81fc032b50 tx=0x7f81fc032e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:30.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.439+0000 7f8204ff9700 1 -- 172.21.15.62:0/3803637252 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81fc030bd0 con 0x7f81f0009260 2023-06-09T04:41:30.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.439+0000 7f820e691700 1 -- 172.21.15.62:0/3803637252 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82080c9580 con 0x7f81f0009260 2023-06-09T04:41:30.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.439+0000 7f820e691700 1 -- 172.21.15.62:0/3803637252 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82080cae00 con 0x7f81f0009260 2023-06-09T04:41:30.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.443+0000 7f8204ff9700 1 -- 172.21.15.62:0/3803637252 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81fc030d30 con 0x7f81f0009260 2023-06-09T04:41:30.448 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.443+0000 7f8204ff9700 1 -- 172.21.15.62:0/3803637252 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81fc03a650 con 0x7f81f0009260 2023-06-09T04:41:30.448 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.443+0000 7f820e691700 1 -- 172.21.15.62:0/3803637252 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81e8005310 con 0x7f81f0009260 2023-06-09T04:41:30.456 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.451+0000 7f8204ff9700 1 -- 172.21.15.62:0/3803637252 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f81fc005a40 con 0x7f81f0009260 2023-06-09T04:41:30.458 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.451+0000 7f8204ff9700 1 --2- 172.21.15.62:0/3803637252 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f81f40663c0 0x7f81f4068870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:30.458 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.451+0000 7f8204ff9700 1 -- 172.21.15.62:0/3803637252 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f81fc0a63b0 con 0x7f81f0009260 2023-06-09T04:41:30.459 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.451+0000 7f82077fe700 1 --2- 172.21.15.62:0/3803637252 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f81f40663c0 0x7f81f4068870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:30.459 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.455+0000 7f8204ff9700 1 -- 172.21.15.62:0/3803637252 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f81fc073660 con 0x7f81f0009260 2023-06-09T04:41:30.460 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.455+0000 7f82077fe700 1 --2- 172.21.15.62:0/3803637252 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f81f40663c0 0x7f81f4068870 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f82082026d0 tx=0x7f8200009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:30.479 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.475+0000 7f3195c91700 1 Processor -- start 2023-06-09T04:41:30.480 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.475+0000 7f3195c91700 1 -- start start 2023-06-09T04:41:30.480 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.475+0000 7f5c3cec3700 1 Processor -- start 2023-06-09T04:41:30.481 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.475+0000 7f5c3cec3700 1 -- start start 2023-06-09T04:41:30.482 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.475+0000 7fef05825700 1 Processor -- start 2023-06-09T04:41:30.482 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.475+0000 7fa7c1625700 1 Processor -- start 2023-06-09T04:41:30.482 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.475+0000 7f3195c91700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f31900ca0c0 0x7f319006c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:30.483 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.475+0000 7fa7c1625700 1 -- start start 2023-06-09T04:41:30.483 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.475+0000 7f3195c91700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31900ca5a0 con 0x7f3190070c90 2023-06-09T04:41:30.483 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.479+0000 7f318f7fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f3190070c90 0x7f31900caa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:45072/0 (socket says 172.21.15.62:45072) 2023-06-09T04:41:30.483 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.479+0000 7f318f7fe700 1 -- 172.21.15.62:0/2167299785 learned_addr learned my addr 172.21.15.62:0/2167299785 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:41:30.484 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.479+0000 7f3195c91700 1 -- 172.21.15.62:0/2167299785 --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f319015ba80 con 0x7f31900cb150 2023-06-09T04:41:30.484 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.479+0000 7f3195c91700 1 -- 172.21.15.62:0/2167299785 --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31900ca880 con 0x7f31900ca0c0 2023-06-09T04:41:30.484 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.479+0000 7f318ffff700 1 --2- 172.21.15.62:0/2167299785 >> v2:172.21.15.62:3300/0 conn(0x7f31900ca0c0 0x7f319006c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:30.484 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.475+0000 7fef05825700 1 -- start start 2023-06-09T04:41:30.485 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.479+0000 7fef05825700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef000cee40 0x7fef000ce6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:30.485 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.479+0000 7f318ffff700 1 -- 172.21.15.62:0/2167299785 >> v1:172.21.15.89:6789/0 conn(0x7f31900cb150 legacy=0x7f31900cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:30.485 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.479+0000 7fa7c1625700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa7bc160210 0x7fa7bc0cf000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:30.486 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.479+0000 7fa7c1625700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7bc0ce240 con 0x7fa7bc0cf540 2023-06-09T04:41:30.486 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.479+0000 7fa7c1625700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7bc0ce520 con 0x7fa7bc0c6690 2023-06-09T04:41:30.486 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.479+0000 7fa7c1625700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7bc0ce800 con 0x7fa7bc160210 2023-06-09T04:41:30.486 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.479+0000 7fef05825700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef000cec10 con 0x7fef000b5280 2023-06-09T04:41:30.486 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.479+0000 7fef05825700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef000ccb20 con 0x7fef0006afc0 2023-06-09T04:41:30.486 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.479+0000 7fef05825700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef000cce00 con 0x7fef000cee40 2023-06-09T04:41:30.487 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.479+0000 7f318ffff700 1 -- 172.21.15.62:0/2167299785 >> v1:172.21.15.62:6789/0 conn(0x7f3190070c90 legacy=0x7f31900caa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:30.487 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.479+0000 7f318e7fc700 1 -- 172.21.15.62:0/2167299785 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 838100201 0 0) 0x7f31900ca5a0 con 0x7f3190070c90 2023-06-09T04:41:30.487 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.479+0000 7f318ffff700 1 -- 172.21.15.62:0/2167299785 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f319015bd60 con 0x7f31900ca0c0 2023-06-09T04:41:30.487 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.479+0000 7fa7baffd700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa7bc160210 0x7fa7bc0cf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:30.488 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.479+0000 7feeff7fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fef000b5280 0x7fef000d12b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:45088/0 (socket says 172.21.15.62:45088) 2023-06-09T04:41:30.488 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.479+0000 7feeff7fe700 1 -- 172.21.15.62:0/3193512410 learned_addr learned my addr 172.21.15.62:0/3193512410 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:41:30.488 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.479+0000 7f318ffff700 1 --2- 172.21.15.62:0/2167299785 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31900ca0c0 0x7f319006c290 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3188009c00 tx=0x7f3188009f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11f21c641485809 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:30.489 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.479+0000 7fa7baffd700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa7bc160210 0x7fa7bc0cf000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.62:44452/0 (socket says 172.21.15.62:44452) 2023-06-09T04:41:30.489 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.479+0000 7fa7baffd700 1 -- 172.21.15.62:0/2162714853 learned_addr learned my addr 172.21.15.62:0/2162714853 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:30.489 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.479+0000 7f5c3cec3700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5c30036e20 0x7f5c30052a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:30.489 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.479+0000 7f5c3cec3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c300c7c20 0x7f5c30052f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:30.490 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.479+0000 7f318e7fc700 1 -- 172.21.15.62:0/2167299785 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3188003c40 con 0x7f31900ca0c0 2023-06-09T04:41:30.490 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.479+0000 7f318e7fc700 1 -- 172.21.15.62:0/2167299785 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3188003da0 con 0x7f31900ca0c0 2023-06-09T04:41:30.490 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.479+0000 7f318e7fc700 1 -- 172.21.15.62:0/2167299785 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f318800bae0 con 0x7f31900ca0c0 2023-06-09T04:41:30.490 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.479+0000 7f5c3cec3700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c300e32d0 con 0x7f5c3004faf0 2023-06-09T04:41:30.490 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.479+0000 7f5c3cec3700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c3004bbd0 con 0x7f5c30036e20 2023-06-09T04:41:30.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.479+0000 7f5c3cec3700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c3004fec0 con 0x7f5c300c7c20 2023-06-09T04:41:30.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.479+0000 7fa7baffd700 1 -- 172.21.15.62:0/2162714853 >> v1:172.21.15.89:6789/0 conn(0x7fa7bc0c6690 legacy=0x7fa7bc0d1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:30.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.479+0000 7fa7baffd700 1 -- 172.21.15.62:0/2162714853 >> v1:172.21.15.62:6789/0 conn(0x7fa7bc0cf540 legacy=0x7fa7bc0c5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:30.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.479+0000 7fa7baffd700 1 -- 172.21.15.62:0/2162714853 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7bc0ceae0 con 0x7fa7bc160210 2023-06-09T04:41:30.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.479+0000 7f5c3659c700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f5c3004faf0 0x7f5c30036710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.62:44678/0 (socket says 172.21.15.62:44678) 2023-06-09T04:41:30.492 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.479+0000 7f5c3659c700 1 -- 172.21.15.62:0/1068776587 learned_addr learned my addr 172.21.15.62:0/1068776587 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:41:30.492 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.479+0000 7f5c35d9b700 1 --2- 172.21.15.62:0/1068776587 >> v2:172.21.15.89:3300/0 conn(0x7f5c30036e20 0x7f5c30052a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:30.492 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.479+0000 7feefeffd700 1 --2- 172.21.15.62:0/3193512410 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef000cee40 0x7fef000ce6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:30.492 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.479+0000 7f5c36d9d700 1 --2- 172.21.15.62:0/1068776587 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c300c7c20 0x7f5c30052f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:30.493 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.479+0000 7feefdffb700 1 -- 172.21.15.62:0/3193512410 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2263296279 0 0) 0x7fef000cec10 con 0x7fef000b5280 2023-06-09T04:41:30.493 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.479+0000 7feefdffb700 1 -- 172.21.15.62:0/3193512410 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feee80035d0 con 0x7fef000b5280 2023-06-09T04:41:30.493 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.479+0000 7fa7baffd700 1 --2- 172.21.15.62:0/2162714853 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7bc160210 0x7fa7bc0cf000 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa7b4009e50 tx=0x7fa7b400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4a8133a1a6ff972 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:30.494 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.479+0000 7f5c35d9b700 1 -- 172.21.15.62:0/1068776587 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c300c7c20 msgr2=0x7f5c30052f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:30.494 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.479+0000 7f5c35d9b700 1 --2- 172.21.15.62:0/1068776587 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c300c7c20 0x7f5c30052f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.494 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.479+0000 7f5c35d9b700 1 -- 172.21.15.62:0/1068776587 >> v1:172.21.15.89:6789/0 conn(0x7f5c3004faf0 legacy=0x7f5c30036710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:30.494 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.479+0000 7f5c35d9b700 1 -- 172.21.15.62:0/1068776587 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c300e2470 con 0x7f5c30036e20 2023-06-09T04:41:30.494 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.483+0000 7feefeffd700 1 -- 172.21.15.62:0/3193512410 >> v1:172.21.15.89:6789/0 conn(0x7fef0006afc0 legacy=0x7fef000cf210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:30.494 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.483+0000 7feefeffd700 1 -- 172.21.15.62:0/3193512410 >> v1:172.21.15.62:6789/0 conn(0x7fef000b5280 legacy=0x7fef000d12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:30.495 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.483+0000 7feefeffd700 1 -- 172.21.15.62:0/3193512410 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef000cd0e0 con 0x7fef000cee40 2023-06-09T04:41:30.495 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.483+0000 7f5c35d9b700 1 --2- 172.21.15.62:0/1068776587 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c30036e20 0x7f5c30052a10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c009850 tx=0x7f5c2c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb851d6b328c05a6 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:30.495 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.483+0000 7f3195c91700 1 -- 172.21.15.62:0/2167299785 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31900ca0c0 msgr2=0x7f319006c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:30.495 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.483+0000 7f3195c91700 1 --2- 172.21.15.62:0/2167299785 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31900ca0c0 0x7f319006c290 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3188009c00 tx=0x7f3188009f10 comp rx=0 tx=0).stop 2023-06-09T04:41:30.496 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.483+0000 7fa7b9ffb700 1 -- 172.21.15.62:0/2162714853 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b400e070 con 0x7fa7bc160210 2023-06-09T04:41:30.496 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.483+0000 7fa7b9ffb700 1 -- 172.21.15.62:0/2162714853 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7b400b9c0 con 0x7fa7bc160210 2023-06-09T04:41:30.496 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.483+0000 7fa7b9ffb700 1 -- 172.21.15.62:0/2162714853 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b400bd70 con 0x7fa7bc160210 2023-06-09T04:41:30.496 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.483+0000 7feefeffd700 1 --2- 172.21.15.62:0/3193512410 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef000cee40 0x7fef000ce6d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7feef0009880 tx=0x7feef0009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b415c0522fb69543 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:30.497 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.483+0000 7f5c3559a700 1 -- 172.21.15.62:0/1068776587 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c2c011830 con 0x7f5c30036e20 2023-06-09T04:41:30.497 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.483+0000 7f5c3559a700 1 -- 172.21.15.62:0/1068776587 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c2c011990 con 0x7f5c30036e20 2023-06-09T04:41:30.497 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.483+0000 7f5c3559a700 1 -- 172.21.15.62:0/1068776587 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c2c011d20 con 0x7f5c30036e20 2023-06-09T04:41:30.497 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.483+0000 7feefdffb700 1 -- 172.21.15.62:0/3193512410 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef80019f0 con 0x7fef000cee40 2023-06-09T04:41:30.498 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.483+0000 7f3195c91700 1 -- 172.21.15.62:0/2167299785 shutdown_connections 2023-06-09T04:41:30.498 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.483+0000 7f3195c91700 1 --2- 172.21.15.62:0/2167299785 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31900ca0c0 0x7f319006c290 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.498 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.483+0000 7f3195c91700 1 -- 172.21.15.62:0/2167299785 >> 172.21.15.62:0/2167299785 conn(0x7f319006a420 msgr2=0x7f31900afc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:30.498 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.483+0000 7f3195c91700 1 -- 172.21.15.62:0/2167299785 shutdown_connections 2023-06-09T04:41:30.499 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.483+0000 7f3195c91700 1 -- 172.21.15.62:0/2167299785 wait complete. 2023-06-09T04:41:30.499 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.483+0000 7fa7c1625700 1 -- 172.21.15.62:0/2162714853 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7bc160210 msgr2=0x7fa7bc0cf000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:30.499 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.483+0000 7fa7c1625700 1 --2- 172.21.15.62:0/2162714853 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7bc160210 0x7fa7bc0cf000 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa7b4009e50 tx=0x7fa7b400b330 comp rx=0 tx=0).stop 2023-06-09T04:41:30.499 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.483+0000 7fa7c1625700 1 -- 172.21.15.62:0/2162714853 shutdown_connections 2023-06-09T04:41:30.499 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.483+0000 7fa7c1625700 1 --2- 172.21.15.62:0/2162714853 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7bc160210 0x7fa7bc0cf000 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.499 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.483+0000 7fa7c1625700 1 -- 172.21.15.62:0/2162714853 >> 172.21.15.62:0/2162714853 conn(0x7fa7bc06a4b0 msgr2=0x7fa7bc06a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:30.500 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.483+0000 7f5c3cec3700 1 -- 172.21.15.62:0/1068776587 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c30036e20 msgr2=0x7f5c30052a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:30.500 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.483+0000 7fa7c1625700 1 -- 172.21.15.62:0/2162714853 shutdown_connections 2023-06-09T04:41:30.501 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.483+0000 7feefdffb700 1 -- 172.21.15.62:0/3193512410 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feef0010590 con 0x7fef000cee40 2023-06-09T04:41:30.501 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.483+0000 7feefdffb700 1 -- 172.21.15.62:0/3193512410 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef0010940 con 0x7fef000cee40 2023-06-09T04:41:30.501 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.483+0000 7fef05825700 1 -- 172.21.15.62:0/3193512410 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef000cee40 msgr2=0x7fef000ce6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:30.501 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.483+0000 7fef05825700 1 --2- 172.21.15.62:0/3193512410 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef000cee40 0x7fef000ce6d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7feef0009880 tx=0x7feef0009b90 comp rx=0 tx=0).stop 2023-06-09T04:41:30.501 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.483+0000 7f5c3cec3700 1 --2- 172.21.15.62:0/1068776587 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c30036e20 0x7f5c30052a10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c009850 tx=0x7f5c2c009b60 comp rx=0 tx=0).stop 2023-06-09T04:41:30.502 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.483+0000 7fef05825700 1 -- 172.21.15.62:0/3193512410 shutdown_connections 2023-06-09T04:41:30.502 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.483+0000 7fef05825700 1 --2- 172.21.15.62:0/3193512410 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef000cee40 0x7fef000ce6d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.502 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.483+0000 7fef05825700 1 -- 172.21.15.62:0/3193512410 >> 172.21.15.62:0/3193512410 conn(0x7fef0006a4b0 msgr2=0x7fef0006a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:30.502 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.483+0000 7fef05825700 1 -- 172.21.15.62:0/3193512410 shutdown_connections 2023-06-09T04:41:30.503 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.483+0000 7f5c3cec3700 1 -- 172.21.15.62:0/1068776587 shutdown_connections 2023-06-09T04:41:30.503 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.483+0000 7f5c3cec3700 1 --2- 172.21.15.62:0/1068776587 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c30036e20 0x7f5c30052a10 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.503 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.483+0000 7f5c3cec3700 1 --2- 172.21.15.62:0/1068776587 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c300c7c20 0x7f5c30052f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.503 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.483+0000 7f5c3cec3700 1 -- 172.21.15.62:0/1068776587 >> 172.21.15.62:0/1068776587 conn(0x7f5c30051710 msgr2=0x7f5c30051ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:30.504 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.483+0000 7fef05825700 1 -- 172.21.15.62:0/3193512410 wait complete. 2023-06-09T04:41:30.504 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.483+0000 7fa7c1625700 1 -- 172.21.15.62:0/2162714853 wait complete. 2023-06-09T04:41:30.504 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.487+0000 7f5c3cec3700 1 -- 172.21.15.62:0/1068776587 shutdown_connections 2023-06-09T04:41:30.504 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.487+0000 7fa7c1625700 1 Processor -- start 2023-06-09T04:41:30.505 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.487+0000 7f3195c91700 1 Processor -- start 2023-06-09T04:41:30.505 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.487+0000 7fa7c1625700 1 -- start start 2023-06-09T04:41:30.505 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.487+0000 7f3195c91700 1 -- start start 2023-06-09T04:41:30.506 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.487+0000 7fef05825700 1 Processor -- start 2023-06-09T04:41:30.506 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.487+0000 7f5c3cec3700 1 -- 172.21.15.62:0/1068776587 wait complete. 2023-06-09T04:41:30.506 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.487+0000 7fa7c1625700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa7bc0c6690 0x7fa7bc1f5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:30.507 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.487+0000 7fa7c1625700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7bc0cf540 0x7fa7bc1fe590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:30.507 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.487+0000 7fa7c1625700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7bc160210 0x7fa7bc15b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:30.507 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.487+0000 7f3195c91700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f31900ca0c0 0x7f319015a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:30.507 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.487+0000 7fef05825700 1 -- start start 2023-06-09T04:41:30.508 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.487+0000 7fef05825700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fef0006afc0 0x7fef00155900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:30.508 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.487+0000 7fa7c1625700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7bc1f5550 con 0x7fa7bc0cf540 2023-06-09T04:41:30.508 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.487+0000 7f3195c91700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f31900cb150 0x7f31901efe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:30.509 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.487+0000 7fa7baffd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa7bc0c6690 0x7fa7bc1f5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:30.509 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.487+0000 7fa7baffd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa7bc0c6690 0x7fa7bc1f5010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.62:36138/0 (socket says 172.21.15.62:36138) 2023-06-09T04:41:30.509 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.491+0000 7fa7baffd700 1 -- 172.21.15.62:0/3733560136 learned_addr learned my addr 172.21.15.62:0/3733560136 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:30.509 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.487+0000 7fa7c1625700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7bc0d1950 con 0x7fa7bc160210 2023-06-09T04:41:30.509 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.491+0000 7fa7c1625700 1 -- 172.21.15.62:0/3733560136 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7bc1fead0 con 0x7fa7bc0c6690 2023-06-09T04:41:30.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.491+0000 7f3195c91700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31901ecf50 0x7f3190158340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:30.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.491+0000 7fa7ba7fc700 1 --2- 172.21.15.62:0/3733560136 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7bc0cf540 0x7fa7bc1fe590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:30.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.491+0000 7fa7bb7fe700 1 --2- 172.21.15.62:0/3733560136 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7bc160210 0x7fa7bc15b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:30.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.491+0000 7feefeffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fef0006afc0 0x7fef00155900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:30.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.491+0000 7feefeffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fef0006afc0 0x7fef00155900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40696/0 (socket says 172.21.15.62:40696) 2023-06-09T04:41:30.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.491+0000 7feefeffd700 1 -- 172.21.15.62:0/699371292 learned_addr learned my addr 172.21.15.62:0/699371292 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:30.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.491+0000 7fef05825700 1 --2- 172.21.15.62:0/699371292 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef000b5280 0x7fef000b4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:30.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.491+0000 7fef05825700 1 --2- 172.21.15.62:0/699371292 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef000cee40 0x7fef001598d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:30.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.491+0000 7fef05825700 1 -- 172.21.15.62:0/699371292 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef001f5450 con 0x7fef0006afc0 2023-06-09T04:41:30.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.491+0000 7fef05825700 1 -- 172.21.15.62:0/699371292 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef001f5730 con 0x7fef000cee40 2023-06-09T04:41:30.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.491+0000 7fa7baffd700 1 -- 172.21.15.62:0/3733560136 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7bc160210 msgr2=0x7fa7bc15b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:30.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.491+0000 7fa7baffd700 1 --2- 172.21.15.62:0/3733560136 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7bc160210 0x7fa7bc15b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.491+0000 7fa7baffd700 1 -- 172.21.15.62:0/3733560136 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7bc0cf540 msgr2=0x7fa7bc1fe590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:30.513 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.491+0000 7fa7baffd700 1 --2- 172.21.15.62:0/3733560136 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7bc0cf540 0x7fa7bc1fe590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.513 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.491+0000 7fa7baffd700 1 -- 172.21.15.62:0/3733560136 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7b4009b30 con 0x7fa7bc0c6690 2023-06-09T04:41:30.513 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.491+0000 7fef05825700 1 -- 172.21.15.62:0/699371292 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef001f5a10 con 0x7fef000b5280 2023-06-09T04:41:30.513 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.491+0000 7f318f7fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f31900ca0c0 0x7f319015a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:30.514 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.491+0000 7f318f7fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f31900ca0c0 0x7f319015a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.62:36150/0 (socket says 172.21.15.62:36150) 2023-06-09T04:41:30.514 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.491+0000 7f318effd700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f31900cb150 0x7f31901efe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:30.514 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.491+0000 7f318effd700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f31900cb150 0x7f31901efe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.62:44468/0 (socket says 172.21.15.62:44468) 2023-06-09T04:41:30.514 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.491+0000 7f318ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31901ecf50 0x7f3190158340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:30.514 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.491+0000 7f318ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31901ecf50 0x7f3190158340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40718/0 (socket says 172.21.15.62:40718) 2023-06-09T04:41:30.514 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.491+0000 7f318f7fe700 1 -- 172.21.15.62:0/8743293 learned_addr learned my addr 172.21.15.62:0/8743293 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:30.515 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.491+0000 7ff89191a700 1 Processor -- start 2023-06-09T04:41:30.515 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.491+0000 7feefe7fc700 1 --2- 172.21.15.62:0/699371292 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef000b5280 0x7fef000b4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:30.515 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.491+0000 7feeff7fe700 1 --2- 172.21.15.62:0/699371292 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef000cee40 0x7fef001598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:30.515 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.491+0000 7fa7baffd700 1 --2- 172.21.15.62:0/3733560136 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa7bc0c6690 0x7fa7bc1f5010 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa7b400b730 tx=0x7fa7b4004af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:30.516 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.491+0000 7ff89191a700 1 -- start start 2023-06-09T04:41:30.516 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.491+0000 7f5c3cec3700 1 Processor -- start 2023-06-09T04:41:30.516 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.491+0000 7f3195c91700 1 -- 172.21.15.62:0/8743293 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31900c5330 con 0x7f31901ecf50 2023-06-09T04:41:30.517 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.491+0000 7f3195c91700 1 -- 172.21.15.62:0/8743293 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31901f0350 con 0x7f31900cb150 2023-06-09T04:41:30.517 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.491+0000 7fa7a37fe700 1 -- 172.21.15.62:0/3733560136 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b4004250 con 0x7fa7bc0c6690 2023-06-09T04:41:30.517 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.491+0000 7f5c3cec3700 1 -- start start 2023-06-09T04:41:30.518 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.491+0000 7feefeffd700 1 -- 172.21.15.62:0/699371292 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef000b5280 msgr2=0x7fef000b4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:30.518 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.491+0000 7feefeffd700 1 --2- 172.21.15.62:0/699371292 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef000b5280 0x7fef000b4110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.518 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.491+0000 7feefeffd700 1 -- 172.21.15.62:0/699371292 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef000cee40 msgr2=0x7fef001598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:30.518 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.491+0000 7feefeffd700 1 --2- 172.21.15.62:0/699371292 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef000cee40 0x7fef001598d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.518 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.491+0000 7feefeffd700 1 -- 172.21.15.62:0/699371292 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef00094b0 con 0x7fef0006afc0 2023-06-09T04:41:30.519 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.491+0000 7fa7a37fe700 1 -- 172.21.15.62:0/3733560136 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7b40043b0 con 0x7fa7bc0c6690 2023-06-09T04:41:30.519 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.491+0000 7fa7c1625700 1 -- 172.21.15.62:0/3733560136 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7bc1fed70 con 0x7fa7bc0c6690 2023-06-09T04:41:30.519 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.491+0000 7fa7a37fe700 1 -- 172.21.15.62:0/3733560136 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b4004760 con 0x7fa7bc0c6690 2023-06-09T04:41:30.519 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.491+0000 7f3195c91700 1 -- 172.21.15.62:0/8743293 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3190159430 con 0x7f31900ca0c0 2023-06-09T04:41:30.519 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.491+0000 7fa7c1625700 1 -- 172.21.15.62:0/3733560136 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7bc1ff330 con 0x7fa7bc0c6690 2023-06-09T04:41:30.520 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.491+0000 7feefeffd700 1 --2- 172.21.15.62:0/699371292 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fef0006afc0 0x7fef00155900 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7feef0000c00 tx=0x7feef0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:30.520 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.491+0000 7feee7fff700 1 -- 172.21.15.62:0/699371292 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef0003c10 con 0x7fef0006afc0 2023-06-09T04:41:30.520 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.491+0000 7f318f7fe700 1 -- 172.21.15.62:0/8743293 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f31900cb150 msgr2=0x7f31901efe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:30.521 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.491+0000 7f318f7fe700 1 --2- 172.21.15.62:0/8743293 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f31900cb150 0x7f31901efe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.521 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.491+0000 7f318f7fe700 1 -- 172.21.15.62:0/8743293 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31901ecf50 msgr2=0x7f3190158340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:30.521 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.491+0000 7f318f7fe700 1 --2- 172.21.15.62:0/8743293 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31901ecf50 0x7f3190158340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.521 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.491+0000 7f318f7fe700 1 -- 172.21.15.62:0/8743293 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f318800d040 con 0x7f31900ca0c0 2023-06-09T04:41:30.521 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.491+0000 7feee7fff700 1 -- 172.21.15.62:0/699371292 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feef001e070 con 0x7fef0006afc0 2023-06-09T04:41:30.521 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.491+0000 7fef05825700 1 -- 172.21.15.62:0/699371292 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef001f5cf0 con 0x7fef0006afc0 2023-06-09T04:41:30.522 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.491+0000 7fef05825700 1 -- 172.21.15.62:0/699371292 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef001f50f0 con 0x7fef0006afc0 2023-06-09T04:41:30.522 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.491+0000 7ff89191a700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff8840e2880 0x7ff88404f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:30.522 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.491+0000 7ff89191a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff884006e60 0x7ff884050d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:30.522 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.491+0000 7ff89191a700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8840060e0 con 0x7ff8840367b0 2023-06-09T04:41:30.522 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.491+0000 7ff89191a700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff884051270 con 0x7ff8840e2880 2023-06-09T04:41:30.522 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.491+0000 7ff89191a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff884006380 con 0x7ff884006e60 2023-06-09T04:41:30.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.495+0000 7feee7fff700 1 -- 172.21.15.62:0/699371292 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef0010700 con 0x7fef0006afc0 2023-06-09T04:41:30.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.495+0000 7f318f7fe700 1 --2- 172.21.15.62:0/8743293 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f31900ca0c0 0x7f319015a680 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f318400c750 tx=0x7f318400ca60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:30.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.495+0000 7ff88a7fc700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff8840e2880 0x7ff88404f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:30.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.495+0000 7ff88a7fc700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff8840e2880 0x7ff88404f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40732/0 (socket says 172.21.15.62:40732) 2023-06-09T04:41:30.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.495+0000 7ff88a7fc700 1 -- 172.21.15.62:0/3303610834 learned_addr learned my addr 172.21.15.62:0/3303610834 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:30.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.495+0000 7ff88affd700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7ff8840367b0 0x7ff8840e6280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:45108/0 (socket says 172.21.15.62:45108) 2023-06-09T04:41:30.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.495+0000 7f5c3cec3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c30036e20 0x7f5c3004aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:30.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.495+0000 7f5c3cec3700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c3004faf0 0x7f5c30055440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:30.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.495+0000 7ff88a7fc700 1 -- 172.21.15.62:0/3303610834 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff884006e60 msgr2=0x7ff884050d30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-06-09T04:41:30.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.495+0000 7ff88a7fc700 1 --2- 172.21.15.62:0/3303610834 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff884006e60 0x7ff884050d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.495+0000 7ff88a7fc700 1 -- 172.21.15.62:0/3303610834 >> v1:172.21.15.62:6789/0 conn(0x7ff8840367b0 legacy=0x7ff8840e6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:30.526 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.495+0000 7ff88a7fc700 1 -- 172.21.15.62:0/3303610834 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff884006660 con 0x7ff8840e2880 2023-06-09T04:41:30.526 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.495+0000 7f5c3cec3700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c300c7c20 0x7f5c30038290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:30.526 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.495+0000 7f5c3cec3700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c300536b0 con 0x7f5c3004faf0 2023-06-09T04:41:30.526 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.495+0000 7f5c3cec3700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c30053950 con 0x7f5c300c7c20 2023-06-09T04:41:30.526 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.495+0000 7f5c3cec3700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c30053c30 con 0x7f5c30036e20 2023-06-09T04:41:30.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.495+0000 7fa7a37fe700 1 -- 172.21.15.62:0/3733560136 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa7b401b430 con 0x7fa7bc0c6690 2023-06-09T04:41:30.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.495+0000 7f5c3659c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c30036e20 0x7f5c3004aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:30.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.495+0000 7f5c36d9d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c300c7c20 0x7f5c30038290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:30.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.495+0000 7f5c36d9d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c300c7c20 0x7f5c30038290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.62:44488/0 (socket says 172.21.15.62:44488) 2023-06-09T04:41:30.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.495+0000 7f5c36d9d700 1 -- 172.21.15.62:0/3953541087 learned_addr learned my addr 172.21.15.62:0/3953541087 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:30.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.495+0000 7ff88a7fc700 1 --2- 172.21.15.62:0/3303610834 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8840e2880 0x7ff88404f380 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff87c009910 tx=0x7ff87c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adca5268c4abd6c server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:30.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.495+0000 7f3177fff700 1 -- 172.21.15.62:0/8743293 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31840070d0 con 0x7f31900ca0c0 2023-06-09T04:41:30.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.495+0000 7f3177fff700 1 -- 172.21.15.62:0/8743293 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3184007230 con 0x7f31900ca0c0 2023-06-09T04:41:30.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.495+0000 7f3177fff700 1 -- 172.21.15.62:0/8743293 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31840075e0 con 0x7f31900ca0c0 2023-06-09T04:41:30.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.495+0000 7f3195c91700 1 -- 172.21.15.62:0/8743293 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3190158b90 con 0x7f31900ca0c0 2023-06-09T04:41:30.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.495+0000 7f3195c91700 1 -- 172.21.15.62:0/8743293 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3190159150 con 0x7f31900ca0c0 2023-06-09T04:41:30.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.495+0000 7fa7c1625700 1 -- 172.21.15.62:0/3733560136 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7bc1ff520 con 0x7fa7bc0c6690 2023-06-09T04:41:30.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.495+0000 7fa7a37fe700 1 --2- 172.21.15.62:0/3733560136 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fa7a80662f0 0x7fa7a80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:30.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.495+0000 7f5c3659c700 1 -- 172.21.15.62:0/3953541087 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c300c7c20 msgr2=0x7f5c30038290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:30.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.495+0000 7f5c3659c700 1 --2- 172.21.15.62:0/3953541087 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c300c7c20 0x7f5c30038290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.495+0000 7f5c35d9b700 1 --2- 172.21.15.62:0/3953541087 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c3004faf0 0x7f5c30055440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:30.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.495+0000 7f5c3659c700 1 -- 172.21.15.62:0/3953541087 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c3004faf0 msgr2=0x7f5c30055440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:30.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.495+0000 7f5c3659c700 1 --2- 172.21.15.62:0/3953541087 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c3004faf0 0x7f5c30055440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.495+0000 7f5c3659c700 1 -- 172.21.15.62:0/3953541087 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c2c0094b0 con 0x7f5c30036e20 2023-06-09T04:41:30.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.495+0000 7f5c35d9b700 1 --2- 172.21.15.62:0/3953541087 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c3004faf0 0x7f5c30055440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:41:30.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.495+0000 7f5c3659c700 1 --2- 172.21.15.62:0/3953541087 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c30036e20 0x7f5c3004aa20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5c2800c480 tx=0x7f5c2800c790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:30.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.495+0000 7fef05825700 1 -- 172.21.15.62:0/699371292 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feee0005310 con 0x7fef0006afc0 2023-06-09T04:41:30.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.495+0000 7ff88bfff700 1 -- 172.21.15.62:0/3303610834 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff87c00ba60 con 0x7ff8840e2880 2023-06-09T04:41:30.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.495+0000 7ff88bfff700 1 -- 172.21.15.62:0/3303610834 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff87c00bbc0 con 0x7ff8840e2880 2023-06-09T04:41:30.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.495+0000 7ff88bfff700 1 -- 172.21.15.62:0/3303610834 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff87c009e60 con 0x7ff8840e2880 2023-06-09T04:41:30.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.495+0000 7fa7a37fe700 1 -- 172.21.15.62:0/3733560136 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa7b4085160 con 0x7fa7bc0c6690 2023-06-09T04:41:30.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.495+0000 7ff89191a700 1 -- 172.21.15.62:0/3303610834 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8840e2880 msgr2=0x7ff88404f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:30.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.495+0000 7ff89191a700 1 --2- 172.21.15.62:0/3303610834 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8840e2880 0x7ff88404f380 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff87c009910 tx=0x7ff87c009c20 comp rx=0 tx=0).stop 2023-06-09T04:41:30.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.499+0000 7fa7ba7fc700 1 --2- 172.21.15.62:0/3733560136 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fa7a80662f0 0x7fa7a80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:30.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.499+0000 7ff89191a700 1 -- 172.21.15.62:0/3303610834 shutdown_connections 2023-06-09T04:41:30.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.499+0000 7ff89191a700 1 --2- 172.21.15.62:0/3303610834 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff884006e60 0x7ff884050d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.499+0000 7ff89191a700 1 --2- 172.21.15.62:0/3303610834 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8840e2880 0x7ff88404f380 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.499+0000 7ff89191a700 1 -- 172.21.15.62:0/3303610834 >> 172.21.15.62:0/3303610834 conn(0x7ff8840517b0 msgr2=0x7ff884051bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:30.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.499+0000 7ff89191a700 1 -- 172.21.15.62:0/3303610834 shutdown_connections 2023-06-09T04:41:30.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.499+0000 7feee7fff700 1 -- 172.21.15.62:0/699371292 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7feef0010880 con 0x7fef0006afc0 2023-06-09T04:41:30.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.499+0000 7fa7ba7fc700 1 --2- 172.21.15.62:0/3733560136 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fa7a80662f0 0x7fa7a80687a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc15c030 tx=0x7fa7ac009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:30.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.499+0000 7f3195c91700 1 -- 172.21.15.62:0/8743293 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31900c5470 con 0x7f31900ca0c0 2023-06-09T04:41:30.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.499+0000 7ff89191a700 1 -- 172.21.15.62:0/3303610834 wait complete. 2023-06-09T04:41:30.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.499+0000 7feee7fff700 1 --2- 172.21.15.62:0/699371292 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7feeec0663c0 0x7feeec068870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:30.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.499+0000 7feee7fff700 1 -- 172.21.15.62:0/699371292 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7feef0084e00 con 0x7fef0006afc0 2023-06-09T04:41:30.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.499+0000 7feefe7fc700 1 --2- 172.21.15.62:0/699371292 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7feeec0663c0 0x7feeec068870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:30.536 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.499+0000 7ff89191a700 1 Processor -- start 2023-06-09T04:41:30.536 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.503+0000 7feefe7fc700 1 --2- 172.21.15.62:0/699371292 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7feeec0663c0 0x7feeec068870 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fef000cc8a0 tx=0x7feef4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:30.536 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.503+0000 7ff89191a700 1 -- start start 2023-06-09T04:41:30.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.503+0000 7ff89191a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff884006e60 0x7ff8840e41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:30.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.503+0000 7f6907da7700 1 Processor -- start 2023-06-09T04:41:30.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.503+0000 7ff89191a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8840367b0 0x7ff8840dd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:30.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.503+0000 7f6907da7700 1 -- start start 2023-06-09T04:41:30.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.503+0000 7ff89191a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8840e2880 0x7ff8840ddd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:30.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.503+0000 7ff889ffb700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8840367b0 0x7ff8840dd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:30.539 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.503+0000 7ff889ffb700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8840367b0 0x7ff8840dd6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40756/0 (socket says 172.21.15.62:40756) 2023-06-09T04:41:30.539 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.503+0000 7ff889ffb700 1 -- 172.21.15.62:0/2786344145 learned_addr learned my addr 172.21.15.62:0/2786344145 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:30.539 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.503+0000 7ff89191a700 1 -- 172.21.15.62:0/2786344145 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8840ddbe0 con 0x7ff8840367b0 2023-06-09T04:41:30.539 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.503+0000 7feee7fff700 1 -- 172.21.15.62:0/699371292 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7feef0052000 con 0x7fef0006afc0 2023-06-09T04:41:30.540 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.503+0000 7ff88affd700 1 --2- 172.21.15.62:0/2786344145 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8840e2880 0x7ff8840ddd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:30.540 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.503+0000 7ff89191a700 1 -- 172.21.15.62:0/2786344145 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8840e3d50 con 0x7ff8840e2880 2023-06-09T04:41:30.540 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.503+0000 7ff88a7fc700 1 --2- 172.21.15.62:0/2786344145 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff884006e60 0x7ff8840e41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:30.540 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.503+0000 7ff89191a700 1 -- 172.21.15.62:0/2786344145 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff884038dc0 con 0x7ff884006e60 2023-06-09T04:41:30.540 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.503+0000 7f6907da7700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f68f8036300 0x7f68f800dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:30.541 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.503+0000 7ff889ffb700 1 -- 172.21.15.62:0/2786344145 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff884006e60 msgr2=0x7ff8840e41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:30.541 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.503+0000 7ff889ffb700 1 --2- 172.21.15.62:0/2786344145 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff884006e60 0x7ff8840e41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.541 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.503+0000 7ff889ffb700 1 -- 172.21.15.62:0/2786344145 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8840e2880 msgr2=0x7ff8840ddd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:30.541 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.503+0000 7f6907da7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68f80e1bc0 0x7f68f8051380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:30.542 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.503+0000 7f6905b43700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f68f8036300 0x7f68f800dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:30.542 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.503+0000 7f6905b43700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f68f8036300 0x7f68f800dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40766/0 (socket says 172.21.15.62:40766) 2023-06-09T04:41:30.542 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.503+0000 7f6905b43700 1 -- 172.21.15.62:0/3634758069 learned_addr learned my addr 172.21.15.62:0/3634758069 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:30.542 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.507+0000 7fa7a37fe700 1 -- 172.21.15.62:0/3733560136 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa7b40522e0 con 0x7fa7bc0c6690 2023-06-09T04:41:30.542 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.507+0000 7ff889ffb700 1 --2- 172.21.15.62:0/2786344145 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8840e2880 0x7ff8840ddd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.507+0000 7f6905342700 1 --2- 172.21.15.62:0/3634758069 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68f80e1bc0 0x7f68f8051380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:30.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.507+0000 7f6907da7700 1 -- 172.21.15.62:0/3634758069 --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68f80e4d10 con 0x7f68f80518c0 2023-06-09T04:41:30.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.507+0000 7f5c26ffd700 1 -- 172.21.15.62:0/3953541087 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c28005d90 con 0x7f5c30036e20 2023-06-09T04:41:30.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.507+0000 7f5c26ffd700 1 -- 172.21.15.62:0/3953541087 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c280070d0 con 0x7f5c30036e20 2023-06-09T04:41:30.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.507+0000 7ff889ffb700 1 -- 172.21.15.62:0/2786344145 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff87c009570 con 0x7ff8840367b0 2023-06-09T04:41:30.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.507+0000 7f6907da7700 1 -- 172.21.15.62:0/3634758069 --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68f8051d40 con 0x7f68f8036300 2023-06-09T04:41:30.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.507+0000 7f5c26ffd700 1 -- 172.21.15.62:0/3953541087 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c28007440 con 0x7f5c30036e20 2023-06-09T04:41:30.547 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.507+0000 7f6907da7700 1 -- 172.21.15.62:0/3634758069 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68f8055e20 con 0x7f68f80e1bc0 2023-06-09T04:41:30.548 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.507+0000 7ff88affd700 1 --2- 172.21.15.62:0/2786344145 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8840e2880 0x7ff8840ddd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:41:30.548 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.507+0000 7f3177fff700 1 -- 172.21.15.62:0/8743293 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3184007740 con 0x7f31900ca0c0 2023-06-09T04:41:30.548 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.507+0000 7f5c3cec3700 1 -- 172.21.15.62:0/3953541087 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c30053f10 con 0x7f5c30036e20 2023-06-09T04:41:30.548 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.507+0000 7f5c3cec3700 1 -- 172.21.15.62:0/3953541087 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c30054710 con 0x7f5c30036e20 2023-06-09T04:41:30.549 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.507+0000 7ff889ffb700 1 --2- 172.21.15.62:0/2786344145 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8840367b0 0x7ff8840dd6a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff88c068190 tx=0x7ff88c06cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:30.549 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.507+0000 7ff873fff700 1 -- 172.21.15.62:0/2786344145 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88c067640 con 0x7ff8840367b0 2023-06-09T04:41:30.549 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.507+0000 7ff873fff700 1 -- 172.21.15.62:0/2786344145 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff88c0677a0 con 0x7ff8840367b0 2023-06-09T04:41:30.549 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.507+0000 7ff873fff700 1 -- 172.21.15.62:0/2786344145 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88c067b90 con 0x7ff8840367b0 2023-06-09T04:41:30.549 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.507+0000 7ff89191a700 1 -- 172.21.15.62:0/2786344145 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8840e3700 con 0x7ff8840367b0 2023-06-09T04:41:30.549 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.507+0000 7ff89191a700 1 -- 172.21.15.62:0/2786344145 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8840390a0 con 0x7ff8840367b0 2023-06-09T04:41:30.550 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.511+0000 7ff873fff700 1 -- 172.21.15.62:0/2786344145 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff88c072220 con 0x7ff8840367b0 2023-06-09T04:41:30.550 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.507+0000 7f6905b43700 1 -- 172.21.15.62:0/3634758069 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68f80e1bc0 msgr2=0x7f68f8051380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:30.550 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.507+0000 7f6905b43700 1 --2- 172.21.15.62:0/3634758069 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68f80e1bc0 0x7f68f8051380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.550 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.507+0000 7f6905b43700 1 -- 172.21.15.62:0/3634758069 >> v1:172.21.15.89:6789/0 conn(0x7f68f80518c0 legacy=0x7f68f8038840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:30.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.507+0000 7f6905b43700 1 -- 172.21.15.62:0/3634758069 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68f800e6c0 con 0x7f68f8036300 2023-06-09T04:41:30.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.507+0000 7f6905b43700 1 --2- 172.21.15.62:0/3634758069 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68f8036300 0x7f68f800dd20 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f68fc009910 tx=0x7f68fc009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da58cc9d0e62ecd7 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:30.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.507+0000 7f6904b41700 1 -- 172.21.15.62:0/3634758069 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68fc004230 con 0x7f68f8036300 2023-06-09T04:41:30.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.507+0000 7f6904b41700 1 -- 172.21.15.62:0/3634758069 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68fc004390 con 0x7f68f8036300 2023-06-09T04:41:30.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.507+0000 7f6904b41700 1 -- 172.21.15.62:0/3634758069 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68fc0036c0 con 0x7f68f8036300 2023-06-09T04:41:30.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.511+0000 7f6907da7700 1 -- 172.21.15.62:0/3634758069 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68f8036300 msgr2=0x7f68f800dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:30.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.511+0000 7f6907da7700 1 --2- 172.21.15.62:0/3634758069 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68f8036300 0x7f68f800dd20 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f68fc009910 tx=0x7f68fc009c20 comp rx=0 tx=0).stop 2023-06-09T04:41:30.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.511+0000 7f6907da7700 1 -- 172.21.15.62:0/3634758069 shutdown_connections 2023-06-09T04:41:30.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.511+0000 7f6907da7700 1 --2- 172.21.15.62:0/3634758069 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68f80e1bc0 0x7f68f8051380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.511+0000 7f6907da7700 1 --2- 172.21.15.62:0/3634758069 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68f8036300 0x7f68f800dd20 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.511+0000 7f6907da7700 1 -- 172.21.15.62:0/3634758069 >> 172.21.15.62:0/3634758069 conn(0x7f68f800cf50 msgr2=0x7f68f8056dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:30.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.511+0000 7ff873fff700 1 --2- 172.21.15.62:0/2786344145 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7ff878066370 0x7ff878068820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:30.553 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.511+0000 7ff873fff700 1 -- 172.21.15.62:0/2786344145 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff88c0fd130 con 0x7ff8840367b0 2023-06-09T04:41:30.553 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.511+0000 7ff89191a700 1 -- 172.21.15.62:0/2786344145 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8840e4720 con 0x7ff8840367b0 2023-06-09T04:41:30.553 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.511+0000 7f3177fff700 1 --2- 172.21.15.62:0/8743293 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f317c066370 0x7f317c068820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:30.553 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.511+0000 7f3177fff700 1 -- 172.21.15.62:0/8743293 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3184084030 con 0x7f31900ca0c0 2023-06-09T04:41:30.553 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.511+0000 7f3177fff700 1 -- 172.21.15.62:0/8743293 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3184084520 con 0x7f31900ca0c0 2023-06-09T04:41:30.554 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.511+0000 7ff88a7fc700 1 --2- 172.21.15.62:0/2786344145 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7ff878066370 0x7ff878068820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:30.554 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.511+0000 7f318effd700 1 --2- 172.21.15.62:0/8743293 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f317c066370 0x7f317c068820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:30.554 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.511+0000 7f6907da7700 1 -- 172.21.15.62:0/3634758069 shutdown_connections 2023-06-09T04:41:30.554 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.511+0000 7f6907da7700 1 -- 172.21.15.62:0/3634758069 wait complete. 2023-06-09T04:41:30.555 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.515+0000 7f318effd700 1 --2- 172.21.15.62:0/8743293 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f317c066370 0x7f317c068820 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f31901f1620 tx=0x7f3180009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:30.555 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.515+0000 7ff88a7fc700 1 --2- 172.21.15.62:0/2786344145 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7ff878066370 0x7ff878068820 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff87c014040 tx=0x7ff87c008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:30.555 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.515+0000 7ff873fff700 1 -- 172.21.15.62:0/2786344145 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff88c0ca210 con 0x7ff8840367b0 2023-06-09T04:41:30.556 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.515+0000 7f6907da7700 1 Processor -- start 2023-06-09T04:41:30.556 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.515+0000 7f5c26ffd700 1 -- 172.21.15.62:0/3953541087 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5c280075a0 con 0x7f5c30036e20 2023-06-09T04:41:30.556 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.515+0000 7f5c26ffd700 1 --2- 172.21.15.62:0/3953541087 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f5c180662f0 0x7f5c180687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:30.556 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.519+0000 7f6907da7700 1 -- start start 2023-06-09T04:41:30.557 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.519+0000 7f5c26ffd700 1 -- 172.21.15.62:0/3953541087 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5c280832d0 con 0x7f5c30036e20 2023-06-09T04:41:30.557 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.519+0000 7f5c35d9b700 1 --2- 172.21.15.62:0/3953541087 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f5c180662f0 0x7f5c180687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:30.557 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.519+0000 7f5c3cec3700 1 -- 172.21.15.62:0/3953541087 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c1c005310 con 0x7f5c30036e20 2023-06-09T04:41:30.557 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.519+0000 7f5c35d9b700 1 --2- 172.21.15.62:0/3953541087 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f5c180662f0 0x7f5c180687a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c0090b0 tx=0x7f5c2c008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:30.558 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.519+0000 7f6907da7700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68f80518c0 0x7f68f804bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:30.559 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.519+0000 7f6907da7700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68f80e1bc0 0x7f68f80cdb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:30.559 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.519+0000 7f6907da7700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68f804d400 0x7f68f803b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:30.559 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.519+0000 7f6905b43700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68f80518c0 0x7f68f804bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:30.559 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.519+0000 7f6905b43700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68f80518c0 0x7f68f804bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.62:44512/0 (socket says 172.21.15.62:44512) 2023-06-09T04:41:30.559 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.519+0000 7f6905342700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68f80e1bc0 0x7f68f80cdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:30.559 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.519+0000 7f6905342700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68f80e1bc0 0x7f68f80cdb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.62:36192/0 (socket says 172.21.15.62:36192) 2023-06-09T04:41:30.559 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.519+0000 7f6905342700 1 -- 172.21.15.62:0/3876896322 learned_addr learned my addr 172.21.15.62:0/3876896322 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:30.559 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.519+0000 7f6907da7700 1 -- 172.21.15.62:0/3876896322 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f804c0c0 con 0x7f68f804d400 2023-06-09T04:41:30.560 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.519+0000 7f6907da7700 1 -- 172.21.15.62:0/3876896322 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f80ce090 con 0x7f68f80518c0 2023-06-09T04:41:30.560 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.519+0000 7f6907da7700 1 -- 172.21.15.62:0/3876896322 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68f804c2f0 con 0x7f68f80e1bc0 2023-06-09T04:41:30.560 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.519+0000 7f6906344700 1 --2- 172.21.15.62:0/3876896322 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68f804d400 0x7f68f803b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:30.560 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.519+0000 7f6905342700 1 -- 172.21.15.62:0/3876896322 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68f80518c0 msgr2=0x7f68f804bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:30.560 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.519+0000 7f6905342700 1 --2- 172.21.15.62:0/3876896322 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68f80518c0 0x7f68f804bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.560 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.519+0000 7f6905342700 1 -- 172.21.15.62:0/3876896322 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68f804d400 msgr2=0x7f68f803b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:30.560 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.519+0000 7f6905342700 1 --2- 172.21.15.62:0/3876896322 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68f804d400 0x7f68f803b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.519+0000 7f6905342700 1 -- 172.21.15.62:0/3876896322 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68fc009570 con 0x7f68f80e1bc0 2023-06-09T04:41:30.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.519+0000 7f6906344700 1 --2- 172.21.15.62:0/3876896322 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68f804d400 0x7f68f803b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:41:30.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.523+0000 7f6905342700 1 --2- 172.21.15.62:0/3876896322 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68f80e1bc0 0x7f68f80cdb50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f68f000e9d0 tx=0x7f68f000ece0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:30.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.523+0000 7f68f67fc700 1 -- 172.21.15.62:0/3876896322 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f0009720 con 0x7f68f80e1bc0 2023-06-09T04:41:30.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.523+0000 7f68f67fc700 1 -- 172.21.15.62:0/3876896322 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68f000ee70 con 0x7f68f80e1bc0 2023-06-09T04:41:30.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.523+0000 7f68f67fc700 1 -- 172.21.15.62:0/3876896322 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68f000c9f0 con 0x7f68f80e1bc0 2023-06-09T04:41:30.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.523+0000 7f6907da7700 1 -- 172.21.15.62:0/3876896322 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68f8175fc0 con 0x7f68f80e1bc0 2023-06-09T04:41:30.562 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.527+0000 7f5c26ffd700 1 -- 172.21.15.62:0/3953541087 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5c28050530 con 0x7f5c30036e20 2023-06-09T04:41:30.562 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.527+0000 7f6907da7700 1 -- 172.21.15.62:0/3876896322 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68f804c920 con 0x7f68f80e1bc0 2023-06-09T04:41:30.562 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.527+0000 7f6907da7700 1 -- 172.21.15.62:0/3876896322 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68f8005770 con 0x7f68f80e1bc0 2023-06-09T04:41:30.563 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.531+0000 7f68f67fc700 1 -- 172.21.15.62:0/3876896322 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f68f000cb50 con 0x7f68f80e1bc0 2023-06-09T04:41:30.563 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.531+0000 7f68f67fc700 1 --2- 172.21.15.62:0/3876896322 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f68e40663c0 0x7f68e4068870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:30.563 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.531+0000 7f68f67fc700 1 -- 172.21.15.62:0/3876896322 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f68f0083f30 con 0x7f68f80e1bc0 2023-06-09T04:41:30.563 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.531+0000 7f6905b43700 1 --2- 172.21.15.62:0/3876896322 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f68e40663c0 0x7f68e4068870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:30.563 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.531+0000 7f6905b43700 1 --2- 172.21.15.62:0/3876896322 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f68e40663c0 0x7f68e4068870 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f68fc009910 tx=0x7f68fc008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:30.563 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.535+0000 7f68f67fc700 1 -- 172.21.15.62:0/3876896322 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f68f0054bc0 con 0x7f68f80e1bc0 2023-06-09T04:41:30.719 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.715+0000 7f9a10581700 1 -- 172.21.15.62:0/3856726372 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9a080c9600 con 0x7f9a080ca3b0 2023-06-09T04:41:30.720 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.715+0000 7f99feffd700 1 -- 172.21.15.62:0/3856726372 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9a00020090 con 0x7f9a080ca3b0 2023-06-09T04:41:30.723 INFO:teuthology.orchestra.run.smithi062.stdout:55834574858 2023-06-09T04:41:30.723 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.719+0000 7f99fcff9700 1 -- 172.21.15.62:0/3856726372 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f99ec0663f0 msgr2=0x7f99ec0688a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:30.724 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.719+0000 7f99fcff9700 1 --2- 172.21.15.62:0/3856726372 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f99ec0663f0 0x7f99ec0688a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9a0400a760 tx=0x7f9a0400e040 comp rx=0 tx=0).stop 2023-06-09T04:41:30.724 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.719+0000 7f99fcff9700 1 -- 172.21.15.62:0/3856726372 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a080ca3b0 msgr2=0x7f9a08141040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:30.725 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.719+0000 7f99fcff9700 1 --2- 172.21.15.62:0/3856726372 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a080ca3b0 0x7f9a08141040 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9a00015000 tx=0x7f9a00004af0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.725 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.719+0000 7f99fcff9700 1 -- 172.21.15.62:0/3856726372 shutdown_connections 2023-06-09T04:41:30.725 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.719+0000 7f99fcff9700 1 --2- 172.21.15.62:0/3856726372 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f99ec0663f0 0x7f99ec0688a0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.725 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.719+0000 7f99fcff9700 1 --2- 172.21.15.62:0/3856726372 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9a0814f820 0x7f9a0814fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.725 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.719+0000 7f99fcff9700 1 --2- 172.21.15.62:0/3856726372 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a080ca3b0 0x7f9a08141040 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.725 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.719+0000 7f99fcff9700 1 --2- 172.21.15.62:0/3856726372 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a0806fae0 0x7f9a08162e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.725 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.719+0000 7f99fcff9700 1 -- 172.21.15.62:0/3856726372 >> 172.21.15.62:0/3856726372 conn(0x7f9a080b0860 msgr2=0x7f9a080cbb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:30.726 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.719+0000 7f99fcff9700 1 -- 172.21.15.62:0/3856726372 shutdown_connections 2023-06-09T04:41:30.726 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.719+0000 7f99fcff9700 1 -- 172.21.15.62:0/3856726372 wait complete. 2023-06-09T04:41:30.749 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.2 2023-06-09T04:41:30.749 DEBUG:teuthology.parallel:result is None 2023-06-09T04:41:30.785 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.779+0000 7f820e691700 1 -- 172.21.15.62:0/3803637252 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f81e8005890 con 0x7f81f0009260 2023-06-09T04:41:30.786 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.779+0000 7f8204ff9700 1 -- 172.21.15.62:0/3803637252 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f81fc03f090 con 0x7f81f0009260 2023-06-09T04:41:30.786 INFO:teuthology.orchestra.run.smithi062.stdout:55834574858 2023-06-09T04:41:30.790 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.783+0000 7f820e691700 1 -- 172.21.15.62:0/3803637252 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f81f40663c0 msgr2=0x7f81f4068870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:30.790 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.783+0000 7f820e691700 1 --2- 172.21.15.62:0/3803637252 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f81f40663c0 0x7f81f4068870 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f82082026d0 tx=0x7f8200009040 comp rx=0 tx=0).stop 2023-06-09T04:41:30.791 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.783+0000 7f820e691700 1 -- 172.21.15.62:0/3803637252 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81f0009260 msgr2=0x7f82080c9aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:30.791 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.783+0000 7f820e691700 1 --2- 172.21.15.62:0/3803637252 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81f0009260 0x7f82080c9aa0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f81fc032b50 tx=0x7f81fc032e60 comp rx=0 tx=0).stop 2023-06-09T04:41:30.791 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.783+0000 7f820e691700 1 -- 172.21.15.62:0/3803637252 shutdown_connections 2023-06-09T04:41:30.791 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.783+0000 7f820e691700 1 --2- 172.21.15.62:0/3803637252 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f81f40663c0 0x7f81f4068870 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.791 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.783+0000 7f820e691700 1 --2- 172.21.15.62:0/3803637252 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82080ca960 0x7f82080c74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.791 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.783+0000 7f820e691700 1 --2- 172.21.15.62:0/3803637252 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82080ca430 0x7f82080c3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.791 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.783+0000 7f820e691700 1 --2- 172.21.15.62:0/3803637252 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81f0009260 0x7f82080c9aa0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.791 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.783+0000 7f820e691700 1 -- 172.21.15.62:0/3803637252 >> 172.21.15.62:0/3803637252 conn(0x7f82080b0860 msgr2=0x7f82080b1020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:30.792 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.787+0000 7f820e691700 1 -- 172.21.15.62:0/3803637252 shutdown_connections 2023-06-09T04:41:30.792 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.787+0000 7f820e691700 1 -- 172.21.15.62:0/3803637252 wait complete. 2023-06-09T04:41:30.796 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.791+0000 7fef05825700 1 -- 172.21.15.62:0/699371292 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7feee00055c0 con 0x7fef0006afc0 2023-06-09T04:41:30.797 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.791+0000 7feee7fff700 1 -- 172.21.15.62:0/699371292 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7feef0020020 con 0x7fef0006afc0 2023-06-09T04:41:30.797 INFO:teuthology.orchestra.run.smithi062.stdout:55834574859 2023-06-09T04:41:30.801 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.795+0000 7fef05825700 1 -- 172.21.15.62:0/699371292 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7feeec0663c0 msgr2=0x7feeec068870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:30.801 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.795+0000 7fef05825700 1 --2- 172.21.15.62:0/699371292 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7feeec0663c0 0x7feeec068870 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fef000cc8a0 tx=0x7feef4009040 comp rx=0 tx=0).stop 2023-06-09T04:41:30.801 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.795+0000 7fef05825700 1 -- 172.21.15.62:0/699371292 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fef0006afc0 msgr2=0x7fef00155900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:30.801 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.795+0000 7fef05825700 1 --2- 172.21.15.62:0/699371292 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fef0006afc0 0x7fef00155900 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7feef0000c00 tx=0x7feef0004770 comp rx=0 tx=0).stop 2023-06-09T04:41:30.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.795+0000 7fef05825700 1 -- 172.21.15.62:0/699371292 shutdown_connections 2023-06-09T04:41:30.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.795+0000 7fef05825700 1 --2- 172.21.15.62:0/699371292 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7feeec0663c0 0x7feeec068870 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.795+0000 7fef05825700 1 --2- 172.21.15.62:0/699371292 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef000cee40 0x7fef001598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.795+0000 7fef05825700 1 --2- 172.21.15.62:0/699371292 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fef000b5280 0x7fef000b4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.795+0000 7fef05825700 1 --2- 172.21.15.62:0/699371292 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fef0006afc0 0x7fef00155900 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.795+0000 7fef05825700 1 -- 172.21.15.62:0/699371292 >> 172.21.15.62:0/699371292 conn(0x7fef0006a4b0 msgr2=0x7fef001590c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:30.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.795+0000 7fef05825700 1 -- 172.21.15.62:0/699371292 shutdown_connections 2023-06-09T04:41:30.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.795+0000 7fef05825700 1 -- 172.21.15.62:0/699371292 wait complete. 2023-06-09T04:41:30.813 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.1 2023-06-09T04:41:30.813 DEBUG:teuthology.parallel:result is None 2023-06-09T04:41:30.821 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.5 2023-06-09T04:41:30.821 DEBUG:teuthology.parallel:result is None 2023-06-09T04:41:30.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.819+0000 7f3195c91700 1 -- 172.21.15.62:0/8743293 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f31900c5470 con 0x7f31900ca0c0 2023-06-09T04:41:30.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.823+0000 7f3177fff700 1 -- 172.21.15.62:0/8743293 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f31900c5470 con 0x7f31900ca0c0 2023-06-09T04:41:30.828 INFO:teuthology.orchestra.run.smithi062.stdout:55834574860 2023-06-09T04:41:30.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.823+0000 7f3195c91700 1 -- 172.21.15.62:0/8743293 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f317c066370 msgr2=0x7f317c068820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:30.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.823+0000 7f3195c91700 1 --2- 172.21.15.62:0/8743293 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f317c066370 0x7f317c068820 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f31901f1620 tx=0x7f3180009040 comp rx=0 tx=0).stop 2023-06-09T04:41:30.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.823+0000 7f3195c91700 1 -- 172.21.15.62:0/8743293 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f31900ca0c0 msgr2=0x7f319015a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:30.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.823+0000 7f3195c91700 1 --2- 172.21.15.62:0/8743293 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f31900ca0c0 0x7f319015a680 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f318400c750 tx=0x7f318400ca60 comp rx=0 tx=0).stop 2023-06-09T04:41:30.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.823+0000 7f3195c91700 1 -- 172.21.15.62:0/8743293 shutdown_connections 2023-06-09T04:41:30.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.823+0000 7f3195c91700 1 --2- 172.21.15.62:0/8743293 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f317c066370 0x7f317c068820 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.823+0000 7f3195c91700 1 --2- 172.21.15.62:0/8743293 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31901ecf50 0x7f3190158340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.832 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.823+0000 7f3195c91700 1 --2- 172.21.15.62:0/8743293 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f31900cb150 0x7f31901efe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.832 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.823+0000 7f3195c91700 1 --2- 172.21.15.62:0/8743293 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f31900ca0c0 0x7f319015a680 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.832 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.823+0000 7f3195c91700 1 -- 172.21.15.62:0/8743293 >> 172.21.15.62:0/8743293 conn(0x7f3190070c90 msgr2=0x7f31900cbd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:30.832 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.827+0000 7f3195c91700 1 -- 172.21.15.62:0/8743293 shutdown_connections 2023-06-09T04:41:30.832 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.827+0000 7f3195c91700 1 -- 172.21.15.62:0/8743293 wait complete. 2023-06-09T04:41:30.847 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.839+0000 7fa7c1625700 1 -- 172.21.15.62:0/3733560136 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fa7bc0c7270 con 0x7fa7bc0c6690 2023-06-09T04:41:30.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.843+0000 7fa7a37fe700 1 -- 172.21.15.62:0/3733560136 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa7b4055900 con 0x7fa7bc0c6690 2023-06-09T04:41:30.848 INFO:teuthology.orchestra.run.smithi062.stdout:55834574860 2023-06-09T04:41:30.850 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.0 2023-06-09T04:41:30.850 DEBUG:teuthology.parallel:result is None 2023-06-09T04:41:30.851 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.847+0000 7fa7c1625700 1 -- 172.21.15.62:0/3733560136 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fa7a80662f0 msgr2=0x7fa7a80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:30.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.847+0000 7fa7c1625700 1 --2- 172.21.15.62:0/3733560136 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fa7a80662f0 0x7fa7a80687a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc15c030 tx=0x7fa7ac009040 comp rx=0 tx=0).stop 2023-06-09T04:41:30.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.847+0000 7fa7c1625700 1 -- 172.21.15.62:0/3733560136 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa7bc0c6690 msgr2=0x7fa7bc1f5010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:30.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.847+0000 7fa7c1625700 1 --2- 172.21.15.62:0/3733560136 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa7bc0c6690 0x7fa7bc1f5010 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa7b400b730 tx=0x7fa7b4004af0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.847+0000 7fa7c1625700 1 -- 172.21.15.62:0/3733560136 shutdown_connections 2023-06-09T04:41:30.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.847+0000 7fa7c1625700 1 --2- 172.21.15.62:0/3733560136 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fa7a80662f0 0x7fa7a80687a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.847+0000 7fa7c1625700 1 --2- 172.21.15.62:0/3733560136 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7bc160210 0x7fa7bc15b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.847+0000 7fa7c1625700 1 --2- 172.21.15.62:0/3733560136 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7bc0cf540 0x7fa7bc1fe590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.847+0000 7fa7c1625700 1 --2- 172.21.15.62:0/3733560136 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa7bc0c6690 0x7fa7bc1f5010 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.847+0000 7fa7c1625700 1 -- 172.21.15.62:0/3733560136 >> 172.21.15.62:0/3733560136 conn(0x7fa7bc06a4b0 msgr2=0x7fa7bc0c6b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:30.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.847+0000 7fa7c1625700 1 -- 172.21.15.62:0/3733560136 shutdown_connections 2023-06-09T04:41:30.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.847+0000 7fa7c1625700 1 -- 172.21.15.62:0/3733560136 wait complete. 2023-06-09T04:41:30.858 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.851+0000 7f5c3cec3700 1 -- 172.21.15.62:0/3953541087 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5c1c0055c0 con 0x7f5c30036e20 2023-06-09T04:41:30.859 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.851+0000 7f5c26ffd700 1 -- 172.21.15.62:0/3953541087 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5c28017070 con 0x7f5c30036e20 2023-06-09T04:41:30.859 INFO:teuthology.orchestra.run.smithi062.stdout:55834574859 2023-06-09T04:41:30.861 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.855+0000 7f5c3cec3700 1 -- 172.21.15.62:0/3953541087 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f5c180662f0 msgr2=0x7f5c180687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:30.861 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.855+0000 7f5c3cec3700 1 --2- 172.21.15.62:0/3953541087 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f5c180662f0 0x7f5c180687a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c0090b0 tx=0x7f5c2c008030 comp rx=0 tx=0).stop 2023-06-09T04:41:30.861 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.855+0000 7f5c3cec3700 1 -- 172.21.15.62:0/3953541087 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c30036e20 msgr2=0x7f5c3004aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:30.861 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.855+0000 7f5c3cec3700 1 --2- 172.21.15.62:0/3953541087 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c30036e20 0x7f5c3004aa20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5c2800c480 tx=0x7f5c2800c790 comp rx=0 tx=0).stop 2023-06-09T04:41:30.861 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.855+0000 7f5c3cec3700 1 -- 172.21.15.62:0/3953541087 shutdown_connections 2023-06-09T04:41:30.862 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.855+0000 7f5c3cec3700 1 --2- 172.21.15.62:0/3953541087 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f5c180662f0 0x7f5c180687a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.862 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.855+0000 7f5c3cec3700 1 --2- 172.21.15.62:0/3953541087 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5c300c7c20 0x7f5c30038290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.862 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.855+0000 7f5c3cec3700 1 --2- 172.21.15.62:0/3953541087 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5c3004faf0 0x7f5c30055440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.862 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.855+0000 7f5c3cec3700 1 --2- 172.21.15.62:0/3953541087 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5c30036e20 0x7f5c3004aa20 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.862 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.855+0000 7f5c3cec3700 1 -- 172.21.15.62:0/3953541087 >> 172.21.15.62:0/3953541087 conn(0x7f5c30051710 msgr2=0x7f5c300396a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:30.863 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.855+0000 7f5c3cec3700 1 -- 172.21.15.62:0/3953541087 shutdown_connections 2023-06-09T04:41:30.863 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.855+0000 7f5c3cec3700 1 -- 172.21.15.62:0/3953541087 wait complete. 2023-06-09T04:41:30.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.859+0000 7ff89191a700 1 -- 172.21.15.62:0/2786344145 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7ff8840524f0 con 0x7ff8840367b0 2023-06-09T04:41:30.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.859+0000 7ff873fff700 1 -- 172.21.15.62:0/2786344145 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff88c0cd830 con 0x7ff8840367b0 2023-06-09T04:41:30.866 INFO:teuthology.orchestra.run.smithi062.stdout:55834574859 2023-06-09T04:41:30.869 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.863+0000 7ff89191a700 1 -- 172.21.15.62:0/2786344145 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7ff878066370 msgr2=0x7ff878068820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:30.869 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.863+0000 7ff89191a700 1 --2- 172.21.15.62:0/2786344145 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7ff878066370 0x7ff878068820 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff87c014040 tx=0x7ff87c008030 comp rx=0 tx=0).stop 2023-06-09T04:41:30.869 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.863+0000 7ff89191a700 1 -- 172.21.15.62:0/2786344145 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8840367b0 msgr2=0x7ff8840dd6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:30.870 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.863+0000 7ff89191a700 1 --2- 172.21.15.62:0/2786344145 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8840367b0 0x7ff8840dd6a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff88c068190 tx=0x7ff88c06cc70 comp rx=0 tx=0).stop 2023-06-09T04:41:30.870 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.863+0000 7ff89191a700 1 -- 172.21.15.62:0/2786344145 shutdown_connections 2023-06-09T04:41:30.870 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.863+0000 7ff89191a700 1 --2- 172.21.15.62:0/2786344145 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7ff878066370 0x7ff878068820 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.870 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.863+0000 7ff89191a700 1 --2- 172.21.15.62:0/2786344145 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff8840e2880 0x7ff8840ddd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.870 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.863+0000 7ff89191a700 1 --2- 172.21.15.62:0/2786344145 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8840367b0 0x7ff8840dd6a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.870 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.863+0000 7ff89191a700 1 --2- 172.21.15.62:0/2786344145 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff884006e60 0x7ff8840e41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.870 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.863+0000 7ff89191a700 1 -- 172.21.15.62:0/2786344145 >> 172.21.15.62:0/2786344145 conn(0x7ff8840517b0 msgr2=0x7ff8840df310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:30.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.863+0000 7ff89191a700 1 -- 172.21.15.62:0/2786344145 shutdown_connections 2023-06-09T04:41:30.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.863+0000 7ff89191a700 1 -- 172.21.15.62:0/2786344145 wait complete. 2023-06-09T04:41:30.873 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.867+0000 7f6907da7700 1 -- 172.21.15.62:0/3876896322 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f68f8057ae0 con 0x7f68f80e1bc0 2023-06-09T04:41:30.874 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.4 2023-06-09T04:41:30.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.867+0000 7f68f67fc700 1 -- 172.21.15.62:0/3876896322 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f68f0017090 con 0x7f68f80e1bc0 2023-06-09T04:41:30.874 DEBUG:teuthology.parallel:result is None 2023-06-09T04:41:30.875 INFO:teuthology.orchestra.run.smithi062.stdout:55834574858 2023-06-09T04:41:30.877 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.871+0000 7f6907da7700 1 -- 172.21.15.62:0/3876896322 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f68e40663c0 msgr2=0x7f68e4068870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:30.877 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.871+0000 7f6907da7700 1 --2- 172.21.15.62:0/3876896322 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f68e40663c0 0x7f68e4068870 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f68fc009910 tx=0x7f68fc008030 comp rx=0 tx=0).stop 2023-06-09T04:41:30.877 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.871+0000 7f6907da7700 1 -- 172.21.15.62:0/3876896322 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68f80e1bc0 msgr2=0x7f68f80cdb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:30.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.871+0000 7f6907da7700 1 --2- 172.21.15.62:0/3876896322 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68f80e1bc0 0x7f68f80cdb50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f68f000e9d0 tx=0x7f68f000ece0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.871+0000 7f6907da7700 1 -- 172.21.15.62:0/3876896322 shutdown_connections 2023-06-09T04:41:30.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.871+0000 7f6907da7700 1 --2- 172.21.15.62:0/3876896322 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f68e40663c0 0x7f68e4068870 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.871+0000 7f6907da7700 1 --2- 172.21.15.62:0/3876896322 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f68f804d400 0x7f68f803b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.871+0000 7f6907da7700 1 --2- 172.21.15.62:0/3876896322 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f68f80e1bc0 0x7f68f80cdb50 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.871+0000 7f6907da7700 1 --2- 172.21.15.62:0/3876896322 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68f80518c0 0x7f68f804bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:30.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.871+0000 7f6907da7700 1 -- 172.21.15.62:0/3876896322 >> 172.21.15.62:0/3876896322 conn(0x7f68f800cf50 msgr2=0x7f68f80e1f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:30.879 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.871+0000 7f6907da7700 1 -- 172.21.15.62:0/3876896322 shutdown_connections 2023-06-09T04:41:30.879 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:30.871+0000 7f6907da7700 1 -- 172.21.15.62:0/3876896322 wait complete. 2023-06-09T04:41:30.880 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.3 2023-06-09T04:41:30.881 DEBUG:teuthology.parallel:result is None 2023-06-09T04:41:30.888 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.7 2023-06-09T04:41:30.889 DEBUG:teuthology.parallel:result is None 2023-06-09T04:41:30.896 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.6 2023-06-09T04:41:30.897 DEBUG:teuthology.parallel:result is None 2023-06-09T04:41:30.897 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-06-09T04:41:30.897 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-09T04:41:31.106 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.099+0000 7f28a41c6700 1 Processor -- start 2023-06-09T04:41:31.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.103+0000 7f28a41c6700 1 -- start start 2023-06-09T04:41:31.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.103+0000 7f28a41c6700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f289c159c90 0x7f289c070e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:31.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.103+0000 7f28a41c6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f289c0cb850 0x7f289c071340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:31.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.103+0000 7f28a41c6700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f289c071880 con 0x7f289c0b08d0 2023-06-09T04:41:31.110 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.103+0000 7f28a41c6700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f289c06b960 con 0x7f289c159c90 2023-06-09T04:41:31.110 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.103+0000 7f28a41c6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f289c06f9b0 con 0x7f289c0cb850 2023-06-09T04:41:31.110 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.103+0000 7f28a1f62700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f289c159c90 0x7f289c070e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:31.110 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.103+0000 7f28a2763700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f289c0b08d0 0x7f289c0ca160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36232/0 (socket says 172.21.15.62:36232) 2023-06-09T04:41:31.110 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.103+0000 7f28a1761700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f289c0cb850 0x7f289c071340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:31.110 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.103+0000 7f28a2763700 1 -- 172.21.15.62:0/472521007 learned_addr learned my addr 172.21.15.62:0/472521007 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:41:31.111 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.103+0000 7f28a1f62700 1 -- 172.21.15.62:0/472521007 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f289c0cb850 msgr2=0x7f289c071340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:31.111 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.103+0000 7f28a1f62700 1 --2- 172.21.15.62:0/472521007 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f289c0cb850 0x7f289c071340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:31.111 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.103+0000 7f28a1f62700 1 -- 172.21.15.62:0/472521007 >> v1:172.21.15.62:6789/0 conn(0x7f289c0b08d0 legacy=0x7f289c0ca160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:31.111 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.103+0000 7f28a1f62700 1 -- 172.21.15.62:0/472521007 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f289c15a060 con 0x7f289c159c90 2023-06-09T04:41:31.111 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.103+0000 7f28a0f60700 1 -- 172.21.15.62:0/472521007 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1832697675 0 0) 0x7f289c071880 con 0x7f289c0b08d0 2023-06-09T04:41:31.112 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.107+0000 7f28a1f62700 1 --2- 172.21.15.62:0/472521007 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f289c159c90 0x7f289c070e00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2898009850 tx=0x7f2898009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89ae67b68b7eb706 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:31.112 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.107+0000 7f28a0f60700 1 -- 172.21.15.62:0/472521007 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2898011830 con 0x7f289c159c90 2023-06-09T04:41:31.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.107+0000 7f28a0f60700 1 -- 172.21.15.62:0/472521007 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2898011990 con 0x7f289c159c90 2023-06-09T04:41:31.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.107+0000 7f28a0f60700 1 -- 172.21.15.62:0/472521007 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2898011d40 con 0x7f289c159c90 2023-06-09T04:41:31.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.107+0000 7f28a41c6700 1 -- 172.21.15.62:0/472521007 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f289c159c90 msgr2=0x7f289c070e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:31.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.107+0000 7f28a41c6700 1 --2- 172.21.15.62:0/472521007 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f289c159c90 0x7f289c070e00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2898009850 tx=0x7f2898009b60 comp rx=0 tx=0).stop 2023-06-09T04:41:31.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.107+0000 7f28a41c6700 1 -- 172.21.15.62:0/472521007 shutdown_connections 2023-06-09T04:41:31.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.107+0000 7f28a41c6700 1 --2- 172.21.15.62:0/472521007 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f289c0cb850 0x7f289c071340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:31.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.107+0000 7f28a41c6700 1 --2- 172.21.15.62:0/472521007 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f289c159c90 0x7f289c070e00 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:31.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.107+0000 7f28a41c6700 1 -- 172.21.15.62:0/472521007 >> 172.21.15.62:0/472521007 conn(0x7f289c06a410 msgr2=0x7f289c0afd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:31.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.107+0000 7f28a41c6700 1 -- 172.21.15.62:0/472521007 shutdown_connections 2023-06-09T04:41:31.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.107+0000 7f28a41c6700 1 -- 172.21.15.62:0/472521007 wait complete. 2023-06-09T04:41:31.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.107+0000 7f28a41c6700 1 Processor -- start 2023-06-09T04:41:31.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.111+0000 7f28a41c6700 1 -- start start 2023-06-09T04:41:31.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.111+0000 7f28a41c6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f289c0b08d0 0x7f289c0c7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:31.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.111+0000 7f28a41c6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f289c0cb850 0x7f289c0c5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:31.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.111+0000 7f28a41c6700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f289c159c90 0x7f289c0b38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:31.117 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.111+0000 7f28a41c6700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f289c0c7d70 con 0x7f289c0cb850 2023-06-09T04:41:31.117 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.111+0000 7f28a41c6700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f289c0ac2c0 con 0x7f289c159c90 2023-06-09T04:41:31.117 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.111+0000 7f28a41c6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f289c0c6310 con 0x7f289c0b08d0 2023-06-09T04:41:31.118 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.111+0000 7f28a1761700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f289c0cb850 0x7f289c0c5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:31.118 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.111+0000 7f28a1761700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f289c0cb850 0x7f289c0c5dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53322/0 (socket says 172.21.15.62:53322) 2023-06-09T04:41:31.118 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.111+0000 7f28a1761700 1 -- 172.21.15.62:0/2634846281 learned_addr learned my addr 172.21.15.62:0/2634846281 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:31.118 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.111+0000 7f28a2763700 1 --2- 172.21.15.62:0/2634846281 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f289c159c90 0x7f289c0b38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:31.118 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.111+0000 7f28a1f62700 1 --2- 172.21.15.62:0/2634846281 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f289c0b08d0 0x7f289c0c7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:31.118 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.111+0000 7f28a1761700 1 -- 172.21.15.62:0/2634846281 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f289c0b08d0 msgr2=0x7f289c0c7830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:31.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.111+0000 7f28a1761700 1 --2- 172.21.15.62:0/2634846281 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f289c0b08d0 0x7f289c0c7830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:31.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.111+0000 7f28a1761700 1 -- 172.21.15.62:0/2634846281 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f289c159c90 msgr2=0x7f289c0b38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:31.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.111+0000 7f28a1761700 1 --2- 172.21.15.62:0/2634846281 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f289c159c90 0x7f289c0b38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:31.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.111+0000 7f28a1761700 1 -- 172.21.15.62:0/2634846281 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28980094b0 con 0x7f289c0cb850 2023-06-09T04:41:31.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.111+0000 7f28a1761700 1 --2- 172.21.15.62:0/2634846281 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f289c0cb850 0x7f289c0c5dd0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f288c00e9d0 tx=0x7f288c00ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:31.120 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.111+0000 7f28927fc700 1 -- 172.21.15.62:0/2634846281 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288c009720 con 0x7f289c0cb850 2023-06-09T04:41:31.120 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.111+0000 7f28927fc700 1 -- 172.21.15.62:0/2634846281 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f288c00c850 con 0x7f289c0cb850 2023-06-09T04:41:31.120 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.111+0000 7f28a41c6700 1 -- 172.21.15.62:0/2634846281 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f289c0b3de0 con 0x7f289c0cb850 2023-06-09T04:41:31.120 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.111+0000 7f28927fc700 1 -- 172.21.15.62:0/2634846281 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288c00cc00 con 0x7f289c0cb850 2023-06-09T04:41:31.120 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.111+0000 7f28a41c6700 1 -- 172.21.15.62:0/2634846281 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f289c0ac510 con 0x7f289c0cb850 2023-06-09T04:41:31.121 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.115+0000 7f28a41c6700 1 -- 172.21.15.62:0/2634846281 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f289c04db30 con 0x7f289c0cb850 2023-06-09T04:41:31.121 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.115+0000 7f28927fc700 1 -- 172.21.15.62:0/2634846281 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f288c00cd60 con 0x7f289c0cb850 2023-06-09T04:41:31.122 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.115+0000 7f28927fc700 1 --2- 172.21.15.62:0/2634846281 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f28800662f0 0x7f28800687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:31.123 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.119+0000 7f28927fc700 1 -- 172.21.15.62:0/2634846281 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f288c084120 con 0x7f289c0cb850 2023-06-09T04:41:31.123 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.119+0000 7f28a1f62700 1 --2- 172.21.15.62:0/2634846281 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f28800662f0 0x7f28800687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:31.124 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.119+0000 7f28a1f62700 1 --2- 172.21.15.62:0/2634846281 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f28800662f0 0x7f28800687a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f28980090b0 tx=0x7f289801c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:31.128 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.123+0000 7f28927fc700 1 -- 172.21.15.62:0/2634846281 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f288c051190 con 0x7f289c0cb850 2023-06-09T04:41:31.294 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.287+0000 7f28a41c6700 1 -- 172.21.15.62:0/2634846281 --> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f289c0c8cc0 con 0x7f28800662f0 2023-06-09T04:41:31.311 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.303+0000 7f28927fc700 1 -- 172.21.15.62:0/2634846281 <== mgr.4106 v2:172.21.15.89:6832/3073446405 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367186 (secure 0 0 0) 0x7f2898011cb0 con 0x7f28800662f0 2023-06-09T04:41:31.313 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:41:31.321 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.315+0000 7f28a41c6700 1 -- 172.21.15.62:0/2634846281 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f28800662f0 msgr2=0x7f28800687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:31.321 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.315+0000 7f28a41c6700 1 --2- 172.21.15.62:0/2634846281 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f28800662f0 0x7f28800687a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f28980090b0 tx=0x7f289801c040 comp rx=0 tx=0).stop 2023-06-09T04:41:31.321 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.315+0000 7f28a41c6700 1 -- 172.21.15.62:0/2634846281 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f289c0cb850 msgr2=0x7f289c0c5dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:31.321 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.315+0000 7f28a41c6700 1 --2- 172.21.15.62:0/2634846281 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f289c0cb850 0x7f289c0c5dd0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f288c00e9d0 tx=0x7f288c00ece0 comp rx=0 tx=0).stop 2023-06-09T04:41:31.322 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.315+0000 7f28a41c6700 1 -- 172.21.15.62:0/2634846281 shutdown_connections 2023-06-09T04:41:31.322 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.315+0000 7f28a41c6700 1 --2- 172.21.15.62:0/2634846281 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f28800662f0 0x7f28800687a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:31.322 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.315+0000 7f28a41c6700 1 --2- 172.21.15.62:0/2634846281 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f289c159c90 0x7f289c0b38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:31.322 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.315+0000 7f28a41c6700 1 --2- 172.21.15.62:0/2634846281 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f289c0cb850 0x7f289c0c5dd0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:31.322 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.315+0000 7f28a41c6700 1 --2- 172.21.15.62:0/2634846281 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f289c0b08d0 0x7f289c0c7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:31.322 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.315+0000 7f28a41c6700 1 -- 172.21.15.62:0/2634846281 >> 172.21.15.62:0/2634846281 conn(0x7f289c06a410 msgr2=0x7f289c0ca2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:31.322 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.315+0000 7f28a41c6700 1 -- 172.21.15.62:0/2634846281 shutdown_connections 2023-06-09T04:41:31.323 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.315+0000 7f28a41c6700 1 -- 172.21.15.62:0/2634846281 wait complete. 2023-06-09T04:41:31.323 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2023-06-09T04:41:31.344 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":45,"stamp":"2023-06-09T04:41:30.576237+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594959,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219208,"kb_used_data":3592,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755512,"statfs":{"total":773094113280,"available":772869644288,"internally_reserved":0,"allocated":3678208,"data_stored":2186494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005607"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.421613+0000","last_change":"2023-06-09T04:41:00.837443+0000","last_active":"2023-06-09T04:41:01.421613+0000","last_peered":"2023-06-09T04:41:01.421613+0000","last_clean":"2023-06-09T04:41:01.421613+0000","last_became_active":"2023-06-09T04:41:00.837056+0000","last_became_peered":"2023-06-09T04:41:00.837056+0000","last_unstale":"2023-06-09T04:41:01.421613+0000","last_undegraded":"2023-06-09T04:41:01.421613+0000","last_fullsized":"2023-06-09T04:41:01.421613+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:12:34.351708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.283099+0000","last_change":"2023-06-09T04:40:56.317710+0000","last_active":"2023-06-09T04:41:01.283099+0000","last_peered":"2023-06-09T04:41:01.283099+0000","last_clean":"2023-06-09T04:41:01.283099+0000","last_became_active":"2023-06-09T04:40:56.317367+0000","last_became_peered":"2023-06-09T04:40:56.317367+0000","last_unstale":"2023-06-09T04:41:01.283099+0000","last_undegraded":"2023-06-09T04:41:01.283099+0000","last_fullsized":"2023-06-09T04:41:01.283099+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:08:05.189610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.285106+0000","last_change":"2023-06-09T04:40:56.786880+0000","last_active":"2023-06-09T04:41:01.285106+0000","last_peered":"2023-06-09T04:41:01.285106+0000","last_clean":"2023-06-09T04:41:01.285106+0000","last_became_active":"2023-06-09T04:40:56.786577+0000","last_became_peered":"2023-06-09T04:40:56.786577+0000","last_unstale":"2023-06-09T04:41:01.285106+0000","last_undegraded":"2023-06-09T04:41:01.285106+0000","last_fullsized":"2023-06-09T04:41:01.285106+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:08:26.522608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.284846+0000","last_change":"2023-06-09T04:41:00.821962+0000","last_active":"2023-06-09T04:41:01.284846+0000","last_peered":"2023-06-09T04:41:01.284846+0000","last_clean":"2023-06-09T04:41:01.284846+0000","last_became_active":"2023-06-09T04:41:00.821590+0000","last_became_peered":"2023-06-09T04:41:00.821590+0000","last_unstale":"2023-06-09T04:41:01.284846+0000","last_undegraded":"2023-06-09T04:41:01.284846+0000","last_fullsized":"2023-06-09T04:41:01.284846+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:24:19.683717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.438875+0000","last_change":"2023-06-09T04:40:56.309042+0000","last_active":"2023-06-09T04:41:01.438875+0000","last_peered":"2023-06-09T04:41:01.438875+0000","last_clean":"2023-06-09T04:41:01.438875+0000","last_became_active":"2023-06-09T04:40:56.308672+0000","last_became_peered":"2023-06-09T04:40:56.308672+0000","last_unstale":"2023-06-09T04:41:01.438875+0000","last_undegraded":"2023-06-09T04:41:01.438875+0000","last_fullsized":"2023-06-09T04:41:01.438875+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:24:15.161832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.436648+0000","last_change":"2023-06-09T04:40:56.792828+0000","last_active":"2023-06-09T04:41:01.436648+0000","last_peered":"2023-06-09T04:41:01.436648+0000","last_clean":"2023-06-09T04:41:01.436648+0000","last_became_active":"2023-06-09T04:40:56.788328+0000","last_became_peered":"2023-06-09T04:40:56.788328+0000","last_unstale":"2023-06-09T04:41:01.436648+0000","last_undegraded":"2023-06-09T04:41:01.436648+0000","last_fullsized":"2023-06-09T04:41:01.436648+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:52:44.006009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.438852+0000","last_change":"2023-06-09T04:41:00.839470+0000","last_active":"2023-06-09T04:41:01.438852+0000","last_peered":"2023-06-09T04:41:01.438852+0000","last_clean":"2023-06-09T04:41:01.438852+0000","last_became_active":"2023-06-09T04:41:00.839052+0000","last_became_peered":"2023-06-09T04:41:00.839052+0000","last_unstale":"2023-06-09T04:41:01.438852+0000","last_undegraded":"2023-06-09T04:41:01.438852+0000","last_fullsized":"2023-06-09T04:41:01.438852+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:49:49.299980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.439510+0000","last_change":"2023-06-09T04:40:56.321454+0000","last_active":"2023-06-09T04:41:01.439510+0000","last_peered":"2023-06-09T04:41:01.439510+0000","last_clean":"2023-06-09T04:41:01.439510+0000","last_became_active":"2023-06-09T04:40:56.321031+0000","last_became_peered":"2023-06-09T04:40:56.321031+0000","last_unstale":"2023-06-09T04:41:01.439510+0000","last_undegraded":"2023-06-09T04:41:01.439510+0000","last_fullsized":"2023-06-09T04:41:01.439510+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:25:05.608273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.285103+0000","last_change":"2023-06-09T04:40:56.803877+0000","last_active":"2023-06-09T04:41:01.285103+0000","last_peered":"2023-06-09T04:41:01.285103+0000","last_clean":"2023-06-09T04:41:01.285103+0000","last_became_active":"2023-06-09T04:40:56.798582+0000","last_became_peered":"2023-06-09T04:40:56.798582+0000","last_unstale":"2023-06-09T04:41:01.285103+0000","last_undegraded":"2023-06-09T04:41:01.285103+0000","last_fullsized":"2023-06-09T04:41:01.285103+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:21:53.601425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.439153+0000","last_change":"2023-06-09T04:41:00.836245+0000","last_active":"2023-06-09T04:41:01.439153+0000","last_peered":"2023-06-09T04:41:01.439153+0000","last_clean":"2023-06-09T04:41:01.439153+0000","last_became_active":"2023-06-09T04:41:00.835686+0000","last_became_peered":"2023-06-09T04:41:00.835686+0000","last_unstale":"2023-06-09T04:41:01.439153+0000","last_undegraded":"2023-06-09T04:41:01.439153+0000","last_fullsized":"2023-06-09T04:41:01.439153+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:03:10.253378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.440020+0000","last_change":"2023-06-09T04:40:56.321489+0000","last_active":"2023-06-09T04:41:01.440020+0000","last_peered":"2023-06-09T04:41:01.440020+0000","last_clean":"2023-06-09T04:41:01.440020+0000","last_became_active":"2023-06-09T04:40:56.321100+0000","last_became_peered":"2023-06-09T04:40:56.321100+0000","last_unstale":"2023-06-09T04:41:01.440020+0000","last_undegraded":"2023-06-09T04:41:01.440020+0000","last_fullsized":"2023-06-09T04:41:01.440020+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:17:49.593978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.285507+0000","last_change":"2023-06-09T04:40:56.794715+0000","last_active":"2023-06-09T04:41:01.285507+0000","last_peered":"2023-06-09T04:41:01.285507+0000","last_clean":"2023-06-09T04:41:01.285507+0000","last_became_active":"2023-06-09T04:40:56.794493+0000","last_became_peered":"2023-06-09T04:40:56.794493+0000","last_unstale":"2023-06-09T04:41:01.285507+0000","last_undegraded":"2023-06-09T04:41:01.285507+0000","last_fullsized":"2023-06-09T04:41:01.285507+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:08:24.838920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.422791+0000","last_change":"2023-06-09T04:41:00.828797+0000","last_active":"2023-06-09T04:41:01.422791+0000","last_peered":"2023-06-09T04:41:01.422791+0000","last_clean":"2023-06-09T04:41:01.422791+0000","last_became_active":"2023-06-09T04:41:00.828438+0000","last_became_peered":"2023-06-09T04:41:00.828438+0000","last_unstale":"2023-06-09T04:41:01.422791+0000","last_undegraded":"2023-06-09T04:41:01.422791+0000","last_fullsized":"2023-06-09T04:41:01.422791+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:24:29.997250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.282480+0000","last_change":"2023-06-09T04:40:56.317253+0000","last_active":"2023-06-09T04:41:01.282480+0000","last_peered":"2023-06-09T04:41:01.282480+0000","last_clean":"2023-06-09T04:41:01.282480+0000","last_became_active":"2023-06-09T04:40:56.316877+0000","last_became_peered":"2023-06-09T04:40:56.316877+0000","last_unstale":"2023-06-09T04:41:01.282480+0000","last_undegraded":"2023-06-09T04:41:01.282480+0000","last_fullsized":"2023-06-09T04:41:01.282480+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:25:25.277964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.437522+0000","last_change":"2023-06-09T04:40:56.797830+0000","last_active":"2023-06-09T04:41:01.437522+0000","last_peered":"2023-06-09T04:41:01.437522+0000","last_clean":"2023-06-09T04:41:01.437522+0000","last_became_active":"2023-06-09T04:40:56.797556+0000","last_became_peered":"2023-06-09T04:40:56.797556+0000","last_unstale":"2023-06-09T04:41:01.437522+0000","last_undegraded":"2023-06-09T04:41:01.437522+0000","last_fullsized":"2023-06-09T04:41:01.437522+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:43:46.753266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.286268+0000","last_change":"2023-06-09T04:41:00.825865+0000","last_active":"2023-06-09T04:41:01.286268+0000","last_peered":"2023-06-09T04:41:01.286268+0000","last_clean":"2023-06-09T04:41:01.286268+0000","last_became_active":"2023-06-09T04:41:00.825477+0000","last_became_peered":"2023-06-09T04:41:00.825477+0000","last_unstale":"2023-06-09T04:41:01.286268+0000","last_undegraded":"2023-06-09T04:41:01.286268+0000","last_fullsized":"2023-06-09T04:41:01.286268+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:51:30.775136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.285644+0000","last_change":"2023-06-09T04:40:56.315320+0000","last_active":"2023-06-09T04:41:01.285644+0000","last_peered":"2023-06-09T04:41:01.285644+0000","last_clean":"2023-06-09T04:41:01.285644+0000","last_became_active":"2023-06-09T04:40:56.314967+0000","last_became_peered":"2023-06-09T04:40:56.314967+0000","last_unstale":"2023-06-09T04:41:01.285644+0000","last_undegraded":"2023-06-09T04:41:01.285644+0000","last_fullsized":"2023-06-09T04:41:01.285644+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:01:49.680802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.438480+0000","last_change":"2023-06-09T04:40:56.798062+0000","last_active":"2023-06-09T04:41:01.438480+0000","last_peered":"2023-06-09T04:41:01.438480+0000","last_clean":"2023-06-09T04:41:01.438480+0000","last_became_active":"2023-06-09T04:40:56.795892+0000","last_became_peered":"2023-06-09T04:40:56.795892+0000","last_unstale":"2023-06-09T04:41:01.438480+0000","last_undegraded":"2023-06-09T04:41:01.438480+0000","last_fullsized":"2023-06-09T04:41:01.438480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:48:05.320971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.287250+0000","last_change":"2023-06-09T04:41:00.829272+0000","last_active":"2023-06-09T04:41:01.287250+0000","last_peered":"2023-06-09T04:41:01.287250+0000","last_clean":"2023-06-09T04:41:01.287250+0000","last_became_active":"2023-06-09T04:41:00.828913+0000","last_became_peered":"2023-06-09T04:41:00.828913+0000","last_unstale":"2023-06-09T04:41:01.287250+0000","last_undegraded":"2023-06-09T04:41:01.287250+0000","last_fullsized":"2023-06-09T04:41:01.287250+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:36:54.747824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.423032+0000","last_change":"2023-06-09T04:40:56.320610+0000","last_active":"2023-06-09T04:41:01.423032+0000","last_peered":"2023-06-09T04:41:01.423032+0000","last_clean":"2023-06-09T04:41:01.423032+0000","last_became_active":"2023-06-09T04:40:56.320210+0000","last_became_peered":"2023-06-09T04:40:56.320210+0000","last_unstale":"2023-06-09T04:41:01.423032+0000","last_undegraded":"2023-06-09T04:41:01.423032+0000","last_fullsized":"2023-06-09T04:41:01.423032+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:43:30.487796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.282810+0000","last_change":"2023-06-09T04:40:56.800181+0000","last_active":"2023-06-09T04:41:01.282810+0000","last_peered":"2023-06-09T04:41:01.282810+0000","last_clean":"2023-06-09T04:41:01.282810+0000","last_became_active":"2023-06-09T04:40:56.798880+0000","last_became_peered":"2023-06-09T04:40:56.798880+0000","last_unstale":"2023-06-09T04:41:01.282810+0000","last_undegraded":"2023-06-09T04:41:01.282810+0000","last_fullsized":"2023-06-09T04:41:01.282810+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:43:31.500509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.282532+0000","last_change":"2023-06-09T04:41:00.841825+0000","last_active":"2023-06-09T04:41:01.282532+0000","last_peered":"2023-06-09T04:41:01.282532+0000","last_clean":"2023-06-09T04:41:01.282532+0000","last_became_active":"2023-06-09T04:41:00.841441+0000","last_became_peered":"2023-06-09T04:41:00.841441+0000","last_unstale":"2023-06-09T04:41:01.282532+0000","last_undegraded":"2023-06-09T04:41:01.282532+0000","last_fullsized":"2023-06-09T04:41:01.282532+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:24:29.997250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.436487+0000","last_change":"2023-06-09T04:40:56.314387+0000","last_active":"2023-06-09T04:41:01.436487+0000","last_peered":"2023-06-09T04:41:01.436487+0000","last_clean":"2023-06-09T04:41:01.436487+0000","last_became_active":"2023-06-09T04:40:56.314056+0000","last_became_peered":"2023-06-09T04:40:56.314056+0000","last_unstale":"2023-06-09T04:41:01.436487+0000","last_undegraded":"2023-06-09T04:41:01.436487+0000","last_fullsized":"2023-06-09T04:41:01.436487+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:03:05.731493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.287409+0000","last_change":"2023-06-09T04:40:56.799527+0000","last_active":"2023-06-09T04:41:01.287409+0000","last_peered":"2023-06-09T04:41:01.287409+0000","last_clean":"2023-06-09T04:41:01.287409+0000","last_became_active":"2023-06-09T04:40:56.799215+0000","last_became_peered":"2023-06-09T04:40:56.799215+0000","last_unstale":"2023-06-09T04:41:01.287409+0000","last_undegraded":"2023-06-09T04:41:01.287409+0000","last_fullsized":"2023-06-09T04:41:01.287409+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:34:05.634982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.436197+0000","last_change":"2023-06-09T04:40:56.785429+0000","last_active":"2023-06-09T04:41:01.436197+0000","last_peered":"2023-06-09T04:41:01.436197+0000","last_clean":"2023-06-09T04:41:01.436197+0000","last_became_active":"2023-06-09T04:40:56.785114+0000","last_became_peered":"2023-06-09T04:40:56.785114+0000","last_unstale":"2023-06-09T04:41:01.436197+0000","last_undegraded":"2023-06-09T04:41:01.436197+0000","last_fullsized":"2023-06-09T04:41:01.436197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:06:43.179689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.283223+0000","last_change":"2023-06-09T04:40:56.317391+0000","last_active":"2023-06-09T04:41:01.283223+0000","last_peered":"2023-06-09T04:41:01.283223+0000","last_clean":"2023-06-09T04:41:01.283223+0000","last_became_active":"2023-06-09T04:40:56.317009+0000","last_became_peered":"2023-06-09T04:40:56.317009+0000","last_unstale":"2023-06-09T04:41:01.283223+0000","last_undegraded":"2023-06-09T04:41:01.283223+0000","last_fullsized":"2023-06-09T04:41:01.283223+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:52:42.993296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.285830+0000","last_change":"2023-06-09T04:41:00.835405+0000","last_active":"2023-06-09T04:41:01.285830+0000","last_peered":"2023-06-09T04:41:01.285830+0000","last_clean":"2023-06-09T04:41:01.285830+0000","last_became_active":"2023-06-09T04:41:00.834994+0000","last_became_peered":"2023-06-09T04:41:00.834994+0000","last_unstale":"2023-06-09T04:41:01.285830+0000","last_undegraded":"2023-06-09T04:41:01.285830+0000","last_fullsized":"2023-06-09T04:41:01.285830+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:47:36.457098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.436354+0000","last_change":"2023-06-09T04:40:56.796887+0000","last_active":"2023-06-09T04:41:01.436354+0000","last_peered":"2023-06-09T04:41:01.436354+0000","last_clean":"2023-06-09T04:41:01.436354+0000","last_became_active":"2023-06-09T04:40:56.796261+0000","last_became_peered":"2023-06-09T04:40:56.796261+0000","last_unstale":"2023-06-09T04:41:01.436354+0000","last_undegraded":"2023-06-09T04:41:01.436354+0000","last_fullsized":"2023-06-09T04:41:01.436354+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:04:45.938545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.440403+0000","last_change":"2023-06-09T04:40:56.316780+0000","last_active":"2023-06-09T04:41:01.440403+0000","last_peered":"2023-06-09T04:41:01.440403+0000","last_clean":"2023-06-09T04:41:01.440403+0000","last_became_active":"2023-06-09T04:40:56.315706+0000","last_became_peered":"2023-06-09T04:40:56.315706+0000","last_unstale":"2023-06-09T04:41:01.440403+0000","last_undegraded":"2023-06-09T04:41:01.440403+0000","last_fullsized":"2023-06-09T04:41:01.440403+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:24:25.475365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.438087+0000","last_change":"2023-06-09T04:41:00.831457+0000","last_active":"2023-06-09T04:41:01.438087+0000","last_peered":"2023-06-09T04:41:01.438087+0000","last_clean":"2023-06-09T04:41:01.438087+0000","last_became_active":"2023-06-09T04:41:00.830962+0000","last_became_peered":"2023-06-09T04:41:00.830962+0000","last_unstale":"2023-06-09T04:41:01.438087+0000","last_undegraded":"2023-06-09T04:41:01.438087+0000","last_fullsized":"2023-06-09T04:41:01.438087+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:20:23.212298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.439608+0000","last_change":"2023-06-09T04:40:56.322126+0000","last_active":"2023-06-09T04:41:01.439608+0000","last_peered":"2023-06-09T04:41:01.439608+0000","last_clean":"2023-06-09T04:41:01.439608+0000","last_became_active":"2023-06-09T04:40:56.321833+0000","last_became_peered":"2023-06-09T04:40:56.321833+0000","last_unstale":"2023-06-09T04:41:01.439608+0000","last_undegraded":"2023-06-09T04:41:01.439608+0000","last_fullsized":"2023-06-09T04:41:01.439608+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:52:42.993296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.422084+0000","last_change":"2023-06-09T04:40:56.810607+0000","last_active":"2023-06-09T04:41:01.422084+0000","last_peered":"2023-06-09T04:41:01.422084+0000","last_clean":"2023-06-09T04:41:01.422084+0000","last_became_active":"2023-06-09T04:40:56.806121+0000","last_became_peered":"2023-06-09T04:40:56.806121+0000","last_unstale":"2023-06-09T04:41:01.422084+0000","last_undegraded":"2023-06-09T04:41:01.422084+0000","last_fullsized":"2023-06-09T04:41:01.422084+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:17:50.606690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.436321+0000","last_change":"2023-06-09T04:41:00.825055+0000","last_active":"2023-06-09T04:41:01.436321+0000","last_peered":"2023-06-09T04:41:01.436321+0000","last_clean":"2023-06-09T04:41:01.436321+0000","last_became_active":"2023-06-09T04:41:00.824544+0000","last_became_peered":"2023-06-09T04:41:00.824544+0000","last_unstale":"2023-06-09T04:41:01.436321+0000","last_undegraded":"2023-06-09T04:41:01.436321+0000","last_fullsized":"2023-06-09T04:41:01.436321+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:43:35.009681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"28'10","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:14.324470+0000","last_change":"2023-06-09T04:40:56.314806+0000","last_active":"2023-06-09T04:41:14.324470+0000","last_peered":"2023-06-09T04:41:14.324470+0000","last_clean":"2023-06-09T04:41:14.324470+0000","last_became_active":"2023-06-09T04:40:56.312677+0000","last_became_peered":"2023-06-09T04:40:56.312677+0000","last_unstale":"2023-06-09T04:41:14.324470+0000","last_undegraded":"2023-06-09T04:41:14.324470+0000","last_fullsized":"2023-06-09T04:41:14.324470+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:50:18.781041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3793,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.285588+0000","last_change":"2023-06-09T04:40:56.787806+0000","last_active":"2023-06-09T04:41:01.285588+0000","last_peered":"2023-06-09T04:41:01.285588+0000","last_clean":"2023-06-09T04:41:01.285588+0000","last_became_active":"2023-06-09T04:40:56.787509+0000","last_became_peered":"2023-06-09T04:40:56.787509+0000","last_unstale":"2023-06-09T04:41:01.285588+0000","last_undegraded":"2023-06-09T04:41:01.285588+0000","last_fullsized":"2023-06-09T04:41:01.285588+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T04:54:37.254871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.421967+0000","last_change":"2023-06-09T04:41:00.837111+0000","last_active":"2023-06-09T04:41:01.421967+0000","last_peered":"2023-06-09T04:41:01.421967+0000","last_clean":"2023-06-09T04:41:01.421967+0000","last_became_active":"2023-06-09T04:41:00.836434+0000","last_became_peered":"2023-06-09T04:41:00.836434+0000","last_unstale":"2023-06-09T04:41:01.421967+0000","last_undegraded":"2023-06-09T04:41:01.421967+0000","last_fullsized":"2023-06-09T04:41:01.421967+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:47:47.084156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.285632+0000","last_change":"2023-06-09T04:40:56.798290+0000","last_active":"2023-06-09T04:41:01.285632+0000","last_peered":"2023-06-09T04:41:01.285632+0000","last_clean":"2023-06-09T04:41:01.285632+0000","last_became_active":"2023-06-09T04:40:56.797577+0000","last_became_peered":"2023-06-09T04:40:56.797577+0000","last_unstale":"2023-06-09T04:41:01.285632+0000","last_undegraded":"2023-06-09T04:41:01.285632+0000","last_fullsized":"2023-06-09T04:41:01.285632+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:40:42.697633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.287520+0000","last_change":"2023-06-09T04:40:51.254956+0000","last_active":"2023-06-09T04:41:01.287520+0000","last_peered":"2023-06-09T04:41:01.287520+0000","last_clean":"2023-06-09T04:41:01.287520+0000","last_became_active":"2023-06-09T04:40:51.254627+0000","last_became_peered":"2023-06-09T04:40:51.254627+0000","last_unstale":"2023-06-09T04:41:01.287520+0000","last_undegraded":"2023-06-09T04:41:01.287520+0000","last_fullsized":"2023-06-09T04:41:01.287520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_clean_scrub_stamp":"2023-06-09T04:40:50.211713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:44:56.996665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"28'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.283072+0000","last_change":"2023-06-09T04:40:56.315263+0000","last_active":"2023-06-09T04:41:01.283072+0000","last_peered":"2023-06-09T04:41:01.283072+0000","last_clean":"2023-06-09T04:41:01.283072+0000","last_became_active":"2023-06-09T04:40:56.314747+0000","last_became_peered":"2023-06-09T04:40:56.314747+0000","last_unstale":"2023-06-09T04:41:01.283072+0000","last_undegraded":"2023-06-09T04:41:01.283072+0000","last_fullsized":"2023-06-09T04:41:01.283072+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:03:05.731493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.436011+0000","last_change":"2023-06-09T04:41:00.833888+0000","last_active":"2023-06-09T04:41:01.436011+0000","last_peered":"2023-06-09T04:41:01.436011+0000","last_clean":"2023-06-09T04:41:01.436011+0000","last_became_active":"2023-06-09T04:41:00.833442+0000","last_became_peered":"2023-06-09T04:41:00.833442+0000","last_unstale":"2023-06-09T04:41:01.436011+0000","last_undegraded":"2023-06-09T04:41:01.436011+0000","last_fullsized":"2023-06-09T04:41:01.436011+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:24:29.997250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.436508+0000","last_change":"2023-06-09T04:40:56.802424+0000","last_active":"2023-06-09T04:41:01.436508+0000","last_peered":"2023-06-09T04:41:01.436508+0000","last_clean":"2023-06-09T04:41:01.436508+0000","last_became_active":"2023-06-09T04:40:56.802154+0000","last_became_peered":"2023-06-09T04:40:56.802154+0000","last_unstale":"2023-06-09T04:41:01.436508+0000","last_undegraded":"2023-06-09T04:41:01.436508+0000","last_fullsized":"2023-06-09T04:41:01.436508+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:05:49.158462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.423447+0000","last_change":"2023-06-09T04:40:51.247235+0000","last_active":"2023-06-09T04:41:01.423447+0000","last_peered":"2023-06-09T04:41:01.423447+0000","last_clean":"2023-06-09T04:41:01.423447+0000","last_became_active":"2023-06-09T04:40:51.246657+0000","last_became_peered":"2023-06-09T04:40:51.246657+0000","last_unstale":"2023-06-09T04:41:01.423447+0000","last_undegraded":"2023-06-09T04:41:01.423447+0000","last_fullsized":"2023-06-09T04:41:01.423447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_clean_scrub_stamp":"2023-06-09T04:40:50.211713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:03:00.683016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.438678+0000","last_change":"2023-06-09T04:40:56.308909+0000","last_active":"2023-06-09T04:41:01.438678+0000","last_peered":"2023-06-09T04:41:01.438678+0000","last_clean":"2023-06-09T04:41:01.438678+0000","last_became_active":"2023-06-09T04:40:56.308599+0000","last_became_peered":"2023-06-09T04:40:56.308599+0000","last_unstale":"2023-06-09T04:41:01.438678+0000","last_undegraded":"2023-06-09T04:41:01.438678+0000","last_fullsized":"2023-06-09T04:41:01.438678+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:25:20.124448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.285749+0000","last_change":"2023-06-09T04:41:00.824541+0000","last_active":"2023-06-09T04:41:01.285749+0000","last_peered":"2023-06-09T04:41:01.285749+0000","last_clean":"2023-06-09T04:41:01.285749+0000","last_became_active":"2023-06-09T04:41:00.823837+0000","last_became_peered":"2023-06-09T04:41:00.823837+0000","last_unstale":"2023-06-09T04:41:01.285749+0000","last_undegraded":"2023-06-09T04:41:01.285749+0000","last_fullsized":"2023-06-09T04:41:01.285749+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:38:10.979218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.281976+0000","last_change":"2023-06-09T04:40:56.791325+0000","last_active":"2023-06-09T04:41:01.281976+0000","last_peered":"2023-06-09T04:41:01.281976+0000","last_clean":"2023-06-09T04:41:01.281976+0000","last_became_active":"2023-06-09T04:40:56.791079+0000","last_became_peered":"2023-06-09T04:40:56.791079+0000","last_unstale":"2023-06-09T04:41:01.281976+0000","last_undegraded":"2023-06-09T04:41:01.281976+0000","last_fullsized":"2023-06-09T04:41:01.281976+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:04:20.137918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.439866+0000","last_change":"2023-06-09T04:40:51.254461+0000","last_active":"2023-06-09T04:41:01.439866+0000","last_peered":"2023-06-09T04:41:01.439866+0000","last_clean":"2023-06-09T04:41:01.439866+0000","last_became_active":"2023-06-09T04:40:51.254070+0000","last_became_peered":"2023-06-09T04:40:51.254070+0000","last_unstale":"2023-06-09T04:41:01.439866+0000","last_undegraded":"2023-06-09T04:41:01.439866+0000","last_fullsized":"2023-06-09T04:41:01.439866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_clean_scrub_stamp":"2023-06-09T04:40:50.211713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:14:25.527350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.422675+0000","last_change":"2023-06-09T04:40:56.320311+0000","last_active":"2023-06-09T04:41:01.422675+0000","last_peered":"2023-06-09T04:41:01.422675+0000","last_clean":"2023-06-09T04:41:01.422675+0000","last_became_active":"2023-06-09T04:40:56.320015+0000","last_became_peered":"2023-06-09T04:40:56.320015+0000","last_unstale":"2023-06-09T04:41:01.422675+0000","last_undegraded":"2023-06-09T04:41:01.422675+0000","last_fullsized":"2023-06-09T04:41:01.422675+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:57:28.487285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.285949+0000","last_change":"2023-06-09T04:41:00.822120+0000","last_active":"2023-06-09T04:41:01.285949+0000","last_peered":"2023-06-09T04:41:01.285949+0000","last_clean":"2023-06-09T04:41:01.285949+0000","last_became_active":"2023-06-09T04:41:00.821726+0000","last_became_peered":"2023-06-09T04:41:00.821726+0000","last_unstale":"2023-06-09T04:41:01.285949+0000","last_undegraded":"2023-06-09T04:41:01.285949+0000","last_fullsized":"2023-06-09T04:41:01.285949+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:03:36.736093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.422235+0000","last_change":"2023-06-09T04:40:56.797145+0000","last_active":"2023-06-09T04:41:01.422235+0000","last_peered":"2023-06-09T04:41:01.422235+0000","last_clean":"2023-06-09T04:41:01.422235+0000","last_became_active":"2023-06-09T04:40:56.796400+0000","last_became_peered":"2023-06-09T04:40:56.796400+0000","last_unstale":"2023-06-09T04:41:01.422235+0000","last_undegraded":"2023-06-09T04:41:01.422235+0000","last_fullsized":"2023-06-09T04:41:01.422235+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:13:45.572440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.423177+0000","last_change":"2023-06-09T04:40:51.246536+0000","last_active":"2023-06-09T04:41:01.423177+0000","last_peered":"2023-06-09T04:41:01.423177+0000","last_clean":"2023-06-09T04:41:01.423177+0000","last_became_active":"2023-06-09T04:40:51.245999+0000","last_became_peered":"2023-06-09T04:40:51.245999+0000","last_unstale":"2023-06-09T04:41:01.423177+0000","last_undegraded":"2023-06-09T04:41:01.423177+0000","last_fullsized":"2023-06-09T04:41:01.423177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_clean_scrub_stamp":"2023-06-09T04:40:50.211713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:04:39.877355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.439639+0000","last_change":"2023-06-09T04:40:56.316395+0000","last_active":"2023-06-09T04:41:01.439639+0000","last_peered":"2023-06-09T04:41:01.439639+0000","last_clean":"2023-06-09T04:41:01.439639+0000","last_became_active":"2023-06-09T04:40:56.315695+0000","last_became_peered":"2023-06-09T04:40:56.315695+0000","last_unstale":"2023-06-09T04:41:01.439639+0000","last_undegraded":"2023-06-09T04:41:01.439639+0000","last_fullsized":"2023-06-09T04:41:01.439639+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:12:29.829823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.281994+0000","last_change":"2023-06-09T04:41:00.832153+0000","last_active":"2023-06-09T04:41:01.281994+0000","last_peered":"2023-06-09T04:41:01.281994+0000","last_clean":"2023-06-09T04:41:01.281994+0000","last_became_active":"2023-06-09T04:41:00.831571+0000","last_became_peered":"2023-06-09T04:41:00.831571+0000","last_unstale":"2023-06-09T04:41:01.281994+0000","last_undegraded":"2023-06-09T04:41:01.281994+0000","last_fullsized":"2023-06-09T04:41:01.281994+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:17:54.115862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.422827+0000","last_change":"2023-06-09T04:40:56.794902+0000","last_active":"2023-06-09T04:41:01.422827+0000","last_peered":"2023-06-09T04:41:01.422827+0000","last_clean":"2023-06-09T04:41:01.422827+0000","last_became_active":"2023-06-09T04:40:56.794542+0000","last_became_peered":"2023-06-09T04:40:56.794542+0000","last_unstale":"2023-06-09T04:41:01.422827+0000","last_undegraded":"2023-06-09T04:41:01.422827+0000","last_fullsized":"2023-06-09T04:41:01.422827+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:25:26.290677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.285785+0000","last_change":"2023-06-09T04:40:56.315468+0000","last_active":"2023-06-09T04:41:01.285785+0000","last_peered":"2023-06-09T04:41:01.285785+0000","last_clean":"2023-06-09T04:41:01.285785+0000","last_became_active":"2023-06-09T04:40:56.315183+0000","last_became_peered":"2023-06-09T04:40:56.315183+0000","last_unstale":"2023-06-09T04:41:01.285785+0000","last_undegraded":"2023-06-09T04:41:01.285785+0000","last_fullsized":"2023-06-09T04:41:01.285785+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:34:48.798835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.439610+0000","last_change":"2023-06-09T04:40:51.256393+0000","last_active":"2023-06-09T04:41:01.439610+0000","last_peered":"2023-06-09T04:41:01.439610+0000","last_clean":"2023-06-09T04:41:01.439610+0000","last_became_active":"2023-06-09T04:40:51.255964+0000","last_became_peered":"2023-06-09T04:40:51.255964+0000","last_unstale":"2023-06-09T04:41:01.439610+0000","last_undegraded":"2023-06-09T04:41:01.439610+0000","last_fullsized":"2023-06-09T04:41:01.439610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_clean_scrub_stamp":"2023-06-09T04:40:50.211713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:36:40.725711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.282494+0000","last_change":"2023-06-09T04:41:00.839261+0000","last_active":"2023-06-09T04:41:01.282494+0000","last_peered":"2023-06-09T04:41:01.282494+0000","last_clean":"2023-06-09T04:41:01.282494+0000","last_became_active":"2023-06-09T04:41:00.838867+0000","last_became_peered":"2023-06-09T04:41:00.838867+0000","last_unstale":"2023-06-09T04:41:01.282494+0000","last_undegraded":"2023-06-09T04:41:01.282494+0000","last_fullsized":"2023-06-09T04:41:01.282494+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:57:33.009170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.423610+0000","last_change":"2023-06-09T04:40:56.798090+0000","last_active":"2023-06-09T04:41:01.423610+0000","last_peered":"2023-06-09T04:41:01.423610+0000","last_clean":"2023-06-09T04:41:01.423610+0000","last_became_active":"2023-06-09T04:40:56.797767+0000","last_became_peered":"2023-06-09T04:40:56.797767+0000","last_unstale":"2023-06-09T04:41:01.423610+0000","last_undegraded":"2023-06-09T04:41:01.423610+0000","last_fullsized":"2023-06-09T04:41:01.423610+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:52:44.006009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.422159+0000","last_change":"2023-06-09T04:40:56.320626+0000","last_active":"2023-06-09T04:41:01.422159+0000","last_peered":"2023-06-09T04:41:01.422159+0000","last_clean":"2023-06-09T04:41:01.422159+0000","last_became_active":"2023-06-09T04:40:56.320232+0000","last_became_peered":"2023-06-09T04:40:56.320232+0000","last_unstale":"2023-06-09T04:41:01.422159+0000","last_undegraded":"2023-06-09T04:41:01.422159+0000","last_fullsized":"2023-06-09T04:41:01.422159+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:20:18.690413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.437109+0000","last_change":"2023-06-09T04:40:51.582053+0000","last_active":"2023-06-09T04:41:01.437109+0000","last_peered":"2023-06-09T04:41:01.437109+0000","last_clean":"2023-06-09T04:41:01.437109+0000","last_became_active":"2023-06-09T04:40:51.581476+0000","last_became_peered":"2023-06-09T04:40:51.581476+0000","last_unstale":"2023-06-09T04:41:01.437109+0000","last_undegraded":"2023-06-09T04:41:01.437109+0000","last_fullsized":"2023-06-09T04:41:01.437109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_clean_scrub_stamp":"2023-06-09T04:40:50.211713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:41:20.442998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.437773+0000","last_change":"2023-06-09T04:41:00.823337+0000","last_active":"2023-06-09T04:41:01.437773+0000","last_peered":"2023-06-09T04:41:01.437773+0000","last_clean":"2023-06-09T04:41:01.437773+0000","last_became_active":"2023-06-09T04:41:00.822873+0000","last_became_peered":"2023-06-09T04:41:00.822873+0000","last_unstale":"2023-06-09T04:41:01.437773+0000","last_undegraded":"2023-06-09T04:41:01.437773+0000","last_fullsized":"2023-06-09T04:41:01.437773+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:44:04.904534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.282652+0000","last_change":"2023-06-09T04:40:56.796601+0000","last_active":"2023-06-09T04:41:01.282652+0000","last_peered":"2023-06-09T04:41:01.282652+0000","last_clean":"2023-06-09T04:41:01.282652+0000","last_became_active":"2023-06-09T04:40:56.796341+0000","last_became_peered":"2023-06-09T04:40:56.796341+0000","last_unstale":"2023-06-09T04:41:01.282652+0000","last_undegraded":"2023-06-09T04:41:01.282652+0000","last_fullsized":"2023-06-09T04:41:01.282652+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:06:43.179689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.281540+0000","last_change":"2023-06-09T04:40:56.317205+0000","last_active":"2023-06-09T04:41:01.281540+0000","last_peered":"2023-06-09T04:41:01.281540+0000","last_clean":"2023-06-09T04:41:01.281540+0000","last_became_active":"2023-06-09T04:40:56.316821+0000","last_became_peered":"2023-06-09T04:40:56.316821+0000","last_unstale":"2023-06-09T04:41:01.281540+0000","last_undegraded":"2023-06-09T04:41:01.281540+0000","last_fullsized":"2023-06-09T04:41:01.281540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:36:45.774188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.438350+0000","last_change":"2023-06-09T04:40:51.256342+0000","last_active":"2023-06-09T04:41:01.438350+0000","last_peered":"2023-06-09T04:41:01.438350+0000","last_clean":"2023-06-09T04:41:01.438350+0000","last_became_active":"2023-06-09T04:40:51.256010+0000","last_became_peered":"2023-06-09T04:40:51.256010+0000","last_unstale":"2023-06-09T04:41:01.438350+0000","last_undegraded":"2023-06-09T04:41:01.438350+0000","last_fullsized":"2023-06-09T04:41:01.438350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_clean_scrub_stamp":"2023-06-09T04:40:50.211713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:13:39.511250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.440147+0000","last_change":"2023-06-09T04:41:00.839270+0000","last_active":"2023-06-09T04:41:01.440147+0000","last_peered":"2023-06-09T04:41:01.440147+0000","last_clean":"2023-06-09T04:41:01.440147+0000","last_became_active":"2023-06-09T04:41:00.838641+0000","last_became_peered":"2023-06-09T04:41:00.838641+0000","last_unstale":"2023-06-09T04:41:01.440147+0000","last_undegraded":"2023-06-09T04:41:01.440147+0000","last_fullsized":"2023-06-09T04:41:01.440147+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:20:23.212298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.286778+0000","last_change":"2023-06-09T04:40:56.806412+0000","last_active":"2023-06-09T04:41:01.286778+0000","last_peered":"2023-06-09T04:41:01.286778+0000","last_clean":"2023-06-09T04:41:01.286778+0000","last_became_active":"2023-06-09T04:40:56.806046+0000","last_became_peered":"2023-06-09T04:40:56.806046+0000","last_unstale":"2023-06-09T04:41:01.286778+0000","last_undegraded":"2023-06-09T04:41:01.286778+0000","last_fullsized":"2023-06-09T04:41:01.286778+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:13:32.401045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.437153+0000","last_change":"2023-06-09T04:40:56.316110+0000","last_active":"2023-06-09T04:41:01.437153+0000","last_peered":"2023-06-09T04:41:01.437153+0000","last_clean":"2023-06-09T04:41:01.437153+0000","last_became_active":"2023-06-09T04:40:56.315754+0000","last_became_peered":"2023-06-09T04:40:56.315754+0000","last_unstale":"2023-06-09T04:41:01.437153+0000","last_undegraded":"2023-06-09T04:41:01.437153+0000","last_fullsized":"2023-06-09T04:41:01.437153+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:59:56.484281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.439096+0000","last_change":"2023-06-09T04:40:51.253269+0000","last_active":"2023-06-09T04:41:01.439096+0000","last_peered":"2023-06-09T04:41:01.439096+0000","last_clean":"2023-06-09T04:41:01.439096+0000","last_became_active":"2023-06-09T04:40:51.252908+0000","last_became_peered":"2023-06-09T04:40:51.252908+0000","last_unstale":"2023-06-09T04:41:01.439096+0000","last_undegraded":"2023-06-09T04:41:01.439096+0000","last_fullsized":"2023-06-09T04:41:01.439096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_clean_scrub_stamp":"2023-06-09T04:40:50.211713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:55:48.768194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":183,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.438683+0000","last_change":"2023-06-09T04:40:46.286764+0000","last_active":"2023-06-09T04:41:01.438683+0000","last_peered":"2023-06-09T04:41:01.438683+0000","last_clean":"2023-06-09T04:41:01.438683+0000","last_became_active":"2023-06-09T04:40:46.285285+0000","last_became_peered":"2023-06-09T04:40:46.285285+0000","last_unstale":"2023-06-09T04:41:01.438683+0000","last_undegraded":"2023-06-09T04:41:01.438683+0000","last_fullsized":"2023-06-09T04:41:01.438683+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:45.151406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:45.151406+0000","last_clean_scrub_stamp":"2023-06-09T04:40:45.151406+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:43:20.379013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.438943+0000","last_change":"2023-06-09T04:41:00.830910+0000","last_active":"2023-06-09T04:41:01.438943+0000","last_peered":"2023-06-09T04:41:01.438943+0000","last_clean":"2023-06-09T04:41:01.438943+0000","last_became_active":"2023-06-09T04:41:00.830476+0000","last_became_peered":"2023-06-09T04:41:00.830476+0000","last_unstale":"2023-06-09T04:41:01.438943+0000","last_undegraded":"2023-06-09T04:41:01.438943+0000","last_fullsized":"2023-06-09T04:41:01.438943+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:04:49.447717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.423561+0000","last_change":"2023-06-09T04:40:56.790616+0000","last_active":"2023-06-09T04:41:01.423561+0000","last_peered":"2023-06-09T04:41:01.423561+0000","last_clean":"2023-06-09T04:41:01.423561+0000","last_became_active":"2023-06-09T04:40:56.790340+0000","last_became_peered":"2023-06-09T04:40:56.790340+0000","last_unstale":"2023-06-09T04:41:01.423561+0000","last_undegraded":"2023-06-09T04:41:01.423561+0000","last_fullsized":"2023-06-09T04:41:01.423561+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:08:06.202323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.436613+0000","last_change":"2023-06-09T04:40:56.319906+0000","last_active":"2023-06-09T04:41:01.436613+0000","last_peered":"2023-06-09T04:41:01.436613+0000","last_clean":"2023-06-09T04:41:01.436613+0000","last_became_active":"2023-06-09T04:40:56.319496+0000","last_became_peered":"2023-06-09T04:40:56.319496+0000","last_unstale":"2023-06-09T04:41:01.436613+0000","last_undegraded":"2023-06-09T04:41:01.436613+0000","last_fullsized":"2023-06-09T04:41:01.436613+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:08:05.189610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.288028+0000","last_change":"2023-06-09T04:41:00.825198+0000","last_active":"2023-06-09T04:41:01.288028+0000","last_peered":"2023-06-09T04:41:01.288028+0000","last_clean":"2023-06-09T04:41:01.288028+0000","last_became_active":"2023-06-09T04:41:00.824804+0000","last_became_peered":"2023-06-09T04:41:00.824804+0000","last_unstale":"2023-06-09T04:41:01.288028+0000","last_undegraded":"2023-06-09T04:41:01.288028+0000","last_fullsized":"2023-06-09T04:41:01.288028+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:52:16.020173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.287921+0000","last_change":"2023-06-09T04:40:56.801931+0000","last_active":"2023-06-09T04:41:01.287921+0000","last_peered":"2023-06-09T04:41:01.287921+0000","last_clean":"2023-06-09T04:41:01.287921+0000","last_became_active":"2023-06-09T04:40:56.801667+0000","last_became_peered":"2023-06-09T04:40:56.801667+0000","last_unstale":"2023-06-09T04:41:01.287921+0000","last_undegraded":"2023-06-09T04:41:01.287921+0000","last_fullsized":"2023-06-09T04:41:01.287921+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:52:18.948571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.285847+0000","last_change":"2023-06-09T04:40:56.322597+0000","last_active":"2023-06-09T04:41:01.285847+0000","last_peered":"2023-06-09T04:41:01.285847+0000","last_clean":"2023-06-09T04:41:01.285847+0000","last_became_active":"2023-06-09T04:40:56.322300+0000","last_became_peered":"2023-06-09T04:40:56.322300+0000","last_unstale":"2023-06-09T04:41:01.285847+0000","last_undegraded":"2023-06-09T04:41:01.285847+0000","last_fullsized":"2023-06-09T04:41:01.285847+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:27:36.587609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.439849+0000","last_change":"2023-06-09T04:41:00.832222+0000","last_active":"2023-06-09T04:41:01.439849+0000","last_peered":"2023-06-09T04:41:01.439849+0000","last_clean":"2023-06-09T04:41:01.439849+0000","last_became_active":"2023-06-09T04:41:00.831821+0000","last_became_peered":"2023-06-09T04:41:00.831821+0000","last_unstale":"2023-06-09T04:41:01.439849+0000","last_undegraded":"2023-06-09T04:41:01.439849+0000","last_fullsized":"2023-06-09T04:41:01.439849+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:47:47.084156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.286843+0000","last_change":"2023-06-09T04:40:56.803238+0000","last_active":"2023-06-09T04:41:01.286843+0000","last_peered":"2023-06-09T04:41:01.286843+0000","last_clean":"2023-06-09T04:41:01.286843+0000","last_became_active":"2023-06-09T04:40:56.802659+0000","last_became_peered":"2023-06-09T04:40:56.802659+0000","last_unstale":"2023-06-09T04:41:01.286843+0000","last_undegraded":"2023-06-09T04:41:01.286843+0000","last_fullsized":"2023-06-09T04:41:01.286843+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:18:37.195363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.286230+0000","last_change":"2023-06-09T04:40:56.310427+0000","last_active":"2023-06-09T04:41:01.286230+0000","last_peered":"2023-06-09T04:41:01.286230+0000","last_clean":"2023-06-09T04:41:01.286230+0000","last_became_active":"2023-06-09T04:40:56.309681+0000","last_became_peered":"2023-06-09T04:40:56.309681+0000","last_unstale":"2023-06-09T04:41:01.286230+0000","last_undegraded":"2023-06-09T04:41:01.286230+0000","last_fullsized":"2023-06-09T04:41:01.286230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:32:44.555572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.422209+0000","last_change":"2023-06-09T04:41:00.833572+0000","last_active":"2023-06-09T04:41:01.422209+0000","last_peered":"2023-06-09T04:41:01.422209+0000","last_clean":"2023-06-09T04:41:01.422209+0000","last_became_active":"2023-06-09T04:41:00.833182+0000","last_became_peered":"2023-06-09T04:41:00.833182+0000","last_unstale":"2023-06-09T04:41:01.422209+0000","last_undegraded":"2023-06-09T04:41:01.422209+0000","last_fullsized":"2023-06-09T04:41:01.422209+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:04:23.647090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.285461+0000","last_change":"2023-06-09T04:40:56.805747+0000","last_active":"2023-06-09T04:41:01.285461+0000","last_peered":"2023-06-09T04:41:01.285461+0000","last_clean":"2023-06-09T04:41:01.285461+0000","last_became_active":"2023-06-09T04:40:56.797532+0000","last_became_peered":"2023-06-09T04:40:56.797532+0000","last_unstale":"2023-06-09T04:41:01.285461+0000","last_undegraded":"2023-06-09T04:41:01.285461+0000","last_fullsized":"2023-06-09T04:41:01.285461+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:45:17.466440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.438024+0000","last_change":"2023-06-09T04:40:56.314468+0000","last_active":"2023-06-09T04:41:01.438024+0000","last_peered":"2023-06-09T04:41:01.438024+0000","last_clean":"2023-06-09T04:41:01.438024+0000","last_became_active":"2023-06-09T04:40:56.314110+0000","last_became_peered":"2023-06-09T04:40:56.314110+0000","last_unstale":"2023-06-09T04:41:01.438024+0000","last_undegraded":"2023-06-09T04:41:01.438024+0000","last_fullsized":"2023-06-09T04:41:01.438024+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:39:14.790353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.437486+0000","last_change":"2023-06-09T04:41:00.823352+0000","last_active":"2023-06-09T04:41:01.437486+0000","last_peered":"2023-06-09T04:41:01.437486+0000","last_clean":"2023-06-09T04:41:01.437486+0000","last_became_active":"2023-06-09T04:41:00.822869+0000","last_became_peered":"2023-06-09T04:41:00.822869+0000","last_unstale":"2023-06-09T04:41:01.437486+0000","last_undegraded":"2023-06-09T04:41:01.437486+0000","last_fullsized":"2023-06-09T04:41:01.437486+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:46:17.286998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.281876+0000","last_change":"2023-06-09T04:40:56.790996+0000","last_active":"2023-06-09T04:41:01.281876+0000","last_peered":"2023-06-09T04:41:01.281876+0000","last_clean":"2023-06-09T04:41:01.281876+0000","last_became_active":"2023-06-09T04:40:56.790630+0000","last_became_peered":"2023-06-09T04:40:56.790630+0000","last_unstale":"2023-06-09T04:41:01.281876+0000","last_undegraded":"2023-06-09T04:41:01.281876+0000","last_fullsized":"2023-06-09T04:41:01.281876+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:47:43.574984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.440099+0000","last_change":"2023-06-09T04:40:56.316852+0000","last_active":"2023-06-09T04:41:01.440099+0000","last_peered":"2023-06-09T04:41:01.440099+0000","last_clean":"2023-06-09T04:41:01.440099+0000","last_became_active":"2023-06-09T04:40:56.315795+0000","last_became_peered":"2023-06-09T04:40:56.315795+0000","last_unstale":"2023-06-09T04:41:01.440099+0000","last_undegraded":"2023-06-09T04:41:01.440099+0000","last_fullsized":"2023-06-09T04:41:01.440099+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:04:19.125206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.436964+0000","last_change":"2023-06-09T04:41:00.815347+0000","last_active":"2023-06-09T04:41:01.436964+0000","last_peered":"2023-06-09T04:41:01.436964+0000","last_clean":"2023-06-09T04:41:01.436964+0000","last_became_active":"2023-06-09T04:41:00.814876+0000","last_became_peered":"2023-06-09T04:41:00.814876+0000","last_unstale":"2023-06-09T04:41:01.436964+0000","last_undegraded":"2023-06-09T04:41:01.436964+0000","last_fullsized":"2023-06-09T04:41:01.436964+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:29:48.861218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.286021+0000","last_change":"2023-06-09T04:40:56.797164+0000","last_active":"2023-06-09T04:41:01.286021+0000","last_peered":"2023-06-09T04:41:01.286021+0000","last_clean":"2023-06-09T04:41:01.286021+0000","last_became_active":"2023-06-09T04:40:56.796793+0000","last_became_peered":"2023-06-09T04:40:56.796793+0000","last_unstale":"2023-06-09T04:41:01.286021+0000","last_undegraded":"2023-06-09T04:41:01.286021+0000","last_fullsized":"2023-06-09T04:41:01.286021+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:22:00.092692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.439725+0000","last_change":"2023-06-09T04:40:56.319708+0000","last_active":"2023-06-09T04:41:01.439725+0000","last_peered":"2023-06-09T04:41:01.439725+0000","last_clean":"2023-06-09T04:41:01.439725+0000","last_became_active":"2023-06-09T04:40:56.319239+0000","last_became_peered":"2023-06-09T04:40:56.319239+0000","last_unstale":"2023-06-09T04:41:01.439725+0000","last_undegraded":"2023-06-09T04:41:01.439725+0000","last_fullsized":"2023-06-09T04:41:01.439725+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:59:56.484281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.437517+0000","last_change":"2023-06-09T04:41:00.830023+0000","last_active":"2023-06-09T04:41:01.437517+0000","last_peered":"2023-06-09T04:41:01.437517+0000","last_clean":"2023-06-09T04:41:01.437517+0000","last_became_active":"2023-06-09T04:41:00.829628+0000","last_became_peered":"2023-06-09T04:41:00.829628+0000","last_unstale":"2023-06-09T04:41:01.437517+0000","last_undegraded":"2023-06-09T04:41:01.437517+0000","last_fullsized":"2023-06-09T04:41:01.437517+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:11:01.800202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.285365+0000","last_change":"2023-06-09T04:40:56.802232+0000","last_active":"2023-06-09T04:41:01.285365+0000","last_peered":"2023-06-09T04:41:01.285365+0000","last_clean":"2023-06-09T04:41:01.285365+0000","last_became_active":"2023-06-09T04:40:56.798647+0000","last_became_peered":"2023-06-09T04:40:56.798647+0000","last_unstale":"2023-06-09T04:41:01.285365+0000","last_undegraded":"2023-06-09T04:41:01.285365+0000","last_fullsized":"2023-06-09T04:41:01.285365+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:15:13.824668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.439375+0000","last_change":"2023-06-09T04:40:56.312886+0000","last_active":"2023-06-09T04:41:01.439375+0000","last_peered":"2023-06-09T04:41:01.439375+0000","last_clean":"2023-06-09T04:41:01.439375+0000","last_became_active":"2023-06-09T04:40:56.312638+0000","last_became_peered":"2023-06-09T04:40:56.312638+0000","last_unstale":"2023-06-09T04:41:01.439375+0000","last_undegraded":"2023-06-09T04:41:01.439375+0000","last_fullsized":"2023-06-09T04:41:01.439375+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:05:48.145750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.436906+0000","last_change":"2023-06-09T04:41:00.837079+0000","last_active":"2023-06-09T04:41:01.436906+0000","last_peered":"2023-06-09T04:41:01.436906+0000","last_clean":"2023-06-09T04:41:01.436906+0000","last_became_active":"2023-06-09T04:41:00.836636+0000","last_became_peered":"2023-06-09T04:41:00.836636+0000","last_unstale":"2023-06-09T04:41:01.436906+0000","last_undegraded":"2023-06-09T04:41:01.436906+0000","last_fullsized":"2023-06-09T04:41:01.436906+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:18:24.073415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.438685+0000","last_change":"2023-06-09T04:40:56.802193+0000","last_active":"2023-06-09T04:41:01.438685+0000","last_peered":"2023-06-09T04:41:01.438685+0000","last_clean":"2023-06-09T04:41:01.438685+0000","last_became_active":"2023-06-09T04:40:56.801743+0000","last_became_peered":"2023-06-09T04:40:56.801743+0000","last_unstale":"2023-06-09T04:41:01.438685+0000","last_undegraded":"2023-06-09T04:41:01.438685+0000","last_fullsized":"2023-06-09T04:41:01.438685+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:26:52.030740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.440193+0000","last_change":"2023-06-09T04:40:56.310010+0000","last_active":"2023-06-09T04:41:01.440193+0000","last_peered":"2023-06-09T04:41:01.440193+0000","last_clean":"2023-06-09T04:41:01.440193+0000","last_became_active":"2023-06-09T04:40:56.309735+0000","last_became_peered":"2023-06-09T04:40:56.309735+0000","last_unstale":"2023-06-09T04:41:01.440193+0000","last_undegraded":"2023-06-09T04:41:01.440193+0000","last_fullsized":"2023-06-09T04:41:01.440193+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:39:14.790353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.439938+0000","last_change":"2023-06-09T04:41:00.831076+0000","last_active":"2023-06-09T04:41:01.439938+0000","last_peered":"2023-06-09T04:41:01.439938+0000","last_clean":"2023-06-09T04:41:01.439938+0000","last_became_active":"2023-06-09T04:41:00.828763+0000","last_became_peered":"2023-06-09T04:41:00.828763+0000","last_unstale":"2023-06-09T04:41:01.439938+0000","last_undegraded":"2023-06-09T04:41:01.439938+0000","last_fullsized":"2023-06-09T04:41:01.439938+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:24:30.332035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.440504+0000","last_change":"2023-06-09T04:41:00.839198+0000","last_active":"2023-06-09T04:41:01.440504+0000","last_peered":"2023-06-09T04:41:01.440504+0000","last_clean":"2023-06-09T04:41:01.440504+0000","last_became_active":"2023-06-09T04:41:00.838883+0000","last_became_peered":"2023-06-09T04:41:00.838883+0000","last_unstale":"2023-06-09T04:41:01.440504+0000","last_undegraded":"2023-06-09T04:41:01.440504+0000","last_fullsized":"2023-06-09T04:41:01.440504+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:25:29.799849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.285514+0000","last_change":"2023-06-09T04:40:56.314061+0000","last_active":"2023-06-09T04:41:01.285514+0000","last_peered":"2023-06-09T04:41:01.285514+0000","last_clean":"2023-06-09T04:41:01.285514+0000","last_became_active":"2023-06-09T04:40:56.313675+0000","last_became_peered":"2023-06-09T04:40:56.313675+0000","last_unstale":"2023-06-09T04:41:01.285514+0000","last_undegraded":"2023-06-09T04:41:01.285514+0000","last_fullsized":"2023-06-09T04:41:01.285514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:05:35.369565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.438564+0000","last_change":"2023-06-09T04:40:56.803235+0000","last_active":"2023-06-09T04:41:01.438564+0000","last_peered":"2023-06-09T04:41:01.438564+0000","last_clean":"2023-06-09T04:41:01.438564+0000","last_became_active":"2023-06-09T04:40:56.802719+0000","last_became_peered":"2023-06-09T04:40:56.802719+0000","last_unstale":"2023-06-09T04:41:01.438564+0000","last_undegraded":"2023-06-09T04:41:01.438564+0000","last_fullsized":"2023-06-09T04:41:01.438564+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:13:35.241848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.438353+0000","last_change":"2023-06-09T04:41:00.824712+0000","last_active":"2023-06-09T04:41:01.438353+0000","last_peered":"2023-06-09T04:41:01.438353+0000","last_clean":"2023-06-09T04:41:01.438353+0000","last_became_active":"2023-06-09T04:41:00.824247+0000","last_became_peered":"2023-06-09T04:41:00.824247+0000","last_unstale":"2023-06-09T04:41:01.438353+0000","last_undegraded":"2023-06-09T04:41:01.438353+0000","last_fullsized":"2023-06-09T04:41:01.438353+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:10:26.089852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.438867+0000","last_change":"2023-06-09T04:40:56.318818+0000","last_active":"2023-06-09T04:41:01.438867+0000","last_peered":"2023-06-09T04:41:01.438867+0000","last_clean":"2023-06-09T04:41:01.438867+0000","last_became_active":"2023-06-09T04:40:56.318430+0000","last_became_peered":"2023-06-09T04:40:56.318430+0000","last_unstale":"2023-06-09T04:41:01.438867+0000","last_undegraded":"2023-06-09T04:41:01.438867+0000","last_fullsized":"2023-06-09T04:41:01.438867+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:14:30.287562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.282910+0000","last_change":"2023-06-09T04:40:56.804430+0000","last_active":"2023-06-09T04:41:01.282910+0000","last_peered":"2023-06-09T04:41:01.282910+0000","last_clean":"2023-06-09T04:41:01.282910+0000","last_became_active":"2023-06-09T04:40:56.804135+0000","last_became_peered":"2023-06-09T04:40:56.804135+0000","last_unstale":"2023-06-09T04:41:01.282910+0000","last_undegraded":"2023-06-09T04:41:01.282910+0000","last_fullsized":"2023-06-09T04:41:01.282910+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:04:45.938545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.281917+0000","last_change":"2023-06-09T04:40:56.311175+0000","last_active":"2023-06-09T04:41:01.281917+0000","last_peered":"2023-06-09T04:41:01.281917+0000","last_clean":"2023-06-09T04:41:01.281917+0000","last_became_active":"2023-06-09T04:40:56.310829+0000","last_became_peered":"2023-06-09T04:40:56.310829+0000","last_unstale":"2023-06-09T04:41:01.281917+0000","last_undegraded":"2023-06-09T04:41:01.281917+0000","last_fullsized":"2023-06-09T04:41:01.281917+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:20:18.690413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.439450+0000","last_change":"2023-06-09T04:40:56.809473+0000","last_active":"2023-06-09T04:41:01.439450+0000","last_peered":"2023-06-09T04:41:01.439450+0000","last_clean":"2023-06-09T04:41:01.439450+0000","last_became_active":"2023-06-09T04:40:56.809181+0000","last_became_peered":"2023-06-09T04:40:56.809181+0000","last_unstale":"2023-06-09T04:41:01.439450+0000","last_undegraded":"2023-06-09T04:41:01.439450+0000","last_fullsized":"2023-06-09T04:41:01.439450+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:05:54.167533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.437947+0000","last_change":"2023-06-09T04:41:00.827111+0000","last_active":"2023-06-09T04:41:01.437947+0000","last_peered":"2023-06-09T04:41:01.437947+0000","last_clean":"2023-06-09T04:41:01.437947+0000","last_became_active":"2023-06-09T04:41:00.826707+0000","last_became_peered":"2023-06-09T04:41:00.826707+0000","last_unstale":"2023-06-09T04:41:01.437947+0000","last_undegraded":"2023-06-09T04:41:01.437947+0000","last_fullsized":"2023-06-09T04:41:01.437947+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:24:30.332035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.438574+0000","last_change":"2023-06-09T04:40:56.318716+0000","last_active":"2023-06-09T04:41:01.438574+0000","last_peered":"2023-06-09T04:41:01.438574+0000","last_clean":"2023-06-09T04:41:01.438574+0000","last_became_active":"2023-06-09T04:40:56.318415+0000","last_became_peered":"2023-06-09T04:40:56.318415+0000","last_unstale":"2023-06-09T04:41:01.438574+0000","last_undegraded":"2023-06-09T04:41:01.438574+0000","last_fullsized":"2023-06-09T04:41:01.438574+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:25:25.277964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.438243+0000","last_change":"2023-06-09T04:40:56.795369+0000","last_active":"2023-06-09T04:41:01.438243+0000","last_peered":"2023-06-09T04:41:01.438243+0000","last_clean":"2023-06-09T04:41:01.438243+0000","last_became_active":"2023-06-09T04:40:56.794885+0000","last_became_peered":"2023-06-09T04:40:56.794885+0000","last_unstale":"2023-06-09T04:41:01.438243+0000","last_undegraded":"2023-06-09T04:41:01.438243+0000","last_fullsized":"2023-06-09T04:41:01.438243+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:58:56.783205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.439095+0000","last_change":"2023-06-09T04:41:00.839070+0000","last_active":"2023-06-09T04:41:01.439095+0000","last_peered":"2023-06-09T04:41:01.439095+0000","last_clean":"2023-06-09T04:41:01.439095+0000","last_became_active":"2023-06-09T04:41:00.838603+0000","last_became_peered":"2023-06-09T04:41:00.838603+0000","last_unstale":"2023-06-09T04:41:01.439095+0000","last_undegraded":"2023-06-09T04:41:01.439095+0000","last_fullsized":"2023-06-09T04:41:01.439095+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T04:55:38.240718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.285287+0000","last_change":"2023-06-09T04:40:56.797265+0000","last_active":"2023-06-09T04:41:01.285287+0000","last_peered":"2023-06-09T04:41:01.285287+0000","last_clean":"2023-06-09T04:41:01.285287+0000","last_became_active":"2023-06-09T04:40:56.796952+0000","last_became_peered":"2023-06-09T04:40:56.796952+0000","last_unstale":"2023-06-09T04:41:01.285287+0000","last_undegraded":"2023-06-09T04:41:01.285287+0000","last_fullsized":"2023-06-09T04:41:01.285287+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:48:55.767412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.436310+0000","last_change":"2023-06-09T04:40:56.797095+0000","last_active":"2023-06-09T04:41:01.436310+0000","last_peered":"2023-06-09T04:41:01.436310+0000","last_clean":"2023-06-09T04:41:01.436310+0000","last_became_active":"2023-06-09T04:40:56.796589+0000","last_became_peered":"2023-06-09T04:40:56.796589+0000","last_unstale":"2023-06-09T04:41:01.436310+0000","last_undegraded":"2023-06-09T04:41:01.436310+0000","last_fullsized":"2023-06-09T04:41:01.436310+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:14:31.300275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.285463+0000","last_change":"2023-06-09T04:40:56.798590+0000","last_active":"2023-06-09T04:41:01.285463+0000","last_peered":"2023-06-09T04:41:01.285463+0000","last_clean":"2023-06-09T04:41:01.285463+0000","last_became_active":"2023-06-09T04:40:56.798170+0000","last_became_peered":"2023-06-09T04:40:56.798170+0000","last_unstale":"2023-06-09T04:41:01.285463+0000","last_undegraded":"2023-06-09T04:41:01.285463+0000","last_fullsized":"2023-06-09T04:41:01.285463+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:17:30.494237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.437846+0000","last_change":"2023-06-09T04:40:56.801414+0000","last_active":"2023-06-09T04:41:01.437846+0000","last_peered":"2023-06-09T04:41:01.437846+0000","last_clean":"2023-06-09T04:41:01.437846+0000","last_became_active":"2023-06-09T04:40:56.801141+0000","last_became_peered":"2023-06-09T04:40:56.801141+0000","last_unstale":"2023-06-09T04:41:01.437846+0000","last_undegraded":"2023-06-09T04:41:01.437846+0000","last_fullsized":"2023-06-09T04:41:01.437846+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:14:31.588540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.423026+0000","last_change":"2023-06-09T04:40:56.800046+0000","last_active":"2023-06-09T04:41:01.423026+0000","last_peered":"2023-06-09T04:41:01.423026+0000","last_clean":"2023-06-09T04:41:01.423026+0000","last_became_active":"2023-06-09T04:40:56.798966+0000","last_became_peered":"2023-06-09T04:40:56.798966+0000","last_unstale":"2023-06-09T04:41:01.423026+0000","last_undegraded":"2023-06-09T04:41:01.423026+0000","last_fullsized":"2023-06-09T04:41:01.423026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:06:43.179689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.439250+0000","last_change":"2023-06-09T04:40:56.809685+0000","last_active":"2023-06-09T04:41:01.439250+0000","last_peered":"2023-06-09T04:41:01.439250+0000","last_clean":"2023-06-09T04:41:01.439250+0000","last_became_active":"2023-06-09T04:40:56.809312+0000","last_became_peered":"2023-06-09T04:40:56.809312+0000","last_unstale":"2023-06-09T04:41:01.439250+0000","last_undegraded":"2023-06-09T04:41:01.439250+0000","last_fullsized":"2023-06-09T04:41:01.439250+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:17:07.126456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.423063+0000","last_change":"2023-06-09T04:40:56.795763+0000","last_active":"2023-06-09T04:41:01.423063+0000","last_peered":"2023-06-09T04:41:01.423063+0000","last_clean":"2023-06-09T04:41:01.423063+0000","last_became_active":"2023-06-09T04:40:56.795456+0000","last_became_peered":"2023-06-09T04:40:56.795456+0000","last_unstale":"2023-06-09T04:41:01.423063+0000","last_undegraded":"2023-06-09T04:41:01.423063+0000","last_fullsized":"2023-06-09T04:41:01.423063+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:14:31.300275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.423520+0000","last_change":"2023-06-09T04:40:56.801907+0000","last_active":"2023-06-09T04:41:01.423520+0000","last_peered":"2023-06-09T04:41:01.423520+0000","last_clean":"2023-06-09T04:41:01.423520+0000","last_became_active":"2023-06-09T04:40:56.801549+0000","last_became_peered":"2023-06-09T04:40:56.801549+0000","last_unstale":"2023-06-09T04:41:01.423520+0000","last_undegraded":"2023-06-09T04:41:01.423520+0000","last_fullsized":"2023-06-09T04:41:01.423520+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:05:49.158462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.439471+0000","last_change":"2023-06-09T04:40:56.807671+0000","last_active":"2023-06-09T04:41:01.439471+0000","last_peered":"2023-06-09T04:41:01.439471+0000","last_clean":"2023-06-09T04:41:01.439471+0000","last_became_active":"2023-06-09T04:40:56.807340+0000","last_became_peered":"2023-06-09T04:40:56.807340+0000","last_unstale":"2023-06-09T04:41:01.439471+0000","last_undegraded":"2023-06-09T04:41:01.439471+0000","last_fullsized":"2023-06-09T04:41:01.439471+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:08:06.202323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.436226+0000","last_change":"2023-06-09T04:40:56.788625+0000","last_active":"2023-06-09T04:41:01.436226+0000","last_peered":"2023-06-09T04:41:01.436226+0000","last_clean":"2023-06-09T04:41:01.436226+0000","last_became_active":"2023-06-09T04:40:56.787863+0000","last_became_peered":"2023-06-09T04:40:56.787863+0000","last_unstale":"2023-06-09T04:41:01.436226+0000","last_undegraded":"2023-06-09T04:41:01.436226+0000","last_fullsized":"2023-06-09T04:41:01.436226+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:25:26.290677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.281831+0000","last_change":"2023-06-09T04:40:56.790021+0000","last_active":"2023-06-09T04:41:01.281831+0000","last_peered":"2023-06-09T04:41:01.281831+0000","last_clean":"2023-06-09T04:41:01.281831+0000","last_became_active":"2023-06-09T04:40:56.789701+0000","last_became_peered":"2023-06-09T04:40:56.789701+0000","last_unstale":"2023-06-09T04:41:01.281831+0000","last_undegraded":"2023-06-09T04:41:01.281831+0000","last_fullsized":"2023-06-09T04:41:01.281831+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:12:30.842536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.438484+0000","last_change":"2023-06-09T04:40:56.808367+0000","last_active":"2023-06-09T04:41:01.438484+0000","last_peered":"2023-06-09T04:41:01.438484+0000","last_clean":"2023-06-09T04:41:01.438484+0000","last_became_active":"2023-06-09T04:40:56.807817+0000","last_became_peered":"2023-06-09T04:40:56.807817+0000","last_unstale":"2023-06-09T04:41:01.438484+0000","last_undegraded":"2023-06-09T04:41:01.438484+0000","last_fullsized":"2023-06-09T04:41:01.438484+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:24:26.488078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.285269+0000","last_change":"2023-06-09T04:40:56.790891+0000","last_active":"2023-06-09T04:41:01.285269+0000","last_peered":"2023-06-09T04:41:01.285269+0000","last_clean":"2023-06-09T04:41:01.285269+0000","last_became_active":"2023-06-09T04:40:56.790633+0000","last_became_peered":"2023-06-09T04:40:56.790633+0000","last_unstale":"2023-06-09T04:41:01.285269+0000","last_undegraded":"2023-06-09T04:41:01.285269+0000","last_fullsized":"2023-06-09T04:41:01.285269+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:40:36.160469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.437785+0000","last_change":"2023-06-09T04:40:56.806490+0000","last_active":"2023-06-09T04:41:01.437785+0000","last_peered":"2023-06-09T04:41:01.437785+0000","last_clean":"2023-06-09T04:41:01.437785+0000","last_became_active":"2023-06-09T04:40:56.806147+0000","last_became_peered":"2023-06-09T04:40:56.806147+0000","last_unstale":"2023-06-09T04:41:01.437785+0000","last_undegraded":"2023-06-09T04:41:01.437785+0000","last_fullsized":"2023-06-09T04:41:01.437785+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:26:06.240424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.287737+0000","last_change":"2023-06-09T04:40:56.797924+0000","last_active":"2023-06-09T04:41:01.287737+0000","last_peered":"2023-06-09T04:41:01.287737+0000","last_clean":"2023-06-09T04:41:01.287737+0000","last_became_active":"2023-06-09T04:40:56.794834+0000","last_became_peered":"2023-06-09T04:40:56.794834+0000","last_unstale":"2023-06-09T04:41:01.287737+0000","last_undegraded":"2023-06-09T04:41:01.287737+0000","last_fullsized":"2023-06-09T04:41:01.287737+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:14:40.902021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.283050+0000","last_change":"2023-06-09T04:40:56.792333+0000","last_active":"2023-06-09T04:41:01.283050+0000","last_peered":"2023-06-09T04:41:01.283050+0000","last_clean":"2023-06-09T04:41:01.283050+0000","last_became_active":"2023-06-09T04:40:56.791978+0000","last_became_peered":"2023-06-09T04:40:56.791978+0000","last_unstale":"2023-06-09T04:41:01.283050+0000","last_undegraded":"2023-06-09T04:41:01.283050+0000","last_fullsized":"2023-06-09T04:41:01.283050+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:05:49.158462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.284964+0000","last_change":"2023-06-09T04:40:56.803527+0000","last_active":"2023-06-09T04:41:01.284964+0000","last_peered":"2023-06-09T04:41:01.284964+0000","last_clean":"2023-06-09T04:41:01.284964+0000","last_became_active":"2023-06-09T04:40:56.798138+0000","last_became_peered":"2023-06-09T04:40:56.798138+0000","last_unstale":"2023-06-09T04:41:01.284964+0000","last_undegraded":"2023-06-09T04:41:01.284964+0000","last_fullsized":"2023-06-09T04:41:01.284964+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:50:19.031791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.438636+0000","last_change":"2023-06-09T04:40:56.808104+0000","last_active":"2023-06-09T04:41:01.438636+0000","last_peered":"2023-06-09T04:41:01.438636+0000","last_clean":"2023-06-09T04:41:01.438636+0000","last_became_active":"2023-06-09T04:40:56.807785+0000","last_became_peered":"2023-06-09T04:40:56.807785+0000","last_unstale":"2023-06-09T04:41:01.438636+0000","last_undegraded":"2023-06-09T04:41:01.438636+0000","last_fullsized":"2023-06-09T04:41:01.438636+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:06:43.179689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.439453+0000","last_change":"2023-06-09T04:40:56.793787+0000","last_active":"2023-06-09T04:41:01.439453+0000","last_peered":"2023-06-09T04:41:01.439453+0000","last_clean":"2023-06-09T04:41:01.439453+0000","last_became_active":"2023-06-09T04:40:56.793480+0000","last_became_peered":"2023-06-09T04:40:56.793480+0000","last_unstale":"2023-06-09T04:41:01.439453+0000","last_undegraded":"2023-06-09T04:41:01.439453+0000","last_fullsized":"2023-06-09T04:41:01.439453+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:12:06.677526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.437720+0000","last_change":"2023-06-09T04:40:56.791804+0000","last_active":"2023-06-09T04:41:01.437720+0000","last_peered":"2023-06-09T04:41:01.437720+0000","last_clean":"2023-06-09T04:41:01.437720+0000","last_became_active":"2023-06-09T04:40:56.791541+0000","last_became_peered":"2023-06-09T04:40:56.791541+0000","last_unstale":"2023-06-09T04:41:01.437720+0000","last_undegraded":"2023-06-09T04:41:01.437720+0000","last_fullsized":"2023-06-09T04:41:01.437720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:23:01.827954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.437398+0000","last_change":"2023-06-09T04:40:56.813222+0000","last_active":"2023-06-09T04:41:01.437398+0000","last_peered":"2023-06-09T04:41:01.437398+0000","last_clean":"2023-06-09T04:41:01.437398+0000","last_became_active":"2023-06-09T04:40:56.812972+0000","last_became_peered":"2023-06-09T04:40:56.812972+0000","last_unstale":"2023-06-09T04:41:01.437398+0000","last_undegraded":"2023-06-09T04:41:01.437398+0000","last_fullsized":"2023-06-09T04:41:01.437398+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:43:09.121493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.286724+0000","last_change":"2023-06-09T04:40:56.803077+0000","last_active":"2023-06-09T04:41:01.286724+0000","last_peered":"2023-06-09T04:41:01.286724+0000","last_clean":"2023-06-09T04:41:01.286724+0000","last_became_active":"2023-06-09T04:40:56.802630+0000","last_became_peered":"2023-06-09T04:40:56.802630+0000","last_unstale":"2023-06-09T04:41:01.286724+0000","last_undegraded":"2023-06-09T04:41:01.286724+0000","last_fullsized":"2023-06-09T04:41:01.286724+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:33:17.724459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.440343+0000","last_change":"2023-06-09T04:40:56.795612+0000","last_active":"2023-06-09T04:41:01.440343+0000","last_peered":"2023-06-09T04:41:01.440343+0000","last_clean":"2023-06-09T04:41:01.440343+0000","last_became_active":"2023-06-09T04:40:56.795372+0000","last_became_peered":"2023-06-09T04:40:56.795372+0000","last_unstale":"2023-06-09T04:41:01.440343+0000","last_undegraded":"2023-06-09T04:41:01.440343+0000","last_fullsized":"2023-06-09T04:41:01.440343+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:57:29.499998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.282852+0000","last_change":"2023-06-09T04:40:56.805170+0000","last_active":"2023-06-09T04:41:01.282852+0000","last_peered":"2023-06-09T04:41:01.282852+0000","last_clean":"2023-06-09T04:41:01.282852+0000","last_became_active":"2023-06-09T04:40:56.804824+0000","last_became_peered":"2023-06-09T04:40:56.804824+0000","last_unstale":"2023-06-09T04:41:01.282852+0000","last_undegraded":"2023-06-09T04:41:01.282852+0000","last_fullsized":"2023-06-09T04:41:01.282852+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:14:31.300275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.438522+0000","last_change":"2023-06-09T04:40:56.815327+0000","last_active":"2023-06-09T04:41:01.438522+0000","last_peered":"2023-06-09T04:41:01.438522+0000","last_clean":"2023-06-09T04:41:01.438522+0000","last_became_active":"2023-06-09T04:40:56.815047+0000","last_became_peered":"2023-06-09T04:40:56.815047+0000","last_unstale":"2023-06-09T04:41:01.438522+0000","last_undegraded":"2023-06-09T04:41:01.438522+0000","last_fullsized":"2023-06-09T04:41:01.438522+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:25:21.467588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.438388+0000","last_change":"2023-06-09T04:40:56.808036+0000","last_active":"2023-06-09T04:41:01.438388+0000","last_peered":"2023-06-09T04:41:01.438388+0000","last_clean":"2023-06-09T04:41:01.438388+0000","last_became_active":"2023-06-09T04:40:56.807413+0000","last_became_peered":"2023-06-09T04:40:56.807413+0000","last_unstale":"2023-06-09T04:41:01.438388+0000","last_undegraded":"2023-06-09T04:41:01.438388+0000","last_fullsized":"2023-06-09T04:41:01.438388+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:57:29.499998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.284773+0000","last_change":"2023-06-09T04:40:56.802358+0000","last_active":"2023-06-09T04:41:01.284773+0000","last_peered":"2023-06-09T04:41:01.284773+0000","last_clean":"2023-06-09T04:41:01.284773+0000","last_became_active":"2023-06-09T04:40:56.798262+0000","last_became_peered":"2023-06-09T04:40:56.798262+0000","last_unstale":"2023-06-09T04:41:01.284773+0000","last_undegraded":"2023-06-09T04:41:01.284773+0000","last_fullsized":"2023-06-09T04:41:01.284773+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:44:45.646471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.282293+0000","last_change":"2023-06-09T04:40:56.805149+0000","last_active":"2023-06-09T04:41:01.282293+0000","last_peered":"2023-06-09T04:41:01.282293+0000","last_clean":"2023-06-09T04:41:01.282293+0000","last_became_active":"2023-06-09T04:40:56.804797+0000","last_became_peered":"2023-06-09T04:40:56.804797+0000","last_unstale":"2023-06-09T04:41:01.282293+0000","last_undegraded":"2023-06-09T04:41:01.282293+0000","last_fullsized":"2023-06-09T04:41:01.282293+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:13:45.572440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.287725+0000","last_change":"2023-06-09T04:40:56.798569+0000","last_active":"2023-06-09T04:41:01.287725+0000","last_peered":"2023-06-09T04:41:01.287725+0000","last_clean":"2023-06-09T04:41:01.287725+0000","last_became_active":"2023-06-09T04:40:56.792897+0000","last_became_peered":"2023-06-09T04:40:56.792897+0000","last_unstale":"2023-06-09T04:41:01.287725+0000","last_undegraded":"2023-06-09T04:41:01.287725+0000","last_fullsized":"2023-06-09T04:41:01.287725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:52:36.991160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.286606+0000","last_change":"2023-06-09T04:40:56.803260+0000","last_active":"2023-06-09T04:41:01.286606+0000","last_peered":"2023-06-09T04:41:01.286606+0000","last_clean":"2023-06-09T04:41:01.286606+0000","last_became_active":"2023-06-09T04:40:56.802966+0000","last_became_peered":"2023-06-09T04:40:56.802966+0000","last_unstale":"2023-06-09T04:41:01.286606+0000","last_undegraded":"2023-06-09T04:41:01.286606+0000","last_fullsized":"2023-06-09T04:41:01.286606+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:02:53.168915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.440235+0000","last_change":"2023-06-09T04:40:56.815725+0000","last_active":"2023-06-09T04:41:01.440235+0000","last_peered":"2023-06-09T04:41:01.440235+0000","last_clean":"2023-06-09T04:41:01.440235+0000","last_became_active":"2023-06-09T04:40:56.815369+0000","last_became_peered":"2023-06-09T04:40:56.815369+0000","last_unstale":"2023-06-09T04:41:01.440235+0000","last_undegraded":"2023-06-09T04:41:01.440235+0000","last_fullsized":"2023-06-09T04:41:01.440235+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:13:45.572440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.438161+0000","last_change":"2023-06-09T04:40:56.791652+0000","last_active":"2023-06-09T04:41:01.438161+0000","last_peered":"2023-06-09T04:41:01.438161+0000","last_clean":"2023-06-09T04:41:01.438161+0000","last_became_active":"2023-06-09T04:40:56.791358+0000","last_became_peered":"2023-06-09T04:40:56.791358+0000","last_unstale":"2023-06-09T04:41:01.438161+0000","last_undegraded":"2023-06-09T04:41:01.438161+0000","last_fullsized":"2023-06-09T04:41:01.438161+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:18:56.081370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4591,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574860,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":904,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":925696,"data_stored":718949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.04}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.161}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2050000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.357}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3839999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":303104,"data_stored":124572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9359999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.022}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.095}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3779999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574860,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":311296,"data_stored":125224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93400000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0129999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.494}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4350000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.466}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2689999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":323584,"data_stored":128421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0860000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.141}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1879999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0329999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4139999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574860,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":307200,"data_stored":124662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1180000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2829999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2390000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.169}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.444}]}]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":303104,"data_stored":124572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1910000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.121}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0580000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.101}]}]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":303104,"data_stored":124572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0429999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.298}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.141}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4770000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1830000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4159999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574861,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":901120,"data_stored":715522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9809999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1919999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-09T04:41:31.352 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-09T04:41:31.564 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.559+0000 7fdbee2eb700 1 Processor -- start 2023-06-09T04:41:31.564 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.559+0000 7fdbee2eb700 1 -- start start 2023-06-09T04:41:31.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.559+0000 7fdbee2eb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdbe815ff70 0x7fdbe80c9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:31.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.559+0000 7fdbee2eb700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fdbe8160340 0x7fdbe80caa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:31.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.559+0000 7fdbee2eb700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbe80cdc20 con 0x7fdbe80ca210 2023-06-09T04:41:31.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.559+0000 7fdbee2eb700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbe80cd330 con 0x7fdbe8160340 2023-06-09T04:41:31.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.559+0000 7fdbee2eb700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe80cd5d0 con 0x7fdbe815ff70 2023-06-09T04:41:31.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.563+0000 7fdbedaea700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fdbe80ca210 0x7fdbe8163df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36244/0 (socket says 172.21.15.62:36244) 2023-06-09T04:41:31.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.563+0000 7fdbedaea700 1 -- 172.21.15.62:0/2484910791 learned_addr learned my addr 172.21.15.62:0/2484910791 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:41:31.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.563+0000 7fdbecae8700 1 --2- 172.21.15.62:0/2484910791 >> v2:172.21.15.62:3300/0 conn(0x7fdbe8160340 0x7fdbe80caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:31.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.563+0000 7fdbed2e9700 1 --2- 172.21.15.62:0/2484910791 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdbe815ff70 0x7fdbe80c9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:31.569 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.563+0000 7fdbdffff700 1 -- 172.21.15.62:0/2484910791 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2982158252 0 0) 0x7fdbe80cdc20 con 0x7fdbe80ca210 2023-06-09T04:41:31.569 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.563+0000 7fdbdffff700 1 -- 172.21.15.62:0/2484910791 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbd40035d0 con 0x7fdbe80ca210 2023-06-09T04:41:31.569 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.563+0000 7fdbecae8700 1 -- 172.21.15.62:0/2484910791 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdbe815ff70 msgr2=0x7fdbe80c9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:31.569 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.563+0000 7fdbecae8700 1 --2- 172.21.15.62:0/2484910791 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdbe815ff70 0x7fdbe80c9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:31.570 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.563+0000 7fdbecae8700 1 -- 172.21.15.62:0/2484910791 >> v1:172.21.15.62:6789/0 conn(0x7fdbe80ca210 legacy=0x7fdbe8163df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:31.570 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.563+0000 7fdbecae8700 1 -- 172.21.15.62:0/2484910791 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbe80cd8b0 con 0x7fdbe8160340 2023-06-09T04:41:31.570 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.563+0000 7fdbecae8700 1 --2- 172.21.15.62:0/2484910791 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdbe8160340 0x7fdbe80caa40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fdbd8009850 tx=0x7fdbd8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=596f6f09e009993a server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:31.570 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.563+0000 7fdbdffff700 1 -- 172.21.15.62:0/2484910791 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd8011830 con 0x7fdbe8160340 2023-06-09T04:41:31.570 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.563+0000 7fdbdffff700 1 -- 172.21.15.62:0/2484910791 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbd8011990 con 0x7fdbe8160340 2023-06-09T04:41:31.570 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.563+0000 7fdbdffff700 1 -- 172.21.15.62:0/2484910791 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd8011d00 con 0x7fdbe8160340 2023-06-09T04:41:31.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.563+0000 7fdbee2eb700 1 -- 172.21.15.62:0/2484910791 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdbe8160340 msgr2=0x7fdbe80caa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:31.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.563+0000 7fdbee2eb700 1 --2- 172.21.15.62:0/2484910791 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdbe8160340 0x7fdbe80caa40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fdbd8009850 tx=0x7fdbd8009b60 comp rx=0 tx=0).stop 2023-06-09T04:41:31.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.563+0000 7fdbee2eb700 1 -- 172.21.15.62:0/2484910791 shutdown_connections 2023-06-09T04:41:31.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.563+0000 7fdbee2eb700 1 --2- 172.21.15.62:0/2484910791 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdbe8160340 0x7fdbe80caa40 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:31.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.563+0000 7fdbee2eb700 1 --2- 172.21.15.62:0/2484910791 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdbe815ff70 0x7fdbe80c9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:31.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.563+0000 7fdbee2eb700 1 -- 172.21.15.62:0/2484910791 >> 172.21.15.62:0/2484910791 conn(0x7fdbe806a420 msgr2=0x7fdbe80afc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:31.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.563+0000 7fdbee2eb700 1 -- 172.21.15.62:0/2484910791 shutdown_connections 2023-06-09T04:41:31.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.567+0000 7fdbee2eb700 1 -- 172.21.15.62:0/2484910791 wait complete. 2023-06-09T04:41:31.574 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.567+0000 7fdbee2eb700 1 Processor -- start 2023-06-09T04:41:31.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.567+0000 7fdbee2eb700 1 -- start start 2023-06-09T04:41:31.577 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.571+0000 7fdbee2eb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdbe815ff70 0x7fdbe8151090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:31.577 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.571+0000 7fdbee2eb700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdbe8160340 0x7fdbe80c5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:31.578 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.571+0000 7fdbee2eb700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbe81f9dc0 0x7fdbe80c3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:31.578 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.571+0000 7fdbee2eb700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe80b2930 con 0x7fdbe8160340 2023-06-09T04:41:31.578 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.571+0000 7fdbee2eb700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe80c6490 con 0x7fdbe81f9dc0 2023-06-09T04:41:31.578 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.571+0000 7fdbee2eb700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe80c6770 con 0x7fdbe815ff70 2023-06-09T04:41:31.578 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.571+0000 7fdbecae8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdbe8160340 0x7fdbe80c5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:31.578 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.571+0000 7fdbecae8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdbe8160340 0x7fdbe80c5c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53346/0 (socket says 172.21.15.62:53346) 2023-06-09T04:41:31.578 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.571+0000 7fdbecae8700 1 -- 172.21.15.62:0/2799065957 learned_addr learned my addr 172.21.15.62:0/2799065957 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:31.579 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.571+0000 7fdbed2e9700 1 --2- 172.21.15.62:0/2799065957 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdbe815ff70 0x7fdbe8151090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:31.579 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.571+0000 7fdbedaea700 1 --2- 172.21.15.62:0/2799065957 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbe81f9dc0 0x7fdbe80c3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:31.580 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.571+0000 7fdbecae8700 1 -- 172.21.15.62:0/2799065957 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdbe815ff70 msgr2=0x7fdbe8151090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:31.580 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.571+0000 7fdbecae8700 1 --2- 172.21.15.62:0/2799065957 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdbe815ff70 0x7fdbe8151090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:31.580 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.571+0000 7fdbecae8700 1 -- 172.21.15.62:0/2799065957 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbe81f9dc0 msgr2=0x7fdbe80c3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:31.580 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.571+0000 7fdbecae8700 1 --2- 172.21.15.62:0/2799065957 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbe81f9dc0 0x7fdbe80c3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:31.580 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.571+0000 7fdbecae8700 1 -- 172.21.15.62:0/2799065957 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbd80094b0 con 0x7fdbe8160340 2023-06-09T04:41:31.580 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.571+0000 7fdbed2e9700 1 --2- 172.21.15.62:0/2799065957 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdbe815ff70 0x7fdbe8151090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:41:31.581 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.571+0000 7fdbecae8700 1 --2- 172.21.15.62:0/2799065957 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdbe8160340 0x7fdbe80c5c20 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fdbd8009ba0 tx=0x7fdbd8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:31.581 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.575+0000 7fdbddffb700 1 -- 172.21.15.62:0/2799065957 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd80036c0 con 0x7fdbe8160340 2023-06-09T04:41:31.581 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.575+0000 7fdbddffb700 1 -- 172.21.15.62:0/2799065957 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbd801e070 con 0x7fdbe8160340 2023-06-09T04:41:31.581 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.575+0000 7fdbddffb700 1 -- 172.21.15.62:0/2799065957 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd8003a60 con 0x7fdbe8160340 2023-06-09T04:41:31.581 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.575+0000 7fdbee2eb700 1 -- 172.21.15.62:0/2799065957 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbe80b22e0 con 0x7fdbe8160340 2023-06-09T04:41:31.581 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.575+0000 7fdbee2eb700 1 -- 172.21.15.62:0/2799065957 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbe80c6160 con 0x7fdbe8160340 2023-06-09T04:41:31.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.575+0000 7fdbee2eb700 1 -- 172.21.15.62:0/2799065957 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbe80b2aa0 con 0x7fdbe8160340 2023-06-09T04:41:31.583 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.579+0000 7fdbddffb700 1 -- 172.21.15.62:0/2799065957 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdbd8003bc0 con 0x7fdbe8160340 2023-06-09T04:41:31.584 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.579+0000 7fdbddffb700 1 --2- 172.21.15.62:0/2799065957 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fdbcc066320 0x7fdbcc0687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:31.584 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.579+0000 7fdbddffb700 1 -- 172.21.15.62:0/2799065957 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fdbd8084f20 con 0x7fdbe8160340 2023-06-09T04:41:31.584 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.579+0000 7fdbed2e9700 1 --2- 172.21.15.62:0/2799065957 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fdbcc066320 0x7fdbcc0687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:31.586 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.579+0000 7fdbed2e9700 1 --2- 172.21.15.62:0/2799065957 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fdbcc066320 0x7fdbcc0687d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fdbe4009c40 tx=0x7fdbe4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:31.592 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.587+0000 7fdbddffb700 1 -- 172.21.15.62:0/2799065957 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdbd80520b0 con 0x7fdbe8160340 2023-06-09T04:41:31.757 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.751+0000 7fdbee2eb700 1 -- 172.21.15.62:0/2799065957 --> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdbe80ca790 con 0x7fdbcc066320 2023-06-09T04:41:31.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.771+0000 7fdbddffb700 1 -- 172.21.15.62:0/2799065957 <== mgr.4106 v2:172.21.15.89:6832/3073446405 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367186 (secure 0 0 0) 0x7fdbe4004030 con 0x7fdbcc066320 2023-06-09T04:41:31.778 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:41:31.786 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.779+0000 7fdbee2eb700 1 -- 172.21.15.62:0/2799065957 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fdbcc066320 msgr2=0x7fdbcc0687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:31.786 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.779+0000 7fdbee2eb700 1 --2- 172.21.15.62:0/2799065957 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fdbcc066320 0x7fdbcc0687d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fdbe4009c40 tx=0x7fdbe4008040 comp rx=0 tx=0).stop 2023-06-09T04:41:31.786 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.779+0000 7fdbee2eb700 1 -- 172.21.15.62:0/2799065957 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdbe8160340 msgr2=0x7fdbe80c5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:31.786 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.779+0000 7fdbee2eb700 1 --2- 172.21.15.62:0/2799065957 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdbe8160340 0x7fdbe80c5c20 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fdbd8009ba0 tx=0x7fdbd8004770 comp rx=0 tx=0).stop 2023-06-09T04:41:31.786 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.779+0000 7fdbee2eb700 1 -- 172.21.15.62:0/2799065957 shutdown_connections 2023-06-09T04:41:31.786 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.779+0000 7fdbee2eb700 1 --2- 172.21.15.62:0/2799065957 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fdbcc066320 0x7fdbcc0687d0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:31.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.779+0000 7fdbee2eb700 1 --2- 172.21.15.62:0/2799065957 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdbe81f9dc0 0x7fdbe80c3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:31.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.779+0000 7fdbee2eb700 1 --2- 172.21.15.62:0/2799065957 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdbe8160340 0x7fdbe80c5c20 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:31.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.779+0000 7fdbee2eb700 1 --2- 172.21.15.62:0/2799065957 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdbe815ff70 0x7fdbe8151090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:31.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.779+0000 7fdbee2eb700 1 -- 172.21.15.62:0/2799065957 >> 172.21.15.62:0/2799065957 conn(0x7fdbe80ca210 msgr2=0x7fdbe80c1b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:31.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.779+0000 7fdbee2eb700 1 -- 172.21.15.62:0/2799065957 shutdown_connections 2023-06-09T04:41:31.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:31.779+0000 7fdbee2eb700 1 -- 172.21.15.62:0/2799065957 wait complete. 2023-06-09T04:41:31.788 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2023-06-09T04:41:31.809 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":45,"stamp":"2023-06-09T04:41:30.576237+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594959,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219208,"kb_used_data":3592,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754755512,"statfs":{"total":773094113280,"available":772869644288,"internally_reserved":0,"allocated":3678208,"data_stored":2186494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005607"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.421613+0000","last_change":"2023-06-09T04:41:00.837443+0000","last_active":"2023-06-09T04:41:01.421613+0000","last_peered":"2023-06-09T04:41:01.421613+0000","last_clean":"2023-06-09T04:41:01.421613+0000","last_became_active":"2023-06-09T04:41:00.837056+0000","last_became_peered":"2023-06-09T04:41:00.837056+0000","last_unstale":"2023-06-09T04:41:01.421613+0000","last_undegraded":"2023-06-09T04:41:01.421613+0000","last_fullsized":"2023-06-09T04:41:01.421613+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:12:34.351708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.283099+0000","last_change":"2023-06-09T04:40:56.317710+0000","last_active":"2023-06-09T04:41:01.283099+0000","last_peered":"2023-06-09T04:41:01.283099+0000","last_clean":"2023-06-09T04:41:01.283099+0000","last_became_active":"2023-06-09T04:40:56.317367+0000","last_became_peered":"2023-06-09T04:40:56.317367+0000","last_unstale":"2023-06-09T04:41:01.283099+0000","last_undegraded":"2023-06-09T04:41:01.283099+0000","last_fullsized":"2023-06-09T04:41:01.283099+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:08:05.189610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.285106+0000","last_change":"2023-06-09T04:40:56.786880+0000","last_active":"2023-06-09T04:41:01.285106+0000","last_peered":"2023-06-09T04:41:01.285106+0000","last_clean":"2023-06-09T04:41:01.285106+0000","last_became_active":"2023-06-09T04:40:56.786577+0000","last_became_peered":"2023-06-09T04:40:56.786577+0000","last_unstale":"2023-06-09T04:41:01.285106+0000","last_undegraded":"2023-06-09T04:41:01.285106+0000","last_fullsized":"2023-06-09T04:41:01.285106+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:08:26.522608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.284846+0000","last_change":"2023-06-09T04:41:00.821962+0000","last_active":"2023-06-09T04:41:01.284846+0000","last_peered":"2023-06-09T04:41:01.284846+0000","last_clean":"2023-06-09T04:41:01.284846+0000","last_became_active":"2023-06-09T04:41:00.821590+0000","last_became_peered":"2023-06-09T04:41:00.821590+0000","last_unstale":"2023-06-09T04:41:01.284846+0000","last_undegraded":"2023-06-09T04:41:01.284846+0000","last_fullsized":"2023-06-09T04:41:01.284846+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:24:19.683717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.438875+0000","last_change":"2023-06-09T04:40:56.309042+0000","last_active":"2023-06-09T04:41:01.438875+0000","last_peered":"2023-06-09T04:41:01.438875+0000","last_clean":"2023-06-09T04:41:01.438875+0000","last_became_active":"2023-06-09T04:40:56.308672+0000","last_became_peered":"2023-06-09T04:40:56.308672+0000","last_unstale":"2023-06-09T04:41:01.438875+0000","last_undegraded":"2023-06-09T04:41:01.438875+0000","last_fullsized":"2023-06-09T04:41:01.438875+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:24:15.161832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.436648+0000","last_change":"2023-06-09T04:40:56.792828+0000","last_active":"2023-06-09T04:41:01.436648+0000","last_peered":"2023-06-09T04:41:01.436648+0000","last_clean":"2023-06-09T04:41:01.436648+0000","last_became_active":"2023-06-09T04:40:56.788328+0000","last_became_peered":"2023-06-09T04:40:56.788328+0000","last_unstale":"2023-06-09T04:41:01.436648+0000","last_undegraded":"2023-06-09T04:41:01.436648+0000","last_fullsized":"2023-06-09T04:41:01.436648+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:52:44.006009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.438852+0000","last_change":"2023-06-09T04:41:00.839470+0000","last_active":"2023-06-09T04:41:01.438852+0000","last_peered":"2023-06-09T04:41:01.438852+0000","last_clean":"2023-06-09T04:41:01.438852+0000","last_became_active":"2023-06-09T04:41:00.839052+0000","last_became_peered":"2023-06-09T04:41:00.839052+0000","last_unstale":"2023-06-09T04:41:01.438852+0000","last_undegraded":"2023-06-09T04:41:01.438852+0000","last_fullsized":"2023-06-09T04:41:01.438852+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:49:49.299980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.439510+0000","last_change":"2023-06-09T04:40:56.321454+0000","last_active":"2023-06-09T04:41:01.439510+0000","last_peered":"2023-06-09T04:41:01.439510+0000","last_clean":"2023-06-09T04:41:01.439510+0000","last_became_active":"2023-06-09T04:40:56.321031+0000","last_became_peered":"2023-06-09T04:40:56.321031+0000","last_unstale":"2023-06-09T04:41:01.439510+0000","last_undegraded":"2023-06-09T04:41:01.439510+0000","last_fullsized":"2023-06-09T04:41:01.439510+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:25:05.608273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.285103+0000","last_change":"2023-06-09T04:40:56.803877+0000","last_active":"2023-06-09T04:41:01.285103+0000","last_peered":"2023-06-09T04:41:01.285103+0000","last_clean":"2023-06-09T04:41:01.285103+0000","last_became_active":"2023-06-09T04:40:56.798582+0000","last_became_peered":"2023-06-09T04:40:56.798582+0000","last_unstale":"2023-06-09T04:41:01.285103+0000","last_undegraded":"2023-06-09T04:41:01.285103+0000","last_fullsized":"2023-06-09T04:41:01.285103+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:21:53.601425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.439153+0000","last_change":"2023-06-09T04:41:00.836245+0000","last_active":"2023-06-09T04:41:01.439153+0000","last_peered":"2023-06-09T04:41:01.439153+0000","last_clean":"2023-06-09T04:41:01.439153+0000","last_became_active":"2023-06-09T04:41:00.835686+0000","last_became_peered":"2023-06-09T04:41:00.835686+0000","last_unstale":"2023-06-09T04:41:01.439153+0000","last_undegraded":"2023-06-09T04:41:01.439153+0000","last_fullsized":"2023-06-09T04:41:01.439153+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:03:10.253378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.440020+0000","last_change":"2023-06-09T04:40:56.321489+0000","last_active":"2023-06-09T04:41:01.440020+0000","last_peered":"2023-06-09T04:41:01.440020+0000","last_clean":"2023-06-09T04:41:01.440020+0000","last_became_active":"2023-06-09T04:40:56.321100+0000","last_became_peered":"2023-06-09T04:40:56.321100+0000","last_unstale":"2023-06-09T04:41:01.440020+0000","last_undegraded":"2023-06-09T04:41:01.440020+0000","last_fullsized":"2023-06-09T04:41:01.440020+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:17:49.593978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.285507+0000","last_change":"2023-06-09T04:40:56.794715+0000","last_active":"2023-06-09T04:41:01.285507+0000","last_peered":"2023-06-09T04:41:01.285507+0000","last_clean":"2023-06-09T04:41:01.285507+0000","last_became_active":"2023-06-09T04:40:56.794493+0000","last_became_peered":"2023-06-09T04:40:56.794493+0000","last_unstale":"2023-06-09T04:41:01.285507+0000","last_undegraded":"2023-06-09T04:41:01.285507+0000","last_fullsized":"2023-06-09T04:41:01.285507+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:08:24.838920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.422791+0000","last_change":"2023-06-09T04:41:00.828797+0000","last_active":"2023-06-09T04:41:01.422791+0000","last_peered":"2023-06-09T04:41:01.422791+0000","last_clean":"2023-06-09T04:41:01.422791+0000","last_became_active":"2023-06-09T04:41:00.828438+0000","last_became_peered":"2023-06-09T04:41:00.828438+0000","last_unstale":"2023-06-09T04:41:01.422791+0000","last_undegraded":"2023-06-09T04:41:01.422791+0000","last_fullsized":"2023-06-09T04:41:01.422791+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:24:29.997250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.282480+0000","last_change":"2023-06-09T04:40:56.317253+0000","last_active":"2023-06-09T04:41:01.282480+0000","last_peered":"2023-06-09T04:41:01.282480+0000","last_clean":"2023-06-09T04:41:01.282480+0000","last_became_active":"2023-06-09T04:40:56.316877+0000","last_became_peered":"2023-06-09T04:40:56.316877+0000","last_unstale":"2023-06-09T04:41:01.282480+0000","last_undegraded":"2023-06-09T04:41:01.282480+0000","last_fullsized":"2023-06-09T04:41:01.282480+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:25:25.277964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.437522+0000","last_change":"2023-06-09T04:40:56.797830+0000","last_active":"2023-06-09T04:41:01.437522+0000","last_peered":"2023-06-09T04:41:01.437522+0000","last_clean":"2023-06-09T04:41:01.437522+0000","last_became_active":"2023-06-09T04:40:56.797556+0000","last_became_peered":"2023-06-09T04:40:56.797556+0000","last_unstale":"2023-06-09T04:41:01.437522+0000","last_undegraded":"2023-06-09T04:41:01.437522+0000","last_fullsized":"2023-06-09T04:41:01.437522+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:43:46.753266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.286268+0000","last_change":"2023-06-09T04:41:00.825865+0000","last_active":"2023-06-09T04:41:01.286268+0000","last_peered":"2023-06-09T04:41:01.286268+0000","last_clean":"2023-06-09T04:41:01.286268+0000","last_became_active":"2023-06-09T04:41:00.825477+0000","last_became_peered":"2023-06-09T04:41:00.825477+0000","last_unstale":"2023-06-09T04:41:01.286268+0000","last_undegraded":"2023-06-09T04:41:01.286268+0000","last_fullsized":"2023-06-09T04:41:01.286268+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:51:30.775136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.285644+0000","last_change":"2023-06-09T04:40:56.315320+0000","last_active":"2023-06-09T04:41:01.285644+0000","last_peered":"2023-06-09T04:41:01.285644+0000","last_clean":"2023-06-09T04:41:01.285644+0000","last_became_active":"2023-06-09T04:40:56.314967+0000","last_became_peered":"2023-06-09T04:40:56.314967+0000","last_unstale":"2023-06-09T04:41:01.285644+0000","last_undegraded":"2023-06-09T04:41:01.285644+0000","last_fullsized":"2023-06-09T04:41:01.285644+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:01:49.680802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.438480+0000","last_change":"2023-06-09T04:40:56.798062+0000","last_active":"2023-06-09T04:41:01.438480+0000","last_peered":"2023-06-09T04:41:01.438480+0000","last_clean":"2023-06-09T04:41:01.438480+0000","last_became_active":"2023-06-09T04:40:56.795892+0000","last_became_peered":"2023-06-09T04:40:56.795892+0000","last_unstale":"2023-06-09T04:41:01.438480+0000","last_undegraded":"2023-06-09T04:41:01.438480+0000","last_fullsized":"2023-06-09T04:41:01.438480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:48:05.320971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.287250+0000","last_change":"2023-06-09T04:41:00.829272+0000","last_active":"2023-06-09T04:41:01.287250+0000","last_peered":"2023-06-09T04:41:01.287250+0000","last_clean":"2023-06-09T04:41:01.287250+0000","last_became_active":"2023-06-09T04:41:00.828913+0000","last_became_peered":"2023-06-09T04:41:00.828913+0000","last_unstale":"2023-06-09T04:41:01.287250+0000","last_undegraded":"2023-06-09T04:41:01.287250+0000","last_fullsized":"2023-06-09T04:41:01.287250+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:36:54.747824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.423032+0000","last_change":"2023-06-09T04:40:56.320610+0000","last_active":"2023-06-09T04:41:01.423032+0000","last_peered":"2023-06-09T04:41:01.423032+0000","last_clean":"2023-06-09T04:41:01.423032+0000","last_became_active":"2023-06-09T04:40:56.320210+0000","last_became_peered":"2023-06-09T04:40:56.320210+0000","last_unstale":"2023-06-09T04:41:01.423032+0000","last_undegraded":"2023-06-09T04:41:01.423032+0000","last_fullsized":"2023-06-09T04:41:01.423032+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:43:30.487796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.282810+0000","last_change":"2023-06-09T04:40:56.800181+0000","last_active":"2023-06-09T04:41:01.282810+0000","last_peered":"2023-06-09T04:41:01.282810+0000","last_clean":"2023-06-09T04:41:01.282810+0000","last_became_active":"2023-06-09T04:40:56.798880+0000","last_became_peered":"2023-06-09T04:40:56.798880+0000","last_unstale":"2023-06-09T04:41:01.282810+0000","last_undegraded":"2023-06-09T04:41:01.282810+0000","last_fullsized":"2023-06-09T04:41:01.282810+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:43:31.500509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.282532+0000","last_change":"2023-06-09T04:41:00.841825+0000","last_active":"2023-06-09T04:41:01.282532+0000","last_peered":"2023-06-09T04:41:01.282532+0000","last_clean":"2023-06-09T04:41:01.282532+0000","last_became_active":"2023-06-09T04:41:00.841441+0000","last_became_peered":"2023-06-09T04:41:00.841441+0000","last_unstale":"2023-06-09T04:41:01.282532+0000","last_undegraded":"2023-06-09T04:41:01.282532+0000","last_fullsized":"2023-06-09T04:41:01.282532+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:24:29.997250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.436487+0000","last_change":"2023-06-09T04:40:56.314387+0000","last_active":"2023-06-09T04:41:01.436487+0000","last_peered":"2023-06-09T04:41:01.436487+0000","last_clean":"2023-06-09T04:41:01.436487+0000","last_became_active":"2023-06-09T04:40:56.314056+0000","last_became_peered":"2023-06-09T04:40:56.314056+0000","last_unstale":"2023-06-09T04:41:01.436487+0000","last_undegraded":"2023-06-09T04:41:01.436487+0000","last_fullsized":"2023-06-09T04:41:01.436487+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:03:05.731493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.287409+0000","last_change":"2023-06-09T04:40:56.799527+0000","last_active":"2023-06-09T04:41:01.287409+0000","last_peered":"2023-06-09T04:41:01.287409+0000","last_clean":"2023-06-09T04:41:01.287409+0000","last_became_active":"2023-06-09T04:40:56.799215+0000","last_became_peered":"2023-06-09T04:40:56.799215+0000","last_unstale":"2023-06-09T04:41:01.287409+0000","last_undegraded":"2023-06-09T04:41:01.287409+0000","last_fullsized":"2023-06-09T04:41:01.287409+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:34:05.634982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.436197+0000","last_change":"2023-06-09T04:40:56.785429+0000","last_active":"2023-06-09T04:41:01.436197+0000","last_peered":"2023-06-09T04:41:01.436197+0000","last_clean":"2023-06-09T04:41:01.436197+0000","last_became_active":"2023-06-09T04:40:56.785114+0000","last_became_peered":"2023-06-09T04:40:56.785114+0000","last_unstale":"2023-06-09T04:41:01.436197+0000","last_undegraded":"2023-06-09T04:41:01.436197+0000","last_fullsized":"2023-06-09T04:41:01.436197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:06:43.179689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.283223+0000","last_change":"2023-06-09T04:40:56.317391+0000","last_active":"2023-06-09T04:41:01.283223+0000","last_peered":"2023-06-09T04:41:01.283223+0000","last_clean":"2023-06-09T04:41:01.283223+0000","last_became_active":"2023-06-09T04:40:56.317009+0000","last_became_peered":"2023-06-09T04:40:56.317009+0000","last_unstale":"2023-06-09T04:41:01.283223+0000","last_undegraded":"2023-06-09T04:41:01.283223+0000","last_fullsized":"2023-06-09T04:41:01.283223+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:52:42.993296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.285830+0000","last_change":"2023-06-09T04:41:00.835405+0000","last_active":"2023-06-09T04:41:01.285830+0000","last_peered":"2023-06-09T04:41:01.285830+0000","last_clean":"2023-06-09T04:41:01.285830+0000","last_became_active":"2023-06-09T04:41:00.834994+0000","last_became_peered":"2023-06-09T04:41:00.834994+0000","last_unstale":"2023-06-09T04:41:01.285830+0000","last_undegraded":"2023-06-09T04:41:01.285830+0000","last_fullsized":"2023-06-09T04:41:01.285830+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:47:36.457098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.436354+0000","last_change":"2023-06-09T04:40:56.796887+0000","last_active":"2023-06-09T04:41:01.436354+0000","last_peered":"2023-06-09T04:41:01.436354+0000","last_clean":"2023-06-09T04:41:01.436354+0000","last_became_active":"2023-06-09T04:40:56.796261+0000","last_became_peered":"2023-06-09T04:40:56.796261+0000","last_unstale":"2023-06-09T04:41:01.436354+0000","last_undegraded":"2023-06-09T04:41:01.436354+0000","last_fullsized":"2023-06-09T04:41:01.436354+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:04:45.938545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.440403+0000","last_change":"2023-06-09T04:40:56.316780+0000","last_active":"2023-06-09T04:41:01.440403+0000","last_peered":"2023-06-09T04:41:01.440403+0000","last_clean":"2023-06-09T04:41:01.440403+0000","last_became_active":"2023-06-09T04:40:56.315706+0000","last_became_peered":"2023-06-09T04:40:56.315706+0000","last_unstale":"2023-06-09T04:41:01.440403+0000","last_undegraded":"2023-06-09T04:41:01.440403+0000","last_fullsized":"2023-06-09T04:41:01.440403+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:24:25.475365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.438087+0000","last_change":"2023-06-09T04:41:00.831457+0000","last_active":"2023-06-09T04:41:01.438087+0000","last_peered":"2023-06-09T04:41:01.438087+0000","last_clean":"2023-06-09T04:41:01.438087+0000","last_became_active":"2023-06-09T04:41:00.830962+0000","last_became_peered":"2023-06-09T04:41:00.830962+0000","last_unstale":"2023-06-09T04:41:01.438087+0000","last_undegraded":"2023-06-09T04:41:01.438087+0000","last_fullsized":"2023-06-09T04:41:01.438087+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:20:23.212298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":24,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.439608+0000","last_change":"2023-06-09T04:40:56.322126+0000","last_active":"2023-06-09T04:41:01.439608+0000","last_peered":"2023-06-09T04:41:01.439608+0000","last_clean":"2023-06-09T04:41:01.439608+0000","last_became_active":"2023-06-09T04:40:56.321833+0000","last_became_peered":"2023-06-09T04:40:56.321833+0000","last_unstale":"2023-06-09T04:41:01.439608+0000","last_undegraded":"2023-06-09T04:41:01.439608+0000","last_fullsized":"2023-06-09T04:41:01.439608+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:52:42.993296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.422084+0000","last_change":"2023-06-09T04:40:56.810607+0000","last_active":"2023-06-09T04:41:01.422084+0000","last_peered":"2023-06-09T04:41:01.422084+0000","last_clean":"2023-06-09T04:41:01.422084+0000","last_became_active":"2023-06-09T04:40:56.806121+0000","last_became_peered":"2023-06-09T04:40:56.806121+0000","last_unstale":"2023-06-09T04:41:01.422084+0000","last_undegraded":"2023-06-09T04:41:01.422084+0000","last_fullsized":"2023-06-09T04:41:01.422084+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:17:50.606690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.436321+0000","last_change":"2023-06-09T04:41:00.825055+0000","last_active":"2023-06-09T04:41:01.436321+0000","last_peered":"2023-06-09T04:41:01.436321+0000","last_clean":"2023-06-09T04:41:01.436321+0000","last_became_active":"2023-06-09T04:41:00.824544+0000","last_became_peered":"2023-06-09T04:41:00.824544+0000","last_unstale":"2023-06-09T04:41:01.436321+0000","last_undegraded":"2023-06-09T04:41:01.436321+0000","last_fullsized":"2023-06-09T04:41:01.436321+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:43:35.009681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"28'10","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:14.324470+0000","last_change":"2023-06-09T04:40:56.314806+0000","last_active":"2023-06-09T04:41:14.324470+0000","last_peered":"2023-06-09T04:41:14.324470+0000","last_clean":"2023-06-09T04:41:14.324470+0000","last_became_active":"2023-06-09T04:40:56.312677+0000","last_became_peered":"2023-06-09T04:40:56.312677+0000","last_unstale":"2023-06-09T04:41:14.324470+0000","last_undegraded":"2023-06-09T04:41:14.324470+0000","last_fullsized":"2023-06-09T04:41:14.324470+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:50:18.781041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3793,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.285588+0000","last_change":"2023-06-09T04:40:56.787806+0000","last_active":"2023-06-09T04:41:01.285588+0000","last_peered":"2023-06-09T04:41:01.285588+0000","last_clean":"2023-06-09T04:41:01.285588+0000","last_became_active":"2023-06-09T04:40:56.787509+0000","last_became_peered":"2023-06-09T04:40:56.787509+0000","last_unstale":"2023-06-09T04:41:01.285588+0000","last_undegraded":"2023-06-09T04:41:01.285588+0000","last_fullsized":"2023-06-09T04:41:01.285588+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T04:54:37.254871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.421967+0000","last_change":"2023-06-09T04:41:00.837111+0000","last_active":"2023-06-09T04:41:01.421967+0000","last_peered":"2023-06-09T04:41:01.421967+0000","last_clean":"2023-06-09T04:41:01.421967+0000","last_became_active":"2023-06-09T04:41:00.836434+0000","last_became_peered":"2023-06-09T04:41:00.836434+0000","last_unstale":"2023-06-09T04:41:01.421967+0000","last_undegraded":"2023-06-09T04:41:01.421967+0000","last_fullsized":"2023-06-09T04:41:01.421967+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:47:47.084156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.285632+0000","last_change":"2023-06-09T04:40:56.798290+0000","last_active":"2023-06-09T04:41:01.285632+0000","last_peered":"2023-06-09T04:41:01.285632+0000","last_clean":"2023-06-09T04:41:01.285632+0000","last_became_active":"2023-06-09T04:40:56.797577+0000","last_became_peered":"2023-06-09T04:40:56.797577+0000","last_unstale":"2023-06-09T04:41:01.285632+0000","last_undegraded":"2023-06-09T04:41:01.285632+0000","last_fullsized":"2023-06-09T04:41:01.285632+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:40:42.697633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.287520+0000","last_change":"2023-06-09T04:40:51.254956+0000","last_active":"2023-06-09T04:41:01.287520+0000","last_peered":"2023-06-09T04:41:01.287520+0000","last_clean":"2023-06-09T04:41:01.287520+0000","last_became_active":"2023-06-09T04:40:51.254627+0000","last_became_peered":"2023-06-09T04:40:51.254627+0000","last_unstale":"2023-06-09T04:41:01.287520+0000","last_undegraded":"2023-06-09T04:41:01.287520+0000","last_fullsized":"2023-06-09T04:41:01.287520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_clean_scrub_stamp":"2023-06-09T04:40:50.211713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:44:56.996665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"28'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.283072+0000","last_change":"2023-06-09T04:40:56.315263+0000","last_active":"2023-06-09T04:41:01.283072+0000","last_peered":"2023-06-09T04:41:01.283072+0000","last_clean":"2023-06-09T04:41:01.283072+0000","last_became_active":"2023-06-09T04:40:56.314747+0000","last_became_peered":"2023-06-09T04:40:56.314747+0000","last_unstale":"2023-06-09T04:41:01.283072+0000","last_undegraded":"2023-06-09T04:41:01.283072+0000","last_fullsized":"2023-06-09T04:41:01.283072+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:03:05.731493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.436011+0000","last_change":"2023-06-09T04:41:00.833888+0000","last_active":"2023-06-09T04:41:01.436011+0000","last_peered":"2023-06-09T04:41:01.436011+0000","last_clean":"2023-06-09T04:41:01.436011+0000","last_became_active":"2023-06-09T04:41:00.833442+0000","last_became_peered":"2023-06-09T04:41:00.833442+0000","last_unstale":"2023-06-09T04:41:01.436011+0000","last_undegraded":"2023-06-09T04:41:01.436011+0000","last_fullsized":"2023-06-09T04:41:01.436011+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:24:29.997250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.436508+0000","last_change":"2023-06-09T04:40:56.802424+0000","last_active":"2023-06-09T04:41:01.436508+0000","last_peered":"2023-06-09T04:41:01.436508+0000","last_clean":"2023-06-09T04:41:01.436508+0000","last_became_active":"2023-06-09T04:40:56.802154+0000","last_became_peered":"2023-06-09T04:40:56.802154+0000","last_unstale":"2023-06-09T04:41:01.436508+0000","last_undegraded":"2023-06-09T04:41:01.436508+0000","last_fullsized":"2023-06-09T04:41:01.436508+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:05:49.158462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.423447+0000","last_change":"2023-06-09T04:40:51.247235+0000","last_active":"2023-06-09T04:41:01.423447+0000","last_peered":"2023-06-09T04:41:01.423447+0000","last_clean":"2023-06-09T04:41:01.423447+0000","last_became_active":"2023-06-09T04:40:51.246657+0000","last_became_peered":"2023-06-09T04:40:51.246657+0000","last_unstale":"2023-06-09T04:41:01.423447+0000","last_undegraded":"2023-06-09T04:41:01.423447+0000","last_fullsized":"2023-06-09T04:41:01.423447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_clean_scrub_stamp":"2023-06-09T04:40:50.211713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:03:00.683016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.438678+0000","last_change":"2023-06-09T04:40:56.308909+0000","last_active":"2023-06-09T04:41:01.438678+0000","last_peered":"2023-06-09T04:41:01.438678+0000","last_clean":"2023-06-09T04:41:01.438678+0000","last_became_active":"2023-06-09T04:40:56.308599+0000","last_became_peered":"2023-06-09T04:40:56.308599+0000","last_unstale":"2023-06-09T04:41:01.438678+0000","last_undegraded":"2023-06-09T04:41:01.438678+0000","last_fullsized":"2023-06-09T04:41:01.438678+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:25:20.124448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.285749+0000","last_change":"2023-06-09T04:41:00.824541+0000","last_active":"2023-06-09T04:41:01.285749+0000","last_peered":"2023-06-09T04:41:01.285749+0000","last_clean":"2023-06-09T04:41:01.285749+0000","last_became_active":"2023-06-09T04:41:00.823837+0000","last_became_peered":"2023-06-09T04:41:00.823837+0000","last_unstale":"2023-06-09T04:41:01.285749+0000","last_undegraded":"2023-06-09T04:41:01.285749+0000","last_fullsized":"2023-06-09T04:41:01.285749+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:38:10.979218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.281976+0000","last_change":"2023-06-09T04:40:56.791325+0000","last_active":"2023-06-09T04:41:01.281976+0000","last_peered":"2023-06-09T04:41:01.281976+0000","last_clean":"2023-06-09T04:41:01.281976+0000","last_became_active":"2023-06-09T04:40:56.791079+0000","last_became_peered":"2023-06-09T04:40:56.791079+0000","last_unstale":"2023-06-09T04:41:01.281976+0000","last_undegraded":"2023-06-09T04:41:01.281976+0000","last_fullsized":"2023-06-09T04:41:01.281976+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:04:20.137918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.439866+0000","last_change":"2023-06-09T04:40:51.254461+0000","last_active":"2023-06-09T04:41:01.439866+0000","last_peered":"2023-06-09T04:41:01.439866+0000","last_clean":"2023-06-09T04:41:01.439866+0000","last_became_active":"2023-06-09T04:40:51.254070+0000","last_became_peered":"2023-06-09T04:40:51.254070+0000","last_unstale":"2023-06-09T04:41:01.439866+0000","last_undegraded":"2023-06-09T04:41:01.439866+0000","last_fullsized":"2023-06-09T04:41:01.439866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_clean_scrub_stamp":"2023-06-09T04:40:50.211713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:14:25.527350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.422675+0000","last_change":"2023-06-09T04:40:56.320311+0000","last_active":"2023-06-09T04:41:01.422675+0000","last_peered":"2023-06-09T04:41:01.422675+0000","last_clean":"2023-06-09T04:41:01.422675+0000","last_became_active":"2023-06-09T04:40:56.320015+0000","last_became_peered":"2023-06-09T04:40:56.320015+0000","last_unstale":"2023-06-09T04:41:01.422675+0000","last_undegraded":"2023-06-09T04:41:01.422675+0000","last_fullsized":"2023-06-09T04:41:01.422675+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:57:28.487285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.285949+0000","last_change":"2023-06-09T04:41:00.822120+0000","last_active":"2023-06-09T04:41:01.285949+0000","last_peered":"2023-06-09T04:41:01.285949+0000","last_clean":"2023-06-09T04:41:01.285949+0000","last_became_active":"2023-06-09T04:41:00.821726+0000","last_became_peered":"2023-06-09T04:41:00.821726+0000","last_unstale":"2023-06-09T04:41:01.285949+0000","last_undegraded":"2023-06-09T04:41:01.285949+0000","last_fullsized":"2023-06-09T04:41:01.285949+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:03:36.736093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.422235+0000","last_change":"2023-06-09T04:40:56.797145+0000","last_active":"2023-06-09T04:41:01.422235+0000","last_peered":"2023-06-09T04:41:01.422235+0000","last_clean":"2023-06-09T04:41:01.422235+0000","last_became_active":"2023-06-09T04:40:56.796400+0000","last_became_peered":"2023-06-09T04:40:56.796400+0000","last_unstale":"2023-06-09T04:41:01.422235+0000","last_undegraded":"2023-06-09T04:41:01.422235+0000","last_fullsized":"2023-06-09T04:41:01.422235+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:13:45.572440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.423177+0000","last_change":"2023-06-09T04:40:51.246536+0000","last_active":"2023-06-09T04:41:01.423177+0000","last_peered":"2023-06-09T04:41:01.423177+0000","last_clean":"2023-06-09T04:41:01.423177+0000","last_became_active":"2023-06-09T04:40:51.245999+0000","last_became_peered":"2023-06-09T04:40:51.245999+0000","last_unstale":"2023-06-09T04:41:01.423177+0000","last_undegraded":"2023-06-09T04:41:01.423177+0000","last_fullsized":"2023-06-09T04:41:01.423177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_clean_scrub_stamp":"2023-06-09T04:40:50.211713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:04:39.877355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.439639+0000","last_change":"2023-06-09T04:40:56.316395+0000","last_active":"2023-06-09T04:41:01.439639+0000","last_peered":"2023-06-09T04:41:01.439639+0000","last_clean":"2023-06-09T04:41:01.439639+0000","last_became_active":"2023-06-09T04:40:56.315695+0000","last_became_peered":"2023-06-09T04:40:56.315695+0000","last_unstale":"2023-06-09T04:41:01.439639+0000","last_undegraded":"2023-06-09T04:41:01.439639+0000","last_fullsized":"2023-06-09T04:41:01.439639+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:12:29.829823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.281994+0000","last_change":"2023-06-09T04:41:00.832153+0000","last_active":"2023-06-09T04:41:01.281994+0000","last_peered":"2023-06-09T04:41:01.281994+0000","last_clean":"2023-06-09T04:41:01.281994+0000","last_became_active":"2023-06-09T04:41:00.831571+0000","last_became_peered":"2023-06-09T04:41:00.831571+0000","last_unstale":"2023-06-09T04:41:01.281994+0000","last_undegraded":"2023-06-09T04:41:01.281994+0000","last_fullsized":"2023-06-09T04:41:01.281994+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:17:54.115862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.422827+0000","last_change":"2023-06-09T04:40:56.794902+0000","last_active":"2023-06-09T04:41:01.422827+0000","last_peered":"2023-06-09T04:41:01.422827+0000","last_clean":"2023-06-09T04:41:01.422827+0000","last_became_active":"2023-06-09T04:40:56.794542+0000","last_became_peered":"2023-06-09T04:40:56.794542+0000","last_unstale":"2023-06-09T04:41:01.422827+0000","last_undegraded":"2023-06-09T04:41:01.422827+0000","last_fullsized":"2023-06-09T04:41:01.422827+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:25:26.290677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.285785+0000","last_change":"2023-06-09T04:40:56.315468+0000","last_active":"2023-06-09T04:41:01.285785+0000","last_peered":"2023-06-09T04:41:01.285785+0000","last_clean":"2023-06-09T04:41:01.285785+0000","last_became_active":"2023-06-09T04:40:56.315183+0000","last_became_peered":"2023-06-09T04:40:56.315183+0000","last_unstale":"2023-06-09T04:41:01.285785+0000","last_undegraded":"2023-06-09T04:41:01.285785+0000","last_fullsized":"2023-06-09T04:41:01.285785+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:34:48.798835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.439610+0000","last_change":"2023-06-09T04:40:51.256393+0000","last_active":"2023-06-09T04:41:01.439610+0000","last_peered":"2023-06-09T04:41:01.439610+0000","last_clean":"2023-06-09T04:41:01.439610+0000","last_became_active":"2023-06-09T04:40:51.255964+0000","last_became_peered":"2023-06-09T04:40:51.255964+0000","last_unstale":"2023-06-09T04:41:01.439610+0000","last_undegraded":"2023-06-09T04:41:01.439610+0000","last_fullsized":"2023-06-09T04:41:01.439610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_clean_scrub_stamp":"2023-06-09T04:40:50.211713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:36:40.725711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.282494+0000","last_change":"2023-06-09T04:41:00.839261+0000","last_active":"2023-06-09T04:41:01.282494+0000","last_peered":"2023-06-09T04:41:01.282494+0000","last_clean":"2023-06-09T04:41:01.282494+0000","last_became_active":"2023-06-09T04:41:00.838867+0000","last_became_peered":"2023-06-09T04:41:00.838867+0000","last_unstale":"2023-06-09T04:41:01.282494+0000","last_undegraded":"2023-06-09T04:41:01.282494+0000","last_fullsized":"2023-06-09T04:41:01.282494+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:57:33.009170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.423610+0000","last_change":"2023-06-09T04:40:56.798090+0000","last_active":"2023-06-09T04:41:01.423610+0000","last_peered":"2023-06-09T04:41:01.423610+0000","last_clean":"2023-06-09T04:41:01.423610+0000","last_became_active":"2023-06-09T04:40:56.797767+0000","last_became_peered":"2023-06-09T04:40:56.797767+0000","last_unstale":"2023-06-09T04:41:01.423610+0000","last_undegraded":"2023-06-09T04:41:01.423610+0000","last_fullsized":"2023-06-09T04:41:01.423610+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:52:44.006009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.422159+0000","last_change":"2023-06-09T04:40:56.320626+0000","last_active":"2023-06-09T04:41:01.422159+0000","last_peered":"2023-06-09T04:41:01.422159+0000","last_clean":"2023-06-09T04:41:01.422159+0000","last_became_active":"2023-06-09T04:40:56.320232+0000","last_became_peered":"2023-06-09T04:40:56.320232+0000","last_unstale":"2023-06-09T04:41:01.422159+0000","last_undegraded":"2023-06-09T04:41:01.422159+0000","last_fullsized":"2023-06-09T04:41:01.422159+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:20:18.690413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.437109+0000","last_change":"2023-06-09T04:40:51.582053+0000","last_active":"2023-06-09T04:41:01.437109+0000","last_peered":"2023-06-09T04:41:01.437109+0000","last_clean":"2023-06-09T04:41:01.437109+0000","last_became_active":"2023-06-09T04:40:51.581476+0000","last_became_peered":"2023-06-09T04:40:51.581476+0000","last_unstale":"2023-06-09T04:41:01.437109+0000","last_undegraded":"2023-06-09T04:41:01.437109+0000","last_fullsized":"2023-06-09T04:41:01.437109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_clean_scrub_stamp":"2023-06-09T04:40:50.211713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:41:20.442998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.437773+0000","last_change":"2023-06-09T04:41:00.823337+0000","last_active":"2023-06-09T04:41:01.437773+0000","last_peered":"2023-06-09T04:41:01.437773+0000","last_clean":"2023-06-09T04:41:01.437773+0000","last_became_active":"2023-06-09T04:41:00.822873+0000","last_became_peered":"2023-06-09T04:41:00.822873+0000","last_unstale":"2023-06-09T04:41:01.437773+0000","last_undegraded":"2023-06-09T04:41:01.437773+0000","last_fullsized":"2023-06-09T04:41:01.437773+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:44:04.904534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.282652+0000","last_change":"2023-06-09T04:40:56.796601+0000","last_active":"2023-06-09T04:41:01.282652+0000","last_peered":"2023-06-09T04:41:01.282652+0000","last_clean":"2023-06-09T04:41:01.282652+0000","last_became_active":"2023-06-09T04:40:56.796341+0000","last_became_peered":"2023-06-09T04:40:56.796341+0000","last_unstale":"2023-06-09T04:41:01.282652+0000","last_undegraded":"2023-06-09T04:41:01.282652+0000","last_fullsized":"2023-06-09T04:41:01.282652+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:06:43.179689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.281540+0000","last_change":"2023-06-09T04:40:56.317205+0000","last_active":"2023-06-09T04:41:01.281540+0000","last_peered":"2023-06-09T04:41:01.281540+0000","last_clean":"2023-06-09T04:41:01.281540+0000","last_became_active":"2023-06-09T04:40:56.316821+0000","last_became_peered":"2023-06-09T04:40:56.316821+0000","last_unstale":"2023-06-09T04:41:01.281540+0000","last_undegraded":"2023-06-09T04:41:01.281540+0000","last_fullsized":"2023-06-09T04:41:01.281540+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:36:45.774188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.438350+0000","last_change":"2023-06-09T04:40:51.256342+0000","last_active":"2023-06-09T04:41:01.438350+0000","last_peered":"2023-06-09T04:41:01.438350+0000","last_clean":"2023-06-09T04:41:01.438350+0000","last_became_active":"2023-06-09T04:40:51.256010+0000","last_became_peered":"2023-06-09T04:40:51.256010+0000","last_unstale":"2023-06-09T04:41:01.438350+0000","last_undegraded":"2023-06-09T04:41:01.438350+0000","last_fullsized":"2023-06-09T04:41:01.438350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_clean_scrub_stamp":"2023-06-09T04:40:50.211713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:13:39.511250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.440147+0000","last_change":"2023-06-09T04:41:00.839270+0000","last_active":"2023-06-09T04:41:01.440147+0000","last_peered":"2023-06-09T04:41:01.440147+0000","last_clean":"2023-06-09T04:41:01.440147+0000","last_became_active":"2023-06-09T04:41:00.838641+0000","last_became_peered":"2023-06-09T04:41:00.838641+0000","last_unstale":"2023-06-09T04:41:01.440147+0000","last_undegraded":"2023-06-09T04:41:01.440147+0000","last_fullsized":"2023-06-09T04:41:01.440147+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:20:23.212298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.286778+0000","last_change":"2023-06-09T04:40:56.806412+0000","last_active":"2023-06-09T04:41:01.286778+0000","last_peered":"2023-06-09T04:41:01.286778+0000","last_clean":"2023-06-09T04:41:01.286778+0000","last_became_active":"2023-06-09T04:40:56.806046+0000","last_became_peered":"2023-06-09T04:40:56.806046+0000","last_unstale":"2023-06-09T04:41:01.286778+0000","last_undegraded":"2023-06-09T04:41:01.286778+0000","last_fullsized":"2023-06-09T04:41:01.286778+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:13:32.401045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.437153+0000","last_change":"2023-06-09T04:40:56.316110+0000","last_active":"2023-06-09T04:41:01.437153+0000","last_peered":"2023-06-09T04:41:01.437153+0000","last_clean":"2023-06-09T04:41:01.437153+0000","last_became_active":"2023-06-09T04:40:56.315754+0000","last_became_peered":"2023-06-09T04:40:56.315754+0000","last_unstale":"2023-06-09T04:41:01.437153+0000","last_undegraded":"2023-06-09T04:41:01.437153+0000","last_fullsized":"2023-06-09T04:41:01.437153+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:59:56.484281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.439096+0000","last_change":"2023-06-09T04:40:51.253269+0000","last_active":"2023-06-09T04:41:01.439096+0000","last_peered":"2023-06-09T04:41:01.439096+0000","last_clean":"2023-06-09T04:41:01.439096+0000","last_became_active":"2023-06-09T04:40:51.252908+0000","last_became_peered":"2023-06-09T04:40:51.252908+0000","last_unstale":"2023-06-09T04:41:01.439096+0000","last_undegraded":"2023-06-09T04:41:01.439096+0000","last_fullsized":"2023-06-09T04:41:01.439096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_clean_scrub_stamp":"2023-06-09T04:40:50.211713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:55:48.768194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":183,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.438683+0000","last_change":"2023-06-09T04:40:46.286764+0000","last_active":"2023-06-09T04:41:01.438683+0000","last_peered":"2023-06-09T04:41:01.438683+0000","last_clean":"2023-06-09T04:41:01.438683+0000","last_became_active":"2023-06-09T04:40:46.285285+0000","last_became_peered":"2023-06-09T04:40:46.285285+0000","last_unstale":"2023-06-09T04:41:01.438683+0000","last_undegraded":"2023-06-09T04:41:01.438683+0000","last_fullsized":"2023-06-09T04:41:01.438683+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:45.151406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:45.151406+0000","last_clean_scrub_stamp":"2023-06-09T04:40:45.151406+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:43:20.379013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.438943+0000","last_change":"2023-06-09T04:41:00.830910+0000","last_active":"2023-06-09T04:41:01.438943+0000","last_peered":"2023-06-09T04:41:01.438943+0000","last_clean":"2023-06-09T04:41:01.438943+0000","last_became_active":"2023-06-09T04:41:00.830476+0000","last_became_peered":"2023-06-09T04:41:00.830476+0000","last_unstale":"2023-06-09T04:41:01.438943+0000","last_undegraded":"2023-06-09T04:41:01.438943+0000","last_fullsized":"2023-06-09T04:41:01.438943+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:04:49.447717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.423561+0000","last_change":"2023-06-09T04:40:56.790616+0000","last_active":"2023-06-09T04:41:01.423561+0000","last_peered":"2023-06-09T04:41:01.423561+0000","last_clean":"2023-06-09T04:41:01.423561+0000","last_became_active":"2023-06-09T04:40:56.790340+0000","last_became_peered":"2023-06-09T04:40:56.790340+0000","last_unstale":"2023-06-09T04:41:01.423561+0000","last_undegraded":"2023-06-09T04:41:01.423561+0000","last_fullsized":"2023-06-09T04:41:01.423561+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:08:06.202323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.436613+0000","last_change":"2023-06-09T04:40:56.319906+0000","last_active":"2023-06-09T04:41:01.436613+0000","last_peered":"2023-06-09T04:41:01.436613+0000","last_clean":"2023-06-09T04:41:01.436613+0000","last_became_active":"2023-06-09T04:40:56.319496+0000","last_became_peered":"2023-06-09T04:40:56.319496+0000","last_unstale":"2023-06-09T04:41:01.436613+0000","last_undegraded":"2023-06-09T04:41:01.436613+0000","last_fullsized":"2023-06-09T04:41:01.436613+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:08:05.189610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.288028+0000","last_change":"2023-06-09T04:41:00.825198+0000","last_active":"2023-06-09T04:41:01.288028+0000","last_peered":"2023-06-09T04:41:01.288028+0000","last_clean":"2023-06-09T04:41:01.288028+0000","last_became_active":"2023-06-09T04:41:00.824804+0000","last_became_peered":"2023-06-09T04:41:00.824804+0000","last_unstale":"2023-06-09T04:41:01.288028+0000","last_undegraded":"2023-06-09T04:41:01.288028+0000","last_fullsized":"2023-06-09T04:41:01.288028+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:52:16.020173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.287921+0000","last_change":"2023-06-09T04:40:56.801931+0000","last_active":"2023-06-09T04:41:01.287921+0000","last_peered":"2023-06-09T04:41:01.287921+0000","last_clean":"2023-06-09T04:41:01.287921+0000","last_became_active":"2023-06-09T04:40:56.801667+0000","last_became_peered":"2023-06-09T04:40:56.801667+0000","last_unstale":"2023-06-09T04:41:01.287921+0000","last_undegraded":"2023-06-09T04:41:01.287921+0000","last_fullsized":"2023-06-09T04:41:01.287921+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:52:18.948571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.285847+0000","last_change":"2023-06-09T04:40:56.322597+0000","last_active":"2023-06-09T04:41:01.285847+0000","last_peered":"2023-06-09T04:41:01.285847+0000","last_clean":"2023-06-09T04:41:01.285847+0000","last_became_active":"2023-06-09T04:40:56.322300+0000","last_became_peered":"2023-06-09T04:40:56.322300+0000","last_unstale":"2023-06-09T04:41:01.285847+0000","last_undegraded":"2023-06-09T04:41:01.285847+0000","last_fullsized":"2023-06-09T04:41:01.285847+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:27:36.587609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.439849+0000","last_change":"2023-06-09T04:41:00.832222+0000","last_active":"2023-06-09T04:41:01.439849+0000","last_peered":"2023-06-09T04:41:01.439849+0000","last_clean":"2023-06-09T04:41:01.439849+0000","last_became_active":"2023-06-09T04:41:00.831821+0000","last_became_peered":"2023-06-09T04:41:00.831821+0000","last_unstale":"2023-06-09T04:41:01.439849+0000","last_undegraded":"2023-06-09T04:41:01.439849+0000","last_fullsized":"2023-06-09T04:41:01.439849+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:47:47.084156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.286843+0000","last_change":"2023-06-09T04:40:56.803238+0000","last_active":"2023-06-09T04:41:01.286843+0000","last_peered":"2023-06-09T04:41:01.286843+0000","last_clean":"2023-06-09T04:41:01.286843+0000","last_became_active":"2023-06-09T04:40:56.802659+0000","last_became_peered":"2023-06-09T04:40:56.802659+0000","last_unstale":"2023-06-09T04:41:01.286843+0000","last_undegraded":"2023-06-09T04:41:01.286843+0000","last_fullsized":"2023-06-09T04:41:01.286843+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:18:37.195363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.286230+0000","last_change":"2023-06-09T04:40:56.310427+0000","last_active":"2023-06-09T04:41:01.286230+0000","last_peered":"2023-06-09T04:41:01.286230+0000","last_clean":"2023-06-09T04:41:01.286230+0000","last_became_active":"2023-06-09T04:40:56.309681+0000","last_became_peered":"2023-06-09T04:40:56.309681+0000","last_unstale":"2023-06-09T04:41:01.286230+0000","last_undegraded":"2023-06-09T04:41:01.286230+0000","last_fullsized":"2023-06-09T04:41:01.286230+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:32:44.555572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.422209+0000","last_change":"2023-06-09T04:41:00.833572+0000","last_active":"2023-06-09T04:41:01.422209+0000","last_peered":"2023-06-09T04:41:01.422209+0000","last_clean":"2023-06-09T04:41:01.422209+0000","last_became_active":"2023-06-09T04:41:00.833182+0000","last_became_peered":"2023-06-09T04:41:00.833182+0000","last_unstale":"2023-06-09T04:41:01.422209+0000","last_undegraded":"2023-06-09T04:41:01.422209+0000","last_fullsized":"2023-06-09T04:41:01.422209+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:04:23.647090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.285461+0000","last_change":"2023-06-09T04:40:56.805747+0000","last_active":"2023-06-09T04:41:01.285461+0000","last_peered":"2023-06-09T04:41:01.285461+0000","last_clean":"2023-06-09T04:41:01.285461+0000","last_became_active":"2023-06-09T04:40:56.797532+0000","last_became_peered":"2023-06-09T04:40:56.797532+0000","last_unstale":"2023-06-09T04:41:01.285461+0000","last_undegraded":"2023-06-09T04:41:01.285461+0000","last_fullsized":"2023-06-09T04:41:01.285461+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:45:17.466440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.438024+0000","last_change":"2023-06-09T04:40:56.314468+0000","last_active":"2023-06-09T04:41:01.438024+0000","last_peered":"2023-06-09T04:41:01.438024+0000","last_clean":"2023-06-09T04:41:01.438024+0000","last_became_active":"2023-06-09T04:40:56.314110+0000","last_became_peered":"2023-06-09T04:40:56.314110+0000","last_unstale":"2023-06-09T04:41:01.438024+0000","last_undegraded":"2023-06-09T04:41:01.438024+0000","last_fullsized":"2023-06-09T04:41:01.438024+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:39:14.790353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.437486+0000","last_change":"2023-06-09T04:41:00.823352+0000","last_active":"2023-06-09T04:41:01.437486+0000","last_peered":"2023-06-09T04:41:01.437486+0000","last_clean":"2023-06-09T04:41:01.437486+0000","last_became_active":"2023-06-09T04:41:00.822869+0000","last_became_peered":"2023-06-09T04:41:00.822869+0000","last_unstale":"2023-06-09T04:41:01.437486+0000","last_undegraded":"2023-06-09T04:41:01.437486+0000","last_fullsized":"2023-06-09T04:41:01.437486+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:46:17.286998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.281876+0000","last_change":"2023-06-09T04:40:56.790996+0000","last_active":"2023-06-09T04:41:01.281876+0000","last_peered":"2023-06-09T04:41:01.281876+0000","last_clean":"2023-06-09T04:41:01.281876+0000","last_became_active":"2023-06-09T04:40:56.790630+0000","last_became_peered":"2023-06-09T04:40:56.790630+0000","last_unstale":"2023-06-09T04:41:01.281876+0000","last_undegraded":"2023-06-09T04:41:01.281876+0000","last_fullsized":"2023-06-09T04:41:01.281876+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:47:43.574984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.440099+0000","last_change":"2023-06-09T04:40:56.316852+0000","last_active":"2023-06-09T04:41:01.440099+0000","last_peered":"2023-06-09T04:41:01.440099+0000","last_clean":"2023-06-09T04:41:01.440099+0000","last_became_active":"2023-06-09T04:40:56.315795+0000","last_became_peered":"2023-06-09T04:40:56.315795+0000","last_unstale":"2023-06-09T04:41:01.440099+0000","last_undegraded":"2023-06-09T04:41:01.440099+0000","last_fullsized":"2023-06-09T04:41:01.440099+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:04:19.125206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.436964+0000","last_change":"2023-06-09T04:41:00.815347+0000","last_active":"2023-06-09T04:41:01.436964+0000","last_peered":"2023-06-09T04:41:01.436964+0000","last_clean":"2023-06-09T04:41:01.436964+0000","last_became_active":"2023-06-09T04:41:00.814876+0000","last_became_peered":"2023-06-09T04:41:00.814876+0000","last_unstale":"2023-06-09T04:41:01.436964+0000","last_undegraded":"2023-06-09T04:41:01.436964+0000","last_fullsized":"2023-06-09T04:41:01.436964+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:29:48.861218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.286021+0000","last_change":"2023-06-09T04:40:56.797164+0000","last_active":"2023-06-09T04:41:01.286021+0000","last_peered":"2023-06-09T04:41:01.286021+0000","last_clean":"2023-06-09T04:41:01.286021+0000","last_became_active":"2023-06-09T04:40:56.796793+0000","last_became_peered":"2023-06-09T04:40:56.796793+0000","last_unstale":"2023-06-09T04:41:01.286021+0000","last_undegraded":"2023-06-09T04:41:01.286021+0000","last_fullsized":"2023-06-09T04:41:01.286021+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:22:00.092692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.439725+0000","last_change":"2023-06-09T04:40:56.319708+0000","last_active":"2023-06-09T04:41:01.439725+0000","last_peered":"2023-06-09T04:41:01.439725+0000","last_clean":"2023-06-09T04:41:01.439725+0000","last_became_active":"2023-06-09T04:40:56.319239+0000","last_became_peered":"2023-06-09T04:40:56.319239+0000","last_unstale":"2023-06-09T04:41:01.439725+0000","last_undegraded":"2023-06-09T04:41:01.439725+0000","last_fullsized":"2023-06-09T04:41:01.439725+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:59:56.484281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.437517+0000","last_change":"2023-06-09T04:41:00.830023+0000","last_active":"2023-06-09T04:41:01.437517+0000","last_peered":"2023-06-09T04:41:01.437517+0000","last_clean":"2023-06-09T04:41:01.437517+0000","last_became_active":"2023-06-09T04:41:00.829628+0000","last_became_peered":"2023-06-09T04:41:00.829628+0000","last_unstale":"2023-06-09T04:41:01.437517+0000","last_undegraded":"2023-06-09T04:41:01.437517+0000","last_fullsized":"2023-06-09T04:41:01.437517+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:11:01.800202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.285365+0000","last_change":"2023-06-09T04:40:56.802232+0000","last_active":"2023-06-09T04:41:01.285365+0000","last_peered":"2023-06-09T04:41:01.285365+0000","last_clean":"2023-06-09T04:41:01.285365+0000","last_became_active":"2023-06-09T04:40:56.798647+0000","last_became_peered":"2023-06-09T04:40:56.798647+0000","last_unstale":"2023-06-09T04:41:01.285365+0000","last_undegraded":"2023-06-09T04:41:01.285365+0000","last_fullsized":"2023-06-09T04:41:01.285365+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:15:13.824668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.439375+0000","last_change":"2023-06-09T04:40:56.312886+0000","last_active":"2023-06-09T04:41:01.439375+0000","last_peered":"2023-06-09T04:41:01.439375+0000","last_clean":"2023-06-09T04:41:01.439375+0000","last_became_active":"2023-06-09T04:40:56.312638+0000","last_became_peered":"2023-06-09T04:40:56.312638+0000","last_unstale":"2023-06-09T04:41:01.439375+0000","last_undegraded":"2023-06-09T04:41:01.439375+0000","last_fullsized":"2023-06-09T04:41:01.439375+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:05:48.145750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.436906+0000","last_change":"2023-06-09T04:41:00.837079+0000","last_active":"2023-06-09T04:41:01.436906+0000","last_peered":"2023-06-09T04:41:01.436906+0000","last_clean":"2023-06-09T04:41:01.436906+0000","last_became_active":"2023-06-09T04:41:00.836636+0000","last_became_peered":"2023-06-09T04:41:00.836636+0000","last_unstale":"2023-06-09T04:41:01.436906+0000","last_undegraded":"2023-06-09T04:41:01.436906+0000","last_fullsized":"2023-06-09T04:41:01.436906+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:18:24.073415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.438685+0000","last_change":"2023-06-09T04:40:56.802193+0000","last_active":"2023-06-09T04:41:01.438685+0000","last_peered":"2023-06-09T04:41:01.438685+0000","last_clean":"2023-06-09T04:41:01.438685+0000","last_became_active":"2023-06-09T04:40:56.801743+0000","last_became_peered":"2023-06-09T04:40:56.801743+0000","last_unstale":"2023-06-09T04:41:01.438685+0000","last_undegraded":"2023-06-09T04:41:01.438685+0000","last_fullsized":"2023-06-09T04:41:01.438685+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:26:52.030740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.440193+0000","last_change":"2023-06-09T04:40:56.310010+0000","last_active":"2023-06-09T04:41:01.440193+0000","last_peered":"2023-06-09T04:41:01.440193+0000","last_clean":"2023-06-09T04:41:01.440193+0000","last_became_active":"2023-06-09T04:40:56.309735+0000","last_became_peered":"2023-06-09T04:40:56.309735+0000","last_unstale":"2023-06-09T04:41:01.440193+0000","last_undegraded":"2023-06-09T04:41:01.440193+0000","last_fullsized":"2023-06-09T04:41:01.440193+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:39:14.790353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.439938+0000","last_change":"2023-06-09T04:41:00.831076+0000","last_active":"2023-06-09T04:41:01.439938+0000","last_peered":"2023-06-09T04:41:01.439938+0000","last_clean":"2023-06-09T04:41:01.439938+0000","last_became_active":"2023-06-09T04:41:00.828763+0000","last_became_peered":"2023-06-09T04:41:00.828763+0000","last_unstale":"2023-06-09T04:41:01.439938+0000","last_undegraded":"2023-06-09T04:41:01.439938+0000","last_fullsized":"2023-06-09T04:41:01.439938+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:24:30.332035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.440504+0000","last_change":"2023-06-09T04:41:00.839198+0000","last_active":"2023-06-09T04:41:01.440504+0000","last_peered":"2023-06-09T04:41:01.440504+0000","last_clean":"2023-06-09T04:41:01.440504+0000","last_became_active":"2023-06-09T04:41:00.838883+0000","last_became_peered":"2023-06-09T04:41:00.838883+0000","last_unstale":"2023-06-09T04:41:01.440504+0000","last_undegraded":"2023-06-09T04:41:01.440504+0000","last_fullsized":"2023-06-09T04:41:01.440504+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:25:29.799849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":29,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.285514+0000","last_change":"2023-06-09T04:40:56.314061+0000","last_active":"2023-06-09T04:41:01.285514+0000","last_peered":"2023-06-09T04:41:01.285514+0000","last_clean":"2023-06-09T04:41:01.285514+0000","last_became_active":"2023-06-09T04:40:56.313675+0000","last_became_peered":"2023-06-09T04:40:56.313675+0000","last_unstale":"2023-06-09T04:41:01.285514+0000","last_undegraded":"2023-06-09T04:41:01.285514+0000","last_fullsized":"2023-06-09T04:41:01.285514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:05:35.369565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.438564+0000","last_change":"2023-06-09T04:40:56.803235+0000","last_active":"2023-06-09T04:41:01.438564+0000","last_peered":"2023-06-09T04:41:01.438564+0000","last_clean":"2023-06-09T04:41:01.438564+0000","last_became_active":"2023-06-09T04:40:56.802719+0000","last_became_peered":"2023-06-09T04:40:56.802719+0000","last_unstale":"2023-06-09T04:41:01.438564+0000","last_undegraded":"2023-06-09T04:41:01.438564+0000","last_fullsized":"2023-06-09T04:41:01.438564+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:13:35.241848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.438353+0000","last_change":"2023-06-09T04:41:00.824712+0000","last_active":"2023-06-09T04:41:01.438353+0000","last_peered":"2023-06-09T04:41:01.438353+0000","last_clean":"2023-06-09T04:41:01.438353+0000","last_became_active":"2023-06-09T04:41:00.824247+0000","last_became_peered":"2023-06-09T04:41:00.824247+0000","last_unstale":"2023-06-09T04:41:01.438353+0000","last_undegraded":"2023-06-09T04:41:01.438353+0000","last_fullsized":"2023-06-09T04:41:01.438353+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:10:26.089852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.438867+0000","last_change":"2023-06-09T04:40:56.318818+0000","last_active":"2023-06-09T04:41:01.438867+0000","last_peered":"2023-06-09T04:41:01.438867+0000","last_clean":"2023-06-09T04:41:01.438867+0000","last_became_active":"2023-06-09T04:40:56.318430+0000","last_became_peered":"2023-06-09T04:40:56.318430+0000","last_unstale":"2023-06-09T04:41:01.438867+0000","last_undegraded":"2023-06-09T04:41:01.438867+0000","last_fullsized":"2023-06-09T04:41:01.438867+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:14:30.287562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.282910+0000","last_change":"2023-06-09T04:40:56.804430+0000","last_active":"2023-06-09T04:41:01.282910+0000","last_peered":"2023-06-09T04:41:01.282910+0000","last_clean":"2023-06-09T04:41:01.282910+0000","last_became_active":"2023-06-09T04:40:56.804135+0000","last_became_peered":"2023-06-09T04:40:56.804135+0000","last_unstale":"2023-06-09T04:41:01.282910+0000","last_undegraded":"2023-06-09T04:41:01.282910+0000","last_fullsized":"2023-06-09T04:41:01.282910+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:04:45.938545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.281917+0000","last_change":"2023-06-09T04:40:56.311175+0000","last_active":"2023-06-09T04:41:01.281917+0000","last_peered":"2023-06-09T04:41:01.281917+0000","last_clean":"2023-06-09T04:41:01.281917+0000","last_became_active":"2023-06-09T04:40:56.310829+0000","last_became_peered":"2023-06-09T04:40:56.310829+0000","last_unstale":"2023-06-09T04:41:01.281917+0000","last_undegraded":"2023-06-09T04:41:01.281917+0000","last_fullsized":"2023-06-09T04:41:01.281917+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:20:18.690413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.439450+0000","last_change":"2023-06-09T04:40:56.809473+0000","last_active":"2023-06-09T04:41:01.439450+0000","last_peered":"2023-06-09T04:41:01.439450+0000","last_clean":"2023-06-09T04:41:01.439450+0000","last_became_active":"2023-06-09T04:40:56.809181+0000","last_became_peered":"2023-06-09T04:40:56.809181+0000","last_unstale":"2023-06-09T04:41:01.439450+0000","last_undegraded":"2023-06-09T04:41:01.439450+0000","last_fullsized":"2023-06-09T04:41:01.439450+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:05:54.167533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.437947+0000","last_change":"2023-06-09T04:41:00.827111+0000","last_active":"2023-06-09T04:41:01.437947+0000","last_peered":"2023-06-09T04:41:01.437947+0000","last_clean":"2023-06-09T04:41:01.437947+0000","last_became_active":"2023-06-09T04:41:00.826707+0000","last_became_peered":"2023-06-09T04:41:00.826707+0000","last_unstale":"2023-06-09T04:41:01.437947+0000","last_undegraded":"2023-06-09T04:41:01.437947+0000","last_fullsized":"2023-06-09T04:41:01.437947+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:24:30.332035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.438574+0000","last_change":"2023-06-09T04:40:56.318716+0000","last_active":"2023-06-09T04:41:01.438574+0000","last_peered":"2023-06-09T04:41:01.438574+0000","last_clean":"2023-06-09T04:41:01.438574+0000","last_became_active":"2023-06-09T04:40:56.318415+0000","last_became_peered":"2023-06-09T04:40:56.318415+0000","last_unstale":"2023-06-09T04:41:01.438574+0000","last_undegraded":"2023-06-09T04:41:01.438574+0000","last_fullsized":"2023-06-09T04:41:01.438574+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:55.260190+0000","last_clean_scrub_stamp":"2023-06-09T04:40:55.260190+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:25:25.277964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.438243+0000","last_change":"2023-06-09T04:40:56.795369+0000","last_active":"2023-06-09T04:41:01.438243+0000","last_peered":"2023-06-09T04:41:01.438243+0000","last_clean":"2023-06-09T04:41:01.438243+0000","last_became_active":"2023-06-09T04:40:56.794885+0000","last_became_peered":"2023-06-09T04:40:56.794885+0000","last_unstale":"2023-06-09T04:41:01.438243+0000","last_undegraded":"2023-06-09T04:41:01.438243+0000","last_fullsized":"2023-06-09T04:41:01.438243+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:58:56.783205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.439095+0000","last_change":"2023-06-09T04:41:00.839070+0000","last_active":"2023-06-09T04:41:01.439095+0000","last_peered":"2023-06-09T04:41:01.439095+0000","last_clean":"2023-06-09T04:41:01.439095+0000","last_became_active":"2023-06-09T04:41:00.838603+0000","last_became_peered":"2023-06-09T04:41:00.838603+0000","last_unstale":"2023-06-09T04:41:01.439095+0000","last_undegraded":"2023-06-09T04:41:01.439095+0000","last_fullsized":"2023-06-09T04:41:01.439095+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:59.782075+0000","last_clean_scrub_stamp":"2023-06-09T04:40:59.782075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T04:55:38.240718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.285287+0000","last_change":"2023-06-09T04:40:56.797265+0000","last_active":"2023-06-09T04:41:01.285287+0000","last_peered":"2023-06-09T04:41:01.285287+0000","last_clean":"2023-06-09T04:41:01.285287+0000","last_became_active":"2023-06-09T04:40:56.796952+0000","last_became_peered":"2023-06-09T04:40:56.796952+0000","last_unstale":"2023-06-09T04:41:01.285287+0000","last_undegraded":"2023-06-09T04:41:01.285287+0000","last_fullsized":"2023-06-09T04:41:01.285287+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:48:55.767412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.436310+0000","last_change":"2023-06-09T04:40:56.797095+0000","last_active":"2023-06-09T04:41:01.436310+0000","last_peered":"2023-06-09T04:41:01.436310+0000","last_clean":"2023-06-09T04:41:01.436310+0000","last_became_active":"2023-06-09T04:40:56.796589+0000","last_became_peered":"2023-06-09T04:40:56.796589+0000","last_unstale":"2023-06-09T04:41:01.436310+0000","last_undegraded":"2023-06-09T04:41:01.436310+0000","last_fullsized":"2023-06-09T04:41:01.436310+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:14:31.300275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.285463+0000","last_change":"2023-06-09T04:40:56.798590+0000","last_active":"2023-06-09T04:41:01.285463+0000","last_peered":"2023-06-09T04:41:01.285463+0000","last_clean":"2023-06-09T04:41:01.285463+0000","last_became_active":"2023-06-09T04:40:56.798170+0000","last_became_peered":"2023-06-09T04:40:56.798170+0000","last_unstale":"2023-06-09T04:41:01.285463+0000","last_undegraded":"2023-06-09T04:41:01.285463+0000","last_fullsized":"2023-06-09T04:41:01.285463+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:17:30.494237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.437846+0000","last_change":"2023-06-09T04:40:56.801414+0000","last_active":"2023-06-09T04:41:01.437846+0000","last_peered":"2023-06-09T04:41:01.437846+0000","last_clean":"2023-06-09T04:41:01.437846+0000","last_became_active":"2023-06-09T04:40:56.801141+0000","last_became_peered":"2023-06-09T04:40:56.801141+0000","last_unstale":"2023-06-09T04:41:01.437846+0000","last_undegraded":"2023-06-09T04:41:01.437846+0000","last_fullsized":"2023-06-09T04:41:01.437846+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:14:31.588540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.423026+0000","last_change":"2023-06-09T04:40:56.800046+0000","last_active":"2023-06-09T04:41:01.423026+0000","last_peered":"2023-06-09T04:41:01.423026+0000","last_clean":"2023-06-09T04:41:01.423026+0000","last_became_active":"2023-06-09T04:40:56.798966+0000","last_became_peered":"2023-06-09T04:40:56.798966+0000","last_unstale":"2023-06-09T04:41:01.423026+0000","last_undegraded":"2023-06-09T04:41:01.423026+0000","last_fullsized":"2023-06-09T04:41:01.423026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:06:43.179689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.439250+0000","last_change":"2023-06-09T04:40:56.809685+0000","last_active":"2023-06-09T04:41:01.439250+0000","last_peered":"2023-06-09T04:41:01.439250+0000","last_clean":"2023-06-09T04:41:01.439250+0000","last_became_active":"2023-06-09T04:40:56.809312+0000","last_became_peered":"2023-06-09T04:40:56.809312+0000","last_unstale":"2023-06-09T04:41:01.439250+0000","last_undegraded":"2023-06-09T04:41:01.439250+0000","last_fullsized":"2023-06-09T04:41:01.439250+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:17:07.126456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.423063+0000","last_change":"2023-06-09T04:40:56.795763+0000","last_active":"2023-06-09T04:41:01.423063+0000","last_peered":"2023-06-09T04:41:01.423063+0000","last_clean":"2023-06-09T04:41:01.423063+0000","last_became_active":"2023-06-09T04:40:56.795456+0000","last_became_peered":"2023-06-09T04:40:56.795456+0000","last_unstale":"2023-06-09T04:41:01.423063+0000","last_undegraded":"2023-06-09T04:41:01.423063+0000","last_fullsized":"2023-06-09T04:41:01.423063+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:14:31.300275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.423520+0000","last_change":"2023-06-09T04:40:56.801907+0000","last_active":"2023-06-09T04:41:01.423520+0000","last_peered":"2023-06-09T04:41:01.423520+0000","last_clean":"2023-06-09T04:41:01.423520+0000","last_became_active":"2023-06-09T04:40:56.801549+0000","last_became_peered":"2023-06-09T04:40:56.801549+0000","last_unstale":"2023-06-09T04:41:01.423520+0000","last_undegraded":"2023-06-09T04:41:01.423520+0000","last_fullsized":"2023-06-09T04:41:01.423520+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:05:49.158462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.439471+0000","last_change":"2023-06-09T04:40:56.807671+0000","last_active":"2023-06-09T04:41:01.439471+0000","last_peered":"2023-06-09T04:41:01.439471+0000","last_clean":"2023-06-09T04:41:01.439471+0000","last_became_active":"2023-06-09T04:40:56.807340+0000","last_became_peered":"2023-06-09T04:40:56.807340+0000","last_unstale":"2023-06-09T04:41:01.439471+0000","last_undegraded":"2023-06-09T04:41:01.439471+0000","last_fullsized":"2023-06-09T04:41:01.439471+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:08:06.202323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.436226+0000","last_change":"2023-06-09T04:40:56.788625+0000","last_active":"2023-06-09T04:41:01.436226+0000","last_peered":"2023-06-09T04:41:01.436226+0000","last_clean":"2023-06-09T04:41:01.436226+0000","last_became_active":"2023-06-09T04:40:56.787863+0000","last_became_peered":"2023-06-09T04:40:56.787863+0000","last_unstale":"2023-06-09T04:41:01.436226+0000","last_undegraded":"2023-06-09T04:41:01.436226+0000","last_fullsized":"2023-06-09T04:41:01.436226+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:25:26.290677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.281831+0000","last_change":"2023-06-09T04:40:56.790021+0000","last_active":"2023-06-09T04:41:01.281831+0000","last_peered":"2023-06-09T04:41:01.281831+0000","last_clean":"2023-06-09T04:41:01.281831+0000","last_became_active":"2023-06-09T04:40:56.789701+0000","last_became_peered":"2023-06-09T04:40:56.789701+0000","last_unstale":"2023-06-09T04:41:01.281831+0000","last_undegraded":"2023-06-09T04:41:01.281831+0000","last_fullsized":"2023-06-09T04:41:01.281831+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:12:30.842536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.438484+0000","last_change":"2023-06-09T04:40:56.808367+0000","last_active":"2023-06-09T04:41:01.438484+0000","last_peered":"2023-06-09T04:41:01.438484+0000","last_clean":"2023-06-09T04:41:01.438484+0000","last_became_active":"2023-06-09T04:40:56.807817+0000","last_became_peered":"2023-06-09T04:40:56.807817+0000","last_unstale":"2023-06-09T04:41:01.438484+0000","last_undegraded":"2023-06-09T04:41:01.438484+0000","last_fullsized":"2023-06-09T04:41:01.438484+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:24:26.488078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.285269+0000","last_change":"2023-06-09T04:40:56.790891+0000","last_active":"2023-06-09T04:41:01.285269+0000","last_peered":"2023-06-09T04:41:01.285269+0000","last_clean":"2023-06-09T04:41:01.285269+0000","last_became_active":"2023-06-09T04:40:56.790633+0000","last_became_peered":"2023-06-09T04:40:56.790633+0000","last_unstale":"2023-06-09T04:41:01.285269+0000","last_undegraded":"2023-06-09T04:41:01.285269+0000","last_fullsized":"2023-06-09T04:41:01.285269+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:40:36.160469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.437785+0000","last_change":"2023-06-09T04:40:56.806490+0000","last_active":"2023-06-09T04:41:01.437785+0000","last_peered":"2023-06-09T04:41:01.437785+0000","last_clean":"2023-06-09T04:41:01.437785+0000","last_became_active":"2023-06-09T04:40:56.806147+0000","last_became_peered":"2023-06-09T04:40:56.806147+0000","last_unstale":"2023-06-09T04:41:01.437785+0000","last_undegraded":"2023-06-09T04:41:01.437785+0000","last_fullsized":"2023-06-09T04:41:01.437785+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:26:06.240424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.287737+0000","last_change":"2023-06-09T04:40:56.797924+0000","last_active":"2023-06-09T04:41:01.287737+0000","last_peered":"2023-06-09T04:41:01.287737+0000","last_clean":"2023-06-09T04:41:01.287737+0000","last_became_active":"2023-06-09T04:40:56.794834+0000","last_became_peered":"2023-06-09T04:40:56.794834+0000","last_unstale":"2023-06-09T04:41:01.287737+0000","last_undegraded":"2023-06-09T04:41:01.287737+0000","last_fullsized":"2023-06-09T04:41:01.287737+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:14:40.902021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.283050+0000","last_change":"2023-06-09T04:40:56.792333+0000","last_active":"2023-06-09T04:41:01.283050+0000","last_peered":"2023-06-09T04:41:01.283050+0000","last_clean":"2023-06-09T04:41:01.283050+0000","last_became_active":"2023-06-09T04:40:56.791978+0000","last_became_peered":"2023-06-09T04:40:56.791978+0000","last_unstale":"2023-06-09T04:41:01.283050+0000","last_undegraded":"2023-06-09T04:41:01.283050+0000","last_fullsized":"2023-06-09T04:41:01.283050+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:05:49.158462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.284964+0000","last_change":"2023-06-09T04:40:56.803527+0000","last_active":"2023-06-09T04:41:01.284964+0000","last_peered":"2023-06-09T04:41:01.284964+0000","last_clean":"2023-06-09T04:41:01.284964+0000","last_became_active":"2023-06-09T04:40:56.798138+0000","last_became_peered":"2023-06-09T04:40:56.798138+0000","last_unstale":"2023-06-09T04:41:01.284964+0000","last_undegraded":"2023-06-09T04:41:01.284964+0000","last_fullsized":"2023-06-09T04:41:01.284964+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:50:19.031791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.438636+0000","last_change":"2023-06-09T04:40:56.808104+0000","last_active":"2023-06-09T04:41:01.438636+0000","last_peered":"2023-06-09T04:41:01.438636+0000","last_clean":"2023-06-09T04:41:01.438636+0000","last_became_active":"2023-06-09T04:40:56.807785+0000","last_became_peered":"2023-06-09T04:40:56.807785+0000","last_unstale":"2023-06-09T04:41:01.438636+0000","last_undegraded":"2023-06-09T04:41:01.438636+0000","last_fullsized":"2023-06-09T04:41:01.438636+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:06:43.179689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.439453+0000","last_change":"2023-06-09T04:40:56.793787+0000","last_active":"2023-06-09T04:41:01.439453+0000","last_peered":"2023-06-09T04:41:01.439453+0000","last_clean":"2023-06-09T04:41:01.439453+0000","last_became_active":"2023-06-09T04:40:56.793480+0000","last_became_peered":"2023-06-09T04:40:56.793480+0000","last_unstale":"2023-06-09T04:41:01.439453+0000","last_undegraded":"2023-06-09T04:41:01.439453+0000","last_fullsized":"2023-06-09T04:41:01.439453+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:12:06.677526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.437720+0000","last_change":"2023-06-09T04:40:56.791804+0000","last_active":"2023-06-09T04:41:01.437720+0000","last_peered":"2023-06-09T04:41:01.437720+0000","last_clean":"2023-06-09T04:41:01.437720+0000","last_became_active":"2023-06-09T04:40:56.791541+0000","last_became_peered":"2023-06-09T04:40:56.791541+0000","last_unstale":"2023-06-09T04:41:01.437720+0000","last_undegraded":"2023-06-09T04:41:01.437720+0000","last_fullsized":"2023-06-09T04:41:01.437720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:23:01.827954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.437398+0000","last_change":"2023-06-09T04:40:56.813222+0000","last_active":"2023-06-09T04:41:01.437398+0000","last_peered":"2023-06-09T04:41:01.437398+0000","last_clean":"2023-06-09T04:41:01.437398+0000","last_became_active":"2023-06-09T04:40:56.812972+0000","last_became_peered":"2023-06-09T04:40:56.812972+0000","last_unstale":"2023-06-09T04:41:01.437398+0000","last_undegraded":"2023-06-09T04:41:01.437398+0000","last_fullsized":"2023-06-09T04:41:01.437398+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:43:09.121493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.286724+0000","last_change":"2023-06-09T04:40:56.803077+0000","last_active":"2023-06-09T04:41:01.286724+0000","last_peered":"2023-06-09T04:41:01.286724+0000","last_clean":"2023-06-09T04:41:01.286724+0000","last_became_active":"2023-06-09T04:40:56.802630+0000","last_became_peered":"2023-06-09T04:40:56.802630+0000","last_unstale":"2023-06-09T04:41:01.286724+0000","last_undegraded":"2023-06-09T04:41:01.286724+0000","last_fullsized":"2023-06-09T04:41:01.286724+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:33:17.724459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.440343+0000","last_change":"2023-06-09T04:40:56.795612+0000","last_active":"2023-06-09T04:41:01.440343+0000","last_peered":"2023-06-09T04:41:01.440343+0000","last_clean":"2023-06-09T04:41:01.440343+0000","last_became_active":"2023-06-09T04:40:56.795372+0000","last_became_peered":"2023-06-09T04:40:56.795372+0000","last_unstale":"2023-06-09T04:41:01.440343+0000","last_undegraded":"2023-06-09T04:41:01.440343+0000","last_fullsized":"2023-06-09T04:41:01.440343+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:57:29.499998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.282852+0000","last_change":"2023-06-09T04:40:56.805170+0000","last_active":"2023-06-09T04:41:01.282852+0000","last_peered":"2023-06-09T04:41:01.282852+0000","last_clean":"2023-06-09T04:41:01.282852+0000","last_became_active":"2023-06-09T04:40:56.804824+0000","last_became_peered":"2023-06-09T04:40:56.804824+0000","last_unstale":"2023-06-09T04:41:01.282852+0000","last_undegraded":"2023-06-09T04:41:01.282852+0000","last_fullsized":"2023-06-09T04:41:01.282852+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:14:31.300275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.438522+0000","last_change":"2023-06-09T04:40:56.815327+0000","last_active":"2023-06-09T04:41:01.438522+0000","last_peered":"2023-06-09T04:41:01.438522+0000","last_clean":"2023-06-09T04:41:01.438522+0000","last_became_active":"2023-06-09T04:40:56.815047+0000","last_became_peered":"2023-06-09T04:40:56.815047+0000","last_unstale":"2023-06-09T04:41:01.438522+0000","last_undegraded":"2023-06-09T04:41:01.438522+0000","last_fullsized":"2023-06-09T04:41:01.438522+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:25:21.467588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.438388+0000","last_change":"2023-06-09T04:40:56.808036+0000","last_active":"2023-06-09T04:41:01.438388+0000","last_peered":"2023-06-09T04:41:01.438388+0000","last_clean":"2023-06-09T04:41:01.438388+0000","last_became_active":"2023-06-09T04:40:56.807413+0000","last_became_peered":"2023-06-09T04:40:56.807413+0000","last_unstale":"2023-06-09T04:41:01.438388+0000","last_undegraded":"2023-06-09T04:41:01.438388+0000","last_fullsized":"2023-06-09T04:41:01.438388+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:57:29.499998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.284773+0000","last_change":"2023-06-09T04:40:56.802358+0000","last_active":"2023-06-09T04:41:01.284773+0000","last_peered":"2023-06-09T04:41:01.284773+0000","last_clean":"2023-06-09T04:41:01.284773+0000","last_became_active":"2023-06-09T04:40:56.798262+0000","last_became_peered":"2023-06-09T04:40:56.798262+0000","last_unstale":"2023-06-09T04:41:01.284773+0000","last_undegraded":"2023-06-09T04:41:01.284773+0000","last_fullsized":"2023-06-09T04:41:01.284773+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:44:45.646471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.282293+0000","last_change":"2023-06-09T04:40:56.805149+0000","last_active":"2023-06-09T04:41:01.282293+0000","last_peered":"2023-06-09T04:41:01.282293+0000","last_clean":"2023-06-09T04:41:01.282293+0000","last_became_active":"2023-06-09T04:40:56.804797+0000","last_became_peered":"2023-06-09T04:40:56.804797+0000","last_unstale":"2023-06-09T04:41:01.282293+0000","last_undegraded":"2023-06-09T04:41:01.282293+0000","last_fullsized":"2023-06-09T04:41:01.282293+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:13:45.572440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.287725+0000","last_change":"2023-06-09T04:40:56.798569+0000","last_active":"2023-06-09T04:41:01.287725+0000","last_peered":"2023-06-09T04:41:01.287725+0000","last_clean":"2023-06-09T04:41:01.287725+0000","last_became_active":"2023-06-09T04:40:56.792897+0000","last_became_peered":"2023-06-09T04:40:56.792897+0000","last_unstale":"2023-06-09T04:41:01.287725+0000","last_undegraded":"2023-06-09T04:41:01.287725+0000","last_fullsized":"2023-06-09T04:41:01.287725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:52:36.991160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.286606+0000","last_change":"2023-06-09T04:40:56.803260+0000","last_active":"2023-06-09T04:41:01.286606+0000","last_peered":"2023-06-09T04:41:01.286606+0000","last_clean":"2023-06-09T04:41:01.286606+0000","last_became_active":"2023-06-09T04:40:56.802966+0000","last_became_peered":"2023-06-09T04:40:56.802966+0000","last_unstale":"2023-06-09T04:41:01.286606+0000","last_undegraded":"2023-06-09T04:41:01.286606+0000","last_fullsized":"2023-06-09T04:41:01.286606+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:02:53.168915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.440235+0000","last_change":"2023-06-09T04:40:56.815725+0000","last_active":"2023-06-09T04:41:01.440235+0000","last_peered":"2023-06-09T04:41:01.440235+0000","last_clean":"2023-06-09T04:41:01.440235+0000","last_became_active":"2023-06-09T04:40:56.815369+0000","last_became_peered":"2023-06-09T04:40:56.815369+0000","last_unstale":"2023-06-09T04:41:01.440235+0000","last_undegraded":"2023-06-09T04:41:01.440235+0000","last_fullsized":"2023-06-09T04:41:01.440235+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:13:45.572440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-06-09T04:41:01.438161+0000","last_change":"2023-06-09T04:40:56.791652+0000","last_active":"2023-06-09T04:41:01.438161+0000","last_peered":"2023-06-09T04:41:01.438161+0000","last_clean":"2023-06-09T04:41:01.438161+0000","last_became_active":"2023-06-09T04:40:56.791358+0000","last_became_peered":"2023-06-09T04:40:56.791358+0000","last_unstale":"2023-06-09T04:41:01.438161+0000","last_undegraded":"2023-06-09T04:41:01.438161+0000","last_fullsized":"2023-06-09T04:41:01.438161+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:56.272903+0000","last_clean_scrub_stamp":"2023-06-09T04:40:56.272903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:18:56.081370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4591,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574860,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":904,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":925696,"data_stored":718949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.04}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.161}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2050000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.357}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3839999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":303104,"data_stored":124572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9359999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.022}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.095}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3779999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574860,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":311296,"data_stored":125224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93400000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0129999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.494}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4350000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.466}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2689999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27268,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344572,"statfs":{"total":96636764160,"available":96608841728,"internally_reserved":0,"allocated":323584,"data_stored":128421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0860000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.141}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1879999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0329999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4139999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574860,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":307200,"data_stored":124662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1180000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2829999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2390000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.169}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.444}]}]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":303104,"data_stored":124572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1910000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.121}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0580000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.101}]}]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":303104,"data_stored":124572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0429999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.298}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.141}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4770000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1830000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4159999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574861,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":901120,"data_stored":715522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9809999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1919999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-09T04:41:31.817 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-06-09T04:41:31.817 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-06-09T04:41:31.818 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-06-09T04:41:31.818 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-06-09T04:41:32.015 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.011+0000 7fc745b70700 1 Processor -- start 2023-06-09T04:41:32.016 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.011+0000 7fc745b70700 1 -- start start 2023-06-09T04:41:32.017 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.011+0000 7fc745b70700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc7400cd4f0 0x7fc7400cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:32.017 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.011+0000 7fc745b70700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc7400c9ea0 0x7fc7400ca320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:32.017 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.011+0000 7fc745b70700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc740071180 con 0x7fc740159a40 2023-06-09T04:41:32.018 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.011+0000 7fc745b70700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7400cbc00 con 0x7fc7400cd4f0 2023-06-09T04:41:32.018 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.011+0000 7fc745b70700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7400ca860 con 0x7fc7400c9ea0 2023-06-09T04:41:32.018 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.011+0000 7fc737fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc7400cd4f0 0x7fc7400cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:32.019 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.011+0000 7fc737fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc7400cd4f0 0x7fc7400cc610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53362/0 (socket says 172.21.15.62:53362) 2023-06-09T04:41:32.019 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.011+0000 7fc737fff700 1 -- 172.21.15.62:0/946221557 learned_addr learned my addr 172.21.15.62:0/946221557 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:32.019 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.011+0000 7fc74536f700 1 --2- 172.21.15.62:0/946221557 >> v2:172.21.15.89:3300/0 conn(0x7fc7400c9ea0 0x7fc7400ca320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:32.019 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.011+0000 7fc737fff700 1 -- 172.21.15.62:0/946221557 >> v2:172.21.15.89:3300/0 conn(0x7fc7400c9ea0 msgr2=0x7fc7400ca320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:32.019 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.011+0000 7fc737fff700 1 --2- 172.21.15.62:0/946221557 >> v2:172.21.15.89:3300/0 conn(0x7fc7400c9ea0 0x7fc7400ca320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:32.019 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.011+0000 7fc737fff700 1 -- 172.21.15.62:0/946221557 >> v1:172.21.15.89:6789/0 conn(0x7fc740159a40 legacy=0x7fc740070a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:32.019 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.011+0000 7fc737fff700 1 -- 172.21.15.62:0/946221557 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7400cc180 con 0x7fc7400cd4f0 2023-06-09T04:41:32.020 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.015+0000 7fc737fff700 1 --2- 172.21.15.62:0/946221557 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7400cd4f0 0x7fc7400cc610 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc7400cd9a0 tx=0x7fc730009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85238297a81c2af server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:32.020 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.015+0000 7fc7377fe700 1 -- 172.21.15.62:0/946221557 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc730011830 con 0x7fc7400cd4f0 2023-06-09T04:41:32.020 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.015+0000 7fc7377fe700 1 -- 172.21.15.62:0/946221557 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc730011990 con 0x7fc7400cd4f0 2023-06-09T04:41:32.020 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.015+0000 7fc7377fe700 1 -- 172.21.15.62:0/946221557 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc730011d20 con 0x7fc7400cd4f0 2023-06-09T04:41:32.021 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.015+0000 7fc745b70700 1 -- 172.21.15.62:0/946221557 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7400cd4f0 msgr2=0x7fc7400cc610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:32.021 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.015+0000 7fc745b70700 1 --2- 172.21.15.62:0/946221557 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7400cd4f0 0x7fc7400cc610 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc7400cd9a0 tx=0x7fc730009bf0 comp rx=0 tx=0).stop 2023-06-09T04:41:32.021 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.015+0000 7fc745b70700 1 -- 172.21.15.62:0/946221557 shutdown_connections 2023-06-09T04:41:32.021 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.015+0000 7fc745b70700 1 --2- 172.21.15.62:0/946221557 >> v2:172.21.15.89:3300/0 conn(0x7fc7400c9ea0 0x7fc7400ca320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:32.022 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.015+0000 7fc745b70700 1 --2- 172.21.15.62:0/946221557 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7400cd4f0 0x7fc7400cc610 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:32.022 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.015+0000 7fc745b70700 1 -- 172.21.15.62:0/946221557 >> 172.21.15.62:0/946221557 conn(0x7fc74006a420 msgr2=0x7fc7400afc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:32.022 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.015+0000 7fc745b70700 1 -- 172.21.15.62:0/946221557 shutdown_connections 2023-06-09T04:41:32.022 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.015+0000 7fc745b70700 1 -- 172.21.15.62:0/946221557 wait complete. 2023-06-09T04:41:32.023 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.019+0000 7fc745b70700 1 Processor -- start 2023-06-09T04:41:32.023 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.019+0000 7fc745b70700 1 -- start start 2023-06-09T04:41:32.025 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.019+0000 7fc745b70700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7400cd4f0 0x7fc740146320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:32.025 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.019+0000 7fc745b70700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc740159a40 0x7fc740154710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:32.025 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.019+0000 7fc745b70700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc7401f15f0 0x7fc7401f1a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:32.026 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.019+0000 7fc745b70700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc74014ff10 con 0x7fc7400cd4f0 2023-06-09T04:41:32.026 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.019+0000 7fc745b70700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7401f1fb0 con 0x7fc740159a40 2023-06-09T04:41:32.026 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.019+0000 7fc745b70700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7401501c0 con 0x7fc7401f15f0 2023-06-09T04:41:32.027 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.019+0000 7fc744b6e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7400cd4f0 0x7fc740146320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:32.027 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.019+0000 7fc744b6e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7400cd4f0 0x7fc740146320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53372/0 (socket says 172.21.15.62:53372) 2023-06-09T04:41:32.027 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.019+0000 7fc744b6e700 1 -- 172.21.15.62:0/1335738728 learned_addr learned my addr 172.21.15.62:0/1335738728 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:32.027 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.019+0000 7fc737fff700 1 --2- 172.21.15.62:0/1335738728 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc740159a40 0x7fc740154710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:32.027 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.019+0000 7fc74536f700 1 --2- 172.21.15.62:0/1335738728 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc7401f15f0 0x7fc7401f1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:32.028 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.019+0000 7fc744b6e700 1 -- 172.21.15.62:0/1335738728 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc7401f15f0 msgr2=0x7fc7401f1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:32.028 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.019+0000 7fc744b6e700 1 --2- 172.21.15.62:0/1335738728 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc7401f15f0 0x7fc7401f1a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:32.028 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.019+0000 7fc744b6e700 1 -- 172.21.15.62:0/1335738728 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc740159a40 msgr2=0x7fc740154710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:32.028 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.019+0000 7fc744b6e700 1 --2- 172.21.15.62:0/1335738728 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc740159a40 0x7fc740154710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:32.028 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.019+0000 7fc744b6e700 1 -- 172.21.15.62:0/1335738728 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc730009570 con 0x7fc7400cd4f0 2023-06-09T04:41:32.028 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.019+0000 7fc737fff700 1 --2- 172.21.15.62:0/1335738728 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc740159a40 0x7fc740154710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:41:32.028 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.023+0000 7fc744b6e700 1 --2- 172.21.15.62:0/1335738728 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7400cd4f0 0x7fc740146320 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc73c00c500 tx=0x7fc73c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:32.029 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.023+0000 7fc7357fa700 1 -- 172.21.15.62:0/1335738728 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73c0052d0 con 0x7fc7400cd4f0 2023-06-09T04:41:32.029 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.023+0000 7fc7357fa700 1 -- 172.21.15.62:0/1335738728 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc73c005430 con 0x7fc7400cd4f0 2023-06-09T04:41:32.029 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.023+0000 7fc745b70700 1 -- 172.21.15.62:0/1335738728 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7401504a0 con 0x7fc7400cd4f0 2023-06-09T04:41:32.029 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.023+0000 7fc7357fa700 1 -- 172.21.15.62:0/1335738728 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73c0055a0 con 0x7fc7400cd4f0 2023-06-09T04:41:32.030 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.023+0000 7fc745b70700 1 -- 172.21.15.62:0/1335738728 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc740150a60 con 0x7fc7400cd4f0 2023-06-09T04:41:32.030 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.023+0000 7fc745b70700 1 -- 172.21.15.62:0/1335738728 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7400739c0 con 0x7fc7400cd4f0 2023-06-09T04:41:32.031 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.027+0000 7fc7357fa700 1 -- 172.21.15.62:0/1335738728 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc73c0038e0 con 0x7fc7400cd4f0 2023-06-09T04:41:32.032 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.027+0000 7fc7357fa700 1 --2- 172.21.15.62:0/1335738728 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fc72c0662f0 0x7fc72c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:32.032 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.027+0000 7fc7357fa700 1 -- 172.21.15.62:0/1335738728 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc73c083370 con 0x7fc7400cd4f0 2023-06-09T04:41:32.033 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.027+0000 7fc737fff700 1 --2- 172.21.15.62:0/1335738728 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fc72c0662f0 0x7fc72c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:32.034 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.027+0000 7fc737fff700 1 --2- 172.21.15.62:0/1335738728 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fc72c0662f0 0x7fc72c0687a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc730000c00 tx=0x7fc730008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:32.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.035+0000 7fc7357fa700 1 -- 172.21.15.62:0/1335738728 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc73c0504f0 con 0x7fc7400cd4f0 2023-06-09T04:41:32.245 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.239+0000 7fc745b70700 1 -- 172.21.15.62:0/1335738728 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fc740071180 con 0x7fc7400cd4f0 2023-06-09T04:41:32.245 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.239+0000 7fc7357fa700 1 -- 172.21.15.62:0/1335738728 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fc740071180 con 0x7fc7400cd4f0 2023-06-09T04:41:32.246 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:41:32.246 INFO:teuthology.orchestra.run.smithi062.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-06-09T04:41:32.248 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.243+0000 7fc745b70700 1 -- 172.21.15.62:0/1335738728 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fc72c0662f0 msgr2=0x7fc72c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:32.248 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.243+0000 7fc745b70700 1 --2- 172.21.15.62:0/1335738728 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fc72c0662f0 0x7fc72c0687a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc730000c00 tx=0x7fc730008030 comp rx=0 tx=0).stop 2023-06-09T04:41:32.249 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.243+0000 7fc745b70700 1 -- 172.21.15.62:0/1335738728 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7400cd4f0 msgr2=0x7fc740146320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:32.249 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.243+0000 7fc745b70700 1 --2- 172.21.15.62:0/1335738728 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7400cd4f0 0x7fc740146320 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc73c00c500 tx=0x7fc73c00c8c0 comp rx=0 tx=0).stop 2023-06-09T04:41:32.249 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.243+0000 7fc745b70700 1 -- 172.21.15.62:0/1335738728 shutdown_connections 2023-06-09T04:41:32.249 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.243+0000 7fc745b70700 1 --2- 172.21.15.62:0/1335738728 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fc72c0662f0 0x7fc72c0687a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:32.249 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.243+0000 7fc745b70700 1 --2- 172.21.15.62:0/1335738728 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc7401f15f0 0x7fc7401f1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:32.249 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.243+0000 7fc745b70700 1 --2- 172.21.15.62:0/1335738728 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc740159a40 0x7fc740154710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:32.249 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.243+0000 7fc745b70700 1 --2- 172.21.15.62:0/1335738728 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc7400cd4f0 0x7fc740146320 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:32.250 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.243+0000 7fc745b70700 1 -- 172.21.15.62:0/1335738728 >> 172.21.15.62:0/1335738728 conn(0x7fc7400c9ea0 msgr2=0x7fc7400b2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:32.250 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.243+0000 7fc745b70700 1 -- 172.21.15.62:0/1335738728 shutdown_connections 2023-06-09T04:41:32.250 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.243+0000 7fc745b70700 1 -- 172.21.15.62:0/1335738728 wait complete. 2023-06-09T04:41:32.268 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-06-09T04:41:32.269 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:41:32.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.435+0000 7f07a5f6b700 1 Processor -- start 2023-06-09T04:41:32.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.435+0000 7f07a5f6b700 1 -- start start 2023-06-09T04:41:32.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.435+0000 7f07a5f6b700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f07980e3d40 0x7f07980e4c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:32.442 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.435+0000 7f07a5f6b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0798037ae0 0x7f0798036710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:32.442 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.435+0000 7f07a5f6b700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f079803a650 con 0x7f07980500a0 2023-06-09T04:41:32.442 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.435+0000 7f07a5f6b700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0798051240 con 0x7f0798037ae0 2023-06-09T04:41:32.442 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.435+0000 7f07a5f6b700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f079804fc10 con 0x7f07980e3d40 2023-06-09T04:41:32.443 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.435+0000 7f079ffff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0798037ae0 0x7f0798036710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:32.443 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.435+0000 7f07a4f69700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f07980e3d40 0x7f07980e4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:32.443 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.435+0000 7f079ffff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0798037ae0 0x7f0798036710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53386/0 (socket says 172.21.15.62:53386) 2023-06-09T04:41:32.443 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.435+0000 7f07a4f69700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f07980e3d40 0x7f07980e4c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.62:48846/0 (socket says 172.21.15.62:48846) 2023-06-09T04:41:32.443 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.435+0000 7f07a576a700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f07980500a0 0x7f0798005fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.62:44438/0 (socket says 172.21.15.62:44438) 2023-06-09T04:41:32.443 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.435+0000 7f079ffff700 1 -- 172.21.15.62:0/1159749312 learned_addr learned my addr 172.21.15.62:0/1159749312 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:32.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.439+0000 7f079ffff700 1 -- 172.21.15.62:0/1159749312 >> v2:172.21.15.89:3300/0 conn(0x7f07980e3d40 msgr2=0x7f07980e4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:32.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.439+0000 7f079ffff700 1 --2- 172.21.15.62:0/1159749312 >> v2:172.21.15.89:3300/0 conn(0x7f07980e3d40 0x7f07980e4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:32.445 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.439+0000 7f079ffff700 1 -- 172.21.15.62:0/1159749312 >> v1:172.21.15.89:6789/0 conn(0x7f07980500a0 legacy=0x7f0798005fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:32.445 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.439+0000 7f079ffff700 1 -- 172.21.15.62:0/1159749312 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07980e5140 con 0x7f0798037ae0 2023-06-09T04:41:32.445 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.439+0000 7f07a4f69700 1 --2- 172.21.15.62:0/1159749312 >> v2:172.21.15.89:3300/0 conn(0x7f07980e3d40 0x7f07980e4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:41:32.445 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.439+0000 7f079ffff700 1 --2- 172.21.15.62:0/1159749312 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0798037ae0 0x7f0798036710 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f079800df80 tx=0x7f078c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a30367dadd23890f server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:32.445 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.439+0000 7f079f7fe700 1 -- 172.21.15.62:0/1159749312 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f078c011830 con 0x7f0798037ae0 2023-06-09T04:41:32.445 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.439+0000 7f079f7fe700 1 -- 172.21.15.62:0/1159749312 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f078c011990 con 0x7f0798037ae0 2023-06-09T04:41:32.445 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.439+0000 7f079f7fe700 1 -- 172.21.15.62:0/1159749312 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f078c011d20 con 0x7f0798037ae0 2023-06-09T04:41:32.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.439+0000 7f07a5f6b700 1 -- 172.21.15.62:0/1159749312 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0798037ae0 msgr2=0x7f0798036710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:32.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.439+0000 7f07a5f6b700 1 --2- 172.21.15.62:0/1159749312 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0798037ae0 0x7f0798036710 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f079800df80 tx=0x7f078c009bf0 comp rx=0 tx=0).stop 2023-06-09T04:41:32.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.439+0000 7f07a5f6b700 1 -- 172.21.15.62:0/1159749312 shutdown_connections 2023-06-09T04:41:32.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.439+0000 7f07a5f6b700 1 --2- 172.21.15.62:0/1159749312 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0798037ae0 0x7f0798036710 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:32.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.439+0000 7f07a5f6b700 1 --2- 172.21.15.62:0/1159749312 >> v2:172.21.15.89:3300/0 conn(0x7f07980e3d40 0x7f07980e4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:32.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.439+0000 7f07a5f6b700 1 -- 172.21.15.62:0/1159749312 >> 172.21.15.62:0/1159749312 conn(0x7f0798051710 msgr2=0x7f0798051ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:32.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.439+0000 7f07a5f6b700 1 -- 172.21.15.62:0/1159749312 shutdown_connections 2023-06-09T04:41:32.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.439+0000 7f07a5f6b700 1 -- 172.21.15.62:0/1159749312 wait complete. 2023-06-09T04:41:32.449 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.443+0000 7f07a5f6b700 1 Processor -- start 2023-06-09T04:41:32.449 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.443+0000 7f07a5f6b700 1 -- start start 2023-06-09T04:41:32.450 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.443+0000 7f07a5f6b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0798037ae0 0x7f07980d3060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:32.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.443+0000 7f07a5f6b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07980500a0 0x7f0798052860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:32.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.443+0000 7f07a5f6b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07980e3d40 0x7f0798032d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:32.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.443+0000 7f07a5f6b700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07980357d0 con 0x7f0798037ae0 2023-06-09T04:41:32.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.443+0000 7f07a5f6b700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0798034e70 con 0x7f07980500a0 2023-06-09T04:41:32.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.443+0000 7f07a5f6b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0798035110 con 0x7f07980e3d40 2023-06-09T04:41:32.452 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.447+0000 7f07a4f69700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0798037ae0 0x7f07980d3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:32.452 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.447+0000 7f07a4f69700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0798037ae0 0x7f07980d3060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53392/0 (socket says 172.21.15.62:53392) 2023-06-09T04:41:32.452 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.447+0000 7f07a4f69700 1 -- 172.21.15.62:0/627950320 learned_addr learned my addr 172.21.15.62:0/627950320 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:32.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.447+0000 7f07a576a700 1 --2- 172.21.15.62:0/627950320 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07980e3d40 0x7f0798032d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:32.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.447+0000 7f079ffff700 1 --2- 172.21.15.62:0/627950320 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07980500a0 0x7f0798052860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:32.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.447+0000 7f07a4f69700 1 -- 172.21.15.62:0/627950320 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07980e3d40 msgr2=0x7f0798032d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:32.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.447+0000 7f07a4f69700 1 --2- 172.21.15.62:0/627950320 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07980e3d40 0x7f0798032d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:32.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.447+0000 7f07a4f69700 1 -- 172.21.15.62:0/627950320 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07980500a0 msgr2=0x7f0798052860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:32.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.447+0000 7f07a4f69700 1 --2- 172.21.15.62:0/627950320 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07980500a0 0x7f0798052860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:32.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.447+0000 7f07a4f69700 1 -- 172.21.15.62:0/627950320 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07940094b0 con 0x7f0798037ae0 2023-06-09T04:41:32.454 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.447+0000 7f07a4f69700 1 --2- 172.21.15.62:0/627950320 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0798037ae0 0x7f07980d3060 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f079400ebe0 tx=0x7f079400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:32.454 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.447+0000 7f079d7fa700 1 -- 172.21.15.62:0/627950320 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0794009770 con 0x7f0798037ae0 2023-06-09T04:41:32.455 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.447+0000 7f079d7fa700 1 -- 172.21.15.62:0/627950320 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f079400c850 con 0x7f0798037ae0 2023-06-09T04:41:32.455 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.447+0000 7f07a5f6b700 1 -- 172.21.15.62:0/627950320 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f078c009570 con 0x7f0798037ae0 2023-06-09T04:41:32.455 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.447+0000 7f079d7fa700 1 -- 172.21.15.62:0/627950320 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f079400cbe0 con 0x7f0798037ae0 2023-06-09T04:41:32.455 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.447+0000 7f07a5f6b700 1 -- 172.21.15.62:0/627950320 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0798032620 con 0x7f0798037ae0 2023-06-09T04:41:32.456 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.451+0000 7f07a5f6b700 1 -- 172.21.15.62:0/627950320 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f079804f5a0 con 0x7f0798037ae0 2023-06-09T04:41:32.458 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.451+0000 7f079d7fa700 1 -- 172.21.15.62:0/627950320 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f079400cd40 con 0x7f0798037ae0 2023-06-09T04:41:32.459 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.455+0000 7f079d7fa700 1 --2- 172.21.15.62:0/627950320 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f07840662f0 0x7f07840687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:32.460 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.455+0000 7f079d7fa700 1 -- 172.21.15.62:0/627950320 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0794083ff0 con 0x7f0798037ae0 2023-06-09T04:41:32.460 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.455+0000 7f079ffff700 1 --2- 172.21.15.62:0/627950320 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f07840662f0 0x7f07840687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:32.461 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.455+0000 7f079ffff700 1 --2- 172.21.15.62:0/627950320 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f07840662f0 0x7f07840687a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0798037f10 tx=0x7f078c008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:32.466 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.459+0000 7f079d7fa700 1 -- 172.21.15.62:0/627950320 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f079804f5a0 con 0x7f0798037ae0 2023-06-09T04:41:32.640 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.635+0000 7f07a5f6b700 1 -- 172.21.15.62:0/627950320 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f079804f570 con 0x7f0798037ae0 2023-06-09T04:41:32.643 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.635+0000 7f079d7fa700 1 -- 172.21.15.62:0/627950320 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20084 (secure 0 0 0) 0x7f0794017090 con 0x7f0798037ae0 2023-06-09T04:41:32.643 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:41:32.643 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":28,"fsid":"f7998a1e-e5a9-4202-abaa-70c0eaae1047","created":"2023-06-09T04:40:30.469588+0000","modified":"2023-06-09T04:41:01.271858+0000","last_up_change":"2023-06-09T04:40:43.120747+0000","last_in_change":"2023-06-09T04:40:33.568221+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:40:44.646921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:40:50.006643+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:40:55.031273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:40:55.773517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-09T04:40:58.845383+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bc50bbc0-dd08-42ed-804c-ec3029e36c19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6802","nonce":1295788017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6807","nonce":1295788017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6815","nonce":1295788017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6809","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6811","nonce":1295788017}]},"public_addr":"172.21.15.62:6802/1295788017","cluster_addr":"172.21.15.62:6807/1295788017","heartbeat_back_addr":"172.21.15.62:6815/1295788017","heartbeat_front_addr":"172.21.15.62:6811/1295788017","state":["exists","up"]},{"osd":1,"uuid":"8230b12d-e22f-4985-a584-4cc64404cdbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6825","nonce":4120692006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6827","nonce":4120692006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6831","nonce":4120692006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6829","nonce":4120692006}]},"public_addr":"172.21.15.62:6825/4120692006","cluster_addr":"172.21.15.62:6827/4120692006","heartbeat_back_addr":"172.21.15.62:6831/4120692006","heartbeat_front_addr":"172.21.15.62:6829/4120692006","state":["exists","up"]},{"osd":2,"uuid":"d0202506-dbe9-4e3c-9271-687929abf96a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6801","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6803","nonce":4169607876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6805","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6806","nonce":4169607876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6814","nonce":4169607876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6810","nonce":4169607876}]},"public_addr":"172.21.15.62:6803/4169607876","cluster_addr":"172.21.15.62:6806/4169607876","heartbeat_back_addr":"172.21.15.62:6814/4169607876","heartbeat_front_addr":"172.21.15.62:6810/4169607876","state":["exists","up"]},{"osd":3,"uuid":"f3c0298a-b075-4411-af50-e16cd74fdddb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6817","nonce":3268438986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6819","nonce":3268438986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6823","nonce":3268438986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6821","nonce":3268438986}]},"public_addr":"172.21.15.62:6817/3268438986","cluster_addr":"172.21.15.62:6819/3268438986","heartbeat_back_addr":"172.21.15.62:6823/3268438986","heartbeat_front_addr":"172.21.15.62:6821/3268438986","state":["exists","up"]},{"osd":4,"uuid":"1ab5c5ca-e74f-475a-a309-683cc0029928","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6817","nonce":3139617628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6819","nonce":3139617628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6823","nonce":3139617628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6821","nonce":3139617628}]},"public_addr":"172.21.15.89:6817/3139617628","cluster_addr":"172.21.15.89:6819/3139617628","heartbeat_back_addr":"172.21.15.89:6823/3139617628","heartbeat_front_addr":"172.21.15.89:6821/3139617628","state":["exists","up"]},{"osd":5,"uuid":"a933e184-bd8f-4369-a1ba-a68de53c578c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6825","nonce":2681723596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6827","nonce":2681723596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6831","nonce":2681723596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6829","nonce":2681723596}]},"public_addr":"172.21.15.89:6825/2681723596","cluster_addr":"172.21.15.89:6827/2681723596","heartbeat_back_addr":"172.21.15.89:6831/2681723596","heartbeat_front_addr":"172.21.15.89:6829/2681723596","state":["exists","up"]},{"osd":6,"uuid":"1ed7ad37-2eee-49a6-954c-b537e2b7f0ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6809","nonce":1657136033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6811","nonce":1657136033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6815","nonce":1657136033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6813","nonce":1657136033}]},"public_addr":"172.21.15.89:6809/1657136033","cluster_addr":"172.21.15.89:6811/1657136033","heartbeat_back_addr":"172.21.15.89:6815/1657136033","heartbeat_front_addr":"172.21.15.89:6813/1657136033","state":["exists","up"]},{"osd":7,"uuid":"6ed732e9-33ff-40df-9038-a9f1d1622671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6801","nonce":1710561686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6803","nonce":1710561686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6807","nonce":1710561686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6805","nonce":1710561686}]},"public_addr":"172.21.15.89:6801/1710561686","cluster_addr":"172.21.15.89:6803/1710561686","heartbeat_back_addr":"172.21.15.89:6807/1710561686","heartbeat_front_addr":"172.21.15.89:6805/1710561686","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.335803+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.419788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.179334+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.263310+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.071846+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.375627+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.282277+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.315997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:41:32.645 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.639+0000 7f07a5f6b700 1 -- 172.21.15.62:0/627950320 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f07840662f0 msgr2=0x7f07840687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:32.646 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.639+0000 7f07a5f6b700 1 --2- 172.21.15.62:0/627950320 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f07840662f0 0x7f07840687a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0798037f10 tx=0x7f078c008030 comp rx=0 tx=0).stop 2023-06-09T04:41:32.646 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.639+0000 7f07a5f6b700 1 -- 172.21.15.62:0/627950320 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0798037ae0 msgr2=0x7f07980d3060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:32.646 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.639+0000 7f07a5f6b700 1 --2- 172.21.15.62:0/627950320 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0798037ae0 0x7f07980d3060 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f079400ebe0 tx=0x7f079400eef0 comp rx=0 tx=0).stop 2023-06-09T04:41:32.646 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.639+0000 7f07a5f6b700 1 -- 172.21.15.62:0/627950320 shutdown_connections 2023-06-09T04:41:32.647 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.639+0000 7f07a5f6b700 1 --2- 172.21.15.62:0/627950320 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f07840662f0 0x7f07840687a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:32.647 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.639+0000 7f07a5f6b700 1 --2- 172.21.15.62:0/627950320 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f07980e3d40 0x7f0798032d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:32.647 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.639+0000 7f07a5f6b700 1 --2- 172.21.15.62:0/627950320 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f07980500a0 0x7f0798052860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:32.647 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.639+0000 7f07a5f6b700 1 --2- 172.21.15.62:0/627950320 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0798037ae0 0x7f07980d3060 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:32.647 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.639+0000 7f07a5f6b700 1 -- 172.21.15.62:0/627950320 >> 172.21.15.62:0/627950320 conn(0x7f0798051710 msgr2=0x7f07980dfc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:32.647 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.639+0000 7f07a5f6b700 1 -- 172.21.15.62:0/627950320 shutdown_connections 2023-06-09T04:41:32.648 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.639+0000 7f07a5f6b700 1 -- 172.21.15.62:0/627950320 wait complete. 2023-06-09T04:41:32.667 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:40:44.646921+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:40:50.006643+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T04:40:55.031273+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T04:40:55.773517+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-09T04:40:58.845383+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-09T04:41:32.668 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:41:32.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.839+0000 7f45e6b45700 1 Processor -- start 2023-06-09T04:41:32.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.839+0000 7f45e6b45700 1 -- start start 2023-06-09T04:41:32.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.839+0000 7f45e6b45700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f45e00d1f80 0x7f45e00b3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:32.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.839+0000 7f45e6b45700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45e00cebf0 0x7f45e00ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:32.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.839+0000 7f45e6b45700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45e00b4d50 con 0x7f45e00cd110 2023-06-09T04:41:32.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.839+0000 7f45e6b45700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45e00cd590 con 0x7f45e00d1f80 2023-06-09T04:41:32.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.839+0000 7f45e6b45700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45e00cf040 con 0x7f45e00cebf0 2023-06-09T04:41:32.847 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.839+0000 7f45e6344700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f45e00cd110 0x7f45e00b2400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36246/0 (socket says 172.21.15.62:36246) 2023-06-09T04:41:32.847 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.839+0000 7f45e6344700 1 -- 172.21.15.62:0/1554829358 learned_addr learned my addr 172.21.15.62:0/1554829358 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:41:32.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.839+0000 7f45e5b43700 1 --2- 172.21.15.62:0/1554829358 >> v2:172.21.15.62:3300/0 conn(0x7f45e00d1f80 0x7f45e00b3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:32.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.839+0000 7f45e5342700 1 --2- 172.21.15.62:0/1554829358 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45e00cebf0 0x7f45e00ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:32.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.839+0000 7f45e5b43700 1 -- 172.21.15.62:0/1554829358 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45e00cebf0 msgr2=0x7f45e00ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:32.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.839+0000 7f45e4b41700 1 -- 172.21.15.62:0/1554829358 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1551964344 0 0) 0x7f45e00b4d50 con 0x7f45e00cd110 2023-06-09T04:41:32.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.839+0000 7f45e5b43700 1 --2- 172.21.15.62:0/1554829358 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45e00cebf0 0x7f45e00ccbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:32.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.839+0000 7f45e5b43700 1 -- 172.21.15.62:0/1554829358 >> v1:172.21.15.62:6789/0 conn(0x7f45e00cd110 legacy=0x7f45e00b2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:32.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.839+0000 7f45e5b43700 1 -- 172.21.15.62:0/1554829358 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45e00b4140 con 0x7f45e00d1f80 2023-06-09T04:41:32.849 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.843+0000 7f45e5b43700 1 --2- 172.21.15.62:0/1554829358 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45e00d1f80 0x7f45e00b3b20 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f45dc009840 tx=0x7f45dc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5191ca6b2eba9e32 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:32.849 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.843+0000 7f45e4b41700 1 -- 172.21.15.62:0/1554829358 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45dc005e50 con 0x7f45e00d1f80 2023-06-09T04:41:32.849 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.843+0000 7f45e4b41700 1 -- 172.21.15.62:0/1554829358 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45dc006030 con 0x7f45e00d1f80 2023-06-09T04:41:32.849 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.843+0000 7f45e4b41700 1 -- 172.21.15.62:0/1554829358 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45dc0063c0 con 0x7f45e00d1f80 2023-06-09T04:41:32.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.843+0000 7f45e6b45700 1 -- 172.21.15.62:0/1554829358 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45e00d1f80 msgr2=0x7f45e00b3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:32.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.843+0000 7f45e6b45700 1 --2- 172.21.15.62:0/1554829358 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45e00d1f80 0x7f45e00b3b20 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f45dc009840 tx=0x7f45dc009b50 comp rx=0 tx=0).stop 2023-06-09T04:41:32.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.843+0000 7f45e6b45700 1 -- 172.21.15.62:0/1554829358 shutdown_connections 2023-06-09T04:41:32.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.843+0000 7f45e6b45700 1 --2- 172.21.15.62:0/1554829358 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45e00cebf0 0x7f45e00ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:32.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.843+0000 7f45e6b45700 1 --2- 172.21.15.62:0/1554829358 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45e00d1f80 0x7f45e00b3b20 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:32.851 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.843+0000 7f45e6b45700 1 -- 172.21.15.62:0/1554829358 >> 172.21.15.62:0/1554829358 conn(0x7f45e0071840 msgr2=0x7f45e009b760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:32.851 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.843+0000 7f45e6b45700 1 -- 172.21.15.62:0/1554829358 shutdown_connections 2023-06-09T04:41:32.851 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.843+0000 7f45e6b45700 1 -- 172.21.15.62:0/1554829358 wait complete. 2023-06-09T04:41:32.851 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.843+0000 7f45e6b45700 1 Processor -- start 2023-06-09T04:41:32.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.843+0000 7f45e6b45700 1 -- start start 2023-06-09T04:41:32.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.847+0000 7f45e6b45700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45e00cd110 0x7f45e0151a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:32.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.847+0000 7f45e6b45700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45e00cebf0 0x7f45e00c8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:32.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.847+0000 7f45e6b45700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45e00d1f80 0x7f45e00b5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:32.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.847+0000 7f45e6b45700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e00c69f0 con 0x7f45e00cd110 2023-06-09T04:41:32.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.847+0000 7f45e6b45700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e0151fa0 con 0x7f45e00cebf0 2023-06-09T04:41:32.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.847+0000 7f45e6b45700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45e00c8890 con 0x7f45e00d1f80 2023-06-09T04:41:32.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.847+0000 7f45e5b43700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45e00cd110 0x7f45e0151a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:32.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.847+0000 7f45e5b43700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45e00cd110 0x7f45e0151a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53424/0 (socket says 172.21.15.62:53424) 2023-06-09T04:41:32.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.847+0000 7f45e5b43700 1 -- 172.21.15.62:0/974599901 learned_addr learned my addr 172.21.15.62:0/974599901 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:32.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.847+0000 7f45e5342700 1 --2- 172.21.15.62:0/974599901 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45e00cebf0 0x7f45e00c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:32.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.847+0000 7f45e6344700 1 --2- 172.21.15.62:0/974599901 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45e00d1f80 0x7f45e00b5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:32.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.847+0000 7f45e5b43700 1 -- 172.21.15.62:0/974599901 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45e00d1f80 msgr2=0x7f45e00b5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:32.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.847+0000 7f45e5b43700 1 --2- 172.21.15.62:0/974599901 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45e00d1f80 0x7f45e00b5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:32.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.847+0000 7f45e5b43700 1 -- 172.21.15.62:0/974599901 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45e00cebf0 msgr2=0x7f45e00c8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:32.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.847+0000 7f45e5b43700 1 --2- 172.21.15.62:0/974599901 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45e00cebf0 0x7f45e00c8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:32.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.847+0000 7f45e5b43700 1 -- 172.21.15.62:0/974599901 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45dc009450 con 0x7f45e00cd110 2023-06-09T04:41:32.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.847+0000 7f45e5b43700 1 --2- 172.21.15.62:0/974599901 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45e00cd110 0x7f45e0151a60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f45dc013040 tx=0x7f45dc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:32.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.847+0000 7f45d67fc700 1 -- 172.21.15.62:0/974599901 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45dc003ad0 con 0x7f45e00cd110 2023-06-09T04:41:32.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.847+0000 7f45d67fc700 1 -- 172.21.15.62:0/974599901 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45dc003c50 con 0x7f45e00cd110 2023-06-09T04:41:32.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.847+0000 7f45d67fc700 1 -- 172.21.15.62:0/974599901 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45dc0061a0 con 0x7f45e00cd110 2023-06-09T04:41:32.857 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.847+0000 7f45e6b45700 1 -- 172.21.15.62:0/974599901 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45e00c6c00 con 0x7f45e00cd110 2023-06-09T04:41:32.857 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.847+0000 7f45e6b45700 1 -- 172.21.15.62:0/974599901 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45e00c71c0 con 0x7f45e00cd110 2023-06-09T04:41:32.857 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.851+0000 7f45e6b45700 1 -- 172.21.15.62:0/974599901 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45e00739c0 con 0x7f45e00cd110 2023-06-09T04:41:32.857 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.851+0000 7f45d67fc700 1 -- 172.21.15.62:0/974599901 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f45dc022070 con 0x7f45e00cd110 2023-06-09T04:41:32.858 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.851+0000 7f45d67fc700 1 --2- 172.21.15.62:0/974599901 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f45c40662f0 0x7f45c40687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:32.859 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.855+0000 7f45d67fc700 1 -- 172.21.15.62:0/974599901 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f45dc085930 con 0x7f45e00cd110 2023-06-09T04:41:32.859 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.855+0000 7f45e5342700 1 --2- 172.21.15.62:0/974599901 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f45c40662f0 0x7f45c40687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:32.860 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.855+0000 7f45e5342700 1 --2- 172.21.15.62:0/974599901 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f45c40662f0 0x7f45c40687a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f45e00cfb50 tx=0x7f45d0008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:32.864 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:32.859+0000 7f45d67fc700 1 -- 172.21.15.62:0/974599901 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f45dc052ab0 con 0x7f45e00cd110 2023-06-09T04:41:33.035 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.031+0000 7f45e6b45700 1 -- 172.21.15.62:0/974599901 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f45e006aa70 con 0x7f45e00cd110 2023-06-09T04:41:33.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.031+0000 7f45d67fc700 1 -- 172.21.15.62:0/974599901 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f45dc02a020 con 0x7f45e00cd110 2023-06-09T04:41:33.036 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2023-06-09T04:41:33.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.035+0000 7f45e6b45700 1 -- 172.21.15.62:0/974599901 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f45c40662f0 msgr2=0x7f45c40687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:33.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.035+0000 7f45e6b45700 1 --2- 172.21.15.62:0/974599901 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f45c40662f0 0x7f45c40687a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f45e00cfb50 tx=0x7f45d0008040 comp rx=0 tx=0).stop 2023-06-09T04:41:33.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.035+0000 7f45e6b45700 1 -- 172.21.15.62:0/974599901 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45e00cd110 msgr2=0x7f45e0151a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:33.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.035+0000 7f45e6b45700 1 --2- 172.21.15.62:0/974599901 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45e00cd110 0x7f45e0151a60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f45dc013040 tx=0x7f45dc004770 comp rx=0 tx=0).stop 2023-06-09T04:41:33.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.035+0000 7f45e6b45700 1 -- 172.21.15.62:0/974599901 shutdown_connections 2023-06-09T04:41:33.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.035+0000 7f45e6b45700 1 --2- 172.21.15.62:0/974599901 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f45c40662f0 0x7f45c40687a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:33.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.035+0000 7f45e6b45700 1 --2- 172.21.15.62:0/974599901 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f45e00d1f80 0x7f45e00b5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:33.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.035+0000 7f45e6b45700 1 --2- 172.21.15.62:0/974599901 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45e00cebf0 0x7f45e00c8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:33.042 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.035+0000 7f45e6b45700 1 --2- 172.21.15.62:0/974599901 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f45e00cd110 0x7f45e0151a60 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:33.042 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.035+0000 7f45e6b45700 1 -- 172.21.15.62:0/974599901 >> 172.21.15.62:0/974599901 conn(0x7f45e0071840 msgr2=0x7f45e00cf1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:33.042 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.035+0000 7f45e6b45700 1 -- 172.21.15.62:0/974599901 shutdown_connections 2023-06-09T04:41:33.042 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.035+0000 7f45e6b45700 1 -- 172.21.15.62:0/974599901 wait complete. 2023-06-09T04:41:33.063 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:41:33.242 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.235+0000 7f2dbfc7b700 1 Processor -- start 2023-06-09T04:41:33.242 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.235+0000 7f2dbfc7b700 1 -- start start 2023-06-09T04:41:33.244 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.239+0000 7f2dbfc7b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2db8159e10 0x7f2db80b09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:33.244 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.239+0000 7f2dbfc7b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2db815e090 0x7f2db80b2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:33.245 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.239+0000 7f2dbfc7b700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2db815e500 0x7f2db80b2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:33.245 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.239+0000 7f2dbfc7b700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2db80cd830 con 0x7f2db8159e10 2023-06-09T04:41:33.245 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.239+0000 7f2dbfc7b700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2db80cda40 con 0x7f2db815e500 2023-06-09T04:41:33.245 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.239+0000 7f2dbfc7b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2db80cdd20 con 0x7f2db815e090 2023-06-09T04:41:33.246 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.239+0000 7f2dbd216700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2db815e090 0x7f2db80b2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:33.246 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.239+0000 7f2dbda17700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2db8159e10 0x7f2db80b09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:33.246 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.239+0000 7f2dbd216700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2db815e090 0x7f2db80b2ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.62:44354/0 (socket says 172.21.15.62:44354) 2023-06-09T04:41:33.246 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.239+0000 7f2dbd216700 1 -- 172.21.15.62:0/3308527484 learned_addr learned my addr 172.21.15.62:0/3308527484 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:33.246 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.239+0000 7f2dbe218700 1 --2- 172.21.15.62:0/3308527484 >> v2:172.21.15.89:3300/0 conn(0x7f2db815e500 0x7f2db80b2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:33.247 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.239+0000 7f2dbd216700 1 -- 172.21.15.62:0/3308527484 >> v2:172.21.15.89:3300/0 conn(0x7f2db815e500 msgr2=0x7f2db80b2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:33.247 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.239+0000 7f2dbd216700 1 --2- 172.21.15.62:0/3308527484 >> v2:172.21.15.89:3300/0 conn(0x7f2db815e500 0x7f2db80b2ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:33.247 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.239+0000 7f2dbd216700 1 -- 172.21.15.62:0/3308527484 >> v2:172.21.15.62:3300/0 conn(0x7f2db8159e10 msgr2=0x7f2db80b09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:33.247 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.239+0000 7f2dbd216700 1 --2- 172.21.15.62:0/3308527484 >> v2:172.21.15.62:3300/0 conn(0x7f2db8159e10 0x7f2db80b09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:33.247 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.239+0000 7f2dbd216700 1 -- 172.21.15.62:0/3308527484 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2db815d890 con 0x7f2db815e090 2023-06-09T04:41:33.248 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.243+0000 7f2dbd216700 1 --2- 172.21.15.62:0/3308527484 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2db815e090 0x7f2db80b2ab0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2db806b0d0 tx=0x7f2da8009bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77fa1990a9625a3a server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:33.248 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.243+0000 7f2dbca15700 1 -- 172.21.15.62:0/3308527484 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da8011830 con 0x7f2db815e090 2023-06-09T04:41:33.248 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.243+0000 7f2dbca15700 1 -- 172.21.15.62:0/3308527484 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2da8011990 con 0x7f2db815e090 2023-06-09T04:41:33.249 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.243+0000 7f2dbca15700 1 -- 172.21.15.62:0/3308527484 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da8011d20 con 0x7f2db815e090 2023-06-09T04:41:33.249 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.243+0000 7f2dbfc7b700 1 -- 172.21.15.62:0/3308527484 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2db815e090 msgr2=0x7f2db80b2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:33.249 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.243+0000 7f2dbfc7b700 1 --2- 172.21.15.62:0/3308527484 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2db815e090 0x7f2db80b2ab0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2db806b0d0 tx=0x7f2da8009bf0 comp rx=0 tx=0).stop 2023-06-09T04:41:33.249 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.243+0000 7f2dbfc7b700 1 -- 172.21.15.62:0/3308527484 shutdown_connections 2023-06-09T04:41:33.249 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.243+0000 7f2dbfc7b700 1 --2- 172.21.15.62:0/3308527484 >> v2:172.21.15.89:3300/0 conn(0x7f2db815e500 0x7f2db80b2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:33.249 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.243+0000 7f2dbfc7b700 1 --2- 172.21.15.62:0/3308527484 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2db815e090 0x7f2db80b2ab0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:33.249 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.243+0000 7f2dbfc7b700 1 --2- 172.21.15.62:0/3308527484 >> v2:172.21.15.62:3300/0 conn(0x7f2db8159e10 0x7f2db80b09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:33.250 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.243+0000 7f2dbfc7b700 1 -- 172.21.15.62:0/3308527484 >> 172.21.15.62:0/3308527484 conn(0x7f2db806c5d0 msgr2=0x7f2db80cad60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:33.250 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.243+0000 7f2dbfc7b700 1 -- 172.21.15.62:0/3308527484 shutdown_connections 2023-06-09T04:41:33.250 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.243+0000 7f2dbfc7b700 1 -- 172.21.15.62:0/3308527484 wait complete. 2023-06-09T04:41:33.251 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.247+0000 7f2dbfc7b700 1 Processor -- start 2023-06-09T04:41:33.252 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.247+0000 7f2dbfc7b700 1 -- start start 2023-06-09T04:41:33.253 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.247+0000 7f2dbfc7b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2db8159e10 0x7f2db815c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:33.253 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.247+0000 7f2dbfc7b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2db815e090 0x7f2db8159130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:33.254 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.247+0000 7f2dbfc7b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2db815e500 0x7f2db80afa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:33.254 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.247+0000 7f2dbfc7b700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db8159670 con 0x7f2db8159e10 2023-06-09T04:41:33.254 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.247+0000 7f2dbfc7b700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db80b0440 con 0x7f2db815e500 2023-06-09T04:41:33.254 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.247+0000 7f2dbfc7b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2db815b8c0 con 0x7f2db815e090 2023-06-09T04:41:33.255 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.247+0000 7f2dbda17700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2db8159e10 0x7f2db815c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:33.255 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.247+0000 7f2dbda17700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2db8159e10 0x7f2db815c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53446/0 (socket says 172.21.15.62:53446) 2023-06-09T04:41:33.255 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.247+0000 7f2dbda17700 1 -- 172.21.15.62:0/536238241 learned_addr learned my addr 172.21.15.62:0/536238241 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:33.255 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.247+0000 7f2dbd216700 1 --2- 172.21.15.62:0/536238241 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2db815e090 0x7f2db8159130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:33.256 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.247+0000 7f2dbe218700 1 --2- 172.21.15.62:0/536238241 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2db815e500 0x7f2db80afa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:33.256 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.247+0000 7f2dbda17700 1 -- 172.21.15.62:0/536238241 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2db815e090 msgr2=0x7f2db8159130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:33.256 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.247+0000 7f2dbda17700 1 --2- 172.21.15.62:0/536238241 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2db815e090 0x7f2db8159130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:33.256 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.247+0000 7f2dbda17700 1 -- 172.21.15.62:0/536238241 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2db815e500 msgr2=0x7f2db80afa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:33.256 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.247+0000 7f2dbda17700 1 --2- 172.21.15.62:0/536238241 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2db815e500 0x7f2db80afa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:33.256 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.247+0000 7f2dbda17700 1 -- 172.21.15.62:0/536238241 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2da8009570 con 0x7f2db8159e10 2023-06-09T04:41:33.256 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.247+0000 7f2dbe218700 1 --2- 172.21.15.62:0/536238241 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2db815e500 0x7f2db80afa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:41:33.256 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.251+0000 7f2dbda17700 1 --2- 172.21.15.62:0/536238241 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2db8159e10 0x7f2db815c680 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2db400eed0 tx=0x7f2db400b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:33.257 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.251+0000 7f2dae7fc700 1 -- 172.21.15.62:0/536238241 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db4010040 con 0x7f2db8159e10 2023-06-09T04:41:33.257 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.251+0000 7f2dae7fc700 1 -- 172.21.15.62:0/536238241 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2db400bdb0 con 0x7f2db8159e10 2023-06-09T04:41:33.257 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.251+0000 7f2dbfc7b700 1 -- 172.21.15.62:0/536238241 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2db815bba0 con 0x7f2db8159e10 2023-06-09T04:41:33.258 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.251+0000 7f2dae7fc700 1 -- 172.21.15.62:0/536238241 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db4014620 con 0x7f2db8159e10 2023-06-09T04:41:33.258 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.251+0000 7f2dbfc7b700 1 -- 172.21.15.62:0/536238241 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2db815c160 con 0x7f2db8159e10 2023-06-09T04:41:33.258 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.251+0000 7f2dbfc7b700 1 -- 172.21.15.62:0/536238241 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2db80739c0 con 0x7f2db8159e10 2023-06-09T04:41:33.258 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.251+0000 7f2dae7fc700 1 -- 172.21.15.62:0/536238241 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2db4014780 con 0x7f2db8159e10 2023-06-09T04:41:33.260 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.255+0000 7f2dae7fc700 1 --2- 172.21.15.62:0/536238241 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f2d9c066320 0x7f2d9c0687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:33.261 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.255+0000 7f2dae7fc700 1 -- 172.21.15.62:0/536238241 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2db4084590 con 0x7f2db8159e10 2023-06-09T04:41:33.261 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.255+0000 7f2dbd216700 1 --2- 172.21.15.62:0/536238241 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f2d9c066320 0x7f2d9c0687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:33.261 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.255+0000 7f2dbd216700 1 --2- 172.21.15.62:0/536238241 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f2d9c066320 0x7f2d9c0687d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2da8009c30 tx=0x7f2da8008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:33.267 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.263+0000 7f2dae7fc700 1 -- 172.21.15.62:0/536238241 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2db4051680 con 0x7f2db8159e10 2023-06-09T04:41:33.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.439+0000 7f2dbfc7b700 1 -- 172.21.15.62:0/536238241 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2db80b0e30 con 0x7f2db8159e10 2023-06-09T04:41:33.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.439+0000 7f2dae7fc700 1 -- 172.21.15.62:0/536238241 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2db4054ca0 con 0x7f2db8159e10 2023-06-09T04:41:33.447 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2023-06-09T04:41:33.452 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.447+0000 7f2dbfc7b700 1 -- 172.21.15.62:0/536238241 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f2d9c066320 msgr2=0x7f2d9c0687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:33.452 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.447+0000 7f2dbfc7b700 1 --2- 172.21.15.62:0/536238241 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f2d9c066320 0x7f2d9c0687d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2da8009c30 tx=0x7f2da8008030 comp rx=0 tx=0).stop 2023-06-09T04:41:33.452 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.447+0000 7f2dbfc7b700 1 -- 172.21.15.62:0/536238241 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2db8159e10 msgr2=0x7f2db815c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:33.452 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.447+0000 7f2dbfc7b700 1 --2- 172.21.15.62:0/536238241 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2db8159e10 0x7f2db815c680 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2db400eed0 tx=0x7f2db400b390 comp rx=0 tx=0).stop 2023-06-09T04:41:33.452 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.447+0000 7f2dbfc7b700 1 -- 172.21.15.62:0/536238241 shutdown_connections 2023-06-09T04:41:33.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.447+0000 7f2dbfc7b700 1 --2- 172.21.15.62:0/536238241 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f2d9c066320 0x7f2d9c0687d0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:33.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.447+0000 7f2dbfc7b700 1 --2- 172.21.15.62:0/536238241 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2db815e500 0x7f2db80afa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:33.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.447+0000 7f2dbfc7b700 1 --2- 172.21.15.62:0/536238241 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2db815e090 0x7f2db8159130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:33.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.447+0000 7f2dbfc7b700 1 --2- 172.21.15.62:0/536238241 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2db8159e10 0x7f2db815c680 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:33.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.447+0000 7f2dbfc7b700 1 -- 172.21.15.62:0/536238241 >> 172.21.15.62:0/536238241 conn(0x7f2db806c5d0 msgr2=0x7f2db8153160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:33.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.447+0000 7f2dbfc7b700 1 -- 172.21.15.62:0/536238241 shutdown_connections 2023-06-09T04:41:33.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.447+0000 7f2dbfc7b700 1 -- 172.21.15.62:0/536238241 wait complete. 2023-06-09T04:41:33.477 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T04:41:33.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.651+0000 7f071b59e700 1 Processor -- start 2023-06-09T04:41:33.656 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.651+0000 7f071b59e700 1 -- start start 2023-06-09T04:41:33.657 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.651+0000 7f071b59e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f071c071730 0x7f071c06f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:33.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.651+0000 7f071b59e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f071c15d860 con 0x7f071c0b0260 2023-06-09T04:41:33.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.651+0000 7f071b59e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f071c071b00 con 0x7f071c0ca1c0 2023-06-09T04:41:33.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.651+0000 7f071b59e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f071c15dab0 con 0x7f071c071730 2023-06-09T04:41:33.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.651+0000 7f071ad9d700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f071c0b0260 0x7f071c0c8720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36256/0 (socket says 172.21.15.62:36256) 2023-06-09T04:41:33.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.651+0000 7f071ad9d700 1 -- 172.21.15.62:0/180769274 learned_addr learned my addr 172.21.15.62:0/180769274 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:41:33.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.651+0000 7f071a59c700 1 --2- 172.21.15.62:0/180769274 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f071c071730 0x7f071c06f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:33.660 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.655+0000 7f0719d9b700 1 -- 172.21.15.62:0/180769274 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2847135395 0 0) 0x7f071c071b00 con 0x7f071c0ca1c0 2023-06-09T04:41:33.660 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.655+0000 7f0719d9b700 1 -- 172.21.15.62:0/180769274 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07080035d0 con 0x7f071c0ca1c0 2023-06-09T04:41:33.660 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.655+0000 7f0719d9b700 1 -- 172.21.15.62:0/180769274 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1849904124 0 0) 0x7f071c15d860 con 0x7f071c0b0260 2023-06-09T04:41:33.660 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.655+0000 7f0719d9b700 1 -- 172.21.15.62:0/180769274 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f071c071b00 con 0x7f071c0b0260 2023-06-09T04:41:33.660 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.655+0000 7f071a59c700 1 -- 172.21.15.62:0/180769274 >> v1:172.21.15.89:6789/0 conn(0x7f071c0ca1c0 legacy=0x7f071c0afb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:33.661 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.655+0000 7f071a59c700 1 -- 172.21.15.62:0/180769274 >> v1:172.21.15.62:6789/0 conn(0x7f071c0b0260 legacy=0x7f071c0c8720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:33.661 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.655+0000 7f071a59c700 1 -- 172.21.15.62:0/180769274 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f071c15dd90 con 0x7f071c071730 2023-06-09T04:41:33.661 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.655+0000 7f071a59c700 1 --2- 172.21.15.62:0/180769274 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f071c071730 0x7f071c06f610 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f070c009dc0 tx=0x7f070c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2943d38da315661 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:33.661 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.655+0000 7f0719d9b700 1 -- 172.21.15.62:0/180769274 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f070c00e070 con 0x7f071c071730 2023-06-09T04:41:33.662 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.655+0000 7f0719d9b700 1 -- 172.21.15.62:0/180769274 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f070c00bb20 con 0x7f071c071730 2023-06-09T04:41:33.662 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.655+0000 7f0719d9b700 1 -- 172.21.15.62:0/180769274 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f070c012430 con 0x7f071c071730 2023-06-09T04:41:33.662 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.655+0000 7f071b59e700 1 -- 172.21.15.62:0/180769274 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f071c071730 msgr2=0x7f071c06f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:33.663 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.655+0000 7f071b59e700 1 --2- 172.21.15.62:0/180769274 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f071c071730 0x7f071c06f610 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f070c009dc0 tx=0x7f070c00b330 comp rx=0 tx=0).stop 2023-06-09T04:41:33.663 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.655+0000 7f071b59e700 1 -- 172.21.15.62:0/180769274 shutdown_connections 2023-06-09T04:41:33.663 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.655+0000 7f071b59e700 1 --2- 172.21.15.62:0/180769274 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f071c071730 0x7f071c06f610 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:33.663 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.655+0000 7f071b59e700 1 -- 172.21.15.62:0/180769274 >> 172.21.15.62:0/180769274 conn(0x7f071c0cab50 msgr2=0x7f071c0caf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:33.663 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.655+0000 7f071b59e700 1 -- 172.21.15.62:0/180769274 shutdown_connections 2023-06-09T04:41:33.663 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.655+0000 7f071b59e700 1 -- 172.21.15.62:0/180769274 wait complete. 2023-06-09T04:41:33.666 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.659+0000 7f071b59e700 1 Processor -- start 2023-06-09T04:41:33.666 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.659+0000 7f071b59e700 1 -- start start 2023-06-09T04:41:33.668 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.663+0000 7f071b59e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f071c071730 0x7f071c15cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:33.669 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.663+0000 7f071b59e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f071c0b0260 0x7f071c1f1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:33.669 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.663+0000 7f071b59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f071c0ca1c0 0x7f071c1f1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:33.669 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.663+0000 7f071b59e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f071c15d2a0 con 0x7f071c0ca1c0 2023-06-09T04:41:33.669 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.663+0000 7f071b59e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f071c15b560 con 0x7f071c071730 2023-06-09T04:41:33.669 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.663+0000 7f071b59e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f071c15b280 con 0x7f071c0b0260 2023-06-09T04:41:33.670 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.663+0000 7f071ad9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f071c0ca1c0 0x7f071c1f1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:33.670 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.663+0000 7f071ad9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f071c0ca1c0 0x7f071c1f1b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53462/0 (socket says 172.21.15.62:53462) 2023-06-09T04:41:33.670 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.663+0000 7f071ad9d700 1 -- 172.21.15.62:0/2029925536 learned_addr learned my addr 172.21.15.62:0/2029925536 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:33.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.663+0000 7f071a59c700 1 --2- 172.21.15.62:0/2029925536 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f071c071730 0x7f071c15cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:33.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.663+0000 7f0711d9b700 1 --2- 172.21.15.62:0/2029925536 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f071c0b0260 0x7f071c1f1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:33.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.663+0000 7f071ad9d700 1 -- 172.21.15.62:0/2029925536 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f071c0b0260 msgr2=0x7f071c1f1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:33.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.663+0000 7f071ad9d700 1 --2- 172.21.15.62:0/2029925536 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f071c0b0260 0x7f071c1f1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:33.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.663+0000 7f071ad9d700 1 -- 172.21.15.62:0/2029925536 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f071c071730 msgr2=0x7f071c15cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:33.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.663+0000 7f071ad9d700 1 --2- 172.21.15.62:0/2029925536 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f071c071730 0x7f071c15cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:33.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.663+0000 7f071ad9d700 1 -- 172.21.15.62:0/2029925536 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f070c009a70 con 0x7f071c0ca1c0 2023-06-09T04:41:33.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.663+0000 7f071ad9d700 1 --2- 172.21.15.62:0/2029925536 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f071c0ca1c0 0x7f071c1f1b80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0714005930 tx=0x7f071400c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:33.672 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.663+0000 7f07137fe700 1 -- 172.21.15.62:0/2029925536 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0714005d90 con 0x7f071c0ca1c0 2023-06-09T04:41:33.672 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.667+0000 7f07137fe700 1 -- 172.21.15.62:0/2029925536 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07140070d0 con 0x7f071c0ca1c0 2023-06-09T04:41:33.672 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.667+0000 7f071b59e700 1 -- 172.21.15.62:0/2029925536 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f071c0c3d40 con 0x7f071c0ca1c0 2023-06-09T04:41:33.673 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.667+0000 7f07137fe700 1 -- 172.21.15.62:0/2029925536 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0714007440 con 0x7f071c0ca1c0 2023-06-09T04:41:33.673 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.667+0000 7f071b59e700 1 -- 172.21.15.62:0/2029925536 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f071c0c4300 con 0x7f071c0ca1c0 2023-06-09T04:41:33.673 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.667+0000 7f071b59e700 1 -- 172.21.15.62:0/2029925536 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f071c0c3b90 con 0x7f071c0ca1c0 2023-06-09T04:41:33.673 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.667+0000 7f07137fe700 1 -- 172.21.15.62:0/2029925536 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f07140075a0 con 0x7f071c0ca1c0 2023-06-09T04:41:33.675 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.671+0000 7f07137fe700 1 --2- 172.21.15.62:0/2029925536 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f06fc066320 0x7f06fc0687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:33.676 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.671+0000 7f07137fe700 1 -- 172.21.15.62:0/2029925536 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0714083250 con 0x7f071c0ca1c0 2023-06-09T04:41:33.676 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.671+0000 7f071a59c700 1 --2- 172.21.15.62:0/2029925536 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f06fc066320 0x7f06fc0687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:33.677 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.671+0000 7f071a59c700 1 --2- 172.21.15.62:0/2029925536 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f06fc066320 0x7f06fc0687d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f070c014040 tx=0x7f070c01e040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:33.681 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.675+0000 7f07137fe700 1 -- 172.21.15.62:0/2029925536 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0714050480 con 0x7f071c0ca1c0 2023-06-09T04:41:33.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.847+0000 7f071b59e700 1 -- 172.21.15.62:0/2029925536 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f071c0739c0 con 0x7f071c0ca1c0 2023-06-09T04:41:33.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.847+0000 7f07137fe700 1 -- 172.21.15.62:0/2029925536 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0714053aa0 con 0x7f071c0ca1c0 2023-06-09T04:41:33.853 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-06-09T04:41:33.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.851+0000 7f071b59e700 1 -- 172.21.15.62:0/2029925536 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f06fc066320 msgr2=0x7f06fc0687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:33.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.851+0000 7f071b59e700 1 --2- 172.21.15.62:0/2029925536 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f06fc066320 0x7f06fc0687d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f070c014040 tx=0x7f070c01e040 comp rx=0 tx=0).stop 2023-06-09T04:41:33.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.851+0000 7f071b59e700 1 -- 172.21.15.62:0/2029925536 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f071c0ca1c0 msgr2=0x7f071c1f1b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:33.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.851+0000 7f071b59e700 1 --2- 172.21.15.62:0/2029925536 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f071c0ca1c0 0x7f071c1f1b80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0714005930 tx=0x7f071400c7d0 comp rx=0 tx=0).stop 2023-06-09T04:41:33.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.851+0000 7f071b59e700 1 -- 172.21.15.62:0/2029925536 shutdown_connections 2023-06-09T04:41:33.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.851+0000 7f071b59e700 1 --2- 172.21.15.62:0/2029925536 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f06fc066320 0x7f06fc0687d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:33.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.851+0000 7f071b59e700 1 --2- 172.21.15.62:0/2029925536 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f071c0ca1c0 0x7f071c1f1b80 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:33.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.851+0000 7f071b59e700 1 --2- 172.21.15.62:0/2029925536 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f071c0b0260 0x7f071c1f1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:33.857 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.851+0000 7f071b59e700 1 --2- 172.21.15.62:0/2029925536 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f071c071730 0x7f071c15cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:33.857 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.851+0000 7f071b59e700 1 -- 172.21.15.62:0/2029925536 >> 172.21.15.62:0/2029925536 conn(0x7f071c0cab50 msgr2=0x7f071c0b1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:33.857 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.851+0000 7f071b59e700 1 -- 172.21.15.62:0/2029925536 shutdown_connections 2023-06-09T04:41:33.857 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:33.851+0000 7f071b59e700 1 -- 172.21.15.62:0/2029925536 wait complete. 2023-06-09T04:41:33.878 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T04:41:34.078 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.071+0000 7f4eaf3bb700 1 Processor -- start 2023-06-09T04:41:34.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.071+0000 7f4eaf3bb700 1 -- start start 2023-06-09T04:41:34.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.075+0000 7f4eaf3bb700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4ea80d1f80 0x7f4ea80b3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:34.083 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.075+0000 7f4eaf3bb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4ea80cebf0 0x7f4ea80ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:34.083 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.075+0000 7f4eaf3bb700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4ea80cd110 0x7f4ea80b2400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:34.083 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.075+0000 7f4eaf3bb700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ea80cd590 con 0x7f4ea80cd110 2023-06-09T04:41:34.083 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.075+0000 7f4eaf3bb700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ea80b4d50 con 0x7f4ea80d1f80 2023-06-09T04:41:34.083 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.075+0000 7f4eaf3bb700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea80cf040 con 0x7f4ea80cebf0 2023-06-09T04:41:34.085 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.079+0000 7f4eaebba700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4ea80cd110 0x7f4ea80b2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:34.085 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.079+0000 7f4eadbb8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4ea80cebf0 0x7f4ea80ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:34.085 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.079+0000 7f4eaebba700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4ea80cd110 0x7f4ea80b2400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53470/0 (socket says 172.21.15.62:53470) 2023-06-09T04:41:34.085 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.079+0000 7f4eaebba700 1 -- 172.21.15.62:0/3594145602 learned_addr learned my addr 172.21.15.62:0/3594145602 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:34.085 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.079+0000 7f4eae3b9700 1 --2- 172.21.15.62:0/3594145602 >> v2:172.21.15.89:3300/0 conn(0x7f4ea80d1f80 0x7f4ea80b3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:34.085 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.079+0000 7f4eaebba700 1 -- 172.21.15.62:0/3594145602 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4ea80cebf0 msgr2=0x7f4ea80ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:34.086 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.079+0000 7f4eaebba700 1 --2- 172.21.15.62:0/3594145602 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4ea80cebf0 0x7f4ea80ccbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:34.086 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.079+0000 7f4eaebba700 1 -- 172.21.15.62:0/3594145602 >> v2:172.21.15.89:3300/0 conn(0x7f4ea80d1f80 msgr2=0x7f4ea80b3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:34.086 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.079+0000 7f4eaebba700 1 --2- 172.21.15.62:0/3594145602 >> v2:172.21.15.89:3300/0 conn(0x7f4ea80d1f80 0x7f4ea80b3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:34.086 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.079+0000 7f4eaebba700 1 -- 172.21.15.62:0/3594145602 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ea80b4140 con 0x7f4ea80cd110 2023-06-09T04:41:34.086 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.079+0000 7f4eaebba700 1 --2- 172.21.15.62:0/3594145602 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ea80cd110 0x7f4ea80b2400 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4ea80b4fd0 tx=0x7f4ea000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ec9d3ce8dbc4333 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:34.086 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.079+0000 7f4ead3b7700 1 -- 172.21.15.62:0/3594145602 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea000e070 con 0x7f4ea80cd110 2023-06-09T04:41:34.086 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.079+0000 7f4ead3b7700 1 -- 172.21.15.62:0/3594145602 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ea000b910 con 0x7f4ea80cd110 2023-06-09T04:41:34.087 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.079+0000 7f4ead3b7700 1 -- 172.21.15.62:0/3594145602 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea000bcc0 con 0x7f4ea80cd110 2023-06-09T04:41:34.087 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.079+0000 7f4eaf3bb700 1 -- 172.21.15.62:0/3594145602 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ea80cd110 msgr2=0x7f4ea80b2400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:34.087 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.079+0000 7f4eaf3bb700 1 --2- 172.21.15.62:0/3594145602 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ea80cd110 0x7f4ea80b2400 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4ea80b4fd0 tx=0x7f4ea000b330 comp rx=0 tx=0).stop 2023-06-09T04:41:34.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.079+0000 7f4eaf3bb700 1 -- 172.21.15.62:0/3594145602 shutdown_connections 2023-06-09T04:41:34.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.079+0000 7f4eaf3bb700 1 --2- 172.21.15.62:0/3594145602 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ea80cd110 0x7f4ea80b2400 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:34.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.079+0000 7f4eaf3bb700 1 --2- 172.21.15.62:0/3594145602 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4ea80cebf0 0x7f4ea80ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:34.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.079+0000 7f4eaf3bb700 1 --2- 172.21.15.62:0/3594145602 >> v2:172.21.15.89:3300/0 conn(0x7f4ea80d1f80 0x7f4ea80b3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:34.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.079+0000 7f4eaf3bb700 1 -- 172.21.15.62:0/3594145602 >> 172.21.15.62:0/3594145602 conn(0x7f4ea8071840 msgr2=0x7f4ea809b760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:34.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.079+0000 7f4eaf3bb700 1 -- 172.21.15.62:0/3594145602 shutdown_connections 2023-06-09T04:41:34.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.079+0000 7f4eaf3bb700 1 -- 172.21.15.62:0/3594145602 wait complete. 2023-06-09T04:41:34.089 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.083+0000 7f4eaf3bb700 1 Processor -- start 2023-06-09T04:41:34.089 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.083+0000 7f4eaf3bb700 1 -- start start 2023-06-09T04:41:34.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.083+0000 7f4eaf3bb700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ea80cd110 0x7f4ea80b7e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:34.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.083+0000 7f4eaf3bb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4ea80cebf0 0x7f4ea80b0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:34.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.083+0000 7f4eaf3bb700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ea80d1f80 0x7f4ea8145420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:34.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.083+0000 7f4eaf3bb700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea80b79b0 con 0x7f4ea80cd110 2023-06-09T04:41:34.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.083+0000 7f4eaf3bb700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea80b6da0 con 0x7f4ea80d1f80 2023-06-09T04:41:34.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.083+0000 7f4eaf3bb700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea80b7080 con 0x7f4ea80cebf0 2023-06-09T04:41:34.092 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.083+0000 7f4eae3b9700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ea80cd110 0x7f4ea80b7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:34.092 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.083+0000 7f4eae3b9700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ea80cd110 0x7f4ea80b7e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53478/0 (socket says 172.21.15.62:53478) 2023-06-09T04:41:34.092 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.083+0000 7f4eae3b9700 1 -- 172.21.15.62:0/3420190635 learned_addr learned my addr 172.21.15.62:0/3420190635 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:34.092 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.083+0000 7f4eaebba700 1 --2- 172.21.15.62:0/3420190635 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ea80d1f80 0x7f4ea8145420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:34.092 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.083+0000 7f4eadbb8700 1 --2- 172.21.15.62:0/3420190635 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4ea80cebf0 0x7f4ea80b0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:34.092 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.083+0000 7f4eae3b9700 1 -- 172.21.15.62:0/3420190635 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4ea80cebf0 msgr2=0x7f4ea80b0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:34.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.083+0000 7f4eae3b9700 1 --2- 172.21.15.62:0/3420190635 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4ea80cebf0 0x7f4ea80b0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:34.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.083+0000 7f4eae3b9700 1 -- 172.21.15.62:0/3420190635 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ea80d1f80 msgr2=0x7f4ea8145420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:34.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.083+0000 7f4eae3b9700 1 --2- 172.21.15.62:0/3420190635 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ea80d1f80 0x7f4ea8145420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:34.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.083+0000 7f4eae3b9700 1 -- 172.21.15.62:0/3420190635 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ea0009b30 con 0x7f4ea80cd110 2023-06-09T04:41:34.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.087+0000 7f4eaebba700 1 --2- 172.21.15.62:0/3420190635 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ea80d1f80 0x7f4ea8145420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:41:34.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.087+0000 7f4eadbb8700 1 --2- 172.21.15.62:0/3420190635 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4ea80cebf0 0x7f4ea80b0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:41:34.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.087+0000 7f4eae3b9700 1 --2- 172.21.15.62:0/3420190635 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ea80cd110 0x7f4ea80b7e40 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4ea400e9b0 tx=0x7f4ea400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:34.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.087+0000 7f4e9effd700 1 -- 172.21.15.62:0/3420190635 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea4009670 con 0x7f4ea80cd110 2023-06-09T04:41:34.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.087+0000 7f4e9effd700 1 -- 172.21.15.62:0/3420190635 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ea400c850 con 0x7f4ea80cd110 2023-06-09T04:41:34.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.087+0000 7f4e9effd700 1 -- 172.21.15.62:0/3420190635 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea400cbc0 con 0x7f4ea80cd110 2023-06-09T04:41:34.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.087+0000 7f4eaf3bb700 1 -- 172.21.15.62:0/3420190635 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ea80b7360 con 0x7f4ea80cd110 2023-06-09T04:41:34.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.087+0000 7f4eaf3bb700 1 -- 172.21.15.62:0/3420190635 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ea80b1060 con 0x7f4ea80cd110 2023-06-09T04:41:34.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.087+0000 7f4eaf3bb700 1 -- 172.21.15.62:0/3420190635 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ea80739c0 con 0x7f4ea80cd110 2023-06-09T04:41:34.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.091+0000 7f4e9effd700 1 -- 172.21.15.62:0/3420190635 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4ea400cd20 con 0x7f4ea80cd110 2023-06-09T04:41:34.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.091+0000 7f4e9effd700 1 --2- 172.21.15.62:0/3420190635 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f4e8c066320 0x7f4e8c0687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:34.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.091+0000 7f4e9effd700 1 -- 172.21.15.62:0/3420190635 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4ea40843e0 con 0x7f4ea80cd110 2023-06-09T04:41:34.098 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.091+0000 7f4eadbb8700 1 --2- 172.21.15.62:0/3420190635 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f4e8c066320 0x7f4e8c0687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:34.099 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.095+0000 7f4eadbb8700 1 --2- 172.21.15.62:0/3420190635 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f4e8c066320 0x7f4e8c0687d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4ea80b1800 tx=0x7f4e98008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:34.103 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.095+0000 7f4e9effd700 1 -- 172.21.15.62:0/3420190635 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4ea4051560 con 0x7f4ea80cd110 2023-06-09T04:41:34.273 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.267+0000 7f4eaf3bb700 1 -- 172.21.15.62:0/3420190635 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4ea80b46d0 con 0x7f4ea80cd110 2023-06-09T04:41:34.274 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.267+0000 7f4e9effd700 1 -- 172.21.15.62:0/3420190635 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4ea4054b80 con 0x7f4ea80cd110 2023-06-09T04:41:34.274 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 64 2023-06-09T04:41:34.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.271+0000 7f4eaf3bb700 1 -- 172.21.15.62:0/3420190635 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f4e8c066320 msgr2=0x7f4e8c0687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:34.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.271+0000 7f4eaf3bb700 1 --2- 172.21.15.62:0/3420190635 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f4e8c066320 0x7f4e8c0687d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4ea80b1800 tx=0x7f4e98008040 comp rx=0 tx=0).stop 2023-06-09T04:41:34.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.271+0000 7f4eaf3bb700 1 -- 172.21.15.62:0/3420190635 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ea80cd110 msgr2=0x7f4ea80b7e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:34.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.271+0000 7f4eaf3bb700 1 --2- 172.21.15.62:0/3420190635 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ea80cd110 0x7f4ea80b7e40 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4ea400e9b0 tx=0x7f4ea400ed70 comp rx=0 tx=0).stop 2023-06-09T04:41:34.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.271+0000 7f4eaf3bb700 1 -- 172.21.15.62:0/3420190635 shutdown_connections 2023-06-09T04:41:34.278 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.271+0000 7f4eaf3bb700 1 --2- 172.21.15.62:0/3420190635 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f4e8c066320 0x7f4e8c0687d0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:34.278 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.271+0000 7f4eaf3bb700 1 --2- 172.21.15.62:0/3420190635 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ea80d1f80 0x7f4ea8145420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:34.278 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.271+0000 7f4eaf3bb700 1 --2- 172.21.15.62:0/3420190635 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4ea80cebf0 0x7f4ea80b0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:34.278 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.271+0000 7f4eaf3bb700 1 --2- 172.21.15.62:0/3420190635 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ea80cd110 0x7f4ea80b7e40 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:34.278 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.271+0000 7f4eaf3bb700 1 -- 172.21.15.62:0/3420190635 >> 172.21.15.62:0/3420190635 conn(0x7f4ea8071840 msgr2=0x7f4ea80cf200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:34.278 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.271+0000 7f4eaf3bb700 1 -- 172.21.15.62:0/3420190635 shutdown_connections 2023-06-09T04:41:34.279 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.271+0000 7f4eaf3bb700 1 -- 172.21.15.62:0/3420190635 wait complete. 2023-06-09T04:41:34.297 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-09T04:41:34.473 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.467+0000 7f254abeb700 1 Processor -- start 2023-06-09T04:41:34.474 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.467+0000 7f254abeb700 1 -- start start 2023-06-09T04:41:34.476 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.471+0000 7f254abeb700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f254415ab60 0x7f25440ca8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:34.477 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.471+0000 7f254abeb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f25440ccc90 0x7f254415c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:34.477 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.471+0000 7f254abeb700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25440cd670 con 0x7f25440b55b0 2023-06-09T04:41:34.477 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.471+0000 7f254abeb700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25440cd110 con 0x7f254415ab60 2023-06-09T04:41:34.477 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.471+0000 7f254abeb700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25440cd390 con 0x7f25440ccc90 2023-06-09T04:41:34.478 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.471+0000 7f25493e8700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f254415ab60 0x7f25440ca8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:34.478 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.471+0000 7f25493e8700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f254415ab60 0x7f25440ca8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53482/0 (socket says 172.21.15.62:53482) 2023-06-09T04:41:34.478 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.471+0000 7f25493e8700 1 -- 172.21.15.62:0/3176277154 learned_addr learned my addr 172.21.15.62:0/3176277154 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:34.478 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.471+0000 7f254a3ea700 1 --2- 172.21.15.62:0/3176277154 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f25440ccc90 0x7f254415c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:34.478 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.471+0000 7f25493e8700 1 -- 172.21.15.62:0/3176277154 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f25440ccc90 msgr2=0x7f254415c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:34.478 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.471+0000 7f25493e8700 1 --2- 172.21.15.62:0/3176277154 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f25440ccc90 0x7f254415c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:34.479 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.471+0000 7f25493e8700 1 -- 172.21.15.62:0/3176277154 >> v1:172.21.15.89:6789/0 conn(0x7f25440b55b0 legacy=0x7f254415a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:34.479 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.471+0000 7f25493e8700 1 -- 172.21.15.62:0/3176277154 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f254415b730 con 0x7f254415ab60 2023-06-09T04:41:34.479 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.471+0000 7f25493e8700 1 --2- 172.21.15.62:0/3176277154 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f254415ab60 0x7f25440ca8b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2534009910 tx=0x7f2534009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73631a4f111dc670 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:34.479 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.471+0000 7f2548be7700 1 -- 172.21.15.62:0/3176277154 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f253400ba60 con 0x7f254415ab60 2023-06-09T04:41:34.479 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.471+0000 7f2548be7700 1 -- 172.21.15.62:0/3176277154 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f253400bbc0 con 0x7f254415ab60 2023-06-09T04:41:34.480 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.471+0000 7f2548be7700 1 -- 172.21.15.62:0/3176277154 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2534009e60 con 0x7f254415ab60 2023-06-09T04:41:34.480 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.475+0000 7f254abeb700 1 -- 172.21.15.62:0/3176277154 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f254415ab60 msgr2=0x7f25440ca8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:34.480 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.475+0000 7f254abeb700 1 --2- 172.21.15.62:0/3176277154 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f254415ab60 0x7f25440ca8b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2534009910 tx=0x7f2534009c20 comp rx=0 tx=0).stop 2023-06-09T04:41:34.481 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.475+0000 7f254abeb700 1 -- 172.21.15.62:0/3176277154 shutdown_connections 2023-06-09T04:41:34.481 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.475+0000 7f254abeb700 1 --2- 172.21.15.62:0/3176277154 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f254415ab60 0x7f25440ca8b0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:34.481 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.475+0000 7f254abeb700 1 --2- 172.21.15.62:0/3176277154 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f25440ccc90 0x7f254415c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:34.481 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.475+0000 7f254abeb700 1 -- 172.21.15.62:0/3176277154 >> 172.21.15.62:0/3176277154 conn(0x7f254406d830 msgr2=0x7f254406dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:34.481 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.475+0000 7f254abeb700 1 -- 172.21.15.62:0/3176277154 shutdown_connections 2023-06-09T04:41:34.481 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.475+0000 7f254abeb700 1 -- 172.21.15.62:0/3176277154 wait complete. 2023-06-09T04:41:34.482 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.475+0000 7f254abeb700 1 Processor -- start 2023-06-09T04:41:34.482 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.475+0000 7f254abeb700 1 -- start start 2023-06-09T04:41:34.483 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.479+0000 7f254abeb700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25440b55b0 0x7f25440ada80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:34.484 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.479+0000 7f254abeb700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f25440ccc90 0x7f25441f2450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:34.484 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.479+0000 7f254abeb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f254415ab60 0x7f25440b4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:34.484 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.479+0000 7f254abeb700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f254415cb60 con 0x7f25440ccc90 2023-06-09T04:41:34.484 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.479+0000 7f254abeb700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25440adfc0 con 0x7f25440b55b0 2023-06-09T04:41:34.484 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.479+0000 7f254abeb700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25441517d0 con 0x7f254415ab60 2023-06-09T04:41:34.485 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.479+0000 7f25493e8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f25440ccc90 0x7f25441f2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:34.485 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.479+0000 7f25493e8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f25440ccc90 0x7f25441f2450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53494/0 (socket says 172.21.15.62:53494) 2023-06-09T04:41:34.486 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.479+0000 7f25493e8700 1 -- 172.21.15.62:0/37011092 learned_addr learned my addr 172.21.15.62:0/37011092 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:34.486 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.479+0000 7f2549be9700 1 --2- 172.21.15.62:0/37011092 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25440b55b0 0x7f25440ada80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:34.486 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.479+0000 7f254a3ea700 1 --2- 172.21.15.62:0/37011092 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f254415ab60 0x7f25440b4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:34.486 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.479+0000 7f25493e8700 1 -- 172.21.15.62:0/37011092 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f254415ab60 msgr2=0x7f25440b4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:34.486 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.479+0000 7f25493e8700 1 --2- 172.21.15.62:0/37011092 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f254415ab60 0x7f25440b4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:34.486 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.479+0000 7f25493e8700 1 -- 172.21.15.62:0/37011092 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25440b55b0 msgr2=0x7f25440ada80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:34.486 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.479+0000 7f25493e8700 1 --2- 172.21.15.62:0/37011092 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25440b55b0 0x7f25440ada80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:34.487 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.479+0000 7f25493e8700 1 -- 172.21.15.62:0/37011092 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2534009570 con 0x7f25440ccc90 2023-06-09T04:41:34.487 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.479+0000 7f254a3ea700 1 --2- 172.21.15.62:0/37011092 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f254415ab60 0x7f25440b4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:41:34.487 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.479+0000 7f2549be9700 1 --2- 172.21.15.62:0/37011092 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25440b55b0 0x7f25440ada80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:41:34.487 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.479+0000 7f25493e8700 1 --2- 172.21.15.62:0/37011092 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f25440ccc90 0x7f25441f2450 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f254406a700 tx=0x7f2534004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:34.487 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.479+0000 7f253a7fc700 1 -- 172.21.15.62:0/37011092 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2534004610 con 0x7f25440ccc90 2023-06-09T04:41:34.487 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.479+0000 7f253a7fc700 1 -- 172.21.15.62:0/37011092 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f253401f070 con 0x7f25440ccc90 2023-06-09T04:41:34.487 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.479+0000 7f254abeb700 1 -- 172.21.15.62:0/37011092 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2544151ab0 con 0x7f25440ccc90 2023-06-09T04:41:34.487 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.479+0000 7f253a7fc700 1 -- 172.21.15.62:0/37011092 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2534003900 con 0x7f25440ccc90 2023-06-09T04:41:34.488 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.479+0000 7f254abeb700 1 -- 172.21.15.62:0/37011092 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25441f1f30 con 0x7f25440ccc90 2023-06-09T04:41:34.488 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.483+0000 7f254abeb700 1 -- 172.21.15.62:0/37011092 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25440739c0 con 0x7f25440ccc90 2023-06-09T04:41:34.489 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.483+0000 7f253a7fc700 1 -- 172.21.15.62:0/37011092 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2534003a60 con 0x7f25440ccc90 2023-06-09T04:41:34.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.483+0000 7f253a7fc700 1 --2- 172.21.15.62:0/37011092 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f2528066320 0x7f25280687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:34.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.487+0000 7f253a7fc700 1 -- 172.21.15.62:0/37011092 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2534021070 con 0x7f25440ccc90 2023-06-09T04:41:34.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.487+0000 7f2549be9700 1 --2- 172.21.15.62:0/37011092 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f2528066320 0x7f25280687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:34.492 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.487+0000 7f2549be9700 1 --2- 172.21.15.62:0/37011092 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f2528066320 0x7f25280687d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2540000f60 tx=0x7f2540009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:34.497 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.491+0000 7f253a7fc700 1 -- 172.21.15.62:0/37011092 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2534052a20 con 0x7f25440ccc90 2023-06-09T04:41:34.676 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.671+0000 7f254abeb700 1 -- 172.21.15.62:0/37011092 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f25441f2120 con 0x7f25440ccc90 2023-06-09T04:41:34.677 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.671+0000 7f253a7fc700 1 -- 172.21.15.62:0/37011092 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f2534056040 con 0x7f25440ccc90 2023-06-09T04:41:34.677 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-06-09T04:41:34.679 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.675+0000 7f254abeb700 1 -- 172.21.15.62:0/37011092 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f2528066320 msgr2=0x7f25280687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:34.680 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.675+0000 7f254abeb700 1 --2- 172.21.15.62:0/37011092 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f2528066320 0x7f25280687d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2540000f60 tx=0x7f2540009040 comp rx=0 tx=0).stop 2023-06-09T04:41:34.680 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.675+0000 7f254abeb700 1 -- 172.21.15.62:0/37011092 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f25440ccc90 msgr2=0x7f25441f2450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:34.680 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.675+0000 7f254abeb700 1 --2- 172.21.15.62:0/37011092 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f25440ccc90 0x7f25441f2450 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f254406a700 tx=0x7f2534004770 comp rx=0 tx=0).stop 2023-06-09T04:41:34.681 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.675+0000 7f254abeb700 1 -- 172.21.15.62:0/37011092 shutdown_connections 2023-06-09T04:41:34.681 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.675+0000 7f254abeb700 1 --2- 172.21.15.62:0/37011092 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f2528066320 0x7f25280687d0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:34.681 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.675+0000 7f254abeb700 1 --2- 172.21.15.62:0/37011092 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f254415ab60 0x7f25440b4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:34.681 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.675+0000 7f254abeb700 1 --2- 172.21.15.62:0/37011092 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f25440ccc90 0x7f25441f2450 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:34.681 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.675+0000 7f254abeb700 1 --2- 172.21.15.62:0/37011092 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25440b55b0 0x7f25440ada80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:34.681 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.675+0000 7f254abeb700 1 -- 172.21.15.62:0/37011092 >> 172.21.15.62:0/37011092 conn(0x7f254406d830 msgr2=0x7f254415a450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:34.681 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.675+0000 7f254abeb700 1 -- 172.21.15.62:0/37011092 shutdown_connections 2023-06-09T04:41:34.682 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.675+0000 7f254abeb700 1 -- 172.21.15.62:0/37011092 wait complete. 2023-06-09T04:41:34.701 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-09T04:41:34.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.871+0000 7fe39c8ee700 1 Processor -- start 2023-06-09T04:41:34.879 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.871+0000 7fe39c8ee700 1 -- start start 2023-06-09T04:41:34.880 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.875+0000 7fe39c8ee700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe3980cb850 0x7fe3980ca160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:34.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.875+0000 7fe39c8ee700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe39806f9b0 con 0x7fe398159c90 2023-06-09T04:41:34.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.875+0000 7fe39c8ee700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe39815a060 con 0x7fe3980b08d0 2023-06-09T04:41:34.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.875+0000 7fe39c8ee700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe39806b960 con 0x7fe3980cb850 2023-06-09T04:41:34.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.875+0000 7fe39659c700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fe398159c90 0x7fe398070e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36262/0 (socket says 172.21.15.62:36262) 2023-06-09T04:41:34.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.875+0000 7fe39659c700 1 -- 172.21.15.62:0/687888640 learned_addr learned my addr 172.21.15.62:0/687888640 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:41:34.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.875+0000 7fe395d9b700 1 --2- 172.21.15.62:0/687888640 >> v2:172.21.15.62:3300/0 conn(0x7fe3980cb850 0x7fe3980ca160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:34.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.875+0000 7fe39559a700 1 -- 172.21.15.62:0/687888640 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3360237293 0 0) 0x7fe39806f9b0 con 0x7fe398159c90 2023-06-09T04:41:34.883 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.875+0000 7fe39559a700 1 -- 172.21.15.62:0/687888640 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3800035d0 con 0x7fe398159c90 2023-06-09T04:41:34.883 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.875+0000 7fe395d9b700 1 -- 172.21.15.62:0/687888640 >> v1:172.21.15.89:6789/0 conn(0x7fe3980b08d0 legacy=0x7fe3980ca6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:34.883 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.875+0000 7fe395d9b700 1 -- 172.21.15.62:0/687888640 >> v1:172.21.15.62:6789/0 conn(0x7fe398159c90 legacy=0x7fe398070e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:34.883 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.875+0000 7fe395d9b700 1 -- 172.21.15.62:0/687888640 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3980c89e0 con 0x7fe3980cb850 2023-06-09T04:41:34.883 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.875+0000 7fe395d9b700 1 --2- 172.21.15.62:0/687888640 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3980cb850 0x7fe3980ca160 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe38c009850 tx=0x7fe38c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92844d1d0db68337 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:34.884 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.879+0000 7fe39559a700 1 -- 172.21.15.62:0/687888640 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38c011830 con 0x7fe3980cb850 2023-06-09T04:41:34.884 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.879+0000 7fe39559a700 1 -- 172.21.15.62:0/687888640 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe38c011990 con 0x7fe3980cb850 2023-06-09T04:41:34.884 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.879+0000 7fe39559a700 1 -- 172.21.15.62:0/687888640 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38c011d40 con 0x7fe3980cb850 2023-06-09T04:41:34.884 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.879+0000 7fe39c8ee700 1 -- 172.21.15.62:0/687888640 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3980cb850 msgr2=0x7fe3980ca160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:34.884 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.879+0000 7fe39c8ee700 1 --2- 172.21.15.62:0/687888640 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3980cb850 0x7fe3980ca160 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe38c009850 tx=0x7fe38c009b60 comp rx=0 tx=0).stop 2023-06-09T04:41:34.885 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.879+0000 7fe39c8ee700 1 -- 172.21.15.62:0/687888640 shutdown_connections 2023-06-09T04:41:34.885 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.879+0000 7fe39c8ee700 1 --2- 172.21.15.62:0/687888640 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3980cb850 0x7fe3980ca160 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:34.885 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.879+0000 7fe39c8ee700 1 -- 172.21.15.62:0/687888640 >> 172.21.15.62:0/687888640 conn(0x7fe39806a410 msgr2=0x7fe3980afd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:34.886 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.879+0000 7fe39c8ee700 1 -- 172.21.15.62:0/687888640 shutdown_connections 2023-06-09T04:41:34.886 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.879+0000 7fe39c8ee700 1 -- 172.21.15.62:0/687888640 wait complete. 2023-06-09T04:41:34.887 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.883+0000 7fe39c8ee700 1 Processor -- start 2023-06-09T04:41:34.887 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.883+0000 7fe39c8ee700 1 -- start start 2023-06-09T04:41:34.888 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.883+0000 7fe39c8ee700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3980b08d0 0x7fe39814a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:34.889 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.883+0000 7fe39c8ee700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3980cb850 0x7fe3980cbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:34.889 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.883+0000 7fe39c8ee700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe398159c90 0x7fe3980aebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:34.889 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.883+0000 7fe39c8ee700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3980c6680 con 0x7fe3980b08d0 2023-06-09T04:41:34.889 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.883+0000 7fe39c8ee700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3980c57d0 con 0x7fe398159c90 2023-06-09T04:41:34.889 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.883+0000 7fe39c8ee700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe39814ad20 con 0x7fe3980cb850 2023-06-09T04:41:34.890 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.883+0000 7fe39659c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3980b08d0 0x7fe39814a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:34.890 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.883+0000 7fe39659c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3980b08d0 0x7fe39814a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53508/0 (socket says 172.21.15.62:53508) 2023-06-09T04:41:34.890 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.883+0000 7fe39659c700 1 -- 172.21.15.62:0/1944439081 learned_addr learned my addr 172.21.15.62:0/1944439081 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:34.891 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.883+0000 7fe395d9b700 1 --2- 172.21.15.62:0/1944439081 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3980cb850 0x7fe3980cbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:34.891 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.883+0000 7fe39659c700 1 -- 172.21.15.62:0/1944439081 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3980cb850 msgr2=0x7fe3980cbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:34.891 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.883+0000 7fe39659c700 1 --2- 172.21.15.62:0/1944439081 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3980cb850 0x7fe3980cbdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:34.891 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.883+0000 7fe39659c700 1 -- 172.21.15.62:0/1944439081 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe398159c90 msgr2=0x7fe3980aebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:34.891 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.883+0000 7fe396d9d700 1 --2- 172.21.15.62:0/1944439081 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe398159c90 0x7fe3980aebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:34.891 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.883+0000 7fe39659c700 1 --2- 172.21.15.62:0/1944439081 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe398159c90 0x7fe3980aebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:34.891 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.883+0000 7fe39659c700 1 -- 172.21.15.62:0/1944439081 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe38c0094b0 con 0x7fe3980b08d0 2023-06-09T04:41:34.891 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.883+0000 7fe396d9d700 1 --2- 172.21.15.62:0/1944439081 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe398159c90 0x7fe3980aebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:41:34.892 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.883+0000 7fe39659c700 1 --2- 172.21.15.62:0/1944439081 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3980b08d0 0x7fe39814a7e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe38800c4d0 tx=0x7fe38800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:34.892 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.883+0000 7fe386ffd700 1 -- 172.21.15.62:0/1944439081 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe388005d90 con 0x7fe3980b08d0 2023-06-09T04:41:34.892 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.883+0000 7fe39c8ee700 1 -- 172.21.15.62:0/1944439081 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3980c6300 con 0x7fe3980b08d0 2023-06-09T04:41:34.893 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.883+0000 7fe386ffd700 1 -- 172.21.15.62:0/1944439081 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3880070d0 con 0x7fe3980b08d0 2023-06-09T04:41:34.893 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.883+0000 7fe386ffd700 1 -- 172.21.15.62:0/1944439081 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe388007480 con 0x7fe3980b08d0 2023-06-09T04:41:34.893 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.887+0000 7fe39c8ee700 1 -- 172.21.15.62:0/1944439081 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3980ccb60 con 0x7fe3980b08d0 2023-06-09T04:41:34.893 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.887+0000 7fe39c8ee700 1 -- 172.21.15.62:0/1944439081 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe39804db30 con 0x7fe3980b08d0 2023-06-09T04:41:34.894 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.887+0000 7fe386ffd700 1 -- 172.21.15.62:0/1944439081 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe3880075e0 con 0x7fe3980b08d0 2023-06-09T04:41:34.895 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.891+0000 7fe386ffd700 1 --2- 172.21.15.62:0/1944439081 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fe3780662f0 0x7fe3780687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:34.895 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.891+0000 7fe386ffd700 1 -- 172.21.15.62:0/1944439081 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe3880836c0 con 0x7fe3980b08d0 2023-06-09T04:41:34.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.891+0000 7fe395d9b700 1 --2- 172.21.15.62:0/1944439081 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fe3780662f0 0x7fe3780687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:34.897 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.891+0000 7fe395d9b700 1 --2- 172.21.15.62:0/1944439081 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fe3780662f0 0x7fe3780687a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe38c0097a0 tx=0x7fe38c008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:34.902 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:34.895+0000 7fe386ffd700 1 -- 172.21.15.62:0/1944439081 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe388050730 con 0x7fe3980b08d0 2023-06-09T04:41:35.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.099+0000 7fe39c8ee700 1 -- 172.21.15.62:0/1944439081 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe3980b0640 con 0x7fe3980b08d0 2023-06-09T04:41:35.106 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.099+0000 7fe386ffd700 1 -- 172.21.15.62:0/1944439081 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4664 (secure 0 0 0) 0x7fe388053d50 con 0x7fe3980b08d0 2023-06-09T04:41:35.106 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:41:35.106 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4256,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/2242182358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2242182358},{"type":"v1","addr":"172.21.15.89:6836","nonce":2242182358}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6834/326702802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":326702802},{"type":"v1","addr":"172.21.15.62:6834","nonce":326702802}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4296,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/3851882562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":3851882562},{"type":"v1","addr":"172.21.15.62:6835","nonce":3851882562}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-09T04:40:56.758756+0000","modified":"2023-06-09T04:41:23.381650+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4312},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4312":{"gid":4312,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6837/1496954959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1496954959},{"type":"v1","addr":"172.21.15.89:6837","nonce":1496954959}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-09T04:41:35.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.103+0000 7fe39c8ee700 1 -- 172.21.15.62:0/1944439081 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fe3780662f0 msgr2=0x7fe3780687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:35.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.103+0000 7fe39c8ee700 1 --2- 172.21.15.62:0/1944439081 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fe3780662f0 0x7fe3780687a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe38c0097a0 tx=0x7fe38c008030 comp rx=0 tx=0).stop 2023-06-09T04:41:35.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.103+0000 7fe39c8ee700 1 -- 172.21.15.62:0/1944439081 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3980b08d0 msgr2=0x7fe39814a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:35.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.103+0000 7fe39c8ee700 1 --2- 172.21.15.62:0/1944439081 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3980b08d0 0x7fe39814a7e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe38800c4d0 tx=0x7fe38800c890 comp rx=0 tx=0).stop 2023-06-09T04:41:35.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.103+0000 7fe39c8ee700 1 -- 172.21.15.62:0/1944439081 shutdown_connections 2023-06-09T04:41:35.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.103+0000 7fe39c8ee700 1 --2- 172.21.15.62:0/1944439081 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fe3780662f0 0x7fe3780687a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:35.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.103+0000 7fe39c8ee700 1 --2- 172.21.15.62:0/1944439081 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe398159c90 0x7fe3980aebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:35.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.103+0000 7fe39c8ee700 1 --2- 172.21.15.62:0/1944439081 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe3980cb850 0x7fe3980cbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:35.110 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.103+0000 7fe39c8ee700 1 --2- 172.21.15.62:0/1944439081 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe3980b08d0 0x7fe39814a7e0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:35.110 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.103+0000 7fe39c8ee700 1 -- 172.21.15.62:0/1944439081 >> 172.21.15.62:0/1944439081 conn(0x7fe39806a410 msgr2=0x7fe398157640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:35.110 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.103+0000 7fe39c8ee700 1 -- 172.21.15.62:0/1944439081 shutdown_connections 2023-06-09T04:41:35.110 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.103+0000 7fe39c8ee700 1 -- 172.21.15.62:0/1944439081 wait complete. 2023-06-09T04:41:35.111 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 9 2023-06-09T04:41:35.131 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:41:35.301 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.295+0000 7f38da997700 1 Processor -- start 2023-06-09T04:41:35.301 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.295+0000 7f38da997700 1 -- start start 2023-06-09T04:41:35.303 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.299+0000 7f38da997700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38d4159b80 0x7f38d40cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:35.303 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.299+0000 7f38da997700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f38d40af760 0x7f38d40ce280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:35.303 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.299+0000 7f38da997700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38d40acd40 con 0x7f38d40af1a0 2023-06-09T04:41:35.303 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.299+0000 7f38da997700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38d4159f50 con 0x7f38d40af760 2023-06-09T04:41:35.304 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.299+0000 7f38da997700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38d406f070 con 0x7f38d4159b80 2023-06-09T04:41:35.304 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.299+0000 7f38d9194700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f38d40af760 0x7f38d40ce280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:35.305 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.299+0000 7f38d9194700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f38d40af760 0x7f38d40ce280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53518/0 (socket says 172.21.15.62:53518) 2023-06-09T04:41:35.305 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.299+0000 7f38d9194700 1 -- 172.21.15.62:0/3547946285 learned_addr learned my addr 172.21.15.62:0/3547946285 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:35.305 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.299+0000 7f38d9995700 1 --2- 172.21.15.62:0/3547946285 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38d4159b80 0x7f38d40cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:35.305 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.299+0000 7f38d9194700 1 -- 172.21.15.62:0/3547946285 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38d4159b80 msgr2=0x7f38d40cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:35.305 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.299+0000 7f38d9194700 1 --2- 172.21.15.62:0/3547946285 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38d4159b80 0x7f38d40cdd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:35.306 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.299+0000 7f38d9194700 1 -- 172.21.15.62:0/3547946285 >> v1:172.21.15.62:6789/0 conn(0x7f38d40af1a0 legacy=0x7f38d406d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:35.306 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.299+0000 7f38d9194700 1 -- 172.21.15.62:0/3547946285 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38d40acf90 con 0x7f38d40af760 2023-06-09T04:41:35.306 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.299+0000 7f38d8993700 1 -- 172.21.15.62:0/3547946285 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2737909050 0 0) 0x7f38d40acd40 con 0x7f38d40af1a0 2023-06-09T04:41:35.306 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.299+0000 7f38d9194700 1 --2- 172.21.15.62:0/3547946285 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38d40af760 0x7f38d40ce280 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f38c4009940 tx=0x7f38c4009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a7993f0fddacc20 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:35.306 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.299+0000 7f38d8993700 1 -- 172.21.15.62:0/3547946285 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c4011830 con 0x7f38d40af760 2023-06-09T04:41:35.307 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.299+0000 7f38d8993700 1 -- 172.21.15.62:0/3547946285 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38c4011990 con 0x7f38d40af760 2023-06-09T04:41:35.307 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.299+0000 7f38d8993700 1 -- 172.21.15.62:0/3547946285 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c4011d20 con 0x7f38d40af760 2023-06-09T04:41:35.307 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.299+0000 7f38da997700 1 -- 172.21.15.62:0/3547946285 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38d40af760 msgr2=0x7f38d40ce280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:35.307 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.299+0000 7f38da997700 1 --2- 172.21.15.62:0/3547946285 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38d40af760 0x7f38d40ce280 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f38c4009940 tx=0x7f38c4009c50 comp rx=0 tx=0).stop 2023-06-09T04:41:35.308 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.299+0000 7f38da997700 1 -- 172.21.15.62:0/3547946285 shutdown_connections 2023-06-09T04:41:35.308 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.299+0000 7f38da997700 1 --2- 172.21.15.62:0/3547946285 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38d40af760 0x7f38d40ce280 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:35.308 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.299+0000 7f38da997700 1 --2- 172.21.15.62:0/3547946285 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38d4159b80 0x7f38d40cdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:35.308 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.299+0000 7f38da997700 1 -- 172.21.15.62:0/3547946285 >> 172.21.15.62:0/3547946285 conn(0x7f38d40994e0 msgr2=0x7f38d40d0170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:35.308 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.299+0000 7f38da997700 1 -- 172.21.15.62:0/3547946285 shutdown_connections 2023-06-09T04:41:35.308 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.303+0000 7f38da997700 1 -- 172.21.15.62:0/3547946285 wait complete. 2023-06-09T04:41:35.309 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.303+0000 7f38da997700 1 Processor -- start 2023-06-09T04:41:35.309 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.303+0000 7f38da997700 1 -- start start 2023-06-09T04:41:35.310 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.303+0000 7f38da997700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38d40af1a0 0x7f38d41e3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:35.311 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.303+0000 7f38da997700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38d40af760 0x7f38d40cc920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:35.311 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.303+0000 7f38da997700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38d4159b80 0x7f38d40b2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:35.311 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.303+0000 7f38da997700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d41e30a0 con 0x7f38d40af1a0 2023-06-09T04:41:35.311 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.303+0000 7f38da997700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d41e24d0 con 0x7f38d40af760 2023-06-09T04:41:35.311 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.303+0000 7f38da997700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38d41e2770 con 0x7f38d4159b80 2023-06-09T04:41:35.312 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.307+0000 7f38d9995700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38d40af1a0 0x7f38d41e3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:35.312 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.307+0000 7f38d9194700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38d40af760 0x7f38d40cc920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:35.312 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.307+0000 7f38d9194700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38d40af760 0x7f38d40cc920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.62:48934/0 (socket says 172.21.15.62:48934) 2023-06-09T04:41:35.313 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.307+0000 7f38d9995700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38d40af1a0 0x7f38d41e3530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53520/0 (socket says 172.21.15.62:53520) 2023-06-09T04:41:35.313 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.307+0000 7f38d9194700 1 -- 172.21.15.62:0/1066091723 learned_addr learned my addr 172.21.15.62:0/1066091723 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:35.313 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.307+0000 7f38da196700 1 --2- 172.21.15.62:0/1066091723 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38d4159b80 0x7f38d40b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:35.313 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.307+0000 7f38d9194700 1 -- 172.21.15.62:0/1066091723 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38d4159b80 msgr2=0x7f38d40b2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:35.313 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.307+0000 7f38d9194700 1 --2- 172.21.15.62:0/1066091723 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38d4159b80 0x7f38d40b2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:35.313 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.307+0000 7f38d9194700 1 -- 172.21.15.62:0/1066091723 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38d40af1a0 msgr2=0x7f38d41e3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:35.313 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.307+0000 7f38d9194700 1 --2- 172.21.15.62:0/1066091723 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38d40af1a0 0x7f38d41e3530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:35.313 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.307+0000 7f38d9194700 1 -- 172.21.15.62:0/1066091723 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38c4009570 con 0x7f38d40af760 2023-06-09T04:41:35.314 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.307+0000 7f38d9194700 1 --2- 172.21.15.62:0/1066091723 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38d40af760 0x7f38d40cc920 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f38c4009fd0 tx=0x7f38c4004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:35.314 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.307+0000 7f38ca7fc700 1 -- 172.21.15.62:0/1066091723 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c4004610 con 0x7f38d40af760 2023-06-09T04:41:35.315 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.307+0000 7f38ca7fc700 1 -- 172.21.15.62:0/1066091723 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38c401f070 con 0x7f38d40af760 2023-06-09T04:41:35.315 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.307+0000 7f38ca7fc700 1 -- 172.21.15.62:0/1066091723 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38c40038e0 con 0x7f38d40af760 2023-06-09T04:41:35.315 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.307+0000 7f38da997700 1 -- 172.21.15.62:0/1066091723 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38d41e2a50 con 0x7f38d40af760 2023-06-09T04:41:35.315 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.307+0000 7f38da997700 1 -- 172.21.15.62:0/1066091723 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38d41e3a70 con 0x7f38d40af760 2023-06-09T04:41:35.315 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.307+0000 7f38da997700 1 -- 172.21.15.62:0/1066091723 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38d41e3250 con 0x7f38d40af760 2023-06-09T04:41:35.316 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.311+0000 7f38ca7fc700 1 -- 172.21.15.62:0/1066091723 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f38c4003a40 con 0x7f38d40af760 2023-06-09T04:41:35.318 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.311+0000 7f38ca7fc700 1 --2- 172.21.15.62:0/1066091723 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f38b80662f0 0x7f38b80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:35.318 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.311+0000 7f38ca7fc700 1 -- 172.21.15.62:0/1066091723 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f38c4021070 con 0x7f38d40af760 2023-06-09T04:41:35.319 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.315+0000 7f38d9995700 1 --2- 172.21.15.62:0/1066091723 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f38b80662f0 0x7f38b80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:35.320 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.315+0000 7f38d9995700 1 --2- 172.21.15.62:0/1066091723 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f38b80662f0 0x7f38b80687a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f38d0009b40 tx=0x7f38d00091c0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:35.327 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.323+0000 7f38ca7fc700 1 -- 172.21.15.62:0/1066091723 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f38d41e3250 con 0x7f38d40af760 2023-06-09T04:41:35.508 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.503+0000 7f38da997700 1 -- 172.21.15.62:0/1066091723 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f38d41e3210 con 0x7f38d40af760 2023-06-09T04:41:35.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.507+0000 7f38ca7fc700 1 -- 172.21.15.62:0/1066091723 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20084 (secure 0 0 0) 0x7f38c40525f0 con 0x7f38d40af760 2023-06-09T04:41:35.512 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:41:35.512 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":28,"fsid":"f7998a1e-e5a9-4202-abaa-70c0eaae1047","created":"2023-06-09T04:40:30.469588+0000","modified":"2023-06-09T04:41:01.271858+0000","last_up_change":"2023-06-09T04:40:43.120747+0000","last_in_change":"2023-06-09T04:40:33.568221+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:40:44.646921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:40:50.006643+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:40:55.031273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:40:55.773517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-09T04:40:58.845383+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bc50bbc0-dd08-42ed-804c-ec3029e36c19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6802","nonce":1295788017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6807","nonce":1295788017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6815","nonce":1295788017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6809","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6811","nonce":1295788017}]},"public_addr":"172.21.15.62:6802/1295788017","cluster_addr":"172.21.15.62:6807/1295788017","heartbeat_back_addr":"172.21.15.62:6815/1295788017","heartbeat_front_addr":"172.21.15.62:6811/1295788017","state":["exists","up"]},{"osd":1,"uuid":"8230b12d-e22f-4985-a584-4cc64404cdbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6825","nonce":4120692006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6827","nonce":4120692006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6831","nonce":4120692006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6829","nonce":4120692006}]},"public_addr":"172.21.15.62:6825/4120692006","cluster_addr":"172.21.15.62:6827/4120692006","heartbeat_back_addr":"172.21.15.62:6831/4120692006","heartbeat_front_addr":"172.21.15.62:6829/4120692006","state":["exists","up"]},{"osd":2,"uuid":"d0202506-dbe9-4e3c-9271-687929abf96a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6801","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6803","nonce":4169607876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6805","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6806","nonce":4169607876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6814","nonce":4169607876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6810","nonce":4169607876}]},"public_addr":"172.21.15.62:6803/4169607876","cluster_addr":"172.21.15.62:6806/4169607876","heartbeat_back_addr":"172.21.15.62:6814/4169607876","heartbeat_front_addr":"172.21.15.62:6810/4169607876","state":["exists","up"]},{"osd":3,"uuid":"f3c0298a-b075-4411-af50-e16cd74fdddb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6817","nonce":3268438986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6819","nonce":3268438986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6823","nonce":3268438986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6821","nonce":3268438986}]},"public_addr":"172.21.15.62:6817/3268438986","cluster_addr":"172.21.15.62:6819/3268438986","heartbeat_back_addr":"172.21.15.62:6823/3268438986","heartbeat_front_addr":"172.21.15.62:6821/3268438986","state":["exists","up"]},{"osd":4,"uuid":"1ab5c5ca-e74f-475a-a309-683cc0029928","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6817","nonce":3139617628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6819","nonce":3139617628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6823","nonce":3139617628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6821","nonce":3139617628}]},"public_addr":"172.21.15.89:6817/3139617628","cluster_addr":"172.21.15.89:6819/3139617628","heartbeat_back_addr":"172.21.15.89:6823/3139617628","heartbeat_front_addr":"172.21.15.89:6821/3139617628","state":["exists","up"]},{"osd":5,"uuid":"a933e184-bd8f-4369-a1ba-a68de53c578c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6825","nonce":2681723596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6827","nonce":2681723596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6831","nonce":2681723596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6829","nonce":2681723596}]},"public_addr":"172.21.15.89:6825/2681723596","cluster_addr":"172.21.15.89:6827/2681723596","heartbeat_back_addr":"172.21.15.89:6831/2681723596","heartbeat_front_addr":"172.21.15.89:6829/2681723596","state":["exists","up"]},{"osd":6,"uuid":"1ed7ad37-2eee-49a6-954c-b537e2b7f0ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6809","nonce":1657136033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6811","nonce":1657136033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6815","nonce":1657136033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6813","nonce":1657136033}]},"public_addr":"172.21.15.89:6809/1657136033","cluster_addr":"172.21.15.89:6811/1657136033","heartbeat_back_addr":"172.21.15.89:6815/1657136033","heartbeat_front_addr":"172.21.15.89:6813/1657136033","state":["exists","up"]},{"osd":7,"uuid":"6ed732e9-33ff-40df-9038-a9f1d1622671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6801","nonce":1710561686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6803","nonce":1710561686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6807","nonce":1710561686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6805","nonce":1710561686}]},"public_addr":"172.21.15.89:6801/1710561686","cluster_addr":"172.21.15.89:6803/1710561686","heartbeat_back_addr":"172.21.15.89:6807/1710561686","heartbeat_front_addr":"172.21.15.89:6805/1710561686","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.335803+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.419788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.179334+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.263310+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.071846+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.375627+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.282277+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.315997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:41:35.516 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.511+0000 7f38da997700 1 -- 172.21.15.62:0/1066091723 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f38b80662f0 msgr2=0x7f38b80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:35.516 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.511+0000 7f38da997700 1 --2- 172.21.15.62:0/1066091723 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f38b80662f0 0x7f38b80687a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f38d0009b40 tx=0x7f38d00091c0 comp rx=0 tx=0).stop 2023-06-09T04:41:35.516 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.511+0000 7f38da997700 1 -- 172.21.15.62:0/1066091723 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38d40af760 msgr2=0x7f38d40cc920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:35.516 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.511+0000 7f38da997700 1 --2- 172.21.15.62:0/1066091723 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38d40af760 0x7f38d40cc920 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f38c4009fd0 tx=0x7f38c4004770 comp rx=0 tx=0).stop 2023-06-09T04:41:35.517 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.511+0000 7f38da997700 1 -- 172.21.15.62:0/1066091723 shutdown_connections 2023-06-09T04:41:35.517 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.511+0000 7f38da997700 1 --2- 172.21.15.62:0/1066091723 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f38b80662f0 0x7f38b80687a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:35.517 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.511+0000 7f38da997700 1 --2- 172.21.15.62:0/1066091723 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f38d4159b80 0x7f38d40b2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:35.517 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.511+0000 7f38da997700 1 --2- 172.21.15.62:0/1066091723 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38d40af760 0x7f38d40cc920 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:35.517 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.511+0000 7f38da997700 1 --2- 172.21.15.62:0/1066091723 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f38d40af1a0 0x7f38d41e3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:35.517 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.511+0000 7f38da997700 1 -- 172.21.15.62:0/1066091723 >> 172.21.15.62:0/1066091723 conn(0x7f38d40994e0 msgr2=0x7f38d4158180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:35.518 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.511+0000 7f38da997700 1 -- 172.21.15.62:0/1066091723 shutdown_connections 2023-06-09T04:41:35.518 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.511+0000 7f38da997700 1 -- 172.21.15.62:0/1066091723 wait complete. 2023-06-09T04:41:35.537 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:40:44.646921+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:40:50.006643+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T04:40:55.031273+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T04:40:55.773517+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-09T04:40:58.845383+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-09T04:41:35.538 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:41:35.717 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.711+0000 7fa8ae674700 1 Processor -- start 2023-06-09T04:41:35.718 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.711+0000 7fa8ae674700 1 -- start start 2023-06-09T04:41:35.721 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.715+0000 7fa8ae674700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8a80cd2e0 0x7fa8a80b3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:35.722 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.715+0000 7fa8ae674700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8a80b4d50 con 0x7fa8a80cebf0 2023-06-09T04:41:35.722 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.715+0000 7fa8ae674700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8a80cf050 con 0x7fa8a80d1f80 2023-06-09T04:41:35.722 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.715+0000 7fa8ae674700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a80b4140 con 0x7fa8a80cd2e0 2023-06-09T04:41:35.722 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.715+0000 7fa8ade73700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fa8a80cebf0 0x7fa8a80d0250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36284/0 (socket says 172.21.15.62:36284) 2023-06-09T04:41:35.723 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.715+0000 7fa8ade73700 1 -- 172.21.15.62:0/3716642768 learned_addr learned my addr 172.21.15.62:0/3716642768 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:41:35.723 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.715+0000 7fa8ace71700 1 --2- 172.21.15.62:0/3716642768 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8a80cd2e0 0x7fa8a80b3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:35.724 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.715+0000 7fa89ffff700 1 -- 172.21.15.62:0/3716642768 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4058941020 0 0) 0x7fa8a80b4d50 con 0x7fa8a80cebf0 2023-06-09T04:41:35.724 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.719+0000 7fa89ffff700 1 -- 172.21.15.62:0/3716642768 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8940035d0 con 0x7fa8a80cebf0 2023-06-09T04:41:35.724 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.719+0000 7fa89ffff700 1 -- 172.21.15.62:0/3716642768 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1680561882 0 0) 0x7fa8a80cf050 con 0x7fa8a80d1f80 2023-06-09T04:41:35.724 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.719+0000 7fa89ffff700 1 -- 172.21.15.62:0/3716642768 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8a80b4d50 con 0x7fa8a80d1f80 2023-06-09T04:41:35.724 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.719+0000 7fa8ace71700 1 -- 172.21.15.62:0/3716642768 >> v1:172.21.15.89:6789/0 conn(0x7fa8a80d1f80 legacy=0x7fa8a80ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:35.724 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.719+0000 7fa8ace71700 1 -- 172.21.15.62:0/3716642768 >> v1:172.21.15.62:6789/0 conn(0x7fa8a80cebf0 legacy=0x7fa8a80d0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:35.724 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.719+0000 7fa8ace71700 1 -- 172.21.15.62:0/3716642768 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8a80b4420 con 0x7fa8a80cd2e0 2023-06-09T04:41:35.725 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.719+0000 7fa8ace71700 1 --2- 172.21.15.62:0/3716642768 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8a80cd2e0 0x7fa8a80b3b20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa898009880 tx=0x7fa898009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2350ec0c1e2f06fe server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:35.725 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.719+0000 7fa89ffff700 1 -- 172.21.15.62:0/3716642768 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa898011830 con 0x7fa8a80cd2e0 2023-06-09T04:41:35.725 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.719+0000 7fa89ffff700 1 -- 172.21.15.62:0/3716642768 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa898011990 con 0x7fa8a80cd2e0 2023-06-09T04:41:35.725 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.719+0000 7fa89ffff700 1 -- 172.21.15.62:0/3716642768 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa898011d20 con 0x7fa8a80cd2e0 2023-06-09T04:41:35.726 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.719+0000 7fa8ae674700 1 -- 172.21.15.62:0/3716642768 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8a80cd2e0 msgr2=0x7fa8a80b3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:35.726 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.719+0000 7fa8ae674700 1 --2- 172.21.15.62:0/3716642768 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8a80cd2e0 0x7fa8a80b3b20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa898009880 tx=0x7fa898009b90 comp rx=0 tx=0).stop 2023-06-09T04:41:35.726 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.719+0000 7fa8ae674700 1 -- 172.21.15.62:0/3716642768 shutdown_connections 2023-06-09T04:41:35.727 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.719+0000 7fa8ae674700 1 --2- 172.21.15.62:0/3716642768 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8a80cd2e0 0x7fa8a80b3b20 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:35.727 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.719+0000 7fa8ae674700 1 -- 172.21.15.62:0/3716642768 >> 172.21.15.62:0/3716642768 conn(0x7fa8a8071840 msgr2=0x7fa8a809b760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:35.727 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.719+0000 7fa8ae674700 1 -- 172.21.15.62:0/3716642768 shutdown_connections 2023-06-09T04:41:35.727 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.719+0000 7fa8ae674700 1 -- 172.21.15.62:0/3716642768 wait complete. 2023-06-09T04:41:35.728 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.723+0000 7fa8ae674700 1 Processor -- start 2023-06-09T04:41:35.728 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.723+0000 7fa8ae674700 1 -- start start 2023-06-09T04:41:35.729 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.723+0000 7fa8ae674700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8a80cd2e0 0x7fa8a80b04c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:35.729 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.723+0000 7fa8ae674700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8a80cebf0 0x7fa8a80b0a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:35.729 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.723+0000 7fa8ae674700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8a80d1f80 0x7fa8a80cb580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:35.730 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.723+0000 7fa8ae674700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a81f3750 con 0x7fa8a80d1f80 2023-06-09T04:41:35.730 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.723+0000 7fa8ae674700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a81f6cd0 con 0x7fa8a80cd2e0 2023-06-09T04:41:35.730 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.723+0000 7fa8ae674700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a81f6fb0 con 0x7fa8a80cebf0 2023-06-09T04:41:35.730 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.723+0000 7fa8ade73700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8a80d1f80 0x7fa8a80cb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:35.730 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.723+0000 7fa8ade73700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8a80d1f80 0x7fa8a80cb580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53522/0 (socket says 172.21.15.62:53522) 2023-06-09T04:41:35.730 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.723+0000 7fa8ade73700 1 -- 172.21.15.62:0/1952584217 learned_addr learned my addr 172.21.15.62:0/1952584217 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:35.731 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.723+0000 7fa8ad672700 1 --2- 172.21.15.62:0/1952584217 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8a80cd2e0 0x7fa8a80b04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:35.732 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.723+0000 7fa8ace71700 1 --2- 172.21.15.62:0/1952584217 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8a80cebf0 0x7fa8a80b0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:35.732 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.723+0000 7fa8ade73700 1 -- 172.21.15.62:0/1952584217 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8a80cebf0 msgr2=0x7fa8a80b0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:35.732 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.723+0000 7fa8ade73700 1 --2- 172.21.15.62:0/1952584217 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8a80cebf0 0x7fa8a80b0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:35.732 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.723+0000 7fa8ade73700 1 -- 172.21.15.62:0/1952584217 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8a80cd2e0 msgr2=0x7fa8a80b04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:35.732 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.723+0000 7fa8ade73700 1 --2- 172.21.15.62:0/1952584217 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8a80cd2e0 0x7fa8a80b04c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:35.732 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.723+0000 7fa8ade73700 1 -- 172.21.15.62:0/1952584217 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8980094b0 con 0x7fa8a80d1f80 2023-06-09T04:41:35.732 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.723+0000 7fa8ace71700 1 --2- 172.21.15.62:0/1952584217 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8a80cebf0 0x7fa8a80b0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:41:35.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.723+0000 7fa8ade73700 1 --2- 172.21.15.62:0/1952584217 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8a80d1f80 0x7fa8a80cb580 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa8a000cba0 tx=0x7fa8a000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:35.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.723+0000 7fa89dffb700 1 -- 172.21.15.62:0/1952584217 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a000a980 con 0x7fa8a80d1f80 2023-06-09T04:41:35.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.727+0000 7fa89dffb700 1 -- 172.21.15.62:0/1952584217 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8a000aae0 con 0x7fa8a80d1f80 2023-06-09T04:41:35.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.727+0000 7fa89dffb700 1 -- 172.21.15.62:0/1952584217 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a000ae70 con 0x7fa8a80d1f80 2023-06-09T04:41:35.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.727+0000 7fa8ae674700 1 -- 172.21.15.62:0/1952584217 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8a81f7290 con 0x7fa8a80d1f80 2023-06-09T04:41:35.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.727+0000 7fa8ae674700 1 -- 172.21.15.62:0/1952584217 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8a81f7850 con 0x7fa8a80d1f80 2023-06-09T04:41:35.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.727+0000 7fa8ae674700 1 -- 172.21.15.62:0/1952584217 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8a81f7a70 con 0x7fa8a80d1f80 2023-06-09T04:41:35.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.727+0000 7fa89dffb700 1 -- 172.21.15.62:0/1952584217 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa8a001b3b0 con 0x7fa8a80d1f80 2023-06-09T04:41:35.735 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.731+0000 7fa89dffb700 1 --2- 172.21.15.62:0/1952584217 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fa88c066320 0x7fa88c0687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:35.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.731+0000 7fa89dffb700 1 -- 172.21.15.62:0/1952584217 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa8a0083ac0 con 0x7fa8a80d1f80 2023-06-09T04:41:35.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.731+0000 7fa8ad672700 1 --2- 172.21.15.62:0/1952584217 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fa88c066320 0x7fa88c0687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:35.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.731+0000 7fa8ad672700 1 --2- 172.21.15.62:0/1952584217 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fa88c066320 0x7fa88c0687d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa8a4001230 tx=0x7fa8a4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:35.742 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.735+0000 7fa89dffb700 1 -- 172.21.15.62:0/1952584217 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa8a0050c50 con 0x7fa8a80d1f80 2023-06-09T04:41:35.916 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.911+0000 7fa8ae674700 1 -- 172.21.15.62:0/1952584217 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa8a80739c0 con 0x7fa8a80d1f80 2023-06-09T04:41:35.916 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.911+0000 7fa89dffb700 1 -- 172.21.15.62:0/1952584217 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa8a0054270 con 0x7fa8a80d1f80 2023-06-09T04:41:35.917 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2023-06-09T04:41:35.919 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.915+0000 7fa8ae674700 1 -- 172.21.15.62:0/1952584217 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fa88c066320 msgr2=0x7fa88c0687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:35.919 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.915+0000 7fa8ae674700 1 --2- 172.21.15.62:0/1952584217 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fa88c066320 0x7fa88c0687d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa8a4001230 tx=0x7fa8a4009040 comp rx=0 tx=0).stop 2023-06-09T04:41:35.920 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.915+0000 7fa8ae674700 1 -- 172.21.15.62:0/1952584217 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8a80d1f80 msgr2=0x7fa8a80cb580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:35.920 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.915+0000 7fa8ae674700 1 --2- 172.21.15.62:0/1952584217 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8a80d1f80 0x7fa8a80cb580 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa8a000cba0 tx=0x7fa8a000cc80 comp rx=0 tx=0).stop 2023-06-09T04:41:35.920 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.915+0000 7fa8ae674700 1 -- 172.21.15.62:0/1952584217 shutdown_connections 2023-06-09T04:41:35.920 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.915+0000 7fa8ae674700 1 --2- 172.21.15.62:0/1952584217 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fa88c066320 0x7fa88c0687d0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:35.920 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.915+0000 7fa8ae674700 1 --2- 172.21.15.62:0/1952584217 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8a80d1f80 0x7fa8a80cb580 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:35.920 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.915+0000 7fa8ae674700 1 --2- 172.21.15.62:0/1952584217 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa8a80cebf0 0x7fa8a80b0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:35.920 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.915+0000 7fa8ae674700 1 --2- 172.21.15.62:0/1952584217 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8a80cd2e0 0x7fa8a80b04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:35.921 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.915+0000 7fa8ae674700 1 -- 172.21.15.62:0/1952584217 >> 172.21.15.62:0/1952584217 conn(0x7fa8a8071840 msgr2=0x7fa8a80cf210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:35.921 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.915+0000 7fa8ae674700 1 -- 172.21.15.62:0/1952584217 shutdown_connections 2023-06-09T04:41:35.921 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:35.915+0000 7fa8ae674700 1 -- 172.21.15.62:0/1952584217 wait complete. 2023-06-09T04:41:35.945 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:41:36.127 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.119+0000 7f9899b77700 1 Processor -- start 2023-06-09T04:41:36.127 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.123+0000 7f9899b77700 1 -- start start 2023-06-09T04:41:36.130 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.123+0000 7f9899b77700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98940d1f80 0x7f98940b3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:36.130 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.123+0000 7f9899b77700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f98940cebf0 0x7f98940ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:36.131 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.123+0000 7f9899b77700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98940b4d50 con 0x7f98940cd110 2023-06-09T04:41:36.131 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.123+0000 7f9899b77700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98940cd590 con 0x7f98940cebf0 2023-06-09T04:41:36.131 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.123+0000 7f9899b77700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98940cf040 con 0x7f98940d1f80 2023-06-09T04:41:36.131 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.127+0000 7f9893fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f98940cebf0 0x7f98940ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:36.132 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.127+0000 7f9898b75700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98940d1f80 0x7f98940b3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:36.132 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.127+0000 7f9893fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f98940cebf0 0x7f98940ccbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53532/0 (socket says 172.21.15.62:53532) 2023-06-09T04:41:36.133 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.127+0000 7f9893fff700 1 -- 172.21.15.62:0/3212119642 learned_addr learned my addr 172.21.15.62:0/3212119642 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:36.133 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.127+0000 7f9893fff700 1 -- 172.21.15.62:0/3212119642 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98940d1f80 msgr2=0x7f98940b3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:36.133 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.127+0000 7f9893fff700 1 --2- 172.21.15.62:0/3212119642 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98940d1f80 0x7f98940b3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:36.133 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.127+0000 7f9893fff700 1 -- 172.21.15.62:0/3212119642 >> v1:172.21.15.89:6789/0 conn(0x7f98940cd110 legacy=0x7f98940b2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:36.133 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.127+0000 7f9893fff700 1 -- 172.21.15.62:0/3212119642 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98940b4140 con 0x7f98940cebf0 2023-06-09T04:41:36.134 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.127+0000 7f9893fff700 1 --2- 172.21.15.62:0/3212119642 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98940cebf0 0x7f98940ccbd0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9880009910 tx=0x7f9880009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8e141241576016b server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:36.134 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.127+0000 7f98937fe700 1 -- 172.21.15.62:0/3212119642 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9880011830 con 0x7f98940cebf0 2023-06-09T04:41:36.134 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.127+0000 7f98937fe700 1 -- 172.21.15.62:0/3212119642 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9880011990 con 0x7f98940cebf0 2023-06-09T04:41:36.134 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.127+0000 7f98937fe700 1 -- 172.21.15.62:0/3212119642 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9880011d40 con 0x7f98940cebf0 2023-06-09T04:41:36.135 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.127+0000 7f9899b77700 1 -- 172.21.15.62:0/3212119642 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98940cebf0 msgr2=0x7f98940ccbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:36.135 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.127+0000 7f9899b77700 1 --2- 172.21.15.62:0/3212119642 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98940cebf0 0x7f98940ccbd0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9880009910 tx=0x7f9880009c20 comp rx=0 tx=0).stop 2023-06-09T04:41:36.135 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.127+0000 7f9899b77700 1 -- 172.21.15.62:0/3212119642 shutdown_connections 2023-06-09T04:41:36.135 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.127+0000 7f9899b77700 1 --2- 172.21.15.62:0/3212119642 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98940cebf0 0x7f98940ccbd0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:36.136 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.127+0000 7f9899b77700 1 --2- 172.21.15.62:0/3212119642 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98940d1f80 0x7f98940b3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:36.136 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.127+0000 7f9899b77700 1 -- 172.21.15.62:0/3212119642 >> 172.21.15.62:0/3212119642 conn(0x7f9894071840 msgr2=0x7f989409b760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:36.136 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.127+0000 7f9899b77700 1 -- 172.21.15.62:0/3212119642 shutdown_connections 2023-06-09T04:41:36.136 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.131+0000 7f9899b77700 1 -- 172.21.15.62:0/3212119642 wait complete. 2023-06-09T04:41:36.138 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.131+0000 7f9899b77700 1 Processor -- start 2023-06-09T04:41:36.138 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.131+0000 7f9899b77700 1 -- start start 2023-06-09T04:41:36.141 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.135+0000 7f9899b77700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98940cd110 0x7f989415c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:36.141 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.135+0000 7f9899b77700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98940cebf0 0x7f98941502d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:36.141 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.135+0000 7f9899b77700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98940d1f80 0x7f989414e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:36.142 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.135+0000 7f9899b77700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f989415c8e0 con 0x7f98940cebf0 2023-06-09T04:41:36.142 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.135+0000 7f9899b77700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98940c7440 con 0x7f98940cd110 2023-06-09T04:41:36.142 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.135+0000 7f9899b77700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98940c7720 con 0x7f98940d1f80 2023-06-09T04:41:36.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.135+0000 7f9893fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98940cebf0 0x7f98941502d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:36.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.135+0000 7f9893fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98940cebf0 0x7f98941502d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53542/0 (socket says 172.21.15.62:53542) 2023-06-09T04:41:36.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.135+0000 7f9893fff700 1 -- 172.21.15.62:0/4294931857 learned_addr learned my addr 172.21.15.62:0/4294931857 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:36.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.135+0000 7f9898b75700 1 --2- 172.21.15.62:0/4294931857 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98940cd110 0x7f989415c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:36.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.135+0000 7f9899376700 1 --2- 172.21.15.62:0/4294931857 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98940d1f80 0x7f989414e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:36.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.135+0000 7f9893fff700 1 -- 172.21.15.62:0/4294931857 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98940d1f80 msgr2=0x7f989414e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:36.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.135+0000 7f9893fff700 1 --2- 172.21.15.62:0/4294931857 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98940d1f80 0x7f989414e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:36.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.135+0000 7f9893fff700 1 -- 172.21.15.62:0/4294931857 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98940cd110 msgr2=0x7f989415c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:36.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.135+0000 7f9893fff700 1 --2- 172.21.15.62:0/4294931857 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98940cd110 0x7f989415c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:36.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.135+0000 7f9893fff700 1 -- 172.21.15.62:0/4294931857 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9880009570 con 0x7f98940cebf0 2023-06-09T04:41:36.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.135+0000 7f9898b75700 1 --2- 172.21.15.62:0/4294931857 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98940cd110 0x7f989415c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:41:36.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.135+0000 7f9893fff700 1 --2- 172.21.15.62:0/4294931857 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98940cebf0 0x7f98941502d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9880000c00 tx=0x7f9880004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:36.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.139+0000 7f98917fa700 1 -- 172.21.15.62:0/4294931857 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9880004610 con 0x7f98940cebf0 2023-06-09T04:41:36.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.139+0000 7f98917fa700 1 -- 172.21.15.62:0/4294931857 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98800036c0 con 0x7f98940cebf0 2023-06-09T04:41:36.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.139+0000 7f9899b77700 1 -- 172.21.15.62:0/4294931857 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98940c7a00 con 0x7f98940cebf0 2023-06-09T04:41:36.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.139+0000 7f98917fa700 1 -- 172.21.15.62:0/4294931857 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9880003a50 con 0x7f98940cebf0 2023-06-09T04:41:36.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.139+0000 7f9899b77700 1 -- 172.21.15.62:0/4294931857 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9894150fe0 con 0x7f98940cebf0 2023-06-09T04:41:36.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.139+0000 7f9899b77700 1 -- 172.21.15.62:0/4294931857 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98940c7f20 con 0x7f98940cebf0 2023-06-09T04:41:36.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.139+0000 7f98917fa700 1 -- 172.21.15.62:0/4294931857 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9880003bb0 con 0x7f98940cebf0 2023-06-09T04:41:36.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.143+0000 7f98917fa700 1 --2- 172.21.15.62:0/4294931857 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f98780662f0 0x7f98780687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:36.149 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.143+0000 7f98917fa700 1 -- 172.21.15.62:0/4294931857 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9880021030 con 0x7f98940cebf0 2023-06-09T04:41:36.149 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.143+0000 7f9898b75700 1 --2- 172.21.15.62:0/4294931857 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f98780662f0 0x7f98780687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:36.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.143+0000 7f9898b75700 1 --2- 172.21.15.62:0/4294931857 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f98780662f0 0x7f98780687a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9888009b90 tx=0x7f9888008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:36.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.151+0000 7f98917fa700 1 -- 172.21.15.62:0/4294931857 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9880052920 con 0x7f98940cebf0 2023-06-09T04:41:36.335 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.331+0000 7f9899b77700 1 -- 172.21.15.62:0/4294931857 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f98940b49b0 con 0x7f98940cebf0 2023-06-09T04:41:36.336 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.331+0000 7f98917fa700 1 -- 172.21.15.62:0/4294931857 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9880003e60 con 0x7f98940cebf0 2023-06-09T04:41:36.337 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2023-06-09T04:41:36.339 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.335+0000 7f9899b77700 1 -- 172.21.15.62:0/4294931857 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f98780662f0 msgr2=0x7f98780687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:36.339 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.335+0000 7f9899b77700 1 --2- 172.21.15.62:0/4294931857 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f98780662f0 0x7f98780687a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9888009b90 tx=0x7f9888008040 comp rx=0 tx=0).stop 2023-06-09T04:41:36.339 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.335+0000 7f9899b77700 1 -- 172.21.15.62:0/4294931857 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98940cebf0 msgr2=0x7f98941502d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:36.340 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.335+0000 7f9899b77700 1 --2- 172.21.15.62:0/4294931857 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98940cebf0 0x7f98941502d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9880000c00 tx=0x7f9880004770 comp rx=0 tx=0).stop 2023-06-09T04:41:36.340 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.335+0000 7f9899b77700 1 -- 172.21.15.62:0/4294931857 shutdown_connections 2023-06-09T04:41:36.341 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.335+0000 7f9899b77700 1 --2- 172.21.15.62:0/4294931857 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f98780662f0 0x7f98780687a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:36.341 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.335+0000 7f9899b77700 1 --2- 172.21.15.62:0/4294931857 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98940d1f80 0x7f989414e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:36.341 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.335+0000 7f9899b77700 1 --2- 172.21.15.62:0/4294931857 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98940cebf0 0x7f98941502d0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:36.341 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.335+0000 7f9899b77700 1 --2- 172.21.15.62:0/4294931857 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98940cd110 0x7f989415c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:36.341 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.335+0000 7f9899b77700 1 -- 172.21.15.62:0/4294931857 >> 172.21.15.62:0/4294931857 conn(0x7f9894071840 msgr2=0x7f989406ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:36.341 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.335+0000 7f9899b77700 1 -- 172.21.15.62:0/4294931857 shutdown_connections 2023-06-09T04:41:36.341 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.335+0000 7f9899b77700 1 -- 172.21.15.62:0/4294931857 wait complete. 2023-06-09T04:41:36.361 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T04:41:36.542 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.535+0000 7f27c5d1f700 1 Processor -- start 2023-06-09T04:41:36.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.535+0000 7f27c5d1f700 1 -- start start 2023-06-09T04:41:36.546 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.539+0000 7f27c5d1f700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f27c00cd2e0 0x7f27c00b3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:36.546 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.539+0000 7f27c5d1f700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f27c00cebf0 0x7f27c00d0250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:36.546 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.539+0000 7f27c5d1f700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27c00b4d50 con 0x7f27c00d1f80 2023-06-09T04:41:36.546 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.539+0000 7f27c5d1f700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27c00ceff0 con 0x7f27c00cebf0 2023-06-09T04:41:36.546 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.539+0000 7f27c5d1f700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27c00b4140 con 0x7f27c00cd2e0 2023-06-09T04:41:36.547 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.539+0000 7f27c4d1d700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f27c00d1f80 0x7f27c00ccbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36290/0 (socket says 172.21.15.62:36290) 2023-06-09T04:41:36.547 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.539+0000 7f27c4d1d700 1 -- 172.21.15.62:0/1003736143 learned_addr learned my addr 172.21.15.62:0/1003736143 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:41:36.547 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.539+0000 7f27c551e700 1 --2- 172.21.15.62:0/1003736143 >> v2:172.21.15.62:3300/0 conn(0x7f27c00cebf0 0x7f27c00d0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:36.547 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.539+0000 7f27bffff700 1 --2- 172.21.15.62:0/1003736143 >> v2:172.21.15.89:3300/0 conn(0x7f27c00cd2e0 0x7f27c00b3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:36.548 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.543+0000 7f27bffff700 1 -- 172.21.15.62:0/1003736143 >> v2:172.21.15.62:3300/0 conn(0x7f27c00cebf0 msgr2=0x7f27c00d0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:36.548 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.543+0000 7f27bffff700 1 --2- 172.21.15.62:0/1003736143 >> v2:172.21.15.62:3300/0 conn(0x7f27c00cebf0 0x7f27c00d0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:36.548 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.543+0000 7f27bffff700 1 -- 172.21.15.62:0/1003736143 >> v1:172.21.15.62:6789/0 conn(0x7f27c00d1f80 legacy=0x7f27c00ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:36.548 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.543+0000 7f27bf7fe700 1 -- 172.21.15.62:0/1003736143 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2820062339 0 0) 0x7f27c00b4d50 con 0x7f27c00d1f80 2023-06-09T04:41:36.548 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.543+0000 7f27bffff700 1 -- 172.21.15.62:0/1003736143 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27c00b4420 con 0x7f27c00cd2e0 2023-06-09T04:41:36.548 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.543+0000 7f27bffff700 1 --2- 172.21.15.62:0/1003736143 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27c00cd2e0 0x7f27c00b3b20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f27c00b8580 tx=0x7f27ac009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c69457294fa583a server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:36.549 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.543+0000 7f27bf7fe700 1 -- 172.21.15.62:0/1003736143 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27ac011830 con 0x7f27c00cd2e0 2023-06-09T04:41:36.549 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.543+0000 7f27bf7fe700 1 -- 172.21.15.62:0/1003736143 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27ac011990 con 0x7f27c00cd2e0 2023-06-09T04:41:36.549 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.543+0000 7f27bf7fe700 1 -- 172.21.15.62:0/1003736143 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27ac011d20 con 0x7f27c00cd2e0 2023-06-09T04:41:36.550 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.543+0000 7f27c5d1f700 1 -- 172.21.15.62:0/1003736143 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27c00cd2e0 msgr2=0x7f27c00b3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:36.550 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.543+0000 7f27c5d1f700 1 --2- 172.21.15.62:0/1003736143 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27c00cd2e0 0x7f27c00b3b20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f27c00b8580 tx=0x7f27ac009b30 comp rx=0 tx=0).stop 2023-06-09T04:41:36.550 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.543+0000 7f27c5d1f700 1 -- 172.21.15.62:0/1003736143 shutdown_connections 2023-06-09T04:41:36.550 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.543+0000 7f27c5d1f700 1 --2- 172.21.15.62:0/1003736143 >> v2:172.21.15.62:3300/0 conn(0x7f27c00cebf0 0x7f27c00d0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:36.550 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.543+0000 7f27c5d1f700 1 --2- 172.21.15.62:0/1003736143 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27c00cd2e0 0x7f27c00b3b20 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:36.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.543+0000 7f27c5d1f700 1 -- 172.21.15.62:0/1003736143 >> 172.21.15.62:0/1003736143 conn(0x7f27c0071840 msgr2=0x7f27c009b760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:36.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.543+0000 7f27c5d1f700 1 -- 172.21.15.62:0/1003736143 shutdown_connections 2023-06-09T04:41:36.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.543+0000 7f27c5d1f700 1 -- 172.21.15.62:0/1003736143 wait complete. 2023-06-09T04:41:36.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.547+0000 7f27c5d1f700 1 Processor -- start 2023-06-09T04:41:36.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.547+0000 7f27c5d1f700 1 -- start start 2023-06-09T04:41:36.554 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.547+0000 7f27c5d1f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27c00cd2e0 0x7f27c00cab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:36.554 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.547+0000 7f27c5d1f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27c00cebf0 0x7f27c00b67e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:36.554 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.547+0000 7f27c5d1f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f27c00d1f80 0x7f27c0159720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:36.554 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.547+0000 7f27c5d1f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27c00b7c90 con 0x7f27c00d1f80 2023-06-09T04:41:36.554 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.547+0000 7f27c5d1f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27c00cbd00 con 0x7f27c00cebf0 2023-06-09T04:41:36.554 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.547+0000 7f27c5d1f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27c015a270 con 0x7f27c00cd2e0 2023-06-09T04:41:36.555 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.547+0000 7f27c551e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f27c00d1f80 0x7f27c0159720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:36.555 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.547+0000 7f27c551e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f27c00d1f80 0x7f27c0159720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53562/0 (socket says 172.21.15.62:53562) 2023-06-09T04:41:36.555 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.547+0000 7f27c551e700 1 -- 172.21.15.62:0/2473558504 learned_addr learned my addr 172.21.15.62:0/2473558504 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:36.555 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.547+0000 7f27bffff700 1 --2- 172.21.15.62:0/2473558504 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27c00cebf0 0x7f27c00b67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:36.556 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.547+0000 7f27c4d1d700 1 --2- 172.21.15.62:0/2473558504 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27c00cd2e0 0x7f27c00cab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:36.556 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.551+0000 7f27c551e700 1 -- 172.21.15.62:0/2473558504 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27c00cd2e0 msgr2=0x7f27c00cab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:36.556 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.551+0000 7f27c551e700 1 --2- 172.21.15.62:0/2473558504 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27c00cd2e0 0x7f27c00cab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:36.556 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.551+0000 7f27c551e700 1 -- 172.21.15.62:0/2473558504 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27c00cebf0 msgr2=0x7f27c00b67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:36.556 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.551+0000 7f27c551e700 1 --2- 172.21.15.62:0/2473558504 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27c00cebf0 0x7f27c00b67e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:36.556 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.551+0000 7f27c551e700 1 -- 172.21.15.62:0/2473558504 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27ac0094b0 con 0x7f27c00d1f80 2023-06-09T04:41:36.557 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.551+0000 7f27c551e700 1 --2- 172.21.15.62:0/2473558504 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f27c00d1f80 0x7f27c0159720 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f27b800efc0 tx=0x7f27b800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:36.557 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.551+0000 7f27bd7fa700 1 -- 172.21.15.62:0/2473558504 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b8009ea0 con 0x7f27c00d1f80 2023-06-09T04:41:36.557 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.551+0000 7f27bd7fa700 1 -- 172.21.15.62:0/2473558504 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27b800f040 con 0x7f27c00d1f80 2023-06-09T04:41:36.557 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.551+0000 7f27bd7fa700 1 -- 172.21.15.62:0/2473558504 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b800ced0 con 0x7f27c00d1f80 2023-06-09T04:41:36.558 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.551+0000 7f27c5d1f700 1 -- 172.21.15.62:0/2473558504 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27c00cb0f0 con 0x7f27c00d1f80 2023-06-09T04:41:36.558 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.551+0000 7f27c5d1f700 1 -- 172.21.15.62:0/2473558504 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27c00cb6b0 con 0x7f27c00d1f80 2023-06-09T04:41:36.558 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.551+0000 7f27c5d1f700 1 -- 172.21.15.62:0/2473558504 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27c00cbe90 con 0x7f27c00d1f80 2023-06-09T04:41:36.560 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.555+0000 7f27bd7fa700 1 -- 172.21.15.62:0/2473558504 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f27b8014480 con 0x7f27c00d1f80 2023-06-09T04:41:36.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.555+0000 7f27bd7fa700 1 --2- 172.21.15.62:0/2473558504 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f27a4066320 0x7f27a40687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:36.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.555+0000 7f27bd7fa700 1 -- 172.21.15.62:0/2473558504 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f27b8084770 con 0x7f27c00d1f80 2023-06-09T04:41:36.562 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.555+0000 7f27c4d1d700 1 --2- 172.21.15.62:0/2473558504 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f27a4066320 0x7f27a40687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:36.563 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.559+0000 7f27c4d1d700 1 --2- 172.21.15.62:0/2473558504 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f27a4066320 0x7f27a40687d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f27b4006240 tx=0x7f27b4009110 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:36.569 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.563+0000 7f27bd7fa700 1 -- 172.21.15.62:0/2473558504 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f27b80519a0 con 0x7f27c00d1f80 2023-06-09T04:41:36.744 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.739+0000 7f27c5d1f700 1 -- 172.21.15.62:0/2473558504 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f27c00739c0 con 0x7f27c00d1f80 2023-06-09T04:41:36.745 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.739+0000 7f27bd7fa700 1 -- 172.21.15.62:0/2473558504 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f27b8054fc0 con 0x7f27c00d1f80 2023-06-09T04:41:36.745 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-06-09T04:41:36.749 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.743+0000 7f27c5d1f700 1 -- 172.21.15.62:0/2473558504 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f27a4066320 msgr2=0x7f27a40687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:36.750 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.743+0000 7f27c5d1f700 1 --2- 172.21.15.62:0/2473558504 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f27a4066320 0x7f27a40687d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f27b4006240 tx=0x7f27b4009110 comp rx=0 tx=0).stop 2023-06-09T04:41:36.750 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.743+0000 7f27c5d1f700 1 -- 172.21.15.62:0/2473558504 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f27c00d1f80 msgr2=0x7f27c0159720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:36.750 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.743+0000 7f27c5d1f700 1 --2- 172.21.15.62:0/2473558504 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f27c00d1f80 0x7f27c0159720 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f27b800efc0 tx=0x7f27b800c3a0 comp rx=0 tx=0).stop 2023-06-09T04:41:36.750 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.743+0000 7f27c5d1f700 1 -- 172.21.15.62:0/2473558504 shutdown_connections 2023-06-09T04:41:36.751 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.743+0000 7f27c5d1f700 1 --2- 172.21.15.62:0/2473558504 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f27a4066320 0x7f27a40687d0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:36.751 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.743+0000 7f27c5d1f700 1 --2- 172.21.15.62:0/2473558504 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f27c00d1f80 0x7f27c0159720 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:36.751 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.743+0000 7f27c5d1f700 1 --2- 172.21.15.62:0/2473558504 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27c00cebf0 0x7f27c00b67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:36.751 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.743+0000 7f27c5d1f700 1 --2- 172.21.15.62:0/2473558504 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f27c00cd2e0 0x7f27c00cab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:36.751 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.743+0000 7f27c5d1f700 1 -- 172.21.15.62:0/2473558504 >> 172.21.15.62:0/2473558504 conn(0x7f27c0071840 msgr2=0x7f27c006bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:36.751 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.743+0000 7f27c5d1f700 1 -- 172.21.15.62:0/2473558504 shutdown_connections 2023-06-09T04:41:36.751 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.743+0000 7f27c5d1f700 1 -- 172.21.15.62:0/2473558504 wait complete. 2023-06-09T04:41:36.772 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T04:41:36.946 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.939+0000 7f72d2acb700 1 Processor -- start 2023-06-09T04:41:36.947 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.943+0000 7f72d2acb700 1 -- start start 2023-06-09T04:41:36.949 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.943+0000 7f72d2acb700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f72cc06f610 0x7f72cc0afb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:36.950 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.943+0000 7f72d2acb700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f72cc0b0090 0x7f72cc0c8720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:36.950 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.943+0000 7f72d2acb700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72cc0b04f0 con 0x7f72cc071730 2023-06-09T04:41:36.950 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.943+0000 7f72d2acb700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72cc15d860 con 0x7f72cc06f610 2023-06-09T04:41:36.950 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.943+0000 7f72d2acb700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72cc071b00 con 0x7f72cc0b0090 2023-06-09T04:41:36.951 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.943+0000 7f72d12c8700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f72cc06f610 0x7f72cc0afb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:36.951 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.943+0000 7f72d22ca700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f72cc0b0090 0x7f72cc0c8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:36.951 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.943+0000 7f72d12c8700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f72cc06f610 0x7f72cc0afb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53564/0 (socket says 172.21.15.62:53564) 2023-06-09T04:41:36.951 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.943+0000 7f72d12c8700 1 -- 172.21.15.62:0/503922956 learned_addr learned my addr 172.21.15.62:0/503922956 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:36.952 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.947+0000 7f72d12c8700 1 -- 172.21.15.62:0/503922956 >> v2:172.21.15.89:3300/0 conn(0x7f72cc0b0090 msgr2=0x7f72cc0c8720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:36.952 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.947+0000 7f72d12c8700 1 --2- 172.21.15.62:0/503922956 >> v2:172.21.15.89:3300/0 conn(0x7f72cc0b0090 0x7f72cc0c8720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:36.952 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.947+0000 7f72d12c8700 1 -- 172.21.15.62:0/503922956 >> v1:172.21.15.89:6789/0 conn(0x7f72cc071730 legacy=0x7f72cc0ca1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:36.952 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.947+0000 7f72d12c8700 1 -- 172.21.15.62:0/503922956 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72cc15dab0 con 0x7f72cc06f610 2023-06-09T04:41:36.953 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.947+0000 7f72d12c8700 1 --2- 172.21.15.62:0/503922956 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72cc06f610 0x7f72cc0afb50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f72cc06f210 tx=0x7f72bc009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d8a61a559f950e3 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:36.953 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.947+0000 7f72d0ac7700 1 -- 172.21.15.62:0/503922956 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72bc011830 con 0x7f72cc06f610 2023-06-09T04:41:36.953 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.947+0000 7f72d0ac7700 1 -- 172.21.15.62:0/503922956 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72bc011990 con 0x7f72cc06f610 2023-06-09T04:41:36.953 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.947+0000 7f72d0ac7700 1 -- 172.21.15.62:0/503922956 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72bc011d20 con 0x7f72cc06f610 2023-06-09T04:41:36.953 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.947+0000 7f72d2acb700 1 -- 172.21.15.62:0/503922956 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72cc06f610 msgr2=0x7f72cc0afb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:36.954 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.947+0000 7f72d2acb700 1 --2- 172.21.15.62:0/503922956 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72cc06f610 0x7f72cc0afb50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f72cc06f210 tx=0x7f72bc009bf0 comp rx=0 tx=0).stop 2023-06-09T04:41:36.954 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.947+0000 7f72d2acb700 1 -- 172.21.15.62:0/503922956 shutdown_connections 2023-06-09T04:41:36.954 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.947+0000 7f72d2acb700 1 --2- 172.21.15.62:0/503922956 >> v2:172.21.15.89:3300/0 conn(0x7f72cc0b0090 0x7f72cc0c8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:36.955 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.947+0000 7f72d2acb700 1 --2- 172.21.15.62:0/503922956 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72cc06f610 0x7f72cc0afb50 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:36.955 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.947+0000 7f72d2acb700 1 -- 172.21.15.62:0/503922956 >> 172.21.15.62:0/503922956 conn(0x7f72cc0cab50 msgr2=0x7f72cc0caf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:36.955 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.947+0000 7f72d2acb700 1 -- 172.21.15.62:0/503922956 shutdown_connections 2023-06-09T04:41:36.955 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.947+0000 7f72d2acb700 1 -- 172.21.15.62:0/503922956 wait complete. 2023-06-09T04:41:36.956 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.951+0000 7f72d2acb700 1 Processor -- start 2023-06-09T04:41:36.957 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.951+0000 7f72d2acb700 1 -- start start 2023-06-09T04:41:36.958 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.951+0000 7f72d2acb700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72cc06f610 0x7f72cc0c55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:36.958 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.951+0000 7f72d2acb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f72cc071730 0x7f72cc146610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:36.958 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.951+0000 7f72d2acb700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72cc0b0090 0x7f72cc0c7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:36.958 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.951+0000 7f72d2acb700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72cc15bb60 con 0x7f72cc06f610 2023-06-09T04:41:36.958 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.951+0000 7f72d2acb700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72cc0c5d20 con 0x7f72cc0b0090 2023-06-09T04:41:36.959 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.951+0000 7f72d2acb700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72cc0c8450 con 0x7f72cc071730 2023-06-09T04:41:36.959 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.951+0000 7f72d1ac9700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72cc06f610 0x7f72cc0c55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:36.960 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.951+0000 7f72d1ac9700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72cc06f610 0x7f72cc0c55d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53572/0 (socket says 172.21.15.62:53572) 2023-06-09T04:41:36.960 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.951+0000 7f72d1ac9700 1 -- 172.21.15.62:0/1518237362 learned_addr learned my addr 172.21.15.62:0/1518237362 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:36.960 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.955+0000 7f72d22ca700 1 --2- 172.21.15.62:0/1518237362 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72cc0b0090 0x7f72cc0c7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:36.960 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.955+0000 7f72d12c8700 1 --2- 172.21.15.62:0/1518237362 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f72cc071730 0x7f72cc146610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:36.960 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.955+0000 7f72d1ac9700 1 -- 172.21.15.62:0/1518237362 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f72cc071730 msgr2=0x7f72cc146610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:36.960 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.955+0000 7f72d1ac9700 1 --2- 172.21.15.62:0/1518237362 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f72cc071730 0x7f72cc146610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:36.960 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.955+0000 7f72d1ac9700 1 -- 172.21.15.62:0/1518237362 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72cc0b0090 msgr2=0x7f72cc0c7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:36.961 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.955+0000 7f72d1ac9700 1 --2- 172.21.15.62:0/1518237362 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72cc0b0090 0x7f72cc0c7920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:36.961 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.955+0000 7f72d1ac9700 1 -- 172.21.15.62:0/1518237362 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72bc009570 con 0x7f72cc06f610 2023-06-09T04:41:36.961 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.955+0000 7f72d1ac9700 1 --2- 172.21.15.62:0/1518237362 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72cc06f610 0x7f72cc0c55d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f72c800c530 tx=0x7f72c800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:36.961 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.955+0000 7f72c27fc700 1 -- 172.21.15.62:0/1518237362 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c80052d0 con 0x7f72cc06f610 2023-06-09T04:41:36.962 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.955+0000 7f72c27fc700 1 -- 172.21.15.62:0/1518237362 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72c8005430 con 0x7f72cc06f610 2023-06-09T04:41:36.962 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.955+0000 7f72d2acb700 1 -- 172.21.15.62:0/1518237362 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72cc15b4e0 con 0x7f72cc06f610 2023-06-09T04:41:36.962 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.955+0000 7f72c27fc700 1 -- 172.21.15.62:0/1518237362 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c80055a0 con 0x7f72cc06f610 2023-06-09T04:41:36.962 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.955+0000 7f72d2acb700 1 -- 172.21.15.62:0/1518237362 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72cc15b780 con 0x7f72cc06f610 2023-06-09T04:41:36.962 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.955+0000 7f72d2acb700 1 -- 172.21.15.62:0/1518237362 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72cc15b340 con 0x7f72cc06f610 2023-06-09T04:41:36.963 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.959+0000 7f72c27fc700 1 -- 172.21.15.62:0/1518237362 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f72c80038e0 con 0x7f72cc06f610 2023-06-09T04:41:36.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.959+0000 7f72c27fc700 1 --2- 172.21.15.62:0/1518237362 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f72b00662f0 0x7f72b00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:36.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.959+0000 7f72c27fc700 1 -- 172.21.15.62:0/1518237362 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f72c80834f0 con 0x7f72cc06f610 2023-06-09T04:41:36.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.959+0000 7f72d12c8700 1 --2- 172.21.15.62:0/1518237362 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f72b00662f0 0x7f72b00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:36.966 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.959+0000 7f72d12c8700 1 --2- 172.21.15.62:0/1518237362 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f72b00662f0 0x7f72b00687a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f72bc000c00 tx=0x7f72bc008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:36.970 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:36.963+0000 7f72c27fc700 1 -- 172.21.15.62:0/1518237362 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f72cc15b340 con 0x7f72cc06f610 2023-06-09T04:41:37.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.139+0000 7f72d2acb700 1 -- 172.21.15.62:0/1518237362 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f72cc15b340 con 0x7f72cc06f610 2023-06-09T04:41:37.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.139+0000 7f72c27fc700 1 -- 172.21.15.62:0/1518237362 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f72cc15b340 con 0x7f72cc06f610 2023-06-09T04:41:37.145 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 64 2023-06-09T04:41:37.149 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.143+0000 7f72d2acb700 1 -- 172.21.15.62:0/1518237362 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f72b00662f0 msgr2=0x7f72b00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:37.149 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.143+0000 7f72d2acb700 1 --2- 172.21.15.62:0/1518237362 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f72b00662f0 0x7f72b00687a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f72bc000c00 tx=0x7f72bc008030 comp rx=0 tx=0).stop 2023-06-09T04:41:37.149 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.143+0000 7f72d2acb700 1 -- 172.21.15.62:0/1518237362 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72cc06f610 msgr2=0x7f72cc0c55d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:37.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.143+0000 7f72d2acb700 1 --2- 172.21.15.62:0/1518237362 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72cc06f610 0x7f72cc0c55d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f72c800c530 tx=0x7f72c800c8f0 comp rx=0 tx=0).stop 2023-06-09T04:41:37.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.143+0000 7f72d2acb700 1 -- 172.21.15.62:0/1518237362 shutdown_connections 2023-06-09T04:41:37.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.143+0000 7f72d2acb700 1 --2- 172.21.15.62:0/1518237362 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f72b00662f0 0x7f72b00687a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:37.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.143+0000 7f72d2acb700 1 --2- 172.21.15.62:0/1518237362 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72cc0b0090 0x7f72cc0c7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:37.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.143+0000 7f72d2acb700 1 --2- 172.21.15.62:0/1518237362 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f72cc071730 0x7f72cc146610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:37.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.143+0000 7f72d2acb700 1 --2- 172.21.15.62:0/1518237362 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72cc06f610 0x7f72cc0c55d0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:37.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.143+0000 7f72d2acb700 1 -- 172.21.15.62:0/1518237362 >> 172.21.15.62:0/1518237362 conn(0x7f72cc0cab50 msgr2=0x7f72cc0b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:37.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.143+0000 7f72d2acb700 1 -- 172.21.15.62:0/1518237362 shutdown_connections 2023-06-09T04:41:37.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.143+0000 7f72d2acb700 1 -- 172.21.15.62:0/1518237362 wait complete. 2023-06-09T04:41:37.171 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-09T04:41:37.352 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.347+0000 7fe67a491700 1 Processor -- start 2023-06-09T04:41:37.353 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.347+0000 7fe67a491700 1 -- start start 2023-06-09T04:41:37.354 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.347+0000 7fe67a491700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe67415c190 0x7fe6740d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:37.355 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.347+0000 7fe67a491700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe6740b16a0 0x7fe6740d07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:37.355 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.347+0000 7fe67a491700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe67406bac0 con 0x7fe6740b1bf0 2023-06-09T04:41:37.355 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.347+0000 7fe67a491700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe67406aa20 con 0x7fe6740b16a0 2023-06-09T04:41:37.355 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.347+0000 7fe67a491700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe67406ad00 con 0x7fe67415c190 2023-06-09T04:41:37.356 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.351+0000 7fe66bfff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe6740b16a0 0x7fe6740d07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:37.356 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.351+0000 7fe673fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe67415c190 0x7fe6740d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:37.356 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.351+0000 7fe673fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe67415c190 0x7fe6740d0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.62:44518/0 (socket says 172.21.15.62:44518) 2023-06-09T04:41:37.356 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.351+0000 7fe673fff700 1 -- 172.21.15.62:0/2055716710 learned_addr learned my addr 172.21.15.62:0/2055716710 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:37.357 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.351+0000 7fe66bfff700 1 -- 172.21.15.62:0/2055716710 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe67415c190 msgr2=0x7fe6740d0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:37.357 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.351+0000 7fe66bfff700 1 --2- 172.21.15.62:0/2055716710 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe67415c190 0x7fe6740d0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:37.357 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.351+0000 7fe66bfff700 1 -- 172.21.15.62:0/2055716710 >> v1:172.21.15.89:6789/0 conn(0x7fe6740b1bf0 legacy=0x7fe67415fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:37.357 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.351+0000 7fe66bfff700 1 -- 172.21.15.62:0/2055716710 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe67406afe0 con 0x7fe6740b16a0 2023-06-09T04:41:37.358 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.351+0000 7fe6737fe700 1 -- 172.21.15.62:0/2055716710 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2961596249 0 0) 0x7fe67406bac0 con 0x7fe6740b1bf0 2023-06-09T04:41:37.358 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.351+0000 7fe66bfff700 1 --2- 172.21.15.62:0/2055716710 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6740b16a0 0x7fe6740d07b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe65c009850 tx=0x7fe65c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d47fd0a0d4c46b2 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:37.358 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.351+0000 7fe6737fe700 1 -- 172.21.15.62:0/2055716710 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65c011830 con 0x7fe6740b16a0 2023-06-09T04:41:37.358 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.351+0000 7fe6737fe700 1 -- 172.21.15.62:0/2055716710 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe65c011990 con 0x7fe6740b16a0 2023-06-09T04:41:37.359 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.351+0000 7fe6737fe700 1 -- 172.21.15.62:0/2055716710 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65c011d40 con 0x7fe6740b16a0 2023-06-09T04:41:37.359 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.351+0000 7fe67a491700 1 -- 172.21.15.62:0/2055716710 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6740b16a0 msgr2=0x7fe6740d07b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:37.360 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.351+0000 7fe67a491700 1 --2- 172.21.15.62:0/2055716710 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6740b16a0 0x7fe6740d07b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe65c009850 tx=0x7fe65c009b60 comp rx=0 tx=0).stop 2023-06-09T04:41:37.360 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.351+0000 7fe67a491700 1 -- 172.21.15.62:0/2055716710 shutdown_connections 2023-06-09T04:41:37.360 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.351+0000 7fe67a491700 1 --2- 172.21.15.62:0/2055716710 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6740b16a0 0x7fe6740d07b0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:37.360 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.351+0000 7fe67a491700 1 --2- 172.21.15.62:0/2055716710 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe67415c190 0x7fe6740d0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:37.360 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.351+0000 7fe67a491700 1 -- 172.21.15.62:0/2055716710 >> 172.21.15.62:0/2055716710 conn(0x7fe674071840 msgr2=0x7fe67409b970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:37.360 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.351+0000 7fe67a491700 1 -- 172.21.15.62:0/2055716710 shutdown_connections 2023-06-09T04:41:37.360 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.351+0000 7fe67a491700 1 -- 172.21.15.62:0/2055716710 wait complete. 2023-06-09T04:41:37.362 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.355+0000 7fe67a491700 1 Processor -- start 2023-06-09T04:41:37.362 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.355+0000 7fe67a491700 1 -- start start 2023-06-09T04:41:37.364 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.359+0000 7fe67a491700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe6740b16a0 0x7fe674155f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:37.364 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.359+0000 7fe67a491700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6740b1bf0 0x7fe6740c61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:37.364 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.359+0000 7fe67a491700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe67415c190 0x7fe6740c8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:37.364 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.359+0000 7fe67a491700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe67415de90 con 0x7fe6740b1bf0 2023-06-09T04:41:37.364 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.359+0000 7fe67a491700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe67415e150 con 0x7fe67415c190 2023-06-09T04:41:37.365 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.359+0000 7fe67a491700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe67415e430 con 0x7fe6740b16a0 2023-06-09T04:41:37.366 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.359+0000 7fe66bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6740b1bf0 0x7fe6740c61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:37.367 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.359+0000 7fe66bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6740b1bf0 0x7fe6740c61d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53592/0 (socket says 172.21.15.62:53592) 2023-06-09T04:41:37.367 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.359+0000 7fe673fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe6740b16a0 0x7fe674155f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:37.367 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.359+0000 7fe66bfff700 1 -- 172.21.15.62:0/907932846 learned_addr learned my addr 172.21.15.62:0/907932846 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:37.367 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.359+0000 7fe678a2e700 1 --2- 172.21.15.62:0/907932846 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe67415c190 0x7fe6740c8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:37.367 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.359+0000 7fe66bfff700 1 -- 172.21.15.62:0/907932846 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe6740b16a0 msgr2=0x7fe674155f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:37.367 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.359+0000 7fe66bfff700 1 --2- 172.21.15.62:0/907932846 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe6740b16a0 0x7fe674155f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:37.367 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.359+0000 7fe66bfff700 1 -- 172.21.15.62:0/907932846 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe67415c190 msgr2=0x7fe6740c8c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:37.368 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.359+0000 7fe66bfff700 1 --2- 172.21.15.62:0/907932846 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe67415c190 0x7fe6740c8c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:37.368 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.359+0000 7fe66bfff700 1 -- 172.21.15.62:0/907932846 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe65c0094b0 con 0x7fe6740b1bf0 2023-06-09T04:41:37.368 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.359+0000 7fe678a2e700 1 --2- 172.21.15.62:0/907932846 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe67415c190 0x7fe6740c8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:41:37.368 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.359+0000 7fe66bfff700 1 --2- 172.21.15.62:0/907932846 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6740b1bf0 0x7fe6740c61d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe65c000c00 tx=0x7fe65c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:37.368 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.359+0000 7fe6717fa700 1 -- 172.21.15.62:0/907932846 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65c019a00 con 0x7fe6740b1bf0 2023-06-09T04:41:37.368 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.359+0000 7fe6717fa700 1 -- 172.21.15.62:0/907932846 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe65c01e070 con 0x7fe6740b1bf0 2023-06-09T04:41:37.368 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.359+0000 7fe6717fa700 1 -- 172.21.15.62:0/907932846 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65c019da0 con 0x7fe6740b1bf0 2023-06-09T04:41:37.369 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.359+0000 7fe67a491700 1 -- 172.21.15.62:0/907932846 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe67415e710 con 0x7fe6740b1bf0 2023-06-09T04:41:37.369 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.359+0000 7fe67a491700 1 -- 172.21.15.62:0/907932846 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe67415ecd0 con 0x7fe6740b1bf0 2023-06-09T04:41:37.369 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.363+0000 7fe67a491700 1 -- 172.21.15.62:0/907932846 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6740d3640 con 0x7fe6740b1bf0 2023-06-09T04:41:37.370 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.363+0000 7fe6717fa700 1 -- 172.21.15.62:0/907932846 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe65c02d450 con 0x7fe6740b1bf0 2023-06-09T04:41:37.372 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.367+0000 7fe6717fa700 1 --2- 172.21.15.62:0/907932846 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fe6540662f0 0x7fe6540687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:37.372 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.367+0000 7fe6717fa700 1 -- 172.21.15.62:0/907932846 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe65c084fd0 con 0x7fe6740b1bf0 2023-06-09T04:41:37.373 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.367+0000 7fe673fff700 1 --2- 172.21.15.62:0/907932846 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fe6540662f0 0x7fe6540687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:37.374 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.367+0000 7fe673fff700 1 --2- 172.21.15.62:0/907932846 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fe6540662f0 0x7fe6540687a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe6740b4500 tx=0x7fe6640092e0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:37.378 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.371+0000 7fe6717fa700 1 -- 172.21.15.62:0/907932846 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe65c052150 con 0x7fe6740b1bf0 2023-06-09T04:41:37.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.559+0000 7fe67a491700 1 -- 172.21.15.62:0/907932846 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe67415eec0 con 0x7fe6740b1bf0 2023-06-09T04:41:37.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.563+0000 7fe6717fa700 1 -- 172.21.15.62:0/907932846 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe65c015020 con 0x7fe6740b1bf0 2023-06-09T04:41:37.568 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-06-09T04:41:37.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.567+0000 7fe67a491700 1 -- 172.21.15.62:0/907932846 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fe6540662f0 msgr2=0x7fe6540687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:37.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.567+0000 7fe67a491700 1 --2- 172.21.15.62:0/907932846 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fe6540662f0 0x7fe6540687a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe6740b4500 tx=0x7fe6640092e0 comp rx=0 tx=0).stop 2023-06-09T04:41:37.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.567+0000 7fe67a491700 1 -- 172.21.15.62:0/907932846 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6740b1bf0 msgr2=0x7fe6740c61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:37.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.567+0000 7fe67a491700 1 --2- 172.21.15.62:0/907932846 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6740b1bf0 0x7fe6740c61d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe65c000c00 tx=0x7fe65c004770 comp rx=0 tx=0).stop 2023-06-09T04:41:37.574 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.567+0000 7fe67a491700 1 -- 172.21.15.62:0/907932846 shutdown_connections 2023-06-09T04:41:37.574 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.567+0000 7fe67a491700 1 --2- 172.21.15.62:0/907932846 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fe6540662f0 0x7fe6540687a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:37.574 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.567+0000 7fe67a491700 1 --2- 172.21.15.62:0/907932846 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe67415c190 0x7fe6740c8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:37.574 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.567+0000 7fe67a491700 1 --2- 172.21.15.62:0/907932846 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe6740b1bf0 0x7fe6740c61d0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:37.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.567+0000 7fe67a491700 1 --2- 172.21.15.62:0/907932846 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe6740b16a0 0x7fe674155f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:37.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.567+0000 7fe67a491700 1 -- 172.21.15.62:0/907932846 >> 172.21.15.62:0/907932846 conn(0x7fe674071840 msgr2=0x7fe674159780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:37.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.567+0000 7fe67a491700 1 -- 172.21.15.62:0/907932846 shutdown_connections 2023-06-09T04:41:37.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.567+0000 7fe67a491700 1 -- 172.21.15.62:0/907932846 wait complete. 2023-06-09T04:41:37.595 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-09T04:41:37.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.767+0000 7f8675381700 1 Processor -- start 2023-06-09T04:41:37.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.767+0000 7f8675381700 1 -- start start 2023-06-09T04:41:37.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.771+0000 7f8675381700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f867006afc0 0x7f86700ce6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:37.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.771+0000 7f8675381700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86700cec10 con 0x7f86700b5280 2023-06-09T04:41:37.776 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.771+0000 7f8675381700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86700ccb20 con 0x7f86700cee40 2023-06-09T04:41:37.776 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.771+0000 7f8675381700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86700cce00 con 0x7f867006afc0 2023-06-09T04:41:37.777 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.771+0000 7f866f7fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f86700b5280 0x7f86700d12b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36306/0 (socket says 172.21.15.62:36306) 2023-06-09T04:41:37.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.771+0000 7f866f7fe700 1 -- 172.21.15.62:0/4280923836 learned_addr learned my addr 172.21.15.62:0/4280923836 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:41:37.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.771+0000 7f8667fff700 1 --2- 172.21.15.62:0/4280923836 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f867006afc0 0x7f86700ce6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:37.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.771+0000 7f866e7fc700 1 -- 172.21.15.62:0/4280923836 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 143563942 0 0) 0x7f86700cec10 con 0x7f86700b5280 2023-06-09T04:41:37.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.771+0000 7f866e7fc700 1 -- 172.21.15.62:0/4280923836 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f865c0035d0 con 0x7f86700b5280 2023-06-09T04:41:37.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.771+0000 7f866e7fc700 1 -- 172.21.15.62:0/4280923836 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3039209067 0 0) 0x7f86700ccb20 con 0x7f86700cee40 2023-06-09T04:41:37.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.771+0000 7f866e7fc700 1 -- 172.21.15.62:0/4280923836 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86700cec10 con 0x7f86700cee40 2023-06-09T04:41:37.779 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.771+0000 7f866e7fc700 1 -- 172.21.15.62:0/4280923836 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2691496622 0 0) 0x7f865c0035d0 con 0x7f86700b5280 2023-06-09T04:41:37.779 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.771+0000 7f866e7fc700 1 -- 172.21.15.62:0/4280923836 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f867006afc0 msgr2=0x7f86700ce6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:37.779 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.771+0000 7f866e7fc700 1 --2- 172.21.15.62:0/4280923836 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f867006afc0 0x7f86700ce6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:37.779 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.771+0000 7f866e7fc700 1 -- 172.21.15.62:0/4280923836 >> v1:172.21.15.89:6789/0 conn(0x7f86700cee40 legacy=0x7f86700cf210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:37.779 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.771+0000 7f866e7fc700 1 -- 172.21.15.62:0/4280923836 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86700cd0e0 con 0x7f86700b5280 2023-06-09T04:41:37.779 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.771+0000 7f866e7fc700 1 -- 172.21.15.62:0/4280923836 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 540845019 0 0) 0x7f86680019f0 con 0x7f86700b5280 2023-06-09T04:41:37.779 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.771+0000 7f866e7fc700 1 -- 172.21.15.62:0/4280923836 >> v1:172.21.15.62:6789/0 conn(0x7f86700b5280 legacy=0x7f86700d12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:37.779 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.771+0000 7f866e7fc700 1 --2- 172.21.15.62:0/4280923836 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f865c003be0 0x7f865c003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:37.780 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.771+0000 7f866e7fc700 1 --2- 172.21.15.62:0/4280923836 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f865c004870 0x7f865c004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:37.780 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.771+0000 7f866e7fc700 1 --2- 172.21.15.62:0/4280923836 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f867006afc0 0x7f865c005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:37.780 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.771+0000 7f866e7fc700 1 -- 172.21.15.62:0/4280923836 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86700cce00 con 0x7f865c003be0 2023-06-09T04:41:37.780 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.771+0000 7f866e7fc700 1 -- 172.21.15.62:0/4280923836 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f865c00bb10 con 0x7f865c004870 2023-06-09T04:41:37.780 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.771+0000 7f866e7fc700 1 -- 172.21.15.62:0/4280923836 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f865c00bcd0 con 0x7f867006afc0 2023-06-09T04:41:37.780 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.771+0000 7f866effd700 1 --2- 172.21.15.62:0/4280923836 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f865c003be0 0x7f865c003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:37.780 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.771+0000 7f866f7fe700 1 --2- 172.21.15.62:0/4280923836 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f867006afc0 0x7f865c005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:37.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.771+0000 7f866effd700 1 -- 172.21.15.62:0/4280923836 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f867006afc0 msgr2=0x7f865c005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:37.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.771+0000 7f866effd700 1 --2- 172.21.15.62:0/4280923836 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f867006afc0 0x7f865c005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:37.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.771+0000 7f866effd700 1 -- 172.21.15.62:0/4280923836 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f865c004870 msgr2=0x7f865c004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:37.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.771+0000 7f866effd700 1 --2- 172.21.15.62:0/4280923836 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f865c004870 0x7f865c004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:37.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.771+0000 7f866effd700 1 -- 172.21.15.62:0/4280923836 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f865c0035d0 con 0x7f865c003be0 2023-06-09T04:41:37.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.771+0000 7f866effd700 1 --2- 172.21.15.62:0/4280923836 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f865c003be0 0x7f865c003fd0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8660001960 tx=0x7f865c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb939ac3a0e08aca server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:37.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.771+0000 7f866e7fc700 1 -- 172.21.15.62:0/4280923836 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8660001450 con 0x7f865c003be0 2023-06-09T04:41:37.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.775+0000 7f866e7fc700 1 -- 172.21.15.62:0/4280923836 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86600052f0 con 0x7f865c003be0 2023-06-09T04:41:37.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.775+0000 7f866e7fc700 1 -- 172.21.15.62:0/4280923836 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86600036a0 con 0x7f865c003be0 2023-06-09T04:41:37.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.775+0000 7f8675381700 1 -- 172.21.15.62:0/4280923836 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f865c003be0 msgr2=0x7f865c003fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:37.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.775+0000 7f8675381700 1 --2- 172.21.15.62:0/4280923836 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f865c003be0 0x7f865c003fd0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8660001960 tx=0x7f865c0058a0 comp rx=0 tx=0).stop 2023-06-09T04:41:37.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.775+0000 7f866f7fe700 1 -- 172.21.15.62:0/4280923836 reap_dead start 2023-06-09T04:41:37.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.775+0000 7f8675381700 1 -- 172.21.15.62:0/4280923836 shutdown_connections 2023-06-09T04:41:37.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.775+0000 7f8675381700 1 -- 172.21.15.62:0/4280923836 >> 172.21.15.62:0/4280923836 conn(0x7f867006a4b0 msgr2=0x7f867006a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:37.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.775+0000 7f8675381700 1 -- 172.21.15.62:0/4280923836 shutdown_connections 2023-06-09T04:41:37.784 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.775+0000 7f8675381700 1 -- 172.21.15.62:0/4280923836 wait complete. 2023-06-09T04:41:37.785 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.775+0000 7f8675381700 1 Processor -- start 2023-06-09T04:41:37.785 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.775+0000 7f8675381700 1 -- start start 2023-06-09T04:41:37.785 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.779+0000 7f8675381700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f865c003be0 0x7f86700c84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:37.785 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.779+0000 7f8675381700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f86700c8a10 0x7f86700cbd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:37.785 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.779+0000 7f8675381700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86700cc240 0x7f8670155010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:37.785 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.779+0000 7f8675381700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86701f0be0 con 0x7f86700c8a10 2023-06-09T04:41:37.786 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.779+0000 7f8675381700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86701f0df0 con 0x7f86700cc240 2023-06-09T04:41:37.786 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.779+0000 7f8675381700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86701f10d0 con 0x7f865c003be0 2023-06-09T04:41:37.786 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.779+0000 7f8667fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f86700c8a10 0x7f86700cbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:37.786 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.779+0000 7f8667fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f86700c8a10 0x7f86700cbd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53602/0 (socket says 172.21.15.62:53602) 2023-06-09T04:41:37.786 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.779+0000 7f8667fff700 1 -- 172.21.15.62:0/699894391 learned_addr learned my addr 172.21.15.62:0/699894391 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:37.786 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.779+0000 7f866effd700 1 --2- 172.21.15.62:0/699894391 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f865c003be0 0x7f86700c84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:37.786 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.779+0000 7f866f7fe700 1 --2- 172.21.15.62:0/699894391 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86700cc240 0x7f8670155010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:37.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.779+0000 7f8667fff700 1 -- 172.21.15.62:0/699894391 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f865c003be0 msgr2=0x7f86700c84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:37.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.779+0000 7f8667fff700 1 --2- 172.21.15.62:0/699894391 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f865c003be0 0x7f86700c84d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:37.788 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.779+0000 7f8667fff700 1 -- 172.21.15.62:0/699894391 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86700cc240 msgr2=0x7f8670155010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:37.788 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.779+0000 7f8667fff700 1 --2- 172.21.15.62:0/699894391 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86700cc240 0x7f8670155010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:37.788 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.779+0000 7f8667fff700 1 -- 172.21.15.62:0/699894391 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86701f13b0 con 0x7f86700c8a10 2023-06-09T04:41:37.788 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.779+0000 7f8667fff700 1 --2- 172.21.15.62:0/699894391 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f86700c8a10 0x7f86700cbd00 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f865800e850 tx=0x7f865800eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:37.788 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.779+0000 7f86677fe700 1 -- 172.21.15.62:0/699894391 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8658013680 con 0x7f86700c8a10 2023-06-09T04:41:37.788 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.779+0000 7f86677fe700 1 -- 172.21.15.62:0/699894391 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86580137e0 con 0x7f86700c8a10 2023-06-09T04:41:37.788 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.779+0000 7f86677fe700 1 -- 172.21.15.62:0/699894391 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8658013b90 con 0x7f86700c8a10 2023-06-09T04:41:37.789 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.779+0000 7f8675381700 1 -- 172.21.15.62:0/699894391 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86701f1690 con 0x7f86700c8a10 2023-06-09T04:41:37.789 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.779+0000 7f8675381700 1 -- 172.21.15.62:0/699894391 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8670155550 con 0x7f86700c8a10 2023-06-09T04:41:37.789 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.783+0000 7f8675381700 1 -- 172.21.15.62:0/699894391 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86700008d0 con 0x7f86700c8a10 2023-06-09T04:41:37.790 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.783+0000 7f86677fe700 1 -- 172.21.15.62:0/699894391 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8658013cf0 con 0x7f86700c8a10 2023-06-09T04:41:37.791 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.787+0000 7f86677fe700 1 --2- 172.21.15.62:0/699894391 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f86500662f0 0x7f86500687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:37.791 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.787+0000 7f86677fe700 1 -- 172.21.15.62:0/699894391 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f8658083ff0 con 0x7f86700c8a10 2023-06-09T04:41:37.792 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.787+0000 7f866effd700 1 --2- 172.21.15.62:0/699894391 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f86500662f0 0x7f86500687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:37.793 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.787+0000 7f866effd700 1 --2- 172.21.15.62:0/699894391 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f86500662f0 0x7f86500687a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8660015040 tx=0x7f866000a000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:37.797 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:37.791+0000 7f86677fe700 1 -- 172.21.15.62:0/699894391 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f86580510a0 con 0x7f86700c8a10 2023-06-09T04:41:38.012 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.007+0000 7f8675381700 1 -- 172.21.15.62:0/699894391 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8670067b20 con 0x7f86700c8a10 2023-06-09T04:41:38.013 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.007+0000 7f86677fe700 1 -- 172.21.15.62:0/699894391 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4664 (secure 0 0 0) 0x7f86580546c0 con 0x7f86700c8a10 2023-06-09T04:41:38.014 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:41:38.014 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4256,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/2242182358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2242182358},{"type":"v1","addr":"172.21.15.89:6836","nonce":2242182358}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6834/326702802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":326702802},{"type":"v1","addr":"172.21.15.62:6834","nonce":326702802}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4296,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/3851882562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":3851882562},{"type":"v1","addr":"172.21.15.62:6835","nonce":3851882562}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-09T04:40:56.758756+0000","modified":"2023-06-09T04:41:23.381650+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4312},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4312":{"gid":4312,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6837/1496954959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1496954959},{"type":"v1","addr":"172.21.15.89:6837","nonce":1496954959}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-09T04:41:38.017 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.011+0000 7f8675381700 1 -- 172.21.15.62:0/699894391 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f86500662f0 msgr2=0x7f86500687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:38.017 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.011+0000 7f8675381700 1 --2- 172.21.15.62:0/699894391 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f86500662f0 0x7f86500687a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8660015040 tx=0x7f866000a000 comp rx=0 tx=0).stop 2023-06-09T04:41:38.017 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.011+0000 7f8675381700 1 -- 172.21.15.62:0/699894391 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f86700c8a10 msgr2=0x7f86700cbd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:38.017 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.011+0000 7f8675381700 1 --2- 172.21.15.62:0/699894391 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f86700c8a10 0x7f86700cbd00 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f865800e850 tx=0x7f865800eb60 comp rx=0 tx=0).stop 2023-06-09T04:41:38.017 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.011+0000 7f8675381700 1 -- 172.21.15.62:0/699894391 shutdown_connections 2023-06-09T04:41:38.018 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.011+0000 7f8675381700 1 --2- 172.21.15.62:0/699894391 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f86500662f0 0x7f86500687a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:38.018 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.011+0000 7f8675381700 1 --2- 172.21.15.62:0/699894391 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f86700cc240 0x7f8670155010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:38.018 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.011+0000 7f8675381700 1 --2- 172.21.15.62:0/699894391 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f86700c8a10 0x7f86700cbd00 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:38.018 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.011+0000 7f8675381700 1 --2- 172.21.15.62:0/699894391 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f865c003be0 0x7f86700c84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:38.018 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.011+0000 7f8675381700 1 -- 172.21.15.62:0/699894391 >> 172.21.15.62:0/699894391 conn(0x7f867006a4b0 msgr2=0x7f86700b75d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:38.018 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.011+0000 7f8675381700 1 -- 172.21.15.62:0/699894391 shutdown_connections 2023-06-09T04:41:38.018 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.011+0000 7f8675381700 1 -- 172.21.15.62:0/699894391 wait complete. 2023-06-09T04:41:38.019 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 9 2023-06-09T04:41:38.039 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:41:38.208 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.203+0000 7fb0b83ba700 1 Processor -- start 2023-06-09T04:41:38.209 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.203+0000 7fb0b83ba700 1 -- start start 2023-06-09T04:41:38.213 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.207+0000 7fb0b83ba700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb0b0159c90 0x7fb0b0070e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:38.213 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.207+0000 7fb0b83ba700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0b00cb850 0x7fb0b0071340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:38.213 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.207+0000 7fb0b83ba700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb0b00b08d0 0x7fb0b00ca160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:38.213 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.207+0000 7fb0b83ba700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0b006b960 con 0x7fb0b00b08d0 2023-06-09T04:41:38.213 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.207+0000 7fb0b83ba700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0b0071880 con 0x7fb0b0159c90 2023-06-09T04:41:38.213 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.207+0000 7fb0b83ba700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b006f9b0 con 0x7fb0b00cb850 2023-06-09T04:41:38.214 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.207+0000 7fb0b6957700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb0b00b08d0 0x7fb0b00ca160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:38.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.207+0000 7fb0b6957700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb0b00b08d0 0x7fb0b00ca160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53612/0 (socket says 172.21.15.62:53612) 2023-06-09T04:41:38.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.207+0000 7fb0b5955700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0b00cb850 0x7fb0b0071340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:38.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.207+0000 7fb0b6957700 1 -- 172.21.15.62:0/1039957297 learned_addr learned my addr 172.21.15.62:0/1039957297 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:38.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.207+0000 7fb0b6156700 1 --2- 172.21.15.62:0/1039957297 >> v2:172.21.15.89:3300/0 conn(0x7fb0b0159c90 0x7fb0b0070e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:38.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.207+0000 7fb0b6957700 1 -- 172.21.15.62:0/1039957297 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0b00cb850 msgr2=0x7fb0b0071340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:38.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.207+0000 7fb0b6957700 1 --2- 172.21.15.62:0/1039957297 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0b00cb850 0x7fb0b0071340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:38.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.207+0000 7fb0b6957700 1 -- 172.21.15.62:0/1039957297 >> v2:172.21.15.89:3300/0 conn(0x7fb0b0159c90 msgr2=0x7fb0b0070e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:38.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.207+0000 7fb0b6957700 1 --2- 172.21.15.62:0/1039957297 >> v2:172.21.15.89:3300/0 conn(0x7fb0b0159c90 0x7fb0b0070e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:38.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.207+0000 7fb0b6957700 1 -- 172.21.15.62:0/1039957297 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0b015a060 con 0x7fb0b00b08d0 2023-06-09T04:41:38.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.207+0000 7fb0b5955700 1 --2- 172.21.15.62:0/1039957297 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0b00cb850 0x7fb0b0071340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:41:38.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.207+0000 7fb0b6957700 1 --2- 172.21.15.62:0/1039957297 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0b00b08d0 0x7fb0b00ca160 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0066cf0 tx=0x7fb0a800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0f14e2700c13e8d server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:38.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.211+0000 7fb0b5154700 1 -- 172.21.15.62:0/1039957297 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a800e070 con 0x7fb0b00b08d0 2023-06-09T04:41:38.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.211+0000 7fb0b5154700 1 -- 172.21.15.62:0/1039957297 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0a800b9c0 con 0x7fb0b00b08d0 2023-06-09T04:41:38.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.211+0000 7fb0b5154700 1 -- 172.21.15.62:0/1039957297 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a800bd70 con 0x7fb0b00b08d0 2023-06-09T04:41:38.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.211+0000 7fb0b83ba700 1 -- 172.21.15.62:0/1039957297 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0b00b08d0 msgr2=0x7fb0b00ca160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:38.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.211+0000 7fb0b83ba700 1 --2- 172.21.15.62:0/1039957297 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0b00b08d0 0x7fb0b00ca160 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0066cf0 tx=0x7fb0a800b330 comp rx=0 tx=0).stop 2023-06-09T04:41:38.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.211+0000 7fb0b83ba700 1 -- 172.21.15.62:0/1039957297 shutdown_connections 2023-06-09T04:41:38.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.211+0000 7fb0b83ba700 1 --2- 172.21.15.62:0/1039957297 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0b00b08d0 0x7fb0b00ca160 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:38.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.211+0000 7fb0b83ba700 1 --2- 172.21.15.62:0/1039957297 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0b00cb850 0x7fb0b0071340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:38.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.211+0000 7fb0b83ba700 1 --2- 172.21.15.62:0/1039957297 >> v2:172.21.15.89:3300/0 conn(0x7fb0b0159c90 0x7fb0b0070e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:38.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.211+0000 7fb0b83ba700 1 -- 172.21.15.62:0/1039957297 >> 172.21.15.62:0/1039957297 conn(0x7fb0b006a410 msgr2=0x7fb0b00afd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:38.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.211+0000 7fb0b83ba700 1 -- 172.21.15.62:0/1039957297 shutdown_connections 2023-06-09T04:41:38.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.211+0000 7fb0b83ba700 1 -- 172.21.15.62:0/1039957297 wait complete. 2023-06-09T04:41:38.219 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.215+0000 7fb0b83ba700 1 Processor -- start 2023-06-09T04:41:38.219 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.215+0000 7fb0b83ba700 1 -- start start 2023-06-09T04:41:38.221 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.215+0000 7fb0b83ba700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0b00b08d0 0x7fb0b00c7c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:38.221 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.215+0000 7fb0b83ba700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0b00cb850 0x7fb0b01460a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:38.221 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.215+0000 7fb0b83ba700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0b0159c90 0x7fb0b01588a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:38.222 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.215+0000 7fb0b83ba700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b015a620 con 0x7fb0b00cb850 2023-06-09T04:41:38.222 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.215+0000 7fb0b83ba700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b00c52c0 con 0x7fb0b00b08d0 2023-06-09T04:41:38.222 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.215+0000 7fb0b83ba700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b00c8140 con 0x7fb0b0159c90 2023-06-09T04:41:38.223 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.215+0000 7fb0b5955700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0b00cb850 0x7fb0b01460a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:38.223 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.215+0000 7fb0b5955700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0b00cb850 0x7fb0b01460a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53624/0 (socket says 172.21.15.62:53624) 2023-06-09T04:41:38.223 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.215+0000 7fb0b5955700 1 -- 172.21.15.62:0/4107508386 learned_addr learned my addr 172.21.15.62:0/4107508386 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:38.223 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.215+0000 7fb0b6957700 1 --2- 172.21.15.62:0/4107508386 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0b0159c90 0x7fb0b01588a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:38.223 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.215+0000 7fb0b6156700 1 --2- 172.21.15.62:0/4107508386 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0b00b08d0 0x7fb0b00c7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:38.223 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.215+0000 7fb0b5955700 1 -- 172.21.15.62:0/4107508386 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0b0159c90 msgr2=0x7fb0b01588a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:38.224 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.215+0000 7fb0b5955700 1 --2- 172.21.15.62:0/4107508386 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0b0159c90 0x7fb0b01588a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:38.224 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.215+0000 7fb0b5955700 1 -- 172.21.15.62:0/4107508386 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0b00b08d0 msgr2=0x7fb0b00c7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:38.224 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.215+0000 7fb0b5955700 1 --2- 172.21.15.62:0/4107508386 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0b00b08d0 0x7fb0b00c7c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:38.224 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.215+0000 7fb0b5955700 1 -- 172.21.15.62:0/4107508386 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0a8009b30 con 0x7fb0b00cb850 2023-06-09T04:41:38.224 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.215+0000 7fb0b5955700 1 --2- 172.21.15.62:0/4107508386 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0b00cb850 0x7fb0b01460a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb0a000d800 tx=0x7fb0a000dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:38.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.219+0000 7fb0a6ffd700 1 -- 172.21.15.62:0/4107508386 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a0004030 con 0x7fb0b00cb850 2023-06-09T04:41:38.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.219+0000 7fb0a6ffd700 1 -- 172.21.15.62:0/4107508386 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0a0004190 con 0x7fb0b00cb850 2023-06-09T04:41:38.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.219+0000 7fb0a6ffd700 1 -- 172.21.15.62:0/4107508386 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a0004520 con 0x7fb0b00cb850 2023-06-09T04:41:38.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.219+0000 7fb0b83ba700 1 -- 172.21.15.62:0/4107508386 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0b015cc50 con 0x7fb0b00cb850 2023-06-09T04:41:38.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.219+0000 7fb0b83ba700 1 -- 172.21.15.62:0/4107508386 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0b00c5510 con 0x7fb0b00cb850 2023-06-09T04:41:38.226 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.219+0000 7fb0b83ba700 1 -- 172.21.15.62:0/4107508386 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0b004db30 con 0x7fb0b00cb850 2023-06-09T04:41:38.226 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.219+0000 7fb0a6ffd700 1 -- 172.21.15.62:0/4107508386 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb0a00036c0 con 0x7fb0b00cb850 2023-06-09T04:41:38.228 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.223+0000 7fb0a6ffd700 1 --2- 172.21.15.62:0/4107508386 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fb0940662f0 0x7fb0940687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:38.229 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.223+0000 7fb0a6ffd700 1 -- 172.21.15.62:0/4107508386 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb0a00845e0 con 0x7fb0b00cb850 2023-06-09T04:41:38.229 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.223+0000 7fb0b6156700 1 --2- 172.21.15.62:0/4107508386 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fb0940662f0 0x7fb0940687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:38.230 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.223+0000 7fb0b6156700 1 --2- 172.21.15.62:0/4107508386 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fb0940662f0 0x7fb0940687a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb0ac009950 tx=0x7fb0ac008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:38.236 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.231+0000 7fb0a6ffd700 1 -- 172.21.15.62:0/4107508386 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb0a0051720 con 0x7fb0b00cb850 2023-06-09T04:41:38.412 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.407+0000 7fb0b83ba700 1 -- 172.21.15.62:0/4107508386 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb0b006cec0 con 0x7fb0b00cb850 2023-06-09T04:41:38.415 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.411+0000 7fb0a6ffd700 1 -- 172.21.15.62:0/4107508386 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20180 (secure 0 0 0) 0x7fb0a0054d40 con 0x7fb0b00cb850 2023-06-09T04:41:38.416 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:41:38.416 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":29,"fsid":"f7998a1e-e5a9-4202-abaa-70c0eaae1047","created":"2023-06-09T04:40:30.469588+0000","modified":"2023-06-09T04:41:37.485184+0000","last_up_change":"2023-06-09T04:40:43.120747+0000","last_in_change":"2023-06-09T04:40:33.568221+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:40:44.646921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:40:50.006643+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:40:55.031273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:40:55.773517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-09T04:40:58.845383+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bc50bbc0-dd08-42ed-804c-ec3029e36c19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6802","nonce":1295788017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6807","nonce":1295788017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6815","nonce":1295788017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6809","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6811","nonce":1295788017}]},"public_addr":"172.21.15.62:6802/1295788017","cluster_addr":"172.21.15.62:6807/1295788017","heartbeat_back_addr":"172.21.15.62:6815/1295788017","heartbeat_front_addr":"172.21.15.62:6811/1295788017","state":["exists","up"]},{"osd":1,"uuid":"8230b12d-e22f-4985-a584-4cc64404cdbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6825","nonce":4120692006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6827","nonce":4120692006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6831","nonce":4120692006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6829","nonce":4120692006}]},"public_addr":"172.21.15.62:6825/4120692006","cluster_addr":"172.21.15.62:6827/4120692006","heartbeat_back_addr":"172.21.15.62:6831/4120692006","heartbeat_front_addr":"172.21.15.62:6829/4120692006","state":["exists","up"]},{"osd":2,"uuid":"d0202506-dbe9-4e3c-9271-687929abf96a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6801","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6803","nonce":4169607876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6805","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6806","nonce":4169607876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6814","nonce":4169607876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6810","nonce":4169607876}]},"public_addr":"172.21.15.62:6803/4169607876","cluster_addr":"172.21.15.62:6806/4169607876","heartbeat_back_addr":"172.21.15.62:6814/4169607876","heartbeat_front_addr":"172.21.15.62:6810/4169607876","state":["exists","up"]},{"osd":3,"uuid":"f3c0298a-b075-4411-af50-e16cd74fdddb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6817","nonce":3268438986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6819","nonce":3268438986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6823","nonce":3268438986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6821","nonce":3268438986}]},"public_addr":"172.21.15.62:6817/3268438986","cluster_addr":"172.21.15.62:6819/3268438986","heartbeat_back_addr":"172.21.15.62:6823/3268438986","heartbeat_front_addr":"172.21.15.62:6821/3268438986","state":["exists","up"]},{"osd":4,"uuid":"1ab5c5ca-e74f-475a-a309-683cc0029928","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6817","nonce":3139617628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6819","nonce":3139617628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6823","nonce":3139617628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6821","nonce":3139617628}]},"public_addr":"172.21.15.89:6817/3139617628","cluster_addr":"172.21.15.89:6819/3139617628","heartbeat_back_addr":"172.21.15.89:6823/3139617628","heartbeat_front_addr":"172.21.15.89:6821/3139617628","state":["exists","up"]},{"osd":5,"uuid":"a933e184-bd8f-4369-a1ba-a68de53c578c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6825","nonce":2681723596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6827","nonce":2681723596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6831","nonce":2681723596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6829","nonce":2681723596}]},"public_addr":"172.21.15.89:6825/2681723596","cluster_addr":"172.21.15.89:6827/2681723596","heartbeat_back_addr":"172.21.15.89:6831/2681723596","heartbeat_front_addr":"172.21.15.89:6829/2681723596","state":["exists","up"]},{"osd":6,"uuid":"1ed7ad37-2eee-49a6-954c-b537e2b7f0ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6809","nonce":1657136033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6811","nonce":1657136033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6815","nonce":1657136033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6813","nonce":1657136033}]},"public_addr":"172.21.15.89:6809/1657136033","cluster_addr":"172.21.15.89:6811/1657136033","heartbeat_back_addr":"172.21.15.89:6815/1657136033","heartbeat_front_addr":"172.21.15.89:6813/1657136033","state":["exists","up"]},{"osd":7,"uuid":"6ed732e9-33ff-40df-9038-a9f1d1622671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6801","nonce":1710561686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6803","nonce":1710561686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6807","nonce":1710561686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6805","nonce":1710561686}]},"public_addr":"172.21.15.89:6801/1710561686","cluster_addr":"172.21.15.89:6803/1710561686","heartbeat_back_addr":"172.21.15.89:6807/1710561686","heartbeat_front_addr":"172.21.15.89:6805/1710561686","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.335803+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.419788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.179334+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.263310+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.071846+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.375627+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.282277+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.315997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.12","mappings":[{"from":1,"to":2}]},{"pgid":"4.19","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:41:38.418 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.411+0000 7fb0b83ba700 1 -- 172.21.15.62:0/4107508386 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fb0940662f0 msgr2=0x7fb0940687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:38.418 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.411+0000 7fb0b83ba700 1 --2- 172.21.15.62:0/4107508386 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fb0940662f0 0x7fb0940687a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb0ac009950 tx=0x7fb0ac008040 comp rx=0 tx=0).stop 2023-06-09T04:41:38.418 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.411+0000 7fb0b83ba700 1 -- 172.21.15.62:0/4107508386 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0b00cb850 msgr2=0x7fb0b01460a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:38.419 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.411+0000 7fb0b83ba700 1 --2- 172.21.15.62:0/4107508386 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0b00cb850 0x7fb0b01460a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb0a000d800 tx=0x7fb0a000dbc0 comp rx=0 tx=0).stop 2023-06-09T04:41:38.419 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.411+0000 7fb0b83ba700 1 -- 172.21.15.62:0/4107508386 shutdown_connections 2023-06-09T04:41:38.419 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.411+0000 7fb0b83ba700 1 --2- 172.21.15.62:0/4107508386 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fb0940662f0 0x7fb0940687a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:38.420 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.411+0000 7fb0b83ba700 1 --2- 172.21.15.62:0/4107508386 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0b0159c90 0x7fb0b01588a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:38.420 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.411+0000 7fb0b83ba700 1 --2- 172.21.15.62:0/4107508386 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0b00cb850 0x7fb0b01460a0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:38.420 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.411+0000 7fb0b83ba700 1 --2- 172.21.15.62:0/4107508386 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0b00b08d0 0x7fb0b00c7c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:38.420 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.411+0000 7fb0b83ba700 1 -- 172.21.15.62:0/4107508386 >> 172.21.15.62:0/4107508386 conn(0x7fb0b006a410 msgr2=0x7fb0b01575b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:38.420 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.411+0000 7fb0b83ba700 1 -- 172.21.15.62:0/4107508386 shutdown_connections 2023-06-09T04:41:38.420 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.415+0000 7fb0b83ba700 1 -- 172.21.15.62:0/4107508386 wait complete. 2023-06-09T04:41:38.442 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-09T04:41:38.623 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.619+0000 7fe555bca700 1 Processor -- start 2023-06-09T04:41:38.624 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.619+0000 7fe555bca700 1 -- start start 2023-06-09T04:41:38.625 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.619+0000 7fe555bca700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5500ca5b0 0x7fe5500cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:38.626 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.619+0000 7fe555bca700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe550071180 con 0x7fe5500cd4f0 2023-06-09T04:41:38.626 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.619+0000 7fe555bca700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5500cc180 con 0x7fe550159a40 2023-06-09T04:41:38.626 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.619+0000 7fe555bca700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5500cbc00 con 0x7fe5500ca5b0 2023-06-09T04:41:38.626 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.619+0000 7fe54ffff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fe5500cd4f0 0x7fe5500c9ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36318/0 (socket says 172.21.15.62:36318) 2023-06-09T04:41:38.627 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.619+0000 7fe54ffff700 1 -- 172.21.15.62:0/2190837716 learned_addr learned my addr 172.21.15.62:0/2190837716 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:41:38.627 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.619+0000 7fe5553c9700 1 --2- 172.21.15.62:0/2190837716 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5500ca5b0 0x7fe5500cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:38.627 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.619+0000 7fe54f7fe700 1 -- 172.21.15.62:0/2190837716 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3615740182 0 0) 0x7fe53c001110 con 0x7fe5500cd4f0 2023-06-09T04:41:38.627 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.619+0000 7fe54f7fe700 1 -- 172.21.15.62:0/2190837716 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5400035d0 con 0x7fe5500cd4f0 2023-06-09T04:41:38.628 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.623+0000 7fe54f7fe700 1 -- 172.21.15.62:0/2190837716 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4197471446 0 0) 0x7fe5500cc180 con 0x7fe550159a40 2023-06-09T04:41:38.628 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.623+0000 7fe54f7fe700 1 -- 172.21.15.62:0/2190837716 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe53c001110 con 0x7fe550159a40 2023-06-09T04:41:38.628 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.623+0000 7fe5553c9700 1 -- 172.21.15.62:0/2190837716 >> v1:172.21.15.89:6789/0 conn(0x7fe550159a40 legacy=0x7fe550070a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:38.628 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.623+0000 7fe5553c9700 1 -- 172.21.15.62:0/2190837716 >> v1:172.21.15.62:6789/0 conn(0x7fe5500cd4f0 legacy=0x7fe5500c9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:38.628 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.623+0000 7fe54f7fe700 1 -- 172.21.15.62:0/2190837716 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2696788568 0 0) 0x7fe5400035d0 con 0x7fe5500cd4f0 2023-06-09T04:41:38.628 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.623+0000 7fe5553c9700 1 -- 172.21.15.62:0/2190837716 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5500713c0 con 0x7fe5500ca5b0 2023-06-09T04:41:38.629 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.623+0000 7fe5553c9700 1 --2- 172.21.15.62:0/2190837716 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5500ca5b0 0x7fe5500cc610 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe548009dc0 tx=0x7fe54800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8bf9c8b847ec884f server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:38.629 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.623+0000 7fe54f7fe700 1 -- 172.21.15.62:0/2190837716 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe54800e070 con 0x7fe5500ca5b0 2023-06-09T04:41:38.629 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.623+0000 7fe54f7fe700 1 -- 172.21.15.62:0/2190837716 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe548003a40 con 0x7fe5500ca5b0 2023-06-09T04:41:38.629 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.623+0000 7fe54f7fe700 1 -- 172.21.15.62:0/2190837716 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53c001800 con 0x7fe5500ca5b0 2023-06-09T04:41:38.630 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.623+0000 7fe555bca700 1 -- 172.21.15.62:0/2190837716 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5500ca5b0 msgr2=0x7fe5500cc610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:38.630 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.623+0000 7fe555bca700 1 --2- 172.21.15.62:0/2190837716 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5500ca5b0 0x7fe5500cc610 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe548009dc0 tx=0x7fe54800b330 comp rx=0 tx=0).stop 2023-06-09T04:41:38.630 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.623+0000 7fe555bca700 1 -- 172.21.15.62:0/2190837716 shutdown_connections 2023-06-09T04:41:38.631 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.623+0000 7fe555bca700 1 --2- 172.21.15.62:0/2190837716 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5500ca5b0 0x7fe5500cc610 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:38.631 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.623+0000 7fe555bca700 1 -- 172.21.15.62:0/2190837716 >> 172.21.15.62:0/2190837716 conn(0x7fe55006a420 msgr2=0x7fe5500afc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:38.631 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.623+0000 7fe555bca700 1 -- 172.21.15.62:0/2190837716 shutdown_connections 2023-06-09T04:41:38.631 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.623+0000 7fe555bca700 1 -- 172.21.15.62:0/2190837716 wait complete. 2023-06-09T04:41:38.633 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.627+0000 7fe555bca700 1 Processor -- start 2023-06-09T04:41:38.633 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.627+0000 7fe555bca700 1 -- start start 2023-06-09T04:41:38.635 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.631+0000 7fe555bca700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5500cd4f0 0x7fe550147920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:38.635 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.631+0000 7fe555bca700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe550159a40 0x7fe550156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:38.635 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.631+0000 7fe555bca700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5501571a0 0x7fe5500aeac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:38.635 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.631+0000 7fe555bca700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5501566a0 con 0x7fe550159a40 2023-06-09T04:41:38.636 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.631+0000 7fe555bca700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe550157620 con 0x7fe5501571a0 2023-06-09T04:41:38.636 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.631+0000 7fe555bca700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe550155780 con 0x7fe5500cd4f0 2023-06-09T04:41:38.637 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.631+0000 7fe54ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe550159a40 0x7fe550156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:38.637 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.631+0000 7fe54ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe550159a40 0x7fe550156c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53630/0 (socket says 172.21.15.62:53630) 2023-06-09T04:41:38.637 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.631+0000 7fe54ffff700 1 -- 172.21.15.62:0/4216696156 learned_addr learned my addr 172.21.15.62:0/4216696156 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:38.637 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.631+0000 7fe554bc8700 1 --2- 172.21.15.62:0/4216696156 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5500cd4f0 0x7fe550147920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:38.637 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.631+0000 7fe5553c9700 1 --2- 172.21.15.62:0/4216696156 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5501571a0 0x7fe5500aeac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:38.638 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.631+0000 7fe54ffff700 1 -- 172.21.15.62:0/4216696156 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5500cd4f0 msgr2=0x7fe550147920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:38.638 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.631+0000 7fe54ffff700 1 --2- 172.21.15.62:0/4216696156 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5500cd4f0 0x7fe550147920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:38.638 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.631+0000 7fe54ffff700 1 -- 172.21.15.62:0/4216696156 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5501571a0 msgr2=0x7fe5500aeac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:38.638 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.631+0000 7fe54ffff700 1 --2- 172.21.15.62:0/4216696156 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5501571a0 0x7fe5500aeac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:38.638 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.631+0000 7fe54ffff700 1 -- 172.21.15.62:0/4216696156 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe548009a70 con 0x7fe550159a40 2023-06-09T04:41:38.638 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.631+0000 7fe5553c9700 1 --2- 172.21.15.62:0/4216696156 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5501571a0 0x7fe5500aeac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:41:38.639 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.631+0000 7fe54ffff700 1 --2- 172.21.15.62:0/4216696156 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe550159a40 0x7fe550156c60 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe53c00c700 tx=0x7fe53c00cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:38.639 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.631+0000 7fe54d7fa700 1 -- 172.21.15.62:0/4216696156 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53c007560 con 0x7fe550159a40 2023-06-09T04:41:38.639 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.631+0000 7fe54d7fa700 1 -- 172.21.15.62:0/4216696156 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe53c0076e0 con 0x7fe550159a40 2023-06-09T04:41:38.639 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.631+0000 7fe555bca700 1 -- 172.21.15.62:0/4216696156 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe550147e60 con 0x7fe550159a40 2023-06-09T04:41:38.639 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.631+0000 7fe54d7fa700 1 -- 172.21.15.62:0/4216696156 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53c004ad0 con 0x7fe550159a40 2023-06-09T04:41:38.639 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.631+0000 7fe555bca700 1 -- 172.21.15.62:0/4216696156 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe550155d00 con 0x7fe550159a40 2023-06-09T04:41:38.640 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.631+0000 7fe555bca700 1 -- 172.21.15.62:0/4216696156 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5500670a0 con 0x7fe550159a40 2023-06-09T04:41:38.640 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.635+0000 7fe54d7fa700 1 -- 172.21.15.62:0/4216696156 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe53c004c30 con 0x7fe550159a40 2023-06-09T04:41:38.643 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.639+0000 7fe54d7fa700 1 --2- 172.21.15.62:0/4216696156 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fe5340662f0 0x7fe5340687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:38.643 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.639+0000 7fe54d7fa700 1 -- 172.21.15.62:0/4216696156 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe53c0834c0 con 0x7fe550159a40 2023-06-09T04:41:38.643 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.639+0000 7fe554bc8700 1 --2- 172.21.15.62:0/4216696156 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fe5340662f0 0x7fe5340687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:38.645 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.639+0000 7fe554bc8700 1 --2- 172.21.15.62:0/4216696156 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fe5340662f0 0x7fe5340687a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe5440011e0 tx=0x7fe544009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:38.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.647+0000 7fe54d7fa700 1 -- 172.21.15.62:0/4216696156 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe53c050600 con 0x7fe550159a40 2023-06-09T04:41:38.866 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.859+0000 7fe555bca700 1 -- 172.21.15.62:0/4216696156 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe550071180 con 0x7fe550159a40 2023-06-09T04:41:38.867 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.863+0000 7fe54d7fa700 1 -- 172.21.15.62:0/4216696156 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4664 (secure 0 0 0) 0x7fe550071180 con 0x7fe550159a40 2023-06-09T04:41:38.867 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:41:38.867 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4256,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/2242182358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2242182358},{"type":"v1","addr":"172.21.15.89:6836","nonce":2242182358}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6834/326702802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":326702802},{"type":"v1","addr":"172.21.15.62:6834","nonce":326702802}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4296,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/3851882562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":3851882562},{"type":"v1","addr":"172.21.15.62:6835","nonce":3851882562}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-09T04:40:56.758756+0000","modified":"2023-06-09T04:41:23.381650+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4312},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4312":{"gid":4312,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6837/1496954959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1496954959},{"type":"v1","addr":"172.21.15.89:6837","nonce":1496954959}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-09T04:41:38.869 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.863+0000 7fe555bca700 1 -- 172.21.15.62:0/4216696156 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fe5340662f0 msgr2=0x7fe5340687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:38.870 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.863+0000 7fe555bca700 1 --2- 172.21.15.62:0/4216696156 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fe5340662f0 0x7fe5340687a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fe5440011e0 tx=0x7fe544009040 comp rx=0 tx=0).stop 2023-06-09T04:41:38.870 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.863+0000 7fe555bca700 1 -- 172.21.15.62:0/4216696156 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe550159a40 msgr2=0x7fe550156c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:38.870 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.863+0000 7fe555bca700 1 --2- 172.21.15.62:0/4216696156 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe550159a40 0x7fe550156c60 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe53c00c700 tx=0x7fe53c00cac0 comp rx=0 tx=0).stop 2023-06-09T04:41:38.870 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.863+0000 7fe555bca700 1 -- 172.21.15.62:0/4216696156 shutdown_connections 2023-06-09T04:41:38.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.863+0000 7fe555bca700 1 --2- 172.21.15.62:0/4216696156 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fe5340662f0 0x7fe5340687a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:38.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.863+0000 7fe555bca700 1 --2- 172.21.15.62:0/4216696156 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5501571a0 0x7fe5500aeac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:38.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.863+0000 7fe555bca700 1 --2- 172.21.15.62:0/4216696156 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe550159a40 0x7fe550156c60 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:38.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.863+0000 7fe555bca700 1 --2- 172.21.15.62:0/4216696156 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe5500cd4f0 0x7fe550147920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:38.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.863+0000 7fe555bca700 1 -- 172.21.15.62:0/4216696156 >> 172.21.15.62:0/4216696156 conn(0x7fe5500ca5b0 msgr2=0x7fe55015c120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:38.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.863+0000 7fe555bca700 1 -- 172.21.15.62:0/4216696156 shutdown_connections 2023-06-09T04:41:38.872 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:38.863+0000 7fe555bca700 1 -- 172.21.15.62:0/4216696156 wait complete. 2023-06-09T04:41:38.873 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 9 2023-06-09T04:41:39.294 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-06-09T04:40:56.758756+0000', 'modified': '2023-06-09T04:41:23.381650+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4312}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4312': {'gid': 4312, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.89:6837/1496954959', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.89:6835', 'nonce': 1496954959}, {'type': 'v1', 'addr': '172.21.15.89:6837', 'nonce': 1496954959}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-06-09T04:41:39.294 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-06-09T04:41:39.295 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-06-09T04:41:39.473 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.467+0000 7f3ee359e700 1 Processor -- start 2023-06-09T04:41:39.474 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.467+0000 7f3ee359e700 1 -- start start 2023-06-09T04:41:39.476 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.471+0000 7f3ee359e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3ee40b1cc0 0x7f3ee40b2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:39.477 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.471+0000 7f3ee359e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ee406a900 0x7f3ee406ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:39.477 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.471+0000 7f3ee359e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ee40cffb0 con 0x7f3ee415bbb0 2023-06-09T04:41:39.477 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.471+0000 7f3ee359e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ee40b2680 con 0x7f3ee40b1cc0 2023-06-09T04:41:39.477 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.471+0000 7f3ee359e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee415f840 con 0x7f3ee406a900 2023-06-09T04:41:39.478 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.471+0000 7f3ee259c700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f3ee415bbb0 0x7f3ee406bfe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.62:44524/0 (socket says 172.21.15.62:44524) 2023-06-09T04:41:39.478 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.471+0000 7f3ee259c700 1 -- 172.21.15.62:0/1466560553 learned_addr learned my addr 172.21.15.62:0/1466560553 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:41:39.478 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.471+0000 7f3edbfff700 1 --2- 172.21.15.62:0/1466560553 >> v2:172.21.15.89:3300/0 conn(0x7f3ee40b1cc0 0x7f3ee40b2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:39.478 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.471+0000 7f3ee2d9d700 1 --2- 172.21.15.62:0/1466560553 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ee406a900 0x7f3ee406ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:39.479 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.471+0000 7f3ee1d9b700 1 -- 172.21.15.62:0/1466560553 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1351361173 0 0) 0x7f3ee40cffb0 con 0x7f3ee415bbb0 2023-06-09T04:41:39.479 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.471+0000 7f3ee1d9b700 1 -- 172.21.15.62:0/1466560553 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ed00035d0 con 0x7f3ee415bbb0 2023-06-09T04:41:39.479 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.471+0000 7f3ee2d9d700 1 -- 172.21.15.62:0/1466560553 >> v2:172.21.15.89:3300/0 conn(0x7f3ee40b1cc0 msgr2=0x7f3ee40b2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:39.479 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.471+0000 7f3ee2d9d700 1 --2- 172.21.15.62:0/1466560553 >> v2:172.21.15.89:3300/0 conn(0x7f3ee40b1cc0 0x7f3ee40b2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:39.479 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.471+0000 7f3ee2d9d700 1 -- 172.21.15.62:0/1466560553 >> v1:172.21.15.89:6789/0 conn(0x7f3ee415bbb0 legacy=0x7f3ee406bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:39.479 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.471+0000 7f3ee2d9d700 1 -- 172.21.15.62:0/1466560553 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ee415fb20 con 0x7f3ee406a900 2023-06-09T04:41:39.480 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.471+0000 7f3edbfff700 1 --2- 172.21.15.62:0/1466560553 >> v2:172.21.15.89:3300/0 conn(0x7f3ee40b1cc0 0x7f3ee40b2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:41:39.480 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.475+0000 7f3ee2d9d700 1 --2- 172.21.15.62:0/1466560553 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ee406a900 0x7f3ee406ad80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3edc009dc0 tx=0x7f3edc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=602da56ba8d97e79 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:39.481 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.475+0000 7f3ee1d9b700 1 -- 172.21.15.62:0/1466560553 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3edc00e070 con 0x7f3ee406a900 2023-06-09T04:41:39.481 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.475+0000 7f3ee1d9b700 1 -- 172.21.15.62:0/1466560553 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3edc00bae0 con 0x7f3ee406a900 2023-06-09T04:41:39.481 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.475+0000 7f3ee1d9b700 1 -- 172.21.15.62:0/1466560553 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3edc00be90 con 0x7f3ee406a900 2023-06-09T04:41:39.481 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.475+0000 7f3ee359e700 1 -- 172.21.15.62:0/1466560553 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ee406a900 msgr2=0x7f3ee406ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:39.481 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.475+0000 7f3ee359e700 1 --2- 172.21.15.62:0/1466560553 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ee406a900 0x7f3ee406ad80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3edc009dc0 tx=0x7f3edc00b330 comp rx=0 tx=0).stop 2023-06-09T04:41:39.482 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.475+0000 7f3ee359e700 1 -- 172.21.15.62:0/1466560553 shutdown_connections 2023-06-09T04:41:39.482 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.475+0000 7f3ee359e700 1 --2- 172.21.15.62:0/1466560553 >> v2:172.21.15.89:3300/0 conn(0x7f3ee40b1cc0 0x7f3ee40b2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:39.482 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.475+0000 7f3ee359e700 1 --2- 172.21.15.62:0/1466560553 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ee406a900 0x7f3ee406ad80 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:39.482 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.475+0000 7f3ee359e700 1 -- 172.21.15.62:0/1466560553 >> 172.21.15.62:0/1466560553 conn(0x7f3ee40cccc0 msgr2=0x7f3ee40cd0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:39.482 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.475+0000 7f3ee359e700 1 -- 172.21.15.62:0/1466560553 shutdown_connections 2023-06-09T04:41:39.482 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.475+0000 7f3ee359e700 1 -- 172.21.15.62:0/1466560553 wait complete. 2023-06-09T04:41:39.484 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.479+0000 7f3ee359e700 1 Processor -- start 2023-06-09T04:41:39.484 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.479+0000 7f3ee359e700 1 -- start start 2023-06-09T04:41:39.485 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.479+0000 7f3ee359e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ee406a900 0x7f3ee40c6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:39.486 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.479+0000 7f3ee359e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ee40b1cc0 0x7f3ee40b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:39.486 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.479+0000 7f3ee359e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ee415bbb0 0x7f3ee41481a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:39.486 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.479+0000 7f3ee359e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee40c54b0 con 0x7f3ee415bbb0 2023-06-09T04:41:39.486 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.479+0000 7f3ee359e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee40c5750 con 0x7f3ee40b1cc0 2023-06-09T04:41:39.486 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.479+0000 7f3ee359e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee40c5a30 con 0x7f3ee406a900 2023-06-09T04:41:39.487 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.479+0000 7f3ee2d9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ee415bbb0 0x7f3ee41481a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:39.487 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.479+0000 7f3ee2d9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ee415bbb0 0x7f3ee41481a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53634/0 (socket says 172.21.15.62:53634) 2023-06-09T04:41:39.487 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.479+0000 7f3ee2d9d700 1 -- 172.21.15.62:0/2888842070 learned_addr learned my addr 172.21.15.62:0/2888842070 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:39.487 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.479+0000 7f3ee259c700 1 --2- 172.21.15.62:0/2888842070 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ee406a900 0x7f3ee40c6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:39.488 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.479+0000 7f3edbfff700 1 --2- 172.21.15.62:0/2888842070 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ee40b1cc0 0x7f3ee40b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:39.488 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.483+0000 7f3ee2d9d700 1 -- 172.21.15.62:0/2888842070 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ee406a900 msgr2=0x7f3ee40c6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:39.488 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.483+0000 7f3ee2d9d700 1 --2- 172.21.15.62:0/2888842070 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ee406a900 0x7f3ee40c6510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:39.488 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.483+0000 7f3ee2d9d700 1 -- 172.21.15.62:0/2888842070 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ee40b1cc0 msgr2=0x7f3ee40b08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:39.488 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.483+0000 7f3ee2d9d700 1 --2- 172.21.15.62:0/2888842070 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ee40b1cc0 0x7f3ee40b08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:39.488 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.483+0000 7f3ee2d9d700 1 -- 172.21.15.62:0/2888842070 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ecc0094b0 con 0x7f3ee415bbb0 2023-06-09T04:41:39.489 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.483+0000 7f3ee2d9d700 1 --2- 172.21.15.62:0/2888842070 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ee415bbb0 0x7f3ee41481a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3edc00b370 tx=0x7f3edc004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:39.489 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.483+0000 7f3edaffd700 1 -- 172.21.15.62:0/2888842070 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3edc004550 con 0x7f3ee415bbb0 2023-06-09T04:41:39.489 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.483+0000 7f3edaffd700 1 -- 172.21.15.62:0/2888842070 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3edc020070 con 0x7f3ee415bbb0 2023-06-09T04:41:39.489 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.483+0000 7f3ee359e700 1 -- 172.21.15.62:0/2888842070 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3edc009a70 con 0x7f3ee415bbb0 2023-06-09T04:41:39.489 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.483+0000 7f3edaffd700 1 -- 172.21.15.62:0/2888842070 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3edc004910 con 0x7f3ee415bbb0 2023-06-09T04:41:39.490 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.483+0000 7f3ee359e700 1 -- 172.21.15.62:0/2888842070 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ee40c5ff0 con 0x7f3ee415bbb0 2023-06-09T04:41:39.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.487+0000 7f3edaffd700 1 -- 172.21.15.62:0/2888842070 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3edc012430 con 0x7f3ee415bbb0 2023-06-09T04:41:39.493 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.487+0000 7f3edaffd700 1 --2- 172.21.15.62:0/2888842070 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f3ec40662f0 0x7f3ec40687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:39.493 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.487+0000 7f3edaffd700 1 -- 172.21.15.62:0/2888842070 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3edc022070 con 0x7f3ee415bbb0 2023-06-09T04:41:39.494 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.487+0000 7f3ee259c700 1 --2- 172.21.15.62:0/2888842070 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f3ec40662f0 0x7f3ec40687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:39.495 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.487+0000 7f3ee259c700 1 --2- 172.21.15.62:0/2888842070 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f3ec40662f0 0x7f3ec40687a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3ed4007fd0 tx=0x7f3ed4007de0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:39.495 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.491+0000 7f3eebedf740 1 Processor -- start 2023-06-09T04:41:39.496 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.491+0000 7f3eebedf740 1 -- start start 2023-06-09T04:41:39.497 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.491+0000 7f3eebedf740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x18cceb0 0x1b3bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:39.497 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.491+0000 7f3eebedf740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x18ccae0 0x1b3c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:39.497 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.491+0000 7f3eebedf740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x18cc710 0x1b822b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:39.497 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.491+0000 7f3eebedf740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x1acbee0 con 0x18cc710 2023-06-09T04:41:39.497 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.491+0000 7f3eebedf740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a59690 con 0x18cceb0 2023-06-09T04:41:39.497 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.491+0000 7f3eebedf740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x1aac340 con 0x18ccae0 2023-06-09T04:41:39.498 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.491+0000 7f3ee2d9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x18cc710 0x1b822b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:39.498 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.491+0000 7f3ee2d9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x18cc710 0x1b822b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53638/0 (socket says 172.21.15.62:53638) 2023-06-09T04:41:39.499 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.491+0000 7f3ee2d9d700 1 -- 172.21.15.62:0/19580758 learned_addr learned my addr 172.21.15.62:0/19580758 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:39.499 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.491+0000 7f3ee259c700 1 --2- 172.21.15.62:0/19580758 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x18cceb0 0x1b3bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:39.499 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.491+0000 7f3edbfff700 1 --2- 172.21.15.62:0/19580758 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x18ccae0 0x1b3c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:39.499 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.491+0000 7f3ee2d9d700 1 -- 172.21.15.62:0/19580758 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x18ccae0 msgr2=0x1b3c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:39.499 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.491+0000 7f3ee2d9d700 1 --2- 172.21.15.62:0/19580758 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x18ccae0 0x1b3c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:39.499 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.491+0000 7f3ee2d9d700 1 -- 172.21.15.62:0/19580758 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x18cceb0 msgr2=0x1b3bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:39.500 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.491+0000 7f3ee2d9d700 1 --2- 172.21.15.62:0/19580758 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x18cceb0 0x1b3bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:39.500 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.491+0000 7f3ee2d9d700 1 -- 172.21.15.62:0/19580758 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1a579a0 con 0x18cc710 2023-06-09T04:41:39.500 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.491+0000 7f3ee259c700 1 --2- 172.21.15.62:0/19580758 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x18cceb0 0x1b3bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:41:39.500 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.491+0000 7f3ee2d9d700 1 --2- 172.21.15.62:0/19580758 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x18cc710 0x1b822b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3edc0840a0 tx=0x7f3edc056880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fa9fd2023ad3c37 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:39.501 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.495+0000 7f3ec3fff700 1 -- 172.21.15.62:0/19580758 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3edc05f1a0 con 0x18cc710 2023-06-09T04:41:39.501 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.495+0000 7f3ec3fff700 1 -- 172.21.15.62:0/19580758 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3edc054f90 con 0x18cc710 2023-06-09T04:41:39.501 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.495+0000 7f3ec3fff700 1 -- 172.21.15.62:0/19580758 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3edc05ed10 con 0x18cc710 2023-06-09T04:41:39.501 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.495+0000 7f3eebedf740 1 -- 172.21.15.62:0/19580758 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x18cc710 msgr2=0x1b822b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:39.501 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.495+0000 7f3eebedf740 1 --2- 172.21.15.62:0/19580758 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x18cc710 0x1b822b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3edc0840a0 tx=0x7f3edc056880 comp rx=0 tx=0).stop 2023-06-09T04:41:39.502 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.495+0000 7f3eebedf740 1 -- 172.21.15.62:0/19580758 shutdown_connections 2023-06-09T04:41:39.502 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.495+0000 7f3eebedf740 1 --2- 172.21.15.62:0/19580758 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x18cc710 0x1b822b0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:39.502 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.495+0000 7f3eebedf740 1 --2- 172.21.15.62:0/19580758 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x18ccae0 0x1b3c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:39.502 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.495+0000 7f3eebedf740 1 --2- 172.21.15.62:0/19580758 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x18cceb0 0x1b3bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:39.502 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.495+0000 7f3eebedf740 1 -- 172.21.15.62:0/19580758 >> 172.21.15.62:0/19580758 conn(0x1b36d10 msgr2=0x1b68f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:39.502 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.495+0000 7f3eebedf740 1 -- 172.21.15.62:0/19580758 shutdown_connections 2023-06-09T04:41:39.502 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.495+0000 7f3eebedf740 1 -- 172.21.15.62:0/19580758 wait complete. 2023-06-09T04:41:39.502 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.495+0000 7f3eebedf740 1 -- start start 2023-06-09T04:41:39.503 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.495+0000 7f3eebedf740 1 Processor -- start 2023-06-09T04:41:39.504 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.495+0000 7f3eebedf740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x18cc710 0x1b65c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:39.504 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.495+0000 7f3eebedf740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x18ccae0 0x1b826a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:39.504 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.495+0000 7f3eebedf740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x18cceb0 0x1b82be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:39.504 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.495+0000 7f3eebedf740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x1aa55a0 con 0x18cc710 2023-06-09T04:41:39.504 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.495+0000 7f3eebedf740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a67f20 con 0x18cceb0 2023-06-09T04:41:39.504 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.495+0000 7f3eebedf740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x1a66890 con 0x18ccae0 2023-06-09T04:41:39.504 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.499+0000 7f3eebedf740 10 client.0 _ll_register_callbacks cb 0x1af87d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-09T04:41:39.505 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.499+0000 7f3ee259c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x18cc710 0x1b65c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:39.505 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.499+0000 7f3ee259c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x18cc710 0x1b65c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53642/0 (socket says 172.21.15.62:53642) 2023-06-09T04:41:39.505 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.499+0000 7f3ee259c700 1 -- 172.21.15.62:0/2436414234 learned_addr learned my addr 172.21.15.62:0/2436414234 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:39.505 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.499+0000 7f3ee2d9d700 1 --2- 172.21.15.62:0/2436414234 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x18cceb0 0x1b82be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:39.505 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.499+0000 7f3edbfff700 1 --2- 172.21.15.62:0/2436414234 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x18ccae0 0x1b826a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:39.507 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.499+0000 7f3ee259c700 1 -- 172.21.15.62:0/2436414234 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x18ccae0 msgr2=0x1b826a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:39.507 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.499+0000 7f3ee259c700 1 --2- 172.21.15.62:0/2436414234 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x18ccae0 0x1b826a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:39.507 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.499+0000 7f3ee259c700 1 -- 172.21.15.62:0/2436414234 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x18cceb0 msgr2=0x1b82be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:39.507 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.499+0000 7f3ee259c700 1 --2- 172.21.15.62:0/2436414234 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x18cceb0 0x1b82be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:39.507 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.499+0000 7f3ee259c700 1 -- 172.21.15.62:0/2436414234 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ed00035d0 con 0x18cc710 2023-06-09T04:41:39.507 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.499+0000 7f3ee2d9d700 1 --2- 172.21.15.62:0/2436414234 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x18cceb0 0x1b82be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:41:39.508 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.499+0000 7f3ee259c700 1 --2- 172.21.15.62:0/2436414234 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x18cc710 0x1b65c40 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3ed4006660 tx=0x7f3ed4001150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=705f582845adf0b8 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:39.508 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.499+0000 7f3ec17fa700 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2023-06-09T04:41:39.508 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.499+0000 7f3ec17fa700 1 -- 172.21.15.62:0/2436414234 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed4026030 con 0x18cc710 2023-06-09T04:41:39.508 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.499+0000 7f3eebedf740 1 -- 172.21.15.62:0/2436414234 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1a9e580 con 0x18cc710 2023-06-09T04:41:39.508 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.499+0000 7f3ec17fa700 1 -- 172.21.15.62:0/2436414234 <== mon.0 v2:172.21.15.62:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3ed4027070 con 0x18cc710 2023-06-09T04:41:39.508 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.499+0000 7f3ec17fa700 1 -- 172.21.15.62:0/2436414234 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3ed4001750 con 0x18cc710 2023-06-09T04:41:39.508 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.499+0000 7f3eebedf740 10 client.4947 fetch_fsmap learned FSMap version 9 2023-06-09T04:41:39.509 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.499+0000 7f3eebedf740 1 -- 172.21.15.62:0/2436414234 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x7f3ee40c5ff0 con 0x18cc710 2023-06-09T04:41:39.509 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.499+0000 7f3ec17fa700 1 -- 172.21.15.62:0/2436414234 <== mon.0 v2:172.21.15.62:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ed4031020 con 0x18cc710 2023-06-09T04:41:39.509 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.499+0000 7f3ec17fa700 1 -- 172.21.15.62:0/2436414234 <== mon.0 v2:172.21.15.62:3300/0 5 ==== fsmap(e 9) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f3ed40018b0 con 0x18cc710 2023-06-09T04:41:39.509 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.499+0000 7f3eebedf740 10 client.4947 fetch_fsmap finished waiting for FSMap version 9 2023-06-09T04:41:39.509 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.499+0000 7f3eebedf740 10 client.4947 resolve_mds: resolved name 'd' to daemon mds.d 2023-06-09T04:41:39.509 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.499+0000 7f3eebedf740 20 client.4947 populate_metadata read hostname 'smithi062' 2023-06-09T04:41:39.509 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.499+0000 7f3eebedf740 1 --2- 172.21.15.62:0/2436414234 >> [v2:172.21.15.89:6835/1496954959,v1:172.21.15.89:6837/1496954959] conn(0x1917790 0x1b3f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:39.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.499+0000 7f3eebedf740 4 client.4947 mds_command: new command op to 4312 tid=0[{"prefix": "get_command_descriptions"}] 2023-06-09T04:41:39.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.499+0000 7f3eebedf740 1 -- 172.21.15.62:0/2436414234 --> [v2:172.21.15.89:6835/1496954959,v1:172.21.15.89:6837/1496954959] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1a9e2a0 con 0x1917790 2023-06-09T04:41:39.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.499+0000 7f3edbfff700 1 --2- 172.21.15.62:0/2436414234 >> [v2:172.21.15.89:6835/1496954959,v1:172.21.15.89:6837/1496954959] conn(0x1917790 0x1b3f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:39.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.503+0000 7f3edbfff700 1 --2- 172.21.15.62:0/2436414234 >> [v2:172.21.15.89:6835/1496954959,v1:172.21.15.89:6837/1496954959] conn(0x1917790 0x1b3f8d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=10e59c5c6162db39 server_cookie=b063956cf242baa1 in_seq=0 out_seq=0 2023-06-09T04:41:39.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.503+0000 7f3ec17fa700 10 client.4947 ms_handle_connect on v2:172.21.15.89:6835/1496954959 2023-06-09T04:41:39.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.503+0000 7f3ec17fa700 1 -- 172.21.15.62:0/2436414234 <== mds.0 v2:172.21.15.89:6835/1496954959 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x1a9e2a0 con 0x1917790 2023-06-09T04:41:39.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.503+0000 7f3ec17fa700 10 client.4947 handle_command_reply: tid=0 2023-06-09T04:41:39.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.503+0000 7f3eebedf740 1 client.4947 shutdown 2023-06-09T04:41:39.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.503+0000 7f3eebedf740 1 -- 172.21.15.62:0/2436414234 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x18cc710 msgr2=0x1b65c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:39.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.503+0000 7f3eebedf740 1 --2- 172.21.15.62:0/2436414234 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x18cc710 0x1b65c40 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3ed4006660 tx=0x7f3ed4001150 comp rx=0 tx=0).stop 2023-06-09T04:41:39.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.503+0000 7f3eebedf740 1 -- 172.21.15.62:0/2436414234 shutdown_connections 2023-06-09T04:41:39.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.503+0000 7f3eebedf740 1 --2- 172.21.15.62:0/2436414234 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x18cceb0 0x1b82be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:39.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.503+0000 7f3eebedf740 1 --2- 172.21.15.62:0/2436414234 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x18ccae0 0x1b826a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:39.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.503+0000 7f3eebedf740 1 --2- 172.21.15.62:0/2436414234 >> [v2:172.21.15.89:6835/1496954959,v1:172.21.15.89:6837/1496954959] conn(0x1917790 0x1b3f8d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:39.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.503+0000 7f3eebedf740 1 --2- 172.21.15.62:0/2436414234 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x18cc710 0x1b65c40 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:39.513 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.503+0000 7f3ec17fa700 0 client.4947 ms_handle_reset on v2:172.21.15.89:6835/1496954959 2023-06-09T04:41:39.513 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.503+0000 7f3eebedf740 1 -- 172.21.15.62:0/2436414234 >> 172.21.15.62:0/2436414234 conn(0x1b36d10 msgr2=0x1b3aed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:39.513 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.503+0000 7f3eebedf740 1 -- 172.21.15.62:0/2436414234 shutdown_connections 2023-06-09T04:41:39.513 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.503+0000 7f3eebedf740 1 -- 172.21.15.62:0/2436414234 wait complete. 2023-06-09T04:41:39.513 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.503+0000 7f3eebedf740 20 client.4947 trim_cache size 0 max 16384 2023-06-09T04:41:39.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.527+0000 7f3eebedf740 1 Processor -- start 2023-06-09T04:41:39.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.527+0000 7f3eebedf740 1 -- start start 2023-06-09T04:41:39.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.527+0000 7f3eebedf740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x18cc710 0x1b825c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:39.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.527+0000 7f3eebedf740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x18ccae0 0x1b82b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:39.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.527+0000 7f3eebedf740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x18cceb0 0x1b63fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:39.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.527+0000 7f3eebedf740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x1951b20 con 0x18cc710 2023-06-09T04:41:39.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.527+0000 7f3eebedf740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x1aa95a0 con 0x18cceb0 2023-06-09T04:41:39.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.527+0000 7f3eebedf740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x1a9f8a0 con 0x18ccae0 2023-06-09T04:41:39.536 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.527+0000 7f3ee259c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x18cc710 0x1b825c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:39.536 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.531+0000 7f3ee259c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x18cc710 0x1b825c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53652/0 (socket says 172.21.15.62:53652) 2023-06-09T04:41:39.536 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.531+0000 7f3ee259c700 1 -- 172.21.15.62:0/4279715502 learned_addr learned my addr 172.21.15.62:0/4279715502 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:39.536 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.531+0000 7f3ee259c700 1 -- 172.21.15.62:0/4279715502 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x18ccae0 msgr2=0x1b82b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:39.536 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.531+0000 7f3ee259c700 1 --2- 172.21.15.62:0/4279715502 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x18ccae0 0x1b82b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:39.536 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.531+0000 7f3ee259c700 1 -- 172.21.15.62:0/4279715502 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x18cceb0 msgr2=0x1b63fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:39.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.531+0000 7f3ee259c700 1 --2- 172.21.15.62:0/4279715502 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x18cceb0 0x1b63fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:39.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.531+0000 7f3ee259c700 1 -- 172.21.15.62:0/4279715502 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ee4148a40 con 0x18cc710 2023-06-09T04:41:39.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.531+0000 7f3ee259c700 1 --2- 172.21.15.62:0/4279715502 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x18cc710 0x1b825c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3ed4006d80 tx=0x7f3ed401b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=192e5f6b023bb169 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:39.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.531+0000 7f3ed8ff9700 1 -- 172.21.15.62:0/4279715502 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed4026040 con 0x18cc710 2023-06-09T04:41:39.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.531+0000 7f3ed8ff9700 1 -- 172.21.15.62:0/4279715502 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ed4031040 con 0x18cc710 2023-06-09T04:41:39.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.531+0000 7f3ed8ff9700 1 -- 172.21.15.62:0/4279715502 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed4001990 con 0x18cc710 2023-06-09T04:41:39.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.531+0000 7f3eebedf740 1 -- 172.21.15.62:0/4279715502 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x18cc710 msgr2=0x1b825c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:39.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.531+0000 7f3eebedf740 1 --2- 172.21.15.62:0/4279715502 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x18cc710 0x1b825c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f3ed4006d80 tx=0x7f3ed401b000 comp rx=0 tx=0).stop 2023-06-09T04:41:39.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.531+0000 7f3eebedf740 1 -- 172.21.15.62:0/4279715502 shutdown_connections 2023-06-09T04:41:39.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.531+0000 7f3eebedf740 1 --2- 172.21.15.62:0/4279715502 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x18cceb0 0x1b63fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:39.539 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.531+0000 7f3eebedf740 1 --2- 172.21.15.62:0/4279715502 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x18ccae0 0x1b82b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:39.539 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.531+0000 7f3eebedf740 1 --2- 172.21.15.62:0/4279715502 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x18cc710 0x1b825c0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:39.539 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.531+0000 7f3eebedf740 1 -- 172.21.15.62:0/4279715502 >> 172.21.15.62:0/4279715502 conn(0x1b36d10 msgr2=0x1b95a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:39.539 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.531+0000 7f3eebedf740 1 -- 172.21.15.62:0/4279715502 shutdown_connections 2023-06-09T04:41:39.539 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.531+0000 7f3eebedf740 1 -- 172.21.15.62:0/4279715502 wait complete. 2023-06-09T04:41:39.540 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.535+0000 7f3eebedf740 1 -- start start 2023-06-09T04:41:39.540 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.535+0000 7f3eebedf740 1 Processor -- start 2023-06-09T04:41:39.542 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.535+0000 7f3eebedf740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x18cc710 0x1bcd850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:39.542 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.535+0000 7f3eebedf740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x18ccae0 0x1b9c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:39.542 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.535+0000 7f3eebedf740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x18cceb0 0x1b9d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:39.542 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.535+0000 7f3eebedf740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b9bcb0 con 0x18cc710 2023-06-09T04:41:39.542 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.535+0000 7f3eebedf740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b3b8b0 con 0x18cceb0 2023-06-09T04:41:39.542 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.535+0000 7f3eebedf740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x1b3ce30 con 0x18ccae0 2023-06-09T04:41:39.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.535+0000 7f3eebedf740 10 client.0 _ll_register_callbacks cb 0x1aa4170 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-09T04:41:39.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.535+0000 7f3ee259c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x18cc710 0x1bcd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:39.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.535+0000 7f3ee259c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x18cc710 0x1bcd850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53662/0 (socket says 172.21.15.62:53662) 2023-06-09T04:41:39.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.535+0000 7f3ee259c700 1 -- 172.21.15.62:0/2977054830 learned_addr learned my addr 172.21.15.62:0/2977054830 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:39.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.535+0000 7f3ee2d9d700 1 --2- 172.21.15.62:0/2977054830 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x18cceb0 0x1b9d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:39.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.535+0000 7f3edbfff700 1 --2- 172.21.15.62:0/2977054830 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x18ccae0 0x1b9c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:39.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.535+0000 7f3ee259c700 1 -- 172.21.15.62:0/2977054830 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x18ccae0 msgr2=0x1b9c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:39.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.535+0000 7f3ee259c700 1 --2- 172.21.15.62:0/2977054830 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x18ccae0 0x1b9c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:39.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.535+0000 7f3ee259c700 1 -- 172.21.15.62:0/2977054830 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x18cceb0 msgr2=0x1b9d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:39.545 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.535+0000 7f3ee259c700 1 --2- 172.21.15.62:0/2977054830 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x18cceb0 0x1b9d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:39.545 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.535+0000 7f3ee259c700 1 -- 172.21.15.62:0/2977054830 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ee40c5ff0 con 0x18cc710 2023-06-09T04:41:39.545 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.539+0000 7f3ee2d9d700 1 --2- 172.21.15.62:0/2977054830 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x18cceb0 0x1b9d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:41:39.545 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.539+0000 7f3ee259c700 1 --2- 172.21.15.62:0/2977054830 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x18cc710 0x1bcd850 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x1a5e730 tx=0x7f3ed4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a69f2b2e1d1dbd66 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:39.545 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.539+0000 7f3ec17fa700 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2023-06-09T04:41:39.546 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.539+0000 7f3ec17fa700 1 -- 172.21.15.62:0/2977054830 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed4026070 con 0x18cc710 2023-06-09T04:41:39.547 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.539+0000 7f3eebedf740 1 -- 172.21.15.62:0/2977054830 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3edc054f90 con 0x18cc710 2023-06-09T04:41:39.547 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.539+0000 7f3ec17fa700 1 -- 172.21.15.62:0/2977054830 <== mon.0 v2:172.21.15.62:3300/0 2 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3ed4032080 con 0x18cc710 2023-06-09T04:41:39.547 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.539+0000 7f3ec17fa700 1 -- 172.21.15.62:0/2977054830 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3ed4001960 con 0x18cc710 2023-06-09T04:41:39.547 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.539+0000 7f3eebedf740 10 client.4953 fetch_fsmap learned FSMap version 9 2023-06-09T04:41:39.547 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.539+0000 7f3eebedf740 1 -- 172.21.15.62:0/2977054830 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x19189e0 con 0x18cc710 2023-06-09T04:41:39.547 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.539+0000 7f3ec17fa700 1 -- 172.21.15.62:0/2977054830 <== mon.0 v2:172.21.15.62:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3edc054f90 con 0x18cc710 2023-06-09T04:41:39.547 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.539+0000 7f3ec17fa700 1 -- 172.21.15.62:0/2977054830 <== mon.0 v2:172.21.15.62:3300/0 5 ==== fsmap(e 9) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f3ed403f420 con 0x18cc710 2023-06-09T04:41:39.548 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.539+0000 7f3eebedf740 10 client.4953 fetch_fsmap finished waiting for FSMap version 9 2023-06-09T04:41:39.548 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.539+0000 7f3eebedf740 10 client.4953 resolve_mds: resolved name 'd' to daemon mds.d 2023-06-09T04:41:39.548 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.539+0000 7f3eebedf740 20 client.4953 populate_metadata read hostname 'smithi062' 2023-06-09T04:41:39.548 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.539+0000 7f3eebedf740 1 --2- 172.21.15.62:0/2977054830 >> [v2:172.21.15.89:6835/1496954959,v1:172.21.15.89:6837/1496954959] conn(0x1be39c0 0x1b99420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:39.548 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.539+0000 7f3eebedf740 4 client.4953 mds_command: new command op to 4312 tid=0[{"prefix": "status"}] 2023-06-09T04:41:39.548 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.539+0000 7f3eebedf740 1 -- 172.21.15.62:0/2977054830 --> [v2:172.21.15.89:6835/1496954959,v1:172.21.15.89:6837/1496954959] -- command(tid 0: {"prefix": "status"}) v1 -- 0x19244e0 con 0x1be39c0 2023-06-09T04:41:39.548 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.539+0000 7f3edbfff700 1 --2- 172.21.15.62:0/2977054830 >> [v2:172.21.15.89:6835/1496954959,v1:172.21.15.89:6837/1496954959] conn(0x1be39c0 0x1b99420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:39.549 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.539+0000 7f3edbfff700 1 --2- 172.21.15.62:0/2977054830 >> [v2:172.21.15.89:6835/1496954959,v1:172.21.15.89:6837/1496954959] conn(0x1be39c0 0x1b99420 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e22d6d63a01f4366 server_cookie=e5e0656846c545fe in_seq=0 out_seq=0 2023-06-09T04:41:39.549 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.539+0000 7f3ec17fa700 10 client.4953 ms_handle_connect on v2:172.21.15.89:6835/1496954959 2023-06-09T04:41:39.550 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.543+0000 7f3ec17fa700 1 -- 172.21.15.62:0/2977054830 <== mds.0 v2:172.21.15.89:6835/1496954959 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x19244e0 con 0x1be39c0 2023-06-09T04:41:39.550 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.543+0000 7f3ec17fa700 10 client.4953 handle_command_reply: tid=0 2023-06-09T04:41:39.550 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.543+0000 7f3eebedf740 1 client.4953 shutdown 2023-06-09T04:41:39.550 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.543+0000 7f3eebedf740 1 -- 172.21.15.62:0/2977054830 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x18cc710 msgr2=0x1bcd850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:39.550 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.543+0000 7f3eebedf740 1 --2- 172.21.15.62:0/2977054830 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x18cc710 0x1bcd850 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x1a5e730 tx=0x7f3ed4014000 comp rx=0 tx=0).stop 2023-06-09T04:41:39.550 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.543+0000 7f3eebedf740 1 -- 172.21.15.62:0/2977054830 shutdown_connections 2023-06-09T04:41:39.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.543+0000 7f3eebedf740 1 --2- 172.21.15.62:0/2977054830 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x18cceb0 0x1b9d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:39.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.543+0000 7f3eebedf740 1 --2- 172.21.15.62:0/2977054830 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x18ccae0 0x1b9c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:39.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.543+0000 7f3eebedf740 1 --2- 172.21.15.62:0/2977054830 >> [v2:172.21.15.89:6835/1496954959,v1:172.21.15.89:6837/1496954959] conn(0x1be39c0 0x1b99420 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:39.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.543+0000 7f3eebedf740 1 --2- 172.21.15.62:0/2977054830 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x18cc710 0x1bcd850 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:39.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.543+0000 7f3eebedf740 1 -- 172.21.15.62:0/2977054830 >> 172.21.15.62:0/2977054830 conn(0x1b36d10 msgr2=0x1b6a6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:39.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.543+0000 7f3ec17fa700 0 client.4953 ms_handle_reset on v2:172.21.15.89:6835/1496954959 2023-06-09T04:41:39.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.543+0000 7f3eebedf740 1 -- 172.21.15.62:0/2977054830 shutdown_connections 2023-06-09T04:41:39.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.543+0000 7f3eebedf740 1 -- 172.21.15.62:0/2977054830 wait complete. 2023-06-09T04:41:39.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.543+0000 7f3eebedf740 20 client.4953 trim_cache size 0 max 16384 2023-06-09T04:41:39.552 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2023-06-09T04:41:39.552 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_fsid": "f7998a1e-e5a9-4202-abaa-70c0eaae1047", 2023-06-09T04:41:39.552 INFO:teuthology.orchestra.run.smithi062.stdout: "whoami": 0, 2023-06-09T04:41:39.552 INFO:teuthology.orchestra.run.smithi062.stdout: "id": 4312, 2023-06-09T04:41:39.552 INFO:teuthology.orchestra.run.smithi062.stdout: "want_state": "up:active", 2023-06-09T04:41:39.553 INFO:teuthology.orchestra.run.smithi062.stdout: "state": "up:active", 2023-06-09T04:41:39.553 INFO:teuthology.orchestra.run.smithi062.stdout: "fs_name": "cephfs", 2023-06-09T04:41:39.553 INFO:teuthology.orchestra.run.smithi062.stdout: "rank_uptime": 42.779909916000001, 2023-06-09T04:41:39.553 INFO:teuthology.orchestra.run.smithi062.stdout: "mdsmap_epoch": 9, 2023-06-09T04:41:39.553 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_epoch": 30, 2023-06-09T04:41:39.553 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_epoch_barrier": 28, 2023-06-09T04:41:39.553 INFO:teuthology.orchestra.run.smithi062.stdout: "uptime": 48.140478956999999 2023-06-09T04:41:39.554 INFO:teuthology.orchestra.run.smithi062.stdout:} 2023-06-09T04:41:39.554 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.543+0000 7f3ee359e700 1 -- 172.21.15.62:0/2888842070 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f3ec40662f0 msgr2=0x7f3ec40687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:39.555 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.543+0000 7f3ee359e700 1 --2- 172.21.15.62:0/2888842070 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f3ec40662f0 0x7f3ec40687a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3ed4007fd0 tx=0x7f3ed4007de0 comp rx=0 tx=0).stop 2023-06-09T04:41:39.555 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.543+0000 7f3ee359e700 1 -- 172.21.15.62:0/2888842070 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ee415bbb0 msgr2=0x7f3ee41481a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:39.555 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.543+0000 7f3ee359e700 1 --2- 172.21.15.62:0/2888842070 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ee415bbb0 0x7f3ee41481a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3edc00b370 tx=0x7f3edc004af0 comp rx=0 tx=0).stop 2023-06-09T04:41:39.555 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.543+0000 7f3ee359e700 1 -- 172.21.15.62:0/2888842070 shutdown_connections 2023-06-09T04:41:39.555 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.543+0000 7f3ee359e700 1 --2- 172.21.15.62:0/2888842070 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f3ec40662f0 0x7f3ec40687a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:39.555 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.543+0000 7f3ee359e700 1 --2- 172.21.15.62:0/2888842070 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ee415bbb0 0x7f3ee41481a0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:39.555 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.543+0000 7f3ee359e700 1 --2- 172.21.15.62:0/2888842070 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ee40b1cc0 0x7f3ee40b08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:39.556 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.543+0000 7f3ee359e700 1 --2- 172.21.15.62:0/2888842070 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ee406a900 0x7f3ee40c6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:39.556 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.543+0000 7f3ee359e700 1 -- 172.21.15.62:0/2888842070 >> 172.21.15.62:0/2888842070 conn(0x7f3ee40cccc0 msgr2=0x7f3ee40cb940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:39.556 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.543+0000 7f3ee359e700 1 -- 172.21.15.62:0/2888842070 shutdown_connections 2023-06-09T04:41:39.556 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:39.543+0000 7f3ee359e700 1 -- 172.21.15.62:0/2888842070 wait complete. 2023-06-09T04:41:39.572 INFO:teuthology.run_tasks:Running task kclient... 2023-06-09T04:41:39.586 INFO:tasks.kclient:Mounting kernel clients... 2023-06-09T04:41:39.586 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-06-09T04:41:39.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:39.587 DEBUG:teuthology.orchestra.run.smithi062:> ip netns list 2023-06-09T04:41:39.605 INFO:teuthology.orchestra.run.smithi062.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-06-09T04:41:39.606 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:39.606 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-06-09T04:41:39.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:39.684 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link delete ceph-brx 2023-06-09T04:41:39.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:39.891 DEBUG:teuthology.orchestra.run.smithi062:> ip netns list 2023-06-09T04:41:39.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:39.909 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link delete ceph-brx 2023-06-09T04:41:39.994 INFO:teuthology.orchestra.run.smithi062.stderr:Cannot find device "ceph-brx" 2023-06-09T04:41:39.997 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T04:41:39.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:39.998 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list 2023-06-09T04:41:40.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:40.021 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link delete ceph-brx 2023-06-09T04:41:40.101 INFO:teuthology.orchestra.run.smithi089.stderr:Cannot find device "ceph-brx" 2023-06-09T04:41:40.104 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T04:41:40.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:40.105 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list 2023-06-09T04:41:40.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:40.164 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link delete ceph-brx 2023-06-09T04:41:40.250 INFO:teuthology.orchestra.run.smithi089.stderr:Cannot find device "ceph-brx" 2023-06-09T04:41:40.253 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T04:41:40.254 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-06-09T04:41:40.254 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-06-09T04:41:40.254 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-06-09T04:41:40.255 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-09T04:41:40.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:40.431+0000 7fa74eeca700 1 Processor -- start 2023-06-09T04:41:40.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:40.435+0000 7fa74eeca700 1 -- start start 2023-06-09T04:41:40.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:40.435+0000 7fa74eeca700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa748159c90 0x7fa748070e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:40.442 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:40.435+0000 7fa74eeca700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa7480b08d0 0x7fa748071340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:40.442 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:40.435+0000 7fa74eeca700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa748071880 con 0x7fa7480cb850 2023-06-09T04:41:40.442 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:40.435+0000 7fa74eeca700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa74806b960 con 0x7fa7480b08d0 2023-06-09T04:41:40.442 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:40.435+0000 7fa74eeca700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa74806f9b0 con 0x7fa748159c90 2023-06-09T04:41:40.443 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:40.435+0000 7fa74d467700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa7480b08d0 0x7fa748071340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:40.443 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:40.435+0000 7fa74d467700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa7480b08d0 0x7fa748071340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53668/0 (socket says 172.21.15.62:53668) 2023-06-09T04:41:40.443 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:40.435+0000 7fa747fff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fa7480cb850 0x7fa7480ca160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36332/0 (socket says 172.21.15.62:36332) 2023-06-09T04:41:40.443 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:40.435+0000 7fa74d467700 1 -- 172.21.15.62:0/3434148433 learned_addr learned my addr 172.21.15.62:0/3434148433 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:40.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:40.435+0000 7fa74cc66700 1 --2- 172.21.15.62:0/3434148433 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa748159c90 0x7fa748070e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:40.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:40.439+0000 7fa74d467700 1 -- 172.21.15.62:0/3434148433 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa748159c90 msgr2=0x7fa748070e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:40.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:40.439+0000 7fa74d467700 1 --2- 172.21.15.62:0/3434148433 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa748159c90 0x7fa748070e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:40.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:40.439+0000 7fa74d467700 1 -- 172.21.15.62:0/3434148433 >> v1:172.21.15.62:6789/0 conn(0x7fa7480cb850 legacy=0x7fa7480ca160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:40.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:40.439+0000 7fa74d467700 1 -- 172.21.15.62:0/3434148433 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa74815a060 con 0x7fa7480b08d0 2023-06-09T04:41:40.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:40.439+0000 7fa7477fe700 1 -- 172.21.15.62:0/3434148433 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3268885946 0 0) 0x7fa748071880 con 0x7fa7480cb850 2023-06-09T04:41:40.445 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:40.439+0000 7fa74d467700 1 --2- 172.21.15.62:0/3434148433 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7480b08d0 0x7fa748071340 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa740009e50 tx=0x7fa74000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb786cdcd08862f7 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:40.445 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:40.439+0000 7fa7477fe700 1 -- 172.21.15.62:0/3434148433 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74000e070 con 0x7fa7480b08d0 2023-06-09T04:41:40.445 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:40.439+0000 7fa7477fe700 1 -- 172.21.15.62:0/3434148433 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa74000b910 con 0x7fa7480b08d0 2023-06-09T04:41:40.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:40.439+0000 7fa7477fe700 1 -- 172.21.15.62:0/3434148433 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74000bcc0 con 0x7fa7480b08d0 2023-06-09T04:41:40.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:40.439+0000 7fa74eeca700 1 -- 172.21.15.62:0/3434148433 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7480b08d0 msgr2=0x7fa748071340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:40.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:40.439+0000 7fa74eeca700 1 --2- 172.21.15.62:0/3434148433 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7480b08d0 0x7fa748071340 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa740009e50 tx=0x7fa74000b330 comp rx=0 tx=0).stop 2023-06-09T04:41:40.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:40.439+0000 7fa74eeca700 1 -- 172.21.15.62:0/3434148433 shutdown_connections 2023-06-09T04:41:40.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:40.439+0000 7fa74eeca700 1 --2- 172.21.15.62:0/3434148433 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7480b08d0 0x7fa748071340 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:40.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:40.439+0000 7fa74eeca700 1 --2- 172.21.15.62:0/3434148433 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa748159c90 0x7fa748070e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:40.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:40.439+0000 7fa74eeca700 1 -- 172.21.15.62:0/3434148433 >> 172.21.15.62:0/3434148433 conn(0x7fa74806a410 msgr2=0x7fa7480afd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:40.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:40.439+0000 7fa74eeca700 1 -- 172.21.15.62:0/3434148433 shutdown_connections 2023-06-09T04:41:40.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:40.439+0000 7fa74eeca700 1 -- 172.21.15.62:0/3434148433 wait complete. 2023-06-09T04:41:40.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:40.443+0000 7fa74eeca700 1 Processor -- start 2023-06-09T04:41:40.448 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:40.443+0000 7fa74eeca700 1 -- start start 2023-06-09T04:41:40.449 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:40.443+0000 7fa74eeca700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7480b08d0 0x7fa74815c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:40.449 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:40.443+0000 7fa74eeca700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7480cb850 0x7fa7480c4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:40.449 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:40.443+0000 7fa74eeca700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa748159c90 0x7fa7480c6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:40.449 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:40.443+0000 7fa74eeca700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7480b3ea0 con 0x7fa7480cb850 2023-06-09T04:41:40.450 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:40.443+0000 7fa74eeca700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7480c4b50 con 0x7fa7480b08d0 2023-06-09T04:41:40.450 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:40.443+0000 7fa74eeca700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7480b2650 con 0x7fa748159c90 2023-06-09T04:41:40.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:40.443+0000 7fa747fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7480cb850 0x7fa7480c4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:40.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:40.443+0000 7fa747fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7480cb850 0x7fa7480c4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53676/0 (socket says 172.21.15.62:53676) 2023-06-09T04:41:40.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:40.443+0000 7fa747fff700 1 -- 172.21.15.62:0/295688957 learned_addr learned my addr 172.21.15.62:0/295688957 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:40.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:40.443+0000 7fa74d467700 1 --2- 172.21.15.62:0/295688957 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa748159c90 0x7fa7480c6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:40.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:40.443+0000 7fa74cc66700 1 --2- 172.21.15.62:0/295688957 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7480b08d0 0x7fa74815c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:40.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:40.443+0000 7fa747fff700 1 -- 172.21.15.62:0/295688957 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa748159c90 msgr2=0x7fa7480c6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:40.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:40.443+0000 7fa747fff700 1 --2- 172.21.15.62:0/295688957 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa748159c90 0x7fa7480c6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:40.452 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:40.443+0000 7fa747fff700 1 -- 172.21.15.62:0/295688957 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7480b08d0 msgr2=0x7fa74815c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:40.452 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:40.443+0000 7fa747fff700 1 --2- 172.21.15.62:0/295688957 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7480b08d0 0x7fa74815c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:40.452 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:40.443+0000 7fa747fff700 1 -- 172.21.15.62:0/295688957 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa740009b30 con 0x7fa7480cb850 2023-06-09T04:41:40.452 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:40.443+0000 7fa747fff700 1 --2- 172.21.15.62:0/295688957 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7480cb850 0x7fa7480c4610 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa73400c780 tx=0x7fa73400cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:40.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:40.447+0000 7fa7457fa700 1 -- 172.21.15.62:0/295688957 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa734004ca0 con 0x7fa7480cb850 2023-06-09T04:41:40.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:40.447+0000 7fa7457fa700 1 -- 172.21.15.62:0/295688957 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa734004e20 con 0x7fa7480cb850 2023-06-09T04:41:40.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:40.447+0000 7fa74eeca700 1 -- 172.21.15.62:0/295688957 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa74815ce40 con 0x7fa7480cb850 2023-06-09T04:41:40.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:40.447+0000 7fa7457fa700 1 -- 172.21.15.62:0/295688957 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa734007310 con 0x7fa7480cb850 2023-06-09T04:41:40.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:40.447+0000 7fa74eeca700 1 -- 172.21.15.62:0/295688957 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7480b2e20 con 0x7fa7480cb850 2023-06-09T04:41:40.454 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:40.447+0000 7fa74eeca700 1 -- 172.21.15.62:0/295688957 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa74804db30 con 0x7fa7480cb850 2023-06-09T04:41:40.455 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:40.451+0000 7fa7457fa700 1 -- 172.21.15.62:0/295688957 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa734007470 con 0x7fa7480cb850 2023-06-09T04:41:40.456 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:40.451+0000 7fa7457fa700 1 --2- 172.21.15.62:0/295688957 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fa72c0662f0 0x7fa72c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:40.457 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:40.451+0000 7fa7457fa700 1 -- 172.21.15.62:0/295688957 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa734083d90 con 0x7fa7480cb850 2023-06-09T04:41:40.457 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:40.451+0000 7fa74cc66700 1 --2- 172.21.15.62:0/295688957 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fa72c0662f0 0x7fa72c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:40.458 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:40.451+0000 7fa74cc66700 1 --2- 172.21.15.62:0/295688957 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fa72c0662f0 0x7fa72c0687a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa73c009ae0 tx=0x7fa73c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:40.461 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:40.455+0000 7fa7457fa700 1 -- 172.21.15.62:0/295688957 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa734050ee0 con 0x7fa7480cb850 2023-06-09T04:41:40.668 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:40.663+0000 7fa74eeca700 1 -- 172.21.15.62:0/295688957 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa7480cb2a0 con 0x7fa7480cb850 2023-06-09T04:41:40.669 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:40.663+0000 7fa7457fa700 1 -- 172.21.15.62:0/295688957 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fa734007720 con 0x7fa7480cb850 2023-06-09T04:41:40.669 INFO:teuthology.orchestra.run.smithi062.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-06-09T04:41:40.672 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:40.667+0000 7fa74eeca700 1 -- 172.21.15.62:0/295688957 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fa72c0662f0 msgr2=0x7fa72c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:40.672 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:40.667+0000 7fa74eeca700 1 --2- 172.21.15.62:0/295688957 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fa72c0662f0 0x7fa72c0687a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa73c009ae0 tx=0x7fa73c008040 comp rx=0 tx=0).stop 2023-06-09T04:41:40.673 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:40.667+0000 7fa74eeca700 1 -- 172.21.15.62:0/295688957 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7480cb850 msgr2=0x7fa7480c4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:40.673 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:40.667+0000 7fa74eeca700 1 --2- 172.21.15.62:0/295688957 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7480cb850 0x7fa7480c4610 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa73400c780 tx=0x7fa73400cb40 comp rx=0 tx=0).stop 2023-06-09T04:41:40.673 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:40.667+0000 7fa74eeca700 1 -- 172.21.15.62:0/295688957 shutdown_connections 2023-06-09T04:41:40.674 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:40.667+0000 7fa74eeca700 1 --2- 172.21.15.62:0/295688957 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fa72c0662f0 0x7fa72c0687a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:40.674 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:40.667+0000 7fa74eeca700 1 --2- 172.21.15.62:0/295688957 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa748159c90 0x7fa7480c6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:40.674 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:40.667+0000 7fa74eeca700 1 --2- 172.21.15.62:0/295688957 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7480cb850 0x7fa7480c4610 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:40.674 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:40.667+0000 7fa74eeca700 1 --2- 172.21.15.62:0/295688957 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa7480b08d0 0x7fa74815c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:40.674 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:40.667+0000 7fa74eeca700 1 -- 172.21.15.62:0/295688957 >> 172.21.15.62:0/295688957 conn(0x7fa74806a410 msgr2=0x7fa7480c9f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:40.674 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:40.667+0000 7fa74eeca700 1 -- 172.21.15.62:0/295688957 shutdown_connections 2023-06-09T04:41:40.675 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:40.667+0000 7fa74eeca700 1 -- 172.21.15.62:0/295688957 wait complete. 2023-06-09T04:41:40.695 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-09T04:41:40.696 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-09T04:41:40.696 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi062.front.sepia.ceph.com 2023-06-09T04:41:40.696 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-06-09T04:41:40.696 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-06-09T04:41:40.697 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-09T04:41:40.697 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-09T04:41:40.697 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-09T04:41:40.697 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-06-09T04:41:40.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:40.698 DEBUG:teuthology.orchestra.run.smithi062:> ip addr 2023-06-09T04:41:40.715 INFO:teuthology.orchestra.run.smithi062.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-09T04:41:40.715 INFO:teuthology.orchestra.run.smithi062.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-09T04:41:40.715 INFO:teuthology.orchestra.run.smithi062.stdout: inet 127.0.0.1/8 scope host lo 2023-06-09T04:41:40.715 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:41:40.716 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 ::1/128 scope host 2023-06-09T04:41:40.716 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:41:40.716 INFO:teuthology.orchestra.run.smithi062.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-09T04:41:40.716 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:a9:aa:14 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:41:40.716 INFO:teuthology.orchestra.run.smithi062.stdout: altname enp7s0f0 2023-06-09T04:41:40.716 INFO:teuthology.orchestra.run.smithi062.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-09T04:41:40.717 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:a9:aa:15 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:41:40.717 INFO:teuthology.orchestra.run.smithi062.stdout: altname enp7s0f1 2023-06-09T04:41:40.717 INFO:teuthology.orchestra.run.smithi062.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-09T04:41:40.717 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:bb:d1:c2 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:41:40.717 INFO:teuthology.orchestra.run.smithi062.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-09T04:41:40.717 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:bb:d1:c3 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:41:40.717 INFO:teuthology.orchestra.run.smithi062.stdout: inet 172.21.15.62/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-06-09T04:41:40.718 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft 42406sec preferred_lft 42406sec 2023-06-09T04:41:40.718 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 fe80::ec4:7aff:febb:d1c3/64 scope link 2023-06-09T04:41:40.718 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:41:40.718 INFO:teuthology.orchestra.run.smithi062.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-06-09T04:41:40.718 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 02:42:bd:2a:61:d1 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:41:40.718 INFO:teuthology.orchestra.run.smithi062.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-06-09T04:41:40.718 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:41:40.719 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-06-09T04:41:40.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:40.720 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec bash -c ' 2023-06-09T04:41:40.720 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2023-06-09T04:41:40.720 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link add name ceph-brx type bridge 2023-06-09T04:41:40.721 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip addr flush dev ceph-brx 2023-06-09T04:41:40.721 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link set ceph-brx up 2023-06-09T04:41:40.721 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-06-09T04:41:40.721 DEBUG:teuthology.orchestra.run.smithi062:> ') 2023-06-09T04:41:40.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:40.884 DEBUG:teuthology.orchestra.run.smithi062:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-09T04:41:40.917 INFO:teuthology.orchestra.run.smithi062.stdout:1 2023-06-09T04:41:40.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:40.920 DEBUG:teuthology.orchestra.run.smithi062:> route 2023-06-09T04:41:40.985 INFO:teuthology.orchestra.run.smithi062.stdout:Kernel IP routing table 2023-06-09T04:41:40.985 INFO:teuthology.orchestra.run.smithi062.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-09T04:41:40.985 INFO:teuthology.orchestra.run.smithi062.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-06-09T04:41:40.986 INFO:teuthology.orchestra.run.smithi062.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-06-09T04:41:40.986 INFO:teuthology.orchestra.run.smithi062.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-06-09T04:41:40.986 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-06-09T04:41:40.986 INFO:teuthology.orchestra.run.smithi062.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-09T04:41:40.986 INFO:teuthology.orchestra.run.smithi062.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-09T04:41:40.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:40.987 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec bash -c ' 2023-06-09T04:41:40.988 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2023-06-09T04:41:40.988 DEBUG:teuthology.orchestra.run.smithi062:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-06-09T04:41:40.988 DEBUG:teuthology.orchestra.run.smithi062:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-06-09T04:41:40.988 DEBUG:teuthology.orchestra.run.smithi062:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-06-09T04:41:40.989 DEBUG:teuthology.orchestra.run.smithi062:> ') 2023-06-09T04:41:41.129 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:41.130 DEBUG:teuthology.orchestra.run.smithi062:> ip netns list 2023-06-09T04:41:41.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:41.150 DEBUG:teuthology.orchestra.run.smithi062:> ip netns list-id 2023-06-09T04:41:41.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:41.209 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec bash -c ' 2023-06-09T04:41:41.209 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2023-06-09T04:41:41.209 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-06-09T04:41:41.209 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-06-09T04:41:41.210 DEBUG:teuthology.orchestra.run.smithi062:> ') 2023-06-09T04:41:41.326 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-06-09T04:41:41.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:41.327 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec bash -c ' 2023-06-09T04:41:41.327 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2023-06-09T04:41:41.327 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-06-09T04:41:41.328 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-06-09T04:41:41.328 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-06-09T04:41:41.328 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-06-09T04:41:41.328 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-06-09T04:41:41.329 DEBUG:teuthology.orchestra.run.smithi062:> ') 2023-06-09T04:41:41.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:41.485 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec bash -c ' 2023-06-09T04:41:41.485 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2023-06-09T04:41:41.485 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link set brx.0 up 2023-06-09T04:41:41.486 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link set dev brx.0 master ceph-brx 2023-06-09T04:41:41.486 DEBUG:teuthology.orchestra.run.smithi062:> ') 2023-06-09T04:41:41.558 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-09T04:41:41.558 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-06-09T04:41:41.574 INFO:teuthology.orchestra.run.smithi062.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-06-09T04:41:41.574 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-09T04:41:41.575 DEBUG:teuthology.orchestra.run.smithi062:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-06-09T04:41:41.634 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-06-09T04:41:41.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:41.635 DEBUG:teuthology.orchestra.run.smithi062:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-06-09T04:41:41.764 INFO:teuthology.orchestra.run.smithi062.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-06-09T04:41:41.764 INFO:teuthology.orchestra.run.smithi062.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-06-09T04:41:41.765 INFO:teuthology.orchestra.run.smithi062.stdout:invalid new device string format 2023-06-09T04:41:41.889 INFO:teuthology.orchestra.run.smithi062.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-06-09T04:41:41.889 INFO:teuthology.orchestra.run.smithi062.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-06-09T04:41:41.890 INFO:teuthology.orchestra.run.smithi062.stdout:invalid new device string format 2023-06-09T04:41:41.890 INFO:teuthology.orchestra.run.smithi062.stdout:mount.ceph: resolved to: "172.21.15.62:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-06-09T04:41:41.890 INFO:teuthology.orchestra.run.smithi062.stdout:mount.ceph: switching to using v1 address with old syntax 2023-06-09T04:41:41.914 INFO:teuthology.orchestra.run.smithi062.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-06-09T04:41:41.914 INFO:teuthology.orchestra.run.smithi062.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-06-09T04:41:41.914 INFO:teuthology.orchestra.run.smithi062.stdout:invalid new device string format 2023-06-09T04:41:41.914 INFO:teuthology.orchestra.run.smithi062.stdout:mount.ceph: resolved to: "172.21.15.62:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-06-09T04:41:41.914 INFO:teuthology.orchestra.run.smithi062.stdout:mount.ceph: switching to using v1 address with old syntax 2023-06-09T04:41:41.914 INFO:teuthology.orchestra.run.smithi062.stdout:mount.ceph: resolved to: "172.21.15.62:6789,172.21.15.89:6789,172.21.15.89:6790" 2023-06-09T04:41:41.914 INFO:teuthology.orchestra.run.smithi062.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.62:6789,172.21.15.89:6789,172.21.15.89:6790:/ 2023-06-09T04:41:41.915 INFO:teuthology.orchestra.run.smithi062.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=f7998a1e-e5a9-4202-abaa-70c0eaae1047" will pass to kernel 2023-06-09T04:41:41.921 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-06-09T04:41:41.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:41.922 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-06-09T04:41:41.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:41.955 DEBUG:teuthology.orchestra.run.smithi062:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-09T04:41:42.021 INFO:teuthology.orchestra.run.smithi062.stdout:client4709 2023-06-09T04:41:42.022 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-06-09T04:41:42.022 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:41:42.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:42.081 DEBUG:teuthology.orchestra.run.smithi062:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-09T04:41:42.149 INFO:teuthology.orchestra.run.smithi062.stdout:client4709 2023-06-09T04:41:42.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:42.150 DEBUG:teuthology.orchestra.run.smithi062:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-09T04:41:42.219 INFO:teuthology.orchestra.run.smithi062.stdout:client4709 2023-06-09T04:41:42.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:42.220 DEBUG:teuthology.orchestra.run.smithi062:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/f7998a1e-e5a9-4202-abaa-70c0eaae1047.client4709/status') 2023-06-09T04:41:42.301 INFO:teuthology.orchestra.run.smithi062.stdout:instance: client.4709 (3)172.21.15.62:0/2351614092 2023-06-09T04:41:42.301 INFO:teuthology.orchestra.run.smithi062.stdout:blocklisted: false 2023-06-09T04:41:42.301 INFO:teuthology.orchestra.run.smithi062.stderr:0+1 records in 2023-06-09T04:41:42.302 INFO:teuthology.orchestra.run.smithi062.stderr:0+1 records out 2023-06-09T04:41:42.302 INFO:teuthology.orchestra.run.smithi062.stderr:70 bytes copied, 0.000148131 s, 473 kB/s 2023-06-09T04:41:42.304 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2023-06-09T04:41:42.304 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-06-09T04:41:42.304 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-06-09T04:41:42.305 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-09T04:41:42.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:42.519+0000 7f54ce7aa700 1 Processor -- start 2023-06-09T04:41:42.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:42.519+0000 7f54ce7aa700 1 -- start start 2023-06-09T04:41:42.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:42.523+0000 7f54ce7aa700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f54c80cc030 0x7f54c80cd750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:42.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:42.523+0000 7f54ce7aa700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f54c80ca7a0 0x7f54c80cdc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:42.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:42.523+0000 7f54ce7aa700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54c80cb6c0 con 0x7f54c80c8840 2023-06-09T04:41:42.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:42.523+0000 7f54ce7aa700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54c80ccfe0 con 0x7f54c80cc030 2023-06-09T04:41:42.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:42.523+0000 7f54ce7aa700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54c80c1360 con 0x7f54c80ca7a0 2023-06-09T04:41:42.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:42.523+0000 7f54c7fff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f54c80cc030 0x7f54c80cd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:42.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:42.523+0000 7f54c7fff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f54c80cc030 0x7f54c80cd750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.62:53818/0 (socket says 172.21.15.62:53818) 2023-06-09T04:41:42.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:42.523+0000 7f54c7fff700 1 -- 172.21.15.62:0/2756119582 learned_addr learned my addr 172.21.15.62:0/2756119582 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:42.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:42.523+0000 7f54ccd47700 1 --2- 172.21.15.62:0/2756119582 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f54c80ca7a0 0x7f54c80cdc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:42.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:42.523+0000 7f54ccd47700 1 -- 172.21.15.62:0/2756119582 >> v2:172.21.15.89:3300/0 conn(0x7f54c80cc030 msgr2=0x7f54c80cd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:42.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:42.523+0000 7f54ccd47700 1 --2- 172.21.15.62:0/2756119582 >> v2:172.21.15.89:3300/0 conn(0x7f54c80cc030 0x7f54c80cd750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:42.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:42.523+0000 7f54ccd47700 1 -- 172.21.15.62:0/2756119582 >> v1:172.21.15.89:6789/0 conn(0x7f54c80c8840 legacy=0x7f54c80ca090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:42.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:42.523+0000 7f54ccd47700 1 -- 172.21.15.62:0/2756119582 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54c80c1080 con 0x7f54c80ca7a0 2023-06-09T04:41:42.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:42.523+0000 7f54c7fff700 1 --2- 172.21.15.62:0/2756119582 >> v2:172.21.15.89:3300/0 conn(0x7f54c80cc030 0x7f54c80cd750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:41:42.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:42.523+0000 7f54ccd47700 1 --2- 172.21.15.62:0/2756119582 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f54c80ca7a0 0x7f54c80cdc90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f54c0009d90 tx=0x7f54c000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f456f27e9f3ca0d5 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:42.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:42.527+0000 7f54c77fe700 1 -- 172.21.15.62:0/2756119582 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c000e070 con 0x7f54c80ca7a0 2023-06-09T04:41:42.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:42.527+0000 7f54c77fe700 1 -- 172.21.15.62:0/2756119582 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54c000bb20 con 0x7f54c80ca7a0 2023-06-09T04:41:42.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:42.527+0000 7f54c77fe700 1 -- 172.21.15.62:0/2756119582 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c0012430 con 0x7f54c80ca7a0 2023-06-09T04:41:42.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:42.527+0000 7f54ce7aa700 1 -- 172.21.15.62:0/2756119582 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f54c80ca7a0 msgr2=0x7f54c80cdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:42.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:42.527+0000 7f54ce7aa700 1 --2- 172.21.15.62:0/2756119582 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f54c80ca7a0 0x7f54c80cdc90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f54c0009d90 tx=0x7f54c000b330 comp rx=0 tx=0).stop 2023-06-09T04:41:42.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:42.527+0000 7f54ce7aa700 1 -- 172.21.15.62:0/2756119582 shutdown_connections 2023-06-09T04:41:42.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:42.527+0000 7f54ce7aa700 1 --2- 172.21.15.62:0/2756119582 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f54c80ca7a0 0x7f54c80cdc90 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:42.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:42.527+0000 7f54ce7aa700 1 --2- 172.21.15.62:0/2756119582 >> v2:172.21.15.89:3300/0 conn(0x7f54c80cc030 0x7f54c80cd750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:42.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:42.527+0000 7f54ce7aa700 1 -- 172.21.15.62:0/2756119582 >> 172.21.15.62:0/2756119582 conn(0x7f54c806a410 msgr2=0x7f54c80afd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:42.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:42.527+0000 7f54ce7aa700 1 -- 172.21.15.62:0/2756119582 shutdown_connections 2023-06-09T04:41:42.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:42.527+0000 7f54ce7aa700 1 -- 172.21.15.62:0/2756119582 wait complete. 2023-06-09T04:41:42.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:42.531+0000 7f54ce7aa700 1 Processor -- start 2023-06-09T04:41:42.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:42.531+0000 7f54ce7aa700 1 -- start start 2023-06-09T04:41:42.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:42.531+0000 7f54ce7aa700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f54c80c8840 0x7f54c81f5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:42.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:42.531+0000 7f54ce7aa700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54c80ca7a0 0x7f54c81f89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:42.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:42.531+0000 7f54ce7aa700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f54c80cc030 0x7f54c8070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:42.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:42.531+0000 7f54ce7aa700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c81f8f20 con 0x7f54c80c8840 2023-06-09T04:41:42.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:42.531+0000 7f54ce7aa700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c80c4f20 con 0x7f54c80ca7a0 2023-06-09T04:41:42.539 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:42.531+0000 7f54ce7aa700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54c80c67c0 con 0x7f54c80cc030 2023-06-09T04:41:42.539 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:42.531+0000 7f54c7fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f54c80c8840 0x7f54c81f5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:42.539 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:42.531+0000 7f54c7fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f54c80c8840 0x7f54c81f5b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55090/0 (socket says 172.21.15.62:55090) 2023-06-09T04:41:42.539 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:42.531+0000 7f54c7fff700 1 -- 172.21.15.62:0/1450550367 learned_addr learned my addr 172.21.15.62:0/1450550367 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:42.539 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:42.531+0000 7f54ccd47700 1 --2- 172.21.15.62:0/1450550367 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f54c80cc030 0x7f54c8070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:42.539 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:42.531+0000 7f54bf7fe700 1 --2- 172.21.15.62:0/1450550367 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54c80ca7a0 0x7f54c81f89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:42.539 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:42.531+0000 7f54c7fff700 1 -- 172.21.15.62:0/1450550367 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f54c80cc030 msgr2=0x7f54c8070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:42.540 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:42.531+0000 7f54c7fff700 1 --2- 172.21.15.62:0/1450550367 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f54c80cc030 0x7f54c8070690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:42.540 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:42.531+0000 7f54c7fff700 1 -- 172.21.15.62:0/1450550367 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54c80ca7a0 msgr2=0x7f54c81f89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:42.540 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:42.531+0000 7f54c7fff700 1 --2- 172.21.15.62:0/1450550367 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54c80ca7a0 0x7f54c81f89e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:42.540 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:42.531+0000 7f54c7fff700 1 -- 172.21.15.62:0/1450550367 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54b8009570 con 0x7f54c80c8840 2023-06-09T04:41:42.540 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:42.531+0000 7f54bf7fe700 1 --2- 172.21.15.62:0/1450550367 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54c80ca7a0 0x7f54c81f89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:41:42.541 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:42.535+0000 7f54c7fff700 1 --2- 172.21.15.62:0/1450550367 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f54c80c8840 0x7f54c81f5b50 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f54b800e9d0 tx=0x7f54b800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:42.541 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:42.535+0000 7f54c57fa700 1 -- 172.21.15.62:0/1450550367 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b800c850 con 0x7f54c80c8840 2023-06-09T04:41:42.541 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:42.535+0000 7f54c57fa700 1 -- 172.21.15.62:0/1450550367 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54b800c9b0 con 0x7f54c80c8840 2023-06-09T04:41:42.541 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:42.535+0000 7f54c57fa700 1 -- 172.21.15.62:0/1450550367 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b800cd20 con 0x7f54c80c8840 2023-06-09T04:41:42.542 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:42.535+0000 7f54ce7aa700 1 -- 172.21.15.62:0/1450550367 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54c0009a70 con 0x7f54c80c8840 2023-06-09T04:41:42.542 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:42.535+0000 7f54ce7aa700 1 -- 172.21.15.62:0/1450550367 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54c80c6d80 con 0x7f54c80c8840 2023-06-09T04:41:42.542 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:42.535+0000 7f54ce7aa700 1 -- 172.21.15.62:0/1450550367 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54c804db30 con 0x7f54c80c8840 2023-06-09T04:41:42.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:42.539+0000 7f54c57fa700 1 -- 172.21.15.62:0/1450550367 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f54b8013470 con 0x7f54c80c8840 2023-06-09T04:41:42.545 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:42.539+0000 7f54c57fa700 1 --2- 172.21.15.62:0/1450550367 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f54ac0662f0 0x7f54ac0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:42.546 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:42.539+0000 7f54c57fa700 1 -- 172.21.15.62:0/1450550367 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f54b8083e50 con 0x7f54c80c8840 2023-06-09T04:41:42.546 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:42.539+0000 7f54bf7fe700 1 --2- 172.21.15.62:0/1450550367 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f54ac0662f0 0x7f54ac0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:42.547 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:42.543+0000 7f54bf7fe700 1 --2- 172.21.15.62:0/1450550367 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f54ac0662f0 0x7f54ac0687a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f54c80c84f0 tx=0x7f54b0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:42.550 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:42.543+0000 7f54c57fa700 1 -- 172.21.15.62:0/1450550367 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f54b8050f00 con 0x7f54c80c8840 2023-06-09T04:41:42.760 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:42.755+0000 7f54ce7aa700 1 -- 172.21.15.62:0/1450550367 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f54c806c6b0 con 0x7f54c80c8840 2023-06-09T04:41:42.761 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:42.755+0000 7f54c57fa700 1 -- 172.21.15.62:0/1450550367 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f54b8054520 con 0x7f54c80c8840 2023-06-09T04:41:42.761 INFO:teuthology.orchestra.run.smithi062.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-06-09T04:41:42.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:42.759+0000 7f54ce7aa700 1 -- 172.21.15.62:0/1450550367 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f54ac0662f0 msgr2=0x7f54ac0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:42.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:42.759+0000 7f54ce7aa700 1 --2- 172.21.15.62:0/1450550367 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f54ac0662f0 0x7f54ac0687a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f54c80c84f0 tx=0x7f54b0009040 comp rx=0 tx=0).stop 2023-06-09T04:41:42.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:42.759+0000 7f54ce7aa700 1 -- 172.21.15.62:0/1450550367 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f54c80c8840 msgr2=0x7f54c81f5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:42.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:42.759+0000 7f54ce7aa700 1 --2- 172.21.15.62:0/1450550367 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f54c80c8840 0x7f54c81f5b50 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f54b800e9d0 tx=0x7f54b800ece0 comp rx=0 tx=0).stop 2023-06-09T04:41:42.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:42.759+0000 7f54ce7aa700 1 -- 172.21.15.62:0/1450550367 shutdown_connections 2023-06-09T04:41:42.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:42.759+0000 7f54ce7aa700 1 --2- 172.21.15.62:0/1450550367 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f54ac0662f0 0x7f54ac0687a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:42.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:42.759+0000 7f54ce7aa700 1 --2- 172.21.15.62:0/1450550367 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f54c80cc030 0x7f54c8070690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:42.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:42.759+0000 7f54ce7aa700 1 --2- 172.21.15.62:0/1450550367 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54c80ca7a0 0x7f54c81f89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:42.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:42.759+0000 7f54ce7aa700 1 --2- 172.21.15.62:0/1450550367 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f54c80c8840 0x7f54c81f5b50 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:42.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:42.759+0000 7f54ce7aa700 1 -- 172.21.15.62:0/1450550367 >> 172.21.15.62:0/1450550367 conn(0x7f54c806a410 msgr2=0x7f54c806b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:42.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:42.759+0000 7f54ce7aa700 1 -- 172.21.15.62:0/1450550367 shutdown_connections 2023-06-09T04:41:42.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:42.759+0000 7f54ce7aa700 1 -- 172.21.15.62:0/1450550367 wait complete. 2023-06-09T04:41:42.787 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-09T04:41:42.787 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-09T04:41:42.787 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi062.front.sepia.ceph.com 2023-06-09T04:41:42.787 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-06-09T04:41:42.788 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-06-09T04:41:42.788 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-09T04:41:42.788 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-09T04:41:42.788 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-09T04:41:42.788 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-06-09T04:41:42.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:42.789 DEBUG:teuthology.orchestra.run.smithi062:> ip addr 2023-06-09T04:41:42.806 INFO:teuthology.orchestra.run.smithi062.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-09T04:41:42.806 INFO:teuthology.orchestra.run.smithi062.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-09T04:41:42.806 INFO:teuthology.orchestra.run.smithi062.stdout: inet 127.0.0.1/8 scope host lo 2023-06-09T04:41:42.806 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:41:42.807 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 ::1/128 scope host 2023-06-09T04:41:42.807 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:41:42.807 INFO:teuthology.orchestra.run.smithi062.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-09T04:41:42.807 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:a9:aa:14 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:41:42.807 INFO:teuthology.orchestra.run.smithi062.stdout: altname enp7s0f0 2023-06-09T04:41:42.807 INFO:teuthology.orchestra.run.smithi062.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-09T04:41:42.807 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:a9:aa:15 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:41:42.808 INFO:teuthology.orchestra.run.smithi062.stdout: altname enp7s0f1 2023-06-09T04:41:42.808 INFO:teuthology.orchestra.run.smithi062.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-09T04:41:42.808 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:bb:d1:c2 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:41:42.808 INFO:teuthology.orchestra.run.smithi062.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-09T04:41:42.808 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:bb:d1:c3 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:41:42.808 INFO:teuthology.orchestra.run.smithi062.stdout: inet 172.21.15.62/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-06-09T04:41:42.809 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft 42403sec preferred_lft 42403sec 2023-06-09T04:41:42.809 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 fe80::ec4:7aff:febb:d1c3/64 scope link 2023-06-09T04:41:42.809 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:41:42.809 INFO:teuthology.orchestra.run.smithi062.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-06-09T04:41:42.809 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 02:42:bd:2a:61:d1 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:41:42.809 INFO:teuthology.orchestra.run.smithi062.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-06-09T04:41:42.809 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:41:42.809 INFO:teuthology.orchestra.run.smithi062.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-09T04:41:42.810 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 9a:39:11:ee:08:bb brd ff:ff:ff:ff:ff:ff 2023-06-09T04:41:42.810 INFO:teuthology.orchestra.run.smithi062.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-06-09T04:41:42.810 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:41:42.810 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 fe80::d45a:e2ff:fe00:d56e/64 scope link 2023-06-09T04:41:42.810 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:41:42.810 INFO:teuthology.orchestra.run.smithi062.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-09T04:41:42.810 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 9a:39:11:ee:08:bb brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-06-09T04:41:42.811 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 fe80::9839:11ff:feee:8bb/64 scope link 2023-06-09T04:41:42.811 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:41:42.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:42.812 DEBUG:teuthology.orchestra.run.smithi062:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-09T04:41:42.890 INFO:teuthology.orchestra.run.smithi062.stdout:1 2023-06-09T04:41:42.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:42.894 DEBUG:teuthology.orchestra.run.smithi062:> route 2023-06-09T04:41:42.953 INFO:teuthology.orchestra.run.smithi062.stdout:Kernel IP routing table 2023-06-09T04:41:42.954 INFO:teuthology.orchestra.run.smithi062.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-09T04:41:42.954 INFO:teuthology.orchestra.run.smithi062.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-06-09T04:41:42.954 INFO:teuthology.orchestra.run.smithi062.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-06-09T04:41:42.954 INFO:teuthology.orchestra.run.smithi062.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-06-09T04:41:42.954 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-06-09T04:41:42.955 INFO:teuthology.orchestra.run.smithi062.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-09T04:41:42.955 INFO:teuthology.orchestra.run.smithi062.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-09T04:41:42.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:42.956 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec bash -c ' 2023-06-09T04:41:42.956 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2023-06-09T04:41:42.956 DEBUG:teuthology.orchestra.run.smithi062:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-06-09T04:41:42.957 DEBUG:teuthology.orchestra.run.smithi062:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-06-09T04:41:42.957 DEBUG:teuthology.orchestra.run.smithi062:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-06-09T04:41:42.957 DEBUG:teuthology.orchestra.run.smithi062:> ') 2023-06-09T04:41:43.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:43.100 DEBUG:teuthology.orchestra.run.smithi062:> ip netns list 2023-06-09T04:41:43.116 INFO:teuthology.orchestra.run.smithi062.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-06-09T04:41:43.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:43.117 DEBUG:teuthology.orchestra.run.smithi062:> ip netns list-id 2023-06-09T04:41:43.180 INFO:teuthology.orchestra.run.smithi062.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-06-09T04:41:43.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:43.181 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec bash -c ' 2023-06-09T04:41:43.181 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2023-06-09T04:41:43.181 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-06-09T04:41:43.182 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-06-09T04:41:43.182 DEBUG:teuthology.orchestra.run.smithi062:> ') 2023-06-09T04:41:43.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:43.301 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-06-09T04:41:43.336 INFO:teuthology.orchestra.run.smithi062.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-09T04:41:43.337 INFO:teuthology.orchestra.run.smithi062.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-09T04:41:43.337 INFO:teuthology.orchestra.run.smithi062.stdout: inet 127.0.0.1/8 scope host lo 2023-06-09T04:41:43.337 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:41:43.337 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 ::1/128 scope host 2023-06-09T04:41:43.337 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:41:43.337 INFO:teuthology.orchestra.run.smithi062.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-09T04:41:43.337 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 2a:4e:11:81:09:82 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-06-09T04:41:43.338 INFO:teuthology.orchestra.run.smithi062.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-06-09T04:41:43.338 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:41:43.338 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 fe80::284e:11ff:fe81:982/64 scope link tentative 2023-06-09T04:41:43.338 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:41:43.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:43.341 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-06-09T04:41:43.420 INFO:teuthology.orchestra.run.smithi062.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-09T04:41:43.420 INFO:teuthology.orchestra.run.smithi062.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-09T04:41:43.420 INFO:teuthology.orchestra.run.smithi062.stdout: inet 127.0.0.1/8 scope host lo 2023-06-09T04:41:43.421 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:41:43.421 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 ::1/128 scope host 2023-06-09T04:41:43.421 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:41:43.421 INFO:teuthology.orchestra.run.smithi062.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-09T04:41:43.421 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 2a:4e:11:81:09:82 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-06-09T04:41:43.421 INFO:teuthology.orchestra.run.smithi062.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-06-09T04:41:43.421 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:41:43.422 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 fe80::284e:11ff:fe81:982/64 scope link 2023-06-09T04:41:43.422 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:41:43.424 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-06-09T04:41:43.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:43.425 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec bash -c ' 2023-06-09T04:41:43.425 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2023-06-09T04:41:43.425 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-06-09T04:41:43.425 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-06-09T04:41:43.426 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-06-09T04:41:43.426 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-06-09T04:41:43.426 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-06-09T04:41:43.426 DEBUG:teuthology.orchestra.run.smithi062:> ') 2023-06-09T04:41:43.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:43.623 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec bash -c ' 2023-06-09T04:41:43.623 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2023-06-09T04:41:43.624 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link set brx.1 up 2023-06-09T04:41:43.624 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link set dev brx.1 master ceph-brx 2023-06-09T04:41:43.624 DEBUG:teuthology.orchestra.run.smithi062:> ') 2023-06-09T04:41:43.695 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-09T04:41:43.695 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-06-09T04:41:43.712 INFO:teuthology.orchestra.run.smithi062.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-06-09T04:41:43.712 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-09T04:41:43.712 DEBUG:teuthology.orchestra.run.smithi062:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-06-09T04:41:43.770 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-06-09T04:41:43.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:43.771 DEBUG:teuthology.orchestra.run.smithi062:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-06-09T04:41:43.907 INFO:teuthology.orchestra.run.smithi062.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-06-09T04:41:43.908 INFO:teuthology.orchestra.run.smithi062.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-06-09T04:41:43.908 INFO:teuthology.orchestra.run.smithi062.stdout:invalid new device string format 2023-06-09T04:41:43.935 INFO:teuthology.orchestra.run.smithi062.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-06-09T04:41:43.935 INFO:teuthology.orchestra.run.smithi062.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-06-09T04:41:43.935 INFO:teuthology.orchestra.run.smithi062.stdout:invalid new device string format 2023-06-09T04:41:43.936 INFO:teuthology.orchestra.run.smithi062.stdout:mount.ceph: resolved to: "172.21.15.62:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-06-09T04:41:43.936 INFO:teuthology.orchestra.run.smithi062.stdout:mount.ceph: switching to using v1 address with old syntax 2023-06-09T04:41:43.953 INFO:teuthology.orchestra.run.smithi062.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-06-09T04:41:43.954 INFO:teuthology.orchestra.run.smithi062.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-06-09T04:41:43.954 INFO:teuthology.orchestra.run.smithi062.stdout:invalid new device string format 2023-06-09T04:41:43.954 INFO:teuthology.orchestra.run.smithi062.stdout:mount.ceph: resolved to: "172.21.15.62:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-06-09T04:41:43.954 INFO:teuthology.orchestra.run.smithi062.stdout:mount.ceph: switching to using v1 address with old syntax 2023-06-09T04:41:43.954 INFO:teuthology.orchestra.run.smithi062.stdout:mount.ceph: resolved to: "172.21.15.62:6789,172.21.15.89:6789,172.21.15.89:6790" 2023-06-09T04:41:43.955 INFO:teuthology.orchestra.run.smithi062.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.62:6789,172.21.15.89:6789,172.21.15.89:6790:/ 2023-06-09T04:41:43.955 INFO:teuthology.orchestra.run.smithi062.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=f7998a1e-e5a9-4202-abaa-70c0eaae1047" will pass to kernel 2023-06-09T04:41:43.960 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-06-09T04:41:43.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:43.961 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-06-09T04:41:43.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:43.991 DEBUG:teuthology.orchestra.run.smithi062:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-09T04:41:44.063 INFO:teuthology.orchestra.run.smithi062.stdout:client4718 2023-06-09T04:41:44.063 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-06-09T04:41:44.064 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:41:44.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:44.124 DEBUG:teuthology.orchestra.run.smithi062:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-09T04:41:44.198 INFO:teuthology.orchestra.run.smithi062.stdout:client4718 2023-06-09T04:41:44.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:44.199 DEBUG:teuthology.orchestra.run.smithi062:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-09T04:41:44.266 INFO:teuthology.orchestra.run.smithi062.stdout:client4718 2023-06-09T04:41:44.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:44.267 DEBUG:teuthology.orchestra.run.smithi062:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/f7998a1e-e5a9-4202-abaa-70c0eaae1047.client4718/status') 2023-06-09T04:41:44.343 INFO:teuthology.orchestra.run.smithi062.stdout:instance: client.4718 (3)172.21.15.62:0/75892102 2023-06-09T04:41:44.343 INFO:teuthology.orchestra.run.smithi062.stdout:blocklisted: false 2023-06-09T04:41:44.344 INFO:teuthology.orchestra.run.smithi062.stderr:0+1 records in 2023-06-09T04:41:44.344 INFO:teuthology.orchestra.run.smithi062.stderr:0+1 records out 2023-06-09T04:41:44.344 INFO:teuthology.orchestra.run.smithi062.stderr:68 bytes copied, 0.000152224 s, 447 kB/s 2023-06-09T04:41:44.346 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2023-06-09T04:41:44.346 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-06-09T04:41:44.347 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-06-09T04:41:44.347 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-09T04:41:44.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:44.563+0000 7f6be652d700 1 Processor -- start 2023-06-09T04:41:44.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:44.563+0000 7f6be652d700 1 -- start start 2023-06-09T04:41:44.569 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:44.563+0000 7f6be652d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6be00b08d0 0x7f6be00ca870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:44.570 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:44.563+0000 7f6be652d700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6be006f9b0 con 0x7f6be0159c90 2023-06-09T04:41:44.570 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:44.563+0000 7f6be652d700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6be015a060 con 0x7f6be00cb850 2023-06-09T04:41:44.570 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:44.563+0000 7f6be652d700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6be006b960 con 0x7f6be00b08d0 2023-06-09T04:41:44.570 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:44.563+0000 7f6be4aca700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6be00b08d0 0x7f6be00ca870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:44.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:44.563+0000 7f6be4aca700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6be00b08d0 0x7f6be00ca870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55098/0 (socket says 172.21.15.62:55098) 2023-06-09T04:41:44.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:44.563+0000 7f6be4aca700 1 -- 172.21.15.62:0/4158208281 learned_addr learned my addr 172.21.15.62:0/4158208281 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:44.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:44.567+0000 7f6be4aca700 1 -- 172.21.15.62:0/4158208281 >> v1:172.21.15.89:6789/0 conn(0x7f6be00cb850 legacy=0x7f6be00ca160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:44.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:44.567+0000 7f6be4aca700 1 -- 172.21.15.62:0/4158208281 >> v1:172.21.15.62:6789/0 conn(0x7f6be0159c90 legacy=0x7f6be0070e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:44.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:44.567+0000 7f6be4aca700 1 -- 172.21.15.62:0/4158208281 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be00c89e0 con 0x7f6be00b08d0 2023-06-09T04:41:44.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:44.567+0000 7f6bdeffd700 1 -- 172.21.15.62:0/4158208281 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2346206814 0 0) 0x7f6be006f9b0 con 0x7f6be0159c90 2023-06-09T04:41:44.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:44.567+0000 7f6be4aca700 1 --2- 172.21.15.62:0/4158208281 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6be00b08d0 0x7f6be00ca870 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6bd0009910 tx=0x7f6bd0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aaaaec52cc60302 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:44.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:44.567+0000 7f6bdeffd700 1 -- 172.21.15.62:0/4158208281 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd000ba60 con 0x7f6be00b08d0 2023-06-09T04:41:44.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:44.567+0000 7f6bdeffd700 1 -- 172.21.15.62:0/4158208281 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bd000bbc0 con 0x7f6be00b08d0 2023-06-09T04:41:44.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:44.567+0000 7f6bdeffd700 1 -- 172.21.15.62:0/4158208281 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd0009e60 con 0x7f6be00b08d0 2023-06-09T04:41:44.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:44.567+0000 7f6be652d700 1 -- 172.21.15.62:0/4158208281 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6be00b08d0 msgr2=0x7f6be00ca870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:44.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:44.567+0000 7f6be652d700 1 --2- 172.21.15.62:0/4158208281 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6be00b08d0 0x7f6be00ca870 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f6bd0009910 tx=0x7f6bd0009c20 comp rx=0 tx=0).stop 2023-06-09T04:41:44.574 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:44.567+0000 7f6be652d700 1 -- 172.21.15.62:0/4158208281 shutdown_connections 2023-06-09T04:41:44.574 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:44.567+0000 7f6be652d700 1 --2- 172.21.15.62:0/4158208281 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6be00b08d0 0x7f6be00ca870 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:44.574 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:44.567+0000 7f6be652d700 1 -- 172.21.15.62:0/4158208281 >> 172.21.15.62:0/4158208281 conn(0x7f6be006a410 msgr2=0x7f6be00afd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:44.574 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:44.567+0000 7f6be652d700 1 -- 172.21.15.62:0/4158208281 shutdown_connections 2023-06-09T04:41:44.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:44.567+0000 7f6be652d700 1 -- 172.21.15.62:0/4158208281 wait complete. 2023-06-09T04:41:44.577 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:44.571+0000 7f6be652d700 1 Processor -- start 2023-06-09T04:41:44.577 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:44.571+0000 7f6be652d700 1 -- start start 2023-06-09T04:41:44.579 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:44.575+0000 7f6be652d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6be00b08d0 0x7f6be00b1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:44.579 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:44.575+0000 7f6be652d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6be00cb850 0x7f6be00c79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:44.579 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:44.575+0000 7f6be652d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6be0159c90 0x7f6be0153820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:44.580 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:44.575+0000 7f6be652d700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be00b2610 con 0x7f6be00cb850 2023-06-09T04:41:44.580 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:44.575+0000 7f6be652d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be0154710 con 0x7f6be00b08d0 2023-06-09T04:41:44.580 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:44.575+0000 7f6be652d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6be00c6210 con 0x7f6be0159c90 2023-06-09T04:41:44.581 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:44.575+0000 7f6bdf7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6be00cb850 0x7f6be00c79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:44.581 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:44.575+0000 7f6bdf7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6be00cb850 0x7f6be00c79b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55108/0 (socket says 172.21.15.62:55108) 2023-06-09T04:41:44.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:44.575+0000 7f6bdf7fe700 1 -- 172.21.15.62:0/1352534622 learned_addr learned my addr 172.21.15.62:0/1352534622 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:44.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:44.575+0000 7f6bdffff700 1 --2- 172.21.15.62:0/1352534622 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6be00b08d0 0x7f6be00b1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:44.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:44.575+0000 7f6be4aca700 1 --2- 172.21.15.62:0/1352534622 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6be0159c90 0x7f6be0153820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:44.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:44.575+0000 7f6bdf7fe700 1 -- 172.21.15.62:0/1352534622 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6be0159c90 msgr2=0x7f6be0153820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:44.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:44.575+0000 7f6bdf7fe700 1 --2- 172.21.15.62:0/1352534622 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6be0159c90 0x7f6be0153820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:44.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:44.575+0000 7f6bdf7fe700 1 -- 172.21.15.62:0/1352534622 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6be00b08d0 msgr2=0x7f6be00b1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:44.583 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:44.575+0000 7f6bdf7fe700 1 --2- 172.21.15.62:0/1352534622 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6be00b08d0 0x7f6be00b1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:44.583 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:44.575+0000 7f6bdf7fe700 1 -- 172.21.15.62:0/1352534622 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd0009570 con 0x7f6be00cb850 2023-06-09T04:41:44.583 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:44.575+0000 7f6be4aca700 1 --2- 172.21.15.62:0/1352534622 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6be0159c90 0x7f6be0153820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:41:44.583 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:44.575+0000 7f6bdf7fe700 1 --2- 172.21.15.62:0/1352534622 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6be00cb850 0x7f6be00c79b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6bd400c500 tx=0x7f6bd400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:44.583 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:44.575+0000 7f6bdcff9700 1 -- 172.21.15.62:0/1352534622 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd40052d0 con 0x7f6be00cb850 2023-06-09T04:41:44.583 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:44.575+0000 7f6bdcff9700 1 -- 172.21.15.62:0/1352534622 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bd4005430 con 0x7f6be00cb850 2023-06-09T04:41:44.583 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:44.575+0000 7f6be652d700 1 -- 172.21.15.62:0/1352534622 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6be00c6550 con 0x7f6be00cb850 2023-06-09T04:41:44.584 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:44.575+0000 7f6bdcff9700 1 -- 172.21.15.62:0/1352534622 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd40055a0 con 0x7f6be00cb850 2023-06-09T04:41:44.584 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:44.575+0000 7f6be652d700 1 -- 172.21.15.62:0/1352534622 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6be00adb70 con 0x7f6be00cb850 2023-06-09T04:41:44.584 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:44.575+0000 7f6be652d700 1 -- 172.21.15.62:0/1352534622 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6be004db30 con 0x7f6be00cb850 2023-06-09T04:41:44.585 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:44.579+0000 7f6bdcff9700 1 -- 172.21.15.62:0/1352534622 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6bd40038e0 con 0x7f6be00cb850 2023-06-09T04:41:44.586 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:44.579+0000 7f6bdcff9700 1 --2- 172.21.15.62:0/1352534622 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f6bcc0662f0 0x7f6bcc0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:44.586 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:44.579+0000 7f6bdcff9700 1 -- 172.21.15.62:0/1352534622 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6bd4083550 con 0x7f6be00cb850 2023-06-09T04:41:44.587 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:44.579+0000 7f6bdffff700 1 --2- 172.21.15.62:0/1352534622 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f6bcc0662f0 0x7f6bcc0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:44.588 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:44.583+0000 7f6bdffff700 1 --2- 172.21.15.62:0/1352534622 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f6bcc0662f0 0x7f6bcc0687a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6be00afdc0 tx=0x7f6bd8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:44.590 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:44.583+0000 7f6bdcff9700 1 -- 172.21.15.62:0/1352534622 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6bd4050600 con 0x7f6be00cb850 2023-06-09T04:41:44.799 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:44.795+0000 7f6be652d700 1 -- 172.21.15.62:0/1352534622 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6be00cdbb0 con 0x7f6be00cb850 2023-06-09T04:41:44.800 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:44.795+0000 7f6bdcff9700 1 -- 172.21.15.62:0/1352534622 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f6bd4053c20 con 0x7f6be00cb850 2023-06-09T04:41:44.800 INFO:teuthology.orchestra.run.smithi062.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-06-09T04:41:44.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:44.795+0000 7f6be652d700 1 -- 172.21.15.62:0/1352534622 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f6bcc0662f0 msgr2=0x7f6bcc0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:44.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:44.795+0000 7f6be652d700 1 --2- 172.21.15.62:0/1352534622 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f6bcc0662f0 0x7f6bcc0687a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f6be00afdc0 tx=0x7f6bd8009040 comp rx=0 tx=0).stop 2023-06-09T04:41:44.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:44.795+0000 7f6be652d700 1 -- 172.21.15.62:0/1352534622 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6be00cb850 msgr2=0x7f6be00c79b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:44.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:44.795+0000 7f6be652d700 1 --2- 172.21.15.62:0/1352534622 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6be00cb850 0x7f6be00c79b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f6bd400c500 tx=0x7f6bd400c810 comp rx=0 tx=0).stop 2023-06-09T04:41:44.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:44.795+0000 7f6be652d700 1 -- 172.21.15.62:0/1352534622 shutdown_connections 2023-06-09T04:41:44.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:44.795+0000 7f6be652d700 1 --2- 172.21.15.62:0/1352534622 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f6bcc0662f0 0x7f6bcc0687a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:44.804 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:44.795+0000 7f6be652d700 1 --2- 172.21.15.62:0/1352534622 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6be0159c90 0x7f6be0153820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:44.804 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:44.795+0000 7f6be652d700 1 --2- 172.21.15.62:0/1352534622 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6be00cb850 0x7f6be00c79b0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:44.804 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:44.795+0000 7f6be652d700 1 --2- 172.21.15.62:0/1352534622 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6be00b08d0 0x7f6be00b1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:44.804 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:44.795+0000 7f6be652d700 1 -- 172.21.15.62:0/1352534622 >> 172.21.15.62:0/1352534622 conn(0x7f6be006a410 msgr2=0x7f6be0158840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:44.804 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:44.799+0000 7f6be652d700 1 -- 172.21.15.62:0/1352534622 shutdown_connections 2023-06-09T04:41:44.805 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:44.799+0000 7f6be652d700 1 -- 172.21.15.62:0/1352534622 wait complete. 2023-06-09T04:41:44.824 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-09T04:41:44.824 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-09T04:41:44.824 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi089.front.sepia.ceph.com 2023-06-09T04:41:44.824 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-06-09T04:41:44.825 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-06-09T04:41:44.825 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-09T04:41:44.825 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-09T04:41:44.825 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-09T04:41:44.825 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-06-09T04:41:44.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:44.826 DEBUG:teuthology.orchestra.run.smithi089:> ip addr 2023-06-09T04:41:44.843 INFO:teuthology.orchestra.run.smithi089.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-09T04:41:44.843 INFO:teuthology.orchestra.run.smithi089.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-09T04:41:44.843 INFO:teuthology.orchestra.run.smithi089.stdout: inet 127.0.0.1/8 scope host lo 2023-06-09T04:41:44.843 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:41:44.843 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 ::1/128 scope host 2023-06-09T04:41:44.844 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:41:44.844 INFO:teuthology.orchestra.run.smithi089.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-09T04:41:44.844 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c6 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:41:44.844 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f0 2023-06-09T04:41:44.844 INFO:teuthology.orchestra.run.smithi089.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-09T04:41:44.844 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c7 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:41:44.845 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f1 2023-06-09T04:41:44.845 INFO:teuthology.orchestra.run.smithi089.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-09T04:41:44.845 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:00 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:41:44.845 INFO:teuthology.orchestra.run.smithi089.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-09T04:41:44.845 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:01 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:41:44.845 INFO:teuthology.orchestra.run.smithi089.stdout: inet 172.21.15.89/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-06-09T04:41:44.845 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft 42391sec preferred_lft 42391sec 2023-06-09T04:41:44.845 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::ec4:7aff:fe8f:d501/64 scope link 2023-06-09T04:41:44.846 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:41:44.846 INFO:teuthology.orchestra.run.smithi089.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-06-09T04:41:44.846 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 02:42:79:fa:5e:13 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:41:44.846 INFO:teuthology.orchestra.run.smithi089.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-06-09T04:41:44.846 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:41:44.847 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-06-09T04:41:44.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:44.847 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec bash -c ' 2023-06-09T04:41:44.848 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2023-06-09T04:41:44.848 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link add name ceph-brx type bridge 2023-06-09T04:41:44.848 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip addr flush dev ceph-brx 2023-06-09T04:41:44.848 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set ceph-brx up 2023-06-09T04:41:44.849 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-06-09T04:41:44.849 DEBUG:teuthology.orchestra.run.smithi089:> ') 2023-06-09T04:41:44.999 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:45.000 DEBUG:teuthology.orchestra.run.smithi089:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-09T04:41:45.036 INFO:teuthology.orchestra.run.smithi089.stdout:1 2023-06-09T04:41:45.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:45.039 DEBUG:teuthology.orchestra.run.smithi089:> route 2023-06-09T04:41:45.125 INFO:teuthology.orchestra.run.smithi089.stdout:Kernel IP routing table 2023-06-09T04:41:45.126 INFO:teuthology.orchestra.run.smithi089.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-09T04:41:45.126 INFO:teuthology.orchestra.run.smithi089.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-06-09T04:41:45.126 INFO:teuthology.orchestra.run.smithi089.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-06-09T04:41:45.127 INFO:teuthology.orchestra.run.smithi089.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-06-09T04:41:45.127 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-06-09T04:41:45.127 INFO:teuthology.orchestra.run.smithi089.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-09T04:41:45.127 INFO:teuthology.orchestra.run.smithi089.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-09T04:41:45.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:45.128 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec bash -c ' 2023-06-09T04:41:45.128 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2023-06-09T04:41:45.128 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-06-09T04:41:45.128 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-06-09T04:41:45.129 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-06-09T04:41:45.129 DEBUG:teuthology.orchestra.run.smithi089:> ') 2023-06-09T04:41:45.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:45.256 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list 2023-06-09T04:41:45.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:45.273 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list-id 2023-06-09T04:41:45.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:45.337 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec bash -c ' 2023-06-09T04:41:45.338 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2023-06-09T04:41:45.338 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-06-09T04:41:45.338 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-06-09T04:41:45.338 DEBUG:teuthology.orchestra.run.smithi089:> ') 2023-06-09T04:41:45.446 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-06-09T04:41:45.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:45.446 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec bash -c ' 2023-06-09T04:41:45.447 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2023-06-09T04:41:45.447 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-06-09T04:41:45.447 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-06-09T04:41:45.447 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-06-09T04:41:45.448 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-06-09T04:41:45.448 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-06-09T04:41:45.448 DEBUG:teuthology.orchestra.run.smithi089:> ') 2023-06-09T04:41:45.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:45.630 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec bash -c ' 2023-06-09T04:41:45.630 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2023-06-09T04:41:45.630 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set brx.0 up 2023-06-09T04:41:45.631 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set dev brx.0 master ceph-brx 2023-06-09T04:41:45.631 DEBUG:teuthology.orchestra.run.smithi089:> ') 2023-06-09T04:41:45.703 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-09T04:41:45.703 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-06-09T04:41:45.724 INFO:teuthology.orchestra.run.smithi089.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-06-09T04:41:45.724 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-09T04:41:45.725 DEBUG:teuthology.orchestra.run.smithi089:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-06-09T04:41:45.787 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-06-09T04:41:45.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:45.788 DEBUG:teuthology.orchestra.run.smithi089:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-06-09T04:41:45.923 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-06-09T04:41:45.924 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-06-09T04:41:45.924 INFO:teuthology.orchestra.run.smithi089.stdout:invalid new device string format 2023-06-09T04:41:46.050 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-06-09T04:41:46.051 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-06-09T04:41:46.051 INFO:teuthology.orchestra.run.smithi089.stdout:invalid new device string format 2023-06-09T04:41:46.051 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: resolved to: "172.21.15.62:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-06-09T04:41:46.051 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: switching to using v1 address with old syntax 2023-06-09T04:41:46.072 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-06-09T04:41:46.073 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-06-09T04:41:46.073 INFO:teuthology.orchestra.run.smithi089.stdout:invalid new device string format 2023-06-09T04:41:46.073 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: resolved to: "172.21.15.62:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-06-09T04:41:46.073 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: switching to using v1 address with old syntax 2023-06-09T04:41:46.073 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: resolved to: "172.21.15.62:6789,172.21.15.89:6789,172.21.15.89:6790" 2023-06-09T04:41:46.073 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.62:6789,172.21.15.89:6789,172.21.15.89:6790:/ 2023-06-09T04:41:46.073 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=f7998a1e-e5a9-4202-abaa-70c0eaae1047" will pass to kernel 2023-06-09T04:41:46.078 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-06-09T04:41:46.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:46.079 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-06-09T04:41:46.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:46.110 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-09T04:41:46.187 INFO:teuthology.orchestra.run.smithi089.stdout:client4977 2023-06-09T04:41:46.188 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-06-09T04:41:46.188 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:41:46.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:46.253 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-09T04:41:46.321 INFO:teuthology.orchestra.run.smithi089.stdout:client4977 2023-06-09T04:41:46.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:46.322 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-09T04:41:46.387 INFO:teuthology.orchestra.run.smithi089.stdout:client4977 2023-06-09T04:41:46.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:46.388 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/f7998a1e-e5a9-4202-abaa-70c0eaae1047.client4977/status') 2023-06-09T04:41:46.469 INFO:teuthology.orchestra.run.smithi089.stdout:instance: client.4977 (3)172.21.15.89:0/411686966 2023-06-09T04:41:46.469 INFO:teuthology.orchestra.run.smithi089.stdout:blocklisted: false 2023-06-09T04:41:46.469 INFO:teuthology.orchestra.run.smithi089.stderr:0+1 records in 2023-06-09T04:41:46.469 INFO:teuthology.orchestra.run.smithi089.stderr:0+1 records out 2023-06-09T04:41:46.469 INFO:teuthology.orchestra.run.smithi089.stderr:69 bytes copied, 0.000154127 s, 448 kB/s 2023-06-09T04:41:46.472 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2023-06-09T04:41:46.473 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-06-09T04:41:46.473 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-06-09T04:41:46.473 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-09T04:41:46.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:46.647+0000 7f94d0e37700 1 Processor -- start 2023-06-09T04:41:46.654 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:46.647+0000 7f94d0e37700 1 -- start start 2023-06-09T04:41:46.656 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:46.651+0000 7f94d0e37700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f94cc1582e0 0x7f94cc06b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:46.656 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:46.651+0000 7f94d0e37700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94cc0c8840 0x7f94cc0c8c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:46.657 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:46.651+0000 7f94d0e37700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94cc15be70 con 0x7f94cc0cb7e0 2023-06-09T04:41:46.657 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:46.651+0000 7f94d0e37700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94cc0c91c0 con 0x7f94cc1582e0 2023-06-09T04:41:46.657 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:46.651+0000 7f94d0e37700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94cc0cdbb0 con 0x7f94cc0c8840 2023-06-09T04:41:46.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:46.651+0000 7f94c9d9b700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f94cc0cb7e0 0x7f94cc15c5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:59600/0 (socket says 172.21.15.62:59600) 2023-06-09T04:41:46.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:46.651+0000 7f94c9d9b700 1 -- 172.21.15.62:0/3010188995 learned_addr learned my addr 172.21.15.62:0/3010188995 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:41:46.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:46.651+0000 7f94ca59c700 1 --2- 172.21.15.62:0/3010188995 >> v2:172.21.15.62:3300/0 conn(0x7f94cc1582e0 0x7f94cc06b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:46.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:46.651+0000 7f94cad9d700 1 --2- 172.21.15.62:0/3010188995 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94cc0c8840 0x7f94cc0c8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:46.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:46.651+0000 7f94c959a700 1 -- 172.21.15.62:0/3010188995 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2089694392 0 0) 0x7f94cc15be70 con 0x7f94cc0cb7e0 2023-06-09T04:41:46.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:46.651+0000 7f94c959a700 1 -- 172.21.15.62:0/3010188995 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94b40035d0 con 0x7f94cc0cb7e0 2023-06-09T04:41:46.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:46.651+0000 7f94ca59c700 1 -- 172.21.15.62:0/3010188995 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94cc0c8840 msgr2=0x7f94cc0c8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:46.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:46.651+0000 7f94ca59c700 1 --2- 172.21.15.62:0/3010188995 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94cc0c8840 0x7f94cc0c8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:46.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:46.651+0000 7f94ca59c700 1 -- 172.21.15.62:0/3010188995 >> v1:172.21.15.62:6789/0 conn(0x7f94cc0cb7e0 legacy=0x7f94cc15c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:46.660 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:46.651+0000 7f94ca59c700 1 -- 172.21.15.62:0/3010188995 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94cc15ccf0 con 0x7f94cc1582e0 2023-06-09T04:41:46.660 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:46.651+0000 7f94ca59c700 1 --2- 172.21.15.62:0/3010188995 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94cc1582e0 0x7f94cc06b5a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f94cc15cee0 tx=0x7f94bc009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aaff552a167748e server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:46.660 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:46.651+0000 7f94c959a700 1 -- 172.21.15.62:0/3010188995 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94bc004020 con 0x7f94cc1582e0 2023-06-09T04:41:46.660 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:46.651+0000 7f94c959a700 1 -- 172.21.15.62:0/3010188995 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94bc004180 con 0x7f94cc1582e0 2023-06-09T04:41:46.660 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:46.651+0000 7f94c959a700 1 -- 172.21.15.62:0/3010188995 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94bc004530 con 0x7f94cc1582e0 2023-06-09T04:41:46.661 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:46.655+0000 7f94d0e37700 1 -- 172.21.15.62:0/3010188995 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94cc1582e0 msgr2=0x7f94cc06b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:46.661 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:46.655+0000 7f94d0e37700 1 --2- 172.21.15.62:0/3010188995 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94cc1582e0 0x7f94cc06b5a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f94cc15cee0 tx=0x7f94bc009b30 comp rx=0 tx=0).stop 2023-06-09T04:41:46.661 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:46.655+0000 7f94d0e37700 1 -- 172.21.15.62:0/3010188995 shutdown_connections 2023-06-09T04:41:46.661 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:46.655+0000 7f94d0e37700 1 --2- 172.21.15.62:0/3010188995 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94cc0c8840 0x7f94cc0c8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:46.661 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:46.655+0000 7f94d0e37700 1 --2- 172.21.15.62:0/3010188995 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94cc1582e0 0x7f94cc06b5a0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:46.662 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:46.655+0000 7f94d0e37700 1 -- 172.21.15.62:0/3010188995 >> 172.21.15.62:0/3010188995 conn(0x7f94cc06a410 msgr2=0x7f94cc0afd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:46.662 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:46.655+0000 7f94d0e37700 1 -- 172.21.15.62:0/3010188995 shutdown_connections 2023-06-09T04:41:46.662 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:46.655+0000 7f94d0e37700 1 -- 172.21.15.62:0/3010188995 wait complete. 2023-06-09T04:41:46.663 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:46.655+0000 7f94d0e37700 1 Processor -- start 2023-06-09T04:41:46.663 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:46.659+0000 7f94d0e37700 1 -- start start 2023-06-09T04:41:46.665 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:46.659+0000 7f94d0e37700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f94cc0c8840 0x7f94cc143b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:46.665 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:46.659+0000 7f94d0e37700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94cc0cb7e0 0x7f94cc1505e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:46.665 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:46.659+0000 7f94d0e37700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94cc1582e0 0x7f94cc157890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:46.665 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:46.659+0000 7f94d0e37700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94cc157400 con 0x7f94cc1582e0 2023-06-09T04:41:46.666 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:46.659+0000 7f94d0e37700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94cc0c64b0 con 0x7f94cc0c8840 2023-06-09T04:41:46.666 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:46.659+0000 7f94d0e37700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94cc156df0 con 0x7f94cc0cb7e0 2023-06-09T04:41:46.666 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:46.659+0000 7f94cad9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94cc1582e0 0x7f94cc157890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:46.667 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:46.659+0000 7f94cad9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94cc1582e0 0x7f94cc157890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55130/0 (socket says 172.21.15.62:55130) 2023-06-09T04:41:46.667 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:46.659+0000 7f94cad9d700 1 -- 172.21.15.62:0/4034831965 learned_addr learned my addr 172.21.15.62:0/4034831965 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:46.667 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:46.659+0000 7f94ca59c700 1 --2- 172.21.15.62:0/4034831965 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f94cc0c8840 0x7f94cc143b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:46.667 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:46.659+0000 7f94c9d9b700 1 --2- 172.21.15.62:0/4034831965 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94cc0cb7e0 0x7f94cc1505e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:46.669 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:46.659+0000 7f94cad9d700 1 -- 172.21.15.62:0/4034831965 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94cc0cb7e0 msgr2=0x7f94cc1505e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:46.669 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:46.659+0000 7f94cad9d700 1 --2- 172.21.15.62:0/4034831965 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94cc0cb7e0 0x7f94cc1505e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:46.670 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:46.659+0000 7f94cad9d700 1 -- 172.21.15.62:0/4034831965 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f94cc0c8840 msgr2=0x7f94cc143b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:46.670 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:46.659+0000 7f94cad9d700 1 --2- 172.21.15.62:0/4034831965 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f94cc0c8840 0x7f94cc143b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:46.670 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:46.659+0000 7f94cad9d700 1 -- 172.21.15.62:0/4034831965 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94bc0094b0 con 0x7f94cc1582e0 2023-06-09T04:41:46.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:46.659+0000 7f94c9d9b700 1 --2- 172.21.15.62:0/4034831965 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94cc0cb7e0 0x7f94cc1505e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:41:46.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:46.659+0000 7f94cad9d700 1 --2- 172.21.15.62:0/4034831965 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94cc1582e0 0x7f94cc157890 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f94c4007e60 tx=0x7f94c400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:46.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:46.659+0000 7f94baffd700 1 -- 172.21.15.62:0/4034831965 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c400ede0 con 0x7f94cc1582e0 2023-06-09T04:41:46.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:46.659+0000 7f94baffd700 1 -- 172.21.15.62:0/4034831965 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94c4014420 con 0x7f94cc1582e0 2023-06-09T04:41:46.672 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:46.659+0000 7f94baffd700 1 -- 172.21.15.62:0/4034831965 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94c40147d0 con 0x7f94cc1582e0 2023-06-09T04:41:46.672 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:46.659+0000 7f94d0e37700 1 -- 172.21.15.62:0/4034831965 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94cc150b20 con 0x7f94cc1582e0 2023-06-09T04:41:46.672 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:46.659+0000 7f94d0e37700 1 -- 172.21.15.62:0/4034831965 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94cc0c6a30 con 0x7f94cc1582e0 2023-06-09T04:41:46.672 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:46.663+0000 7f94d0e37700 1 -- 172.21.15.62:0/4034831965 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94cc0c6c50 con 0x7f94cc1582e0 2023-06-09T04:41:46.673 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:46.663+0000 7f94baffd700 1 -- 172.21.15.62:0/4034831965 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f94c4014930 con 0x7f94cc1582e0 2023-06-09T04:41:46.673 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:46.667+0000 7f94baffd700 1 --2- 172.21.15.62:0/4034831965 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f94ac0662f0 0x7f94ac0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:46.673 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:46.667+0000 7f94baffd700 1 -- 172.21.15.62:0/4034831965 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f94c40847e0 con 0x7f94cc1582e0 2023-06-09T04:41:46.673 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:46.667+0000 7f94ca59c700 1 --2- 172.21.15.62:0/4034831965 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f94ac0662f0 0x7f94ac0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:46.674 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:46.667+0000 7f94ca59c700 1 --2- 172.21.15.62:0/4034831965 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f94ac0662f0 0x7f94ac0687a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f94bc0090b0 tx=0x7f94bc008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:46.680 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:46.675+0000 7f94baffd700 1 -- 172.21.15.62:0/4034831965 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f94cc0c6c50 con 0x7f94cc1582e0 2023-06-09T04:41:46.888 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:46.883+0000 7f94d0e37700 1 -- 172.21.15.62:0/4034831965 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f94cc0c6c50 con 0x7f94cc1582e0 2023-06-09T04:41:46.889 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:46.883+0000 7f94baffd700 1 -- 172.21.15.62:0/4034831965 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f94cc0c6c50 con 0x7f94cc1582e0 2023-06-09T04:41:46.889 INFO:teuthology.orchestra.run.smithi062.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-06-09T04:41:46.894 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:46.887+0000 7f94d0e37700 1 -- 172.21.15.62:0/4034831965 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f94ac0662f0 msgr2=0x7f94ac0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:46.894 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:46.887+0000 7f94d0e37700 1 --2- 172.21.15.62:0/4034831965 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f94ac0662f0 0x7f94ac0687a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f94bc0090b0 tx=0x7f94bc008030 comp rx=0 tx=0).stop 2023-06-09T04:41:46.894 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:46.887+0000 7f94d0e37700 1 -- 172.21.15.62:0/4034831965 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94cc1582e0 msgr2=0x7f94cc157890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:46.894 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:46.887+0000 7f94d0e37700 1 --2- 172.21.15.62:0/4034831965 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94cc1582e0 0x7f94cc157890 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f94c4007e60 tx=0x7f94c400e3c0 comp rx=0 tx=0).stop 2023-06-09T04:41:46.894 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:46.887+0000 7f94d0e37700 1 -- 172.21.15.62:0/4034831965 shutdown_connections 2023-06-09T04:41:46.895 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:46.887+0000 7f94d0e37700 1 --2- 172.21.15.62:0/4034831965 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f94ac0662f0 0x7f94ac0687a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:46.895 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:46.887+0000 7f94d0e37700 1 --2- 172.21.15.62:0/4034831965 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94cc1582e0 0x7f94cc157890 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:46.895 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:46.887+0000 7f94d0e37700 1 --2- 172.21.15.62:0/4034831965 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f94cc0cb7e0 0x7f94cc1505e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:46.895 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:46.887+0000 7f94d0e37700 1 --2- 172.21.15.62:0/4034831965 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f94cc0c8840 0x7f94cc143b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:46.895 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:46.887+0000 7f94d0e37700 1 -- 172.21.15.62:0/4034831965 >> 172.21.15.62:0/4034831965 conn(0x7f94cc06a410 msgr2=0x7f94cc0b3810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:46.895 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:46.887+0000 7f94d0e37700 1 -- 172.21.15.62:0/4034831965 shutdown_connections 2023-06-09T04:41:46.895 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:46.887+0000 7f94d0e37700 1 -- 172.21.15.62:0/4034831965 wait complete. 2023-06-09T04:41:46.917 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-09T04:41:46.917 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-09T04:41:46.917 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi089.front.sepia.ceph.com 2023-06-09T04:41:46.917 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-06-09T04:41:46.917 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-06-09T04:41:46.918 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-09T04:41:46.918 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-09T04:41:46.918 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-09T04:41:46.918 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-06-09T04:41:46.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:46.919 DEBUG:teuthology.orchestra.run.smithi089:> ip addr 2023-06-09T04:41:46.937 INFO:teuthology.orchestra.run.smithi089.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-09T04:41:46.938 INFO:teuthology.orchestra.run.smithi089.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-09T04:41:46.938 INFO:teuthology.orchestra.run.smithi089.stdout: inet 127.0.0.1/8 scope host lo 2023-06-09T04:41:46.938 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:41:46.938 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 ::1/128 scope host 2023-06-09T04:41:46.938 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:41:46.938 INFO:teuthology.orchestra.run.smithi089.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-09T04:41:46.939 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c6 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:41:46.939 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f0 2023-06-09T04:41:46.939 INFO:teuthology.orchestra.run.smithi089.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-09T04:41:46.939 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c7 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:41:46.939 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f1 2023-06-09T04:41:46.939 INFO:teuthology.orchestra.run.smithi089.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-09T04:41:46.939 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:00 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:41:46.939 INFO:teuthology.orchestra.run.smithi089.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-09T04:41:46.940 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:01 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:41:46.940 INFO:teuthology.orchestra.run.smithi089.stdout: inet 172.21.15.89/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-06-09T04:41:46.940 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft 42389sec preferred_lft 42389sec 2023-06-09T04:41:46.940 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::ec4:7aff:fe8f:d501/64 scope link 2023-06-09T04:41:46.940 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:41:46.940 INFO:teuthology.orchestra.run.smithi089.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-06-09T04:41:46.940 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 02:42:79:fa:5e:13 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:41:46.941 INFO:teuthology.orchestra.run.smithi089.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-06-09T04:41:46.941 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:41:46.941 INFO:teuthology.orchestra.run.smithi089.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-09T04:41:46.941 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 46:bf:72:7a:3b:5b brd ff:ff:ff:ff:ff:ff 2023-06-09T04:41:46.941 INFO:teuthology.orchestra.run.smithi089.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-06-09T04:41:46.941 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:41:46.941 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::64d5:7fff:fe7e:deff/64 scope link 2023-06-09T04:41:46.941 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:41:46.942 INFO:teuthology.orchestra.run.smithi089.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-09T04:41:46.942 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 46:bf:72:7a:3b:5b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-06-09T04:41:46.942 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::44bf:72ff:fe7a:3b5b/64 scope link tentative 2023-06-09T04:41:46.942 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:41:46.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:46.943 DEBUG:teuthology.orchestra.run.smithi089:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-09T04:41:47.028 INFO:teuthology.orchestra.run.smithi089.stdout:1 2023-06-09T04:41:47.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:47.031 DEBUG:teuthology.orchestra.run.smithi089:> route 2023-06-09T04:41:47.092 INFO:teuthology.orchestra.run.smithi089.stdout:Kernel IP routing table 2023-06-09T04:41:47.092 INFO:teuthology.orchestra.run.smithi089.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-09T04:41:47.092 INFO:teuthology.orchestra.run.smithi089.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-06-09T04:41:47.093 INFO:teuthology.orchestra.run.smithi089.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-06-09T04:41:47.093 INFO:teuthology.orchestra.run.smithi089.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-06-09T04:41:47.093 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-06-09T04:41:47.093 INFO:teuthology.orchestra.run.smithi089.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-09T04:41:47.093 INFO:teuthology.orchestra.run.smithi089.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-09T04:41:47.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:47.094 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec bash -c ' 2023-06-09T04:41:47.095 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2023-06-09T04:41:47.095 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-06-09T04:41:47.095 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-06-09T04:41:47.095 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-06-09T04:41:47.095 DEBUG:teuthology.orchestra.run.smithi089:> ') 2023-06-09T04:41:47.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:47.235 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list 2023-06-09T04:41:47.251 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-06-09T04:41:47.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:47.252 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list-id 2023-06-09T04:41:47.312 INFO:teuthology.orchestra.run.smithi089.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-06-09T04:41:47.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:47.313 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec bash -c ' 2023-06-09T04:41:47.313 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2023-06-09T04:41:47.313 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-06-09T04:41:47.314 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-06-09T04:41:47.314 DEBUG:teuthology.orchestra.run.smithi089:> ') 2023-06-09T04:41:47.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:47.427 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-06-09T04:41:47.460 INFO:teuthology.orchestra.run.smithi089.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-09T04:41:47.460 INFO:teuthology.orchestra.run.smithi089.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-09T04:41:47.460 INFO:teuthology.orchestra.run.smithi089.stdout: inet 127.0.0.1/8 scope host lo 2023-06-09T04:41:47.460 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:41:47.461 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 ::1/128 scope host 2023-06-09T04:41:47.461 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:41:47.461 INFO:teuthology.orchestra.run.smithi089.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-09T04:41:47.461 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether fe:13:f9:4c:f1:76 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-06-09T04:41:47.461 INFO:teuthology.orchestra.run.smithi089.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-06-09T04:41:47.461 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:41:47.461 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::fc13:f9ff:fe4c:f176/64 scope link 2023-06-09T04:41:47.461 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:41:47.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:47.464 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-06-09T04:41:47.543 INFO:teuthology.orchestra.run.smithi089.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-09T04:41:47.544 INFO:teuthology.orchestra.run.smithi089.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-09T04:41:47.544 INFO:teuthology.orchestra.run.smithi089.stdout: inet 127.0.0.1/8 scope host lo 2023-06-09T04:41:47.544 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:41:47.544 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 ::1/128 scope host 2023-06-09T04:41:47.544 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:41:47.544 INFO:teuthology.orchestra.run.smithi089.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-09T04:41:47.545 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether fe:13:f9:4c:f1:76 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-06-09T04:41:47.545 INFO:teuthology.orchestra.run.smithi089.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-06-09T04:41:47.545 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:41:47.545 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::fc13:f9ff:fe4c:f176/64 scope link 2023-06-09T04:41:47.545 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:41:47.547 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-06-09T04:41:47.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:47.548 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec bash -c ' 2023-06-09T04:41:47.548 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2023-06-09T04:41:47.548 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-06-09T04:41:47.549 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-06-09T04:41:47.549 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-06-09T04:41:47.549 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-06-09T04:41:47.549 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-06-09T04:41:47.549 DEBUG:teuthology.orchestra.run.smithi089:> ') 2023-06-09T04:41:47.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:47.741 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec bash -c ' 2023-06-09T04:41:47.741 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2023-06-09T04:41:47.742 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set brx.1 up 2023-06-09T04:41:47.742 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set dev brx.1 master ceph-brx 2023-06-09T04:41:47.742 DEBUG:teuthology.orchestra.run.smithi089:> ') 2023-06-09T04:41:47.811 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-09T04:41:47.811 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-06-09T04:41:47.827 INFO:teuthology.orchestra.run.smithi089.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-06-09T04:41:47.828 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-09T04:41:47.828 DEBUG:teuthology.orchestra.run.smithi089:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-06-09T04:41:47.890 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-06-09T04:41:47.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:47.891 DEBUG:teuthology.orchestra.run.smithi089:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-06-09T04:41:48.019 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-06-09T04:41:48.020 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-06-09T04:41:48.020 INFO:teuthology.orchestra.run.smithi089.stdout:invalid new device string format 2023-06-09T04:41:48.048 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-06-09T04:41:48.048 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-06-09T04:41:48.048 INFO:teuthology.orchestra.run.smithi089.stdout:invalid new device string format 2023-06-09T04:41:48.048 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: resolved to: "172.21.15.62:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-06-09T04:41:48.048 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: switching to using v1 address with old syntax 2023-06-09T04:41:48.066 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-06-09T04:41:48.066 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-06-09T04:41:48.066 INFO:teuthology.orchestra.run.smithi089.stdout:invalid new device string format 2023-06-09T04:41:48.067 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: resolved to: "172.21.15.62:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-06-09T04:41:48.067 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: switching to using v1 address with old syntax 2023-06-09T04:41:48.067 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: resolved to: "172.21.15.62:6789,172.21.15.89:6789,172.21.15.89:6790" 2023-06-09T04:41:48.067 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.62:6789,172.21.15.89:6789,172.21.15.89:6790:/ 2023-06-09T04:41:48.067 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=f7998a1e-e5a9-4202-abaa-70c0eaae1047" will pass to kernel 2023-06-09T04:41:48.075 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-06-09T04:41:48.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:48.076 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-06-09T04:41:48.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:48.106 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-09T04:41:48.174 INFO:teuthology.orchestra.run.smithi089.stdout:client4989 2023-06-09T04:41:48.174 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-06-09T04:41:48.174 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:41:48.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:48.232 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-09T04:41:48.299 INFO:teuthology.orchestra.run.smithi089.stdout:client4989 2023-06-09T04:41:48.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:48.300 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-09T04:41:48.368 INFO:teuthology.orchestra.run.smithi089.stdout:client4989 2023-06-09T04:41:48.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:41:48.369 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/f7998a1e-e5a9-4202-abaa-70c0eaae1047.client4989/status') 2023-06-09T04:41:48.447 INFO:teuthology.orchestra.run.smithi089.stdout:instance: client.4989 (3)172.21.15.89:0/620124005 2023-06-09T04:41:48.448 INFO:teuthology.orchestra.run.smithi089.stdout:blocklisted: false 2023-06-09T04:41:48.448 INFO:teuthology.orchestra.run.smithi089.stderr:0+1 records in 2023-06-09T04:41:48.448 INFO:teuthology.orchestra.run.smithi089.stderr:0+1 records out 2023-06-09T04:41:48.448 INFO:teuthology.orchestra.run.smithi089.stderr:69 bytes copied, 0.000157399 s, 438 kB/s 2023-06-09T04:41:48.450 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-06-09T04:41:48.466 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:41:48.645 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:48.639+0000 7f980f59e700 1 Processor -- start 2023-06-09T04:41:48.646 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:48.639+0000 7f980f59e700 1 -- start start 2023-06-09T04:41:48.647 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:48.643+0000 7f980f59e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f98100cd4f0 0x7f98100cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:48.647 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:48.643+0000 7f980f59e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f98100c9ea0 0x7f98100ca320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:48.648 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:48.643+0000 7f980f59e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9810071180 con 0x7f9810159a40 2023-06-09T04:41:48.648 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:48.643+0000 7f980f59e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98100cbc00 con 0x7f98100c9ea0 2023-06-09T04:41:48.648 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:48.643+0000 7f980f59e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98100ca860 con 0x7f98100cd4f0 2023-06-09T04:41:48.649 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:48.643+0000 7f980ed9d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f98100c9ea0 0x7f98100ca320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:48.649 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:48.643+0000 7f980e59c700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f9810159a40 0x7f9810070a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:59610/0 (socket says 172.21.15.62:59610) 2023-06-09T04:41:48.649 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:48.643+0000 7f980e59c700 1 -- 172.21.15.62:0/3221596194 learned_addr learned my addr 172.21.15.62:0/3221596194 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:41:48.649 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:48.643+0000 7f9805d9b700 1 --2- 172.21.15.62:0/3221596194 >> v2:172.21.15.89:3300/0 conn(0x7f98100cd4f0 0x7f98100cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:48.649 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:48.643+0000 7f980ed9d700 1 -- 172.21.15.62:0/3221596194 >> v2:172.21.15.89:3300/0 conn(0x7f98100cd4f0 msgr2=0x7f98100cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:48.650 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:48.643+0000 7f980ed9d700 1 --2- 172.21.15.62:0/3221596194 >> v2:172.21.15.89:3300/0 conn(0x7f98100cd4f0 0x7f98100cc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:48.650 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:48.643+0000 7f980ed9d700 1 -- 172.21.15.62:0/3221596194 >> v1:172.21.15.62:6789/0 conn(0x7f9810159a40 legacy=0x7f9810070a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:48.650 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:48.643+0000 7f980ed9d700 1 -- 172.21.15.62:0/3221596194 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98100cc180 con 0x7f98100c9ea0 2023-06-09T04:41:48.650 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:48.643+0000 7f980dd9b700 1 -- 172.21.15.62:0/3221596194 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1709219375 0 0) 0x7f9800001110 con 0x7f9810159a40 2023-06-09T04:41:48.650 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:48.643+0000 7f980ed9d700 1 --2- 172.21.15.62:0/3221596194 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98100c9ea0 0x7f98100ca320 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f98100cd070 tx=0x7f980800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a6dbff86cf65627 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:48.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:48.643+0000 7f980dd9b700 1 -- 172.21.15.62:0/3221596194 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980800e070 con 0x7f98100c9ea0 2023-06-09T04:41:48.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:48.643+0000 7f980dd9b700 1 -- 172.21.15.62:0/3221596194 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f980800bbd0 con 0x7f98100c9ea0 2023-06-09T04:41:48.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:48.643+0000 7f980dd9b700 1 -- 172.21.15.62:0/3221596194 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9808012430 con 0x7f98100c9ea0 2023-06-09T04:41:48.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:48.643+0000 7f980f59e700 1 -- 172.21.15.62:0/3221596194 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98100c9ea0 msgr2=0x7f98100ca320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:48.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:48.643+0000 7f980f59e700 1 --2- 172.21.15.62:0/3221596194 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98100c9ea0 0x7f98100ca320 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f98100cd070 tx=0x7f980800b330 comp rx=0 tx=0).stop 2023-06-09T04:41:48.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:48.647+0000 7f980f59e700 1 -- 172.21.15.62:0/3221596194 shutdown_connections 2023-06-09T04:41:48.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:48.647+0000 7f980f59e700 1 --2- 172.21.15.62:0/3221596194 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98100c9ea0 0x7f98100ca320 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:48.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:48.647+0000 7f980f59e700 1 --2- 172.21.15.62:0/3221596194 >> v2:172.21.15.89:3300/0 conn(0x7f98100cd4f0 0x7f98100cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:48.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:48.647+0000 7f980f59e700 1 -- 172.21.15.62:0/3221596194 >> 172.21.15.62:0/3221596194 conn(0x7f981006a420 msgr2=0x7f98100afc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:48.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:48.647+0000 7f980f59e700 1 -- 172.21.15.62:0/3221596194 shutdown_connections 2023-06-09T04:41:48.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:48.647+0000 7f980f59e700 1 -- 172.21.15.62:0/3221596194 wait complete. 2023-06-09T04:41:48.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:48.651+0000 7f980f59e700 1 Processor -- start 2023-06-09T04:41:48.656 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:48.651+0000 7f980f59e700 1 -- start start 2023-06-09T04:41:48.657 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:48.651+0000 7f980f59e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98100cd4f0 0x7f981014a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:48.657 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:48.651+0000 7f980f59e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9810159a40 0x7f981015a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:48.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:48.651+0000 7f980f59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98100aeb90 0x7f98100af010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:48.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:48.651+0000 7f980f59e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f981014aa60 con 0x7f98100aeb90 2023-06-09T04:41:48.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:48.651+0000 7f980f59e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f981015cc30 con 0x7f9810159a40 2023-06-09T04:41:48.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:48.651+0000 7f980f59e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98100af550 con 0x7f98100cd4f0 2023-06-09T04:41:48.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:48.651+0000 7f980e59c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98100cd4f0 0x7f981014a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:48.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:48.651+0000 7f980e59c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98100cd4f0 0x7f981014a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.62:38100/0 (socket says 172.21.15.62:38100) 2023-06-09T04:41:48.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:48.651+0000 7f980e59c700 1 -- 172.21.15.62:0/3166462846 learned_addr learned my addr 172.21.15.62:0/3166462846 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:48.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:48.651+0000 7f980ed9d700 1 --2- 172.21.15.62:0/3166462846 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98100aeb90 0x7f98100af010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:48.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:48.651+0000 7f9805d9b700 1 --2- 172.21.15.62:0/3166462846 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9810159a40 0x7f981015a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:48.660 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:48.651+0000 7f980e59c700 1 -- 172.21.15.62:0/3166462846 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9810159a40 msgr2=0x7f981015a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:48.660 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:48.651+0000 7f980e59c700 1 --2- 172.21.15.62:0/3166462846 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9810159a40 0x7f981015a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:48.660 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:48.651+0000 7f980e59c700 1 -- 172.21.15.62:0/3166462846 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98100aeb90 msgr2=0x7f98100af010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:48.660 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:48.651+0000 7f980e59c700 1 --2- 172.21.15.62:0/3166462846 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98100aeb90 0x7f98100af010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:48.660 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:48.651+0000 7f980e59c700 1 -- 172.21.15.62:0/3166462846 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9808009a70 con 0x7f98100cd4f0 2023-06-09T04:41:48.660 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:48.651+0000 7f980ed9d700 1 --2- 172.21.15.62:0/3166462846 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98100aeb90 0x7f98100af010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:41:48.660 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:48.655+0000 7f980e59c700 1 --2- 172.21.15.62:0/3166462846 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98100cd4f0 0x7f981014a520 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f980000c750 tx=0x7f980000ca60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:48.661 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:48.655+0000 7f98077fe700 1 -- 172.21.15.62:0/3166462846 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9800004ca0 con 0x7f98100cd4f0 2023-06-09T04:41:48.661 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:48.655+0000 7f98077fe700 1 -- 172.21.15.62:0/3166462846 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9800004e00 con 0x7f98100cd4f0 2023-06-09T04:41:48.661 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:48.655+0000 7f98077fe700 1 -- 172.21.15.62:0/3166462846 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9800007310 con 0x7f98100cd4f0 2023-06-09T04:41:48.661 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:48.655+0000 7f980f59e700 1 -- 172.21.15.62:0/3166462846 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f981015c670 con 0x7f98100cd4f0 2023-06-09T04:41:48.662 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:48.655+0000 7f980f59e700 1 -- 172.21.15.62:0/3166462846 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98101f2280 con 0x7f98100cd4f0 2023-06-09T04:41:48.662 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:48.655+0000 7f980f59e700 1 -- 172.21.15.62:0/3166462846 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98100739c0 con 0x7f98100cd4f0 2023-06-09T04:41:48.662 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:48.655+0000 7f98077fe700 1 -- 172.21.15.62:0/3166462846 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9800007470 con 0x7f98100cd4f0 2023-06-09T04:41:48.664 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:48.659+0000 7f98077fe700 1 --2- 172.21.15.62:0/3166462846 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f97f0066340 0x7f97f00687f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:48.664 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:48.659+0000 7f98077fe700 1 -- 172.21.15.62:0/3166462846 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9800083ad0 con 0x7f98100cd4f0 2023-06-09T04:41:48.664 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:48.659+0000 7f9805d9b700 1 --2- 172.21.15.62:0/3166462846 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f97f0066340 0x7f97f00687f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:48.665 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:48.659+0000 7f9805d9b700 1 --2- 172.21.15.62:0/3166462846 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f97f0066340 0x7f97f00687f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f98100b40c0 tx=0x7f97f8008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:48.670 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:48.663+0000 7f98077fe700 1 -- 172.21.15.62:0/3166462846 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9800050c00 con 0x7f98100cd4f0 2023-06-09T04:41:48.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:48.847+0000 7f980f59e700 1 -- 172.21.15.62:0/3166462846 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9810071180 con 0x7f98100cd4f0 2023-06-09T04:41:48.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:48.851+0000 7f98077fe700 1 -- 172.21.15.62:0/3166462846 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+20180 (secure 0 0 0) 0x7f9810071180 con 0x7f98100cd4f0 2023-06-09T04:41:48.856 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:41:48.857 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":30,"fsid":"f7998a1e-e5a9-4202-abaa-70c0eaae1047","created":"2023-06-09T04:40:30.469588+0000","modified":"2023-06-09T04:41:38.495589+0000","last_up_change":"2023-06-09T04:40:43.120747+0000","last_in_change":"2023-06-09T04:40:33.568221+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:40:44.646921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:40:50.006643+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:40:55.031273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:40:55.773517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-09T04:40:58.845383+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bc50bbc0-dd08-42ed-804c-ec3029e36c19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6802","nonce":1295788017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6807","nonce":1295788017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6815","nonce":1295788017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6809","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6811","nonce":1295788017}]},"public_addr":"172.21.15.62:6802/1295788017","cluster_addr":"172.21.15.62:6807/1295788017","heartbeat_back_addr":"172.21.15.62:6815/1295788017","heartbeat_front_addr":"172.21.15.62:6811/1295788017","state":["exists","up"]},{"osd":1,"uuid":"8230b12d-e22f-4985-a584-4cc64404cdbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6825","nonce":4120692006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6827","nonce":4120692006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6831","nonce":4120692006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6829","nonce":4120692006}]},"public_addr":"172.21.15.62:6825/4120692006","cluster_addr":"172.21.15.62:6827/4120692006","heartbeat_back_addr":"172.21.15.62:6831/4120692006","heartbeat_front_addr":"172.21.15.62:6829/4120692006","state":["exists","up"]},{"osd":2,"uuid":"d0202506-dbe9-4e3c-9271-687929abf96a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6801","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6803","nonce":4169607876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6805","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6806","nonce":4169607876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6814","nonce":4169607876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6810","nonce":4169607876}]},"public_addr":"172.21.15.62:6803/4169607876","cluster_addr":"172.21.15.62:6806/4169607876","heartbeat_back_addr":"172.21.15.62:6814/4169607876","heartbeat_front_addr":"172.21.15.62:6810/4169607876","state":["exists","up"]},{"osd":3,"uuid":"f3c0298a-b075-4411-af50-e16cd74fdddb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6817","nonce":3268438986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6819","nonce":3268438986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6823","nonce":3268438986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6821","nonce":3268438986}]},"public_addr":"172.21.15.62:6817/3268438986","cluster_addr":"172.21.15.62:6819/3268438986","heartbeat_back_addr":"172.21.15.62:6823/3268438986","heartbeat_front_addr":"172.21.15.62:6821/3268438986","state":["exists","up"]},{"osd":4,"uuid":"1ab5c5ca-e74f-475a-a309-683cc0029928","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6817","nonce":3139617628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6819","nonce":3139617628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6823","nonce":3139617628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6821","nonce":3139617628}]},"public_addr":"172.21.15.89:6817/3139617628","cluster_addr":"172.21.15.89:6819/3139617628","heartbeat_back_addr":"172.21.15.89:6823/3139617628","heartbeat_front_addr":"172.21.15.89:6821/3139617628","state":["exists","up"]},{"osd":5,"uuid":"a933e184-bd8f-4369-a1ba-a68de53c578c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6825","nonce":2681723596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6827","nonce":2681723596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6831","nonce":2681723596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6829","nonce":2681723596}]},"public_addr":"172.21.15.89:6825/2681723596","cluster_addr":"172.21.15.89:6827/2681723596","heartbeat_back_addr":"172.21.15.89:6831/2681723596","heartbeat_front_addr":"172.21.15.89:6829/2681723596","state":["exists","up"]},{"osd":6,"uuid":"1ed7ad37-2eee-49a6-954c-b537e2b7f0ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6809","nonce":1657136033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6811","nonce":1657136033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6815","nonce":1657136033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6813","nonce":1657136033}]},"public_addr":"172.21.15.89:6809/1657136033","cluster_addr":"172.21.15.89:6811/1657136033","heartbeat_back_addr":"172.21.15.89:6815/1657136033","heartbeat_front_addr":"172.21.15.89:6813/1657136033","state":["exists","up"]},{"osd":7,"uuid":"6ed732e9-33ff-40df-9038-a9f1d1622671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6801","nonce":1710561686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6803","nonce":1710561686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6807","nonce":1710561686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6805","nonce":1710561686}]},"public_addr":"172.21.15.89:6801/1710561686","cluster_addr":"172.21.15.89:6803/1710561686","heartbeat_back_addr":"172.21.15.89:6807/1710561686","heartbeat_front_addr":"172.21.15.89:6805/1710561686","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.335803+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.419788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.179334+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.263310+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.071846+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.375627+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.282277+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.315997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.12","mappings":[{"from":1,"to":2}]},{"pgid":"4.19","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:41:48.859 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:48.851+0000 7f980f59e700 1 -- 172.21.15.62:0/3166462846 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f97f0066340 msgr2=0x7f97f00687f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:48.859 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:48.851+0000 7f980f59e700 1 --2- 172.21.15.62:0/3166462846 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f97f0066340 0x7f97f00687f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f98100b40c0 tx=0x7f97f8008040 comp rx=0 tx=0).stop 2023-06-09T04:41:48.859 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:48.851+0000 7f980f59e700 1 -- 172.21.15.62:0/3166462846 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98100cd4f0 msgr2=0x7f981014a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:48.859 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:48.851+0000 7f980f59e700 1 --2- 172.21.15.62:0/3166462846 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98100cd4f0 0x7f981014a520 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f980000c750 tx=0x7f980000ca60 comp rx=0 tx=0).stop 2023-06-09T04:41:48.859 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:48.851+0000 7f980f59e700 1 -- 172.21.15.62:0/3166462846 shutdown_connections 2023-06-09T04:41:48.859 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:48.851+0000 7f980f59e700 1 --2- 172.21.15.62:0/3166462846 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f97f0066340 0x7f97f00687f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:48.859 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:48.851+0000 7f980f59e700 1 --2- 172.21.15.62:0/3166462846 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98100aeb90 0x7f98100af010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:48.860 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:48.851+0000 7f980f59e700 1 --2- 172.21.15.62:0/3166462846 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9810159a40 0x7f981015a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:48.860 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:48.851+0000 7f980f59e700 1 --2- 172.21.15.62:0/3166462846 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98100cd4f0 0x7f981014a520 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:48.860 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:48.851+0000 7f980f59e700 1 -- 172.21.15.62:0/3166462846 >> 172.21.15.62:0/3166462846 conn(0x7f98100c9ea0 msgr2=0x7f98100b3560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:48.860 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:48.855+0000 7f980f59e700 1 -- 172.21.15.62:0/3166462846 shutdown_connections 2023-06-09T04:41:48.861 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:48.855+0000 7f980f59e700 1 -- 172.21.15.62:0/3166462846 wait complete. 2023-06-09T04:41:48.881 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:40:44.646921+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:40:50.006643+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T04:40:55.031273+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T04:40:55.773517+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-09T04:40:58.845383+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-09T04:41:48.882 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:41:49.060 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.055+0000 7f4a199d5700 1 Processor -- start 2023-06-09T04:41:49.061 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.055+0000 7f4a199d5700 1 -- start start 2023-06-09T04:41:49.063 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.059+0000 7f4a199d5700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f4a140b0260 0x7f4a14164bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:49.063 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.059+0000 7f4a199d5700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a1415d860 con 0x7f4a1406f610 2023-06-09T04:41:49.064 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.059+0000 7f4a199d5700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a14071b00 con 0x7f4a14071730 2023-06-09T04:41:49.064 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.059+0000 7f4a199d5700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a1415dab0 con 0x7f4a140b0260 2023-06-09T04:41:49.064 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.059+0000 7f4a13fff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f4a1406f610 0x7f4a140afb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:59624/0 (socket says 172.21.15.62:59624) 2023-06-09T04:41:49.065 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.059+0000 7f4a13fff700 1 -- 172.21.15.62:0/2426459834 learned_addr learned my addr 172.21.15.62:0/2426459834 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:41:49.065 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.059+0000 7f4a191d4700 1 --2- 172.21.15.62:0/2426459834 >> v2:172.21.15.89:3300/0 conn(0x7f4a140b0260 0x7f4a14164bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:49.065 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.059+0000 7f4a137fe700 1 -- 172.21.15.62:0/2426459834 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2683589208 0 0) 0x7f4a1415d860 con 0x7f4a1406f610 2023-06-09T04:41:49.065 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.059+0000 7f4a137fe700 1 -- 172.21.15.62:0/2426459834 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a040035d0 con 0x7f4a1406f610 2023-06-09T04:41:49.065 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.059+0000 7f4a191d4700 1 -- 172.21.15.62:0/2426459834 >> v1:172.21.15.89:6789/0 conn(0x7f4a14071730 legacy=0x7f4a140ca1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:49.066 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.059+0000 7f4a191d4700 1 -- 172.21.15.62:0/2426459834 >> v1:172.21.15.62:6789/0 conn(0x7f4a1406f610 legacy=0x7f4a140afb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:49.066 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.059+0000 7f4a191d4700 1 -- 172.21.15.62:0/2426459834 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a1415dd90 con 0x7f4a140b0260 2023-06-09T04:41:49.066 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.059+0000 7f4a191d4700 1 --2- 172.21.15.62:0/2426459834 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a140b0260 0x7f4a14164bf0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c009d90 tx=0x7f4a0c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d6e0055cbf9814b server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:49.067 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.059+0000 7f4a137fe700 1 -- 172.21.15.62:0/2426459834 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a0c00e070 con 0x7f4a140b0260 2023-06-09T04:41:49.067 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.059+0000 7f4a137fe700 1 -- 172.21.15.62:0/2426459834 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a0c00bb20 con 0x7f4a140b0260 2023-06-09T04:41:49.067 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.059+0000 7f4a137fe700 1 -- 172.21.15.62:0/2426459834 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a0c012430 con 0x7f4a140b0260 2023-06-09T04:41:49.067 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.059+0000 7f4a199d5700 1 -- 172.21.15.62:0/2426459834 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a140b0260 msgr2=0x7f4a14164bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:49.067 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.059+0000 7f4a199d5700 1 --2- 172.21.15.62:0/2426459834 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a140b0260 0x7f4a14164bf0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c009d90 tx=0x7f4a0c00b330 comp rx=0 tx=0).stop 2023-06-09T04:41:49.068 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.063+0000 7f4a199d5700 1 -- 172.21.15.62:0/2426459834 shutdown_connections 2023-06-09T04:41:49.068 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.063+0000 7f4a199d5700 1 --2- 172.21.15.62:0/2426459834 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a140b0260 0x7f4a14164bf0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:49.068 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.063+0000 7f4a199d5700 1 -- 172.21.15.62:0/2426459834 >> 172.21.15.62:0/2426459834 conn(0x7f4a140cab50 msgr2=0x7f4a140caf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:49.068 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.063+0000 7f4a199d5700 1 -- 172.21.15.62:0/2426459834 shutdown_connections 2023-06-09T04:41:49.069 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.063+0000 7f4a199d5700 1 -- 172.21.15.62:0/2426459834 wait complete. 2023-06-09T04:41:49.069 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.063+0000 7f4a199d5700 1 Processor -- start 2023-06-09T04:41:49.069 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.063+0000 7f4a199d5700 1 -- start start 2023-06-09T04:41:49.071 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.063+0000 7f4a199d5700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a1406f610 0x7f4a1406b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:49.071 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.063+0000 7f4a199d5700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a14071730 0x7f4a14153970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:49.071 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.063+0000 7f4a199d5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4a140b0260 0x7f4a140c2860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:49.071 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.063+0000 7f4a199d5700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1415a520 con 0x7f4a1406f610 2023-06-09T04:41:49.071 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.063+0000 7f4a199d5700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1406d250 con 0x7f4a14071730 2023-06-09T04:41:49.071 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.063+0000 7f4a199d5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a1406bdc0 con 0x7f4a140b0260 2023-06-09T04:41:49.072 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.067+0000 7f4a189d3700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a1406f610 0x7f4a1406b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:49.073 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.067+0000 7f4a13fff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a14071730 0x7f4a14153970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:49.073 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.067+0000 7f4a189d3700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a1406f610 0x7f4a1406b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55160/0 (socket says 172.21.15.62:55160) 2023-06-09T04:41:49.073 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.067+0000 7f4a189d3700 1 -- 172.21.15.62:0/3474702130 learned_addr learned my addr 172.21.15.62:0/3474702130 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:49.073 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.067+0000 7f4a191d4700 1 --2- 172.21.15.62:0/3474702130 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4a140b0260 0x7f4a140c2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:49.073 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.067+0000 7f4a189d3700 1 -- 172.21.15.62:0/3474702130 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4a140b0260 msgr2=0x7f4a140c2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:49.073 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.067+0000 7f4a189d3700 1 --2- 172.21.15.62:0/3474702130 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4a140b0260 0x7f4a140c2860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:49.073 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.067+0000 7f4a189d3700 1 -- 172.21.15.62:0/3474702130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a14071730 msgr2=0x7f4a14153970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:49.074 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.067+0000 7f4a189d3700 1 --2- 172.21.15.62:0/3474702130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a14071730 0x7f4a14153970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:49.074 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.067+0000 7f4a189d3700 1 -- 172.21.15.62:0/3474702130 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a0c009a70 con 0x7f4a1406f610 2023-06-09T04:41:49.074 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.067+0000 7f4a189d3700 1 --2- 172.21.15.62:0/3474702130 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a1406f610 0x7f4a1406b880 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4a0800c500 tx=0x7f4a0800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:49.074 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.067+0000 7f4a117fa700 1 -- 172.21.15.62:0/3474702130 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a080052d0 con 0x7f4a1406f610 2023-06-09T04:41:49.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.067+0000 7f4a117fa700 1 -- 172.21.15.62:0/3474702130 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a08005430 con 0x7f4a1406f610 2023-06-09T04:41:49.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.067+0000 7f4a117fa700 1 -- 172.21.15.62:0/3474702130 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a080055a0 con 0x7f4a1406f610 2023-06-09T04:41:49.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.067+0000 7f4a199d5700 1 -- 172.21.15.62:0/3474702130 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a1406c890 con 0x7f4a1406f610 2023-06-09T04:41:49.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.067+0000 7f4a199d5700 1 -- 172.21.15.62:0/3474702130 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a1406c2d0 con 0x7f4a1406f610 2023-06-09T04:41:49.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.071+0000 7f4a199d5700 1 -- 172.21.15.62:0/3474702130 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a1415a660 con 0x7f4a1406f610 2023-06-09T04:41:49.077 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.071+0000 7f4a117fa700 1 -- 172.21.15.62:0/3474702130 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4a080038e0 con 0x7f4a1406f610 2023-06-09T04:41:49.078 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.071+0000 7f4a117fa700 1 --2- 172.21.15.62:0/3474702130 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f49f80662f0 0x7f49f80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:49.078 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.071+0000 7f4a117fa700 1 -- 172.21.15.62:0/3474702130 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4a080832e0 con 0x7f4a1406f610 2023-06-09T04:41:49.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.075+0000 7f4a13fff700 1 --2- 172.21.15.62:0/3474702130 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f49f80662f0 0x7f49f80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:49.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.075+0000 7f4a13fff700 1 --2- 172.21.15.62:0/3474702130 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f49f80662f0 0x7f49f80687a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4a141f5a10 tx=0x7f4a00007de0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:49.085 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.079+0000 7f4a117fa700 1 -- 172.21.15.62:0/3474702130 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4a1415a660 con 0x7f4a1406f610 2023-06-09T04:41:49.260 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.255+0000 7f4a199d5700 1 -- 172.21.15.62:0/3474702130 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4a1415a660 con 0x7f4a1406f610 2023-06-09T04:41:49.261 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.255+0000 7f4a117fa700 1 -- 172.21.15.62:0/3474702130 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4a08050440 con 0x7f4a1406f610 2023-06-09T04:41:49.262 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2023-06-09T04:41:49.266 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.259+0000 7f4a199d5700 1 -- 172.21.15.62:0/3474702130 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f49f80662f0 msgr2=0x7f49f80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:49.266 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.259+0000 7f4a199d5700 1 --2- 172.21.15.62:0/3474702130 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f49f80662f0 0x7f49f80687a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4a141f5a10 tx=0x7f4a00007de0 comp rx=0 tx=0).stop 2023-06-09T04:41:49.266 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.259+0000 7f4a199d5700 1 -- 172.21.15.62:0/3474702130 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a1406f610 msgr2=0x7f4a1406b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:49.266 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.259+0000 7f4a199d5700 1 --2- 172.21.15.62:0/3474702130 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a1406f610 0x7f4a1406b880 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4a0800c500 tx=0x7f4a0800c810 comp rx=0 tx=0).stop 2023-06-09T04:41:49.267 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.259+0000 7f4a199d5700 1 -- 172.21.15.62:0/3474702130 shutdown_connections 2023-06-09T04:41:49.267 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.259+0000 7f4a199d5700 1 --2- 172.21.15.62:0/3474702130 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f49f80662f0 0x7f49f80687a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:49.267 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.259+0000 7f4a199d5700 1 --2- 172.21.15.62:0/3474702130 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4a140b0260 0x7f4a140c2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:49.267 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.259+0000 7f4a199d5700 1 --2- 172.21.15.62:0/3474702130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4a14071730 0x7f4a14153970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:49.267 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.259+0000 7f4a199d5700 1 --2- 172.21.15.62:0/3474702130 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a1406f610 0x7f4a1406b880 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:49.268 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.259+0000 7f4a199d5700 1 -- 172.21.15.62:0/3474702130 >> 172.21.15.62:0/3474702130 conn(0x7f4a140cab50 msgr2=0x7f4a140cbfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:49.268 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.259+0000 7f4a199d5700 1 -- 172.21.15.62:0/3474702130 shutdown_connections 2023-06-09T04:41:49.268 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.259+0000 7f4a199d5700 1 -- 172.21.15.62:0/3474702130 wait complete. 2023-06-09T04:41:49.288 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:41:49.462 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.455+0000 7f6b4e764700 1 Processor -- start 2023-06-09T04:41:49.462 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.455+0000 7f6b4e764700 1 -- start start 2023-06-09T04:41:49.465 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.459+0000 7f6b4e764700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6b4815b6a0 0x7f6b4806a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:49.466 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.459+0000 7f6b4e764700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6b480705e0 0x7f6b480c9b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:49.466 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.459+0000 7f6b4e764700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b480ccad0 con 0x7f6b480cc530 2023-06-09T04:41:49.466 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.459+0000 7f6b4e764700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b480ccdb0 con 0x7f6b480705e0 2023-06-09T04:41:49.466 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.459+0000 7f6b4e764700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b480c9050 con 0x7f6b4815b6a0 2023-06-09T04:41:49.466 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.459+0000 7f6b4df63700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6b480705e0 0x7f6b480c9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:49.467 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.459+0000 7f6b4df63700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6b480705e0 0x7f6b480c9b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55164/0 (socket says 172.21.15.62:55164) 2023-06-09T04:41:49.467 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.459+0000 7f6b4df63700 1 -- 172.21.15.62:0/1426480815 learned_addr learned my addr 172.21.15.62:0/1426480815 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:49.467 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.459+0000 7f6b4d762700 1 --2- 172.21.15.62:0/1426480815 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6b4815b6a0 0x7f6b4806a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:49.467 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.459+0000 7f6b4df63700 1 -- 172.21.15.62:0/1426480815 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6b4815b6a0 msgr2=0x7f6b4806a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:49.468 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.459+0000 7f6b4df63700 1 --2- 172.21.15.62:0/1426480815 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6b4815b6a0 0x7f6b4806a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:49.468 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.459+0000 7f6b4df63700 1 -- 172.21.15.62:0/1426480815 >> v1:172.21.15.89:6789/0 conn(0x7f6b480cc530 legacy=0x7f6b4806fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:49.468 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.459+0000 7f6b4df63700 1 -- 172.21.15.62:0/1426480815 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b480c9330 con 0x7f6b480705e0 2023-06-09T04:41:49.468 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.459+0000 7f6b4d762700 1 --2- 172.21.15.62:0/1426480815 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6b4815b6a0 0x7f6b4806a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:41:49.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.463+0000 7f6b4df63700 1 --2- 172.21.15.62:0/1426480815 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6b480705e0 0x7f6b480c9b30 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f6b4000d150 tx=0x7f6b4000d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=893236fbdaa8ef78 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:49.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.463+0000 7f6b3ffff700 1 -- 172.21.15.62:0/1426480815 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b40010070 con 0x7f6b480705e0 2023-06-09T04:41:49.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.463+0000 7f6b3ffff700 1 -- 172.21.15.62:0/1426480815 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b4000dbb0 con 0x7f6b480705e0 2023-06-09T04:41:49.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.463+0000 7f6b3ffff700 1 -- 172.21.15.62:0/1426480815 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b40016400 con 0x7f6b480705e0 2023-06-09T04:41:49.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.463+0000 7f6b4e764700 1 -- 172.21.15.62:0/1426480815 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6b480705e0 msgr2=0x7f6b480c9b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:49.470 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.463+0000 7f6b4e764700 1 --2- 172.21.15.62:0/1426480815 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6b480705e0 0x7f6b480c9b30 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f6b4000d150 tx=0x7f6b4000d460 comp rx=0 tx=0).stop 2023-06-09T04:41:49.470 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.463+0000 7f6b4e764700 1 -- 172.21.15.62:0/1426480815 shutdown_connections 2023-06-09T04:41:49.470 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.463+0000 7f6b4e764700 1 --2- 172.21.15.62:0/1426480815 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6b480705e0 0x7f6b480c9b30 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:49.470 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.463+0000 7f6b4e764700 1 --2- 172.21.15.62:0/1426480815 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6b4815b6a0 0x7f6b4806a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:49.470 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.463+0000 7f6b4e764700 1 -- 172.21.15.62:0/1426480815 >> 172.21.15.62:0/1426480815 conn(0x7f6b480ce960 msgr2=0x7f6b480ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:49.470 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.463+0000 7f6b4e764700 1 -- 172.21.15.62:0/1426480815 shutdown_connections 2023-06-09T04:41:49.470 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.463+0000 7f6b4e764700 1 -- 172.21.15.62:0/1426480815 wait complete. 2023-06-09T04:41:49.472 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.467+0000 7f6b4e764700 1 Processor -- start 2023-06-09T04:41:49.472 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.467+0000 7f6b4e764700 1 -- start start 2023-06-09T04:41:49.473 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.467+0000 7f6b4e764700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6b480705e0 0x7f6b48153410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:49.473 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.467+0000 7f6b4e764700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6b480cc530 0x7f6b481f4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:49.474 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.467+0000 7f6b4e764700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6b4815b6a0 0x7f6b481f4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:49.474 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.467+0000 7f6b4e764700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b48152f80 con 0x7f6b4815b6a0 2023-06-09T04:41:49.474 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.467+0000 7f6b4e764700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b48152370 con 0x7f6b480705e0 2023-06-09T04:41:49.474 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.467+0000 7f6b4e764700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b48152650 con 0x7f6b480cc530 2023-06-09T04:41:49.475 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.467+0000 7f6b4df63700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6b4815b6a0 0x7f6b481f4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:49.475 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.467+0000 7f6b4d762700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6b480705e0 0x7f6b48153410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:49.475 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.467+0000 7f6b4d762700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6b480705e0 0x7f6b48153410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.62:53890/0 (socket says 172.21.15.62:53890) 2023-06-09T04:41:49.475 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.467+0000 7f6b4d762700 1 -- 172.21.15.62:0/3372125548 learned_addr learned my addr 172.21.15.62:0/3372125548 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:49.475 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.467+0000 7f6b4cf61700 1 --2- 172.21.15.62:0/3372125548 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6b480cc530 0x7f6b481f4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:49.476 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.467+0000 7f6b4d762700 1 -- 172.21.15.62:0/3372125548 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6b480cc530 msgr2=0x7f6b481f4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:49.476 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.467+0000 7f6b4d762700 1 --2- 172.21.15.62:0/3372125548 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6b480cc530 0x7f6b481f4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:49.476 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.467+0000 7f6b4d762700 1 -- 172.21.15.62:0/3372125548 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6b4815b6a0 msgr2=0x7f6b481f4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:49.476 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.467+0000 7f6b4d762700 1 --2- 172.21.15.62:0/3372125548 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6b4815b6a0 0x7f6b481f4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:49.476 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.467+0000 7f6b4d762700 1 -- 172.21.15.62:0/3372125548 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b4000bd40 con 0x7f6b480705e0 2023-06-09T04:41:49.476 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.467+0000 7f6b4df63700 1 --2- 172.21.15.62:0/3372125548 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6b4815b6a0 0x7f6b481f4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:41:49.476 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.471+0000 7f6b4d762700 1 --2- 172.21.15.62:0/3372125548 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6b480705e0 0x7f6b48153410 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6b4400e880 tx=0x7f6b4400eb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:49.477 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.471+0000 7f6b3dffb700 1 -- 172.21.15.62:0/3372125548 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b44013610 con 0x7f6b480705e0 2023-06-09T04:41:49.477 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.471+0000 7f6b3dffb700 1 -- 172.21.15.62:0/3372125548 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b44013770 con 0x7f6b480705e0 2023-06-09T04:41:49.477 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.471+0000 7f6b4e764700 1 -- 172.21.15.62:0/3372125548 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b48152930 con 0x7f6b480705e0 2023-06-09T04:41:49.477 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.471+0000 7f6b3dffb700 1 -- 172.21.15.62:0/3372125548 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b44013b00 con 0x7f6b480705e0 2023-06-09T04:41:49.478 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.471+0000 7f6b4e764700 1 -- 172.21.15.62:0/3372125548 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b48152000 con 0x7f6b480705e0 2023-06-09T04:41:49.478 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.471+0000 7f6b4e764700 1 -- 172.21.15.62:0/3372125548 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b48066090 con 0x7f6b480705e0 2023-06-09T04:41:49.479 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.475+0000 7f6b3dffb700 1 -- 172.21.15.62:0/3372125548 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6b44013c60 con 0x7f6b480705e0 2023-06-09T04:41:49.480 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.475+0000 7f6b3dffb700 1 --2- 172.21.15.62:0/3372125548 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f6b2c0662f0 0x7f6b2c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:49.481 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.475+0000 7f6b3dffb700 1 -- 172.21.15.62:0/3372125548 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6b44083c10 con 0x7f6b480705e0 2023-06-09T04:41:49.481 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.475+0000 7f6b4cf61700 1 --2- 172.21.15.62:0/3372125548 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f6b2c0662f0 0x7f6b2c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:49.482 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.475+0000 7f6b4cf61700 1 --2- 172.21.15.62:0/3372125548 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f6b2c0662f0 0x7f6b2c0687a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6b480ad550 tx=0x7f6b38009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:49.487 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.483+0000 7f6b3dffb700 1 -- 172.21.15.62:0/3372125548 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6b44050cc0 con 0x7f6b480705e0 2023-06-09T04:41:49.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.655+0000 7f6b4e764700 1 -- 172.21.15.62:0/3372125548 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6b4814e740 con 0x7f6b480705e0 2023-06-09T04:41:49.661 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.655+0000 7f6b3dffb700 1 -- 172.21.15.62:0/3372125548 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6b44017020 con 0x7f6b480705e0 2023-06-09T04:41:49.661 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2023-06-09T04:41:49.665 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.659+0000 7f6b4e764700 1 -- 172.21.15.62:0/3372125548 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f6b2c0662f0 msgr2=0x7f6b2c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:49.665 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.659+0000 7f6b4e764700 1 --2- 172.21.15.62:0/3372125548 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f6b2c0662f0 0x7f6b2c0687a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6b480ad550 tx=0x7f6b38009040 comp rx=0 tx=0).stop 2023-06-09T04:41:49.665 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.659+0000 7f6b4e764700 1 -- 172.21.15.62:0/3372125548 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6b480705e0 msgr2=0x7f6b48153410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:49.666 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.659+0000 7f6b4e764700 1 --2- 172.21.15.62:0/3372125548 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6b480705e0 0x7f6b48153410 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6b4400e880 tx=0x7f6b4400eb90 comp rx=0 tx=0).stop 2023-06-09T04:41:49.666 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.659+0000 7f6b4e764700 1 -- 172.21.15.62:0/3372125548 shutdown_connections 2023-06-09T04:41:49.666 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.659+0000 7f6b4e764700 1 --2- 172.21.15.62:0/3372125548 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f6b2c0662f0 0x7f6b2c0687a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:49.666 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.659+0000 7f6b4e764700 1 --2- 172.21.15.62:0/3372125548 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6b4815b6a0 0x7f6b481f4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:49.666 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.659+0000 7f6b4e764700 1 --2- 172.21.15.62:0/3372125548 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f6b480cc530 0x7f6b481f4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:49.666 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.659+0000 7f6b4e764700 1 --2- 172.21.15.62:0/3372125548 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6b480705e0 0x7f6b48153410 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:49.666 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.659+0000 7f6b4e764700 1 -- 172.21.15.62:0/3372125548 >> 172.21.15.62:0/3372125548 conn(0x7f6b480ce960 msgr2=0x7f6b480c9a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:49.667 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.659+0000 7f6b4e764700 1 -- 172.21.15.62:0/3372125548 shutdown_connections 2023-06-09T04:41:49.667 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.659+0000 7f6b4e764700 1 -- 172.21.15.62:0/3372125548 wait complete. 2023-06-09T04:41:49.688 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T04:41:49.872 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.867+0000 7f7df061d700 1 Processor -- start 2023-06-09T04:41:49.872 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.867+0000 7f7df061d700 1 -- start start 2023-06-09T04:41:49.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.871+0000 7f7df061d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7de80d0870 0x7f7de806aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:49.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.871+0000 7f7df061d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7de80d2c20 0x7f7de806b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:49.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.871+0000 7f7df061d700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7de80b53e0 con 0x7f7de815f7a0 2023-06-09T04:41:49.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.871+0000 7f7df061d700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7de806c280 con 0x7f7de80d2c20 2023-06-09T04:41:49.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.871+0000 7f7df061d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7de80af300 con 0x7f7de80d0870 2023-06-09T04:41:49.877 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.871+0000 7f7deebba700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7de80d2c20 0x7f7de806b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:49.877 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.871+0000 7f7dee3b9700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f7de815f7a0 0x7f7de80d0160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.62:49134/0 (socket says 172.21.15.62:49134) 2023-06-09T04:41:49.877 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.871+0000 7f7dee3b9700 1 -- 172.21.15.62:0/1906486346 learned_addr learned my addr 172.21.15.62:0/1906486346 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:41:49.877 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.871+0000 7f7dedbb8700 1 --2- 172.21.15.62:0/1906486346 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7de80d0870 0x7f7de806aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:49.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.871+0000 7f7ded3b7700 1 -- 172.21.15.62:0/1906486346 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3197276867 0 0) 0x7f7de80b53e0 con 0x7f7de815f7a0 2023-06-09T04:41:49.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.871+0000 7f7ded3b7700 1 -- 172.21.15.62:0/1906486346 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7dd40035d0 con 0x7f7de815f7a0 2023-06-09T04:41:49.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.871+0000 7f7deebba700 1 -- 172.21.15.62:0/1906486346 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7de80d0870 msgr2=0x7f7de806aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:49.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.871+0000 7f7deebba700 1 --2- 172.21.15.62:0/1906486346 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7de80d0870 0x7f7de806aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:49.879 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.871+0000 7f7deebba700 1 -- 172.21.15.62:0/1906486346 >> v1:172.21.15.89:6789/0 conn(0x7f7de815f7a0 legacy=0x7f7de80d0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:49.879 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.871+0000 7f7deebba700 1 -- 172.21.15.62:0/1906486346 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7de80af5e0 con 0x7f7de80d2c20 2023-06-09T04:41:49.879 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.871+0000 7f7deebba700 1 --2- 172.21.15.62:0/1906486346 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7de80d2c20 0x7f7de806b1e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f7de0009d90 tx=0x7f7de000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=753f4ba04800be68 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:49.879 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.871+0000 7f7ded3b7700 1 -- 172.21.15.62:0/1906486346 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de000e070 con 0x7f7de80d2c20 2023-06-09T04:41:49.880 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.871+0000 7f7ded3b7700 1 -- 172.21.15.62:0/1906486346 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7de000bb20 con 0x7f7de80d2c20 2023-06-09T04:41:49.880 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.871+0000 7f7ded3b7700 1 -- 172.21.15.62:0/1906486346 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de0012430 con 0x7f7de80d2c20 2023-06-09T04:41:49.880 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.875+0000 7f7df061d700 1 -- 172.21.15.62:0/1906486346 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7de80d2c20 msgr2=0x7f7de806b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:49.880 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.875+0000 7f7df061d700 1 --2- 172.21.15.62:0/1906486346 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7de80d2c20 0x7f7de806b1e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f7de0009d90 tx=0x7f7de000b330 comp rx=0 tx=0).stop 2023-06-09T04:41:49.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.875+0000 7f7df061d700 1 -- 172.21.15.62:0/1906486346 shutdown_connections 2023-06-09T04:41:49.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.875+0000 7f7df061d700 1 --2- 172.21.15.62:0/1906486346 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7de80d2c20 0x7f7de806b1e0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:49.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.875+0000 7f7df061d700 1 --2- 172.21.15.62:0/1906486346 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7de80d0870 0x7f7de806aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:49.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.875+0000 7f7df061d700 1 -- 172.21.15.62:0/1906486346 >> 172.21.15.62:0/1906486346 conn(0x7f7de8071840 msgr2=0x7f7de809b970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:49.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.875+0000 7f7df061d700 1 -- 172.21.15.62:0/1906486346 shutdown_connections 2023-06-09T04:41:49.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.875+0000 7f7df061d700 1 -- 172.21.15.62:0/1906486346 wait complete. 2023-06-09T04:41:49.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.875+0000 7f7df061d700 1 Processor -- start 2023-06-09T04:41:49.883 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.879+0000 7f7df061d700 1 -- start start 2023-06-09T04:41:49.884 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.879+0000 7f7df061d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7de80d0870 0x7f7de80c6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:49.885 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.879+0000 7f7df061d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7de80d2c20 0x7f7de815b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:49.885 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.879+0000 7f7df061d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7de815f7a0 0x7f7de80b56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:49.885 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.879+0000 7f7df061d700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de80c9890 con 0x7f7de80d2c20 2023-06-09T04:41:49.885 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.879+0000 7f7df061d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de80c65d0 con 0x7f7de80d0870 2023-06-09T04:41:49.885 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.879+0000 7f7df061d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7de80c6870 con 0x7f7de815f7a0 2023-06-09T04:41:49.886 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.879+0000 7f7dedbb8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7de80d2c20 0x7f7de815b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:49.886 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.879+0000 7f7dedbb8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7de80d2c20 0x7f7de815b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55196/0 (socket says 172.21.15.62:55196) 2023-06-09T04:41:49.886 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.879+0000 7f7dedbb8700 1 -- 172.21.15.62:0/849720123 learned_addr learned my addr 172.21.15.62:0/849720123 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:49.886 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.879+0000 7f7deebba700 1 --2- 172.21.15.62:0/849720123 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7de815f7a0 0x7f7de80b56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:49.887 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.879+0000 7f7dee3b9700 1 --2- 172.21.15.62:0/849720123 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7de80d0870 0x7f7de80c6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:49.887 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.879+0000 7f7dedbb8700 1 -- 172.21.15.62:0/849720123 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7de815f7a0 msgr2=0x7f7de80b56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:49.887 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.879+0000 7f7dedbb8700 1 --2- 172.21.15.62:0/849720123 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7de815f7a0 0x7f7de80b56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:49.887 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.879+0000 7f7dedbb8700 1 -- 172.21.15.62:0/849720123 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7de80d0870 msgr2=0x7f7de80c6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:49.887 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.879+0000 7f7dedbb8700 1 --2- 172.21.15.62:0/849720123 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7de80d0870 0x7f7de80c6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:49.887 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.879+0000 7f7dedbb8700 1 -- 172.21.15.62:0/849720123 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7de0009a70 con 0x7f7de80d2c20 2023-06-09T04:41:49.888 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.879+0000 7f7dedbb8700 1 --2- 172.21.15.62:0/849720123 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7de80d2c20 0x7f7de815b0e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7dd800e9a0 tx=0x7f7dd800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:49.888 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.879+0000 7f7ddeffd700 1 -- 172.21.15.62:0/849720123 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd8009720 con 0x7f7de80d2c20 2023-06-09T04:41:49.888 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.879+0000 7f7ddeffd700 1 -- 172.21.15.62:0/849720123 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dd800c690 con 0x7f7de80d2c20 2023-06-09T04:41:49.888 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.879+0000 7f7ddeffd700 1 -- 172.21.15.62:0/849720123 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd800ca40 con 0x7f7de80d2c20 2023-06-09T04:41:49.889 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.883+0000 7f7df061d700 1 -- 172.21.15.62:0/849720123 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7de80c6b50 con 0x7f7de80d2c20 2023-06-09T04:41:49.889 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.883+0000 7f7df061d700 1 -- 172.21.15.62:0/849720123 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7de815b620 con 0x7f7de80d2c20 2023-06-09T04:41:49.889 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.883+0000 7f7df061d700 1 -- 172.21.15.62:0/849720123 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7de80cca30 con 0x7f7de80d2c20 2023-06-09T04:41:49.890 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.883+0000 7f7ddeffd700 1 -- 172.21.15.62:0/849720123 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7dd800cba0 con 0x7f7de80d2c20 2023-06-09T04:41:49.892 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.887+0000 7f7ddeffd700 1 --2- 172.21.15.62:0/849720123 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f7dcc0662f0 0x7f7dcc0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:49.892 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.887+0000 7f7ddeffd700 1 -- 172.21.15.62:0/849720123 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7dd8083f50 con 0x7f7de80d2c20 2023-06-09T04:41:49.893 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.887+0000 7f7dee3b9700 1 --2- 172.21.15.62:0/849720123 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f7dcc0662f0 0x7f7dcc0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:49.894 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.887+0000 7f7dee3b9700 1 --2- 172.21.15.62:0/849720123 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f7dcc0662f0 0x7f7dcc0687a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7de4007fd0 tx=0x7f7de4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:49.897 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:49.891+0000 7f7ddeffd700 1 -- 172.21.15.62:0/849720123 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7dd8054bc0 con 0x7f7de80d2c20 2023-06-09T04:41:50.072 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.067+0000 7f7df061d700 1 -- 172.21.15.62:0/849720123 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7de80c7070 con 0x7f7de80d2c20 2023-06-09T04:41:50.073 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.067+0000 7f7ddeffd700 1 -- 172.21.15.62:0/849720123 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7dd8017020 con 0x7f7de80d2c20 2023-06-09T04:41:50.073 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-06-09T04:41:50.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.071+0000 7f7df061d700 1 -- 172.21.15.62:0/849720123 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f7dcc0662f0 msgr2=0x7f7dcc0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:50.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.071+0000 7f7df061d700 1 --2- 172.21.15.62:0/849720123 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f7dcc0662f0 0x7f7dcc0687a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7de4007fd0 tx=0x7f7de4009040 comp rx=0 tx=0).stop 2023-06-09T04:41:50.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.071+0000 7f7df061d700 1 -- 172.21.15.62:0/849720123 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7de80d2c20 msgr2=0x7f7de815b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:50.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.071+0000 7f7df061d700 1 --2- 172.21.15.62:0/849720123 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7de80d2c20 0x7f7de815b0e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7dd800e9a0 tx=0x7f7dd800ecb0 comp rx=0 tx=0).stop 2023-06-09T04:41:50.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.071+0000 7f7df061d700 1 -- 172.21.15.62:0/849720123 shutdown_connections 2023-06-09T04:41:50.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.071+0000 7f7df061d700 1 --2- 172.21.15.62:0/849720123 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f7dcc0662f0 0x7f7dcc0687a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:50.077 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.071+0000 7f7df061d700 1 --2- 172.21.15.62:0/849720123 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7de815f7a0 0x7f7de80b56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:50.077 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.071+0000 7f7df061d700 1 --2- 172.21.15.62:0/849720123 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7de80d2c20 0x7f7de815b0e0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:50.077 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.071+0000 7f7df061d700 1 --2- 172.21.15.62:0/849720123 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7de80d0870 0x7f7de80c6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:50.077 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.071+0000 7f7df061d700 1 -- 172.21.15.62:0/849720123 >> 172.21.15.62:0/849720123 conn(0x7f7de8071840 msgr2=0x7f7de80ccbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:50.077 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.071+0000 7f7df061d700 1 -- 172.21.15.62:0/849720123 shutdown_connections 2023-06-09T04:41:50.078 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.071+0000 7f7df061d700 1 -- 172.21.15.62:0/849720123 wait complete. 2023-06-09T04:41:50.097 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T04:41:50.276 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.271+0000 7f87f9946700 1 Processor -- start 2023-06-09T04:41:50.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.271+0000 7f87f9946700 1 -- start start 2023-06-09T04:41:50.279 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.271+0000 7f87f9946700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f87f406e9e0 0x7f87f406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:50.279 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.275+0000 7f87f9946700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87f406b500 con 0x7f87f40cc140 2023-06-09T04:41:50.279 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.275+0000 7f87f9946700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87f415a2d0 con 0x7f87f406b920 2023-06-09T04:41:50.280 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.275+0000 7f87f9946700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87f40cebb0 con 0x7f87f406e9e0 2023-06-09T04:41:50.281 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.275+0000 7f87f3fff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f87f40cc140 0x7f87f40cc5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:59626/0 (socket says 172.21.15.62:59626) 2023-06-09T04:41:50.281 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.275+0000 7f87f3fff700 1 -- 172.21.15.62:0/2765227646 learned_addr learned my addr 172.21.15.62:0/2765227646 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:41:50.281 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.275+0000 7f87f2ffd700 1 --2- 172.21.15.62:0/2765227646 >> v2:172.21.15.62:3300/0 conn(0x7f87f406e9e0 0x7f87f406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:50.281 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.275+0000 7f87f1ffb700 1 -- 172.21.15.62:0/2765227646 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1702500396 0 0) 0x7f87f406b500 con 0x7f87f40cc140 2023-06-09T04:41:50.281 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.275+0000 7f87f1ffb700 1 -- 172.21.15.62:0/2765227646 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87dc0035d0 con 0x7f87f40cc140 2023-06-09T04:41:50.282 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.275+0000 7f87f1ffb700 1 -- 172.21.15.62:0/2765227646 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2923729591 0 0) 0x7f87f415a2d0 con 0x7f87f406b920 2023-06-09T04:41:50.282 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.275+0000 7f87f1ffb700 1 -- 172.21.15.62:0/2765227646 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87f406b500 con 0x7f87f406b920 2023-06-09T04:41:50.282 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.275+0000 7f87f1ffb700 1 -- 172.21.15.62:0/2765227646 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2446720753 0 0) 0x7f87dc0035d0 con 0x7f87f40cc140 2023-06-09T04:41:50.282 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.275+0000 7f87f1ffb700 1 -- 172.21.15.62:0/2765227646 >> v2:172.21.15.62:3300/0 conn(0x7f87f406e9e0 msgr2=0x7f87f406edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:50.282 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.275+0000 7f87f1ffb700 1 --2- 172.21.15.62:0/2765227646 >> v2:172.21.15.62:3300/0 conn(0x7f87f406e9e0 0x7f87f406edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:50.282 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.275+0000 7f87f1ffb700 1 -- 172.21.15.62:0/2765227646 >> v1:172.21.15.89:6789/0 conn(0x7f87f406b920 legacy=0x7f87f406f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:50.282 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.275+0000 7f87f1ffb700 1 -- 172.21.15.62:0/2765227646 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87f406abd0 con 0x7f87f40cc140 2023-06-09T04:41:50.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.275+0000 7f87f1ffb700 1 -- 172.21.15.62:0/2765227646 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 540845019 0 0) 0x7f87ec0019f0 con 0x7f87f40cc140 2023-06-09T04:41:50.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.275+0000 7f87f1ffb700 1 -- 172.21.15.62:0/2765227646 >> v1:172.21.15.62:6789/0 conn(0x7f87f40cc140 legacy=0x7f87f40cc5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:50.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.275+0000 7f87f1ffb700 1 --2- 172.21.15.62:0/2765227646 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f87dc003c00 0x7f87dc003ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:50.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.275+0000 7f87f1ffb700 1 --2- 172.21.15.62:0/2765227646 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f87dc004870 0x7f87dc004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:50.284 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.275+0000 7f87f1ffb700 1 --2- 172.21.15.62:0/2765227646 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87dc005270 0x7f87dc00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:50.284 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.275+0000 7f87f1ffb700 1 -- 172.21.15.62:0/2765227646 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f40cebb0 con 0x7f87dc003c00 2023-06-09T04:41:50.285 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.275+0000 7f87f1ffb700 1 -- 172.21.15.62:0/2765227646 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87dc00c180 con 0x7f87dc005270 2023-06-09T04:41:50.285 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.275+0000 7f87f1ffb700 1 -- 172.21.15.62:0/2765227646 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87dc00c340 con 0x7f87dc004870 2023-06-09T04:41:50.285 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.275+0000 7f87f2ffd700 1 --2- 172.21.15.62:0/2765227646 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f87dc003c00 0x7f87dc003ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:50.285 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.275+0000 7f87f3fff700 1 --2- 172.21.15.62:0/2765227646 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87dc005270 0x7f87dc00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:50.285 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.275+0000 7f87f27fc700 1 --2- 172.21.15.62:0/2765227646 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f87dc004870 0x7f87dc004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:50.285 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.275+0000 7f87f2ffd700 1 -- 172.21.15.62:0/2765227646 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f87dc004870 msgr2=0x7f87dc004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:50.285 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.275+0000 7f87f2ffd700 1 --2- 172.21.15.62:0/2765227646 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f87dc004870 0x7f87dc004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:50.286 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.275+0000 7f87f2ffd700 1 -- 172.21.15.62:0/2765227646 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87dc005270 msgr2=0x7f87dc00ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:50.286 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.275+0000 7f87f2ffd700 1 --2- 172.21.15.62:0/2765227646 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87dc005270 0x7f87dc00ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:50.286 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.275+0000 7f87f2ffd700 1 -- 172.21.15.62:0/2765227646 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87dc0035d0 con 0x7f87dc003c00 2023-06-09T04:41:50.286 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.275+0000 7f87f3fff700 1 -- 172.21.15.62:0/2765227646 reap_dead start 2023-06-09T04:41:50.286 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.275+0000 7f87f27fc700 1 --2- 172.21.15.62:0/2765227646 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f87dc004870 0x7f87dc004ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:41:50.286 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.275+0000 7f87f2ffd700 1 --2- 172.21.15.62:0/2765227646 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f87dc003c00 0x7f87dc003ff0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f87e4009b40 tx=0x7f87dc0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7c32c8a1e38db49 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:50.286 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.279+0000 7f87f1ffb700 1 -- 172.21.15.62:0/2765227646 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e400e6c0 con 0x7f87dc003c00 2023-06-09T04:41:50.287 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.279+0000 7f87f1ffb700 1 -- 172.21.15.62:0/2765227646 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87e400e820 con 0x7f87dc003c00 2023-06-09T04:41:50.287 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.279+0000 7f87f1ffb700 1 -- 172.21.15.62:0/2765227646 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e400eb90 con 0x7f87dc003c00 2023-06-09T04:41:50.287 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.279+0000 7f87f9946700 1 -- 172.21.15.62:0/2765227646 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f87dc003c00 msgr2=0x7f87dc003ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:50.287 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.279+0000 7f87f9946700 1 --2- 172.21.15.62:0/2765227646 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f87dc003c00 0x7f87dc003ff0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f87e4009b40 tx=0x7f87dc0058a0 comp rx=0 tx=0).stop 2023-06-09T04:41:50.287 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.279+0000 7f87f9946700 1 -- 172.21.15.62:0/2765227646 shutdown_connections 2023-06-09T04:41:50.287 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.279+0000 7f87f9946700 1 --2- 172.21.15.62:0/2765227646 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f87dc003c00 0x7f87dc003ff0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:50.287 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.279+0000 7f87f9946700 1 -- 172.21.15.62:0/2765227646 >> 172.21.15.62:0/2765227646 conn(0x7f87f40b22c0 msgr2=0x7f87f40cf9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:50.288 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.279+0000 7f87f9946700 1 -- 172.21.15.62:0/2765227646 shutdown_connections 2023-06-09T04:41:50.288 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.279+0000 7f87f9946700 1 -- 172.21.15.62:0/2765227646 wait complete. 2023-06-09T04:41:50.289 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.279+0000 7f87f9946700 1 Processor -- start 2023-06-09T04:41:50.289 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.279+0000 7f87f9946700 1 -- start start 2023-06-09T04:41:50.289 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.283+0000 7f87f9946700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f87dc003c00 0x7f87f41510b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:50.289 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.283+0000 7f87f9946700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87f4157980 0x7f87f40b43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:50.289 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.283+0000 7f87f9946700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f87f40ca280 0x7f87f41e3310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:50.289 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.283+0000 7f87f9946700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f40b3f80 con 0x7f87f40ca280 2023-06-09T04:41:50.290 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.283+0000 7f87f9946700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f4156860 con 0x7f87f4157980 2023-06-09T04:41:50.290 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.283+0000 7f87f9946700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87f4157e80 con 0x7f87dc003c00 2023-06-09T04:41:50.290 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.283+0000 7f87f3fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f87f40ca280 0x7f87f41e3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:50.290 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.283+0000 7f87f3fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f87f40ca280 0x7f87f41e3310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:55238/0 (socket says 172.21.15.62:55238) 2023-06-09T04:41:50.290 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.283+0000 7f87f3fff700 1 -- 172.21.15.62:0/2333852462 learned_addr learned my addr 172.21.15.62:0/2333852462 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:50.290 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.283+0000 7f87f2ffd700 1 --2- 172.21.15.62:0/2333852462 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f87dc003c00 0x7f87f41510b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:50.290 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.283+0000 7f87f27fc700 1 --2- 172.21.15.62:0/2333852462 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87f4157980 0x7f87f40b43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:50.291 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.283+0000 7f87f3fff700 1 -- 172.21.15.62:0/2333852462 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f87dc003c00 msgr2=0x7f87f41510b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:50.292 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.283+0000 7f87f3fff700 1 --2- 172.21.15.62:0/2333852462 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f87dc003c00 0x7f87f41510b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:50.292 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.283+0000 7f87f3fff700 1 -- 172.21.15.62:0/2333852462 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87f4157980 msgr2=0x7f87f40b43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:50.292 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.283+0000 7f87f3fff700 1 --2- 172.21.15.62:0/2333852462 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87f4157980 0x7f87f40b43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:50.292 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.283+0000 7f87f3fff700 1 -- 172.21.15.62:0/2333852462 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87f40b35e0 con 0x7f87f40ca280 2023-06-09T04:41:50.292 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.283+0000 7f87f27fc700 1 --2- 172.21.15.62:0/2333852462 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87f4157980 0x7f87f40b43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:41:50.292 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.283+0000 7f87f3fff700 1 --2- 172.21.15.62:0/2333852462 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f87f40ca280 0x7f87f41e3310 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f87f40cc510 tx=0x7f87ec001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:50.292 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.283+0000 7f87dbfff700 1 -- 172.21.15.62:0/2333852462 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87ec00e830 con 0x7f87f40ca280 2023-06-09T04:41:50.293 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.283+0000 7f87f9946700 1 -- 172.21.15.62:0/2333852462 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87f40b38c0 con 0x7f87f40ca280 2023-06-09T04:41:50.293 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.283+0000 7f87dbfff700 1 -- 172.21.15.62:0/2333852462 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87ec00e9b0 con 0x7f87f40ca280 2023-06-09T04:41:50.293 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.283+0000 7f87dbfff700 1 -- 172.21.15.62:0/2333852462 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87ec00ed60 con 0x7f87f40ca280 2023-06-09T04:41:50.293 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.283+0000 7f87f9946700 1 -- 172.21.15.62:0/2333852462 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87f40b48e0 con 0x7f87f40ca280 2023-06-09T04:41:50.294 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.287+0000 7f87f9946700 1 -- 172.21.15.62:0/2333852462 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87f40b4a70 con 0x7f87f40ca280 2023-06-09T04:41:50.294 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.287+0000 7f87dbfff700 1 -- 172.21.15.62:0/2333852462 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f87ec01d460 con 0x7f87f40ca280 2023-06-09T04:41:50.294 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.287+0000 7f87dbfff700 1 --2- 172.21.15.62:0/2333852462 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f87e00662f0 0x7f87e00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:50.294 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.287+0000 7f87dbfff700 1 -- 172.21.15.62:0/2333852462 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f87ec084380 con 0x7f87f40ca280 2023-06-09T04:41:50.295 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.291+0000 7f87f2ffd700 1 --2- 172.21.15.62:0/2333852462 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f87e00662f0 0x7f87e00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:50.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.291+0000 7f87f2ffd700 1 --2- 172.21.15.62:0/2333852462 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f87e00662f0 0x7f87e00687a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f87e40090b0 tx=0x7f87e401e040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:50.303 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.299+0000 7f87dbfff700 1 -- 172.21.15.62:0/2333852462 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f87ec051320 con 0x7f87f40ca280 2023-06-09T04:41:50.462 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:41:50.468 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:41:50.476 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.471+0000 7f87f9946700 1 -- 172.21.15.62:0/2333852462 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f87f40739c0 con 0x7f87f40ca280 2023-06-09T04:41:50.477 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.471+0000 7f87dbfff700 1 -- 172.21.15.62:0/2333852462 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7f87ec054940 con 0x7f87f40ca280 2023-06-09T04:41:50.477 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 64 2023-06-09T04:41:50.480 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.475+0000 7f87f9946700 1 -- 172.21.15.62:0/2333852462 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f87e00662f0 msgr2=0x7f87e00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:50.481 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.475+0000 7f87f9946700 1 --2- 172.21.15.62:0/2333852462 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f87e00662f0 0x7f87e00687a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f87e40090b0 tx=0x7f87e401e040 comp rx=0 tx=0).stop 2023-06-09T04:41:50.481 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.475+0000 7f87f9946700 1 -- 172.21.15.62:0/2333852462 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f87f40ca280 msgr2=0x7f87f41e3310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:50.481 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.475+0000 7f87f9946700 1 --2- 172.21.15.62:0/2333852462 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f87f40ca280 0x7f87f41e3310 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f87f40cc510 tx=0x7f87ec001a20 comp rx=0 tx=0).stop 2023-06-09T04:41:50.481 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.475+0000 7f87f9946700 1 -- 172.21.15.62:0/2333852462 shutdown_connections 2023-06-09T04:41:50.481 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.475+0000 7f87f9946700 1 --2- 172.21.15.62:0/2333852462 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f87e00662f0 0x7f87e00687a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:50.481 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.475+0000 7f87f9946700 1 --2- 172.21.15.62:0/2333852462 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f87f40ca280 0x7f87f41e3310 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:50.481 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.475+0000 7f87f9946700 1 --2- 172.21.15.62:0/2333852462 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87f4157980 0x7f87f40b43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:50.482 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.475+0000 7f87f9946700 1 --2- 172.21.15.62:0/2333852462 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f87dc003c00 0x7f87f41510b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:50.482 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.475+0000 7f87f9946700 1 -- 172.21.15.62:0/2333852462 >> 172.21.15.62:0/2333852462 conn(0x7f87f40b22c0 msgr2=0x7f87f4153640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:50.482 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.475+0000 7f87f9946700 1 -- 172.21.15.62:0/2333852462 shutdown_connections 2023-06-09T04:41:50.482 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.475+0000 7f87f9946700 1 -- 172.21.15.62:0/2333852462 wait complete. 2023-06-09T04:41:50.501 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-09T04:41:50.753 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.747+0000 7f98a359e700 1 Processor -- start 2023-06-09T04:41:50.753 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.747+0000 7f98a359e700 1 -- start start 2023-06-09T04:41:50.756 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.751+0000 7f98a359e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98a406d370 0x7f98a40c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:50.757 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.751+0000 7f98a359e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f98a40c8f70 0x7f98a40cc180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:50.757 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.751+0000 7f98a359e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98a40c93b0 con 0x7f98a4155d00 2023-06-09T04:41:50.757 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.751+0000 7f98a359e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98a4158890 con 0x7f98a40c8f70 2023-06-09T04:41:50.757 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.751+0000 7f98a359e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98a4158a80 con 0x7f98a406d370 2023-06-09T04:41:50.758 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.751+0000 7f98a259c700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f98a4155d00 0x7f98a415c7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:39290/0 (socket says 172.21.15.62:39290) 2023-06-09T04:41:50.758 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.751+0000 7f98a259c700 1 -- 172.21.15.62:0/79803303 learned_addr learned my addr 172.21.15.62:0/79803303 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:41:50.758 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.751+0000 7f98a2d9d700 1 --2- 172.21.15.62:0/79803303 >> v2:172.21.15.62:3300/0 conn(0x7f98a40c8f70 0x7f98a40cc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:50.758 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.751+0000 7f98a1d9b700 1 --2- 172.21.15.62:0/79803303 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98a406d370 0x7f98a40c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:50.758 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.751+0000 7f98a159a700 1 -- 172.21.15.62:0/79803303 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3763820361 0 0) 0x7f98a40c93b0 con 0x7f98a4155d00 2023-06-09T04:41:50.758 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.751+0000 7f98a159a700 1 -- 172.21.15.62:0/79803303 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f988c0035d0 con 0x7f98a4155d00 2023-06-09T04:41:50.759 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.751+0000 7f98a2d9d700 1 -- 172.21.15.62:0/79803303 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98a406d370 msgr2=0x7f98a40c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:50.759 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.751+0000 7f98a2d9d700 1 --2- 172.21.15.62:0/79803303 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98a406d370 0x7f98a40c8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:50.760 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.751+0000 7f98a2d9d700 1 -- 172.21.15.62:0/79803303 >> v1:172.21.15.62:6789/0 conn(0x7f98a4155d00 legacy=0x7f98a415c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:50.760 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.751+0000 7f98a2d9d700 1 -- 172.21.15.62:0/79803303 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98a4158d40 con 0x7f98a40c8f70 2023-06-09T04:41:50.760 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.751+0000 7f98a2d9d700 1 --2- 172.21.15.62:0/79803303 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98a40c8f70 0x7f98a40cc180 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f989c009dc0 tx=0x7f989c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f700fc9e6791f0d1 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:50.760 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.755+0000 7f98a159a700 1 -- 172.21.15.62:0/79803303 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989c00e070 con 0x7f98a40c8f70 2023-06-09T04:41:50.760 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.755+0000 7f98a159a700 1 -- 172.21.15.62:0/79803303 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f989c00bae0 con 0x7f98a40c8f70 2023-06-09T04:41:50.760 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.755+0000 7f98a159a700 1 -- 172.21.15.62:0/79803303 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989c00be50 con 0x7f98a40c8f70 2023-06-09T04:41:50.761 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.755+0000 7f98a359e700 1 -- 172.21.15.62:0/79803303 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98a40c8f70 msgr2=0x7f98a40cc180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:50.761 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.755+0000 7f98a359e700 1 --2- 172.21.15.62:0/79803303 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98a40c8f70 0x7f98a40cc180 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f989c009dc0 tx=0x7f989c00b330 comp rx=0 tx=0).stop 2023-06-09T04:41:50.761 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.755+0000 7f98a359e700 1 -- 172.21.15.62:0/79803303 shutdown_connections 2023-06-09T04:41:50.761 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.755+0000 7f98a359e700 1 --2- 172.21.15.62:0/79803303 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98a40c8f70 0x7f98a40cc180 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:50.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.755+0000 7f98a359e700 1 --2- 172.21.15.62:0/79803303 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98a406d370 0x7f98a40c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:50.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.755+0000 7f98a359e700 1 -- 172.21.15.62:0/79803303 >> 172.21.15.62:0/79803303 conn(0x7f98a40cab50 msgr2=0x7f98a40caf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:50.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.755+0000 7f98a359e700 1 -- 172.21.15.62:0/79803303 shutdown_connections 2023-06-09T04:41:50.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.755+0000 7f98a359e700 1 -- 172.21.15.62:0/79803303 wait complete. 2023-06-09T04:41:50.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.755+0000 7f98a359e700 1 Processor -- start 2023-06-09T04:41:50.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.755+0000 7f98a359e700 1 -- start start 2023-06-09T04:41:50.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.759+0000 7f98a359e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98a406d370 0x7f98a414a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:50.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.759+0000 7f98a359e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98a40c8f70 0x7f98a4153090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:50.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.759+0000 7f98a359e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98a4155d00 0x7f98a40706e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:50.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.759+0000 7f98a359e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a40aeb60 con 0x7f98a40c8f70 2023-06-09T04:41:50.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.759+0000 7f98a359e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a40c51a0 con 0x7f98a4155d00 2023-06-09T04:41:50.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.759+0000 7f98a359e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98a40adee0 con 0x7f98a406d370 2023-06-09T04:41:50.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.759+0000 7f98a1d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98a40c8f70 0x7f98a4153090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:50.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.759+0000 7f98a1d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98a40c8f70 0x7f98a4153090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:44790/0 (socket says 172.21.15.62:44790) 2023-06-09T04:41:50.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.759+0000 7f98a1d9b700 1 -- 172.21.15.62:0/1546054099 learned_addr learned my addr 172.21.15.62:0/1546054099 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:50.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.759+0000 7f98a259c700 1 --2- 172.21.15.62:0/1546054099 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98a406d370 0x7f98a414a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:50.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.759+0000 7f98a2d9d700 1 --2- 172.21.15.62:0/1546054099 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98a4155d00 0x7f98a40706e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:50.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.759+0000 7f98a1d9b700 1 -- 172.21.15.62:0/1546054099 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98a406d370 msgr2=0x7f98a414a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:50.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.759+0000 7f98a1d9b700 1 --2- 172.21.15.62:0/1546054099 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98a406d370 0x7f98a414a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:50.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.759+0000 7f98a1d9b700 1 -- 172.21.15.62:0/1546054099 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98a4155d00 msgr2=0x7f98a40706e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:50.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.759+0000 7f98a1d9b700 1 --2- 172.21.15.62:0/1546054099 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98a4155d00 0x7f98a40706e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:50.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.759+0000 7f98a1d9b700 1 -- 172.21.15.62:0/1546054099 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f989c009a70 con 0x7f98a40c8f70 2023-06-09T04:41:50.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.759+0000 7f98a1d9b700 1 --2- 172.21.15.62:0/1546054099 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98a40c8f70 0x7f98a4153090 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f989800e9d0 tx=0x7f989800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:50.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.759+0000 7f9892ffd700 1 -- 172.21.15.62:0/1546054099 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9898009720 con 0x7f98a40c8f70 2023-06-09T04:41:50.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.759+0000 7f9892ffd700 1 -- 172.21.15.62:0/1546054099 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f989800c850 con 0x7f98a40c8f70 2023-06-09T04:41:50.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.759+0000 7f98a359e700 1 -- 172.21.15.62:0/1546054099 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98a40ae1c0 con 0x7f98a40c8f70 2023-06-09T04:41:50.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.759+0000 7f9892ffd700 1 -- 172.21.15.62:0/1546054099 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989800cbc0 con 0x7f98a40c8f70 2023-06-09T04:41:50.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.759+0000 7f98a359e700 1 -- 172.21.15.62:0/1546054099 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98a40ae780 con 0x7f98a40c8f70 2023-06-09T04:41:50.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.763+0000 7f98a359e700 1 -- 172.21.15.62:0/1546054099 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98a40739c0 con 0x7f98a40c8f70 2023-06-09T04:41:50.770 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.763+0000 7f9892ffd700 1 -- 172.21.15.62:0/1546054099 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f989800cd20 con 0x7f98a40c8f70 2023-06-09T04:41:50.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.767+0000 7f9892ffd700 1 --2- 172.21.15.62:0/1546054099 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f98840662f0 0x7f98840687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:50.772 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.767+0000 7f9892ffd700 1 -- 172.21.15.62:0/1546054099 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f98980840e0 con 0x7f98a40c8f70 2023-06-09T04:41:50.772 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.767+0000 7f98a259c700 1 --2- 172.21.15.62:0/1546054099 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f98840662f0 0x7f98840687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:50.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.767+0000 7f98a259c700 1 --2- 172.21.15.62:0/1546054099 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f98840662f0 0x7f98840687a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f9894007fd0 tx=0x7f9894007de0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:50.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.771+0000 7f9892ffd700 1 -- 172.21.15.62:0/1546054099 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9898051220 con 0x7f98a40c8f70 2023-06-09T04:41:50.953 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.947+0000 7f98a359e700 1 -- 172.21.15.62:0/1546054099 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f98a406baa0 con 0x7f98a40c8f70 2023-06-09T04:41:50.954 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.947+0000 7f9892ffd700 1 -- 172.21.15.62:0/1546054099 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7f9898054840 con 0x7f98a40c8f70 2023-06-09T04:41:50.954 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-06-09T04:41:50.956 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.951+0000 7f98a359e700 1 -- 172.21.15.62:0/1546054099 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f98840662f0 msgr2=0x7f98840687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:50.957 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.951+0000 7f98a359e700 1 --2- 172.21.15.62:0/1546054099 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f98840662f0 0x7f98840687a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f9894007fd0 tx=0x7f9894007de0 comp rx=0 tx=0).stop 2023-06-09T04:41:50.957 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.951+0000 7f98a359e700 1 -- 172.21.15.62:0/1546054099 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98a40c8f70 msgr2=0x7f98a4153090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:50.957 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.951+0000 7f98a359e700 1 --2- 172.21.15.62:0/1546054099 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98a40c8f70 0x7f98a4153090 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f989800e9d0 tx=0x7f989800ece0 comp rx=0 tx=0).stop 2023-06-09T04:41:50.957 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.951+0000 7f98a359e700 1 -- 172.21.15.62:0/1546054099 shutdown_connections 2023-06-09T04:41:50.957 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.951+0000 7f98a359e700 1 --2- 172.21.15.62:0/1546054099 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f98840662f0 0x7f98840687a0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:50.957 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.951+0000 7f98a359e700 1 --2- 172.21.15.62:0/1546054099 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98a4155d00 0x7f98a40706e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:50.958 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.951+0000 7f98a359e700 1 --2- 172.21.15.62:0/1546054099 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f98a40c8f70 0x7f98a4153090 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:50.958 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.951+0000 7f98a359e700 1 --2- 172.21.15.62:0/1546054099 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f98a406d370 0x7f98a414a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:50.958 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.951+0000 7f98a359e700 1 -- 172.21.15.62:0/1546054099 >> 172.21.15.62:0/1546054099 conn(0x7f98a40cab50 msgr2=0x7f98a40ad0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:50.958 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.951+0000 7f98a359e700 1 -- 172.21.15.62:0/1546054099 shutdown_connections 2023-06-09T04:41:50.958 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:50.951+0000 7f98a359e700 1 -- 172.21.15.62:0/1546054099 wait complete. 2023-06-09T04:41:50.978 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:41:51.154 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.147+0000 7f978d46f700 1 Processor -- start 2023-06-09T04:41:51.154 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.147+0000 7f978d46f700 1 -- start start 2023-06-09T04:41:51.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.151+0000 7f978d46f700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f978815c0f0 0x7f97880cbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:51.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.151+0000 7f978d46f700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f97880ad480 0x7f97880caae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:51.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.151+0000 7f978d46f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97880cb020 0x7f978806b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:51.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.151+0000 7f978d46f700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97880cc300 con 0x7f978815c0f0 2023-06-09T04:41:51.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.151+0000 7f978d46f700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97880ad2f0 con 0x7f97880ad480 2023-06-09T04:41:51.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.151+0000 7f978d46f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f978815fa30 con 0x7f97880cb020 2023-06-09T04:41:51.157 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.151+0000 7f9786ffd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f978815c0f0 0x7f97880cbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:51.157 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.151+0000 7f97877fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97880cb020 0x7f978806b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:51.157 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.151+0000 7f9786ffd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f978815c0f0 0x7f97880cbdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:44792/0 (socket says 172.21.15.62:44792) 2023-06-09T04:41:51.157 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.151+0000 7f9786ffd700 1 -- 172.21.15.62:0/1823193346 learned_addr learned my addr 172.21.15.62:0/1823193346 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:51.158 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.151+0000 7f977e7fc700 1 --2- 172.21.15.62:0/1823193346 >> v2:172.21.15.89:3300/0 conn(0x7f97880ad480 0x7f97880caae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:51.158 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.151+0000 7f97877fe700 1 -- 172.21.15.62:0/1823193346 >> v2:172.21.15.89:3300/0 conn(0x7f97880ad480 msgr2=0x7f97880caae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:51.158 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.151+0000 7f97877fe700 1 --2- 172.21.15.62:0/1823193346 >> v2:172.21.15.89:3300/0 conn(0x7f97880ad480 0x7f97880caae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:51.158 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.151+0000 7f97877fe700 1 -- 172.21.15.62:0/1823193346 >> v2:172.21.15.62:3300/0 conn(0x7f978815c0f0 msgr2=0x7f97880cbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:51.158 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.151+0000 7f97877fe700 1 --2- 172.21.15.62:0/1823193346 >> v2:172.21.15.62:3300/0 conn(0x7f978815c0f0 0x7f97880cbdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:51.158 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.151+0000 7f97877fe700 1 -- 172.21.15.62:0/1823193346 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97880cb420 con 0x7f97880cb020 2023-06-09T04:41:51.159 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.151+0000 7f97877fe700 1 --2- 172.21.15.62:0/1823193346 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97880cb020 0x7f978806b5a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f97880b4120 tx=0x7f9780009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2ccdc2283e00e11 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:51.159 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.151+0000 7f97867fc700 1 -- 172.21.15.62:0/1823193346 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9780011830 con 0x7f97880cb020 2023-06-09T04:41:51.159 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.151+0000 7f97867fc700 1 -- 172.21.15.62:0/1823193346 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9780011990 con 0x7f97880cb020 2023-06-09T04:41:51.159 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.151+0000 7f97867fc700 1 -- 172.21.15.62:0/1823193346 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9780011d20 con 0x7f97880cb020 2023-06-09T04:41:51.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.155+0000 7f978d46f700 1 -- 172.21.15.62:0/1823193346 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97880cb020 msgr2=0x7f978806b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:51.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.155+0000 7f978d46f700 1 --2- 172.21.15.62:0/1823193346 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97880cb020 0x7f978806b5a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f97880b4120 tx=0x7f9780009b30 comp rx=0 tx=0).stop 2023-06-09T04:41:51.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.155+0000 7f978d46f700 1 -- 172.21.15.62:0/1823193346 shutdown_connections 2023-06-09T04:41:51.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.155+0000 7f978d46f700 1 --2- 172.21.15.62:0/1823193346 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97880cb020 0x7f978806b5a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:51.161 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.155+0000 7f978d46f700 1 --2- 172.21.15.62:0/1823193346 >> v2:172.21.15.89:3300/0 conn(0x7f97880ad480 0x7f97880caae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:51.161 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.155+0000 7f978d46f700 1 --2- 172.21.15.62:0/1823193346 >> v2:172.21.15.62:3300/0 conn(0x7f978815c0f0 0x7f97880cbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:51.161 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.155+0000 7f978d46f700 1 -- 172.21.15.62:0/1823193346 >> 172.21.15.62:0/1823193346 conn(0x7f978806a410 msgr2=0x7f97880afd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:51.161 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.155+0000 7f978d46f700 1 -- 172.21.15.62:0/1823193346 shutdown_connections 2023-06-09T04:41:51.161 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.155+0000 7f978d46f700 1 -- 172.21.15.62:0/1823193346 wait complete. 2023-06-09T04:41:51.163 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.159+0000 7f978d46f700 1 Processor -- start 2023-06-09T04:41:51.163 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.159+0000 7f978d46f700 1 -- start start 2023-06-09T04:41:51.166 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.159+0000 7f978d46f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97880ad480 0x7f97881588c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:51.166 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.159+0000 7f978d46f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97880cb020 0x7f978815db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:51.166 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.159+0000 7f978d46f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f978815c0f0 0x7f97880c3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:51.166 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.159+0000 7f978d46f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97880ae500 con 0x7f97880cb020 2023-06-09T04:41:51.166 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.159+0000 7f978d46f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97880adbd0 con 0x7f978815c0f0 2023-06-09T04:41:51.166 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.159+0000 7f978d46f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97880adeb0 con 0x7f97880ad480 2023-06-09T04:41:51.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.159+0000 7f977e7fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97880cb020 0x7f978815db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:51.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.159+0000 7f977e7fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97880cb020 0x7f978815db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:44796/0 (socket says 172.21.15.62:44796) 2023-06-09T04:41:51.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.159+0000 7f977e7fc700 1 -- 172.21.15.62:0/154871093 learned_addr learned my addr 172.21.15.62:0/154871093 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:51.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.159+0000 7f9786ffd700 1 --2- 172.21.15.62:0/154871093 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97880ad480 0x7f97881588c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:51.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.159+0000 7f977e7fc700 1 -- 172.21.15.62:0/154871093 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97880ad480 msgr2=0x7f97881588c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:51.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.159+0000 7f977e7fc700 1 --2- 172.21.15.62:0/154871093 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97880ad480 0x7f97881588c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:51.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.159+0000 7f977e7fc700 1 -- 172.21.15.62:0/154871093 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f978815c0f0 msgr2=0x7f97880c3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:51.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.159+0000 7f977e7fc700 1 --2- 172.21.15.62:0/154871093 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f978815c0f0 0x7f97880c3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:51.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.159+0000 7f977e7fc700 1 -- 172.21.15.62:0/154871093 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97800094b0 con 0x7f97880cb020 2023-06-09T04:41:51.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.159+0000 7f977e7fc700 1 --2- 172.21.15.62:0/154871093 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97880cb020 0x7f978815db10 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f977000efc0 tx=0x7f977000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:51.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.163+0000 7f977ffff700 1 -- 172.21.15.62:0/154871093 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f977000cdc0 con 0x7f97880cb020 2023-06-09T04:41:51.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.163+0000 7f977ffff700 1 -- 172.21.15.62:0/154871093 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f977000f040 con 0x7f97880cb020 2023-06-09T04:41:51.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.163+0000 7f977ffff700 1 -- 172.21.15.62:0/154871093 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97700146a0 con 0x7f97880cb020 2023-06-09T04:41:51.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.163+0000 7f978d46f700 1 -- 172.21.15.62:0/154871093 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97880ae190 con 0x7f97880cb020 2023-06-09T04:41:51.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.163+0000 7f978d46f700 1 -- 172.21.15.62:0/154871093 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f978815e050 con 0x7f97880cb020 2023-06-09T04:41:51.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.163+0000 7f978d46f700 1 -- 172.21.15.62:0/154871093 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97880ae670 con 0x7f97880cb020 2023-06-09T04:41:51.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.167+0000 7f977ffff700 1 -- 172.21.15.62:0/154871093 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9770014800 con 0x7f97880cb020 2023-06-09T04:41:51.173 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.167+0000 7f977ffff700 1 --2- 172.21.15.62:0/154871093 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f97680662f0 0x7f97680687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:51.173 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.167+0000 7f977ffff700 1 -- 172.21.15.62:0/154871093 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f97700849a0 con 0x7f97880cb020 2023-06-09T04:41:51.174 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.167+0000 7f9786ffd700 1 --2- 172.21.15.62:0/154871093 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f97680662f0 0x7f97680687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:51.175 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.171+0000 7f9786ffd700 1 --2- 172.21.15.62:0/154871093 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f97680662f0 0x7f97680687a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f978815f720 tx=0x7f9778008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:51.181 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.175+0000 7f977ffff700 1 -- 172.21.15.62:0/154871093 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9770051af0 con 0x7f97880cb020 2023-06-09T04:41:51.359 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.351+0000 7f978d46f700 1 -- 172.21.15.62:0/154871093 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f978804db30 con 0x7f97880cb020 2023-06-09T04:41:51.362 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.355+0000 7f977ffff700 1 -- 172.21.15.62:0/154871093 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+20180 (secure 0 0 0) 0x7f9770082e60 con 0x7f97880cb020 2023-06-09T04:41:51.363 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:41:51.363 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":30,"fsid":"f7998a1e-e5a9-4202-abaa-70c0eaae1047","created":"2023-06-09T04:40:30.469588+0000","modified":"2023-06-09T04:41:38.495589+0000","last_up_change":"2023-06-09T04:40:43.120747+0000","last_in_change":"2023-06-09T04:40:33.568221+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:40:44.646921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:40:50.006643+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:40:55.031273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:40:55.773517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-09T04:40:58.845383+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bc50bbc0-dd08-42ed-804c-ec3029e36c19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6802","nonce":1295788017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6807","nonce":1295788017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6815","nonce":1295788017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6809","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6811","nonce":1295788017}]},"public_addr":"172.21.15.62:6802/1295788017","cluster_addr":"172.21.15.62:6807/1295788017","heartbeat_back_addr":"172.21.15.62:6815/1295788017","heartbeat_front_addr":"172.21.15.62:6811/1295788017","state":["exists","up"]},{"osd":1,"uuid":"8230b12d-e22f-4985-a584-4cc64404cdbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6825","nonce":4120692006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6827","nonce":4120692006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6831","nonce":4120692006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6829","nonce":4120692006}]},"public_addr":"172.21.15.62:6825/4120692006","cluster_addr":"172.21.15.62:6827/4120692006","heartbeat_back_addr":"172.21.15.62:6831/4120692006","heartbeat_front_addr":"172.21.15.62:6829/4120692006","state":["exists","up"]},{"osd":2,"uuid":"d0202506-dbe9-4e3c-9271-687929abf96a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6801","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6803","nonce":4169607876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6805","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6806","nonce":4169607876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6814","nonce":4169607876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6810","nonce":4169607876}]},"public_addr":"172.21.15.62:6803/4169607876","cluster_addr":"172.21.15.62:6806/4169607876","heartbeat_back_addr":"172.21.15.62:6814/4169607876","heartbeat_front_addr":"172.21.15.62:6810/4169607876","state":["exists","up"]},{"osd":3,"uuid":"f3c0298a-b075-4411-af50-e16cd74fdddb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6817","nonce":3268438986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6819","nonce":3268438986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6823","nonce":3268438986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6821","nonce":3268438986}]},"public_addr":"172.21.15.62:6817/3268438986","cluster_addr":"172.21.15.62:6819/3268438986","heartbeat_back_addr":"172.21.15.62:6823/3268438986","heartbeat_front_addr":"172.21.15.62:6821/3268438986","state":["exists","up"]},{"osd":4,"uuid":"1ab5c5ca-e74f-475a-a309-683cc0029928","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6817","nonce":3139617628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6819","nonce":3139617628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6823","nonce":3139617628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6821","nonce":3139617628}]},"public_addr":"172.21.15.89:6817/3139617628","cluster_addr":"172.21.15.89:6819/3139617628","heartbeat_back_addr":"172.21.15.89:6823/3139617628","heartbeat_front_addr":"172.21.15.89:6821/3139617628","state":["exists","up"]},{"osd":5,"uuid":"a933e184-bd8f-4369-a1ba-a68de53c578c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6825","nonce":2681723596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6827","nonce":2681723596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6831","nonce":2681723596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6829","nonce":2681723596}]},"public_addr":"172.21.15.89:6825/2681723596","cluster_addr":"172.21.15.89:6827/2681723596","heartbeat_back_addr":"172.21.15.89:6831/2681723596","heartbeat_front_addr":"172.21.15.89:6829/2681723596","state":["exists","up"]},{"osd":6,"uuid":"1ed7ad37-2eee-49a6-954c-b537e2b7f0ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6809","nonce":1657136033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6811","nonce":1657136033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6815","nonce":1657136033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6813","nonce":1657136033}]},"public_addr":"172.21.15.89:6809/1657136033","cluster_addr":"172.21.15.89:6811/1657136033","heartbeat_back_addr":"172.21.15.89:6815/1657136033","heartbeat_front_addr":"172.21.15.89:6813/1657136033","state":["exists","up"]},{"osd":7,"uuid":"6ed732e9-33ff-40df-9038-a9f1d1622671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6801","nonce":1710561686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6803","nonce":1710561686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6807","nonce":1710561686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6805","nonce":1710561686}]},"public_addr":"172.21.15.89:6801/1710561686","cluster_addr":"172.21.15.89:6803/1710561686","heartbeat_back_addr":"172.21.15.89:6807/1710561686","heartbeat_front_addr":"172.21.15.89:6805/1710561686","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.335803+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.419788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.179334+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.263310+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.071846+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.375627+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.282277+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.315997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.12","mappings":[{"from":1,"to":2}]},{"pgid":"4.19","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:41:51.365 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.359+0000 7f978d46f700 1 -- 172.21.15.62:0/154871093 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f97680662f0 msgr2=0x7f97680687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:51.366 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.359+0000 7f978d46f700 1 --2- 172.21.15.62:0/154871093 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f97680662f0 0x7f97680687a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f978815f720 tx=0x7f9778008040 comp rx=0 tx=0).stop 2023-06-09T04:41:51.366 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.359+0000 7f978d46f700 1 -- 172.21.15.62:0/154871093 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97880cb020 msgr2=0x7f978815db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:51.366 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.359+0000 7f978d46f700 1 --2- 172.21.15.62:0/154871093 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97880cb020 0x7f978815db10 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f977000efc0 tx=0x7f977000c3a0 comp rx=0 tx=0).stop 2023-06-09T04:41:51.366 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.359+0000 7f978d46f700 1 -- 172.21.15.62:0/154871093 shutdown_connections 2023-06-09T04:41:51.366 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.359+0000 7f978d46f700 1 --2- 172.21.15.62:0/154871093 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f97680662f0 0x7f97680687a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:51.366 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.359+0000 7f978d46f700 1 --2- 172.21.15.62:0/154871093 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f978815c0f0 0x7f97880c3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:51.367 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.359+0000 7f978d46f700 1 --2- 172.21.15.62:0/154871093 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97880cb020 0x7f978815db10 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:51.367 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.359+0000 7f978d46f700 1 --2- 172.21.15.62:0/154871093 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97880ad480 0x7f97881588c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:51.367 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.359+0000 7f978d46f700 1 -- 172.21.15.62:0/154871093 >> 172.21.15.62:0/154871093 conn(0x7f978806a410 msgr2=0x7f97880b3960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:51.367 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.359+0000 7f978d46f700 1 -- 172.21.15.62:0/154871093 shutdown_connections 2023-06-09T04:41:51.367 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.359+0000 7f978d46f700 1 -- 172.21.15.62:0/154871093 wait complete. 2023-06-09T04:41:51.389 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:40:44.646921+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:40:50.006643+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T04:40:55.031273+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T04:40:55.773517+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-09T04:40:58.845383+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-09T04:41:51.390 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:41:51.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.567+0000 7f81beae3700 1 Processor -- start 2023-06-09T04:41:51.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.567+0000 7f81beae3700 1 -- start start 2023-06-09T04:41:51.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.567+0000 7f81beae3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81b815b6a0 0x7f81b806a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:51.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.567+0000 7f81beae3700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f81b80cc530 0x7f81b806fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:51.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.567+0000 7f81beae3700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81b8070830 con 0x7f81b8070410 2023-06-09T04:41:51.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.571+0000 7f81beae3700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81b80ccad0 con 0x7f81b80cc530 2023-06-09T04:41:51.576 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.571+0000 7f81beae3700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81b80ccdb0 con 0x7f81b815b6a0 2023-06-09T04:41:51.576 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.571+0000 7f81be2e2700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f81b8070410 0x7f81b815bde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:39296/0 (socket says 172.21.15.62:39296) 2023-06-09T04:41:51.576 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.571+0000 7f81be2e2700 1 -- 172.21.15.62:0/2003540651 learned_addr learned my addr 172.21.15.62:0/2003540651 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:41:51.577 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.571+0000 7f81bd2e0700 1 --2- 172.21.15.62:0/2003540651 >> v2:172.21.15.89:3300/0 conn(0x7f81b80cc530 0x7f81b806fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:51.577 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.571+0000 7f81bdae1700 1 --2- 172.21.15.62:0/2003540651 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81b815b6a0 0x7f81b806a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:51.577 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.571+0000 7f81bcadf700 1 -- 172.21.15.62:0/2003540651 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1519211081 0 0) 0x7f81b8070830 con 0x7f81b8070410 2023-06-09T04:41:51.577 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.571+0000 7f81bcadf700 1 -- 172.21.15.62:0/2003540651 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81a40035d0 con 0x7f81b8070410 2023-06-09T04:41:51.577 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.571+0000 7f81bd2e0700 1 -- 172.21.15.62:0/2003540651 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81b815b6a0 msgr2=0x7f81b806a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:51.577 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.571+0000 7f81bd2e0700 1 --2- 172.21.15.62:0/2003540651 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81b815b6a0 0x7f81b806a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:51.578 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.571+0000 7f81bd2e0700 1 -- 172.21.15.62:0/2003540651 >> v1:172.21.15.62:6789/0 conn(0x7f81b8070410 legacy=0x7f81b815bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:51.578 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.571+0000 7f81bd2e0700 1 -- 172.21.15.62:0/2003540651 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81b80c9050 con 0x7f81b80cc530 2023-06-09T04:41:51.578 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.571+0000 7f81bd2e0700 1 --2- 172.21.15.62:0/2003540651 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81b80cc530 0x7f81b806fed0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f81a8009850 tx=0x7f81a8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba844fbf9f111a03 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:51.578 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.571+0000 7f81bcadf700 1 -- 172.21.15.62:0/2003540651 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a8011830 con 0x7f81b80cc530 2023-06-09T04:41:51.579 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.571+0000 7f81bcadf700 1 -- 172.21.15.62:0/2003540651 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81a8011990 con 0x7f81b80cc530 2023-06-09T04:41:51.579 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.571+0000 7f81bcadf700 1 -- 172.21.15.62:0/2003540651 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a8011d40 con 0x7f81b80cc530 2023-06-09T04:41:51.579 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.575+0000 7f81beae3700 1 -- 172.21.15.62:0/2003540651 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81b80cc530 msgr2=0x7f81b806fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:51.580 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.575+0000 7f81beae3700 1 --2- 172.21.15.62:0/2003540651 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81b80cc530 0x7f81b806fed0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f81a8009850 tx=0x7f81a8009b60 comp rx=0 tx=0).stop 2023-06-09T04:41:51.580 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.575+0000 7f81beae3700 1 -- 172.21.15.62:0/2003540651 shutdown_connections 2023-06-09T04:41:51.580 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.575+0000 7f81beae3700 1 --2- 172.21.15.62:0/2003540651 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81b80cc530 0x7f81b806fed0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:51.580 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.575+0000 7f81beae3700 1 --2- 172.21.15.62:0/2003540651 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81b815b6a0 0x7f81b806a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:51.580 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.575+0000 7f81beae3700 1 -- 172.21.15.62:0/2003540651 >> 172.21.15.62:0/2003540651 conn(0x7f81b80ce960 msgr2=0x7f81b80ced30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:51.581 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.575+0000 7f81beae3700 1 -- 172.21.15.62:0/2003540651 shutdown_connections 2023-06-09T04:41:51.581 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.575+0000 7f81beae3700 1 -- 172.21.15.62:0/2003540651 wait complete. 2023-06-09T04:41:51.583 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.579+0000 7f81beae3700 1 Processor -- start 2023-06-09T04:41:51.583 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.579+0000 7f81beae3700 1 -- start start 2023-06-09T04:41:51.585 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.579+0000 7f81beae3700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81b8070410 0x7f81b80c4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:51.585 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.579+0000 7f81beae3700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81b80cc530 0x7f81b8152730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:51.585 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.579+0000 7f81beae3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81b815b6a0 0x7f81b80afd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:51.585 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.579+0000 7f81beae3700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81b80c3af0 con 0x7f81b80cc530 2023-06-09T04:41:51.585 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.579+0000 7f81beae3700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81b80c2ee0 con 0x7f81b8070410 2023-06-09T04:41:51.586 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.579+0000 7f81beae3700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81b80c31c0 con 0x7f81b815b6a0 2023-06-09T04:41:51.586 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.579+0000 7f81bd2e0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81b80cc530 0x7f81b8152730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:51.587 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.579+0000 7f81bd2e0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81b80cc530 0x7f81b8152730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:44802/0 (socket says 172.21.15.62:44802) 2023-06-09T04:41:51.587 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.579+0000 7f81bd2e0700 1 -- 172.21.15.62:0/4000516482 learned_addr learned my addr 172.21.15.62:0/4000516482 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:51.587 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.579+0000 7f81be2e2700 1 --2- 172.21.15.62:0/4000516482 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81b815b6a0 0x7f81b80afd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:51.587 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.579+0000 7f81bdae1700 1 --2- 172.21.15.62:0/4000516482 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81b8070410 0x7f81b80c4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:51.587 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.579+0000 7f81bd2e0700 1 -- 172.21.15.62:0/4000516482 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81b815b6a0 msgr2=0x7f81b80afd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:51.587 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.579+0000 7f81bd2e0700 1 --2- 172.21.15.62:0/4000516482 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81b815b6a0 0x7f81b80afd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:51.587 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.579+0000 7f81bd2e0700 1 -- 172.21.15.62:0/4000516482 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81b8070410 msgr2=0x7f81b80c4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:51.588 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.579+0000 7f81bd2e0700 1 --2- 172.21.15.62:0/4000516482 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81b8070410 0x7f81b80c4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:51.588 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.579+0000 7f81bd2e0700 1 -- 172.21.15.62:0/4000516482 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81a80094b0 con 0x7f81b80cc530 2023-06-09T04:41:51.588 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.583+0000 7f81bd2e0700 1 --2- 172.21.15.62:0/4000516482 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81b80cc530 0x7f81b8152730 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f81a80090b0 tx=0x7f81a8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:51.589 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.583+0000 7f81ae7fc700 1 -- 172.21.15.62:0/4000516482 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a8004380 con 0x7f81b80cc530 2023-06-09T04:41:51.589 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.583+0000 7f81ae7fc700 1 -- 172.21.15.62:0/4000516482 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81a801f070 con 0x7f81b80cc530 2023-06-09T04:41:51.589 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.583+0000 7f81ae7fc700 1 -- 172.21.15.62:0/4000516482 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a80036c0 con 0x7f81b80cc530 2023-06-09T04:41:51.589 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.583+0000 7f81beae3700 1 -- 172.21.15.62:0/4000516482 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81b80c34a0 con 0x7f81b80cc530 2023-06-09T04:41:51.589 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.583+0000 7f81beae3700 1 -- 172.21.15.62:0/4000516482 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81b80c4b80 con 0x7f81b80cc530 2023-06-09T04:41:51.589 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.583+0000 7f81beae3700 1 -- 172.21.15.62:0/4000516482 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81b8066090 con 0x7f81b80cc530 2023-06-09T04:41:51.591 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.587+0000 7f81ae7fc700 1 -- 172.21.15.62:0/4000516482 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f81a8021030 con 0x7f81b80cc530 2023-06-09T04:41:51.592 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.587+0000 7f81ae7fc700 1 --2- 172.21.15.62:0/4000516482 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f819c0662f0 0x7f819c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:51.592 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.587+0000 7f81ae7fc700 1 -- 172.21.15.62:0/4000516482 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f81a80853d0 con 0x7f81b80cc530 2023-06-09T04:41:51.593 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.587+0000 7f81bdae1700 1 --2- 172.21.15.62:0/4000516482 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f819c0662f0 0x7f819c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:51.594 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.587+0000 7f81bdae1700 1 --2- 172.21.15.62:0/4000516482 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f819c0662f0 0x7f819c0687a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f81b4009bf0 tx=0x7f81b4009240 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:51.600 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.595+0000 7f81ae7fc700 1 -- 172.21.15.62:0/4000516482 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f81a8052630 con 0x7f81b80cc530 2023-06-09T04:41:51.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.767+0000 7f81beae3700 1 -- 172.21.15.62:0/4000516482 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f81b80739c0 con 0x7f81b80cc530 2023-06-09T04:41:51.772 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.767+0000 7f81ae7fc700 1 -- 172.21.15.62:0/4000516482 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f81a8006ce0 con 0x7f81b80cc530 2023-06-09T04:41:51.772 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2023-06-09T04:41:51.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.767+0000 7f81beae3700 1 -- 172.21.15.62:0/4000516482 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f819c0662f0 msgr2=0x7f819c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:51.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.767+0000 7f81beae3700 1 --2- 172.21.15.62:0/4000516482 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f819c0662f0 0x7f819c0687a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f81b4009bf0 tx=0x7f81b4009240 comp rx=0 tx=0).stop 2023-06-09T04:41:51.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.767+0000 7f81beae3700 1 -- 172.21.15.62:0/4000516482 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81b80cc530 msgr2=0x7f81b8152730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:51.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.767+0000 7f81beae3700 1 --2- 172.21.15.62:0/4000516482 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81b80cc530 0x7f81b8152730 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f81a80090b0 tx=0x7f81a8004770 comp rx=0 tx=0).stop 2023-06-09T04:41:51.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.767+0000 7f81beae3700 1 -- 172.21.15.62:0/4000516482 shutdown_connections 2023-06-09T04:41:51.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.767+0000 7f81beae3700 1 --2- 172.21.15.62:0/4000516482 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f819c0662f0 0x7f819c0687a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:51.776 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.767+0000 7f81beae3700 1 --2- 172.21.15.62:0/4000516482 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f81b815b6a0 0x7f81b80afd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:51.776 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.767+0000 7f81beae3700 1 --2- 172.21.15.62:0/4000516482 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f81b80cc530 0x7f81b8152730 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:51.776 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.767+0000 7f81beae3700 1 --2- 172.21.15.62:0/4000516482 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81b8070410 0x7f81b80c4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:51.776 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.767+0000 7f81beae3700 1 -- 172.21.15.62:0/4000516482 >> 172.21.15.62:0/4000516482 conn(0x7f81b80ce960 msgr2=0x7f81b80acb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:51.776 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.771+0000 7f81beae3700 1 -- 172.21.15.62:0/4000516482 shutdown_connections 2023-06-09T04:41:51.777 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.771+0000 7f81beae3700 1 -- 172.21.15.62:0/4000516482 wait complete. 2023-06-09T04:41:51.795 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:41:51.979 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.975+0000 7f7259577700 1 Processor -- start 2023-06-09T04:41:51.980 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.975+0000 7f7259577700 1 -- start start 2023-06-09T04:41:51.982 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.975+0000 7f7259577700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7254160360 0x7f72540ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:51.982 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.975+0000 7f7259577700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f72540b0260 0x7f725406d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:51.982 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.975+0000 7f7259577700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7254160730 con 0x7f72540c8800 2023-06-09T04:41:51.982 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.975+0000 7f7259577700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72540ca860 con 0x7f72540b0260 2023-06-09T04:41:51.983 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.975+0000 7f7259577700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72540ca580 con 0x7f7254160360 2023-06-09T04:41:51.983 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.975+0000 7f7253fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7254160360 0x7f72540ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:51.983 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.975+0000 7f7258d76700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f72540b0260 0x7f725406d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:51.983 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.975+0000 7f72537fe700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f72540c8800 0x7f72540afb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.62:47884/0 (socket says 172.21.15.62:47884) 2023-06-09T04:41:51.984 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.975+0000 7f72537fe700 1 -- 172.21.15.62:0/1750773080 learned_addr learned my addr 172.21.15.62:0/1750773080 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:41:51.984 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.979+0000 7f7252ffd700 1 -- 172.21.15.62:0/1750773080 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 759084642 0 0) 0x7f7254160730 con 0x7f72540c8800 2023-06-09T04:41:51.984 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.979+0000 7f7252ffd700 1 -- 172.21.15.62:0/1750773080 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f723c0035d0 con 0x7f72540c8800 2023-06-09T04:41:51.985 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.979+0000 7f7258d76700 1 -- 172.21.15.62:0/1750773080 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7254160360 msgr2=0x7f72540ccb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:51.985 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.979+0000 7f7258d76700 1 --2- 172.21.15.62:0/1750773080 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7254160360 0x7f72540ccb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:51.985 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.979+0000 7f7258d76700 1 -- 172.21.15.62:0/1750773080 >> v1:172.21.15.89:6789/0 conn(0x7f72540c8800 legacy=0x7f72540afb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:51.985 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.979+0000 7f7258d76700 1 -- 172.21.15.62:0/1750773080 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72540cc070 con 0x7f72540b0260 2023-06-09T04:41:51.985 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.979+0000 7f7253fff700 1 --2- 172.21.15.62:0/1750773080 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7254160360 0x7f72540ccb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:41:51.986 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.979+0000 7f7258d76700 1 --2- 172.21.15.62:0/1750773080 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72540b0260 0x7f725406d4b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f724c009d90 tx=0x7f724c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=777951419da7c43a server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:51.986 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.979+0000 7f7252ffd700 1 -- 172.21.15.62:0/1750773080 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724c00e070 con 0x7f72540b0260 2023-06-09T04:41:51.986 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.979+0000 7f7252ffd700 1 -- 172.21.15.62:0/1750773080 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f724c00bb20 con 0x7f72540b0260 2023-06-09T04:41:51.986 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.979+0000 7f7252ffd700 1 -- 172.21.15.62:0/1750773080 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724c012430 con 0x7f72540b0260 2023-06-09T04:41:51.986 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.979+0000 7f7259577700 1 -- 172.21.15.62:0/1750773080 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72540b0260 msgr2=0x7f725406d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:51.987 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.979+0000 7f7259577700 1 --2- 172.21.15.62:0/1750773080 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72540b0260 0x7f725406d4b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f724c009d90 tx=0x7f724c00b330 comp rx=0 tx=0).stop 2023-06-09T04:41:51.987 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.979+0000 7f7259577700 1 -- 172.21.15.62:0/1750773080 shutdown_connections 2023-06-09T04:41:51.987 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.979+0000 7f7259577700 1 --2- 172.21.15.62:0/1750773080 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72540b0260 0x7f725406d4b0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:51.987 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.979+0000 7f7259577700 1 --2- 172.21.15.62:0/1750773080 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7254160360 0x7f72540ccb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:51.988 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.979+0000 7f7259577700 1 -- 172.21.15.62:0/1750773080 >> 172.21.15.62:0/1750773080 conn(0x7f72540cab50 msgr2=0x7f72540caf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:51.988 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.979+0000 7f7259577700 1 -- 172.21.15.62:0/1750773080 shutdown_connections 2023-06-09T04:41:51.988 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.979+0000 7f7259577700 1 -- 172.21.15.62:0/1750773080 wait complete. 2023-06-09T04:41:51.990 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.983+0000 7f7259577700 1 Processor -- start 2023-06-09T04:41:51.990 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.983+0000 7f7259577700 1 -- start start 2023-06-09T04:41:51.992 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.987+0000 7f7259577700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72540b0260 0x7f72540b2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:51.992 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.987+0000 7f7259577700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72540c8800 0x7f72541622b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:51.992 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.987+0000 7f7259577700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7254160360 0x7f7254070a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:51.992 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.987+0000 7f7259577700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7254163560 con 0x7f72540c8800 2023-06-09T04:41:51.992 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.987+0000 7f7259577700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72541627f0 con 0x7f72540b0260 2023-06-09T04:41:51.993 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.987+0000 7f7259577700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72541629e0 con 0x7f7254160360 2023-06-09T04:41:51.994 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.987+0000 7f72537fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72540c8800 0x7f72541622b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:51.994 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.987+0000 7f72537fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72540c8800 0x7f72541622b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:44818/0 (socket says 172.21.15.62:44818) 2023-06-09T04:41:51.994 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.987+0000 7f72537fe700 1 -- 172.21.15.62:0/4063322830 learned_addr learned my addr 172.21.15.62:0/4063322830 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:51.994 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.987+0000 7f7253fff700 1 --2- 172.21.15.62:0/4063322830 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72540b0260 0x7f72540b2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:51.994 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.987+0000 7f7258d76700 1 --2- 172.21.15.62:0/4063322830 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7254160360 0x7f7254070a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:51.994 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.987+0000 7f72537fe700 1 -- 172.21.15.62:0/4063322830 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7254160360 msgr2=0x7f7254070a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:51.995 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.987+0000 7f72537fe700 1 --2- 172.21.15.62:0/4063322830 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7254160360 0x7f7254070a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:51.995 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.987+0000 7f72537fe700 1 -- 172.21.15.62:0/4063322830 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72540b0260 msgr2=0x7f72540b2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:51.995 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.987+0000 7f72537fe700 1 --2- 172.21.15.62:0/4063322830 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72540b0260 0x7f72540b2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:51.995 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.987+0000 7f72537fe700 1 -- 172.21.15.62:0/4063322830 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72440094b0 con 0x7f72540c8800 2023-06-09T04:41:51.995 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.987+0000 7f7253fff700 1 --2- 172.21.15.62:0/4063322830 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72540b0260 0x7f72540b2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:41:51.995 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.987+0000 7f72537fe700 1 --2- 172.21.15.62:0/4063322830 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72540c8800 0x7f72541622b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f724800c4d0 tx=0x7f724800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:51.995 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.987+0000 7f7250ff9700 1 -- 172.21.15.62:0/4063322830 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7248005d90 con 0x7f72540c8800 2023-06-09T04:41:51.995 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.987+0000 7f7250ff9700 1 -- 172.21.15.62:0/4063322830 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72480070d0 con 0x7f72540c8800 2023-06-09T04:41:51.996 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.987+0000 7f7259577700 1 -- 172.21.15.62:0/4063322830 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f724c009a70 con 0x7f72540c8800 2023-06-09T04:41:51.996 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.987+0000 7f7250ff9700 1 -- 172.21.15.62:0/4063322830 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7248007480 con 0x7f72540c8800 2023-06-09T04:41:51.996 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.987+0000 7f7259577700 1 -- 172.21.15.62:0/4063322830 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7254163280 con 0x7f72540c8800 2023-06-09T04:41:51.996 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.991+0000 7f7259577700 1 -- 172.21.15.62:0/4063322830 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72540739c0 con 0x7f72540c8800 2023-06-09T04:41:51.997 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.991+0000 7f7250ff9700 1 -- 172.21.15.62:0/4063322830 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f72480075e0 con 0x7f72540c8800 2023-06-09T04:41:51.999 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.995+0000 7f7250ff9700 1 --2- 172.21.15.62:0/4063322830 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f72400662f0 0x7f72400687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:52.000 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.995+0000 7f7250ff9700 1 -- 172.21.15.62:0/4063322830 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7248083670 con 0x7f72540c8800 2023-06-09T04:41:52.000 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.995+0000 7f7253fff700 1 --2- 172.21.15.62:0/4063322830 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f72400662f0 0x7f72400687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:52.001 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.995+0000 7f7253fff700 1 --2- 172.21.15.62:0/4063322830 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f72400662f0 0x7f72400687a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7244009d00 tx=0x7f7244008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:52.004 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:51.999+0000 7f7250ff9700 1 -- 172.21.15.62:0/4063322830 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7248050720 con 0x7f72540c8800 2023-06-09T04:41:52.174 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.167+0000 7f7259577700 1 -- 172.21.15.62:0/4063322830 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7254163ae0 con 0x7f72540c8800 2023-06-09T04:41:52.174 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.167+0000 7f7250ff9700 1 -- 172.21.15.62:0/4063322830 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7248053d40 con 0x7f72540c8800 2023-06-09T04:41:52.175 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2023-06-09T04:41:52.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.171+0000 7f7259577700 1 -- 172.21.15.62:0/4063322830 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f72400662f0 msgr2=0x7f72400687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:52.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.171+0000 7f7259577700 1 --2- 172.21.15.62:0/4063322830 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f72400662f0 0x7f72400687a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7244009d00 tx=0x7f7244008040 comp rx=0 tx=0).stop 2023-06-09T04:41:52.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.171+0000 7f7259577700 1 -- 172.21.15.62:0/4063322830 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72540c8800 msgr2=0x7f72541622b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:52.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.171+0000 7f7259577700 1 --2- 172.21.15.62:0/4063322830 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72540c8800 0x7f72541622b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f724800c4d0 tx=0x7f724800c890 comp rx=0 tx=0).stop 2023-06-09T04:41:52.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.171+0000 7f7259577700 1 -- 172.21.15.62:0/4063322830 shutdown_connections 2023-06-09T04:41:52.178 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.171+0000 7f7259577700 1 --2- 172.21.15.62:0/4063322830 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f72400662f0 0x7f72400687a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:52.178 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.171+0000 7f7259577700 1 --2- 172.21.15.62:0/4063322830 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7254160360 0x7f7254070a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:52.178 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.171+0000 7f7259577700 1 --2- 172.21.15.62:0/4063322830 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f72540c8800 0x7f72541622b0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:52.178 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.171+0000 7f7259577700 1 --2- 172.21.15.62:0/4063322830 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f72540b0260 0x7f72540b2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:52.178 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.171+0000 7f7259577700 1 -- 172.21.15.62:0/4063322830 >> 172.21.15.62:0/4063322830 conn(0x7f72540cab50 msgr2=0x7f725406c120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:52.179 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.171+0000 7f7259577700 1 -- 172.21.15.62:0/4063322830 shutdown_connections 2023-06-09T04:41:52.179 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.171+0000 7f7259577700 1 -- 172.21.15.62:0/4063322830 wait complete. 2023-06-09T04:41:52.200 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T04:41:52.380 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.375+0000 7f0c3c491700 1 Processor -- start 2023-06-09T04:41:52.380 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.375+0000 7f0c3c491700 1 -- start start 2023-06-09T04:41:52.383 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.379+0000 7f0c3c491700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c34159e10 0x7f0c340b09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:52.383 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.379+0000 7f0c3c491700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0c3415e500 0x7f0c340b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:52.383 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.379+0000 7f0c3c491700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c340cda40 con 0x7f0c3415e090 2023-06-09T04:41:52.383 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.379+0000 7f0c3c491700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c340cd830 con 0x7f0c3415e500 2023-06-09T04:41:52.384 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.379+0000 7f0c3c491700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c340cdd20 con 0x7f0c34159e10 2023-06-09T04:41:52.384 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.379+0000 7f0c39a2c700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f0c3415e090 0x7f0c340b2ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:39310/0 (socket says 172.21.15.62:39310) 2023-06-09T04:41:52.384 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.379+0000 7f0c39a2c700 1 -- 172.21.15.62:0/3296484308 learned_addr learned my addr 172.21.15.62:0/3296484308 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:41:52.385 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.379+0000 7f0c3a22d700 1 --2- 172.21.15.62:0/3296484308 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c34159e10 0x7f0c340b09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:52.385 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.379+0000 7f0c3aa2e700 1 --2- 172.21.15.62:0/3296484308 >> v2:172.21.15.89:3300/0 conn(0x7f0c3415e500 0x7f0c340b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:52.385 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.379+0000 7f0c3922b700 1 -- 172.21.15.62:0/3296484308 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4264956947 0 0) 0x7f0c340cda40 con 0x7f0c3415e090 2023-06-09T04:41:52.385 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.379+0000 7f0c3922b700 1 -- 172.21.15.62:0/3296484308 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c200035d0 con 0x7f0c3415e090 2023-06-09T04:41:52.386 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.379+0000 7f0c3a22d700 1 -- 172.21.15.62:0/3296484308 >> v2:172.21.15.89:3300/0 conn(0x7f0c3415e500 msgr2=0x7f0c340b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:52.386 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.379+0000 7f0c3a22d700 1 --2- 172.21.15.62:0/3296484308 >> v2:172.21.15.89:3300/0 conn(0x7f0c3415e500 0x7f0c340b31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:52.386 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.379+0000 7f0c3a22d700 1 -- 172.21.15.62:0/3296484308 >> v1:172.21.15.62:6789/0 conn(0x7f0c3415e090 legacy=0x7f0c340b2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:52.386 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.379+0000 7f0c3922b700 1 -- 172.21.15.62:0/3296484308 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2209669877 0 0) 0x7f0c200035d0 con 0x7f0c3415e090 2023-06-09T04:41:52.387 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.379+0000 7f0c3a22d700 1 -- 172.21.15.62:0/3296484308 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c3415d890 con 0x7f0c34159e10 2023-06-09T04:41:52.387 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.379+0000 7f0c3a22d700 1 --2- 172.21.15.62:0/3296484308 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c34159e10 0x7f0c340b09b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0c30009850 tx=0x7f0c30009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1d57a45054a60bb server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:52.387 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.379+0000 7f0c3922b700 1 -- 172.21.15.62:0/3296484308 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c24001670 con 0x7f0c34159e10 2023-06-09T04:41:52.387 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.379+0000 7f0c3922b700 1 -- 172.21.15.62:0/3296484308 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c30004030 con 0x7f0c34159e10 2023-06-09T04:41:52.387 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.379+0000 7f0c3922b700 1 -- 172.21.15.62:0/3296484308 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c300043e0 con 0x7f0c34159e10 2023-06-09T04:41:52.388 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.379+0000 7f0c3c491700 1 -- 172.21.15.62:0/3296484308 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c34159e10 msgr2=0x7f0c340b09b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:52.388 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.379+0000 7f0c3c491700 1 --2- 172.21.15.62:0/3296484308 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c34159e10 0x7f0c340b09b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0c30009850 tx=0x7f0c30009b60 comp rx=0 tx=0).stop 2023-06-09T04:41:52.388 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.383+0000 7f0c3c491700 1 -- 172.21.15.62:0/3296484308 shutdown_connections 2023-06-09T04:41:52.388 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.383+0000 7f0c3c491700 1 --2- 172.21.15.62:0/3296484308 >> v2:172.21.15.89:3300/0 conn(0x7f0c3415e500 0x7f0c340b31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:52.388 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.383+0000 7f0c3c491700 1 --2- 172.21.15.62:0/3296484308 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c34159e10 0x7f0c340b09b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:52.389 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.383+0000 7f0c3c491700 1 -- 172.21.15.62:0/3296484308 >> 172.21.15.62:0/3296484308 conn(0x7f0c3406c5d0 msgr2=0x7f0c340cad60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:52.389 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.383+0000 7f0c3c491700 1 -- 172.21.15.62:0/3296484308 shutdown_connections 2023-06-09T04:41:52.389 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.383+0000 7f0c3c491700 1 -- 172.21.15.62:0/3296484308 wait complete. 2023-06-09T04:41:52.389 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.383+0000 7f0c3c491700 1 Processor -- start 2023-06-09T04:41:52.390 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.383+0000 7f0c3c491700 1 -- start start 2023-06-09T04:41:52.391 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.383+0000 7f0c3c491700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c34159e10 0x7f0c34147590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:52.391 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.383+0000 7f0c3c491700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c3415e090 0x7f0c34147ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:52.391 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.383+0000 7f0c3c491700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c3415e500 0x7f0c34148010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:52.391 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.383+0000 7f0c3c491700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3415a1e0 con 0x7f0c34159e10 2023-06-09T04:41:52.391 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.383+0000 7f0c3c491700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3415c5a0 con 0x7f0c3415e090 2023-06-09T04:41:52.391 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.383+0000 7f0c3c491700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3415c840 con 0x7f0c3415e500 2023-06-09T04:41:52.392 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.387+0000 7f0c3a22d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c34159e10 0x7f0c34147590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:52.393 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.387+0000 7f0c3a22d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c34159e10 0x7f0c34147590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:44826/0 (socket says 172.21.15.62:44826) 2023-06-09T04:41:52.393 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.387+0000 7f0c3a22d700 1 -- 172.21.15.62:0/742068581 learned_addr learned my addr 172.21.15.62:0/742068581 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:52.393 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.387+0000 7f0c39a2c700 1 --2- 172.21.15.62:0/742068581 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c3415e090 0x7f0c34147ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:52.393 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.387+0000 7f0c3aa2e700 1 --2- 172.21.15.62:0/742068581 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c3415e500 0x7f0c34148010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:52.393 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.387+0000 7f0c3a22d700 1 -- 172.21.15.62:0/742068581 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c3415e500 msgr2=0x7f0c34148010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:52.393 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.387+0000 7f0c3a22d700 1 --2- 172.21.15.62:0/742068581 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c3415e500 0x7f0c34148010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:52.394 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.387+0000 7f0c3a22d700 1 -- 172.21.15.62:0/742068581 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c3415e090 msgr2=0x7f0c34147ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:52.394 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.387+0000 7f0c3a22d700 1 --2- 172.21.15.62:0/742068581 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c3415e090 0x7f0c34147ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:52.394 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.387+0000 7f0c3a22d700 1 -- 172.21.15.62:0/742068581 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c300094b0 con 0x7f0c34159e10 2023-06-09T04:41:52.394 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.387+0000 7f0c3a22d700 1 --2- 172.21.15.62:0/742068581 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c34159e10 0x7f0c34147590 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f0c340cd970 tx=0x7f0c30004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:52.395 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.387+0000 7f0c2affd700 1 -- 172.21.15.62:0/742068581 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c30003e00 con 0x7f0c34159e10 2023-06-09T04:41:52.395 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.387+0000 7f0c2affd700 1 -- 172.21.15.62:0/742068581 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c3001f070 con 0x7f0c34159e10 2023-06-09T04:41:52.395 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.387+0000 7f0c3c491700 1 -- 172.21.15.62:0/742068581 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c3415a3f0 con 0x7f0c34159e10 2023-06-09T04:41:52.395 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.387+0000 7f0c2affd700 1 -- 172.21.15.62:0/742068581 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c30011870 con 0x7f0c34159e10 2023-06-09T04:41:52.395 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.387+0000 7f0c3c491700 1 -- 172.21.15.62:0/742068581 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c340c3280 con 0x7f0c34159e10 2023-06-09T04:41:52.395 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.387+0000 7f0c3c491700 1 -- 172.21.15.62:0/742068581 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c3415ca00 con 0x7f0c34159e10 2023-06-09T04:41:52.397 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.391+0000 7f0c2affd700 1 -- 172.21.15.62:0/742068581 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0c300119d0 con 0x7f0c34159e10 2023-06-09T04:41:52.398 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.391+0000 7f0c2affd700 1 --2- 172.21.15.62:0/742068581 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f0c180662f0 0x7f0c180687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:52.398 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.391+0000 7f0c2affd700 1 -- 172.21.15.62:0/742068581 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0c30021070 con 0x7f0c34159e10 2023-06-09T04:41:52.399 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.395+0000 7f0c39a2c700 1 --2- 172.21.15.62:0/742068581 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f0c180662f0 0x7f0c180687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:52.400 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.395+0000 7f0c39a2c700 1 --2- 172.21.15.62:0/742068581 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f0c180662f0 0x7f0c180687a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0c340b3480 tx=0x7f0c24001e40 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:52.402 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.395+0000 7f0c2affd700 1 -- 172.21.15.62:0/742068581 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0c30052a90 con 0x7f0c34159e10 2023-06-09T04:41:52.578 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.571+0000 7f0c3c491700 1 -- 172.21.15.62:0/742068581 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0c340739c0 con 0x7f0c34159e10 2023-06-09T04:41:52.578 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.571+0000 7f0c2affd700 1 -- 172.21.15.62:0/742068581 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0c300253e0 con 0x7f0c34159e10 2023-06-09T04:41:52.579 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-06-09T04:41:52.581 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.575+0000 7f0c3c491700 1 -- 172.21.15.62:0/742068581 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f0c180662f0 msgr2=0x7f0c180687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:52.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.575+0000 7f0c3c491700 1 --2- 172.21.15.62:0/742068581 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f0c180662f0 0x7f0c180687a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0c340b3480 tx=0x7f0c24001e40 comp rx=0 tx=0).stop 2023-06-09T04:41:52.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.575+0000 7f0c3c491700 1 -- 172.21.15.62:0/742068581 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c34159e10 msgr2=0x7f0c34147590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:52.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.575+0000 7f0c3c491700 1 --2- 172.21.15.62:0/742068581 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c34159e10 0x7f0c34147590 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f0c340cd970 tx=0x7f0c30004770 comp rx=0 tx=0).stop 2023-06-09T04:41:52.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.575+0000 7f0c3c491700 1 -- 172.21.15.62:0/742068581 shutdown_connections 2023-06-09T04:41:52.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.575+0000 7f0c3c491700 1 --2- 172.21.15.62:0/742068581 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f0c180662f0 0x7f0c180687a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:52.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.575+0000 7f0c3c491700 1 --2- 172.21.15.62:0/742068581 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c3415e500 0x7f0c34148010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:52.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.575+0000 7f0c3c491700 1 --2- 172.21.15.62:0/742068581 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c3415e090 0x7f0c34147ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:52.583 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.575+0000 7f0c3c491700 1 --2- 172.21.15.62:0/742068581 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c34159e10 0x7f0c34147590 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:52.583 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.575+0000 7f0c3c491700 1 -- 172.21.15.62:0/742068581 >> 172.21.15.62:0/742068581 conn(0x7f0c3406c5d0 msgr2=0x7f0c340b0270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:52.583 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.575+0000 7f0c3c491700 1 -- 172.21.15.62:0/742068581 shutdown_connections 2023-06-09T04:41:52.583 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.575+0000 7f0c3c491700 1 -- 172.21.15.62:0/742068581 wait complete. 2023-06-09T04:41:52.603 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T04:41:52.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.775+0000 7f7550a68700 1 Processor -- start 2023-06-09T04:41:52.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.775+0000 7f7550a68700 1 -- start start 2023-06-09T04:41:52.785 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.779+0000 7f7550a68700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f754c0b3b20 0x7f754c0cebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:52.785 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.779+0000 7f7550a68700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f754c0b4d50 con 0x7f754c0d1f80 2023-06-09T04:41:52.785 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.779+0000 7f7550a68700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f754c0b4140 con 0x7f754c0cd2e0 2023-06-09T04:41:52.785 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.779+0000 7f7550a68700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f754c0b4420 con 0x7f754c0b3b20 2023-06-09T04:41:52.786 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.779+0000 7f754b7fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f754c0d1f80 0x7f754c0ccbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:39314/0 (socket says 172.21.15.62:39314) 2023-06-09T04:41:52.786 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.779+0000 7f754b7fe700 1 -- 172.21.15.62:0/564301863 learned_addr learned my addr 172.21.15.62:0/564301863 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:41:52.786 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.779+0000 7f754bfff700 1 --2- 172.21.15.62:0/564301863 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f754c0b3b20 0x7f754c0cebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:52.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.779+0000 7f754a7fc700 1 -- 172.21.15.62:0/564301863 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2469833880 0 0) 0x7f754c0b4d50 con 0x7f754c0d1f80 2023-06-09T04:41:52.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.779+0000 7f754a7fc700 1 -- 172.21.15.62:0/564301863 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75340035d0 con 0x7f754c0d1f80 2023-06-09T04:41:52.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.779+0000 7f754a7fc700 1 -- 172.21.15.62:0/564301863 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2253546704 0 0) 0x7f754c0b4140 con 0x7f754c0cd2e0 2023-06-09T04:41:52.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.779+0000 7f754a7fc700 1 -- 172.21.15.62:0/564301863 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f754c0b4d50 con 0x7f754c0cd2e0 2023-06-09T04:41:52.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.779+0000 7f754bfff700 1 -- 172.21.15.62:0/564301863 >> v1:172.21.15.89:6789/0 conn(0x7f754c0cd2e0 legacy=0x7f754c0d0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:52.788 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.779+0000 7f754bfff700 1 -- 172.21.15.62:0/564301863 >> v1:172.21.15.62:6789/0 conn(0x7f754c0d1f80 legacy=0x7f754c0ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:52.788 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.779+0000 7f754bfff700 1 -- 172.21.15.62:0/564301863 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f754c0b4700 con 0x7f754c0b3b20 2023-06-09T04:41:52.788 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.783+0000 7f754bfff700 1 --2- 172.21.15.62:0/564301863 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f754c0b3b20 0x7f754c0cebf0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7544009dc0 tx=0x7f754400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe7691b23ad84c40 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:52.789 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.783+0000 7f754a7fc700 1 -- 172.21.15.62:0/564301863 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f754400e070 con 0x7f754c0b3b20 2023-06-09T04:41:52.789 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.783+0000 7f754a7fc700 1 -- 172.21.15.62:0/564301863 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f754400bb20 con 0x7f754c0b3b20 2023-06-09T04:41:52.789 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.783+0000 7f754a7fc700 1 -- 172.21.15.62:0/564301863 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7544012430 con 0x7f754c0b3b20 2023-06-09T04:41:52.789 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.783+0000 7f7550a68700 1 -- 172.21.15.62:0/564301863 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f754c0b3b20 msgr2=0x7f754c0cebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:52.789 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.783+0000 7f7550a68700 1 --2- 172.21.15.62:0/564301863 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f754c0b3b20 0x7f754c0cebf0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7544009dc0 tx=0x7f754400b330 comp rx=0 tx=0).stop 2023-06-09T04:41:52.790 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.783+0000 7f7550a68700 1 -- 172.21.15.62:0/564301863 shutdown_connections 2023-06-09T04:41:52.790 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.783+0000 7f7550a68700 1 --2- 172.21.15.62:0/564301863 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f754c0b3b20 0x7f754c0cebf0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:52.790 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.783+0000 7f7550a68700 1 -- 172.21.15.62:0/564301863 >> 172.21.15.62:0/564301863 conn(0x7f754c071840 msgr2=0x7f754c09b760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:52.790 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.783+0000 7f7550a68700 1 -- 172.21.15.62:0/564301863 shutdown_connections 2023-06-09T04:41:52.790 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.783+0000 7f7550a68700 1 -- 172.21.15.62:0/564301863 wait complete. 2023-06-09T04:41:52.791 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.787+0000 7f7550a68700 1 Processor -- start 2023-06-09T04:41:52.792 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.787+0000 7f7550a68700 1 -- start start 2023-06-09T04:41:52.793 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.787+0000 7f7550a68700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f754c0b3b20 0x7f754c1f5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:52.793 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.787+0000 7f7550a68700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f754c0cd2e0 0x7f754c0cc150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:52.794 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.787+0000 7f7550a68700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f754c0d1f80 0x7f754c15c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:52.794 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.787+0000 7f7550a68700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f754c0cc690 con 0x7f754c0cd2e0 2023-06-09T04:41:52.794 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.787+0000 7f7550a68700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f754c15c820 con 0x7f754c0b3b20 2023-06-09T04:41:52.795 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.787+0000 7f7550a68700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f754c15ca80 con 0x7f754c0d1f80 2023-06-09T04:41:52.795 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.787+0000 7f754affd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f754c0cd2e0 0x7f754c0cc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:52.795 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.787+0000 7f754affd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f754c0cd2e0 0x7f754c0cc150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:44830/0 (socket says 172.21.15.62:44830) 2023-06-09T04:41:52.795 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.787+0000 7f754bfff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f754c0d1f80 0x7f754c15c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:52.795 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.787+0000 7f754affd700 1 -- 172.21.15.62:0/540665897 learned_addr learned my addr 172.21.15.62:0/540665897 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:52.795 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.787+0000 7f754b7fe700 1 --2- 172.21.15.62:0/540665897 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f754c0b3b20 0x7f754c1f5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:52.796 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.787+0000 7f754affd700 1 -- 172.21.15.62:0/540665897 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f754c0d1f80 msgr2=0x7f754c15c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:52.796 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.787+0000 7f754affd700 1 --2- 172.21.15.62:0/540665897 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f754c0d1f80 0x7f754c15c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:52.796 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.787+0000 7f754affd700 1 -- 172.21.15.62:0/540665897 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f754c0b3b20 msgr2=0x7f754c1f5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:52.797 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.787+0000 7f754affd700 1 --2- 172.21.15.62:0/540665897 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f754c0b3b20 0x7f754c1f5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:52.797 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.787+0000 7f754affd700 1 -- 172.21.15.62:0/540665897 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7544009a70 con 0x7f754c0cd2e0 2023-06-09T04:41:52.797 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.791+0000 7f754affd700 1 --2- 172.21.15.62:0/540665897 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f754c0cd2e0 0x7f754c0cc150 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f754000c730 tx=0x7f754000caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:52.797 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.791+0000 7f7533fff700 1 -- 172.21.15.62:0/540665897 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75400052d0 con 0x7f754c0cd2e0 2023-06-09T04:41:52.797 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.791+0000 7f7533fff700 1 -- 172.21.15.62:0/540665897 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7540005430 con 0x7f754c0cd2e0 2023-06-09T04:41:52.797 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.791+0000 7f7533fff700 1 -- 172.21.15.62:0/540665897 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75400055a0 con 0x7f754c0cd2e0 2023-06-09T04:41:52.797 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.791+0000 7f7550a68700 1 -- 172.21.15.62:0/540665897 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f754c15cd60 con 0x7f754c0cd2e0 2023-06-09T04:41:52.798 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.791+0000 7f7550a68700 1 -- 172.21.15.62:0/540665897 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f754c15d320 con 0x7f754c0cd2e0 2023-06-09T04:41:52.798 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.791+0000 7f7550a68700 1 -- 172.21.15.62:0/540665897 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f754c0739c0 con 0x7f754c0cd2e0 2023-06-09T04:41:52.800 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.795+0000 7f7533fff700 1 -- 172.21.15.62:0/540665897 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f75400038e0 con 0x7f754c0cd2e0 2023-06-09T04:41:52.801 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.795+0000 7f7533fff700 1 --2- 172.21.15.62:0/540665897 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f75380662f0 0x7f75380687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:52.801 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.795+0000 7f7533fff700 1 -- 172.21.15.62:0/540665897 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f75400835b0 con 0x7f754c0cd2e0 2023-06-09T04:41:52.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.795+0000 7f754b7fe700 1 --2- 172.21.15.62:0/540665897 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f75380662f0 0x7f75380687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:52.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.795+0000 7f754b7fe700 1 --2- 172.21.15.62:0/540665897 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f75380662f0 0x7f75380687a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f753c0010e0 tx=0x7f753c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:52.806 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.799+0000 7f7533fff700 1 -- 172.21.15.62:0/540665897 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7540050700 con 0x7f754c0cd2e0 2023-06-09T04:41:52.975 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.971+0000 7f7550a68700 1 -- 172.21.15.62:0/540665897 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f754c0cec90 con 0x7f754c0cd2e0 2023-06-09T04:41:52.976 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.971+0000 7f7533fff700 1 -- 172.21.15.62:0/540665897 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7540053d20 con 0x7f754c0cd2e0 2023-06-09T04:41:52.976 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 64 2023-06-09T04:41:52.981 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.975+0000 7f7550a68700 1 -- 172.21.15.62:0/540665897 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f75380662f0 msgr2=0x7f75380687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:52.981 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.975+0000 7f7550a68700 1 --2- 172.21.15.62:0/540665897 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f75380662f0 0x7f75380687a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f753c0010e0 tx=0x7f753c009040 comp rx=0 tx=0).stop 2023-06-09T04:41:52.981 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.975+0000 7f7550a68700 1 -- 172.21.15.62:0/540665897 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f754c0cd2e0 msgr2=0x7f754c0cc150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:52.981 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.975+0000 7f7550a68700 1 --2- 172.21.15.62:0/540665897 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f754c0cd2e0 0x7f754c0cc150 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f754000c730 tx=0x7f754000caf0 comp rx=0 tx=0).stop 2023-06-09T04:41:52.981 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.975+0000 7f7550a68700 1 -- 172.21.15.62:0/540665897 shutdown_connections 2023-06-09T04:41:52.981 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.975+0000 7f7550a68700 1 --2- 172.21.15.62:0/540665897 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f75380662f0 0x7f75380687a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:52.982 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.975+0000 7f7550a68700 1 --2- 172.21.15.62:0/540665897 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f754c0d1f80 0x7f754c15c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:52.982 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.975+0000 7f7550a68700 1 --2- 172.21.15.62:0/540665897 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f754c0cd2e0 0x7f754c0cc150 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:52.982 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.975+0000 7f7550a68700 1 --2- 172.21.15.62:0/540665897 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f754c0b3b20 0x7f754c1f5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:52.982 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.975+0000 7f7550a68700 1 -- 172.21.15.62:0/540665897 >> 172.21.15.62:0/540665897 conn(0x7f754c071840 msgr2=0x7f754c0cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:52.982 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.975+0000 7f7550a68700 1 -- 172.21.15.62:0/540665897 shutdown_connections 2023-06-09T04:41:52.983 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:52.975+0000 7f7550a68700 1 -- 172.21.15.62:0/540665897 wait complete. 2023-06-09T04:41:53.004 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-09T04:41:53.183 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.175+0000 7f32aee2c700 1 Processor -- start 2023-06-09T04:41:53.183 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.179+0000 7f32aee2c700 1 -- start start 2023-06-09T04:41:53.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.179+0000 7f32aee2c700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f32a8159e10 0x7f32a80b09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:53.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.179+0000 7f32aee2c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f32a815e090 0x7f32a80b2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:53.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.179+0000 7f32aee2c700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32a80cda40 con 0x7f32a815e500 2023-06-09T04:41:53.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.179+0000 7f32aee2c700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32a80cd830 con 0x7f32a8159e10 2023-06-09T04:41:53.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.179+0000 7f32aee2c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32a80cdd20 con 0x7f32a815e090 2023-06-09T04:41:53.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.179+0000 7f32acbc8700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f32a8159e10 0x7f32a80b09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:53.187 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.179+0000 7f32a7fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f32a815e090 0x7f32a80b2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:53.187 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.179+0000 7f32ad3c9700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f32a815e500 0x7f32a80b2ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.62:47900/0 (socket says 172.21.15.62:47900) 2023-06-09T04:41:53.187 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.179+0000 7f32ad3c9700 1 -- 172.21.15.62:0/2986700019 learned_addr learned my addr 172.21.15.62:0/2986700019 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:41:53.188 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.183+0000 7f32acbc8700 1 -- 172.21.15.62:0/2986700019 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f32a815e090 msgr2=0x7f32a80b2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:53.188 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.183+0000 7f32acbc8700 1 --2- 172.21.15.62:0/2986700019 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f32a815e090 0x7f32a80b2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:53.188 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.183+0000 7f32acbc8700 1 -- 172.21.15.62:0/2986700019 >> v1:172.21.15.89:6789/0 conn(0x7f32a815e500 legacy=0x7f32a80b2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:53.188 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.183+0000 7f32a77fe700 1 -- 172.21.15.62:0/2986700019 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 570982333 0 0) 0x7f32a80cda40 con 0x7f32a815e500 2023-06-09T04:41:53.188 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.183+0000 7f32acbc8700 1 -- 172.21.15.62:0/2986700019 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32a815d890 con 0x7f32a8159e10 2023-06-09T04:41:53.189 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.183+0000 7f32acbc8700 1 --2- 172.21.15.62:0/2986700019 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f32a8159e10 0x7f32a80b09b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f329c009850 tx=0x7f329c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b98e599b7b0344f9 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:53.189 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.183+0000 7f32a77fe700 1 -- 172.21.15.62:0/2986700019 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f329c011830 con 0x7f32a8159e10 2023-06-09T04:41:53.189 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.183+0000 7f32a77fe700 1 -- 172.21.15.62:0/2986700019 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f329c011990 con 0x7f32a8159e10 2023-06-09T04:41:53.190 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.183+0000 7f32a77fe700 1 -- 172.21.15.62:0/2986700019 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f329c011d40 con 0x7f32a8159e10 2023-06-09T04:41:53.190 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.183+0000 7f32aee2c700 1 -- 172.21.15.62:0/2986700019 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f32a8159e10 msgr2=0x7f32a80b09b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:53.191 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.183+0000 7f32aee2c700 1 --2- 172.21.15.62:0/2986700019 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f32a8159e10 0x7f32a80b09b0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f329c009850 tx=0x7f329c009b60 comp rx=0 tx=0).stop 2023-06-09T04:41:53.191 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.183+0000 7f32aee2c700 1 -- 172.21.15.62:0/2986700019 shutdown_connections 2023-06-09T04:41:53.191 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.183+0000 7f32aee2c700 1 --2- 172.21.15.62:0/2986700019 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f32a815e090 0x7f32a80b2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:53.191 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.183+0000 7f32aee2c700 1 --2- 172.21.15.62:0/2986700019 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f32a8159e10 0x7f32a80b09b0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:53.191 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.183+0000 7f32aee2c700 1 -- 172.21.15.62:0/2986700019 >> 172.21.15.62:0/2986700019 conn(0x7f32a806c5d0 msgr2=0x7f32a80cad60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:53.191 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.183+0000 7f32aee2c700 1 -- 172.21.15.62:0/2986700019 shutdown_connections 2023-06-09T04:41:53.191 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.183+0000 7f32aee2c700 1 -- 172.21.15.62:0/2986700019 wait complete. 2023-06-09T04:41:53.193 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.187+0000 7f32aee2c700 1 Processor -- start 2023-06-09T04:41:53.194 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.187+0000 7f32aee2c700 1 -- start start 2023-06-09T04:41:53.196 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.191+0000 7f32aee2c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f32a8159e10 0x7f32a81f17a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:53.196 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.191+0000 7f32aee2c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f32a815e090 0x7f32a814b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:53.196 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.191+0000 7f32aee2c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f32a815e500 0x7f32a80707f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:53.196 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.191+0000 7f32aee2c700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32a815bff0 con 0x7f32a8159e10 2023-06-09T04:41:53.197 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.191+0000 7f32aee2c700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32a815b730 con 0x7f32a815e090 2023-06-09T04:41:53.197 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.191+0000 7f32aee2c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32a814bc80 con 0x7f32a815e500 2023-06-09T04:41:53.197 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.191+0000 7f32acbc8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f32a8159e10 0x7f32a81f17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:53.198 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.191+0000 7f32acbc8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f32a8159e10 0x7f32a81f17a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:44834/0 (socket says 172.21.15.62:44834) 2023-06-09T04:41:53.198 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.191+0000 7f32acbc8700 1 -- 172.21.15.62:0/2290767430 learned_addr learned my addr 172.21.15.62:0/2290767430 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:53.198 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.191+0000 7f32a7fff700 1 --2- 172.21.15.62:0/2290767430 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f32a815e090 0x7f32a814b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:53.198 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.191+0000 7f32ad3c9700 1 --2- 172.21.15.62:0/2290767430 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f32a815e500 0x7f32a80707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:53.198 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.191+0000 7f32acbc8700 1 -- 172.21.15.62:0/2290767430 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f32a815e500 msgr2=0x7f32a80707f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:53.198 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.191+0000 7f32acbc8700 1 --2- 172.21.15.62:0/2290767430 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f32a815e500 0x7f32a80707f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:53.198 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.191+0000 7f32acbc8700 1 -- 172.21.15.62:0/2290767430 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f32a815e090 msgr2=0x7f32a814b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:53.199 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.191+0000 7f32acbc8700 1 --2- 172.21.15.62:0/2290767430 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f32a815e090 0x7f32a814b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:53.199 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.191+0000 7f32acbc8700 1 -- 172.21.15.62:0/2290767430 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f329c0094b0 con 0x7f32a8159e10 2023-06-09T04:41:53.199 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.191+0000 7f32a7fff700 1 --2- 172.21.15.62:0/2290767430 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f32a815e090 0x7f32a814b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:41:53.199 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.191+0000 7f32acbc8700 1 --2- 172.21.15.62:0/2290767430 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f32a8159e10 0x7f32a81f17a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f32a8066ce0 tx=0x7f329c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:53.200 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.191+0000 7f32a57fa700 1 -- 172.21.15.62:0/2290767430 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f329c01a990 con 0x7f32a8159e10 2023-06-09T04:41:53.200 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.191+0000 7f32a57fa700 1 -- 172.21.15.62:0/2290767430 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f329c01f070 con 0x7f32a8159e10 2023-06-09T04:41:53.200 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.191+0000 7f32a57fa700 1 -- 172.21.15.62:0/2290767430 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f329c01ad30 con 0x7f32a8159e10 2023-06-09T04:41:53.200 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.191+0000 7f32aee2c700 1 -- 172.21.15.62:0/2290767430 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32a815b9a0 con 0x7f32a8159e10 2023-06-09T04:41:53.200 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.195+0000 7f32aee2c700 1 -- 172.21.15.62:0/2290767430 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32a806fb60 con 0x7f32a8159e10 2023-06-09T04:41:53.201 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.195+0000 7f32aee2c700 1 -- 172.21.15.62:0/2290767430 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32a80b15d0 con 0x7f32a8159e10 2023-06-09T04:41:53.202 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.195+0000 7f32a57fa700 1 -- 172.21.15.62:0/2290767430 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f329c01b430 con 0x7f32a8159e10 2023-06-09T04:41:53.203 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.199+0000 7f32a57fa700 1 --2- 172.21.15.62:0/2290767430 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f328c0662f0 0x7f328c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:53.204 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.199+0000 7f32a57fa700 1 -- 172.21.15.62:0/2290767430 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f329c085040 con 0x7f32a8159e10 2023-06-09T04:41:53.204 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.199+0000 7f32a7fff700 1 --2- 172.21.15.62:0/2290767430 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f328c0662f0 0x7f328c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:53.205 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.199+0000 7f32a7fff700 1 --2- 172.21.15.62:0/2290767430 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f328c0662f0 0x7f328c0687a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f32a8156be0 tx=0x7f3294009240 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:53.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.203+0000 7f32a57fa700 1 -- 172.21.15.62:0/2290767430 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f329c052220 con 0x7f32a8159e10 2023-06-09T04:41:53.383 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.375+0000 7f32aee2c700 1 -- 172.21.15.62:0/2290767430 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f32a80739c0 con 0x7f32a8159e10 2023-06-09T04:41:53.383 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.379+0000 7f32a57fa700 1 -- 172.21.15.62:0/2290767430 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7f329c021020 con 0x7f32a8159e10 2023-06-09T04:41:53.384 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-06-09T04:41:53.386 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.379+0000 7f32aee2c700 1 -- 172.21.15.62:0/2290767430 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f328c0662f0 msgr2=0x7f328c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:53.386 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.379+0000 7f32aee2c700 1 --2- 172.21.15.62:0/2290767430 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f328c0662f0 0x7f328c0687a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f32a8156be0 tx=0x7f3294009240 comp rx=0 tx=0).stop 2023-06-09T04:41:53.386 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.379+0000 7f32aee2c700 1 -- 172.21.15.62:0/2290767430 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f32a8159e10 msgr2=0x7f32a81f17a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:53.386 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.379+0000 7f32aee2c700 1 --2- 172.21.15.62:0/2290767430 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f32a8159e10 0x7f32a81f17a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f32a8066ce0 tx=0x7f329c004770 comp rx=0 tx=0).stop 2023-06-09T04:41:53.387 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.379+0000 7f32aee2c700 1 -- 172.21.15.62:0/2290767430 shutdown_connections 2023-06-09T04:41:53.387 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.379+0000 7f32aee2c700 1 --2- 172.21.15.62:0/2290767430 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f328c0662f0 0x7f328c0687a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:53.387 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.379+0000 7f32aee2c700 1 --2- 172.21.15.62:0/2290767430 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f32a815e500 0x7f32a80707f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:53.388 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.379+0000 7f32aee2c700 1 --2- 172.21.15.62:0/2290767430 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f32a815e090 0x7f32a814b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:53.388 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.379+0000 7f32aee2c700 1 --2- 172.21.15.62:0/2290767430 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f32a8159e10 0x7f32a81f17a0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:53.388 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.379+0000 7f32aee2c700 1 -- 172.21.15.62:0/2290767430 >> 172.21.15.62:0/2290767430 conn(0x7f32a806c5d0 msgr2=0x7f32a80b2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:53.388 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.379+0000 7f32aee2c700 1 -- 172.21.15.62:0/2290767430 shutdown_connections 2023-06-09T04:41:53.388 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.379+0000 7f32aee2c700 1 -- 172.21.15.62:0/2290767430 wait complete. 2023-06-09T04:41:53.408 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:41:53.577 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.571+0000 7f851ea2f700 1 Processor -- start 2023-06-09T04:41:53.577 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.571+0000 7f851ea2f700 1 -- start start 2023-06-09T04:41:53.579 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.571+0000 7f851ea2f700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8518160340 0x7f85180caa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:53.579 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.575+0000 7f851ea2f700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85180cdc20 con 0x7f851815ff70 2023-06-09T04:41:53.579 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.575+0000 7f851ea2f700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85180cd330 con 0x7f85180caf80 2023-06-09T04:41:53.580 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.575+0000 7f851ea2f700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85180cb400 con 0x7f8518160340 2023-06-09T04:41:53.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.575+0000 7f851da2d700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f851815ff70 0x7f85180c9cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:39324/0 (socket says 172.21.15.62:39324) 2023-06-09T04:41:53.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.575+0000 7f851da2d700 1 -- 172.21.15.62:0/1634441943 learned_addr learned my addr 172.21.15.62:0/1634441943 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:41:53.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.575+0000 7f851d22c700 1 --2- 172.21.15.62:0/1634441943 >> v2:172.21.15.89:3300/0 conn(0x7f8518160340 0x7f85180caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:53.583 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.575+0000 7f851ca2b700 1 -- 172.21.15.62:0/1634441943 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4160862460 0 0) 0x7f85180cdc20 con 0x7f851815ff70 2023-06-09T04:41:53.583 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.575+0000 7f851ca2b700 1 -- 172.21.15.62:0/1634441943 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85040035d0 con 0x7f851815ff70 2023-06-09T04:41:53.583 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.575+0000 7f851ca2b700 1 -- 172.21.15.62:0/1634441943 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3136729628 0 0) 0x7f85040035d0 con 0x7f851815ff70 2023-06-09T04:41:53.583 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.575+0000 7f851ca2b700 1 -- 172.21.15.62:0/1634441943 >> v2:172.21.15.89:3300/0 conn(0x7f8518160340 msgr2=0x7f85180caa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:53.583 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.575+0000 7f851ca2b700 1 --2- 172.21.15.62:0/1634441943 >> v2:172.21.15.89:3300/0 conn(0x7f8518160340 0x7f85180caa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:53.583 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.575+0000 7f851ca2b700 1 -- 172.21.15.62:0/1634441943 >> v1:172.21.15.89:6789/0 conn(0x7f85180caf80 legacy=0x7f8518163df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:53.584 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.575+0000 7f851ca2b700 1 -- 172.21.15.62:0/1634441943 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85180cd5d0 con 0x7f851815ff70 2023-06-09T04:41:53.584 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.575+0000 7f851ca2b700 1 -- 172.21.15.62:0/1634441943 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 540845019 0 0) 0x7f8514001670 con 0x7f851815ff70 2023-06-09T04:41:53.584 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.575+0000 7f851ca2b700 1 -- 172.21.15.62:0/1634441943 >> v1:172.21.15.62:6789/0 conn(0x7f851815ff70 legacy=0x7f85180c9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:53.584 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.575+0000 7f851ca2b700 1 --2- 172.21.15.62:0/1634441943 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8504003a20 0x7f8504003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:53.584 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.575+0000 7f851ca2b700 1 --2- 172.21.15.62:0/1634441943 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8504004870 0x7f8504004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:53.584 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.575+0000 7f851ca2b700 1 --2- 172.21.15.62:0/1634441943 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8504005220 0x7f850400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:53.584 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.575+0000 7f851ca2b700 1 -- 172.21.15.62:0/1634441943 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85180cb400 con 0x7f8504003a20 2023-06-09T04:41:53.585 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.575+0000 7f851ca2b700 1 -- 172.21.15.62:0/1634441943 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f850400c190 con 0x7f8504004870 2023-06-09T04:41:53.585 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.575+0000 7f851ca2b700 1 -- 172.21.15.62:0/1634441943 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f850400c350 con 0x7f8504005220 2023-06-09T04:41:53.585 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.575+0000 7f851da2d700 1 --2- 172.21.15.62:0/1634441943 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8504003a20 0x7f8504003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:53.585 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.575+0000 7f851da2d700 1 -- 172.21.15.62:0/1634441943 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8504005220 msgr2=0x7f850400ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:53.585 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.575+0000 7f851da2d700 1 --2- 172.21.15.62:0/1634441943 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8504005220 0x7f850400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:53.585 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.575+0000 7f851da2d700 1 -- 172.21.15.62:0/1634441943 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8504004870 msgr2=0x7f8504004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:53.586 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.575+0000 7f851da2d700 1 --2- 172.21.15.62:0/1634441943 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8504004870 0x7f8504004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:53.586 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.575+0000 7f851da2d700 1 -- 172.21.15.62:0/1634441943 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85040035d0 con 0x7f8504003a20 2023-06-09T04:41:53.586 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.575+0000 7f851e22e700 1 -- 172.21.15.62:0/1634441943 reap_dead start 2023-06-09T04:41:53.586 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.575+0000 7f851da2d700 1 --2- 172.21.15.62:0/1634441943 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8504003a20 0x7f8504003e30 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f851400c320 tx=0x7f85040058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d00910a2c63b288 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:53.587 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.575+0000 7f851ca2b700 1 -- 172.21.15.62:0/1634441943 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8514007c30 con 0x7f8504003a20 2023-06-09T04:41:53.588 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.575+0000 7f851ca2b700 1 -- 172.21.15.62:0/1634441943 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f851400ce80 con 0x7f8504003a20 2023-06-09T04:41:53.588 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.575+0000 7f851ca2b700 1 -- 172.21.15.62:0/1634441943 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8514005bc0 con 0x7f8504003a20 2023-06-09T04:41:53.588 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.575+0000 7f851ea2f700 1 -- 172.21.15.62:0/1634441943 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8504003a20 msgr2=0x7f8504003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:53.588 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.575+0000 7f851ea2f700 1 --2- 172.21.15.62:0/1634441943 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8504003a20 0x7f8504003e30 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f851400c320 tx=0x7f85040058a0 comp rx=0 tx=0).stop 2023-06-09T04:41:53.588 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.579+0000 7f851ea2f700 1 -- 172.21.15.62:0/1634441943 shutdown_connections 2023-06-09T04:41:53.589 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.579+0000 7f851ea2f700 1 --2- 172.21.15.62:0/1634441943 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8504003a20 0x7f8504003e30 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:53.589 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.579+0000 7f851ea2f700 1 -- 172.21.15.62:0/1634441943 >> 172.21.15.62:0/1634441943 conn(0x7f851806a420 msgr2=0x7f85180afc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:53.589 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.579+0000 7f851ea2f700 1 -- 172.21.15.62:0/1634441943 shutdown_connections 2023-06-09T04:41:53.589 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.579+0000 7f851ea2f700 1 -- 172.21.15.62:0/1634441943 wait complete. 2023-06-09T04:41:53.589 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.579+0000 7f851ea2f700 1 Processor -- start 2023-06-09T04:41:53.589 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.579+0000 7f851ea2f700 1 -- start start 2023-06-09T04:41:53.589 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.583+0000 7f851ea2f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85181505f0 0x7f8518154340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:53.590 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.583+0000 7f851ea2f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f85181509c0 0x7f8518070e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:53.590 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.583+0000 7f851ea2f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8518070760 0x7f8518071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:53.590 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.583+0000 7f851ea2f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8518154cb0 con 0x7f85181505f0 2023-06-09T04:41:53.590 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.583+0000 7f851ea2f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8518154f90 con 0x7f8518070760 2023-06-09T04:41:53.590 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.583+0000 7f851ea2f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8518155270 con 0x7f85181509c0 2023-06-09T04:41:53.590 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.583+0000 7f851da2d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85181505f0 0x7f8518154340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:53.590 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.583+0000 7f851da2d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85181505f0 0x7f8518154340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:44858/0 (socket says 172.21.15.62:44858) 2023-06-09T04:41:53.591 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.583+0000 7f851da2d700 1 -- 172.21.15.62:0/2467766315 learned_addr learned my addr 172.21.15.62:0/2467766315 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:53.592 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.583+0000 7f851da2d700 1 -- 172.21.15.62:0/2467766315 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f85181509c0 msgr2=0x7f8518070e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:53.592 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.583+0000 7f851d22c700 1 --2- 172.21.15.62:0/2467766315 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f85181509c0 0x7f8518070e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:53.592 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.583+0000 7f851e22e700 1 --2- 172.21.15.62:0/2467766315 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8518070760 0x7f8518071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:53.593 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.583+0000 7f851da2d700 1 --2- 172.21.15.62:0/2467766315 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f85181509c0 0x7f8518070e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:53.593 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.583+0000 7f851da2d700 1 -- 172.21.15.62:0/2467766315 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8518070760 msgr2=0x7f8518071380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:53.593 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.583+0000 7f851da2d700 1 --2- 172.21.15.62:0/2467766315 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8518070760 0x7f8518071380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:53.593 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.583+0000 7f851da2d700 1 -- 172.21.15.62:0/2467766315 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8518155550 con 0x7f85181505f0 2023-06-09T04:41:53.593 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.583+0000 7f851d22c700 1 --2- 172.21.15.62:0/2467766315 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f85181509c0 0x7f8518070e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:41:53.593 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.583+0000 7f851e22e700 1 --2- 172.21.15.62:0/2467766315 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8518070760 0x7f8518071380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:41:53.593 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.583+0000 7f851da2d700 1 --2- 172.21.15.62:0/2467766315 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85181505f0 0x7f8518154340 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f850400c160 tx=0x7f8514001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:53.594 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.583+0000 7f850e7fc700 1 -- 172.21.15.62:0/2467766315 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85140072d0 con 0x7f85181505f0 2023-06-09T04:41:53.594 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.583+0000 7f850e7fc700 1 -- 172.21.15.62:0/2467766315 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8514007430 con 0x7f85181505f0 2023-06-09T04:41:53.594 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.583+0000 7f850e7fc700 1 -- 172.21.15.62:0/2467766315 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85140077a0 con 0x7f85181505f0 2023-06-09T04:41:53.594 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.583+0000 7f851ea2f700 1 -- 172.21.15.62:0/2467766315 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85180b0f20 con 0x7f85181505f0 2023-06-09T04:41:53.594 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.583+0000 7f851ea2f700 1 -- 172.21.15.62:0/2467766315 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8518154880 con 0x7f85181505f0 2023-06-09T04:41:53.594 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.583+0000 7f851ea2f700 1 -- 172.21.15.62:0/2467766315 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8518070cb0 con 0x7f85181505f0 2023-06-09T04:41:53.594 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.587+0000 7f850e7fc700 1 -- 172.21.15.62:0/2467766315 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f851401d420 con 0x7f85181505f0 2023-06-09T04:41:53.595 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.587+0000 7f850e7fc700 1 --2- 172.21.15.62:0/2467766315 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f84fc0662f0 0x7f84fc0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:53.595 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.587+0000 7f850e7fc700 1 -- 172.21.15.62:0/2467766315 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f8514085180 con 0x7f85181505f0 2023-06-09T04:41:53.595 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.587+0000 7f851d22c700 1 --2- 172.21.15.62:0/2467766315 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f84fc0662f0 0x7f84fc0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:53.596 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.591+0000 7f851d22c700 1 --2- 172.21.15.62:0/2467766315 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f84fc0662f0 0x7f84fc0687a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f85181eab60 tx=0x7f8508008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:53.599 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.591+0000 7f850e7fc700 1 -- 172.21.15.62:0/2467766315 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f85140522c0 con 0x7f85181505f0 2023-06-09T04:41:53.776 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.771+0000 7f851ea2f700 1 -- 172.21.15.62:0/2467766315 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f85180b10b0 con 0x7f85181505f0 2023-06-09T04:41:53.779 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.775+0000 7f850e7fc700 1 -- 172.21.15.62:0/2467766315 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+20180 (secure 0 0 0) 0x7f85140558e0 con 0x7f85181505f0 2023-06-09T04:41:53.780 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:41:53.780 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":30,"fsid":"f7998a1e-e5a9-4202-abaa-70c0eaae1047","created":"2023-06-09T04:40:30.469588+0000","modified":"2023-06-09T04:41:38.495589+0000","last_up_change":"2023-06-09T04:40:43.120747+0000","last_in_change":"2023-06-09T04:40:33.568221+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:40:44.646921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:40:50.006643+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:40:55.031273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:40:55.773517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-09T04:40:58.845383+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bc50bbc0-dd08-42ed-804c-ec3029e36c19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6802","nonce":1295788017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6807","nonce":1295788017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6815","nonce":1295788017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6809","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6811","nonce":1295788017}]},"public_addr":"172.21.15.62:6802/1295788017","cluster_addr":"172.21.15.62:6807/1295788017","heartbeat_back_addr":"172.21.15.62:6815/1295788017","heartbeat_front_addr":"172.21.15.62:6811/1295788017","state":["exists","up"]},{"osd":1,"uuid":"8230b12d-e22f-4985-a584-4cc64404cdbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6825","nonce":4120692006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6827","nonce":4120692006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6831","nonce":4120692006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6829","nonce":4120692006}]},"public_addr":"172.21.15.62:6825/4120692006","cluster_addr":"172.21.15.62:6827/4120692006","heartbeat_back_addr":"172.21.15.62:6831/4120692006","heartbeat_front_addr":"172.21.15.62:6829/4120692006","state":["exists","up"]},{"osd":2,"uuid":"d0202506-dbe9-4e3c-9271-687929abf96a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6801","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6803","nonce":4169607876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6805","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6806","nonce":4169607876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6814","nonce":4169607876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6810","nonce":4169607876}]},"public_addr":"172.21.15.62:6803/4169607876","cluster_addr":"172.21.15.62:6806/4169607876","heartbeat_back_addr":"172.21.15.62:6814/4169607876","heartbeat_front_addr":"172.21.15.62:6810/4169607876","state":["exists","up"]},{"osd":3,"uuid":"f3c0298a-b075-4411-af50-e16cd74fdddb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6817","nonce":3268438986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6819","nonce":3268438986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6823","nonce":3268438986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6821","nonce":3268438986}]},"public_addr":"172.21.15.62:6817/3268438986","cluster_addr":"172.21.15.62:6819/3268438986","heartbeat_back_addr":"172.21.15.62:6823/3268438986","heartbeat_front_addr":"172.21.15.62:6821/3268438986","state":["exists","up"]},{"osd":4,"uuid":"1ab5c5ca-e74f-475a-a309-683cc0029928","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6817","nonce":3139617628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6819","nonce":3139617628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6823","nonce":3139617628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6821","nonce":3139617628}]},"public_addr":"172.21.15.89:6817/3139617628","cluster_addr":"172.21.15.89:6819/3139617628","heartbeat_back_addr":"172.21.15.89:6823/3139617628","heartbeat_front_addr":"172.21.15.89:6821/3139617628","state":["exists","up"]},{"osd":5,"uuid":"a933e184-bd8f-4369-a1ba-a68de53c578c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6825","nonce":2681723596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6827","nonce":2681723596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6831","nonce":2681723596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6829","nonce":2681723596}]},"public_addr":"172.21.15.89:6825/2681723596","cluster_addr":"172.21.15.89:6827/2681723596","heartbeat_back_addr":"172.21.15.89:6831/2681723596","heartbeat_front_addr":"172.21.15.89:6829/2681723596","state":["exists","up"]},{"osd":6,"uuid":"1ed7ad37-2eee-49a6-954c-b537e2b7f0ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6809","nonce":1657136033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6811","nonce":1657136033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6815","nonce":1657136033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6813","nonce":1657136033}]},"public_addr":"172.21.15.89:6809/1657136033","cluster_addr":"172.21.15.89:6811/1657136033","heartbeat_back_addr":"172.21.15.89:6815/1657136033","heartbeat_front_addr":"172.21.15.89:6813/1657136033","state":["exists","up"]},{"osd":7,"uuid":"6ed732e9-33ff-40df-9038-a9f1d1622671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6801","nonce":1710561686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6803","nonce":1710561686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6807","nonce":1710561686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6805","nonce":1710561686}]},"public_addr":"172.21.15.89:6801/1710561686","cluster_addr":"172.21.15.89:6803/1710561686","heartbeat_back_addr":"172.21.15.89:6807/1710561686","heartbeat_front_addr":"172.21.15.89:6805/1710561686","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.335803+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.419788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.179334+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.263310+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.071846+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.375627+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.282277+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.315997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.12","mappings":[{"from":1,"to":2}]},{"pgid":"4.19","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:41:53.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.775+0000 7f851ea2f700 1 -- 172.21.15.62:0/2467766315 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f84fc0662f0 msgr2=0x7f84fc0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:53.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.775+0000 7f851ea2f700 1 --2- 172.21.15.62:0/2467766315 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f84fc0662f0 0x7f84fc0687a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f85181eab60 tx=0x7f8508008040 comp rx=0 tx=0).stop 2023-06-09T04:41:53.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.775+0000 7f851ea2f700 1 -- 172.21.15.62:0/2467766315 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85181505f0 msgr2=0x7f8518154340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:53.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.775+0000 7f851ea2f700 1 --2- 172.21.15.62:0/2467766315 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85181505f0 0x7f8518154340 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f850400c160 tx=0x7f8514001a00 comp rx=0 tx=0).stop 2023-06-09T04:41:53.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.775+0000 7f851ea2f700 1 -- 172.21.15.62:0/2467766315 shutdown_connections 2023-06-09T04:41:53.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.775+0000 7f851ea2f700 1 --2- 172.21.15.62:0/2467766315 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f84fc0662f0 0x7f84fc0687a0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:53.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.775+0000 7f851ea2f700 1 --2- 172.21.15.62:0/2467766315 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8518070760 0x7f8518071380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:53.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.775+0000 7f851ea2f700 1 --2- 172.21.15.62:0/2467766315 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f85181509c0 0x7f8518070e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:53.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.775+0000 7f851ea2f700 1 --2- 172.21.15.62:0/2467766315 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f85181505f0 0x7f8518154340 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:53.784 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.775+0000 7f851ea2f700 1 -- 172.21.15.62:0/2467766315 >> 172.21.15.62:0/2467766315 conn(0x7f8504003a20 msgr2=0x7f85180c4480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:53.784 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.775+0000 7f851ea2f700 1 -- 172.21.15.62:0/2467766315 shutdown_connections 2023-06-09T04:41:53.784 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.775+0000 7f851ea2f700 1 -- 172.21.15.62:0/2467766315 wait complete. 2023-06-09T04:41:53.805 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:40:44.646921+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:40:50.006643+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T04:40:55.031273+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T04:40:55.773517+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-09T04:40:58.845383+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-09T04:41:53.806 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:41:53.989 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.983+0000 7f97b14a6700 1 Processor -- start 2023-06-09T04:41:53.990 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.983+0000 7f97b14a6700 1 -- start start 2023-06-09T04:41:53.991 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.987+0000 7f97b14a6700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f97ac160360 0x7f97ac0ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:53.992 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.987+0000 7f97b14a6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97ac0b0260 0x7f97ac06d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:53.992 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.987+0000 7f97b14a6700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97ac160730 con 0x7f97ac0c8800 2023-06-09T04:41:53.992 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.987+0000 7f97b14a6700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97ac0ca860 con 0x7f97ac160360 2023-06-09T04:41:53.993 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.987+0000 7f97b14a6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97ac0ca580 con 0x7f97ac0b0260 2023-06-09T04:41:53.995 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.987+0000 7f97abfff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f97ac160360 0x7f97ac0ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:53.996 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.987+0000 7f97a37fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f97ac0c8800 0x7f97ac0afb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:39328/0 (socket says 172.21.15.62:39328) 2023-06-09T04:41:53.996 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.987+0000 7f97a37fe700 1 -- 172.21.15.62:0/3000384502 learned_addr learned my addr 172.21.15.62:0/3000384502 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:41:53.996 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.987+0000 7f97b0ca5700 1 --2- 172.21.15.62:0/3000384502 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97ac0b0260 0x7f97ac06d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:53.996 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.987+0000 7f97abfff700 1 -- 172.21.15.62:0/3000384502 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97ac0b0260 msgr2=0x7f97ac06d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:53.996 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.987+0000 7f97abfff700 1 --2- 172.21.15.62:0/3000384502 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97ac0b0260 0x7f97ac06d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:53.996 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.987+0000 7f97abfff700 1 -- 172.21.15.62:0/3000384502 >> v1:172.21.15.62:6789/0 conn(0x7f97ac0c8800 legacy=0x7f97ac0afb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:53.997 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.987+0000 7f97abfff700 1 -- 172.21.15.62:0/3000384502 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97ac0cc070 con 0x7f97ac160360 2023-06-09T04:41:53.997 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.987+0000 7f97ab7fe700 1 -- 172.21.15.62:0/3000384502 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1214754714 0 0) 0x7f97ac160730 con 0x7f97ac0c8800 2023-06-09T04:41:53.997 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.987+0000 7f97abfff700 1 --2- 172.21.15.62:0/3000384502 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97ac160360 0x7f97ac0ccb50 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f979c009850 tx=0x7f979c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7210f1aaa491d808 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:53.997 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.987+0000 7f97ab7fe700 1 -- 172.21.15.62:0/3000384502 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f979c011830 con 0x7f97ac160360 2023-06-09T04:41:53.997 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.987+0000 7f97ab7fe700 1 -- 172.21.15.62:0/3000384502 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f979c011990 con 0x7f97ac160360 2023-06-09T04:41:53.997 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.987+0000 7f97ab7fe700 1 -- 172.21.15.62:0/3000384502 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f979c011d40 con 0x7f97ac160360 2023-06-09T04:41:53.997 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.987+0000 7f97b14a6700 1 -- 172.21.15.62:0/3000384502 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97ac160360 msgr2=0x7f97ac0ccb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:53.998 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.987+0000 7f97b14a6700 1 --2- 172.21.15.62:0/3000384502 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97ac160360 0x7f97ac0ccb50 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f979c009850 tx=0x7f979c009b60 comp rx=0 tx=0).stop 2023-06-09T04:41:53.998 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.991+0000 7f97b14a6700 1 -- 172.21.15.62:0/3000384502 shutdown_connections 2023-06-09T04:41:53.998 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.991+0000 7f97b14a6700 1 --2- 172.21.15.62:0/3000384502 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97ac0b0260 0x7f97ac06d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:53.998 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.991+0000 7f97b14a6700 1 --2- 172.21.15.62:0/3000384502 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97ac160360 0x7f97ac0ccb50 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:53.998 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.991+0000 7f97b14a6700 1 -- 172.21.15.62:0/3000384502 >> 172.21.15.62:0/3000384502 conn(0x7f97ac0cab50 msgr2=0x7f97ac0caf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:53.998 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.991+0000 7f97b14a6700 1 -- 172.21.15.62:0/3000384502 shutdown_connections 2023-06-09T04:41:53.998 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.991+0000 7f97b14a6700 1 -- 172.21.15.62:0/3000384502 wait complete. 2023-06-09T04:41:53.999 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.991+0000 7f97b14a6700 1 Processor -- start 2023-06-09T04:41:53.999 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.991+0000 7f97b14a6700 1 -- start start 2023-06-09T04:41:54.001 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.995+0000 7f97b14a6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97ac0b0260 0x7f97ac1f5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:54.001 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.995+0000 7f97b14a6700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97ac0c8800 0x7f97ac1f90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:54.001 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.995+0000 7f97b14a6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97ac160360 0x7f97ac1f95f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:54.001 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.995+0000 7f97b14a6700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97ac0c6b10 con 0x7f97ac160360 2023-06-09T04:41:54.001 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.995+0000 7f97b14a6700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97ac0c5d50 con 0x7f97ac0c8800 2023-06-09T04:41:54.002 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.995+0000 7f97b14a6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97ac0c6030 con 0x7f97ac0b0260 2023-06-09T04:41:54.002 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.995+0000 7f97b0ca5700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97ac160360 0x7f97ac1f95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:54.002 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.995+0000 7f97b0ca5700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97ac160360 0x7f97ac1f95f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:44886/0 (socket says 172.21.15.62:44886) 2023-06-09T04:41:54.002 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.995+0000 7f97b0ca5700 1 -- 172.21.15.62:0/2165983111 learned_addr learned my addr 172.21.15.62:0/2165983111 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:54.003 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.995+0000 7f97abfff700 1 --2- 172.21.15.62:0/2165983111 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97ac0b0260 0x7f97ac1f5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:54.003 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.995+0000 7f97a37fe700 1 --2- 172.21.15.62:0/2165983111 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97ac0c8800 0x7f97ac1f90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:54.004 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.995+0000 7f97b0ca5700 1 -- 172.21.15.62:0/2165983111 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97ac0b0260 msgr2=0x7f97ac1f5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:54.004 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.995+0000 7f97b0ca5700 1 --2- 172.21.15.62:0/2165983111 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97ac0b0260 0x7f97ac1f5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:54.004 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.995+0000 7f97b0ca5700 1 -- 172.21.15.62:0/2165983111 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97ac0c8800 msgr2=0x7f97ac1f90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:54.005 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.995+0000 7f97b0ca5700 1 --2- 172.21.15.62:0/2165983111 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97ac0c8800 0x7f97ac1f90b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:54.005 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.995+0000 7f97b0ca5700 1 -- 172.21.15.62:0/2165983111 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f979c0094b0 con 0x7f97ac160360 2023-06-09T04:41:54.005 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.995+0000 7f97b0ca5700 1 --2- 172.21.15.62:0/2165983111 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97ac160360 0x7f97ac1f95f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f97a400e780 tx=0x7f97a400ea90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:54.005 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.995+0000 7f97a97fa700 1 -- 172.21.15.62:0/2165983111 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a4013680 con 0x7f97ac160360 2023-06-09T04:41:54.005 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.995+0000 7f97a97fa700 1 -- 172.21.15.62:0/2165983111 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97a40137e0 con 0x7f97ac160360 2023-06-09T04:41:54.005 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.995+0000 7f97b14a6700 1 -- 172.21.15.62:0/2165983111 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97ac0c6310 con 0x7f97ac160360 2023-06-09T04:41:54.005 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.995+0000 7f97a97fa700 1 -- 172.21.15.62:0/2165983111 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a4013b70 con 0x7f97ac160360 2023-06-09T04:41:54.006 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.995+0000 7f97b14a6700 1 -- 172.21.15.62:0/2165983111 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97ac1f5960 con 0x7f97ac160360 2023-06-09T04:41:54.007 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.999+0000 7f97b14a6700 1 -- 172.21.15.62:0/2165983111 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97ac0c6830 con 0x7f97ac160360 2023-06-09T04:41:54.007 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:53.999+0000 7f97a97fa700 1 -- 172.21.15.62:0/2165983111 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f97a4013cd0 con 0x7f97ac160360 2023-06-09T04:41:54.009 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.003+0000 7f97a97fa700 1 --2- 172.21.15.62:0/2165983111 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f978c0662f0 0x7f978c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:54.009 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.003+0000 7f97a97fa700 1 -- 172.21.15.62:0/2165983111 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f97a4083e70 con 0x7f97ac160360 2023-06-09T04:41:54.010 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.003+0000 7f97abfff700 1 --2- 172.21.15.62:0/2165983111 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f978c0662f0 0x7f978c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:54.011 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.007+0000 7f97abfff700 1 --2- 172.21.15.62:0/2165983111 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f978c0662f0 0x7f978c0687a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f979c009ba0 tx=0x7f979c008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:54.014 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.007+0000 7f97a97fa700 1 -- 172.21.15.62:0/2165983111 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f97ac0c6830 con 0x7f97ac160360 2023-06-09T04:41:54.187 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.183+0000 7f97b14a6700 1 -- 172.21.15.62:0/2165983111 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f97ac0c6830 con 0x7f97ac160360 2023-06-09T04:41:54.188 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.183+0000 7f97a97fa700 1 -- 172.21.15.62:0/2165983111 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f97ac0c6830 con 0x7f97ac160360 2023-06-09T04:41:54.189 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2023-06-09T04:41:54.192 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.187+0000 7f97b14a6700 1 -- 172.21.15.62:0/2165983111 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f978c0662f0 msgr2=0x7f978c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:54.193 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.187+0000 7f97b14a6700 1 --2- 172.21.15.62:0/2165983111 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f978c0662f0 0x7f978c0687a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f979c009ba0 tx=0x7f979c008030 comp rx=0 tx=0).stop 2023-06-09T04:41:54.193 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.187+0000 7f97b14a6700 1 -- 172.21.15.62:0/2165983111 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97ac160360 msgr2=0x7f97ac1f95f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:54.193 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.187+0000 7f97b14a6700 1 --2- 172.21.15.62:0/2165983111 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97ac160360 0x7f97ac1f95f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f97a400e780 tx=0x7f97a400ea90 comp rx=0 tx=0).stop 2023-06-09T04:41:54.194 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.187+0000 7f97b14a6700 1 -- 172.21.15.62:0/2165983111 shutdown_connections 2023-06-09T04:41:54.194 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.187+0000 7f97b14a6700 1 --2- 172.21.15.62:0/2165983111 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f978c0662f0 0x7f978c0687a0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:54.194 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.187+0000 7f97b14a6700 1 --2- 172.21.15.62:0/2165983111 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97ac160360 0x7f97ac1f95f0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:54.194 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.187+0000 7f97b14a6700 1 --2- 172.21.15.62:0/2165983111 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97ac0c8800 0x7f97ac1f90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:54.194 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.187+0000 7f97b14a6700 1 --2- 172.21.15.62:0/2165983111 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97ac0b0260 0x7f97ac1f5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:54.194 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.187+0000 7f97b14a6700 1 -- 172.21.15.62:0/2165983111 >> 172.21.15.62:0/2165983111 conn(0x7f97ac0cab50 msgr2=0x7f97ac15f250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:54.195 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.187+0000 7f97b14a6700 1 -- 172.21.15.62:0/2165983111 shutdown_connections 2023-06-09T04:41:54.195 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.187+0000 7f97b14a6700 1 -- 172.21.15.62:0/2165983111 wait complete. 2023-06-09T04:41:54.215 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:41:54.390 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.383+0000 7f7d4a02f700 1 Processor -- start 2023-06-09T04:41:54.391 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.387+0000 7f7d4a02f700 1 -- start start 2023-06-09T04:41:54.394 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.387+0000 7f7d4a02f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d440cd2e0 0x7f7d440b3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:54.394 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.387+0000 7f7d4a02f700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f7d440cebf0 0x7f7d440d0250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:54.394 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.387+0000 7f7d4a02f700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d440b4d50 con 0x7f7d440d1f80 2023-06-09T04:41:54.394 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.387+0000 7f7d4a02f700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d440cf050 con 0x7f7d440cebf0 2023-06-09T04:41:54.394 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.387+0000 7f7d4a02f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d440b4140 con 0x7f7d440cd2e0 2023-06-09T04:41:54.395 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.387+0000 7f7d4902d700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f7d440d1f80 0x7f7d440ccbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:39340/0 (socket says 172.21.15.62:39340) 2023-06-09T04:41:54.395 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.387+0000 7f7d4902d700 1 -- 172.21.15.62:0/2317128201 learned_addr learned my addr 172.21.15.62:0/2317128201 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:41:54.395 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.387+0000 7f7d4882c700 1 --2- 172.21.15.62:0/2317128201 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d440cd2e0 0x7f7d440b3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:54.396 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.387+0000 7f7d4982e700 1 --2- 172.21.15.62:0/2317128201 >> v2:172.21.15.89:3300/0 conn(0x7f7d440cebf0 0x7f7d440d0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:54.396 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.391+0000 7f7d3bfff700 1 -- 172.21.15.62:0/2317128201 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3300909703 0 0) 0x7f7d440b4d50 con 0x7f7d440d1f80 2023-06-09T04:41:54.396 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.391+0000 7f7d3bfff700 1 -- 172.21.15.62:0/2317128201 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d300035d0 con 0x7f7d440d1f80 2023-06-09T04:41:54.396 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.391+0000 7f7d4882c700 1 -- 172.21.15.62:0/2317128201 >> v2:172.21.15.89:3300/0 conn(0x7f7d440cebf0 msgr2=0x7f7d440d0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:54.397 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.391+0000 7f7d4882c700 1 --2- 172.21.15.62:0/2317128201 >> v2:172.21.15.89:3300/0 conn(0x7f7d440cebf0 0x7f7d440d0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:54.397 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.391+0000 7f7d4882c700 1 -- 172.21.15.62:0/2317128201 >> v1:172.21.15.62:6789/0 conn(0x7f7d440d1f80 legacy=0x7f7d440ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:54.397 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.391+0000 7f7d4882c700 1 -- 172.21.15.62:0/2317128201 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d440b4420 con 0x7f7d440cd2e0 2023-06-09T04:41:54.397 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.391+0000 7f7d4882c700 1 --2- 172.21.15.62:0/2317128201 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d440cd2e0 0x7f7d440b3b20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7d34009850 tx=0x7f7d34009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=642bc5f25af3bcf2 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:54.397 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.391+0000 7f7d3bfff700 1 -- 172.21.15.62:0/2317128201 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d34011830 con 0x7f7d440cd2e0 2023-06-09T04:41:54.398 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.391+0000 7f7d3bfff700 1 -- 172.21.15.62:0/2317128201 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d34011990 con 0x7f7d440cd2e0 2023-06-09T04:41:54.398 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.391+0000 7f7d3bfff700 1 -- 172.21.15.62:0/2317128201 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d34011d40 con 0x7f7d440cd2e0 2023-06-09T04:41:54.399 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.391+0000 7f7d4a02f700 1 -- 172.21.15.62:0/2317128201 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d440cd2e0 msgr2=0x7f7d440b3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:54.399 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.391+0000 7f7d4a02f700 1 --2- 172.21.15.62:0/2317128201 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d440cd2e0 0x7f7d440b3b20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7d34009850 tx=0x7f7d34009b60 comp rx=0 tx=0).stop 2023-06-09T04:41:54.399 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.391+0000 7f7d4a02f700 1 -- 172.21.15.62:0/2317128201 shutdown_connections 2023-06-09T04:41:54.399 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.391+0000 7f7d4a02f700 1 --2- 172.21.15.62:0/2317128201 >> v2:172.21.15.89:3300/0 conn(0x7f7d440cebf0 0x7f7d440d0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:54.399 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.391+0000 7f7d4a02f700 1 --2- 172.21.15.62:0/2317128201 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d440cd2e0 0x7f7d440b3b20 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:54.399 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.391+0000 7f7d4a02f700 1 -- 172.21.15.62:0/2317128201 >> 172.21.15.62:0/2317128201 conn(0x7f7d44071840 msgr2=0x7f7d4409b760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:54.399 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.391+0000 7f7d4a02f700 1 -- 172.21.15.62:0/2317128201 shutdown_connections 2023-06-09T04:41:54.400 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.391+0000 7f7d4a02f700 1 -- 172.21.15.62:0/2317128201 wait complete. 2023-06-09T04:41:54.402 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.395+0000 7f7d4a02f700 1 Processor -- start 2023-06-09T04:41:54.402 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.395+0000 7f7d4a02f700 1 -- start start 2023-06-09T04:41:54.404 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.399+0000 7f7d4a02f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d440cd2e0 0x7f7d4415e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:54.404 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.399+0000 7f7d4a02f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7d440cebf0 0x7f7d441515a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:54.404 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.399+0000 7f7d4a02f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d440d1f80 0x7f7d44151ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:54.405 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.399+0000 7f7d4a02f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4415dc40 con 0x7f7d440cebf0 2023-06-09T04:41:54.405 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.399+0000 7f7d4a02f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4415d030 con 0x7f7d440d1f80 2023-06-09T04:41:54.405 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.399+0000 7f7d4a02f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4415d310 con 0x7f7d440cd2e0 2023-06-09T04:41:54.406 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.399+0000 7f7d4882c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7d440cebf0 0x7f7d441515a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:54.406 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.399+0000 7f7d4882c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7d440cebf0 0x7f7d441515a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:44902/0 (socket says 172.21.15.62:44902) 2023-06-09T04:41:54.406 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.399+0000 7f7d4882c700 1 -- 172.21.15.62:0/2815490842 learned_addr learned my addr 172.21.15.62:0/2815490842 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:54.406 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.399+0000 7f7d4902d700 1 --2- 172.21.15.62:0/2815490842 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d440cd2e0 0x7f7d4415e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:54.406 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.399+0000 7f7d4982e700 1 --2- 172.21.15.62:0/2815490842 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d440d1f80 0x7f7d44151ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:54.406 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.399+0000 7f7d4882c700 1 -- 172.21.15.62:0/2815490842 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d440cd2e0 msgr2=0x7f7d4415e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:54.407 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.399+0000 7f7d4882c700 1 --2- 172.21.15.62:0/2815490842 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d440cd2e0 0x7f7d4415e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:54.407 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.399+0000 7f7d4882c700 1 -- 172.21.15.62:0/2815490842 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d440d1f80 msgr2=0x7f7d44151ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:54.407 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.399+0000 7f7d4882c700 1 --2- 172.21.15.62:0/2815490842 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d440d1f80 0x7f7d44151ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:54.407 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.399+0000 7f7d4882c700 1 -- 172.21.15.62:0/2815490842 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d340094b0 con 0x7f7d440cebf0 2023-06-09T04:41:54.407 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.399+0000 7f7d4882c700 1 --2- 172.21.15.62:0/2815490842 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7d440cebf0 0x7f7d441515a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7d340090b0 tx=0x7f7d34004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:54.408 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.399+0000 7f7d39ffb700 1 -- 172.21.15.62:0/2815490842 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d34004480 con 0x7f7d440cebf0 2023-06-09T04:41:54.408 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.399+0000 7f7d4a02f700 1 -- 172.21.15.62:0/2815490842 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d4415d5f0 con 0x7f7d440cebf0 2023-06-09T04:41:54.408 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.399+0000 7f7d39ffb700 1 -- 172.21.15.62:0/2815490842 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d3401f070 con 0x7f7d440cebf0 2023-06-09T04:41:54.408 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.399+0000 7f7d39ffb700 1 -- 172.21.15.62:0/2815490842 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d34003900 con 0x7f7d440cebf0 2023-06-09T04:41:54.408 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.399+0000 7f7d4a02f700 1 -- 172.21.15.62:0/2815490842 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d4415eec0 con 0x7f7d440cebf0 2023-06-09T04:41:54.409 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.403+0000 7f7d4a02f700 1 -- 172.21.15.62:0/2815490842 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d4415ddf0 con 0x7f7d440cebf0 2023-06-09T04:41:54.410 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.403+0000 7f7d39ffb700 1 -- 172.21.15.62:0/2815490842 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7d34021030 con 0x7f7d440cebf0 2023-06-09T04:41:54.412 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.407+0000 7f7d39ffb700 1 --2- 172.21.15.62:0/2815490842 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f7d28066320 0x7f7d280687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:54.413 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.407+0000 7f7d39ffb700 1 -- 172.21.15.62:0/2815490842 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7d34085520 con 0x7f7d440cebf0 2023-06-09T04:41:54.413 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.407+0000 7f7d4902d700 1 --2- 172.21.15.62:0/2815490842 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f7d28066320 0x7f7d280687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:54.414 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.407+0000 7f7d4902d700 1 --2- 172.21.15.62:0/2815490842 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f7d28066320 0x7f7d280687d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7d400010e0 tx=0x7f7d40009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:54.418 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.411+0000 7f7d39ffb700 1 -- 172.21.15.62:0/2815490842 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7d4415ddf0 con 0x7f7d440cebf0 2023-06-09T04:41:54.592 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.587+0000 7f7d4a02f700 1 -- 172.21.15.62:0/2815490842 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7d440739c0 con 0x7f7d440cebf0 2023-06-09T04:41:54.593 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.587+0000 7f7d39ffb700 1 -- 172.21.15.62:0/2815490842 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7d34052700 con 0x7f7d440cebf0 2023-06-09T04:41:54.593 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2023-06-09T04:41:54.596 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.591+0000 7f7d4a02f700 1 -- 172.21.15.62:0/2815490842 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f7d28066320 msgr2=0x7f7d280687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:54.596 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.591+0000 7f7d4a02f700 1 --2- 172.21.15.62:0/2815490842 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f7d28066320 0x7f7d280687d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7d400010e0 tx=0x7f7d40009040 comp rx=0 tx=0).stop 2023-06-09T04:41:54.596 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.591+0000 7f7d4a02f700 1 -- 172.21.15.62:0/2815490842 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7d440cebf0 msgr2=0x7f7d441515a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:54.596 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.591+0000 7f7d4a02f700 1 --2- 172.21.15.62:0/2815490842 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7d440cebf0 0x7f7d441515a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7d340090b0 tx=0x7f7d34004770 comp rx=0 tx=0).stop 2023-06-09T04:41:54.596 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.591+0000 7f7d4a02f700 1 -- 172.21.15.62:0/2815490842 shutdown_connections 2023-06-09T04:41:54.597 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.591+0000 7f7d4a02f700 1 --2- 172.21.15.62:0/2815490842 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f7d28066320 0x7f7d280687d0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:54.597 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.591+0000 7f7d4a02f700 1 --2- 172.21.15.62:0/2815490842 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7d440d1f80 0x7f7d44151ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:54.597 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.591+0000 7f7d4a02f700 1 --2- 172.21.15.62:0/2815490842 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7d440cebf0 0x7f7d441515a0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:54.597 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.591+0000 7f7d4a02f700 1 --2- 172.21.15.62:0/2815490842 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7d440cd2e0 0x7f7d4415e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:54.597 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.591+0000 7f7d4a02f700 1 -- 172.21.15.62:0/2815490842 >> 172.21.15.62:0/2815490842 conn(0x7f7d44071840 msgr2=0x7f7d440cf190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:54.597 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.591+0000 7f7d4a02f700 1 -- 172.21.15.62:0/2815490842 shutdown_connections 2023-06-09T04:41:54.597 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.591+0000 7f7d4a02f700 1 -- 172.21.15.62:0/2815490842 wait complete. 2023-06-09T04:41:54.617 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T04:41:54.799 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.795+0000 7f582d71a700 1 Processor -- start 2023-06-09T04:41:54.800 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.795+0000 7f582d71a700 1 -- start start 2023-06-09T04:41:54.801 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.795+0000 7f582d71a700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5828160360 0x7f58280ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:54.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.795+0000 7f582d71a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58280c8800 0x7f582806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:54.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.795+0000 7f582d71a700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5828160730 con 0x7f58280afb50 2023-06-09T04:41:54.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.795+0000 7f582d71a700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58280ca860 con 0x7f5828160360 2023-06-09T04:41:54.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.795+0000 7f582d71a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58280ca580 con 0x7f58280c8800 2023-06-09T04:41:54.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.795+0000 7f58277fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f58280afb50 0x7f58280705b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:39356/0 (socket says 172.21.15.62:39356) 2023-06-09T04:41:54.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.795+0000 7f58277fe700 1 -- 172.21.15.62:0/2563645330 learned_addr learned my addr 172.21.15.62:0/2563645330 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:41:54.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.795+0000 7f5826ffd700 1 --2- 172.21.15.62:0/2563645330 >> v2:172.21.15.62:3300/0 conn(0x7f5828160360 0x7f58280ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:54.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.795+0000 7f58267fc700 1 --2- 172.21.15.62:0/2563645330 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58280c8800 0x7f582806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:54.804 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.799+0000 7f5825ffb700 1 -- 172.21.15.62:0/2563645330 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1799276741 0 0) 0x7f5828160730 con 0x7f58280afb50 2023-06-09T04:41:54.804 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.799+0000 7f5825ffb700 1 -- 172.21.15.62:0/2563645330 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58100035d0 con 0x7f58280afb50 2023-06-09T04:41:54.804 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.799+0000 7f58267fc700 1 -- 172.21.15.62:0/2563645330 >> v2:172.21.15.62:3300/0 conn(0x7f5828160360 msgr2=0x7f58280ccb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:54.804 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.799+0000 7f58267fc700 1 --2- 172.21.15.62:0/2563645330 >> v2:172.21.15.62:3300/0 conn(0x7f5828160360 0x7f58280ccb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:54.805 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.799+0000 7f58267fc700 1 -- 172.21.15.62:0/2563645330 >> v1:172.21.15.62:6789/0 conn(0x7f58280afb50 legacy=0x7f58280705b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:54.805 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.799+0000 7f58267fc700 1 -- 172.21.15.62:0/2563645330 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58280cc070 con 0x7f58280c8800 2023-06-09T04:41:54.805 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.799+0000 7f5826ffd700 1 --2- 172.21.15.62:0/2563645330 >> v2:172.21.15.62:3300/0 conn(0x7f5828160360 0x7f58280ccb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:41:54.805 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.799+0000 7f58267fc700 1 --2- 172.21.15.62:0/2563645330 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58280c8800 0x7f582806d4b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f581c009850 tx=0x7f581c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2c7ff49a575c008 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:54.806 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.799+0000 7f5825ffb700 1 -- 172.21.15.62:0/2563645330 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f581c011830 con 0x7f58280c8800 2023-06-09T04:41:54.806 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.799+0000 7f5825ffb700 1 -- 172.21.15.62:0/2563645330 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f581c011990 con 0x7f58280c8800 2023-06-09T04:41:54.806 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.799+0000 7f5825ffb700 1 -- 172.21.15.62:0/2563645330 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f581c011d40 con 0x7f58280c8800 2023-06-09T04:41:54.806 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.799+0000 7f582d71a700 1 -- 172.21.15.62:0/2563645330 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58280c8800 msgr2=0x7f582806d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:54.807 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.799+0000 7f582d71a700 1 --2- 172.21.15.62:0/2563645330 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58280c8800 0x7f582806d4b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f581c009850 tx=0x7f581c009b60 comp rx=0 tx=0).stop 2023-06-09T04:41:54.807 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.799+0000 7f582d71a700 1 -- 172.21.15.62:0/2563645330 shutdown_connections 2023-06-09T04:41:54.807 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.799+0000 7f582d71a700 1 --2- 172.21.15.62:0/2563645330 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f58280c8800 0x7f582806d4b0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:54.807 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.799+0000 7f582d71a700 1 --2- 172.21.15.62:0/2563645330 >> v2:172.21.15.62:3300/0 conn(0x7f5828160360 0x7f58280ccb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:54.807 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.799+0000 7f582d71a700 1 -- 172.21.15.62:0/2563645330 >> 172.21.15.62:0/2563645330 conn(0x7f58280cab50 msgr2=0x7f58280caf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:54.807 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.799+0000 7f582d71a700 1 -- 172.21.15.62:0/2563645330 shutdown_connections 2023-06-09T04:41:54.808 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.799+0000 7f582d71a700 1 -- 172.21.15.62:0/2563645330 wait complete. 2023-06-09T04:41:54.811 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.803+0000 7f582d71a700 1 Processor -- start 2023-06-09T04:41:54.811 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.807+0000 7f582d71a700 1 -- start start 2023-06-09T04:41:54.812 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.807+0000 7f582d71a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58280afb50 0x7f58280c6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:54.812 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.807+0000 7f582d71a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58280c8800 0x7f58280aef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:54.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.807+0000 7f582d71a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5828160360 0x7f58280af470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:54.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.807+0000 7f582d71a700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58280c1c00 con 0x7f58280c8800 2023-06-09T04:41:54.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.807+0000 7f582d71a700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58280c24a0 con 0x7f58280afb50 2023-06-09T04:41:54.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.807+0000 7f582d71a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f582814e0d0 con 0x7f5828160360 2023-06-09T04:41:54.814 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.807+0000 7f58267fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58280c8800 0x7f58280aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:54.814 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.807+0000 7f58267fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58280c8800 0x7f58280aef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:44922/0 (socket says 172.21.15.62:44922) 2023-06-09T04:41:54.814 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.807+0000 7f58267fc700 1 -- 172.21.15.62:0/2698922527 learned_addr learned my addr 172.21.15.62:0/2698922527 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:54.814 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.807+0000 7f5826ffd700 1 --2- 172.21.15.62:0/2698922527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58280afb50 0x7f58280c6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:54.814 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.807+0000 7f58277fe700 1 --2- 172.21.15.62:0/2698922527 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5828160360 0x7f58280af470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:54.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.807+0000 7f58267fc700 1 -- 172.21.15.62:0/2698922527 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5828160360 msgr2=0x7f58280af470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:54.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.807+0000 7f58267fc700 1 --2- 172.21.15.62:0/2698922527 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5828160360 0x7f58280af470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:54.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.807+0000 7f58267fc700 1 -- 172.21.15.62:0/2698922527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58280afb50 msgr2=0x7f58280c6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:54.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.807+0000 7f58267fc700 1 --2- 172.21.15.62:0/2698922527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58280afb50 0x7f58280c6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:54.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.807+0000 7f58267fc700 1 -- 172.21.15.62:0/2698922527 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58180094b0 con 0x7f58280c8800 2023-06-09T04:41:54.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.807+0000 7f58267fc700 1 --2- 172.21.15.62:0/2698922527 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58280c8800 0x7f58280aef30 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f581c0090b0 tx=0x7f581c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:54.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.807+0000 7f580f7fe700 1 -- 172.21.15.62:0/2698922527 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f581c004380 con 0x7f58280c8800 2023-06-09T04:41:54.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.807+0000 7f580f7fe700 1 -- 172.21.15.62:0/2698922527 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f581c01f070 con 0x7f58280c8800 2023-06-09T04:41:54.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.807+0000 7f580f7fe700 1 -- 172.21.15.62:0/2698922527 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f581c0036c0 con 0x7f58280c8800 2023-06-09T04:41:54.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.811+0000 7f582d71a700 1 -- 172.21.15.62:0/2698922527 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f581c0094b0 con 0x7f58280c8800 2023-06-09T04:41:54.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.811+0000 7f582d71a700 1 -- 172.21.15.62:0/2698922527 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58280c1de0 con 0x7f58280c8800 2023-06-09T04:41:54.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.811+0000 7f582d71a700 1 -- 172.21.15.62:0/2698922527 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58280c25e0 con 0x7f58280c8800 2023-06-09T04:41:54.819 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.815+0000 7f580f7fe700 1 -- 172.21.15.62:0/2698922527 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f581c021030 con 0x7f58280c8800 2023-06-09T04:41:54.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.815+0000 7f580f7fe700 1 --2- 172.21.15.62:0/2698922527 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f58140662f0 0x7f58140687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:54.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.815+0000 7f580f7fe700 1 -- 172.21.15.62:0/2698922527 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f581c0853d0 con 0x7f58280c8800 2023-06-09T04:41:54.822 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.815+0000 7f5826ffd700 1 --2- 172.21.15.62:0/2698922527 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f58140662f0 0x7f58140687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:54.823 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.819+0000 7f5826ffd700 1 --2- 172.21.15.62:0/2698922527 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f58140662f0 0x7f58140687a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5818009d80 tx=0x7f5818009240 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:54.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.823+0000 7f580f7fe700 1 -- 172.21.15.62:0/2698922527 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f58280c25e0 con 0x7f58280c8800 2023-06-09T04:41:55.002 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.995+0000 7f582d71a700 1 -- 172.21.15.62:0/2698922527 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f58280c25e0 con 0x7f58280c8800 2023-06-09T04:41:55.003 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.999+0000 7f580f7fe700 1 -- 172.21.15.62:0/2698922527 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7f58280c25e0 con 0x7f58280c8800 2023-06-09T04:41:55.003 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-06-09T04:41:55.006 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.999+0000 7f582d71a700 1 -- 172.21.15.62:0/2698922527 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f58140662f0 msgr2=0x7f58140687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:55.006 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.999+0000 7f582d71a700 1 --2- 172.21.15.62:0/2698922527 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f58140662f0 0x7f58140687a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5818009d80 tx=0x7f5818009240 comp rx=0 tx=0).stop 2023-06-09T04:41:55.006 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.999+0000 7f582d71a700 1 -- 172.21.15.62:0/2698922527 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58280c8800 msgr2=0x7f58280aef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:55.006 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.999+0000 7f582d71a700 1 --2- 172.21.15.62:0/2698922527 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58280c8800 0x7f58280aef30 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f581c0090b0 tx=0x7f581c004770 comp rx=0 tx=0).stop 2023-06-09T04:41:55.007 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.999+0000 7f582d71a700 1 -- 172.21.15.62:0/2698922527 shutdown_connections 2023-06-09T04:41:55.007 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.999+0000 7f582d71a700 1 --2- 172.21.15.62:0/2698922527 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f58140662f0 0x7f58140687a0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:55.007 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.999+0000 7f582d71a700 1 --2- 172.21.15.62:0/2698922527 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5828160360 0x7f58280af470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:55.007 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.999+0000 7f582d71a700 1 --2- 172.21.15.62:0/2698922527 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58280c8800 0x7f58280aef30 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:55.007 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.999+0000 7f582d71a700 1 --2- 172.21.15.62:0/2698922527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58280afb50 0x7f58280c6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:55.008 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.999+0000 7f582d71a700 1 -- 172.21.15.62:0/2698922527 >> 172.21.15.62:0/2698922527 conn(0x7f58280cab50 msgr2=0x7f582806f5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:55.008 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.999+0000 7f582d71a700 1 -- 172.21.15.62:0/2698922527 shutdown_connections 2023-06-09T04:41:55.008 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:54.999+0000 7f582d71a700 1 -- 172.21.15.62:0/2698922527 wait complete. 2023-06-09T04:41:55.028 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T04:41:55.212 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.207+0000 7fee9759e700 1 Processor -- start 2023-06-09T04:41:55.213 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.207+0000 7fee9759e700 1 -- start start 2023-06-09T04:41:55.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.207+0000 7fee9759e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fee98071730 0x7fee9806f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:55.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.207+0000 7fee9759e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fee980ca1c0 0x7fee980afb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:55.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.207+0000 7fee9759e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee980b04f0 con 0x7fee980b0090 2023-06-09T04:41:55.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.207+0000 7fee9759e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee9815d860 con 0x7fee98071730 2023-06-09T04:41:55.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.211+0000 7fee9759e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee98071b00 con 0x7fee980ca1c0 2023-06-09T04:41:55.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.211+0000 7fee9659c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fee98071730 0x7fee9806f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:55.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.211+0000 7fee9659c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fee98071730 0x7fee9806f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:44924/0 (socket says 172.21.15.62:44924) 2023-06-09T04:41:55.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.211+0000 7fee9659c700 1 -- 172.21.15.62:0/1718247674 learned_addr learned my addr 172.21.15.62:0/1718247674 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:55.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.211+0000 7fee95d9b700 1 --2- 172.21.15.62:0/1718247674 >> v2:172.21.15.89:3300/0 conn(0x7fee980ca1c0 0x7fee980afb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:55.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.211+0000 7fee9659c700 1 -- 172.21.15.62:0/1718247674 >> v2:172.21.15.89:3300/0 conn(0x7fee980ca1c0 msgr2=0x7fee980afb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:55.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.211+0000 7fee9659c700 1 --2- 172.21.15.62:0/1718247674 >> v2:172.21.15.89:3300/0 conn(0x7fee980ca1c0 0x7fee980afb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:55.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.211+0000 7fee9659c700 1 -- 172.21.15.62:0/1718247674 >> v1:172.21.15.89:6789/0 conn(0x7fee980b0090 legacy=0x7fee980cbfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:55.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.211+0000 7fee9659c700 1 -- 172.21.15.62:0/1718247674 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee9815dab0 con 0x7fee98071730 2023-06-09T04:41:55.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.211+0000 7fee9659c700 1 --2- 172.21.15.62:0/1718247674 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee98071730 0x7fee9806f610 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fee9806f110 tx=0x7fee88009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65ed6093ef0b5794 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:55.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.211+0000 7fee9559a700 1 -- 172.21.15.62:0/1718247674 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee88011830 con 0x7fee98071730 2023-06-09T04:41:55.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.211+0000 7fee9559a700 1 -- 172.21.15.62:0/1718247674 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee88011990 con 0x7fee98071730 2023-06-09T04:41:55.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.211+0000 7fee9559a700 1 -- 172.21.15.62:0/1718247674 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee88011d20 con 0x7fee98071730 2023-06-09T04:41:55.219 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.211+0000 7fee9759e700 1 -- 172.21.15.62:0/1718247674 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee98071730 msgr2=0x7fee9806f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:55.219 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.211+0000 7fee9759e700 1 --2- 172.21.15.62:0/1718247674 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee98071730 0x7fee9806f610 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fee9806f110 tx=0x7fee88009bf0 comp rx=0 tx=0).stop 2023-06-09T04:41:55.220 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.215+0000 7fee9759e700 1 -- 172.21.15.62:0/1718247674 shutdown_connections 2023-06-09T04:41:55.220 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.215+0000 7fee9759e700 1 --2- 172.21.15.62:0/1718247674 >> v2:172.21.15.89:3300/0 conn(0x7fee980ca1c0 0x7fee980afb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:55.220 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.215+0000 7fee9759e700 1 --2- 172.21.15.62:0/1718247674 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee98071730 0x7fee9806f610 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:55.220 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.215+0000 7fee9759e700 1 -- 172.21.15.62:0/1718247674 >> 172.21.15.62:0/1718247674 conn(0x7fee980cab50 msgr2=0x7fee980caf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:55.220 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.215+0000 7fee9759e700 1 -- 172.21.15.62:0/1718247674 shutdown_connections 2023-06-09T04:41:55.220 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.215+0000 7fee9759e700 1 -- 172.21.15.62:0/1718247674 wait complete. 2023-06-09T04:41:55.223 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.219+0000 7fee9759e700 1 Processor -- start 2023-06-09T04:41:55.223 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.219+0000 7fee9759e700 1 -- start start 2023-06-09T04:41:55.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.219+0000 7fee9759e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee98071730 0x7fee98151830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:55.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.219+0000 7fee9759e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee980b0090 0x7fee980c1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:55.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.219+0000 7fee9759e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee980ca1c0 0x7fee981564b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:55.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.219+0000 7fee9759e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee98151d70 con 0x7fee980b0090 2023-06-09T04:41:55.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.219+0000 7fee9759e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee980ac930 con 0x7fee980ca1c0 2023-06-09T04:41:55.226 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.219+0000 7fee9759e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee980ab8b0 con 0x7fee98071730 2023-06-09T04:41:55.227 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.219+0000 7fee95d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee980b0090 0x7fee980c1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:55.227 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.219+0000 7fee95d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee980b0090 0x7fee980c1e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:44936/0 (socket says 172.21.15.62:44936) 2023-06-09T04:41:55.227 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.219+0000 7fee95d9b700 1 -- 172.21.15.62:0/3747706666 learned_addr learned my addr 172.21.15.62:0/3747706666 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:55.227 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.219+0000 7fee9659c700 1 --2- 172.21.15.62:0/3747706666 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee98071730 0x7fee98151830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:55.227 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.219+0000 7fee96d9d700 1 --2- 172.21.15.62:0/3747706666 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee980ca1c0 0x7fee981564b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:55.228 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.219+0000 7fee95d9b700 1 -- 172.21.15.62:0/3747706666 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee98071730 msgr2=0x7fee98151830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:55.228 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.219+0000 7fee95d9b700 1 --2- 172.21.15.62:0/3747706666 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee98071730 0x7fee98151830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:55.228 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.219+0000 7fee95d9b700 1 -- 172.21.15.62:0/3747706666 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee980ca1c0 msgr2=0x7fee981564b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:55.228 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.219+0000 7fee95d9b700 1 --2- 172.21.15.62:0/3747706666 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee980ca1c0 0x7fee981564b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:55.228 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.219+0000 7fee95d9b700 1 -- 172.21.15.62:0/3747706666 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee88009570 con 0x7fee980b0090 2023-06-09T04:41:55.228 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.219+0000 7fee95d9b700 1 --2- 172.21.15.62:0/3747706666 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee980b0090 0x7fee980c1e70 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fee8c00e9d0 tx=0x7fee8c00ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:55.228 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.219+0000 7fee86ffd700 1 -- 172.21.15.62:0/3747706666 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee8c009720 con 0x7fee980b0090 2023-06-09T04:41:55.228 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.223+0000 7fee86ffd700 1 -- 172.21.15.62:0/3747706666 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee8c00ee70 con 0x7fee980b0090 2023-06-09T04:41:55.229 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.223+0000 7fee86ffd700 1 -- 172.21.15.62:0/3747706666 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee8c00ca50 con 0x7fee980b0090 2023-06-09T04:41:55.229 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.223+0000 7fee9759e700 1 -- 172.21.15.62:0/3747706666 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee980abb70 con 0x7fee980b0090 2023-06-09T04:41:55.229 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.223+0000 7fee9759e700 1 -- 172.21.15.62:0/3747706666 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee980ac130 con 0x7fee980b0090 2023-06-09T04:41:55.229 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.223+0000 7fee9759e700 1 -- 172.21.15.62:0/3747706666 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee980739c0 con 0x7fee980b0090 2023-06-09T04:41:55.230 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.223+0000 7fee86ffd700 1 -- 172.21.15.62:0/3747706666 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fee8c00cbb0 con 0x7fee980b0090 2023-06-09T04:41:55.231 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.227+0000 7fee86ffd700 1 --2- 172.21.15.62:0/3747706666 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fee780662f0 0x7fee780687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:55.231 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.227+0000 7fee86ffd700 1 -- 172.21.15.62:0/3747706666 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fee8c0840e0 con 0x7fee980b0090 2023-06-09T04:41:55.232 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.227+0000 7fee9659c700 1 --2- 172.21.15.62:0/3747706666 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fee780662f0 0x7fee780687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:55.233 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.227+0000 7fee9659c700 1 --2- 172.21.15.62:0/3747706666 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fee780662f0 0x7fee780687a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fee88000c00 tx=0x7fee88008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:55.237 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.231+0000 7fee86ffd700 1 -- 172.21.15.62:0/3747706666 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fee8c054c20 con 0x7fee980b0090 2023-06-09T04:41:55.411 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.407+0000 7fee9759e700 1 -- 172.21.15.62:0/3747706666 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fee980c19a0 con 0x7fee980b0090 2023-06-09T04:41:55.412 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.407+0000 7fee86ffd700 1 -- 172.21.15.62:0/3747706666 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7fee8c00ce60 con 0x7fee980b0090 2023-06-09T04:41:55.412 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 64 2023-06-09T04:41:55.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.411+0000 7fee9759e700 1 -- 172.21.15.62:0/3747706666 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fee780662f0 msgr2=0x7fee780687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:55.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.411+0000 7fee9759e700 1 --2- 172.21.15.62:0/3747706666 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fee780662f0 0x7fee780687a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fee88000c00 tx=0x7fee88008030 comp rx=0 tx=0).stop 2023-06-09T04:41:55.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.411+0000 7fee9759e700 1 -- 172.21.15.62:0/3747706666 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee980b0090 msgr2=0x7fee980c1e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:55.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.411+0000 7fee9759e700 1 --2- 172.21.15.62:0/3747706666 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee980b0090 0x7fee980c1e70 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fee8c00e9d0 tx=0x7fee8c00ece0 comp rx=0 tx=0).stop 2023-06-09T04:41:55.418 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.411+0000 7fee9759e700 1 -- 172.21.15.62:0/3747706666 shutdown_connections 2023-06-09T04:41:55.418 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.411+0000 7fee9759e700 1 --2- 172.21.15.62:0/3747706666 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fee780662f0 0x7fee780687a0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:55.418 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.411+0000 7fee9759e700 1 --2- 172.21.15.62:0/3747706666 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fee980ca1c0 0x7fee981564b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:55.418 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.411+0000 7fee9759e700 1 --2- 172.21.15.62:0/3747706666 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fee980b0090 0x7fee980c1e70 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:55.418 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.411+0000 7fee9759e700 1 --2- 172.21.15.62:0/3747706666 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fee98071730 0x7fee98151830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:55.418 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.411+0000 7fee9759e700 1 -- 172.21.15.62:0/3747706666 >> 172.21.15.62:0/3747706666 conn(0x7fee980cab50 msgr2=0x7fee981595a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:55.418 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.411+0000 7fee9759e700 1 -- 172.21.15.62:0/3747706666 shutdown_connections 2023-06-09T04:41:55.419 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.411+0000 7fee9759e700 1 -- 172.21.15.62:0/3747706666 wait complete. 2023-06-09T04:41:55.439 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-09T04:41:55.621 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.615+0000 7fb66cc16700 1 Processor -- start 2023-06-09T04:41:55.622 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.615+0000 7fb66cc16700 1 -- start start 2023-06-09T04:41:55.624 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.619+0000 7fb66cc16700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb6680d2c00 0x7fb6680b1d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:55.624 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.619+0000 7fb66cc16700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6680ccf50 con 0x7fb6680d0040 2023-06-09T04:41:55.625 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.619+0000 7fb66cc16700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6680cd230 con 0x7fb6680ccac0 2023-06-09T04:41:55.625 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.619+0000 7fb66cc16700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6680cd510 con 0x7fb6680d2c00 2023-06-09T04:41:55.625 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.619+0000 7fb667fff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fb6680d0040 0x7fb6680cdff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:39358/0 (socket says 172.21.15.62:39358) 2023-06-09T04:41:55.625 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.619+0000 7fb667fff700 1 -- 172.21.15.62:0/1483006784 learned_addr learned my addr 172.21.15.62:0/1483006784 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:41:55.626 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.619+0000 7fb6677fe700 1 --2- 172.21.15.62:0/1483006784 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb6680d2c00 0x7fb6680b1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:55.626 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.619+0000 7fb6667fc700 1 -- 172.21.15.62:0/1483006784 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3856081715 0 0) 0x7fb6680ccf50 con 0x7fb6680d0040 2023-06-09T04:41:55.626 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.619+0000 7fb6667fc700 1 -- 172.21.15.62:0/1483006784 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6500035d0 con 0x7fb6680d0040 2023-06-09T04:41:55.627 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.619+0000 7fb6667fc700 1 -- 172.21.15.62:0/1483006784 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 328402115 0 0) 0x7fb6680cd230 con 0x7fb6680ccac0 2023-06-09T04:41:55.627 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.619+0000 7fb6667fc700 1 -- 172.21.15.62:0/1483006784 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6680ccf50 con 0x7fb6680ccac0 2023-06-09T04:41:55.627 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.619+0000 7fb6677fe700 1 -- 172.21.15.62:0/1483006784 >> v1:172.21.15.89:6789/0 conn(0x7fb6680ccac0 legacy=0x7fb668145520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:55.627 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.619+0000 7fb6677fe700 1 -- 172.21.15.62:0/1483006784 >> v1:172.21.15.62:6789/0 conn(0x7fb6680d0040 legacy=0x7fb6680cdff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:55.627 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.619+0000 7fb6677fe700 1 -- 172.21.15.62:0/1483006784 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6680cd7f0 con 0x7fb6680d2c00 2023-06-09T04:41:55.628 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.619+0000 7fb6677fe700 1 --2- 172.21.15.62:0/1483006784 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb6680d2c00 0x7fb6680b1d70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb658009880 tx=0x7fb658009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c041a9012c9b8ca server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:55.628 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.623+0000 7fb6667fc700 1 -- 172.21.15.62:0/1483006784 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb658011830 con 0x7fb6680d2c00 2023-06-09T04:41:55.628 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.623+0000 7fb6667fc700 1 -- 172.21.15.62:0/1483006784 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb658011990 con 0x7fb6680d2c00 2023-06-09T04:41:55.628 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.623+0000 7fb6667fc700 1 -- 172.21.15.62:0/1483006784 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb658011d20 con 0x7fb6680d2c00 2023-06-09T04:41:55.629 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.623+0000 7fb66cc16700 1 -- 172.21.15.62:0/1483006784 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb6680d2c00 msgr2=0x7fb6680b1d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:55.629 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.623+0000 7fb66cc16700 1 --2- 172.21.15.62:0/1483006784 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb6680d2c00 0x7fb6680b1d70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb658009880 tx=0x7fb658009b90 comp rx=0 tx=0).stop 2023-06-09T04:41:55.629 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.623+0000 7fb66cc16700 1 -- 172.21.15.62:0/1483006784 shutdown_connections 2023-06-09T04:41:55.630 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.623+0000 7fb66cc16700 1 --2- 172.21.15.62:0/1483006784 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb6680d2c00 0x7fb6680b1d70 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:55.630 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.623+0000 7fb66cc16700 1 -- 172.21.15.62:0/1483006784 >> 172.21.15.62:0/1483006784 conn(0x7fb668071840 msgr2=0x7fb66809b740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:55.630 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.623+0000 7fb66cc16700 1 -- 172.21.15.62:0/1483006784 shutdown_connections 2023-06-09T04:41:55.630 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.623+0000 7fb66cc16700 1 -- 172.21.15.62:0/1483006784 wait complete. 2023-06-09T04:41:55.631 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.627+0000 7fb66cc16700 1 Processor -- start 2023-06-09T04:41:55.632 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.627+0000 7fb66cc16700 1 -- start start 2023-06-09T04:41:55.633 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.627+0000 7fb66cc16700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb6680ccac0 0x7fb6681f0c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:55.633 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.627+0000 7fb66cc16700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6680d0040 0x7fb6680c6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:55.633 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.627+0000 7fb66cc16700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6680d2c00 0x7fb6681f4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:55.634 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.627+0000 7fb66cc16700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6680c7700 con 0x7fb6680d0040 2023-06-09T04:41:55.634 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.627+0000 7fb66cc16700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6680c6af0 con 0x7fb6680d2c00 2023-06-09T04:41:55.634 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.627+0000 7fb66cc16700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6680c6dd0 con 0x7fb6680ccac0 2023-06-09T04:41:55.635 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.627+0000 7fb666ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6680d0040 0x7fb6680c6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:55.635 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.627+0000 7fb666ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6680d0040 0x7fb6680c6010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:44938/0 (socket says 172.21.15.62:44938) 2023-06-09T04:41:55.635 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.627+0000 7fb666ffd700 1 -- 172.21.15.62:0/2809140799 learned_addr learned my addr 172.21.15.62:0/2809140799 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:55.635 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.627+0000 7fb6677fe700 1 --2- 172.21.15.62:0/2809140799 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb6680ccac0 0x7fb6681f0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:55.636 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.627+0000 7fb667fff700 1 --2- 172.21.15.62:0/2809140799 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6680d2c00 0x7fb6681f4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:55.636 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.627+0000 7fb666ffd700 1 -- 172.21.15.62:0/2809140799 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb6680ccac0 msgr2=0x7fb6681f0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:55.636 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.627+0000 7fb666ffd700 1 --2- 172.21.15.62:0/2809140799 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb6680ccac0 0x7fb6681f0c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:55.636 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.627+0000 7fb666ffd700 1 -- 172.21.15.62:0/2809140799 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6680d2c00 msgr2=0x7fb6681f4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:55.636 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.627+0000 7fb666ffd700 1 --2- 172.21.15.62:0/2809140799 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6680d2c00 0x7fb6681f4950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:55.636 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.627+0000 7fb666ffd700 1 -- 172.21.15.62:0/2809140799 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6580094b0 con 0x7fb6680d0040 2023-06-09T04:41:55.636 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.627+0000 7fb6677fe700 1 --2- 172.21.15.62:0/2809140799 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb6680ccac0 0x7fb6681f0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:41:55.637 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.627+0000 7fb666ffd700 1 --2- 172.21.15.62:0/2809140799 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6680d0040 0x7fb6680c6010 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb65c00c520 tx=0x7fb65c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:55.637 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.631+0000 7fb64ffff700 1 -- 172.21.15.62:0/2809140799 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb65c0052d0 con 0x7fb6680d0040 2023-06-09T04:41:55.637 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.631+0000 7fb64ffff700 1 -- 172.21.15.62:0/2809140799 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb65c005450 con 0x7fb6680d0040 2023-06-09T04:41:55.637 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.631+0000 7fb64ffff700 1 -- 172.21.15.62:0/2809140799 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb65c0038e0 con 0x7fb6680d0040 2023-06-09T04:41:55.637 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.631+0000 7fb66cc16700 1 -- 172.21.15.62:0/2809140799 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6680c70b0 con 0x7fb6680d0040 2023-06-09T04:41:55.637 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.631+0000 7fb66cc16700 1 -- 172.21.15.62:0/2809140799 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6681f11a0 con 0x7fb6680d0040 2023-06-09T04:41:55.638 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.631+0000 7fb66cc16700 1 -- 172.21.15.62:0/2809140799 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6680c78b0 con 0x7fb6680d0040 2023-06-09T04:41:55.638 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.631+0000 7fb64ffff700 1 -- 172.21.15.62:0/2809140799 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb65c003a40 con 0x7fb6680d0040 2023-06-09T04:41:55.640 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.635+0000 7fb64ffff700 1 --2- 172.21.15.62:0/2809140799 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fb6540662f0 0x7fb6540687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:55.641 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.635+0000 7fb64ffff700 1 -- 172.21.15.62:0/2809140799 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb65c083670 con 0x7fb6680d0040 2023-06-09T04:41:55.641 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.635+0000 7fb6677fe700 1 --2- 172.21.15.62:0/2809140799 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fb6540662f0 0x7fb6540687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:55.642 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.635+0000 7fb6677fe700 1 --2- 172.21.15.62:0/2809140799 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fb6540662f0 0x7fb6540687a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb658000c00 tx=0x7fb65801c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:55.648 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.643+0000 7fb64ffff700 1 -- 172.21.15.62:0/2809140799 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb65c050690 con 0x7fb6680d0040 2023-06-09T04:41:55.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.815+0000 7fb66cc16700 1 -- 172.21.15.62:0/2809140799 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fb6680cdad0 con 0x7fb6680d0040 2023-06-09T04:41:55.822 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.815+0000 7fb64ffff700 1 -- 172.21.15.62:0/2809140799 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb65c017020 con 0x7fb6680d0040 2023-06-09T04:41:55.822 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-06-09T04:41:55.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.819+0000 7fb66cc16700 1 -- 172.21.15.62:0/2809140799 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fb6540662f0 msgr2=0x7fb6540687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:55.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.819+0000 7fb66cc16700 1 --2- 172.21.15.62:0/2809140799 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fb6540662f0 0x7fb6540687a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb658000c00 tx=0x7fb65801c040 comp rx=0 tx=0).stop 2023-06-09T04:41:55.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.819+0000 7fb66cc16700 1 -- 172.21.15.62:0/2809140799 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6680d0040 msgr2=0x7fb6680c6010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:55.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.819+0000 7fb66cc16700 1 --2- 172.21.15.62:0/2809140799 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6680d0040 0x7fb6680c6010 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb65c00c520 tx=0x7fb65c00c8e0 comp rx=0 tx=0).stop 2023-06-09T04:41:55.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.819+0000 7fb66cc16700 1 -- 172.21.15.62:0/2809140799 shutdown_connections 2023-06-09T04:41:55.826 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.819+0000 7fb66cc16700 1 --2- 172.21.15.62:0/2809140799 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fb6540662f0 0x7fb6540687a0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:55.826 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.819+0000 7fb66cc16700 1 --2- 172.21.15.62:0/2809140799 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb6680d2c00 0x7fb6681f4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:55.826 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.819+0000 7fb66cc16700 1 --2- 172.21.15.62:0/2809140799 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6680d0040 0x7fb6680c6010 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:55.826 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.819+0000 7fb66cc16700 1 --2- 172.21.15.62:0/2809140799 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb6680ccac0 0x7fb6681f0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:55.826 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.819+0000 7fb66cc16700 1 -- 172.21.15.62:0/2809140799 >> 172.21.15.62:0/2809140799 conn(0x7fb668071840 msgr2=0x7fb6680b72b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:55.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.819+0000 7fb66cc16700 1 -- 172.21.15.62:0/2809140799 shutdown_connections 2023-06-09T04:41:55.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:55.819+0000 7fb66cc16700 1 -- 172.21.15.62:0/2809140799 wait complete. 2023-06-09T04:41:55.848 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:41:56.021 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.015+0000 7f2d6ab97700 1 Processor -- start 2023-06-09T04:41:56.022 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.015+0000 7f2d6ab97700 1 -- start start 2023-06-09T04:41:56.023 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.019+0000 7f2d6ab97700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2d64160340 0x7f2d640caa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:56.024 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.019+0000 7f2d6ab97700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2d640caf80 0x7f2d64163df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:56.024 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.019+0000 7f2d6ab97700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d640cdc20 con 0x7f2d6415ff70 2023-06-09T04:41:56.024 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.019+0000 7f2d6ab97700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d640cb400 con 0x7f2d64160340 2023-06-09T04:41:56.024 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.019+0000 7f2d6ab97700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d640cd330 con 0x7f2d640caf80 2023-06-09T04:41:56.025 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.019+0000 7f2d69b95700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f2d6415ff70 0x7f2d640c9cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:39364/0 (socket says 172.21.15.62:39364) 2023-06-09T04:41:56.025 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.019+0000 7f2d69b95700 1 -- 172.21.15.62:0/3802888039 learned_addr learned my addr 172.21.15.62:0/3802888039 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:41:56.025 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.019+0000 7f2d69394700 1 --2- 172.21.15.62:0/3802888039 >> v2:172.21.15.89:3300/0 conn(0x7f2d64160340 0x7f2d640caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:56.025 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.019+0000 7f2d6a396700 1 --2- 172.21.15.62:0/3802888039 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2d640caf80 0x7f2d64163df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:56.026 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.019+0000 7f2d68b93700 1 -- 172.21.15.62:0/3802888039 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3737027991 0 0) 0x7f2d640cdc20 con 0x7f2d6415ff70 2023-06-09T04:41:56.026 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.019+0000 7f2d68b93700 1 -- 172.21.15.62:0/3802888039 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d500035d0 con 0x7f2d6415ff70 2023-06-09T04:41:56.026 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.019+0000 7f2d69394700 1 -- 172.21.15.62:0/3802888039 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2d640caf80 msgr2=0x7f2d64163df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:56.026 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.019+0000 7f2d69394700 1 --2- 172.21.15.62:0/3802888039 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2d640caf80 0x7f2d64163df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:56.027 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.019+0000 7f2d69394700 1 -- 172.21.15.62:0/3802888039 >> v1:172.21.15.62:6789/0 conn(0x7f2d6415ff70 legacy=0x7f2d640c9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:56.027 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.019+0000 7f2d69394700 1 -- 172.21.15.62:0/3802888039 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d640cd5d0 con 0x7f2d64160340 2023-06-09T04:41:56.027 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.019+0000 7f2d69394700 1 --2- 172.21.15.62:0/3802888039 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d64160340 0x7f2d640caa40 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2d54009850 tx=0x7f2d54009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b277e5b7713811cc server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:56.027 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.023+0000 7f2d68b93700 1 -- 172.21.15.62:0/3802888039 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d54011830 con 0x7f2d64160340 2023-06-09T04:41:56.028 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.023+0000 7f2d68b93700 1 -- 172.21.15.62:0/3802888039 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d54011990 con 0x7f2d64160340 2023-06-09T04:41:56.028 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.023+0000 7f2d68b93700 1 -- 172.21.15.62:0/3802888039 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d54011d40 con 0x7f2d64160340 2023-06-09T04:41:56.029 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.023+0000 7f2d6ab97700 1 -- 172.21.15.62:0/3802888039 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d64160340 msgr2=0x7f2d640caa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:56.029 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.023+0000 7f2d6ab97700 1 --2- 172.21.15.62:0/3802888039 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d64160340 0x7f2d640caa40 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2d54009850 tx=0x7f2d54009b60 comp rx=0 tx=0).stop 2023-06-09T04:41:56.029 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.023+0000 7f2d6ab97700 1 -- 172.21.15.62:0/3802888039 shutdown_connections 2023-06-09T04:41:56.029 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.023+0000 7f2d6ab97700 1 --2- 172.21.15.62:0/3802888039 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2d640caf80 0x7f2d64163df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:56.029 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.023+0000 7f2d6ab97700 1 --2- 172.21.15.62:0/3802888039 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d64160340 0x7f2d640caa40 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:56.029 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.023+0000 7f2d6ab97700 1 -- 172.21.15.62:0/3802888039 >> 172.21.15.62:0/3802888039 conn(0x7f2d6406a420 msgr2=0x7f2d640afc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:56.030 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.023+0000 7f2d6ab97700 1 -- 172.21.15.62:0/3802888039 shutdown_connections 2023-06-09T04:41:56.030 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.023+0000 7f2d6ab97700 1 -- 172.21.15.62:0/3802888039 wait complete. 2023-06-09T04:41:56.031 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.027+0000 7f2d6ab97700 1 Processor -- start 2023-06-09T04:41:56.032 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.027+0000 7f2d6ab97700 1 -- start start 2023-06-09T04:41:56.033 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.027+0000 7f2d6ab97700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2d6415ff70 0x7f2d641f5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:56.033 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.027+0000 7f2d6ab97700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d64160340 0x7f2d64161c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:56.033 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.027+0000 7f2d6ab97700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d640c46a0 0x7f2d640af7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:56.034 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.027+0000 7f2d6ab97700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d64163050 con 0x7f2d640c46a0 2023-06-09T04:41:56.034 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.027+0000 7f2d6ab97700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d641f5960 con 0x7f2d64160340 2023-06-09T04:41:56.034 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.027+0000 7f2d6ab97700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d641624d0 con 0x7f2d6415ff70 2023-06-09T04:41:56.035 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.027+0000 7f2d6a396700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d640c46a0 0x7f2d640af7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:56.035 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.027+0000 7f2d6a396700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d640c46a0 0x7f2d640af7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:44954/0 (socket says 172.21.15.62:44954) 2023-06-09T04:41:56.035 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.027+0000 7f2d6a396700 1 -- 172.21.15.62:0/1160039231 learned_addr learned my addr 172.21.15.62:0/1160039231 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:56.035 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.027+0000 7f2d69394700 1 --2- 172.21.15.62:0/1160039231 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d64160340 0x7f2d64161c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:56.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.027+0000 7f2d69b95700 1 --2- 172.21.15.62:0/1160039231 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2d6415ff70 0x7f2d641f5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:56.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.027+0000 7f2d6a396700 1 -- 172.21.15.62:0/1160039231 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2d6415ff70 msgr2=0x7f2d641f5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:56.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.027+0000 7f2d6a396700 1 --2- 172.21.15.62:0/1160039231 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2d6415ff70 0x7f2d641f5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:56.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.027+0000 7f2d6a396700 1 -- 172.21.15.62:0/1160039231 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d64160340 msgr2=0x7f2d64161c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:56.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.027+0000 7f2d6a396700 1 --2- 172.21.15.62:0/1160039231 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d64160340 0x7f2d64161c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:56.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.027+0000 7f2d6a396700 1 -- 172.21.15.62:0/1160039231 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d540094b0 con 0x7f2d640c46a0 2023-06-09T04:41:56.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.027+0000 7f2d69b95700 1 --2- 172.21.15.62:0/1160039231 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2d6415ff70 0x7f2d641f5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:41:56.037 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.027+0000 7f2d6a396700 1 --2- 172.21.15.62:0/1160039231 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d640c46a0 0x7f2d640af7f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c00efc0 tx=0x7f2d5c00c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:56.037 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.031+0000 7f2d5a7fc700 1 -- 172.21.15.62:0/1160039231 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d5c00cb80 con 0x7f2d640c46a0 2023-06-09T04:41:56.037 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.031+0000 7f2d5a7fc700 1 -- 172.21.15.62:0/1160039231 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d5c00f040 con 0x7f2d640c46a0 2023-06-09T04:41:56.038 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.031+0000 7f2d6ab97700 1 -- 172.21.15.62:0/1160039231 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d641627b0 con 0x7f2d640c46a0 2023-06-09T04:41:56.038 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.031+0000 7f2d5a7fc700 1 -- 172.21.15.62:0/1160039231 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d5c014480 con 0x7f2d640c46a0 2023-06-09T04:41:56.038 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.031+0000 7f2d6ab97700 1 -- 172.21.15.62:0/1160039231 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d64162d70 con 0x7f2d640c46a0 2023-06-09T04:41:56.038 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.031+0000 7f2d6ab97700 1 -- 172.21.15.62:0/1160039231 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d640c9350 con 0x7f2d640c46a0 2023-06-09T04:41:56.039 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.031+0000 7f2d5a7fc700 1 -- 172.21.15.62:0/1160039231 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2d5c0145e0 con 0x7f2d640c46a0 2023-06-09T04:41:56.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.035+0000 7f2d5a7fc700 1 --2- 172.21.15.62:0/1160039231 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f2d480662f0 0x7f2d480687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:56.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.035+0000 7f2d5a7fc700 1 -- 172.21.15.62:0/1160039231 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2d5c0847d0 con 0x7f2d640c46a0 2023-06-09T04:41:56.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.035+0000 7f2d69b95700 1 --2- 172.21.15.62:0/1160039231 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f2d480662f0 0x7f2d480687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:56.042 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.035+0000 7f2d69b95700 1 --2- 172.21.15.62:0/1160039231 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f2d480662f0 0x7f2d480687a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2d600011e0 tx=0x7f2d60009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:56.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.043+0000 7f2d5a7fc700 1 -- 172.21.15.62:0/1160039231 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2d5c051920 con 0x7f2d640c46a0 2023-06-09T04:41:56.219 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.211+0000 7f2d6ab97700 1 -- 172.21.15.62:0/1160039231 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2d640739c0 con 0x7f2d640c46a0 2023-06-09T04:41:56.220 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.215+0000 7f2d5a7fc700 1 -- 172.21.15.62:0/1160039231 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+20180 (secure 0 0 0) 0x7f2d5c054f40 con 0x7f2d640c46a0 2023-06-09T04:41:56.221 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:41:56.221 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":30,"fsid":"f7998a1e-e5a9-4202-abaa-70c0eaae1047","created":"2023-06-09T04:40:30.469588+0000","modified":"2023-06-09T04:41:38.495589+0000","last_up_change":"2023-06-09T04:40:43.120747+0000","last_in_change":"2023-06-09T04:40:33.568221+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:40:44.646921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:40:50.006643+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:40:55.031273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:40:55.773517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-09T04:40:58.845383+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bc50bbc0-dd08-42ed-804c-ec3029e36c19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6802","nonce":1295788017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6807","nonce":1295788017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6815","nonce":1295788017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6809","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6811","nonce":1295788017}]},"public_addr":"172.21.15.62:6802/1295788017","cluster_addr":"172.21.15.62:6807/1295788017","heartbeat_back_addr":"172.21.15.62:6815/1295788017","heartbeat_front_addr":"172.21.15.62:6811/1295788017","state":["exists","up"]},{"osd":1,"uuid":"8230b12d-e22f-4985-a584-4cc64404cdbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6825","nonce":4120692006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6827","nonce":4120692006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6831","nonce":4120692006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6829","nonce":4120692006}]},"public_addr":"172.21.15.62:6825/4120692006","cluster_addr":"172.21.15.62:6827/4120692006","heartbeat_back_addr":"172.21.15.62:6831/4120692006","heartbeat_front_addr":"172.21.15.62:6829/4120692006","state":["exists","up"]},{"osd":2,"uuid":"d0202506-dbe9-4e3c-9271-687929abf96a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6801","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6803","nonce":4169607876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6805","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6806","nonce":4169607876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6814","nonce":4169607876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6810","nonce":4169607876}]},"public_addr":"172.21.15.62:6803/4169607876","cluster_addr":"172.21.15.62:6806/4169607876","heartbeat_back_addr":"172.21.15.62:6814/4169607876","heartbeat_front_addr":"172.21.15.62:6810/4169607876","state":["exists","up"]},{"osd":3,"uuid":"f3c0298a-b075-4411-af50-e16cd74fdddb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6817","nonce":3268438986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6819","nonce":3268438986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6823","nonce":3268438986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6821","nonce":3268438986}]},"public_addr":"172.21.15.62:6817/3268438986","cluster_addr":"172.21.15.62:6819/3268438986","heartbeat_back_addr":"172.21.15.62:6823/3268438986","heartbeat_front_addr":"172.21.15.62:6821/3268438986","state":["exists","up"]},{"osd":4,"uuid":"1ab5c5ca-e74f-475a-a309-683cc0029928","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6817","nonce":3139617628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6819","nonce":3139617628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6823","nonce":3139617628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6821","nonce":3139617628}]},"public_addr":"172.21.15.89:6817/3139617628","cluster_addr":"172.21.15.89:6819/3139617628","heartbeat_back_addr":"172.21.15.89:6823/3139617628","heartbeat_front_addr":"172.21.15.89:6821/3139617628","state":["exists","up"]},{"osd":5,"uuid":"a933e184-bd8f-4369-a1ba-a68de53c578c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6825","nonce":2681723596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6827","nonce":2681723596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6831","nonce":2681723596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6829","nonce":2681723596}]},"public_addr":"172.21.15.89:6825/2681723596","cluster_addr":"172.21.15.89:6827/2681723596","heartbeat_back_addr":"172.21.15.89:6831/2681723596","heartbeat_front_addr":"172.21.15.89:6829/2681723596","state":["exists","up"]},{"osd":6,"uuid":"1ed7ad37-2eee-49a6-954c-b537e2b7f0ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6809","nonce":1657136033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6811","nonce":1657136033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6815","nonce":1657136033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6813","nonce":1657136033}]},"public_addr":"172.21.15.89:6809/1657136033","cluster_addr":"172.21.15.89:6811/1657136033","heartbeat_back_addr":"172.21.15.89:6815/1657136033","heartbeat_front_addr":"172.21.15.89:6813/1657136033","state":["exists","up"]},{"osd":7,"uuid":"6ed732e9-33ff-40df-9038-a9f1d1622671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6801","nonce":1710561686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6803","nonce":1710561686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6807","nonce":1710561686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6805","nonce":1710561686}]},"public_addr":"172.21.15.89:6801/1710561686","cluster_addr":"172.21.15.89:6803/1710561686","heartbeat_back_addr":"172.21.15.89:6807/1710561686","heartbeat_front_addr":"172.21.15.89:6805/1710561686","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.335803+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.419788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.179334+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.263310+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.071846+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.375627+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.282277+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.315997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.12","mappings":[{"from":1,"to":2}]},{"pgid":"4.19","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:41:56.224 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.219+0000 7f2d6ab97700 1 -- 172.21.15.62:0/1160039231 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f2d480662f0 msgr2=0x7f2d480687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:56.224 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.219+0000 7f2d6ab97700 1 --2- 172.21.15.62:0/1160039231 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f2d480662f0 0x7f2d480687a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2d600011e0 tx=0x7f2d60009040 comp rx=0 tx=0).stop 2023-06-09T04:41:56.224 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.219+0000 7f2d6ab97700 1 -- 172.21.15.62:0/1160039231 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d640c46a0 msgr2=0x7f2d640af7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:56.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.219+0000 7f2d6ab97700 1 --2- 172.21.15.62:0/1160039231 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d640c46a0 0x7f2d640af7f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c00efc0 tx=0x7f2d5c00c0c0 comp rx=0 tx=0).stop 2023-06-09T04:41:56.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.219+0000 7f2d6ab97700 1 -- 172.21.15.62:0/1160039231 shutdown_connections 2023-06-09T04:41:56.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.219+0000 7f2d6ab97700 1 --2- 172.21.15.62:0/1160039231 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f2d480662f0 0x7f2d480687a0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:56.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.219+0000 7f2d6ab97700 1 --2- 172.21.15.62:0/1160039231 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d640c46a0 0x7f2d640af7f0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:56.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.219+0000 7f2d6ab97700 1 --2- 172.21.15.62:0/1160039231 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d64160340 0x7f2d64161c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:56.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.219+0000 7f2d6ab97700 1 --2- 172.21.15.62:0/1160039231 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2d6415ff70 0x7f2d641f5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:56.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.219+0000 7f2d6ab97700 1 -- 172.21.15.62:0/1160039231 >> 172.21.15.62:0/1160039231 conn(0x7f2d640caf80 msgr2=0x7f2d640700e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:56.226 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.219+0000 7f2d6ab97700 1 -- 172.21.15.62:0/1160039231 shutdown_connections 2023-06-09T04:41:56.226 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.219+0000 7f2d6ab97700 1 -- 172.21.15.62:0/1160039231 wait complete. 2023-06-09T04:41:56.245 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:40:44.646921+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:40:50.006643+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T04:40:55.031273+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T04:40:55.773517+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-09T04:40:58.845383+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-09T04:41:56.246 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:41:56.425 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.419+0000 7fb88e915700 1 Processor -- start 2023-06-09T04:41:56.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.419+0000 7fb88e915700 1 -- start start 2023-06-09T04:41:56.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.423+0000 7fb88e915700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb8881562c0 0x7fb8881603f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:56.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.423+0000 7fb88e915700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb88806b880 0x7fb8880afb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:56.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.423+0000 7fb88e915700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb8880b0090 0x7fb8880cbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:56.430 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.423+0000 7fb88e915700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb888160930 con 0x7fb8881562c0 2023-06-09T04:41:56.430 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.423+0000 7fb88e915700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8880b0510 con 0x7fb8880b0090 2023-06-09T04:41:56.431 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.423+0000 7fb88e915700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb88815cd90 con 0x7fb88806b880 2023-06-09T04:41:56.431 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.423+0000 7fb88d913700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb8881562c0 0x7fb8881603f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:56.431 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.423+0000 7fb88d913700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb8881562c0 0x7fb8881603f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:44966/0 (socket says 172.21.15.62:44966) 2023-06-09T04:41:56.431 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.423+0000 7fb88d913700 1 -- 172.21.15.62:0/3928779441 learned_addr learned my addr 172.21.15.62:0/3928779441 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:56.431 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.423+0000 7fb88d112700 1 --2- 172.21.15.62:0/3928779441 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb88806b880 0x7fb8880afb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:56.431 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.423+0000 7fb88e114700 1 --2- 172.21.15.62:0/3928779441 >> v2:172.21.15.89:3300/0 conn(0x7fb8880b0090 0x7fb8880cbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:56.432 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.423+0000 7fb88e114700 1 -- 172.21.15.62:0/3928779441 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb88806b880 msgr2=0x7fb8880afb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:56.432 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.423+0000 7fb88e114700 1 --2- 172.21.15.62:0/3928779441 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb88806b880 0x7fb8880afb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:56.433 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.423+0000 7fb88e114700 1 -- 172.21.15.62:0/3928779441 >> v2:172.21.15.62:3300/0 conn(0x7fb8881562c0 msgr2=0x7fb8881603f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:56.433 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.423+0000 7fb88e114700 1 --2- 172.21.15.62:0/3928779441 >> v2:172.21.15.62:3300/0 conn(0x7fb8881562c0 0x7fb8881603f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:56.433 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.423+0000 7fb88e114700 1 -- 172.21.15.62:0/3928779441 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb88806bd10 con 0x7fb8880b0090 2023-06-09T04:41:56.433 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.423+0000 7fb88d913700 1 --2- 172.21.15.62:0/3928779441 >> v2:172.21.15.62:3300/0 conn(0x7fb8881562c0 0x7fb8881603f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:41:56.433 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.427+0000 7fb88e114700 1 --2- 172.21.15.62:0/3928779441 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8880b0090 0x7fb8880cbfd0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb8880c5130 tx=0x7fb88000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e717aadee94b40a4 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:56.433 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.427+0000 7fb88c911700 1 -- 172.21.15.62:0/3928779441 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb88000e070 con 0x7fb8880b0090 2023-06-09T04:41:56.433 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.427+0000 7fb88c911700 1 -- 172.21.15.62:0/3928779441 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb88000bb20 con 0x7fb8880b0090 2023-06-09T04:41:56.434 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.427+0000 7fb88c911700 1 -- 172.21.15.62:0/3928779441 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb880012430 con 0x7fb8880b0090 2023-06-09T04:41:56.434 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.427+0000 7fb88e915700 1 -- 172.21.15.62:0/3928779441 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8880b0090 msgr2=0x7fb8880cbfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:56.435 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.427+0000 7fb88e915700 1 --2- 172.21.15.62:0/3928779441 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8880b0090 0x7fb8880cbfd0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb8880c5130 tx=0x7fb88000b330 comp rx=0 tx=0).stop 2023-06-09T04:41:56.435 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.427+0000 7fb88e915700 1 -- 172.21.15.62:0/3928779441 shutdown_connections 2023-06-09T04:41:56.435 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.427+0000 7fb88e915700 1 --2- 172.21.15.62:0/3928779441 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8880b0090 0x7fb8880cbfd0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:56.435 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.427+0000 7fb88e915700 1 --2- 172.21.15.62:0/3928779441 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb88806b880 0x7fb8880afb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:56.435 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.427+0000 7fb88e915700 1 --2- 172.21.15.62:0/3928779441 >> v2:172.21.15.62:3300/0 conn(0x7fb8881562c0 0x7fb8881603f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:56.435 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.427+0000 7fb88e915700 1 -- 172.21.15.62:0/3928779441 >> 172.21.15.62:0/3928779441 conn(0x7fb8880cab50 msgr2=0x7fb8880caf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:56.435 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.427+0000 7fb88e915700 1 -- 172.21.15.62:0/3928779441 shutdown_connections 2023-06-09T04:41:56.436 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.427+0000 7fb88e915700 1 -- 172.21.15.62:0/3928779441 wait complete. 2023-06-09T04:41:56.436 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.431+0000 7fb88e915700 1 Processor -- start 2023-06-09T04:41:56.437 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.431+0000 7fb88e915700 1 -- start start 2023-06-09T04:41:56.437 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.431+0000 7fb88e915700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb88806b880 0x7fb8881f5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:56.438 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.431+0000 7fb88e915700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8880b0090 0x7fb8881555b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:56.438 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.431+0000 7fb88e915700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb8881562c0 0x7fb8880b2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:56.438 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.431+0000 7fb88e915700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8881f5c40 con 0x7fb88806b880 2023-06-09T04:41:56.438 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.431+0000 7fb88e915700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8880c42d0 con 0x7fb8880b0090 2023-06-09T04:41:56.438 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.431+0000 7fb88e915700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8880c2c50 con 0x7fb8881562c0 2023-06-09T04:41:56.438 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.431+0000 7fb88d913700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb88806b880 0x7fb8881f5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:56.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.431+0000 7fb88d913700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb88806b880 0x7fb8881f5700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:44980/0 (socket says 172.21.15.62:44980) 2023-06-09T04:41:56.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.431+0000 7fb88d913700 1 -- 172.21.15.62:0/34247443 learned_addr learned my addr 172.21.15.62:0/34247443 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:56.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.431+0000 7fb88d112700 1 --2- 172.21.15.62:0/34247443 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8880b0090 0x7fb8881555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:56.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.431+0000 7fb88d913700 1 -- 172.21.15.62:0/34247443 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb8881562c0 msgr2=0x7fb8880b2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:56.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.431+0000 7fb88d913700 1 --2- 172.21.15.62:0/34247443 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb8881562c0 0x7fb8880b2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:56.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.431+0000 7fb88d913700 1 -- 172.21.15.62:0/34247443 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8880b0090 msgr2=0x7fb8881555b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:56.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.431+0000 7fb88d913700 1 --2- 172.21.15.62:0/34247443 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8880b0090 0x7fb8881555b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:56.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.431+0000 7fb88d913700 1 -- 172.21.15.62:0/34247443 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb884009570 con 0x7fb88806b880 2023-06-09T04:41:56.442 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.431+0000 7fb88d112700 1 --2- 172.21.15.62:0/34247443 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8880b0090 0x7fb8881555b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:41:56.442 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.431+0000 7fb88d913700 1 --2- 172.21.15.62:0/34247443 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb88806b880 0x7fb8881f5700 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb88400ea00 tx=0x7fb88400edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:56.442 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.435+0000 7fb87e7fc700 1 -- 172.21.15.62:0/34247443 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb88400c850 con 0x7fb88806b880 2023-06-09T04:41:56.443 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.435+0000 7fb87e7fc700 1 -- 172.21.15.62:0/34247443 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb88400c9b0 con 0x7fb88806b880 2023-06-09T04:41:56.443 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.435+0000 7fb88e915700 1 -- 172.21.15.62:0/34247443 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb880009a70 con 0x7fb88806b880 2023-06-09T04:41:56.443 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.435+0000 7fb87e7fc700 1 -- 172.21.15.62:0/34247443 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb88400cd20 con 0x7fb88806b880 2023-06-09T04:41:56.443 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.435+0000 7fb88e915700 1 -- 172.21.15.62:0/34247443 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8880b1710 con 0x7fb88806b880 2023-06-09T04:41:56.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.435+0000 7fb88e915700 1 -- 172.21.15.62:0/34247443 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8880739c0 con 0x7fb88806b880 2023-06-09T04:41:56.445 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.435+0000 7fb87e7fc700 1 -- 172.21.15.62:0/34247443 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb884013470 con 0x7fb88806b880 2023-06-09T04:41:56.445 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.439+0000 7fb87e7fc700 1 --2- 172.21.15.62:0/34247443 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fb86c0662f0 0x7fb86c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:56.445 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.439+0000 7fb87e7fc700 1 -- 172.21.15.62:0/34247443 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb884083e80 con 0x7fb88806b880 2023-06-09T04:41:56.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.439+0000 7fb88d112700 1 --2- 172.21.15.62:0/34247443 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fb86c0662f0 0x7fb86c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:56.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.439+0000 7fb88d112700 1 --2- 172.21.15.62:0/34247443 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fb86c0662f0 0x7fb86c0687a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb8880b2550 tx=0x7fb878008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:56.449 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.443+0000 7fb87e7fc700 1 -- 172.21.15.62:0/34247443 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb884050f30 con 0x7fb88806b880 2023-06-09T04:41:56.623 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.615+0000 7fb88e915700 1 -- 172.21.15.62:0/34247443 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb8880cd4e0 con 0x7fb88806b880 2023-06-09T04:41:56.623 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.619+0000 7fb87e7fc700 1 -- 172.21.15.62:0/34247443 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb884054550 con 0x7fb88806b880 2023-06-09T04:41:56.624 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2023-06-09T04:41:56.626 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.619+0000 7fb88e915700 1 -- 172.21.15.62:0/34247443 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fb86c0662f0 msgr2=0x7fb86c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:56.627 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.619+0000 7fb88e915700 1 --2- 172.21.15.62:0/34247443 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fb86c0662f0 0x7fb86c0687a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb8880b2550 tx=0x7fb878008040 comp rx=0 tx=0).stop 2023-06-09T04:41:56.627 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.619+0000 7fb88e915700 1 -- 172.21.15.62:0/34247443 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb88806b880 msgr2=0x7fb8881f5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:56.627 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.619+0000 7fb88e915700 1 --2- 172.21.15.62:0/34247443 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb88806b880 0x7fb8881f5700 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fb88400ea00 tx=0x7fb88400edc0 comp rx=0 tx=0).stop 2023-06-09T04:41:56.627 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.619+0000 7fb88e915700 1 -- 172.21.15.62:0/34247443 shutdown_connections 2023-06-09T04:41:56.627 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.619+0000 7fb88e915700 1 --2- 172.21.15.62:0/34247443 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fb86c0662f0 0x7fb86c0687a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:56.627 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.619+0000 7fb88e915700 1 --2- 172.21.15.62:0/34247443 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb8881562c0 0x7fb8880b2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:56.628 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.619+0000 7fb88e915700 1 --2- 172.21.15.62:0/34247443 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8880b0090 0x7fb8881555b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:56.628 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.619+0000 7fb88e915700 1 --2- 172.21.15.62:0/34247443 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb88806b880 0x7fb8881f5700 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:56.628 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.619+0000 7fb88e915700 1 -- 172.21.15.62:0/34247443 >> 172.21.15.62:0/34247443 conn(0x7fb8880cab50 msgr2=0x7fb8880ce060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:56.628 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.619+0000 7fb88e915700 1 -- 172.21.15.62:0/34247443 shutdown_connections 2023-06-09T04:41:56.629 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.623+0000 7fb88e915700 1 -- 172.21.15.62:0/34247443 wait complete. 2023-06-09T04:41:56.648 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:41:56.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.823+0000 7f9f9aba8700 1 Processor -- start 2023-06-09T04:41:56.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.823+0000 7f9f9aba8700 1 -- start start 2023-06-09T04:41:56.832 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.827+0000 7f9f9aba8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9f940d1f80 0x7f9f940b3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:56.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.827+0000 7f9f9aba8700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9f940cd2e0 0x7f9f940d0250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:56.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.827+0000 7f9f9aba8700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f940b4d50 con 0x7f9f940cebf0 2023-06-09T04:41:56.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.827+0000 7f9f9aba8700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f940cf040 con 0x7f9f940cd2e0 2023-06-09T04:41:56.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.827+0000 7f9f9aba8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f940b4140 con 0x7f9f940d1f80 2023-06-09T04:41:56.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.827+0000 7f9f993a5700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f9f940cebf0 0x7f9f940ccbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:39372/0 (socket says 172.21.15.62:39372) 2023-06-09T04:41:56.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.827+0000 7f9f9a3a7700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9f940cd2e0 0x7f9f940d0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:56.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.827+0000 7f9f993a5700 1 -- 172.21.15.62:0/4139090559 learned_addr learned my addr 172.21.15.62:0/4139090559 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:41:56.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.827+0000 7f9f99ba6700 1 --2- 172.21.15.62:0/4139090559 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9f940d1f80 0x7f9f940b3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:56.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.827+0000 7f9f99ba6700 1 -- 172.21.15.62:0/4139090559 >> v2:172.21.15.89:3300/0 conn(0x7f9f940cd2e0 msgr2=0x7f9f940d0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:56.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.827+0000 7f9f99ba6700 1 --2- 172.21.15.62:0/4139090559 >> v2:172.21.15.89:3300/0 conn(0x7f9f940cd2e0 0x7f9f940d0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:56.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.827+0000 7f9f99ba6700 1 -- 172.21.15.62:0/4139090559 >> v1:172.21.15.62:6789/0 conn(0x7f9f940cebf0 legacy=0x7f9f940ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:56.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.827+0000 7f9f99ba6700 1 -- 172.21.15.62:0/4139090559 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f940b4420 con 0x7f9f940d1f80 2023-06-09T04:41:56.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.827+0000 7f9f98ba4700 1 -- 172.21.15.62:0/4139090559 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 85616317 0 0) 0x7f9f940b4d50 con 0x7f9f940cebf0 2023-06-09T04:41:56.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.827+0000 7f9f99ba6700 1 --2- 172.21.15.62:0/4139090559 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9f940d1f80 0x7f9f940b3b20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9f90009870 tx=0x7f9f90009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f19269264024e28f server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:56.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.827+0000 7f9f98ba4700 1 -- 172.21.15.62:0/4139090559 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f90005e50 con 0x7f9f940d1f80 2023-06-09T04:41:56.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.827+0000 7f9f98ba4700 1 -- 172.21.15.62:0/4139090559 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f90006030 con 0x7f9f940d1f80 2023-06-09T04:41:56.837 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.827+0000 7f9f98ba4700 1 -- 172.21.15.62:0/4139090559 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f900063c0 con 0x7f9f940d1f80 2023-06-09T04:41:56.837 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.831+0000 7f9f9aba8700 1 -- 172.21.15.62:0/4139090559 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9f940d1f80 msgr2=0x7f9f940b3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:56.837 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.831+0000 7f9f9aba8700 1 --2- 172.21.15.62:0/4139090559 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9f940d1f80 0x7f9f940b3b20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9f90009870 tx=0x7f9f90009b80 comp rx=0 tx=0).stop 2023-06-09T04:41:56.837 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.831+0000 7f9f9aba8700 1 -- 172.21.15.62:0/4139090559 shutdown_connections 2023-06-09T04:41:56.837 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.831+0000 7f9f9aba8700 1 --2- 172.21.15.62:0/4139090559 >> v2:172.21.15.89:3300/0 conn(0x7f9f940cd2e0 0x7f9f940d0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:56.837 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.831+0000 7f9f9aba8700 1 --2- 172.21.15.62:0/4139090559 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9f940d1f80 0x7f9f940b3b20 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:56.837 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.831+0000 7f9f9aba8700 1 -- 172.21.15.62:0/4139090559 >> 172.21.15.62:0/4139090559 conn(0x7f9f94071840 msgr2=0x7f9f9409b760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:56.838 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.831+0000 7f9f9aba8700 1 -- 172.21.15.62:0/4139090559 shutdown_connections 2023-06-09T04:41:56.838 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.831+0000 7f9f9aba8700 1 -- 172.21.15.62:0/4139090559 wait complete. 2023-06-09T04:41:56.838 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.831+0000 7f9f9aba8700 1 Processor -- start 2023-06-09T04:41:56.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.831+0000 7f9f9aba8700 1 -- start start 2023-06-09T04:41:56.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.835+0000 7f9f9aba8700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f940cd2e0 0x7f9f94151af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:56.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.835+0000 7f9f9aba8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f940cebf0 0x7f9f940cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:56.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.835+0000 7f9f9aba8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9f940d1f80 0x7f9f940cf720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:56.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.835+0000 7f9f9aba8700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f940cbe70 con 0x7f9f940cebf0 2023-06-09T04:41:56.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.835+0000 7f9f9aba8700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f940b8470 con 0x7f9f940cd2e0 2023-06-09T04:41:56.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.835+0000 7f9f9aba8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f94152030 con 0x7f9f940d1f80 2023-06-09T04:41:56.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.835+0000 7f9f993a5700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f940cebf0 0x7f9f940cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:56.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.835+0000 7f9f993a5700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f940cebf0 0x7f9f940cf1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:44982/0 (socket says 172.21.15.62:44982) 2023-06-09T04:41:56.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.835+0000 7f9f993a5700 1 -- 172.21.15.62:0/1064820176 learned_addr learned my addr 172.21.15.62:0/1064820176 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:56.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.835+0000 7f9f99ba6700 1 --2- 172.21.15.62:0/1064820176 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f940cd2e0 0x7f9f94151af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:56.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.835+0000 7f9f9a3a7700 1 --2- 172.21.15.62:0/1064820176 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9f940d1f80 0x7f9f940cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:56.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.835+0000 7f9f99ba6700 1 -- 172.21.15.62:0/1064820176 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9f940d1f80 msgr2=0x7f9f940cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:56.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.835+0000 7f9f99ba6700 1 --2- 172.21.15.62:0/1064820176 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9f940d1f80 0x7f9f940cf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:56.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.835+0000 7f9f99ba6700 1 -- 172.21.15.62:0/1064820176 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f940cebf0 msgr2=0x7f9f940cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:56.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.835+0000 7f9f99ba6700 1 --2- 172.21.15.62:0/1064820176 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f940cebf0 0x7f9f940cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:56.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.835+0000 7f9f99ba6700 1 -- 172.21.15.62:0/1064820176 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f90009450 con 0x7f9f940cd2e0 2023-06-09T04:41:56.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.835+0000 7f9f993a5700 1 --2- 172.21.15.62:0/1064820176 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f940cebf0 0x7f9f940cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:41:56.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.835+0000 7f9f99ba6700 1 --2- 172.21.15.62:0/1064820176 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f940cd2e0 0x7f9f94151af0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9f90015000 tx=0x7f9f90004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:56.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.835+0000 7f9f8a7fc700 1 -- 172.21.15.62:0/1064820176 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f900065b0 con 0x7f9f940cd2e0 2023-06-09T04:41:56.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.835+0000 7f9f8a7fc700 1 -- 172.21.15.62:0/1064820176 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f90006710 con 0x7f9f940cd2e0 2023-06-09T04:41:56.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.835+0000 7f9f8a7fc700 1 -- 172.21.15.62:0/1064820176 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f900045b0 con 0x7f9f940cd2e0 2023-06-09T04:41:56.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.835+0000 7f9f9aba8700 1 -- 172.21.15.62:0/1064820176 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f940b78f0 con 0x7f9f940cd2e0 2023-06-09T04:41:56.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.835+0000 7f9f9aba8700 1 -- 172.21.15.62:0/1064820176 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f940b7eb0 con 0x7f9f940cd2e0 2023-06-09T04:41:56.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.839+0000 7f9f9aba8700 1 -- 172.21.15.62:0/1064820176 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f940739c0 con 0x7f9f940cd2e0 2023-06-09T04:41:56.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.839+0000 7f9f8a7fc700 1 -- 172.21.15.62:0/1064820176 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9f90022070 con 0x7f9f940cd2e0 2023-06-09T04:41:56.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.839+0000 7f9f8a7fc700 1 --2- 172.21.15.62:0/1064820176 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f9f78066320 0x7f9f780687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:56.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.839+0000 7f9f8a7fc700 1 -- 172.21.15.62:0/1064820176 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9f90085900 con 0x7f9f940cd2e0 2023-06-09T04:41:56.847 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.839+0000 7f9f993a5700 1 --2- 172.21.15.62:0/1064820176 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f9f78066320 0x7f9f780687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:56.847 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.843+0000 7f9f993a5700 1 --2- 172.21.15.62:0/1064820176 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f9f78066320 0x7f9f780687d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9f940b53b0 tx=0x7f9f84007ec0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:56.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:56.847+0000 7f9f8a7fc700 1 -- 172.21.15.62:0/1064820176 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9f90052b60 con 0x7f9f940cd2e0 2023-06-09T04:41:57.024 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.019+0000 7f9f9aba8700 1 -- 172.21.15.62:0/1064820176 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9f940b49b0 con 0x7f9f940cd2e0 2023-06-09T04:41:57.025 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.019+0000 7f9f8a7fc700 1 -- 172.21.15.62:0/1064820176 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9f9002a020 con 0x7f9f940cd2e0 2023-06-09T04:41:57.026 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2023-06-09T04:41:57.030 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.023+0000 7f9f9aba8700 1 -- 172.21.15.62:0/1064820176 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f9f78066320 msgr2=0x7f9f780687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:57.031 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.023+0000 7f9f9aba8700 1 --2- 172.21.15.62:0/1064820176 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f9f78066320 0x7f9f780687d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9f940b53b0 tx=0x7f9f84007ec0 comp rx=0 tx=0).stop 2023-06-09T04:41:57.031 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.023+0000 7f9f9aba8700 1 -- 172.21.15.62:0/1064820176 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f940cd2e0 msgr2=0x7f9f94151af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:57.031 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.023+0000 7f9f9aba8700 1 --2- 172.21.15.62:0/1064820176 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f940cd2e0 0x7f9f94151af0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9f90015000 tx=0x7f9f90004770 comp rx=0 tx=0).stop 2023-06-09T04:41:57.031 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.023+0000 7f9f9aba8700 1 -- 172.21.15.62:0/1064820176 shutdown_connections 2023-06-09T04:41:57.031 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.023+0000 7f9f9aba8700 1 --2- 172.21.15.62:0/1064820176 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f9f78066320 0x7f9f780687d0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:57.031 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.023+0000 7f9f9aba8700 1 --2- 172.21.15.62:0/1064820176 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9f940d1f80 0x7f9f940cf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:57.032 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.023+0000 7f9f9aba8700 1 --2- 172.21.15.62:0/1064820176 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9f940cebf0 0x7f9f940cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:57.032 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.023+0000 7f9f9aba8700 1 --2- 172.21.15.62:0/1064820176 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f940cd2e0 0x7f9f94151af0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:57.032 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.023+0000 7f9f9aba8700 1 -- 172.21.15.62:0/1064820176 >> 172.21.15.62:0/1064820176 conn(0x7f9f94071840 msgr2=0x7f9f9406a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:57.032 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.023+0000 7f9f9aba8700 1 -- 172.21.15.62:0/1064820176 shutdown_connections 2023-06-09T04:41:57.032 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.023+0000 7f9f9aba8700 1 -- 172.21.15.62:0/1064820176 wait complete. 2023-06-09T04:41:57.052 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T04:41:57.232 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.227+0000 7f296e65a700 1 Processor -- start 2023-06-09T04:41:57.232 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.227+0000 7f296e65a700 1 -- start start 2023-06-09T04:41:57.234 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.227+0000 7f296e65a700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f29680cd2e0 0x7f29680b3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:57.234 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.227+0000 7f296e65a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29680cebf0 0x7f29680d0250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:57.235 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.227+0000 7f296e65a700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29680b4d50 con 0x7f29680d1f80 2023-06-09T04:41:57.235 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.227+0000 7f296e65a700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29680cf010 con 0x7f29680cd2e0 2023-06-09T04:41:57.235 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.227+0000 7f296e65a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29680b4140 con 0x7f29680cebf0 2023-06-09T04:41:57.237 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.227+0000 7f296d658700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f29680d1f80 0x7f29680ccbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:39382/0 (socket says 172.21.15.62:39382) 2023-06-09T04:41:57.237 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.227+0000 7f296d658700 1 -- 172.21.15.62:0/4025274721 learned_addr learned my addr 172.21.15.62:0/4025274721 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:41:57.237 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.231+0000 7f296ce57700 1 --2- 172.21.15.62:0/4025274721 >> v2:172.21.15.89:3300/0 conn(0x7f29680cd2e0 0x7f29680b3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:57.238 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.231+0000 7f296de59700 1 --2- 172.21.15.62:0/4025274721 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29680cebf0 0x7f29680d0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:57.238 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.231+0000 7f295ffff700 1 -- 172.21.15.62:0/4025274721 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2690619547 0 0) 0x7f29680b4d50 con 0x7f29680d1f80 2023-06-09T04:41:57.238 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.231+0000 7f295ffff700 1 -- 172.21.15.62:0/4025274721 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29540035d0 con 0x7f29680d1f80 2023-06-09T04:41:57.239 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.231+0000 7f296ce57700 1 -- 172.21.15.62:0/4025274721 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29680cebf0 msgr2=0x7f29680d0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:57.239 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.231+0000 7f296ce57700 1 --2- 172.21.15.62:0/4025274721 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29680cebf0 0x7f29680d0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:57.239 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.231+0000 7f296ce57700 1 -- 172.21.15.62:0/4025274721 >> v1:172.21.15.62:6789/0 conn(0x7f29680d1f80 legacy=0x7f29680ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:57.239 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.231+0000 7f296ce57700 1 -- 172.21.15.62:0/4025274721 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29680b4420 con 0x7f29680cd2e0 2023-06-09T04:41:57.240 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.231+0000 7f296ce57700 1 --2- 172.21.15.62:0/4025274721 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29680cd2e0 0x7f29680b3b20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2958009850 tx=0x7f2958009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4267d77b55498544 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:57.241 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.231+0000 7f295ffff700 1 -- 172.21.15.62:0/4025274721 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2958011830 con 0x7f29680cd2e0 2023-06-09T04:41:57.242 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.231+0000 7f295ffff700 1 -- 172.21.15.62:0/4025274721 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2958011990 con 0x7f29680cd2e0 2023-06-09T04:41:57.242 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.231+0000 7f295ffff700 1 -- 172.21.15.62:0/4025274721 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2958011d40 con 0x7f29680cd2e0 2023-06-09T04:41:57.242 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.231+0000 7f296e65a700 1 -- 172.21.15.62:0/4025274721 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29680cd2e0 msgr2=0x7f29680b3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:57.243 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.231+0000 7f296e65a700 1 --2- 172.21.15.62:0/4025274721 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29680cd2e0 0x7f29680b3b20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2958009850 tx=0x7f2958009b60 comp rx=0 tx=0).stop 2023-06-09T04:41:57.243 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.231+0000 7f296e65a700 1 -- 172.21.15.62:0/4025274721 shutdown_connections 2023-06-09T04:41:57.243 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.231+0000 7f296e65a700 1 --2- 172.21.15.62:0/4025274721 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29680cebf0 0x7f29680d0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:57.243 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.231+0000 7f296e65a700 1 --2- 172.21.15.62:0/4025274721 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29680cd2e0 0x7f29680b3b20 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:57.243 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.231+0000 7f296e65a700 1 -- 172.21.15.62:0/4025274721 >> 172.21.15.62:0/4025274721 conn(0x7f2968071840 msgr2=0x7f296809b760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:57.243 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.231+0000 7f296e65a700 1 -- 172.21.15.62:0/4025274721 shutdown_connections 2023-06-09T04:41:57.244 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.231+0000 7f296e65a700 1 -- 172.21.15.62:0/4025274721 wait complete. 2023-06-09T04:41:57.244 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.235+0000 7f296e65a700 1 Processor -- start 2023-06-09T04:41:57.244 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.235+0000 7f296e65a700 1 -- start start 2023-06-09T04:41:57.245 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.235+0000 7f296e65a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29680cd2e0 0x7f29681f0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:57.245 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.235+0000 7f296e65a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f29680cebf0 0x7f29680b7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:57.245 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.239+0000 7f296e65a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29680d1f80 0x7f29680c75f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:57.245 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.239+0000 7f296e65a700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f296815d3a0 con 0x7f29680cebf0 2023-06-09T04:41:57.246 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.239+0000 7f296e65a700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29680b77e0 con 0x7f29680d1f80 2023-06-09T04:41:57.246 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.239+0000 7f296e65a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29680b7ac0 con 0x7f29680cd2e0 2023-06-09T04:41:57.246 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.239+0000 7f296ce57700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f29680cebf0 0x7f29680b7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:57.246 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.239+0000 7f296ce57700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f29680cebf0 0x7f29680b7150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:44986/0 (socket says 172.21.15.62:44986) 2023-06-09T04:41:57.246 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.239+0000 7f296ce57700 1 -- 172.21.15.62:0/848346940 learned_addr learned my addr 172.21.15.62:0/848346940 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:57.246 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.239+0000 7f296d658700 1 --2- 172.21.15.62:0/848346940 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29680cd2e0 0x7f29681f0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:57.247 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.239+0000 7f296de59700 1 --2- 172.21.15.62:0/848346940 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29680d1f80 0x7f29680c75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:57.247 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.239+0000 7f296ce57700 1 -- 172.21.15.62:0/848346940 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29680cd2e0 msgr2=0x7f29681f0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:57.247 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.239+0000 7f296ce57700 1 --2- 172.21.15.62:0/848346940 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29680cd2e0 0x7f29681f0cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:57.247 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.239+0000 7f296ce57700 1 -- 172.21.15.62:0/848346940 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29680d1f80 msgr2=0x7f29680c75f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:57.247 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.239+0000 7f296ce57700 1 --2- 172.21.15.62:0/848346940 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29680d1f80 0x7f29680c75f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:57.247 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.239+0000 7f296ce57700 1 -- 172.21.15.62:0/848346940 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29580094b0 con 0x7f29680cebf0 2023-06-09T04:41:57.247 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.239+0000 7f296ce57700 1 --2- 172.21.15.62:0/848346940 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f29680cebf0 0x7f29680b7150 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f29580090b0 tx=0x7f2958004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:57.248 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.239+0000 7f295dffb700 1 -- 172.21.15.62:0/848346940 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2958004380 con 0x7f29680cebf0 2023-06-09T04:41:57.248 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.239+0000 7f296e65a700 1 -- 172.21.15.62:0/848346940 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29680b7da0 con 0x7f29680cebf0 2023-06-09T04:41:57.248 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.239+0000 7f295dffb700 1 -- 172.21.15.62:0/848346940 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f295801f070 con 0x7f29680cebf0 2023-06-09T04:41:57.249 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.239+0000 7f295dffb700 1 -- 172.21.15.62:0/848346940 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29580036c0 con 0x7f29680cebf0 2023-06-09T04:41:57.249 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.239+0000 7f296e65a700 1 -- 172.21.15.62:0/848346940 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29680b8080 con 0x7f29680cebf0 2023-06-09T04:41:57.249 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.243+0000 7f296e65a700 1 -- 172.21.15.62:0/848346940 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f296815d510 con 0x7f29680cebf0 2023-06-09T04:41:57.249 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.243+0000 7f295dffb700 1 -- 172.21.15.62:0/848346940 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2958021030 con 0x7f29680cebf0 2023-06-09T04:41:57.251 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.247+0000 7f295dffb700 1 --2- 172.21.15.62:0/848346940 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f294c0662f0 0x7f294c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:57.252 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.247+0000 7f295dffb700 1 -- 172.21.15.62:0/848346940 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2958085450 con 0x7f29680cebf0 2023-06-09T04:41:57.252 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.247+0000 7f296d658700 1 --2- 172.21.15.62:0/848346940 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f294c0662f0 0x7f294c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:57.253 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.247+0000 7f296d658700 1 --2- 172.21.15.62:0/848346940 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f294c0662f0 0x7f294c0687a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2964007b10 tx=0x7f2964007a60 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:57.257 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.251+0000 7f295dffb700 1 -- 172.21.15.62:0/848346940 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2958052630 con 0x7f29680cebf0 2023-06-09T04:41:57.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.423+0000 7f296e65a700 1 -- 172.21.15.62:0/848346940 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f29680739c0 con 0x7f29680cebf0 2023-06-09T04:41:57.430 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.423+0000 7f295dffb700 1 -- 172.21.15.62:0/848346940 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2958006ce0 con 0x7f29680cebf0 2023-06-09T04:41:57.430 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-06-09T04:41:57.433 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.427+0000 7f296e65a700 1 -- 172.21.15.62:0/848346940 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f294c0662f0 msgr2=0x7f294c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:57.433 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.427+0000 7f296e65a700 1 --2- 172.21.15.62:0/848346940 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f294c0662f0 0x7f294c0687a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2964007b10 tx=0x7f2964007a60 comp rx=0 tx=0).stop 2023-06-09T04:41:57.433 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.427+0000 7f296e65a700 1 -- 172.21.15.62:0/848346940 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f29680cebf0 msgr2=0x7f29680b7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:57.433 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.427+0000 7f296e65a700 1 --2- 172.21.15.62:0/848346940 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f29680cebf0 0x7f29680b7150 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f29580090b0 tx=0x7f2958004770 comp rx=0 tx=0).stop 2023-06-09T04:41:57.433 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.427+0000 7f296e65a700 1 -- 172.21.15.62:0/848346940 shutdown_connections 2023-06-09T04:41:57.434 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.427+0000 7f296e65a700 1 --2- 172.21.15.62:0/848346940 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f294c0662f0 0x7f294c0687a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:57.434 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.427+0000 7f296e65a700 1 --2- 172.21.15.62:0/848346940 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29680d1f80 0x7f29680c75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:57.434 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.427+0000 7f296e65a700 1 --2- 172.21.15.62:0/848346940 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f29680cebf0 0x7f29680b7150 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:57.434 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.427+0000 7f296e65a700 1 --2- 172.21.15.62:0/848346940 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f29680cd2e0 0x7f29681f0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:57.434 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.427+0000 7f296e65a700 1 -- 172.21.15.62:0/848346940 >> 172.21.15.62:0/848346940 conn(0x7f2968071840 msgr2=0x7f29680d2350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:57.434 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.427+0000 7f296e65a700 1 -- 172.21.15.62:0/848346940 shutdown_connections 2023-06-09T04:41:57.435 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.427+0000 7f296e65a700 1 -- 172.21.15.62:0/848346940 wait complete. 2023-06-09T04:41:57.457 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T04:41:57.640 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.635+0000 7fe4f9f81700 1 Processor -- start 2023-06-09T04:41:57.641 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.635+0000 7fe4f9f81700 1 -- start start 2023-06-09T04:41:57.643 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.635+0000 7fe4f9f81700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe4f4159e10 0x7fe4f40b09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:57.643 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.639+0000 7fe4f9f81700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe4f415e500 0x7fe4f40b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:57.644 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.639+0000 7fe4f9f81700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4f40cda40 con 0x7fe4f415e090 2023-06-09T04:41:57.644 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.639+0000 7fe4f9f81700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4f40cd830 con 0x7fe4f415e500 2023-06-09T04:41:57.644 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.639+0000 7fe4f9f81700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f40cdd20 con 0x7fe4f4159e10 2023-06-09T04:41:57.645 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.639+0000 7fe4f3fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe4f415e500 0x7fe4f40b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:57.645 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.639+0000 7fe4f3fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe4f415e500 0x7fe4f40b31c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:44998/0 (socket says 172.21.15.62:44998) 2023-06-09T04:41:57.645 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.639+0000 7fe4f3fff700 1 -- 172.21.15.62:0/431046147 learned_addr learned my addr 172.21.15.62:0/431046147 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:57.645 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.639+0000 7fe4f37fe700 1 --2- 172.21.15.62:0/431046147 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe4f4159e10 0x7fe4f40b09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:57.646 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.639+0000 7fe4f3fff700 1 -- 172.21.15.62:0/431046147 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe4f4159e10 msgr2=0x7fe4f40b09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:57.646 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.639+0000 7fe4f3fff700 1 --2- 172.21.15.62:0/431046147 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe4f4159e10 0x7fe4f40b09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:57.646 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.639+0000 7fe4f3fff700 1 -- 172.21.15.62:0/431046147 >> v1:172.21.15.89:6789/0 conn(0x7fe4f415e090 legacy=0x7fe4f40b2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:57.646 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.639+0000 7fe4f3fff700 1 -- 172.21.15.62:0/431046147 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4f415d890 con 0x7fe4f415e500 2023-06-09T04:41:57.646 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.639+0000 7fe4f3fff700 1 --2- 172.21.15.62:0/431046147 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4f415e500 0x7fe4f40b31c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec009e50 tx=0x7fe4ec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2b42225d58e157b server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:57.647 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.639+0000 7fe4f27fc700 1 -- 172.21.15.62:0/431046147 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4ec00e070 con 0x7fe4f415e500 2023-06-09T04:41:57.647 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.639+0000 7fe4f27fc700 1 -- 172.21.15.62:0/431046147 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4ec00b9c0 con 0x7fe4f415e500 2023-06-09T04:41:57.647 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.639+0000 7fe4f27fc700 1 -- 172.21.15.62:0/431046147 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4ec00bd70 con 0x7fe4f415e500 2023-06-09T04:41:57.647 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.639+0000 7fe4f9f81700 1 -- 172.21.15.62:0/431046147 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4f415e500 msgr2=0x7fe4f40b31c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:57.648 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.639+0000 7fe4f9f81700 1 --2- 172.21.15.62:0/431046147 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4f415e500 0x7fe4f40b31c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec009e50 tx=0x7fe4ec00b330 comp rx=0 tx=0).stop 2023-06-09T04:41:57.648 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.639+0000 7fe4f9f81700 1 -- 172.21.15.62:0/431046147 shutdown_connections 2023-06-09T04:41:57.648 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.639+0000 7fe4f9f81700 1 --2- 172.21.15.62:0/431046147 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4f415e500 0x7fe4f40b31c0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:57.648 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.639+0000 7fe4f9f81700 1 --2- 172.21.15.62:0/431046147 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe4f4159e10 0x7fe4f40b09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:57.648 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.639+0000 7fe4f9f81700 1 -- 172.21.15.62:0/431046147 >> 172.21.15.62:0/431046147 conn(0x7fe4f406c5d0 msgr2=0x7fe4f40cad60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:57.648 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.639+0000 7fe4f9f81700 1 -- 172.21.15.62:0/431046147 shutdown_connections 2023-06-09T04:41:57.649 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.643+0000 7fe4f9f81700 1 -- 172.21.15.62:0/431046147 wait complete. 2023-06-09T04:41:57.649 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.643+0000 7fe4f9f81700 1 Processor -- start 2023-06-09T04:41:57.649 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.643+0000 7fe4f9f81700 1 -- start start 2023-06-09T04:41:57.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.643+0000 7fe4f9f81700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe4f4159e10 0x7fe4f4148280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:57.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.647+0000 7fe4f9f81700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe4f415e090 0x7fe4f40c9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:57.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.647+0000 7fe4f9f81700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4f415e500 0x7fe4f40cbe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:57.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.647+0000 7fe4f9f81700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f4147e60 con 0x7fe4f415e500 2023-06-09T04:41:57.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.647+0000 7fe4f9f81700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f4156990 con 0x7fe4f4159e10 2023-06-09T04:41:57.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.647+0000 7fe4f9f81700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f41f5920 con 0x7fe4f415e090 2023-06-09T04:41:57.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.647+0000 7fe4f3fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4f415e500 0x7fe4f40cbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:57.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.647+0000 7fe4f3fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4f415e500 0x7fe4f40cbe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:45006/0 (socket says 172.21.15.62:45006) 2023-06-09T04:41:57.654 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.647+0000 7fe4f3fff700 1 -- 172.21.15.62:0/2446938782 learned_addr learned my addr 172.21.15.62:0/2446938782 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:57.654 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.647+0000 7fe4f37fe700 1 --2- 172.21.15.62:0/2446938782 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe4f4159e10 0x7fe4f4148280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:57.654 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.647+0000 7fe4f2ffd700 1 --2- 172.21.15.62:0/2446938782 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe4f415e090 0x7fe4f40c9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:57.654 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.647+0000 7fe4f3fff700 1 -- 172.21.15.62:0/2446938782 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe4f415e090 msgr2=0x7fe4f40c9bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:57.654 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.647+0000 7fe4f3fff700 1 --2- 172.21.15.62:0/2446938782 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe4f415e090 0x7fe4f40c9bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:57.654 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.647+0000 7fe4f3fff700 1 -- 172.21.15.62:0/2446938782 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe4f4159e10 msgr2=0x7fe4f4148280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:57.654 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.647+0000 7fe4f3fff700 1 --2- 172.21.15.62:0/2446938782 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe4f4159e10 0x7fe4f4148280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:57.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.647+0000 7fe4f3fff700 1 -- 172.21.15.62:0/2446938782 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4ec009b30 con 0x7fe4f415e500 2023-06-09T04:41:57.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.647+0000 7fe4f37fe700 1 --2- 172.21.15.62:0/2446938782 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe4f4159e10 0x7fe4f4148280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:41:57.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.647+0000 7fe4f3fff700 1 --2- 172.21.15.62:0/2446938782 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4f415e500 0x7fe4f40cbe00 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fe4f4066ce0 tx=0x7fe4ec004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:57.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.647+0000 7fe4dbfff700 1 -- 172.21.15.62:0/2446938782 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4ec004960 con 0x7fe4f415e500 2023-06-09T04:41:57.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.647+0000 7fe4dbfff700 1 -- 172.21.15.62:0/2446938782 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4ec0099b0 con 0x7fe4f415e500 2023-06-09T04:41:57.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.647+0000 7fe4dbfff700 1 -- 172.21.15.62:0/2446938782 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4ec01c680 con 0x7fe4f415e500 2023-06-09T04:41:57.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.647+0000 7fe4f9f81700 1 -- 172.21.15.62:0/2446938782 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4f40ca0f0 con 0x7fe4f415e500 2023-06-09T04:41:57.656 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.647+0000 7fe4f9f81700 1 -- 172.21.15.62:0/2446938782 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4f41477a0 con 0x7fe4f415e500 2023-06-09T04:41:57.656 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.651+0000 7fe4f9f81700 1 -- 172.21.15.62:0/2446938782 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4f4147fa0 con 0x7fe4f415e500 2023-06-09T04:41:57.656 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.651+0000 7fe4dbfff700 1 -- 172.21.15.62:0/2446938782 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe4ec01c7e0 con 0x7fe4f415e500 2023-06-09T04:41:57.657 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.651+0000 7fe4dbfff700 1 --2- 172.21.15.62:0/2446938782 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fe4e00662f0 0x7fe4e00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:57.657 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.651+0000 7fe4dbfff700 1 -- 172.21.15.62:0/2446938782 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe4ec085cc0 con 0x7fe4f415e500 2023-06-09T04:41:57.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.651+0000 7fe4f37fe700 1 --2- 172.21.15.62:0/2446938782 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fe4e00662f0 0x7fe4e00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:57.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.655+0000 7fe4f37fe700 1 --2- 172.21.15.62:0/2446938782 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fe4e00662f0 0x7fe4e00687a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe4e4009a10 tx=0x7fe4e4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:57.664 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.659+0000 7fe4dbfff700 1 -- 172.21.15.62:0/2446938782 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe4f4147fa0 con 0x7fe4f415e500 2023-06-09T04:41:57.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.831+0000 7fe4f9f81700 1 -- 172.21.15.62:0/2446938782 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe4f4147fa0 con 0x7fe4f415e500 2023-06-09T04:41:57.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.835+0000 7fe4dbfff700 1 -- 172.21.15.62:0/2446938782 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe4f4147fa0 con 0x7fe4f415e500 2023-06-09T04:41:57.840 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 64 2023-06-09T04:41:57.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.839+0000 7fe4f9f81700 1 -- 172.21.15.62:0/2446938782 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fe4e00662f0 msgr2=0x7fe4e00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:57.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.839+0000 7fe4f9f81700 1 --2- 172.21.15.62:0/2446938782 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fe4e00662f0 0x7fe4e00687a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe4e4009a10 tx=0x7fe4e4008040 comp rx=0 tx=0).stop 2023-06-09T04:41:57.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.839+0000 7fe4f9f81700 1 -- 172.21.15.62:0/2446938782 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4f415e500 msgr2=0x7fe4f40cbe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:57.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.839+0000 7fe4f9f81700 1 --2- 172.21.15.62:0/2446938782 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4f415e500 0x7fe4f40cbe00 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fe4f4066ce0 tx=0x7fe4ec004af0 comp rx=0 tx=0).stop 2023-06-09T04:41:57.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.839+0000 7fe4f9f81700 1 -- 172.21.15.62:0/2446938782 shutdown_connections 2023-06-09T04:41:57.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.839+0000 7fe4f9f81700 1 --2- 172.21.15.62:0/2446938782 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fe4e00662f0 0x7fe4e00687a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:57.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.839+0000 7fe4f9f81700 1 --2- 172.21.15.62:0/2446938782 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4f415e500 0x7fe4f40cbe00 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:57.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.839+0000 7fe4f9f81700 1 --2- 172.21.15.62:0/2446938782 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe4f415e090 0x7fe4f40c9bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:57.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.839+0000 7fe4f9f81700 1 --2- 172.21.15.62:0/2446938782 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe4f4159e10 0x7fe4f4148280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:57.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.839+0000 7fe4f9f81700 1 -- 172.21.15.62:0/2446938782 >> 172.21.15.62:0/2446938782 conn(0x7fe4f406c5d0 msgr2=0x7fe4f40b15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:57.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.839+0000 7fe4f9f81700 1 -- 172.21.15.62:0/2446938782 shutdown_connections 2023-06-09T04:41:57.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:57.839+0000 7fe4f9f81700 1 -- 172.21.15.62:0/2446938782 wait complete. 2023-06-09T04:41:57.867 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-09T04:41:58.044 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.039+0000 7f2032da1700 1 Processor -- start 2023-06-09T04:41:58.045 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.039+0000 7f2032da1700 1 -- start start 2023-06-09T04:41:58.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.043+0000 7f2032da1700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f202c0b3ed0 0x7f202c0b42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:58.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.043+0000 7f2032da1700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f202c0d1090 0x7f202c0ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:58.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.043+0000 7f2032da1700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f202c0d0c00 con 0x7f202c0cf0e0 2023-06-09T04:41:58.048 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.043+0000 7f2032da1700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f202c0b1b30 con 0x7f202c0b3ed0 2023-06-09T04:41:58.048 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.043+0000 7f2032da1700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f202c0b47e0 con 0x7f202c0d1090 2023-06-09T04:41:58.048 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.043+0000 7f2031d9f700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f202c0b3ed0 0x7f202c0b42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:58.049 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.043+0000 7f20325a0700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f202c0cf0e0 0x7f202c0b52a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.62:47944/0 (socket says 172.21.15.62:47944) 2023-06-09T04:41:58.049 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.043+0000 7f20325a0700 1 -- 172.21.15.62:0/300775638 learned_addr learned my addr 172.21.15.62:0/300775638 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:41:58.049 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.043+0000 7f203159e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f202c0d1090 0x7f202c0ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:58.049 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.043+0000 7f2030d9d700 1 -- 172.21.15.62:0/300775638 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2864852011 0 0) 0x7f202c0d0c00 con 0x7f202c0cf0e0 2023-06-09T04:41:58.050 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.043+0000 7f2030d9d700 1 -- 172.21.15.62:0/300775638 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20180035d0 con 0x7f202c0cf0e0 2023-06-09T04:41:58.050 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.043+0000 7f2031d9f700 1 -- 172.21.15.62:0/300775638 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f202c0d1090 msgr2=0x7f202c0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:58.050 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.043+0000 7f2031d9f700 1 --2- 172.21.15.62:0/300775638 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f202c0d1090 0x7f202c0ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:58.050 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.043+0000 7f2031d9f700 1 -- 172.21.15.62:0/300775638 >> v1:172.21.15.89:6789/0 conn(0x7f202c0cf0e0 legacy=0x7f202c0b52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:58.050 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.043+0000 7f2031d9f700 1 -- 172.21.15.62:0/300775638 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f202c0cf940 con 0x7f202c0b3ed0 2023-06-09T04:41:58.050 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.043+0000 7f203159e700 1 --2- 172.21.15.62:0/300775638 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f202c0d1090 0x7f202c0ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:41:58.051 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.043+0000 7f2031d9f700 1 --2- 172.21.15.62:0/300775638 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f202c0b3ed0 0x7f202c0b42a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2028009850 tx=0x7f2028009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3666676620b5907 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:58.051 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.043+0000 7f2030d9d700 1 -- 172.21.15.62:0/300775638 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2028011830 con 0x7f202c0b3ed0 2023-06-09T04:41:58.051 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.047+0000 7f2030d9d700 1 -- 172.21.15.62:0/300775638 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2028011990 con 0x7f202c0b3ed0 2023-06-09T04:41:58.051 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.047+0000 7f2030d9d700 1 -- 172.21.15.62:0/300775638 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2028011d40 con 0x7f202c0b3ed0 2023-06-09T04:41:58.052 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.047+0000 7f2032da1700 1 -- 172.21.15.62:0/300775638 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f202c0b3ed0 msgr2=0x7f202c0b42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:58.052 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.047+0000 7f2032da1700 1 --2- 172.21.15.62:0/300775638 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f202c0b3ed0 0x7f202c0b42a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2028009850 tx=0x7f2028009b60 comp rx=0 tx=0).stop 2023-06-09T04:41:58.053 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.047+0000 7f2032da1700 1 -- 172.21.15.62:0/300775638 shutdown_connections 2023-06-09T04:41:58.053 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.047+0000 7f2032da1700 1 --2- 172.21.15.62:0/300775638 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f202c0d1090 0x7f202c0ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:58.053 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.047+0000 7f2032da1700 1 --2- 172.21.15.62:0/300775638 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f202c0b3ed0 0x7f202c0b42a0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:58.053 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.047+0000 7f2032da1700 1 -- 172.21.15.62:0/300775638 >> 172.21.15.62:0/300775638 conn(0x7f202c06a500 msgr2=0x7f202c06a900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:58.053 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.047+0000 7f2032da1700 1 -- 172.21.15.62:0/300775638 shutdown_connections 2023-06-09T04:41:58.053 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.047+0000 7f2032da1700 1 -- 172.21.15.62:0/300775638 wait complete. 2023-06-09T04:41:58.057 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.051+0000 7f2032da1700 1 Processor -- start 2023-06-09T04:41:58.057 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.051+0000 7f2032da1700 1 -- start start 2023-06-09T04:41:58.058 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.051+0000 7f2032da1700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f202c0b3ed0 0x7f202c1f52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:58.059 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.051+0000 7f2032da1700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f202c0cf0e0 0x7f202c0b0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:58.059 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.051+0000 7f2032da1700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f202c0d1090 0x7f202c1f1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:58.059 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.051+0000 7f2032da1700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f202c1f4820 con 0x7f202c0cf0e0 2023-06-09T04:41:58.059 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.051+0000 7f2032da1700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f202c0cd010 con 0x7f202c0b3ed0 2023-06-09T04:41:58.059 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.051+0000 7f2032da1700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f202c0cd2f0 con 0x7f202c0d1090 2023-06-09T04:41:58.060 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.051+0000 7f203159e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f202c0cf0e0 0x7f202c0b0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:58.060 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.055+0000 7f203159e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f202c0cf0e0 0x7f202c0b0d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:45016/0 (socket says 172.21.15.62:45016) 2023-06-09T04:41:58.060 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.055+0000 7f203159e700 1 -- 172.21.15.62:0/603297243 learned_addr learned my addr 172.21.15.62:0/603297243 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:58.061 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.055+0000 7f2031d9f700 1 --2- 172.21.15.62:0/603297243 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f202c0b3ed0 0x7f202c1f52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:58.061 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.055+0000 7f20325a0700 1 --2- 172.21.15.62:0/603297243 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f202c0d1090 0x7f202c1f1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:58.061 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.055+0000 7f203159e700 1 -- 172.21.15.62:0/603297243 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f202c0d1090 msgr2=0x7f202c1f1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:58.061 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.055+0000 7f203159e700 1 --2- 172.21.15.62:0/603297243 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f202c0d1090 0x7f202c1f1c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:58.061 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.055+0000 7f203159e700 1 -- 172.21.15.62:0/603297243 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f202c0b3ed0 msgr2=0x7f202c1f52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:58.061 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.055+0000 7f203159e700 1 --2- 172.21.15.62:0/603297243 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f202c0b3ed0 0x7f202c1f52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:58.061 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.055+0000 7f203159e700 1 -- 172.21.15.62:0/603297243 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f201c0094b0 con 0x7f202c0cf0e0 2023-06-09T04:41:58.062 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.055+0000 7f20325a0700 1 --2- 172.21.15.62:0/603297243 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f202c0d1090 0x7f202c1f1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:41:58.062 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.055+0000 7f203159e700 1 --2- 172.21.15.62:0/603297243 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f202c0cf0e0 0x7f202c0b0d30 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f201c00ebe0 tx=0x7f201c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:58.062 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.055+0000 7f20227fc700 1 -- 172.21.15.62:0/603297243 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201c00c850 con 0x7f202c0cf0e0 2023-06-09T04:41:58.062 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.055+0000 7f20227fc700 1 -- 172.21.15.62:0/603297243 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f201c00c9b0 con 0x7f202c0cf0e0 2023-06-09T04:41:58.063 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.055+0000 7f20227fc700 1 -- 172.21.15.62:0/603297243 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201c00cd40 con 0x7f202c0cf0e0 2023-06-09T04:41:58.063 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.055+0000 7f2032da1700 1 -- 172.21.15.62:0/603297243 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20280094b0 con 0x7f202c0cf0e0 2023-06-09T04:41:58.063 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.055+0000 7f2032da1700 1 -- 172.21.15.62:0/603297243 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f202c1f4dc0 con 0x7f202c0cf0e0 2023-06-09T04:41:58.063 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.059+0000 7f2032da1700 1 -- 172.21.15.62:0/603297243 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f202c0739c0 con 0x7f202c0cf0e0 2023-06-09T04:41:58.065 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.059+0000 7f20227fc700 1 -- 172.21.15.62:0/603297243 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f201c013470 con 0x7f202c0cf0e0 2023-06-09T04:41:58.067 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.059+0000 7f20227fc700 1 --2- 172.21.15.62:0/603297243 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f20100662f0 0x7f20100687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:58.067 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.063+0000 7f20227fc700 1 -- 172.21.15.62:0/603297243 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f201c0841b0 con 0x7f202c0cf0e0 2023-06-09T04:41:58.068 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.063+0000 7f2031d9f700 1 --2- 172.21.15.62:0/603297243 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f20100662f0 0x7f20100687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:58.069 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.063+0000 7f2031d9f700 1 --2- 172.21.15.62:0/603297243 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f20100662f0 0x7f20100687a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f20280090b0 tx=0x7f2028008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:58.074 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.067+0000 7f20227fc700 1 -- 172.21.15.62:0/603297243 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f201c051260 con 0x7f202c0cf0e0 2023-06-09T04:41:58.248 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.243+0000 7f2032da1700 1 -- 172.21.15.62:0/603297243 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f202c0d32b0 con 0x7f202c0cf0e0 2023-06-09T04:41:58.248 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.243+0000 7f20227fc700 1 -- 172.21.15.62:0/603297243 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7f201c00cea0 con 0x7f202c0cf0e0 2023-06-09T04:41:58.249 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-06-09T04:41:58.251 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.247+0000 7f2032da1700 1 -- 172.21.15.62:0/603297243 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f20100662f0 msgr2=0x7f20100687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:58.252 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.247+0000 7f2032da1700 1 --2- 172.21.15.62:0/603297243 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f20100662f0 0x7f20100687a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f20280090b0 tx=0x7f2028008030 comp rx=0 tx=0).stop 2023-06-09T04:41:58.252 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.247+0000 7f2032da1700 1 -- 172.21.15.62:0/603297243 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f202c0cf0e0 msgr2=0x7f202c0b0d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:58.252 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.247+0000 7f2032da1700 1 --2- 172.21.15.62:0/603297243 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f202c0cf0e0 0x7f202c0b0d30 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f201c00ebe0 tx=0x7f201c00eef0 comp rx=0 tx=0).stop 2023-06-09T04:41:58.252 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.247+0000 7f2032da1700 1 -- 172.21.15.62:0/603297243 shutdown_connections 2023-06-09T04:41:58.252 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.247+0000 7f2032da1700 1 --2- 172.21.15.62:0/603297243 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f20100662f0 0x7f20100687a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:58.252 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.247+0000 7f2032da1700 1 --2- 172.21.15.62:0/603297243 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f202c0d1090 0x7f202c1f1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:58.253 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.247+0000 7f2032da1700 1 --2- 172.21.15.62:0/603297243 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f202c0cf0e0 0x7f202c0b0d30 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:58.253 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.247+0000 7f2032da1700 1 --2- 172.21.15.62:0/603297243 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f202c0b3ed0 0x7f202c1f52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:58.253 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.247+0000 7f2032da1700 1 -- 172.21.15.62:0/603297243 >> 172.21.15.62:0/603297243 conn(0x7f202c06a500 msgr2=0x7f202c15b870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:58.253 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.247+0000 7f2032da1700 1 -- 172.21.15.62:0/603297243 shutdown_connections 2023-06-09T04:41:58.253 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.247+0000 7f2032da1700 1 -- 172.21.15.62:0/603297243 wait complete. 2023-06-09T04:41:58.281 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-06-09T04:41:58.282 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2023-06-09T04:41:58.460 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.455+0000 7fbfe318b700 1 Processor -- start 2023-06-09T04:41:58.460 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.455+0000 7fbfe318b700 1 -- start start 2023-06-09T04:41:58.462 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.455+0000 7fbfe318b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbfdc159910 0x7fbfdc0c8680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:58.462 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.455+0000 7fbfe318b700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfdc0cbf30 con 0x7fbfdc0ad1a0 2023-06-09T04:41:58.462 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.455+0000 7fbfe318b700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfdc15c640 con 0x7fbfdc0cacf0 2023-06-09T04:41:58.462 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.455+0000 7fbfe318b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfdc15d1c0 con 0x7fbfdc159910 2023-06-09T04:41:58.464 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.455+0000 7fbfe1988700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fbfdc0ad1a0 0x7fbfdc0ca5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:39386/0 (socket says 172.21.15.62:39386) 2023-06-09T04:41:58.464 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.455+0000 7fbfe1988700 1 -- 172.21.15.62:0/1491935132 learned_addr learned my addr 172.21.15.62:0/1491935132 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:41:58.464 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.455+0000 7fbfe2189700 1 --2- 172.21.15.62:0/1491935132 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbfdc159910 0x7fbfdc0c8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:58.465 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.459+0000 7fbfe1187700 1 -- 172.21.15.62:0/1491935132 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3324809090 0 0) 0x7fbfdc0cbf30 con 0x7fbfdc0ad1a0 2023-06-09T04:41:58.465 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.459+0000 7fbfe1187700 1 -- 172.21.15.62:0/1491935132 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbfc80035d0 con 0x7fbfdc0ad1a0 2023-06-09T04:41:58.465 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.459+0000 7fbfe1187700 1 -- 172.21.15.62:0/1491935132 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1608582796 0 0) 0x7fbfdc15c640 con 0x7fbfdc0cacf0 2023-06-09T04:41:58.465 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.459+0000 7fbfe1187700 1 -- 172.21.15.62:0/1491935132 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbfdc0cbf30 con 0x7fbfdc0cacf0 2023-06-09T04:41:58.466 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.459+0000 7fbfe2189700 1 -- 172.21.15.62:0/1491935132 >> v1:172.21.15.89:6789/0 conn(0x7fbfdc0cacf0 legacy=0x7fbfdc15fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:58.466 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.459+0000 7fbfe2189700 1 -- 172.21.15.62:0/1491935132 >> v1:172.21.15.62:6789/0 conn(0x7fbfdc0ad1a0 legacy=0x7fbfdc0ca5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:58.466 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.459+0000 7fbfe2189700 1 -- 172.21.15.62:0/1491935132 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfdc15c920 con 0x7fbfdc159910 2023-06-09T04:41:58.468 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.459+0000 7fbfe2189700 1 --2- 172.21.15.62:0/1491935132 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbfdc159910 0x7fbfdc0c8680 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbfd8009dc0 tx=0x7fbfd800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b44805dcf7d40bc server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:58.468 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.459+0000 7fbfe1187700 1 -- 172.21.15.62:0/1491935132 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd800e070 con 0x7fbfdc159910 2023-06-09T04:41:58.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.459+0000 7fbfe1187700 1 -- 172.21.15.62:0/1491935132 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfd800bb20 con 0x7fbfdc159910 2023-06-09T04:41:58.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.459+0000 7fbfe1187700 1 -- 172.21.15.62:0/1491935132 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd8012430 con 0x7fbfdc159910 2023-06-09T04:41:58.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.459+0000 7fbfe318b700 1 -- 172.21.15.62:0/1491935132 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbfdc159910 msgr2=0x7fbfdc0c8680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:58.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.459+0000 7fbfe318b700 1 --2- 172.21.15.62:0/1491935132 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbfdc159910 0x7fbfdc0c8680 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbfd8009dc0 tx=0x7fbfd800b330 comp rx=0 tx=0).stop 2023-06-09T04:41:58.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.459+0000 7fbfe318b700 1 -- 172.21.15.62:0/1491935132 shutdown_connections 2023-06-09T04:41:58.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.459+0000 7fbfe318b700 1 --2- 172.21.15.62:0/1491935132 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbfdc159910 0x7fbfdc0c8680 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:58.470 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.459+0000 7fbfe318b700 1 -- 172.21.15.62:0/1491935132 >> 172.21.15.62:0/1491935132 conn(0x7fbfdc06a420 msgr2=0x7fbfdc0afc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:58.470 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.459+0000 7fbfe318b700 1 -- 172.21.15.62:0/1491935132 shutdown_connections 2023-06-09T04:41:58.470 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.459+0000 7fbfe318b700 1 -- 172.21.15.62:0/1491935132 wait complete. 2023-06-09T04:41:58.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.463+0000 7fbfe318b700 1 Processor -- start 2023-06-09T04:41:58.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.463+0000 7fbfe318b700 1 -- start start 2023-06-09T04:41:58.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.463+0000 7fbfe318b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbfdc0cacf0 0x7fbfdc154530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:58.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.463+0000 7fbfe318b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbfdc159910 0x7fbfdc0c26e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:58.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.463+0000 7fbfe318b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbfdc0c2c20 0x7fbfdc0c3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:58.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.463+0000 7fbfe318b700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfdc0714b0 con 0x7fbfdc159910 2023-06-09T04:41:58.472 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.463+0000 7fbfe318b700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfdc071790 con 0x7fbfdc0c2c20 2023-06-09T04:41:58.472 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.463+0000 7fbfe318b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfdc0c1c00 con 0x7fbfdc0cacf0 2023-06-09T04:41:58.472 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.463+0000 7fbfe2189700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbfdc0cacf0 0x7fbfdc154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:58.472 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.463+0000 7fbfe1988700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbfdc159910 0x7fbfdc0c26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:58.472 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.463+0000 7fbfe2189700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbfdc0cacf0 0x7fbfdc154530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.62:35826/0 (socket says 172.21.15.62:35826) 2023-06-09T04:41:58.472 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.463+0000 7fbfe2189700 1 -- 172.21.15.62:0/1760318495 learned_addr learned my addr 172.21.15.62:0/1760318495 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:58.472 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.463+0000 7fbfe298a700 1 --2- 172.21.15.62:0/1760318495 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbfdc0c2c20 0x7fbfdc0c3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:58.473 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.467+0000 7fbfe2189700 1 -- 172.21.15.62:0/1760318495 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbfdc0c2c20 msgr2=0x7fbfdc0c3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:58.474 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.467+0000 7fbfe2189700 1 --2- 172.21.15.62:0/1760318495 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbfdc0c2c20 0x7fbfdc0c3400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:58.474 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.467+0000 7fbfe2189700 1 -- 172.21.15.62:0/1760318495 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbfdc159910 msgr2=0x7fbfdc0c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:58.474 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.467+0000 7fbfe2189700 1 --2- 172.21.15.62:0/1760318495 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbfdc159910 0x7fbfdc0c26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:58.474 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.467+0000 7fbfe2189700 1 -- 172.21.15.62:0/1760318495 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd8009a70 con 0x7fbfdc0cacf0 2023-06-09T04:41:58.474 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.467+0000 7fbfe2189700 1 --2- 172.21.15.62:0/1760318495 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbfdc0cacf0 0x7fbfdc154530 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbfd8014040 tx=0x7fbfd8004af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:58.474 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.467+0000 7fbfd2ffd700 1 -- 172.21.15.62:0/1760318495 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd8012430 con 0x7fbfdc0cacf0 2023-06-09T04:41:58.474 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.467+0000 7fbfd2ffd700 1 -- 172.21.15.62:0/1760318495 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfd8020070 con 0x7fbfdc0cacf0 2023-06-09T04:41:58.475 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.467+0000 7fbfe318b700 1 -- 172.21.15.62:0/1760318495 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfdc0c1ee0 con 0x7fbfdc0cacf0 2023-06-09T04:41:58.475 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.467+0000 7fbfd2ffd700 1 -- 172.21.15.62:0/1760318495 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfd801ba70 con 0x7fbfdc0cacf0 2023-06-09T04:41:58.475 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.467+0000 7fbfe318b700 1 -- 172.21.15.62:0/1760318495 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfdc154a70 con 0x7fbfdc0cacf0 2023-06-09T04:41:58.475 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.467+0000 7fbfe318b700 1 -- 172.21.15.62:0/1760318495 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfdc0739c0 con 0x7fbfdc0cacf0 2023-06-09T04:41:58.476 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.471+0000 7fbfd2ffd700 1 -- 172.21.15.62:0/1760318495 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbfd801bbd0 con 0x7fbfdc0cacf0 2023-06-09T04:41:58.478 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.471+0000 7fbfd2ffd700 1 --2- 172.21.15.62:0/1760318495 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fbfc00662f0 0x7fbfc00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:58.478 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.471+0000 7fbfd2ffd700 1 -- 172.21.15.62:0/1760318495 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fbfd8022070 con 0x7fbfdc0cacf0 2023-06-09T04:41:58.478 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.471+0000 7fbfe1988700 1 --2- 172.21.15.62:0/1760318495 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fbfc00662f0 0x7fbfc00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:58.479 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.475+0000 7fbfe1988700 1 --2- 172.21.15.62:0/1760318495 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fbfc00662f0 0x7fbfc00687a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc0abc40 tx=0x7fbfcc007e20 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:58.485 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.479+0000 7fbfd2ffd700 1 -- 172.21.15.62:0/1760318495 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbfd8053900 con 0x7fbfdc0cacf0 2023-06-09T04:41:58.724 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:58.719+0000 7fbfe318b700 1 -- 172.21.15.62:0/1760318495 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7fbfdc0b09e0 con 0x7fbfdc0cacf0 2023-06-09T04:41:59.727 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:59.719+0000 7fbfd2ffd700 1 -- 172.21.15.62:0/1760318495 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v81) v1 ==== 147+0+0 (secure 0 0 0) 0x7fbfd8056f20 con 0x7fbfdc0cacf0 2023-06-09T04:41:59.730 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:59.723+0000 7fbfe318b700 1 -- 172.21.15.62:0/1760318495 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fbfc00662f0 msgr2=0x7fbfc00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:59.730 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:59.723+0000 7fbfe318b700 1 --2- 172.21.15.62:0/1760318495 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fbfc00662f0 0x7fbfc00687a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fbfdc0abc40 tx=0x7fbfcc007e20 comp rx=0 tx=0).stop 2023-06-09T04:41:59.731 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:59.723+0000 7fbfe318b700 1 -- 172.21.15.62:0/1760318495 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbfdc0cacf0 msgr2=0x7fbfdc154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:59.731 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:59.723+0000 7fbfe318b700 1 --2- 172.21.15.62:0/1760318495 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbfdc0cacf0 0x7fbfdc154530 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbfd8014040 tx=0x7fbfd8004af0 comp rx=0 tx=0).stop 2023-06-09T04:41:59.731 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:59.723+0000 7fbfe318b700 1 -- 172.21.15.62:0/1760318495 shutdown_connections 2023-06-09T04:41:59.731 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:59.723+0000 7fbfe318b700 1 --2- 172.21.15.62:0/1760318495 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fbfc00662f0 0x7fbfc00687a0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:59.732 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:59.723+0000 7fbfe318b700 1 --2- 172.21.15.62:0/1760318495 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbfdc0c2c20 0x7fbfdc0c3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:59.732 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:59.723+0000 7fbfe318b700 1 --2- 172.21.15.62:0/1760318495 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbfdc159910 0x7fbfdc0c26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:59.732 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:59.723+0000 7fbfe318b700 1 --2- 172.21.15.62:0/1760318495 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbfdc0cacf0 0x7fbfdc154530 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:59.732 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:59.723+0000 7fbfe318b700 1 -- 172.21.15.62:0/1760318495 >> 172.21.15.62:0/1760318495 conn(0x7fbfdc0ad1a0 msgr2=0x7fbfdc0ac120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:59.732 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:59.723+0000 7fbfe318b700 1 -- 172.21.15.62:0/1760318495 shutdown_connections 2023-06-09T04:41:59.732 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:59.723+0000 7fbfe318b700 1 -- 172.21.15.62:0/1760318495 wait complete. 2023-06-09T04:41:59.755 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-06-09T04:41:59.934 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:59.927+0000 7fcfe5268700 1 Processor -- start 2023-06-09T04:41:59.934 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:59.927+0000 7fcfe5268700 1 -- start start 2023-06-09T04:41:59.937 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:59.931+0000 7fcfe5268700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fcfe0160360 0x7fcfe00ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:59.937 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:59.931+0000 7fcfe5268700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fcfe00b0260 0x7fcfe006d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:59.937 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:59.931+0000 7fcfe5268700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfe0160730 con 0x7fcfe00c8800 2023-06-09T04:41:59.938 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:59.931+0000 7fcfe5268700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfe00ca860 con 0x7fcfe00b0260 2023-06-09T04:41:59.938 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:59.931+0000 7fcfe5268700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfe00ca580 con 0x7fcfe0160360 2023-06-09T04:41:59.938 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:59.931+0000 7fcfe4a67700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fcfe00b0260 0x7fcfe006d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:59.938 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:59.931+0000 7fcfdf7fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fcfe00c8800 0x7fcfe00afb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:39390/0 (socket says 172.21.15.62:39390) 2023-06-09T04:41:59.939 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:59.931+0000 7fcfdf7fe700 1 -- 172.21.15.62:0/4194095999 learned_addr learned my addr 172.21.15.62:0/4194095999 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:41:59.939 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:59.931+0000 7fcfdffff700 1 --2- 172.21.15.62:0/4194095999 >> v2:172.21.15.89:3300/0 conn(0x7fcfe0160360 0x7fcfe00ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:59.939 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:59.931+0000 7fcfdeffd700 1 -- 172.21.15.62:0/4194095999 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 542775579 0 0) 0x7fcfe0160730 con 0x7fcfe00c8800 2023-06-09T04:41:59.939 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:59.931+0000 7fcfdeffd700 1 -- 172.21.15.62:0/4194095999 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfc80035d0 con 0x7fcfe00c8800 2023-06-09T04:41:59.940 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:59.931+0000 7fcfe4a67700 1 -- 172.21.15.62:0/4194095999 >> v2:172.21.15.89:3300/0 conn(0x7fcfe0160360 msgr2=0x7fcfe00ccb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:41:59.940 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:59.931+0000 7fcfe4a67700 1 --2- 172.21.15.62:0/4194095999 >> v2:172.21.15.89:3300/0 conn(0x7fcfe0160360 0x7fcfe00ccb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:59.940 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:59.931+0000 7fcfe4a67700 1 -- 172.21.15.62:0/4194095999 >> v1:172.21.15.62:6789/0 conn(0x7fcfe00c8800 legacy=0x7fcfe00afb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:59.940 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:59.931+0000 7fcfe4a67700 1 -- 172.21.15.62:0/4194095999 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfe00cc070 con 0x7fcfe00b0260 2023-06-09T04:41:59.941 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:59.935+0000 7fcfe4a67700 1 --2- 172.21.15.62:0/4194095999 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcfe00b0260 0x7fcfe006d4b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fcfe00caab0 tx=0x7fcfd800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc6bde2029dcabf4 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:59.941 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:59.935+0000 7fcfdeffd700 1 -- 172.21.15.62:0/4194095999 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd800e070 con 0x7fcfe00b0260 2023-06-09T04:41:59.941 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:59.935+0000 7fcfdeffd700 1 -- 172.21.15.62:0/4194095999 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfd800bb20 con 0x7fcfe00b0260 2023-06-09T04:41:59.942 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:59.935+0000 7fcfdeffd700 1 -- 172.21.15.62:0/4194095999 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd8012430 con 0x7fcfe00b0260 2023-06-09T04:41:59.942 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:59.935+0000 7fcfe5268700 1 -- 172.21.15.62:0/4194095999 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcfe00b0260 msgr2=0x7fcfe006d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:59.942 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:59.935+0000 7fcfe5268700 1 --2- 172.21.15.62:0/4194095999 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcfe00b0260 0x7fcfe006d4b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fcfe00caab0 tx=0x7fcfd800b330 comp rx=0 tx=0).stop 2023-06-09T04:41:59.942 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:59.935+0000 7fcfe5268700 1 -- 172.21.15.62:0/4194095999 shutdown_connections 2023-06-09T04:41:59.943 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:59.935+0000 7fcfe5268700 1 --2- 172.21.15.62:0/4194095999 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcfe00b0260 0x7fcfe006d4b0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:59.943 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:59.935+0000 7fcfe5268700 1 --2- 172.21.15.62:0/4194095999 >> v2:172.21.15.89:3300/0 conn(0x7fcfe0160360 0x7fcfe00ccb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:59.943 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:59.935+0000 7fcfe5268700 1 -- 172.21.15.62:0/4194095999 >> 172.21.15.62:0/4194095999 conn(0x7fcfe00cab50 msgr2=0x7fcfe00caf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:41:59.943 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:59.935+0000 7fcfe5268700 1 -- 172.21.15.62:0/4194095999 shutdown_connections 2023-06-09T04:41:59.943 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:59.935+0000 7fcfe5268700 1 -- 172.21.15.62:0/4194095999 wait complete. 2023-06-09T04:41:59.945 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:59.939+0000 7fcfe5268700 1 Processor -- start 2023-06-09T04:41:59.946 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:59.939+0000 7fcfe5268700 1 -- start start 2023-06-09T04:41:59.947 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:59.943+0000 7fcfe5268700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcfe00b0260 0x7fcfe015d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:59.948 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:59.943+0000 7fcfe5268700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcfe00c8800 0x7fcfe01f5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:59.948 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:59.943+0000 7fcfe5268700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcfe0160360 0x7fcfe00b0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:59.948 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:59.943+0000 7fcfe5268700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe01e8120 con 0x7fcfe00c8800 2023-06-09T04:41:59.948 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:59.943+0000 7fcfe5268700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe0154ea0 con 0x7fcfe00b0260 2023-06-09T04:41:59.948 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:59.943+0000 7fcfe5268700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe01e7e40 con 0x7fcfe0160360 2023-06-09T04:41:59.949 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:59.943+0000 7fcfdf7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcfe00c8800 0x7fcfe01f5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:59.949 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:59.943+0000 7fcfdf7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcfe00c8800 0x7fcfe01f5410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:45042/0 (socket says 172.21.15.62:45042) 2023-06-09T04:41:59.950 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:59.943+0000 7fcfdf7fe700 1 -- 172.21.15.62:0/804187091 learned_addr learned my addr 172.21.15.62:0/804187091 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:41:59.950 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:59.943+0000 7fcfdffff700 1 --2- 172.21.15.62:0/804187091 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcfe00b0260 0x7fcfe015d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:59.950 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:59.943+0000 7fcfe4a67700 1 --2- 172.21.15.62:0/804187091 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcfe0160360 0x7fcfe00b0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:59.950 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:59.943+0000 7fcfdf7fe700 1 -- 172.21.15.62:0/804187091 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcfe0160360 msgr2=0x7fcfe00b0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:59.950 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:59.943+0000 7fcfdf7fe700 1 --2- 172.21.15.62:0/804187091 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcfe0160360 0x7fcfe00b0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:59.950 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:59.943+0000 7fcfdf7fe700 1 -- 172.21.15.62:0/804187091 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcfe00b0260 msgr2=0x7fcfe015d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:41:59.950 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:59.943+0000 7fcfdf7fe700 1 --2- 172.21.15.62:0/804187091 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcfe00b0260 0x7fcfe015d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:41:59.950 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:59.943+0000 7fcfdf7fe700 1 -- 172.21.15.62:0/804187091 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd8009a70 con 0x7fcfe00c8800 2023-06-09T04:41:59.951 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:59.943+0000 7fcfdf7fe700 1 --2- 172.21.15.62:0/804187091 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcfe00c8800 0x7fcfe01f5410 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fcfd400c500 tx=0x7fcfd400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:59.951 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:59.943+0000 7fcfdcff9700 1 -- 172.21.15.62:0/804187091 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd4005d90 con 0x7fcfe00c8800 2023-06-09T04:41:59.952 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:59.943+0000 7fcfe5268700 1 -- 172.21.15.62:0/804187091 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfe015c6c0 con 0x7fcfe00c8800 2023-06-09T04:41:59.952 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:59.943+0000 7fcfdcff9700 1 -- 172.21.15.62:0/804187091 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfd40070d0 con 0x7fcfe00c8800 2023-06-09T04:41:59.952 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:59.943+0000 7fcfdcff9700 1 -- 172.21.15.62:0/804187091 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd4007480 con 0x7fcfe00c8800 2023-06-09T04:41:59.952 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:59.943+0000 7fcfe5268700 1 -- 172.21.15.62:0/804187091 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfe015cc80 con 0x7fcfe00c8800 2023-06-09T04:41:59.952 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:59.947+0000 7fcfe5268700 1 -- 172.21.15.62:0/804187091 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfe015c520 con 0x7fcfe00c8800 2023-06-09T04:41:59.954 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:59.947+0000 7fcfdcff9700 1 -- 172.21.15.62:0/804187091 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcfd40075e0 con 0x7fcfe00c8800 2023-06-09T04:41:59.955 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:59.951+0000 7fcfdcff9700 1 --2- 172.21.15.62:0/804187091 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fcfcc066320 0x7fcfcc0687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:41:59.956 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:59.951+0000 7fcfdcff9700 1 -- 172.21.15.62:0/804187091 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fcfd4083550 con 0x7fcfe00c8800 2023-06-09T04:41:59.956 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:59.951+0000 7fcfdffff700 1 --2- 172.21.15.62:0/804187091 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fcfcc066320 0x7fcfcc0687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:41:59.957 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:59.951+0000 7fcfdffff700 1 --2- 172.21.15.62:0/804187091 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fcfcc066320 0x7fcfcc0687d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fcfe00b3fa0 tx=0x7fcfd0009240 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:41:59.962 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:41:59.955+0000 7fcfdcff9700 1 -- 172.21.15.62:0/804187091 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcfe015c520 con 0x7fcfe00c8800 2023-06-09T04:42:00.138 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.131+0000 7fcfe5268700 1 -- 172.21.15.62:0/804187091 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fcfe015c520 con 0x7fcfe00c8800 2023-06-09T04:42:00.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.139+0000 7fcfdcff9700 1 -- 172.21.15.62:0/804187091 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fcfe015c520 con 0x7fcfe00c8800 2023-06-09T04:42:00.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.143+0000 7fcfe5268700 1 -- 172.21.15.62:0/804187091 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fcfcc066320 msgr2=0x7fcfcc0687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:00.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.143+0000 7fcfe5268700 1 --2- 172.21.15.62:0/804187091 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fcfcc066320 0x7fcfcc0687d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fcfe00b3fa0 tx=0x7fcfd0009240 comp rx=0 tx=0).stop 2023-06-09T04:42:00.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.143+0000 7fcfe5268700 1 -- 172.21.15.62:0/804187091 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcfe00c8800 msgr2=0x7fcfe01f5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:00.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.143+0000 7fcfe5268700 1 --2- 172.21.15.62:0/804187091 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcfe00c8800 0x7fcfe01f5410 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fcfd400c500 tx=0x7fcfd400c810 comp rx=0 tx=0).stop 2023-06-09T04:42:00.149 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.143+0000 7fcfe5268700 1 -- 172.21.15.62:0/804187091 shutdown_connections 2023-06-09T04:42:00.149 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.143+0000 7fcfe5268700 1 --2- 172.21.15.62:0/804187091 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fcfcc066320 0x7fcfcc0687d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.149 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.143+0000 7fcfe5268700 1 --2- 172.21.15.62:0/804187091 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcfe0160360 0x7fcfe00b0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.143+0000 7fcfe5268700 1 --2- 172.21.15.62:0/804187091 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcfe00c8800 0x7fcfe01f5410 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.143+0000 7fcfe5268700 1 --2- 172.21.15.62:0/804187091 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcfe00b0260 0x7fcfe015d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.143+0000 7fcfe5268700 1 -- 172.21.15.62:0/804187091 >> 172.21.15.62:0/804187091 conn(0x7fcfe00cab50 msgr2=0x7fcfe015f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:00.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.143+0000 7fcfe5268700 1 -- 172.21.15.62:0/804187091 shutdown_connections 2023-06-09T04:42:00.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.143+0000 7fcfe5268700 1 -- 172.21.15.62:0/804187091 wait complete. 2023-06-09T04:42:00.170 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-06-09T04:42:00.171 DEBUG:teuthology.orchestra.run.smithi062:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-06-09T04:42:00.210 DEBUG:teuthology.orchestra.run.smithi089:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-06-09T04:42:00.250 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-06-09T04:42:00.251 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-06-09T04:42:00.251 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:42:00.271 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-06-09T04:42:00.272 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:42:00.331 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-06-09T04:42:00.331 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:42:00.395 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:42:00.619 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.611+0000 7f9ecb4fa700 1 Processor -- start 2023-06-09T04:42:00.619 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.615+0000 7f9ecb4fa700 1 -- start start 2023-06-09T04:42:00.622 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.615+0000 7f9ecb4fa700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9ec40cb850 0x7f9ec40ca160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:00.622 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.615+0000 7f9ecb4fa700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9ec40b08d0 0x7f9ec40ca6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:00.622 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.615+0000 7f9ecb4fa700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ec406f9b0 con 0x7f9ec4159c90 2023-06-09T04:42:00.622 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.615+0000 7f9ecb4fa700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ec406b960 con 0x7f9ec40b08d0 2023-06-09T04:42:00.622 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.615+0000 7f9ecb4fa700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ec415a060 con 0x7f9ec40cb850 2023-06-09T04:42:00.623 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.615+0000 7f9ec9a97700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9ec40b08d0 0x7f9ec40ca6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:00.623 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.615+0000 7f9ec8a95700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9ec40cb850 0x7f9ec40ca160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:00.623 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.615+0000 7f9ec9a97700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9ec40b08d0 0x7f9ec40ca6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53678/0 (socket says 172.21.15.62:53678) 2023-06-09T04:42:00.623 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.615+0000 7f9ec9a97700 1 -- 172.21.15.62:0/1505441250 learned_addr learned my addr 172.21.15.62:0/1505441250 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:00.624 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.619+0000 7f9ec8a95700 1 -- 172.21.15.62:0/1505441250 >> v2:172.21.15.62:3300/0 conn(0x7f9ec40b08d0 msgr2=0x7f9ec40ca6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:00.624 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.619+0000 7f9ec8a95700 1 --2- 172.21.15.62:0/1505441250 >> v2:172.21.15.62:3300/0 conn(0x7f9ec40b08d0 0x7f9ec40ca6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.625 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.619+0000 7f9ec8a95700 1 -- 172.21.15.62:0/1505441250 >> v1:172.21.15.89:6789/0 conn(0x7f9ec4159c90 legacy=0x7f9ec4070e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:00.625 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.619+0000 7f9ec8a95700 1 -- 172.21.15.62:0/1505441250 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec40c89e0 con 0x7f9ec40cb850 2023-06-09T04:42:00.625 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.619+0000 7f9ec9a97700 1 --2- 172.21.15.62:0/1505441250 >> v2:172.21.15.62:3300/0 conn(0x7f9ec40b08d0 0x7f9ec40ca6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:42:00.625 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.619+0000 7f9ec8a95700 1 --2- 172.21.15.62:0/1505441250 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ec40cb850 0x7f9ec40ca160 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9ec40c8770 tx=0x7f9eb4009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4da532247a6a824b server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:00.625 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.619+0000 7f9ebbfff700 1 -- 172.21.15.62:0/1505441250 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb4011830 con 0x7f9ec40cb850 2023-06-09T04:42:00.625 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.619+0000 7f9ebbfff700 1 -- 172.21.15.62:0/1505441250 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eb4011990 con 0x7f9ec40cb850 2023-06-09T04:42:00.626 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.619+0000 7f9ebbfff700 1 -- 172.21.15.62:0/1505441250 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eb4011d20 con 0x7f9ec40cb850 2023-06-09T04:42:00.626 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.619+0000 7f9ecb4fa700 1 -- 172.21.15.62:0/1505441250 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ec40cb850 msgr2=0x7f9ec40ca160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:00.626 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.619+0000 7f9ecb4fa700 1 --2- 172.21.15.62:0/1505441250 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ec40cb850 0x7f9ec40ca160 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9ec40c8770 tx=0x7f9eb4009b30 comp rx=0 tx=0).stop 2023-06-09T04:42:00.626 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.619+0000 7f9ecb4fa700 1 -- 172.21.15.62:0/1505441250 shutdown_connections 2023-06-09T04:42:00.627 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.619+0000 7f9ecb4fa700 1 --2- 172.21.15.62:0/1505441250 >> v2:172.21.15.62:3300/0 conn(0x7f9ec40b08d0 0x7f9ec40ca6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.627 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.619+0000 7f9ecb4fa700 1 --2- 172.21.15.62:0/1505441250 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ec40cb850 0x7f9ec40ca160 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.627 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.619+0000 7f9ecb4fa700 1 -- 172.21.15.62:0/1505441250 >> 172.21.15.62:0/1505441250 conn(0x7f9ec406a410 msgr2=0x7f9ec40afd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:00.627 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.619+0000 7f9ecb4fa700 1 -- 172.21.15.62:0/1505441250 shutdown_connections 2023-06-09T04:42:00.627 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.619+0000 7f9ecb4fa700 1 -- 172.21.15.62:0/1505441250 wait complete. 2023-06-09T04:42:00.628 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.623+0000 7f9ecb4fa700 1 Processor -- start 2023-06-09T04:42:00.628 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.623+0000 7f9ecb4fa700 1 -- start start 2023-06-09T04:42:00.629 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.623+0000 7f9ecb4fa700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ec40b08d0 0x7f9ec41eec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:00.630 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.623+0000 7f9ecb4fa700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9ec40cb850 0x7f9ec40ac900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:00.630 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.623+0000 7f9ecb4fa700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ec4159c90 0x7f9ec40ace40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:00.630 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.623+0000 7f9ecb4fa700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec41ef170 con 0x7f9ec4159c90 2023-06-09T04:42:00.630 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.623+0000 7f9ecb4fa700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec41f1a70 con 0x7f9ec40b08d0 2023-06-09T04:42:00.630 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.623+0000 7f9ecb4fa700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec40c6d20 con 0x7f9ec40cb850 2023-06-09T04:42:00.631 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.623+0000 7f9ec9a97700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ec4159c90 0x7f9ec40ace40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:00.631 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.623+0000 7f9ec9a97700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ec4159c90 0x7f9ec40ace40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53692/0 (socket says 172.21.15.62:53692) 2023-06-09T04:42:00.631 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.623+0000 7f9ec9a97700 1 -- 172.21.15.62:0/2616304313 learned_addr learned my addr 172.21.15.62:0/2616304313 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:00.631 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.623+0000 7f9ec9296700 1 --2- 172.21.15.62:0/2616304313 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ec40b08d0 0x7f9ec41eec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:00.632 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.623+0000 7f9ec8a95700 1 --2- 172.21.15.62:0/2616304313 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9ec40cb850 0x7f9ec40ac900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:00.632 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.623+0000 7f9ec9a97700 1 -- 172.21.15.62:0/2616304313 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9ec40cb850 msgr2=0x7f9ec40ac900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:00.632 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.623+0000 7f9ec9a97700 1 --2- 172.21.15.62:0/2616304313 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9ec40cb850 0x7f9ec40ac900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.632 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.623+0000 7f9ec9a97700 1 -- 172.21.15.62:0/2616304313 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ec40b08d0 msgr2=0x7f9ec41eec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:00.632 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.623+0000 7f9ec9a97700 1 --2- 172.21.15.62:0/2616304313 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ec40b08d0 0x7f9ec41eec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.632 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.623+0000 7f9ec9a97700 1 -- 172.21.15.62:0/2616304313 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ebc009570 con 0x7f9ec4159c90 2023-06-09T04:42:00.633 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.627+0000 7f9ec9a97700 1 --2- 172.21.15.62:0/2616304313 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ec4159c90 0x7f9ec40ace40 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc00eb60 tx=0x7f9ebc00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:00.633 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.627+0000 7f9eb9ffb700 1 -- 172.21.15.62:0/2616304313 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ebc009e80 con 0x7f9ec4159c90 2023-06-09T04:42:00.633 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.627+0000 7f9eb9ffb700 1 -- 172.21.15.62:0/2616304313 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ebc00c850 con 0x7f9ec4159c90 2023-06-09T04:42:00.633 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.627+0000 7f9ecb4fa700 1 -- 172.21.15.62:0/2616304313 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9eb40094b0 con 0x7f9ec4159c90 2023-06-09T04:42:00.634 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.627+0000 7f9eb9ffb700 1 -- 172.21.15.62:0/2616304313 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ebc00cbe0 con 0x7f9ec4159c90 2023-06-09T04:42:00.634 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.627+0000 7f9ecb4fa700 1 -- 172.21.15.62:0/2616304313 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ec40c72e0 con 0x7f9ec4159c90 2023-06-09T04:42:00.634 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.627+0000 7f9ecb4fa700 1 -- 172.21.15.62:0/2616304313 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ec404db30 con 0x7f9ec4159c90 2023-06-09T04:42:00.635 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.631+0000 7f9eb9ffb700 1 -- 172.21.15.62:0/2616304313 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9ebc00cd40 con 0x7f9ec4159c90 2023-06-09T04:42:00.636 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.631+0000 7f9eb9ffb700 1 --2- 172.21.15.62:0/2616304313 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f9ea80662f0 0x7f9ea80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:00.637 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.631+0000 7f9eb9ffb700 1 -- 172.21.15.62:0/2616304313 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9ebc084100 con 0x7f9ec4159c90 2023-06-09T04:42:00.637 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.631+0000 7f9ec9296700 1 --2- 172.21.15.62:0/2616304313 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f9ea80662f0 0x7f9ea80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:00.638 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.631+0000 7f9ec9296700 1 --2- 172.21.15.62:0/2616304313 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f9ea80662f0 0x7f9ea80687a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9ec00012e0 tx=0x7f9ec0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:00.645 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.639+0000 7f9eb9ffb700 1 -- 172.21.15.62:0/2616304313 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9ebc054cd0 con 0x7f9ec4159c90 2023-06-09T04:42:00.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.815+0000 7f9ecb4fa700 1 -- 172.21.15.62:0/2616304313 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9ec406df60 con 0x7f9ec4159c90 2023-06-09T04:42:00.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.819+0000 7f9eb9ffb700 1 -- 172.21.15.62:0/2616304313 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+20180 (secure 0 0 0) 0x7f9ebc054860 con 0x7f9ec4159c90 2023-06-09T04:42:00.824 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:42:00.825 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":30,"fsid":"f7998a1e-e5a9-4202-abaa-70c0eaae1047","created":"2023-06-09T04:40:30.469588+0000","modified":"2023-06-09T04:41:38.495589+0000","last_up_change":"2023-06-09T04:40:43.120747+0000","last_in_change":"2023-06-09T04:40:33.568221+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:40:44.646921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:40:50.006643+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:40:55.031273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:40:55.773517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-09T04:40:58.845383+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bc50bbc0-dd08-42ed-804c-ec3029e36c19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6802","nonce":1295788017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6807","nonce":1295788017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6815","nonce":1295788017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6809","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6811","nonce":1295788017}]},"public_addr":"172.21.15.62:6802/1295788017","cluster_addr":"172.21.15.62:6807/1295788017","heartbeat_back_addr":"172.21.15.62:6815/1295788017","heartbeat_front_addr":"172.21.15.62:6811/1295788017","state":["exists","up"]},{"osd":1,"uuid":"8230b12d-e22f-4985-a584-4cc64404cdbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6825","nonce":4120692006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6827","nonce":4120692006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6831","nonce":4120692006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6829","nonce":4120692006}]},"public_addr":"172.21.15.62:6825/4120692006","cluster_addr":"172.21.15.62:6827/4120692006","heartbeat_back_addr":"172.21.15.62:6831/4120692006","heartbeat_front_addr":"172.21.15.62:6829/4120692006","state":["exists","up"]},{"osd":2,"uuid":"d0202506-dbe9-4e3c-9271-687929abf96a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6801","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6803","nonce":4169607876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6805","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6806","nonce":4169607876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6814","nonce":4169607876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6810","nonce":4169607876}]},"public_addr":"172.21.15.62:6803/4169607876","cluster_addr":"172.21.15.62:6806/4169607876","heartbeat_back_addr":"172.21.15.62:6814/4169607876","heartbeat_front_addr":"172.21.15.62:6810/4169607876","state":["exists","up"]},{"osd":3,"uuid":"f3c0298a-b075-4411-af50-e16cd74fdddb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6817","nonce":3268438986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6819","nonce":3268438986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6823","nonce":3268438986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6821","nonce":3268438986}]},"public_addr":"172.21.15.62:6817/3268438986","cluster_addr":"172.21.15.62:6819/3268438986","heartbeat_back_addr":"172.21.15.62:6823/3268438986","heartbeat_front_addr":"172.21.15.62:6821/3268438986","state":["exists","up"]},{"osd":4,"uuid":"1ab5c5ca-e74f-475a-a309-683cc0029928","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6817","nonce":3139617628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6819","nonce":3139617628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6823","nonce":3139617628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6821","nonce":3139617628}]},"public_addr":"172.21.15.89:6817/3139617628","cluster_addr":"172.21.15.89:6819/3139617628","heartbeat_back_addr":"172.21.15.89:6823/3139617628","heartbeat_front_addr":"172.21.15.89:6821/3139617628","state":["exists","up"]},{"osd":5,"uuid":"a933e184-bd8f-4369-a1ba-a68de53c578c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6825","nonce":2681723596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6827","nonce":2681723596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6831","nonce":2681723596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6829","nonce":2681723596}]},"public_addr":"172.21.15.89:6825/2681723596","cluster_addr":"172.21.15.89:6827/2681723596","heartbeat_back_addr":"172.21.15.89:6831/2681723596","heartbeat_front_addr":"172.21.15.89:6829/2681723596","state":["exists","up"]},{"osd":6,"uuid":"1ed7ad37-2eee-49a6-954c-b537e2b7f0ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6809","nonce":1657136033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6811","nonce":1657136033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6815","nonce":1657136033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6813","nonce":1657136033}]},"public_addr":"172.21.15.89:6809/1657136033","cluster_addr":"172.21.15.89:6811/1657136033","heartbeat_back_addr":"172.21.15.89:6815/1657136033","heartbeat_front_addr":"172.21.15.89:6813/1657136033","state":["exists","up"]},{"osd":7,"uuid":"6ed732e9-33ff-40df-9038-a9f1d1622671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6801","nonce":1710561686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6803","nonce":1710561686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6807","nonce":1710561686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6805","nonce":1710561686}]},"public_addr":"172.21.15.89:6801/1710561686","cluster_addr":"172.21.15.89:6803/1710561686","heartbeat_back_addr":"172.21.15.89:6807/1710561686","heartbeat_front_addr":"172.21.15.89:6805/1710561686","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.335803+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.419788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.179334+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.263310+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.071846+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.375627+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.282277+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.315997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.12","mappings":[{"from":1,"to":2}]},{"pgid":"4.19","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:42:00.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.819+0000 7f9ecb4fa700 1 -- 172.21.15.62:0/2616304313 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f9ea80662f0 msgr2=0x7f9ea80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:00.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.819+0000 7f9ecb4fa700 1 --2- 172.21.15.62:0/2616304313 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f9ea80662f0 0x7f9ea80687a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9ec00012e0 tx=0x7f9ec0009040 comp rx=0 tx=0).stop 2023-06-09T04:42:00.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.819+0000 7f9ecb4fa700 1 -- 172.21.15.62:0/2616304313 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ec4159c90 msgr2=0x7f9ec40ace40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:00.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.819+0000 7f9ecb4fa700 1 --2- 172.21.15.62:0/2616304313 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ec4159c90 0x7f9ec40ace40 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc00eb60 tx=0x7f9ebc00ee70 comp rx=0 tx=0).stop 2023-06-09T04:42:00.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.819+0000 7f9ecb4fa700 1 -- 172.21.15.62:0/2616304313 shutdown_connections 2023-06-09T04:42:00.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.819+0000 7f9ecb4fa700 1 --2- 172.21.15.62:0/2616304313 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f9ea80662f0 0x7f9ea80687a0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.819+0000 7f9ecb4fa700 1 --2- 172.21.15.62:0/2616304313 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ec4159c90 0x7f9ec40ace40 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.819+0000 7f9ecb4fa700 1 --2- 172.21.15.62:0/2616304313 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9ec40cb850 0x7f9ec40ac900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.819+0000 7f9ecb4fa700 1 --2- 172.21.15.62:0/2616304313 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9ec40b08d0 0x7f9ec41eec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:00.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.819+0000 7f9ecb4fa700 1 -- 172.21.15.62:0/2616304313 >> 172.21.15.62:0/2616304313 conn(0x7f9ec406a410 msgr2=0x7f9ec41588a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:00.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.823+0000 7f9ecb4fa700 1 -- 172.21.15.62:0/2616304313 shutdown_connections 2023-06-09T04:42:00.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:00.823+0000 7f9ecb4fa700 1 -- 172.21.15.62:0/2616304313 wait complete. 2023-06-09T04:42:00.851 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:40:44.646921+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:40:50.006643+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T04:40:55.031273+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T04:40:55.773517+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-09T04:40:58.845383+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-09T04:42:00.852 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:42:01.024 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.019+0000 7f47f7fff700 1 Processor -- start 2023-06-09T04:42:01.025 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.019+0000 7f47f7fff700 1 -- start start 2023-06-09T04:42:01.027 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.019+0000 7f47f7fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47f80cf2b0 0x7f47f80b52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:01.027 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.019+0000 7f47f7fff700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47f80d0c00 con 0x7f47f80b3ed0 2023-06-09T04:42:01.027 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.019+0000 7f47f7fff700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47f80b1b30 con 0x7f47f80d1090 2023-06-09T04:42:01.027 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.019+0000 7f47f7fff700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47f80cf730 con 0x7f47f80cf2b0 2023-06-09T04:42:01.028 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.023+0000 7f47f67fc700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f47f80d1090 0x7f47f80ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.62:54198/0 (socket says 172.21.15.62:54198) 2023-06-09T04:42:01.028 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.023+0000 7f47f67fc700 1 -- 172.21.15.62:0/3965925528 learned_addr learned my addr 172.21.15.62:0/3965925528 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:42:01.028 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.023+0000 7f47f6ffd700 1 --1- 172.21.15.62:0/3965925528 >> v1:172.21.15.62:6789/0 conn(0x7f47f80b3ed0 0x7f47f80b42a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:32936/0 (socket says 172.21.15.62:32936) 2023-06-09T04:42:01.028 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.023+0000 7f47f77fe700 1 --2- 172.21.15.62:0/3965925528 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47f80cf2b0 0x7f47f80b52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:01.029 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.023+0000 7f47f5ffb700 1 -- 172.21.15.62:0/3965925528 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3835243878 0 0) 0x7f47f80b1b30 con 0x7f47f80d1090 2023-06-09T04:42:01.029 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.023+0000 7f47f5ffb700 1 -- 172.21.15.62:0/3965925528 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47e00035d0 con 0x7f47f80d1090 2023-06-09T04:42:01.029 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.023+0000 7f47f5ffb700 1 -- 172.21.15.62:0/3965925528 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 169078420 0 0) 0x7f47f80d0c00 con 0x7f47f80b3ed0 2023-06-09T04:42:01.029 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.023+0000 7f47f5ffb700 1 -- 172.21.15.62:0/3965925528 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47f80b1b30 con 0x7f47f80b3ed0 2023-06-09T04:42:01.030 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.023+0000 7f47f77fe700 1 -- 172.21.15.62:0/3965925528 >> v1:172.21.15.89:6789/0 conn(0x7f47f80d1090 legacy=0x7f47f80ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:01.030 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.023+0000 7f47f77fe700 1 -- 172.21.15.62:0/3965925528 >> v1:172.21.15.62:6789/0 conn(0x7f47f80b3ed0 legacy=0x7f47f80b42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:01.030 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.023+0000 7f47f77fe700 1 -- 172.21.15.62:0/3965925528 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47f80cf940 con 0x7f47f80cf2b0 2023-06-09T04:42:01.030 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.023+0000 7f47f77fe700 1 --2- 172.21.15.62:0/3965925528 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47f80cf2b0 0x7f47f80b52a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f47f0009dc0 tx=0x7f47f000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3162d8855b5f9d0c server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:01.031 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.023+0000 7f47f5ffb700 1 -- 172.21.15.62:0/3965925528 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f000e070 con 0x7f47f80cf2b0 2023-06-09T04:42:01.031 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.023+0000 7f47f5ffb700 1 -- 172.21.15.62:0/3965925528 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47f000bb20 con 0x7f47f80cf2b0 2023-06-09T04:42:01.031 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.023+0000 7f47f5ffb700 1 -- 172.21.15.62:0/3965925528 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f0012430 con 0x7f47f80cf2b0 2023-06-09T04:42:01.032 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.023+0000 7f47f7fff700 1 -- 172.21.15.62:0/3965925528 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47f80cf2b0 msgr2=0x7f47f80b52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:01.032 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.023+0000 7f47f7fff700 1 --2- 172.21.15.62:0/3965925528 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47f80cf2b0 0x7f47f80b52a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f47f0009dc0 tx=0x7f47f000b330 comp rx=0 tx=0).stop 2023-06-09T04:42:01.032 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.027+0000 7f47f7fff700 1 -- 172.21.15.62:0/3965925528 shutdown_connections 2023-06-09T04:42:01.032 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.027+0000 7f47f7fff700 1 --2- 172.21.15.62:0/3965925528 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47f80cf2b0 0x7f47f80b52a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.032 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.027+0000 7f47f7fff700 1 -- 172.21.15.62:0/3965925528 >> 172.21.15.62:0/3965925528 conn(0x7f47f806a500 msgr2=0x7f47f806a900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:01.032 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.027+0000 7f47f7fff700 1 -- 172.21.15.62:0/3965925528 shutdown_connections 2023-06-09T04:42:01.033 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.027+0000 7f47f7fff700 1 -- 172.21.15.62:0/3965925528 wait complete. 2023-06-09T04:42:01.034 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.027+0000 7f47f7fff700 1 Processor -- start 2023-06-09T04:42:01.035 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.027+0000 7f47f7fff700 1 -- start start 2023-06-09T04:42:01.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.031+0000 7f47f7fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47f80b3ed0 0x7f47f8146910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:01.037 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.031+0000 7f47f7fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f47f80cf2b0 0x7f47f8143a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:01.037 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.031+0000 7f47f7fff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47f80d1090 0x7f47f815d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:01.037 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.031+0000 7f47f7fff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47f8146e50 con 0x7f47f80cf2b0 2023-06-09T04:42:01.037 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.031+0000 7f47f7fff700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47f8143f80 con 0x7f47f80d1090 2023-06-09T04:42:01.037 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.031+0000 7f47f7fff700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47f8147330 con 0x7f47f80b3ed0 2023-06-09T04:42:01.038 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.031+0000 7f47f67fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f47f80cf2b0 0x7f47f8143a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:01.038 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.031+0000 7f47f77fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47f80d1090 0x7f47f815d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:01.038 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.031+0000 7f47f77fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47f80d1090 0x7f47f815d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.62:54596/0 (socket says 172.21.15.62:54596) 2023-06-09T04:42:01.039 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.031+0000 7f47f77fe700 1 -- 172.21.15.62:0/2928149751 learned_addr learned my addr 172.21.15.62:0/2928149751 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:01.039 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.031+0000 7f47f6ffd700 1 --2- 172.21.15.62:0/2928149751 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47f80b3ed0 0x7f47f8146910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:01.039 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.031+0000 7f47f77fe700 1 -- 172.21.15.62:0/2928149751 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47f80b3ed0 msgr2=0x7f47f8146910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:01.039 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.031+0000 7f47f77fe700 1 --2- 172.21.15.62:0/2928149751 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47f80b3ed0 0x7f47f8146910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.039 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.031+0000 7f47f77fe700 1 -- 172.21.15.62:0/2928149751 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f47f80cf2b0 msgr2=0x7f47f8143a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:01.039 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.031+0000 7f47f77fe700 1 --2- 172.21.15.62:0/2928149751 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f47f80cf2b0 0x7f47f8143a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.039 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.031+0000 7f47f77fe700 1 -- 172.21.15.62:0/2928149751 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47f0009a70 con 0x7f47f80d1090 2023-06-09T04:42:01.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.031+0000 7f47f77fe700 1 --2- 172.21.15.62:0/2928149751 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47f80d1090 0x7f47f815d360 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f47f000b370 tx=0x7f47f0004af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:01.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.031+0000 7f47dffff700 1 -- 172.21.15.62:0/2928149751 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f0012430 con 0x7f47f80d1090 2023-06-09T04:42:01.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.031+0000 7f47dffff700 1 -- 172.21.15.62:0/2928149751 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47f0020070 con 0x7f47f80d1090 2023-06-09T04:42:01.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.031+0000 7f47f7fff700 1 -- 172.21.15.62:0/2928149751 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47f80b7e00 con 0x7f47f80d1090 2023-06-09T04:42:01.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.031+0000 7f47dffff700 1 -- 172.21.15.62:0/2928149751 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f001ba70 con 0x7f47f80d1090 2023-06-09T04:42:01.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.035+0000 7f47f7fff700 1 -- 172.21.15.62:0/2928149751 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47f8156de0 con 0x7f47f80d1090 2023-06-09T04:42:01.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.035+0000 7f47f7fff700 1 -- 172.21.15.62:0/2928149751 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47f8156c40 con 0x7f47f80d1090 2023-06-09T04:42:01.042 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.035+0000 7f47dffff700 1 -- 172.21.15.62:0/2928149751 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f47f001bbd0 con 0x7f47f80d1090 2023-06-09T04:42:01.043 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.039+0000 7f47dffff700 1 --2- 172.21.15.62:0/2928149751 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f47e40662f0 0x7f47e40687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:01.044 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.039+0000 7f47dffff700 1 -- 172.21.15.62:0/2928149751 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f47f0022070 con 0x7f47f80d1090 2023-06-09T04:42:01.044 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.039+0000 7f47f6ffd700 1 --2- 172.21.15.62:0/2928149751 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f47e40662f0 0x7f47e40687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:01.045 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.039+0000 7f47f6ffd700 1 --2- 172.21.15.62:0/2928149751 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f47e40662f0 0x7f47e40687a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f47e8007fd0 tx=0x7f47e8004a70 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:01.050 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.043+0000 7f47dffff700 1 -- 172.21.15.62:0/2928149751 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f47f00534e0 con 0x7f47f80d1090 2023-06-09T04:42:01.222 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.215+0000 7f47f7fff700 1 -- 172.21.15.62:0/2928149751 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f47f8156c40 con 0x7f47f80d1090 2023-06-09T04:42:01.223 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.219+0000 7f47dffff700 1 -- 172.21.15.62:0/2928149751 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f47f8156c40 con 0x7f47f80d1090 2023-06-09T04:42:01.224 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2023-06-09T04:42:01.228 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.223+0000 7f47f7fff700 1 -- 172.21.15.62:0/2928149751 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f47e40662f0 msgr2=0x7f47e40687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:01.228 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.223+0000 7f47f7fff700 1 --2- 172.21.15.62:0/2928149751 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f47e40662f0 0x7f47e40687a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f47e8007fd0 tx=0x7f47e8004a70 comp rx=0 tx=0).stop 2023-06-09T04:42:01.228 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.223+0000 7f47f7fff700 1 -- 172.21.15.62:0/2928149751 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47f80d1090 msgr2=0x7f47f815d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:01.228 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.223+0000 7f47f7fff700 1 --2- 172.21.15.62:0/2928149751 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47f80d1090 0x7f47f815d360 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f47f000b370 tx=0x7f47f0004af0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.229 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.223+0000 7f47f7fff700 1 -- 172.21.15.62:0/2928149751 shutdown_connections 2023-06-09T04:42:01.229 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.223+0000 7f47f7fff700 1 --2- 172.21.15.62:0/2928149751 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f47e40662f0 0x7f47e40687a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.229 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.223+0000 7f47f7fff700 1 --2- 172.21.15.62:0/2928149751 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47f80d1090 0x7f47f815d360 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.229 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.223+0000 7f47f7fff700 1 --2- 172.21.15.62:0/2928149751 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f47f80cf2b0 0x7f47f8143a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.229 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.223+0000 7f47f7fff700 1 --2- 172.21.15.62:0/2928149751 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f47f80b3ed0 0x7f47f8146910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.230 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.223+0000 7f47f7fff700 1 -- 172.21.15.62:0/2928149751 >> 172.21.15.62:0/2928149751 conn(0x7f47f806a500 msgr2=0x7f47f80cea50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:01.230 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.223+0000 7f47f7fff700 1 -- 172.21.15.62:0/2928149751 shutdown_connections 2023-06-09T04:42:01.230 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.223+0000 7f47f7fff700 1 -- 172.21.15.62:0/2928149751 wait complete. 2023-06-09T04:42:01.251 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:42:01.435 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.427+0000 7f1f5885a700 1 Processor -- start 2023-06-09T04:42:01.435 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.431+0000 7f1f5885a700 1 -- start start 2023-06-09T04:42:01.438 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.431+0000 7f1f5885a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1f540cd2e0 0x7f1f540b3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:01.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.431+0000 7f1f5885a700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1f540cebf0 0x7f1f540d0250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:01.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.431+0000 7f1f5885a700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f540b4d50 con 0x7f1f540d1f80 2023-06-09T04:42:01.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.431+0000 7f1f5885a700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f540cf050 con 0x7f1f540cebf0 2023-06-09T04:42:01.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.431+0000 7f1f5885a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f540b4140 con 0x7f1f540cd2e0 2023-06-09T04:42:01.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.431+0000 7f1f537fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f1f540d1f80 0x7f1f540ccbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:32948/0 (socket says 172.21.15.62:32948) 2023-06-09T04:42:01.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.431+0000 7f1f537fe700 1 -- 172.21.15.62:0/3520287141 learned_addr learned my addr 172.21.15.62:0/3520287141 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:42:01.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.435+0000 7f1f52ffd700 1 --2- 172.21.15.62:0/3520287141 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1f540cd2e0 0x7f1f540b3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:01.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.435+0000 7f1f527fc700 1 -- 172.21.15.62:0/3520287141 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3133067648 0 0) 0x7f1f540b4d50 con 0x7f1f540d1f80 2023-06-09T04:42:01.442 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.435+0000 7f1f53fff700 1 --2- 172.21.15.62:0/3520287141 >> v2:172.21.15.89:3300/0 conn(0x7f1f540cebf0 0x7f1f540d0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:01.442 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.435+0000 7f1f527fc700 1 -- 172.21.15.62:0/3520287141 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f3c0035d0 con 0x7f1f540d1f80 2023-06-09T04:42:01.442 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.435+0000 7f1f527fc700 1 -- 172.21.15.62:0/3520287141 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3219331081 0 0) 0x7f1f3c0035d0 con 0x7f1f540d1f80 2023-06-09T04:42:01.443 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.435+0000 7f1f527fc700 1 -- 172.21.15.62:0/3520287141 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1f540cd2e0 msgr2=0x7f1f540b3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:01.443 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.435+0000 7f1f527fc700 1 --2- 172.21.15.62:0/3520287141 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1f540cd2e0 0x7f1f540b3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.443 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.435+0000 7f1f527fc700 1 -- 172.21.15.62:0/3520287141 >> v2:172.21.15.89:3300/0 conn(0x7f1f540cebf0 msgr2=0x7f1f540d0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:01.443 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.435+0000 7f1f527fc700 1 --2- 172.21.15.62:0/3520287141 >> v2:172.21.15.89:3300/0 conn(0x7f1f540cebf0 0x7f1f540d0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.435+0000 7f1f527fc700 1 -- 172.21.15.62:0/3520287141 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f540b4420 con 0x7f1f540d1f80 2023-06-09T04:42:01.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.435+0000 7f1f527fc700 1 -- 172.21.15.62:0/3520287141 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 540845019 0 0) 0x7f1f440017f0 con 0x7f1f540d1f80 2023-06-09T04:42:01.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.435+0000 7f1f527fc700 1 -- 172.21.15.62:0/3520287141 >> v1:172.21.15.62:6789/0 conn(0x7f1f540d1f80 legacy=0x7f1f540ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:01.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.435+0000 7f1f527fc700 1 --2- 172.21.15.62:0/3520287141 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1f540cd2e0 0x7f1f3c003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:01.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.435+0000 7f1f527fc700 1 --2- 172.21.15.62:0/3520287141 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1f3c003fa0 0x7f1f3c004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:01.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.435+0000 7f1f527fc700 1 --2- 172.21.15.62:0/3520287141 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1f3c004db0 0x7f1f3c005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:01.445 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.435+0000 7f1f527fc700 1 -- 172.21.15.62:0/3520287141 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f540cf050 con 0x7f1f3c004db0 2023-06-09T04:42:01.445 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.435+0000 7f1f527fc700 1 -- 172.21.15.62:0/3520287141 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f540b4140 con 0x7f1f3c003fa0 2023-06-09T04:42:01.445 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.435+0000 7f1f527fc700 1 -- 172.21.15.62:0/3520287141 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3c00ba30 con 0x7f1f540cd2e0 2023-06-09T04:42:01.445 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.435+0000 7f1f53fff700 1 --2- 172.21.15.62:0/3520287141 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1f3c004db0 0x7f1f3c005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:01.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.435+0000 7f1f537fe700 1 --2- 172.21.15.62:0/3520287141 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1f540cd2e0 0x7f1f3c003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:01.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.435+0000 7f1f52ffd700 1 --2- 172.21.15.62:0/3520287141 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1f3c003fa0 0x7f1f3c004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:01.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.435+0000 7f1f53fff700 1 -- 172.21.15.62:0/3520287141 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1f540cd2e0 msgr2=0x7f1f3c003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:01.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.435+0000 7f1f53fff700 1 --2- 172.21.15.62:0/3520287141 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1f540cd2e0 0x7f1f3c003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.448 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.435+0000 7f1f53fff700 1 -- 172.21.15.62:0/3520287141 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1f3c003fa0 msgr2=0x7f1f3c004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:01.448 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.435+0000 7f1f53fff700 1 --2- 172.21.15.62:0/3520287141 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1f3c003fa0 0x7f1f3c004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.448 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.435+0000 7f1f53fff700 1 -- 172.21.15.62:0/3520287141 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f3c0035d0 con 0x7f1f3c004db0 2023-06-09T04:42:01.448 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.435+0000 7f1f52ffd700 1 --2- 172.21.15.62:0/3520287141 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1f3c003fa0 0x7f1f3c004870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:01.448 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.435+0000 7f1f53fff700 1 --2- 172.21.15.62:0/3520287141 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1f3c004db0 0x7f1f3c005220 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c009fc0 tx=0x7f1f3c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=672449e7625043d0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:01.448 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.435+0000 7f1f527fc700 1 -- 172.21.15.62:0/3520287141 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c00ec30 con 0x7f1f3c004db0 2023-06-09T04:42:01.448 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.435+0000 7f1f527fc700 1 -- 172.21.15.62:0/3520287141 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f4c00f040 con 0x7f1f3c004db0 2023-06-09T04:42:01.449 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.435+0000 7f1f527fc700 1 -- 172.21.15.62:0/3520287141 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f4c014480 con 0x7f1f3c004db0 2023-06-09T04:42:01.449 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.439+0000 7f1f5885a700 1 -- 172.21.15.62:0/3520287141 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1f3c004db0 msgr2=0x7f1f3c005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:01.449 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.439+0000 7f1f5885a700 1 --2- 172.21.15.62:0/3520287141 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1f3c004db0 0x7f1f3c005220 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f1f4c009fc0 tx=0x7f1f3c0058a0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.449 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.439+0000 7f1f53fff700 1 -- 172.21.15.62:0/3520287141 reap_dead start 2023-06-09T04:42:01.449 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.439+0000 7f1f5885a700 1 -- 172.21.15.62:0/3520287141 shutdown_connections 2023-06-09T04:42:01.449 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.439+0000 7f1f5885a700 1 -- 172.21.15.62:0/3520287141 >> 172.21.15.62:0/3520287141 conn(0x7f1f54071840 msgr2=0x7f1f5409b760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:01.449 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.439+0000 7f1f5885a700 1 -- 172.21.15.62:0/3520287141 shutdown_connections 2023-06-09T04:42:01.450 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.439+0000 7f1f5885a700 1 -- 172.21.15.62:0/3520287141 wait complete. 2023-06-09T04:42:01.450 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.439+0000 7f1f5885a700 1 Processor -- start 2023-06-09T04:42:01.450 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.443+0000 7f1f5885a700 1 -- start start 2023-06-09T04:42:01.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.443+0000 7f1f5885a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1f5406af20 0x7f1f540cbf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:01.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.443+0000 7f1f5885a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1f5406b2f0 0x7f1f540c8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:01.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.443+0000 7f1f5885a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1f540c7ee0 0x7f1f54159ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:01.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.443+0000 7f1f5885a700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f540c7ac0 con 0x7f1f5406b2f0 2023-06-09T04:42:01.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.443+0000 7f1f5885a700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f5415aa70 con 0x7f1f540c7ee0 2023-06-09T04:42:01.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.443+0000 7f1f5885a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f540c6ef0 con 0x7f1f5406af20 2023-06-09T04:42:01.454 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.443+0000 7f1f52ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1f5406b2f0 0x7f1f540c8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:01.454 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.443+0000 7f1f52ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1f5406b2f0 0x7f1f540c8d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53718/0 (socket says 172.21.15.62:53718) 2023-06-09T04:42:01.454 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.443+0000 7f1f52ffd700 1 -- 172.21.15.62:0/702385000 learned_addr learned my addr 172.21.15.62:0/702385000 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:01.455 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.443+0000 7f1f537fe700 1 --2- 172.21.15.62:0/702385000 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1f5406af20 0x7f1f540cbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:01.455 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.443+0000 7f1f53fff700 1 --2- 172.21.15.62:0/702385000 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1f540c7ee0 0x7f1f54159ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:01.455 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.443+0000 7f1f52ffd700 1 -- 172.21.15.62:0/702385000 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1f5406af20 msgr2=0x7f1f540cbf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:01.455 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.443+0000 7f1f52ffd700 1 --2- 172.21.15.62:0/702385000 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1f5406af20 0x7f1f540cbf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.455 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.443+0000 7f1f52ffd700 1 -- 172.21.15.62:0/702385000 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1f540c7ee0 msgr2=0x7f1f54159ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:01.455 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.443+0000 7f1f52ffd700 1 --2- 172.21.15.62:0/702385000 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1f540c7ee0 0x7f1f54159ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.455 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.443+0000 7f1f52ffd700 1 -- 172.21.15.62:0/702385000 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f540cc500 con 0x7f1f5406b2f0 2023-06-09T04:42:01.456 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.443+0000 7f1f53fff700 1 --2- 172.21.15.62:0/702385000 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1f540c7ee0 0x7f1f54159ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:01.456 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.443+0000 7f1f52ffd700 1 --2- 172.21.15.62:0/702385000 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1f5406b2f0 0x7f1f540c8d40 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f1f480108c0 tx=0x7f1f48010bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:01.456 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.447+0000 7f1f3bfff700 1 -- 172.21.15.62:0/702385000 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f48004020 con 0x7f1f5406b2f0 2023-06-09T04:42:01.456 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.447+0000 7f1f3bfff700 1 -- 172.21.15.62:0/702385000 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f48004180 con 0x7f1f5406b2f0 2023-06-09T04:42:01.456 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.447+0000 7f1f5885a700 1 -- 172.21.15.62:0/702385000 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f540c7120 con 0x7f1f5406b2f0 2023-06-09T04:42:01.456 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.447+0000 7f1f3bfff700 1 -- 172.21.15.62:0/702385000 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f48004510 con 0x7f1f5406b2f0 2023-06-09T04:42:01.456 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.447+0000 7f1f5885a700 1 -- 172.21.15.62:0/702385000 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f540c76e0 con 0x7f1f5406b2f0 2023-06-09T04:42:01.457 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.447+0000 7f1f5885a700 1 -- 172.21.15.62:0/702385000 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f540c7c00 con 0x7f1f5406b2f0 2023-06-09T04:42:01.457 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.447+0000 7f1f3bfff700 1 -- 172.21.15.62:0/702385000 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f1f480036c0 con 0x7f1f5406b2f0 2023-06-09T04:42:01.458 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.451+0000 7f1f3bfff700 1 --2- 172.21.15.62:0/702385000 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f1f400662f0 0x7f1f400687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:01.458 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.451+0000 7f1f3bfff700 1 -- 172.21.15.62:0/702385000 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1f480843b0 con 0x7f1f5406b2f0 2023-06-09T04:42:01.458 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.451+0000 7f1f537fe700 1 --2- 172.21.15.62:0/702385000 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f1f400662f0 0x7f1f400687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:01.458 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.451+0000 7f1f537fe700 1 --2- 172.21.15.62:0/702385000 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f1f400662f0 0x7f1f400687a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1f44000fd0 tx=0x7f1f44009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:01.460 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.455+0000 7f1f3bfff700 1 -- 172.21.15.62:0/702385000 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1f540c7c00 con 0x7f1f5406b2f0 2023-06-09T04:42:01.632 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.627+0000 7f1f5885a700 1 -- 172.21.15.62:0/702385000 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1f540c7c00 con 0x7f1f5406b2f0 2023-06-09T04:42:01.633 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.627+0000 7f1f3bfff700 1 -- 172.21.15.62:0/702385000 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1f540c7c00 con 0x7f1f5406b2f0 2023-06-09T04:42:01.633 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2023-06-09T04:42:01.637 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.631+0000 7f1f5885a700 1 -- 172.21.15.62:0/702385000 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f1f400662f0 msgr2=0x7f1f400687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:01.637 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.631+0000 7f1f5885a700 1 --2- 172.21.15.62:0/702385000 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f1f400662f0 0x7f1f400687a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1f44000fd0 tx=0x7f1f44009040 comp rx=0 tx=0).stop 2023-06-09T04:42:01.637 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.631+0000 7f1f5885a700 1 -- 172.21.15.62:0/702385000 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1f5406b2f0 msgr2=0x7f1f540c8d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:01.637 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.631+0000 7f1f5885a700 1 --2- 172.21.15.62:0/702385000 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1f5406b2f0 0x7f1f540c8d40 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f1f480108c0 tx=0x7f1f48010bd0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.638 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.631+0000 7f1f5885a700 1 -- 172.21.15.62:0/702385000 shutdown_connections 2023-06-09T04:42:01.638 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.631+0000 7f1f5885a700 1 --2- 172.21.15.62:0/702385000 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f1f400662f0 0x7f1f400687a0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.638 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.631+0000 7f1f5885a700 1 --2- 172.21.15.62:0/702385000 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1f540c7ee0 0x7f1f54159ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.638 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.631+0000 7f1f5885a700 1 --2- 172.21.15.62:0/702385000 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1f5406b2f0 0x7f1f540c8d40 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.638 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.631+0000 7f1f5885a700 1 --2- 172.21.15.62:0/702385000 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1f5406af20 0x7f1f540cbf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.638 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.631+0000 7f1f5885a700 1 -- 172.21.15.62:0/702385000 >> 172.21.15.62:0/702385000 conn(0x7f1f54071840 msgr2=0x7f1f540cdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:01.639 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.631+0000 7f1f5885a700 1 -- 172.21.15.62:0/702385000 shutdown_connections 2023-06-09T04:42:01.639 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.631+0000 7f1f5885a700 1 -- 172.21.15.62:0/702385000 wait complete. 2023-06-09T04:42:01.662 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T04:42:01.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.843+0000 7f9684fae700 1 Processor -- start 2023-06-09T04:42:01.849 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.843+0000 7f9684fae700 1 -- start start 2023-06-09T04:42:01.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.847+0000 7f9684fae700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f968015f400 0x7f968015d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:01.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.847+0000 7f9684fae700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f968015c3f0 0x7f9680071530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:01.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.847+0000 7f9684fae700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f96800697f0 0x7f9680069c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:01.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.847+0000 7f9684fae700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f968015f7d0 con 0x7f968015f400 2023-06-09T04:42:01.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.847+0000 7f9684fae700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f968006a170 con 0x7f968015c3f0 2023-06-09T04:42:01.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.847+0000 7f9684fae700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f968015c8f0 con 0x7f96800697f0 2023-06-09T04:42:01.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.847+0000 7f967e59c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f968015f400 0x7f968015d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:01.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.847+0000 7f967e59c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f968015f400 0x7f968015d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53732/0 (socket says 172.21.15.62:53732) 2023-06-09T04:42:01.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.847+0000 7f967dd9b700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f968015c3f0 0x7f9680071530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:01.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.847+0000 7f967e59c700 1 -- 172.21.15.62:0/245271494 learned_addr learned my addr 172.21.15.62:0/245271494 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:01.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.847+0000 7f967ed9d700 1 --2- 172.21.15.62:0/245271494 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f96800697f0 0x7f9680069c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:01.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.847+0000 7f967e59c700 1 -- 172.21.15.62:0/245271494 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f96800697f0 msgr2=0x7f9680069c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:01.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.847+0000 7f967e59c700 1 --2- 172.21.15.62:0/245271494 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f96800697f0 0x7f9680069c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.847+0000 7f967e59c700 1 -- 172.21.15.62:0/245271494 >> v2:172.21.15.89:3300/0 conn(0x7f968015c3f0 msgr2=0x7f9680071530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:01.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.847+0000 7f967e59c700 1 --2- 172.21.15.62:0/245271494 >> v2:172.21.15.89:3300/0 conn(0x7f968015c3f0 0x7f9680071530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.847+0000 7f967e59c700 1 -- 172.21.15.62:0/245271494 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f968015cbd0 con 0x7f968015f400 2023-06-09T04:42:01.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.847+0000 7f967e59c700 1 --2- 172.21.15.62:0/245271494 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f968015f400 0x7f968015d5b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9680073340 tx=0x7f9670009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75d804eb1af76e0d server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:01.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.851+0000 7f967d59a700 1 -- 172.21.15.62:0/245271494 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9670011830 con 0x7f968015f400 2023-06-09T04:42:01.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.851+0000 7f967d59a700 1 -- 172.21.15.62:0/245271494 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9670011990 con 0x7f968015f400 2023-06-09T04:42:01.857 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.851+0000 7f967d59a700 1 -- 172.21.15.62:0/245271494 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9670011d20 con 0x7f968015f400 2023-06-09T04:42:01.857 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.851+0000 7f9684fae700 1 -- 172.21.15.62:0/245271494 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f968015f400 msgr2=0x7f968015d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:01.857 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.851+0000 7f9684fae700 1 --2- 172.21.15.62:0/245271494 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f968015f400 0x7f968015d5b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f9680073340 tx=0x7f9670009bf0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.858 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.851+0000 7f9684fae700 1 -- 172.21.15.62:0/245271494 shutdown_connections 2023-06-09T04:42:01.858 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.851+0000 7f9684fae700 1 --2- 172.21.15.62:0/245271494 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f96800697f0 0x7f9680069c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.858 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.851+0000 7f9684fae700 1 --2- 172.21.15.62:0/245271494 >> v2:172.21.15.89:3300/0 conn(0x7f968015c3f0 0x7f9680071530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.858 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.851+0000 7f9684fae700 1 --2- 172.21.15.62:0/245271494 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f968015f400 0x7f968015d5b0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.858 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.851+0000 7f9684fae700 1 -- 172.21.15.62:0/245271494 >> 172.21.15.62:0/245271494 conn(0x7f968006c5d0 msgr2=0x7f96800cad60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:01.858 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.851+0000 7f9684fae700 1 -- 172.21.15.62:0/245271494 shutdown_connections 2023-06-09T04:42:01.858 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.851+0000 7f9684fae700 1 -- 172.21.15.62:0/245271494 wait complete. 2023-06-09T04:42:01.860 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.855+0000 7f9684fae700 1 Processor -- start 2023-06-09T04:42:01.860 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.855+0000 7f9684fae700 1 -- start start 2023-06-09T04:42:01.863 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.855+0000 7f9684fae700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96800697f0 0x7f96800b1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:01.863 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.855+0000 7f9684fae700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f968015c3f0 0x7f968015b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:01.863 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.855+0000 7f9684fae700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f968015f400 0x7f9680145c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:01.863 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.855+0000 7f9684fae700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f968015b700 con 0x7f96800697f0 2023-06-09T04:42:01.864 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.855+0000 7f9684fae700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96800b2420 con 0x7f968015c3f0 2023-06-09T04:42:01.864 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.855+0000 7f9684fae700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96800b2700 con 0x7f968015f400 2023-06-09T04:42:01.864 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.855+0000 7f967e59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96800697f0 0x7f96800b1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:01.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.855+0000 7f967e59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96800697f0 0x7f96800b1d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53742/0 (socket says 172.21.15.62:53742) 2023-06-09T04:42:01.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.855+0000 7f967e59c700 1 -- 172.21.15.62:0/1536514311 learned_addr learned my addr 172.21.15.62:0/1536514311 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:01.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.855+0000 7f967ed9d700 1 --2- 172.21.15.62:0/1536514311 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f968015f400 0x7f9680145c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:01.866 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.855+0000 7f967dd9b700 1 --2- 172.21.15.62:0/1536514311 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f968015c3f0 0x7f968015b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:01.867 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.859+0000 7f967e59c700 1 -- 172.21.15.62:0/1536514311 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f968015f400 msgr2=0x7f9680145c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:01.868 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.859+0000 7f967e59c700 1 --2- 172.21.15.62:0/1536514311 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f968015f400 0x7f9680145c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.868 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.859+0000 7f967e59c700 1 -- 172.21.15.62:0/1536514311 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f968015c3f0 msgr2=0x7f968015b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:01.868 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.859+0000 7f967e59c700 1 --2- 172.21.15.62:0/1536514311 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f968015c3f0 0x7f968015b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:01.869 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.859+0000 7f967e59c700 1 -- 172.21.15.62:0/1536514311 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9670009570 con 0x7f96800697f0 2023-06-09T04:42:01.869 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.859+0000 7f967e59c700 1 --2- 172.21.15.62:0/1536514311 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96800697f0 0x7f96800b1d20 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f9680066ce0 tx=0x7f9670004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:01.869 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.859+0000 7f966effd700 1 -- 172.21.15.62:0/1536514311 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9670004240 con 0x7f96800697f0 2023-06-09T04:42:01.869 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.859+0000 7f966effd700 1 -- 172.21.15.62:0/1536514311 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f967001f070 con 0x7f96800697f0 2023-06-09T04:42:01.869 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.859+0000 7f9684fae700 1 -- 172.21.15.62:0/1536514311 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96800b29e0 con 0x7f96800697f0 2023-06-09T04:42:01.870 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.859+0000 7f966effd700 1 -- 172.21.15.62:0/1536514311 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9670004600 con 0x7f96800697f0 2023-06-09T04:42:01.870 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.859+0000 7f9684fae700 1 -- 172.21.15.62:0/1536514311 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96800b2cc0 con 0x7f96800697f0 2023-06-09T04:42:01.870 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.859+0000 7f9684fae700 1 -- 172.21.15.62:0/1536514311 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9680071530 con 0x7f96800697f0 2023-06-09T04:42:01.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.863+0000 7f966effd700 1 -- 172.21.15.62:0/1536514311 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9670021030 con 0x7f96800697f0 2023-06-09T04:42:01.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.863+0000 7f966effd700 1 --2- 172.21.15.62:0/1536514311 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f96600662f0 0x7f96600687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:01.872 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.863+0000 7f966effd700 1 -- 172.21.15.62:0/1536514311 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9670084fd0 con 0x7f96800697f0 2023-06-09T04:42:01.872 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.867+0000 7f967dd9b700 1 --2- 172.21.15.62:0/1536514311 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f96600662f0 0x7f96600687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:01.872 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.867+0000 7f967dd9b700 1 --2- 172.21.15.62:0/1536514311 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f96600662f0 0x7f96600687a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f96801f4460 tx=0x7f9674009240 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:01.877 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:01.871+0000 7f966effd700 1 -- 172.21.15.62:0/1536514311 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f96700521d0 con 0x7f96800697f0 2023-06-09T04:42:02.049 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.043+0000 7f9684fae700 1 -- 172.21.15.62:0/1536514311 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f96800739c0 con 0x7f96800697f0 2023-06-09T04:42:02.050 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.043+0000 7f966effd700 1 -- 172.21.15.62:0/1536514311 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9670015020 con 0x7f96800697f0 2023-06-09T04:42:02.050 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-06-09T04:42:02.052 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.047+0000 7f9684fae700 1 -- 172.21.15.62:0/1536514311 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f96600662f0 msgr2=0x7f96600687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:02.052 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.047+0000 7f9684fae700 1 --2- 172.21.15.62:0/1536514311 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f96600662f0 0x7f96600687a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f96801f4460 tx=0x7f9674009240 comp rx=0 tx=0).stop 2023-06-09T04:42:02.053 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.047+0000 7f9684fae700 1 -- 172.21.15.62:0/1536514311 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96800697f0 msgr2=0x7f96800b1d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:02.053 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.047+0000 7f9684fae700 1 --2- 172.21.15.62:0/1536514311 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96800697f0 0x7f96800b1d20 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f9680066ce0 tx=0x7f9670004770 comp rx=0 tx=0).stop 2023-06-09T04:42:02.053 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.047+0000 7f9684fae700 1 -- 172.21.15.62:0/1536514311 shutdown_connections 2023-06-09T04:42:02.054 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.047+0000 7f9684fae700 1 --2- 172.21.15.62:0/1536514311 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f96600662f0 0x7f96600687a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:02.054 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.047+0000 7f9684fae700 1 --2- 172.21.15.62:0/1536514311 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f968015f400 0x7f9680145c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:02.054 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.047+0000 7f9684fae700 1 --2- 172.21.15.62:0/1536514311 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f968015c3f0 0x7f968015b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:02.054 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.047+0000 7f9684fae700 1 --2- 172.21.15.62:0/1536514311 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96800697f0 0x7f96800b1d20 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:02.054 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.047+0000 7f9684fae700 1 -- 172.21.15.62:0/1536514311 >> 172.21.15.62:0/1536514311 conn(0x7f968006c5d0 msgr2=0x7f96800aff70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:02.054 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.047+0000 7f9684fae700 1 -- 172.21.15.62:0/1536514311 shutdown_connections 2023-06-09T04:42:02.054 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.047+0000 7f9684fae700 1 -- 172.21.15.62:0/1536514311 wait complete. 2023-06-09T04:42:02.073 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T04:42:02.261 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.255+0000 7f11c90f5700 1 Processor -- start 2023-06-09T04:42:02.261 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.255+0000 7f11c90f5700 1 -- start start 2023-06-09T04:42:02.263 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.259+0000 7f11c90f5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11c4159b00 0x7f11c406c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:02.263 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.259+0000 7f11c90f5700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11c40ce4b0 con 0x7f11c4159ed0 2023-06-09T04:42:02.264 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.259+0000 7f11c90f5700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11c40b2ac0 con 0x7f11c40ce050 2023-06-09T04:42:02.264 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.259+0000 7f11c90f5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11c40cffd0 con 0x7f11c4159b00 2023-06-09T04:42:02.264 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.259+0000 7f11bbfff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f11c4159ed0 0x7f11c40d0a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:32960/0 (socket says 172.21.15.62:32960) 2023-06-09T04:42:02.264 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.259+0000 7f11bbfff700 1 -- 172.21.15.62:0/273813237 learned_addr learned my addr 172.21.15.62:0/273813237 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:42:02.265 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.259+0000 7f11c2d9d700 1 --2- 172.21.15.62:0/273813237 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11c4159b00 0x7f11c406c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:02.265 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.259+0000 7f11c2d9d700 1 -- 172.21.15.62:0/273813237 >> v1:172.21.15.89:6789/0 conn(0x7f11c40ce050 legacy=0x7f11c415fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:02.265 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.259+0000 7f11c2d9d700 1 -- 172.21.15.62:0/273813237 >> v1:172.21.15.62:6789/0 conn(0x7f11c4159ed0 legacy=0x7f11c40d0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:02.266 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.259+0000 7f11c259c700 1 -- 172.21.15.62:0/273813237 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3237904868 0 0) 0x7f11c40ce4b0 con 0x7f11c4159ed0 2023-06-09T04:42:02.266 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.259+0000 7f11c2d9d700 1 -- 172.21.15.62:0/273813237 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c40ce6e0 con 0x7f11c4159b00 2023-06-09T04:42:02.266 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.259+0000 7f11c2d9d700 1 --2- 172.21.15.62:0/273813237 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11c4159b00 0x7f11c406c530 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f11b4009880 tx=0x7f11b4009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=761d116d045391e8 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:02.266 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.259+0000 7f11c259c700 1 -- 172.21.15.62:0/273813237 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b4011830 con 0x7f11c4159b00 2023-06-09T04:42:02.267 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.259+0000 7f11c259c700 1 -- 172.21.15.62:0/273813237 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11b4011990 con 0x7f11c4159b00 2023-06-09T04:42:02.267 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.259+0000 7f11c259c700 1 -- 172.21.15.62:0/273813237 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b4011d20 con 0x7f11c4159b00 2023-06-09T04:42:02.267 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.259+0000 7f11c90f5700 1 -- 172.21.15.62:0/273813237 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11c4159b00 msgr2=0x7f11c406c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:02.268 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.259+0000 7f11c90f5700 1 --2- 172.21.15.62:0/273813237 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11c4159b00 0x7f11c406c530 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f11b4009880 tx=0x7f11b4009b90 comp rx=0 tx=0).stop 2023-06-09T04:42:02.268 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.263+0000 7f11c90f5700 1 -- 172.21.15.62:0/273813237 shutdown_connections 2023-06-09T04:42:02.268 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.263+0000 7f11c90f5700 1 --2- 172.21.15.62:0/273813237 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11c4159b00 0x7f11c406c530 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:02.268 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.263+0000 7f11c90f5700 1 -- 172.21.15.62:0/273813237 >> 172.21.15.62:0/273813237 conn(0x7f11c406db50 msgr2=0x7f11c406df50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:02.268 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.263+0000 7f11c90f5700 1 -- 172.21.15.62:0/273813237 shutdown_connections 2023-06-09T04:42:02.269 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.263+0000 7f11c90f5700 1 -- 172.21.15.62:0/273813237 wait complete. 2023-06-09T04:42:02.271 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.267+0000 7f11c90f5700 1 Processor -- start 2023-06-09T04:42:02.271 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.267+0000 7f11c90f5700 1 -- start start 2023-06-09T04:42:02.272 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.267+0000 7f11c90f5700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f11c40ce050 0x7f11c41f2d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:02.273 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.267+0000 7f11c90f5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11c4159b00 0x7f11c414d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:02.273 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.267+0000 7f11c90f5700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11c4159ed0 0x7f11c415b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:02.273 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.267+0000 7f11c90f5700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c41f61a0 con 0x7f11c40ce050 2023-06-09T04:42:02.273 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.267+0000 7f11c90f5700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c40b61e0 con 0x7f11c4159ed0 2023-06-09T04:42:02.273 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.267+0000 7f11c90f5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11c41f5ec0 con 0x7f11c4159b00 2023-06-09T04:42:02.274 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.267+0000 7f11c2d9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f11c40ce050 0x7f11c41f2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:02.274 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.267+0000 7f11c2d9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f11c40ce050 0x7f11c41f2d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53752/0 (socket says 172.21.15.62:53752) 2023-06-09T04:42:02.274 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.267+0000 7f11c2d9d700 1 -- 172.21.15.62:0/3454435264 learned_addr learned my addr 172.21.15.62:0/3454435264 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:02.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.267+0000 7f11bbfff700 1 --2- 172.21.15.62:0/3454435264 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11c4159b00 0x7f11c414d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:02.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.267+0000 7f11c359e700 1 --2- 172.21.15.62:0/3454435264 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11c4159ed0 0x7f11c415b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:02.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.267+0000 7f11c2d9d700 1 -- 172.21.15.62:0/3454435264 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11c4159b00 msgr2=0x7f11c414d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:02.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.267+0000 7f11c2d9d700 1 --2- 172.21.15.62:0/3454435264 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11c4159b00 0x7f11c414d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:02.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.267+0000 7f11c2d9d700 1 -- 172.21.15.62:0/3454435264 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11c4159ed0 msgr2=0x7f11c415b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:02.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.267+0000 7f11c2d9d700 1 --2- 172.21.15.62:0/3454435264 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11c4159ed0 0x7f11c415b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:02.276 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.267+0000 7f11c2d9d700 1 -- 172.21.15.62:0/3454435264 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11b40094b0 con 0x7f11c40ce050 2023-06-09T04:42:02.276 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.267+0000 7f11c2d9d700 1 --2- 172.21.15.62:0/3454435264 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f11c40ce050 0x7f11c41f2d50 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f11c4071740 tx=0x7f11b4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:02.276 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.267+0000 7f11bb7fe700 1 -- 172.21.15.62:0/3454435264 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b400ba70 con 0x7f11c40ce050 2023-06-09T04:42:02.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.271+0000 7f11bb7fe700 1 -- 172.21.15.62:0/3454435264 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11b401f070 con 0x7f11c40ce050 2023-06-09T04:42:02.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.271+0000 7f11bb7fe700 1 -- 172.21.15.62:0/3454435264 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b400be10 con 0x7f11c40ce050 2023-06-09T04:42:02.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.271+0000 7f11c90f5700 1 -- 172.21.15.62:0/3454435264 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11c40c51f0 con 0x7f11c40ce050 2023-06-09T04:42:02.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.271+0000 7f11c90f5700 1 -- 172.21.15.62:0/3454435264 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11c40c57b0 con 0x7f11c40ce050 2023-06-09T04:42:02.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.271+0000 7f11c90f5700 1 -- 172.21.15.62:0/3454435264 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11c40c5050 con 0x7f11c40ce050 2023-06-09T04:42:02.278 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.271+0000 7f11bb7fe700 1 -- 172.21.15.62:0/3454435264 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f11b401a430 con 0x7f11c40ce050 2023-06-09T04:42:02.281 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.275+0000 7f11bb7fe700 1 --2- 172.21.15.62:0/3454435264 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f11a40662f0 0x7f11a40687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:02.281 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.275+0000 7f11bb7fe700 1 -- 172.21.15.62:0/3454435264 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f11b4021070 con 0x7f11c40ce050 2023-06-09T04:42:02.281 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.275+0000 7f11bbfff700 1 --2- 172.21.15.62:0/3454435264 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f11a40662f0 0x7f11a40687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:02.282 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.275+0000 7f11bbfff700 1 --2- 172.21.15.62:0/3454435264 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f11a40662f0 0x7f11a40687a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f11c4160c60 tx=0x7f11ac007a80 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:02.286 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.279+0000 7f11bb7fe700 1 -- 172.21.15.62:0/3454435264 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f11c40c5050 con 0x7f11c40ce050 2023-06-09T04:42:02.459 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.455+0000 7f11c90f5700 1 -- 172.21.15.62:0/3454435264 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f11c40c5050 con 0x7f11c40ce050 2023-06-09T04:42:02.460 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.455+0000 7f11bb7fe700 1 -- 172.21.15.62:0/3454435264 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7f11c40c5050 con 0x7f11c40ce050 2023-06-09T04:42:02.461 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 64 2023-06-09T04:42:02.465 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.459+0000 7f11c90f5700 1 -- 172.21.15.62:0/3454435264 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f11a40662f0 msgr2=0x7f11a40687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:02.465 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.459+0000 7f11c90f5700 1 --2- 172.21.15.62:0/3454435264 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f11a40662f0 0x7f11a40687a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f11c4160c60 tx=0x7f11ac007a80 comp rx=0 tx=0).stop 2023-06-09T04:42:02.466 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.459+0000 7f11c90f5700 1 -- 172.21.15.62:0/3454435264 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f11c40ce050 msgr2=0x7f11c41f2d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:02.466 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.459+0000 7f11c90f5700 1 --2- 172.21.15.62:0/3454435264 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f11c40ce050 0x7f11c41f2d50 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f11c4071740 tx=0x7f11b4004770 comp rx=0 tx=0).stop 2023-06-09T04:42:02.466 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.459+0000 7f11c90f5700 1 -- 172.21.15.62:0/3454435264 shutdown_connections 2023-06-09T04:42:02.467 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.459+0000 7f11c90f5700 1 --2- 172.21.15.62:0/3454435264 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f11a40662f0 0x7f11a40687a0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:02.467 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.459+0000 7f11c90f5700 1 --2- 172.21.15.62:0/3454435264 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f11c4159ed0 0x7f11c415b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:02.467 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.459+0000 7f11c90f5700 1 --2- 172.21.15.62:0/3454435264 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f11c4159b00 0x7f11c414d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:02.468 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.459+0000 7f11c90f5700 1 --2- 172.21.15.62:0/3454435264 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f11c40ce050 0x7f11c41f2d50 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:02.468 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.459+0000 7f11c90f5700 1 -- 172.21.15.62:0/3454435264 >> 172.21.15.62:0/3454435264 conn(0x7f11c406db50 msgr2=0x7f11c40b0740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:02.468 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.459+0000 7f11c90f5700 1 -- 172.21.15.62:0/3454435264 shutdown_connections 2023-06-09T04:42:02.468 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.459+0000 7f11c90f5700 1 -- 172.21.15.62:0/3454435264 wait complete. 2023-06-09T04:42:02.488 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-09T04:42:02.676 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.671+0000 7f170c6f5700 1 Processor -- start 2023-06-09T04:42:02.676 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.671+0000 7f170c6f5700 1 -- start start 2023-06-09T04:42:02.678 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.671+0000 7f170c6f5700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1704159e10 0x7f17040b09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:02.679 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.671+0000 7f170c6f5700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f170415e090 0x7f17040b2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:02.679 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.671+0000 7f170c6f5700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17040cda40 con 0x7f170415e530 2023-06-09T04:42:02.679 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.671+0000 7f170c6f5700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17040cd830 con 0x7f1704159e10 2023-06-09T04:42:02.679 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.671+0000 7f170c6f5700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17040cdd20 con 0x7f170415e090 2023-06-09T04:42:02.680 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.675+0000 7f170ac92700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f170415e530 0x7f17040b2ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:32970/0 (socket says 172.21.15.62:32970) 2023-06-09T04:42:02.680 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.675+0000 7f170ac92700 1 -- 172.21.15.62:0/3461550959 learned_addr learned my addr 172.21.15.62:0/3461550959 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:42:02.680 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.675+0000 7f170a491700 1 --2- 172.21.15.62:0/3461550959 >> v2:172.21.15.62:3300/0 conn(0x7f1704159e10 0x7f17040b09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:02.680 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.675+0000 7f1709c90700 1 --2- 172.21.15.62:0/3461550959 >> v2:172.21.15.89:3300/0 conn(0x7f170415e090 0x7f17040b2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:02.681 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.675+0000 7f170948f700 1 -- 172.21.15.62:0/3461550959 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3412307118 0 0) 0x7f17040cda40 con 0x7f170415e530 2023-06-09T04:42:02.681 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.675+0000 7f170948f700 1 -- 172.21.15.62:0/3461550959 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16f00035d0 con 0x7f170415e530 2023-06-09T04:42:02.681 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.675+0000 7f170a491700 1 -- 172.21.15.62:0/3461550959 >> v2:172.21.15.89:3300/0 conn(0x7f170415e090 msgr2=0x7f17040b2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:02.681 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.675+0000 7f170a491700 1 --2- 172.21.15.62:0/3461550959 >> v2:172.21.15.89:3300/0 conn(0x7f170415e090 0x7f17040b2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:02.682 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.675+0000 7f170a491700 1 -- 172.21.15.62:0/3461550959 >> v1:172.21.15.62:6789/0 conn(0x7f170415e530 legacy=0x7f17040b2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:02.682 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.675+0000 7f170948f700 1 -- 172.21.15.62:0/3461550959 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3049573361 0 0) 0x7f16f00035d0 con 0x7f170415e530 2023-06-09T04:42:02.682 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.675+0000 7f170a491700 1 -- 172.21.15.62:0/3461550959 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f170415d890 con 0x7f1704159e10 2023-06-09T04:42:02.682 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.675+0000 7f1709c90700 1 --2- 172.21.15.62:0/3461550959 >> v2:172.21.15.89:3300/0 conn(0x7f170415e090 0x7f17040b2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:42:02.683 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.675+0000 7f170a491700 1 --2- 172.21.15.62:0/3461550959 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1704159e10 0x7f17040b09b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f17040b45d0 tx=0x7f1700009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fcc2054a58f4707 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:02.683 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.675+0000 7f170948f700 1 -- 172.21.15.62:0/3461550959 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16fc0019f0 con 0x7f1704159e10 2023-06-09T04:42:02.683 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.675+0000 7f170948f700 1 -- 172.21.15.62:0/3461550959 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1700004030 con 0x7f1704159e10 2023-06-09T04:42:02.683 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.675+0000 7f170948f700 1 -- 172.21.15.62:0/3461550959 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17000043c0 con 0x7f1704159e10 2023-06-09T04:42:02.683 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.675+0000 7f170c6f5700 1 -- 172.21.15.62:0/3461550959 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1704159e10 msgr2=0x7f17040b09b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:02.683 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.675+0000 7f170c6f5700 1 --2- 172.21.15.62:0/3461550959 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1704159e10 0x7f17040b09b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f17040b45d0 tx=0x7f1700009b30 comp rx=0 tx=0).stop 2023-06-09T04:42:02.684 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.679+0000 7f170c6f5700 1 -- 172.21.15.62:0/3461550959 shutdown_connections 2023-06-09T04:42:02.684 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.679+0000 7f170c6f5700 1 --2- 172.21.15.62:0/3461550959 >> v2:172.21.15.89:3300/0 conn(0x7f170415e090 0x7f17040b2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:02.684 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.679+0000 7f170c6f5700 1 --2- 172.21.15.62:0/3461550959 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1704159e10 0x7f17040b09b0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:02.684 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.679+0000 7f170c6f5700 1 -- 172.21.15.62:0/3461550959 >> 172.21.15.62:0/3461550959 conn(0x7f170406c5d0 msgr2=0x7f17040cad60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:02.685 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.679+0000 7f170c6f5700 1 -- 172.21.15.62:0/3461550959 shutdown_connections 2023-06-09T04:42:02.685 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.679+0000 7f170c6f5700 1 -- 172.21.15.62:0/3461550959 wait complete. 2023-06-09T04:42:02.686 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.679+0000 7f170c6f5700 1 Processor -- start 2023-06-09T04:42:02.687 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.679+0000 7f170c6f5700 1 -- start start 2023-06-09T04:42:02.688 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.683+0000 7f170c6f5700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1704159e10 0x7f17040af720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:02.688 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.683+0000 7f170c6f5700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f170415e090 0x7f17040adf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:02.688 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.683+0000 7f170c6f5700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f170415e530 0x7f170414d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:02.689 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.683+0000 7f170c6f5700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17040af290 con 0x7f1704159e10 2023-06-09T04:42:02.689 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.683+0000 7f170c6f5700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f170414e270 con 0x7f170415e090 2023-06-09T04:42:02.689 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.683+0000 7f170c6f5700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17040ae680 con 0x7f170415e530 2023-06-09T04:42:02.690 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.683+0000 7f170a491700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1704159e10 0x7f17040af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:02.691 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.683+0000 7f170a491700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1704159e10 0x7f17040af720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53772/0 (socket says 172.21.15.62:53772) 2023-06-09T04:42:02.691 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.683+0000 7f170a491700 1 -- 172.21.15.62:0/2868268111 learned_addr learned my addr 172.21.15.62:0/2868268111 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:02.691 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.683+0000 7f1709c90700 1 --2- 172.21.15.62:0/2868268111 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f170415e090 0x7f17040adf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:02.691 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.683+0000 7f170a491700 1 -- 172.21.15.62:0/2868268111 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f170415e530 msgr2=0x7f170414d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:02.691 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.683+0000 7f170ac92700 1 --2- 172.21.15.62:0/2868268111 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f170415e530 0x7f170414d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:02.692 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.683+0000 7f170a491700 1 --2- 172.21.15.62:0/2868268111 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f170415e530 0x7f170414d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:02.692 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.683+0000 7f170a491700 1 -- 172.21.15.62:0/2868268111 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f170415e090 msgr2=0x7f17040adf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:02.692 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.683+0000 7f170a491700 1 --2- 172.21.15.62:0/2868268111 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f170415e090 0x7f17040adf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:02.692 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.683+0000 7f170a491700 1 -- 172.21.15.62:0/2868268111 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16f40094b0 con 0x7f1704159e10 2023-06-09T04:42:02.692 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.683+0000 7f1709c90700 1 --2- 172.21.15.62:0/2868268111 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f170415e090 0x7f17040adf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:42:02.692 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.683+0000 7f170ac92700 1 --2- 172.21.15.62:0/2868268111 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f170415e530 0x7f170414d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:42:02.692 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.683+0000 7f170a491700 1 --2- 172.21.15.62:0/2868268111 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1704159e10 0x7f17040af720 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f17000090b0 tx=0x7f1700004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:02.693 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.683+0000 7f16faffd700 1 -- 172.21.15.62:0/2868268111 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1700003df0 con 0x7f1704159e10 2023-06-09T04:42:02.693 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.683+0000 7f16faffd700 1 -- 172.21.15.62:0/2868268111 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f170001f070 con 0x7f1704159e10 2023-06-09T04:42:02.693 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.683+0000 7f170c6f5700 1 -- 172.21.15.62:0/2868268111 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17000094b0 con 0x7f1704159e10 2023-06-09T04:42:02.693 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.683+0000 7f16faffd700 1 -- 172.21.15.62:0/2868268111 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1700011870 con 0x7f1704159e10 2023-06-09T04:42:02.693 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.683+0000 7f170c6f5700 1 -- 172.21.15.62:0/2868268111 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17040aec40 con 0x7f1704159e10 2023-06-09T04:42:02.694 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.687+0000 7f170c6f5700 1 -- 172.21.15.62:0/2868268111 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17040739c0 con 0x7f1704159e10 2023-06-09T04:42:02.694 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.687+0000 7f16faffd700 1 -- 172.21.15.62:0/2868268111 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f17000119d0 con 0x7f1704159e10 2023-06-09T04:42:02.695 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.691+0000 7f16faffd700 1 --2- 172.21.15.62:0/2868268111 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f16e8066320 0x7f16e80687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:02.695 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.691+0000 7f16faffd700 1 -- 172.21.15.62:0/2868268111 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1700021070 con 0x7f1704159e10 2023-06-09T04:42:02.696 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.691+0000 7f1709c90700 1 --2- 172.21.15.62:0/2868268111 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f16e8066320 0x7f16e80687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:02.697 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.691+0000 7f1709c90700 1 --2- 172.21.15.62:0/2868268111 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f16e8066320 0x7f16e80687d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f170406acf0 tx=0x7f16f4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:02.700 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.695+0000 7f16faffd700 1 -- 172.21.15.62:0/2868268111 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1700052b70 con 0x7f1704159e10 2023-06-09T04:42:02.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.863+0000 7f170c6f5700 1 -- 172.21.15.62:0/2868268111 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f17040ccd20 con 0x7f1704159e10 2023-06-09T04:42:02.872 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.867+0000 7f16faffd700 1 -- 172.21.15.62:0/2868268111 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7f1700056190 con 0x7f1704159e10 2023-06-09T04:42:02.872 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-06-09T04:42:02.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.871+0000 7f170c6f5700 1 -- 172.21.15.62:0/2868268111 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f16e8066320 msgr2=0x7f16e80687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:02.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.871+0000 7f170c6f5700 1 --2- 172.21.15.62:0/2868268111 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f16e8066320 0x7f16e80687d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f170406acf0 tx=0x7f16f4008040 comp rx=0 tx=0).stop 2023-06-09T04:42:02.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.871+0000 7f170c6f5700 1 -- 172.21.15.62:0/2868268111 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1704159e10 msgr2=0x7f17040af720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:02.877 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.871+0000 7f170c6f5700 1 --2- 172.21.15.62:0/2868268111 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1704159e10 0x7f17040af720 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f17000090b0 tx=0x7f1700004770 comp rx=0 tx=0).stop 2023-06-09T04:42:02.877 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.871+0000 7f170c6f5700 1 -- 172.21.15.62:0/2868268111 shutdown_connections 2023-06-09T04:42:02.877 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.871+0000 7f170c6f5700 1 --2- 172.21.15.62:0/2868268111 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f16e8066320 0x7f16e80687d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:02.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.871+0000 7f170c6f5700 1 --2- 172.21.15.62:0/2868268111 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f170415e530 0x7f170414d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:02.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.871+0000 7f170c6f5700 1 --2- 172.21.15.62:0/2868268111 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f170415e090 0x7f17040adf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:02.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.871+0000 7f170c6f5700 1 --2- 172.21.15.62:0/2868268111 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1704159e10 0x7f17040af720 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:02.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.871+0000 7f170c6f5700 1 -- 172.21.15.62:0/2868268111 >> 172.21.15.62:0/2868268111 conn(0x7f170406c5d0 msgr2=0x7f1704158d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:02.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.871+0000 7f170c6f5700 1 -- 172.21.15.62:0/2868268111 shutdown_connections 2023-06-09T04:42:02.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:02.871+0000 7f170c6f5700 1 -- 172.21.15.62:0/2868268111 wait complete. 2023-06-09T04:42:02.899 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-09T04:42:03.077 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.071+0000 7fb16006f700 1 Processor -- start 2023-06-09T04:42:03.078 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.071+0000 7fb16006f700 1 -- start start 2023-06-09T04:42:03.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.075+0000 7fb16006f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1580cd400 0x7fb158166be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:03.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.075+0000 7fb16006f700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1580ce4e0 con 0x7fb1580d0270 2023-06-09T04:42:03.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.075+0000 7fb16006f700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1580d25e0 con 0x7fb1580ce970 2023-06-09T04:42:03.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.075+0000 7fb16006f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1580cd8d0 con 0x7fb1580cd400 2023-06-09T04:42:03.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.075+0000 7fb15de0b700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fb1580d0270 0x7fb1580d0640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:32978/0 (socket says 172.21.15.62:32978) 2023-06-09T04:42:03.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.075+0000 7fb15de0b700 1 -- 172.21.15.62:0/3119509964 learned_addr learned my addr 172.21.15.62:0/3119509964 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:42:03.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.075+0000 7fb15e60c700 1 --2- 172.21.15.62:0/3119509964 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1580cd400 0x7fb158166be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:03.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.075+0000 7fb15ce09700 1 -- 172.21.15.62:0/3119509964 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4069859388 0 0) 0x7fb1580ce4e0 con 0x7fb1580d0270 2023-06-09T04:42:03.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.075+0000 7fb15ce09700 1 -- 172.21.15.62:0/3119509964 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1440035d0 con 0x7fb1580d0270 2023-06-09T04:42:03.083 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.075+0000 7fb15ce09700 1 -- 172.21.15.62:0/3119509964 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3281062493 0 0) 0x7fb1440035d0 con 0x7fb1580d0270 2023-06-09T04:42:03.083 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.075+0000 7fb15ce09700 1 -- 172.21.15.62:0/3119509964 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1580cd400 msgr2=0x7fb158166be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:03.083 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.075+0000 7fb15ce09700 1 --2- 172.21.15.62:0/3119509964 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1580cd400 0x7fb158166be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:03.084 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.075+0000 7fb15ce09700 1 -- 172.21.15.62:0/3119509964 >> v1:172.21.15.89:6789/0 conn(0x7fb1580ce970 legacy=0x7fb1580cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:03.084 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.075+0000 7fb15ce09700 1 -- 172.21.15.62:0/3119509964 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1580cdbb0 con 0x7fb1580d0270 2023-06-09T04:42:03.084 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.075+0000 7fb15ce09700 1 -- 172.21.15.62:0/3119509964 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 540845019 0 0) 0x7fb154005140 con 0x7fb1580d0270 2023-06-09T04:42:03.084 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.075+0000 7fb15ce09700 1 -- 172.21.15.62:0/3119509964 >> v1:172.21.15.62:6789/0 conn(0x7fb1580d0270 legacy=0x7fb1580d0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:03.084 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.075+0000 7fb15ce09700 1 --2- 172.21.15.62:0/3119509964 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb144003a50 0x7fb144003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:03.084 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.075+0000 7fb15ce09700 1 --2- 172.21.15.62:0/3119509964 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1440043a0 0x7fb144004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:03.084 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.075+0000 7fb15ce09700 1 --2- 172.21.15.62:0/3119509964 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb144005070 0x7fb14400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:03.085 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.075+0000 7fb15ce09700 1 -- 172.21.15.62:0/3119509964 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1580cd8d0 con 0x7fb144005070 2023-06-09T04:42:03.085 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.075+0000 7fb15ce09700 1 -- 172.21.15.62:0/3119509964 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb14400bf70 con 0x7fb1440043a0 2023-06-09T04:42:03.085 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.075+0000 7fb15ce09700 1 -- 172.21.15.62:0/3119509964 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb14400c130 con 0x7fb144003a50 2023-06-09T04:42:03.085 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.075+0000 7fb15e60c700 1 --2- 172.21.15.62:0/3119509964 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb1580cd400 0x7fb158166be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:42:03.085 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.075+0000 7fb15e60c700 1 --2- 172.21.15.62:0/3119509964 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb144005070 0x7fb14400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:03.085 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.075+0000 7fb15de0b700 1 --2- 172.21.15.62:0/3119509964 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb144003a50 0x7fb144003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:03.085 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.075+0000 7fb15d60a700 1 --2- 172.21.15.62:0/3119509964 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1440043a0 0x7fb144004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:03.087 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.079+0000 7fb15e60c700 1 -- 172.21.15.62:0/3119509964 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb144003a50 msgr2=0x7fb144003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:03.087 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.079+0000 7fb15e60c700 1 --2- 172.21.15.62:0/3119509964 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb144003a50 0x7fb144003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:03.087 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.079+0000 7fb15e60c700 1 -- 172.21.15.62:0/3119509964 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1440043a0 msgr2=0x7fb144004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:03.087 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.079+0000 7fb15e60c700 1 --2- 172.21.15.62:0/3119509964 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1440043a0 0x7fb144004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:03.087 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.079+0000 7fb15e60c700 1 -- 172.21.15.62:0/3119509964 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1440035d0 con 0x7fb144005070 2023-06-09T04:42:03.087 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.079+0000 7fb15d60a700 1 --2- 172.21.15.62:0/3119509964 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1440043a0 0x7fb144004870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:03.087 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.079+0000 7fb15e60c700 1 --2- 172.21.15.62:0/3119509964 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb144005070 0x7fb14400ba30 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fb1580cd800 tx=0x7fb1440058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45872b1ac4225313 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:03.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.079+0000 7fb15ce09700 1 -- 172.21.15.62:0/3119509964 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb150003c40 con 0x7fb144005070 2023-06-09T04:42:03.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.079+0000 7fb15ce09700 1 -- 172.21.15.62:0/3119509964 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb15000f040 con 0x7fb144005070 2023-06-09T04:42:03.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.079+0000 7fb15ce09700 1 -- 172.21.15.62:0/3119509964 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15000ea60 con 0x7fb144005070 2023-06-09T04:42:03.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.079+0000 7fb16006f700 1 -- 172.21.15.62:0/3119509964 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb144005070 msgr2=0x7fb14400ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:03.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.079+0000 7fb16006f700 1 --2- 172.21.15.62:0/3119509964 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb144005070 0x7fb14400ba30 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fb1580cd800 tx=0x7fb1440058a0 comp rx=0 tx=0).stop 2023-06-09T04:42:03.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.079+0000 7fb15e60c700 1 -- 172.21.15.62:0/3119509964 reap_dead start 2023-06-09T04:42:03.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.079+0000 7fb16006f700 1 -- 172.21.15.62:0/3119509964 shutdown_connections 2023-06-09T04:42:03.089 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.079+0000 7fb16006f700 1 -- 172.21.15.62:0/3119509964 >> 172.21.15.62:0/3119509964 conn(0x7fb158071840 msgr2=0x7fb15809b970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:03.089 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.079+0000 7fb16006f700 1 -- 172.21.15.62:0/3119509964 shutdown_connections 2023-06-09T04:42:03.089 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.079+0000 7fb16006f700 1 -- 172.21.15.62:0/3119509964 wait complete. 2023-06-09T04:42:03.089 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.083+0000 7fb16006f700 1 Processor -- start 2023-06-09T04:42:03.089 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.083+0000 7fb16006f700 1 -- start start 2023-06-09T04:42:03.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.083+0000 7fb16006f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb144005070 0x7fb1580cc190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:03.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.083+0000 7fb16006f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1580b7d60 0x7fb1580af260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:03.091 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.083+0000 7fb16006f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb15815d010 0x7fb1580af7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:03.091 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.083+0000 7fb16006f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1580b78d0 con 0x7fb1580b7d60 2023-06-09T04:42:03.091 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.083+0000 7fb16006f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1580b6cc0 con 0x7fb144005070 2023-06-09T04:42:03.091 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.083+0000 7fb16006f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1580b6fa0 con 0x7fb15815d010 2023-06-09T04:42:03.091 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.083+0000 7fb15d60a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1580b7d60 0x7fb1580af260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:03.091 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.083+0000 7fb15d60a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1580b7d60 0x7fb1580af260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53782/0 (socket says 172.21.15.62:53782) 2023-06-09T04:42:03.091 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.083+0000 7fb15d60a700 1 -- 172.21.15.62:0/2420596246 learned_addr learned my addr 172.21.15.62:0/2420596246 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:03.092 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.083+0000 7fb15de0b700 1 --2- 172.21.15.62:0/2420596246 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb144005070 0x7fb1580cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:03.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.083+0000 7fb15e60c700 1 --2- 172.21.15.62:0/2420596246 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb15815d010 0x7fb1580af7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:03.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.087+0000 7fb15d60a700 1 -- 172.21.15.62:0/2420596246 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb15815d010 msgr2=0x7fb1580af7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:03.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.087+0000 7fb15d60a700 1 --2- 172.21.15.62:0/2420596246 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb15815d010 0x7fb1580af7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:03.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.087+0000 7fb15d60a700 1 -- 172.21.15.62:0/2420596246 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb144005070 msgr2=0x7fb1580cc190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:03.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.087+0000 7fb15d60a700 1 --2- 172.21.15.62:0/2420596246 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb144005070 0x7fb1580cc190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:03.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.087+0000 7fb15d60a700 1 -- 172.21.15.62:0/2420596246 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1580b7280 con 0x7fb1580b7d60 2023-06-09T04:42:03.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.087+0000 7fb15d60a700 1 --2- 172.21.15.62:0/2420596246 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1580b7d60 0x7fb1580af260 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb14800e7d0 tx=0x7fb14800eae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:03.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.087+0000 7fb14e7fc700 1 -- 172.21.15.62:0/2420596246 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1480052e0 con 0x7fb1580b7d60 2023-06-09T04:42:03.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.087+0000 7fb14e7fc700 1 -- 172.21.15.62:0/2420596246 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb148005440 con 0x7fb1580b7d60 2023-06-09T04:42:03.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.087+0000 7fb14e7fc700 1 -- 172.21.15.62:0/2420596246 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1480038c0 con 0x7fb1580b7d60 2023-06-09T04:42:03.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.087+0000 7fb16006f700 1 -- 172.21.15.62:0/2420596246 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1580b7560 con 0x7fb1580b7d60 2023-06-09T04:42:03.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.087+0000 7fb16006f700 1 -- 172.21.15.62:0/2420596246 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1580c9950 con 0x7fb1580b7d60 2023-06-09T04:42:03.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.087+0000 7fb16006f700 1 -- 172.21.15.62:0/2420596246 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1580b7a40 con 0x7fb1580b7d60 2023-06-09T04:42:03.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.091+0000 7fb14e7fc700 1 -- 172.21.15.62:0/2420596246 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb148003a20 con 0x7fb1580b7d60 2023-06-09T04:42:03.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.091+0000 7fb14e7fc700 1 --2- 172.21.15.62:0/2420596246 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fb13c066320 0x7fb13c0687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:03.098 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.091+0000 7fb14e7fc700 1 -- 172.21.15.62:0/2420596246 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb148083d40 con 0x7fb1580b7d60 2023-06-09T04:42:03.098 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.091+0000 7fb15de0b700 1 --2- 172.21.15.62:0/2420596246 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fb13c066320 0x7fb13c0687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:03.099 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.095+0000 7fb15de0b700 1 --2- 172.21.15.62:0/2420596246 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fb13c066320 0x7fb13c0687d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb154005220 tx=0x7fb154009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:03.103 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.099+0000 7fb14e7fc700 1 -- 172.21.15.62:0/2420596246 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb148050df0 con 0x7fb1580b7d60 2023-06-09T04:42:03.288 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.283+0000 7fb16006f700 1 -- 172.21.15.62:0/2420596246 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb15804db30 con 0x7fb1580b7d60 2023-06-09T04:42:03.289 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.283+0000 7fb14e7fc700 1 -- 172.21.15.62:0/2420596246 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v30) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb148054410 con 0x7fb1580b7d60 2023-06-09T04:42:03.292 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.287+0000 7fb16006f700 1 -- 172.21.15.62:0/2420596246 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fb13c066320 msgr2=0x7fb13c0687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:03.293 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.287+0000 7fb16006f700 1 --2- 172.21.15.62:0/2420596246 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fb13c066320 0x7fb13c0687d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb154005220 tx=0x7fb154009040 comp rx=0 tx=0).stop 2023-06-09T04:42:03.293 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.287+0000 7fb16006f700 1 -- 172.21.15.62:0/2420596246 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1580b7d60 msgr2=0x7fb1580af260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:03.293 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.287+0000 7fb16006f700 1 --2- 172.21.15.62:0/2420596246 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1580b7d60 0x7fb1580af260 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb14800e7d0 tx=0x7fb14800eae0 comp rx=0 tx=0).stop 2023-06-09T04:42:03.293 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.287+0000 7fb16006f700 1 -- 172.21.15.62:0/2420596246 shutdown_connections 2023-06-09T04:42:03.293 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.287+0000 7fb16006f700 1 --2- 172.21.15.62:0/2420596246 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fb13c066320 0x7fb13c0687d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:03.293 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.287+0000 7fb16006f700 1 --2- 172.21.15.62:0/2420596246 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb15815d010 0x7fb1580af7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:03.293 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.287+0000 7fb16006f700 1 --2- 172.21.15.62:0/2420596246 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb1580b7d60 0x7fb1580af260 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:03.293 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.287+0000 7fb16006f700 1 --2- 172.21.15.62:0/2420596246 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb144005070 0x7fb1580cc190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:03.294 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.287+0000 7fb16006f700 1 -- 172.21.15.62:0/2420596246 >> 172.21.15.62:0/2420596246 conn(0x7fb158071840 msgr2=0x7fb1580d0640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:03.294 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.287+0000 7fb16006f700 1 -- 172.21.15.62:0/2420596246 shutdown_connections 2023-06-09T04:42:03.294 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.287+0000 7fb16006f700 1 -- 172.21.15.62:0/2420596246 wait complete. 2023-06-09T04:42:03.295 INFO:teuthology.orchestra.run.smithi062.stderr:listed 0 entries 2023-06-09T04:42:03.316 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-06-09T04:42:03.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:03.316 DEBUG:teuthology.orchestra.run.smithi062:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-06-09T04:42:03.388 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi062.front.sepia.ceph.com 2023-06-09T04:42:03.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:03.389 DEBUG:teuthology.orchestra.run.smithi062:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-06-09T04:42:03.407 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-06-09T04:42:03.407 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:42:03.426 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-06-09T04:42:03.427 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:42:03.486 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-06-09T04:42:03.487 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:42:03.550 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:42:03.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.731+0000 7f463a4dd700 1 Processor -- start 2023-06-09T04:42:03.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.731+0000 7f463a4dd700 1 -- start start 2023-06-09T04:42:03.739 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.735+0000 7f463a4dd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4634159c90 0x7f4634070e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:03.739 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.735+0000 7f463a4dd700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f46340b08d0 0x7f4634071340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:03.740 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.735+0000 7f463a4dd700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4634071880 con 0x7f46340cb850 2023-06-09T04:42:03.740 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.735+0000 7f463a4dd700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f463406b960 con 0x7f46340b08d0 2023-06-09T04:42:03.740 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.735+0000 7f463a4dd700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f463406f9b0 con 0x7f4634159c90 2023-06-09T04:42:03.740 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.735+0000 7f4638a7a700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f46340b08d0 0x7f4634071340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:03.741 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.735+0000 7f4633fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4634159c90 0x7f4634070e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:03.741 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.735+0000 7f4638a7a700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f46340b08d0 0x7f4634071340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.62:54718/0 (socket says 172.21.15.62:54718) 2023-06-09T04:42:03.741 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.735+0000 7f4638a7a700 1 -- 172.21.15.62:0/2742524774 learned_addr learned my addr 172.21.15.62:0/2742524774 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:03.741 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.735+0000 7f462bfff700 1 --1- 172.21.15.62:0/2742524774 >> v1:172.21.15.89:6789/0 conn(0x7f46340cb850 0x7f46340ca160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.62:54212/0 (socket says 172.21.15.62:54212) 2023-06-09T04:42:03.742 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.735+0000 7f4638a7a700 1 -- 172.21.15.62:0/2742524774 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4634159c90 msgr2=0x7f4634070e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:03.742 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.735+0000 7f4638a7a700 1 --2- 172.21.15.62:0/2742524774 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4634159c90 0x7f4634070e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:03.742 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.735+0000 7f4638a7a700 1 -- 172.21.15.62:0/2742524774 >> v1:172.21.15.89:6789/0 conn(0x7f46340cb850 legacy=0x7f46340ca160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:03.742 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.735+0000 7f4638a7a700 1 -- 172.21.15.62:0/2742524774 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f463415a060 con 0x7f46340b08d0 2023-06-09T04:42:03.743 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.735+0000 7f4638a7a700 1 --2- 172.21.15.62:0/2742524774 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f46340b08d0 0x7f4634071340 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f462c009e50 tx=0x7f462c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b6a0600edba0620 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:03.747 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.743+0000 7f46337fe700 1 -- 172.21.15.62:0/2742524774 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462c00e070 con 0x7f46340b08d0 2023-06-09T04:42:03.748 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.743+0000 7f46337fe700 1 -- 172.21.15.62:0/2742524774 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f462c00b910 con 0x7f46340b08d0 2023-06-09T04:42:03.748 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.743+0000 7f46337fe700 1 -- 172.21.15.62:0/2742524774 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462c00bcc0 con 0x7f46340b08d0 2023-06-09T04:42:03.749 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.743+0000 7f463a4dd700 1 -- 172.21.15.62:0/2742524774 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f46340b08d0 msgr2=0x7f4634071340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:03.750 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.743+0000 7f463a4dd700 1 --2- 172.21.15.62:0/2742524774 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f46340b08d0 0x7f4634071340 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f462c009e50 tx=0x7f462c00b330 comp rx=0 tx=0).stop 2023-06-09T04:42:03.750 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.743+0000 7f463a4dd700 1 -- 172.21.15.62:0/2742524774 shutdown_connections 2023-06-09T04:42:03.750 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.743+0000 7f463a4dd700 1 --2- 172.21.15.62:0/2742524774 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f46340b08d0 0x7f4634071340 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:03.750 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.743+0000 7f463a4dd700 1 --2- 172.21.15.62:0/2742524774 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4634159c90 0x7f4634070e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:03.751 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.743+0000 7f463a4dd700 1 -- 172.21.15.62:0/2742524774 >> 172.21.15.62:0/2742524774 conn(0x7f463406a410 msgr2=0x7f46340afd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:03.751 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.743+0000 7f463a4dd700 1 -- 172.21.15.62:0/2742524774 shutdown_connections 2023-06-09T04:42:03.751 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.743+0000 7f463a4dd700 1 -- 172.21.15.62:0/2742524774 wait complete. 2023-06-09T04:42:03.752 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.747+0000 7f463a4dd700 1 Processor -- start 2023-06-09T04:42:03.752 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.747+0000 7f463a4dd700 1 -- start start 2023-06-09T04:42:03.755 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.747+0000 7f463a4dd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f46340b08d0 0x7f46340c71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:03.755 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.747+0000 7f463a4dd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46340cb850 0x7f46340c5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:03.755 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.747+0000 7f463a4dd700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4634159c90 0x7f46341532d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:03.756 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.747+0000 7f463a4dd700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46340c58f0 con 0x7f46340cb850 2023-06-09T04:42:03.756 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.747+0000 7f463a4dd700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46340c52c0 con 0x7f4634159c90 2023-06-09T04:42:03.756 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.747+0000 7f463a4dd700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4634153d90 con 0x7f46340b08d0 2023-06-09T04:42:03.756 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.751+0000 7f462bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46340cb850 0x7f46340c5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:03.757 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.751+0000 7f462bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46340cb850 0x7f46340c5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53792/0 (socket says 172.21.15.62:53792) 2023-06-09T04:42:03.757 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.751+0000 7f462bfff700 1 -- 172.21.15.62:0/1949176799 learned_addr learned my addr 172.21.15.62:0/1949176799 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:03.757 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.751+0000 7f4633fff700 1 --2- 172.21.15.62:0/1949176799 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f46340b08d0 0x7f46340c71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:03.757 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.751+0000 7f4638a7a700 1 --2- 172.21.15.62:0/1949176799 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4634159c90 0x7f46341532d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:03.757 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.751+0000 7f462bfff700 1 -- 172.21.15.62:0/1949176799 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f46340b08d0 msgr2=0x7f46340c71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:03.757 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.751+0000 7f462bfff700 1 --2- 172.21.15.62:0/1949176799 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f46340b08d0 0x7f46340c71b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:03.757 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.751+0000 7f462bfff700 1 -- 172.21.15.62:0/1949176799 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4634159c90 msgr2=0x7f46341532d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:03.758 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.751+0000 7f462bfff700 1 --2- 172.21.15.62:0/1949176799 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4634159c90 0x7f46341532d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:03.758 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.751+0000 7f462bfff700 1 -- 172.21.15.62:0/1949176799 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f462c009b30 con 0x7f46340cb850 2023-06-09T04:42:03.758 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.751+0000 7f4638a7a700 1 --2- 172.21.15.62:0/1949176799 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4634159c90 0x7f46341532d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:03.758 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.751+0000 7f462bfff700 1 --2- 172.21.15.62:0/1949176799 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46340cb850 0x7f46340c5d10 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f461c00c480 tx=0x7f461c00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:03.759 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.751+0000 7f46317fa700 1 -- 172.21.15.62:0/1949176799 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f461c005cd0 con 0x7f46340cb850 2023-06-09T04:42:03.759 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.751+0000 7f46317fa700 1 -- 172.21.15.62:0/1949176799 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f461c005e30 con 0x7f46340cb850 2023-06-09T04:42:03.759 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.751+0000 7f463a4dd700 1 -- 172.21.15.62:0/1949176799 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4634154070 con 0x7f46340cb850 2023-06-09T04:42:03.759 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.751+0000 7f46317fa700 1 -- 172.21.15.62:0/1949176799 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f461c0072f0 con 0x7f46340cb850 2023-06-09T04:42:03.759 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.751+0000 7f463a4dd700 1 -- 172.21.15.62:0/1949176799 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4634154880 con 0x7f46340cb850 2023-06-09T04:42:03.759 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.755+0000 7f463a4dd700 1 -- 172.21.15.62:0/1949176799 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f463404db30 con 0x7f46340cb850 2023-06-09T04:42:03.760 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.755+0000 7f46317fa700 1 -- 172.21.15.62:0/1949176799 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f461c007450 con 0x7f46340cb850 2023-06-09T04:42:03.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.755+0000 7f46317fa700 1 --2- 172.21.15.62:0/1949176799 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f46140662f0 0x7f46140687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:03.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.759+0000 7f46317fa700 1 -- 172.21.15.62:0/1949176799 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f461c0835b0 con 0x7f46340cb850 2023-06-09T04:42:03.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.759+0000 7f4633fff700 1 --2- 172.21.15.62:0/1949176799 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f46140662f0 0x7f46140687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:03.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.759+0000 7f4633fff700 1 --2- 172.21.15.62:0/1949176799 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f46140662f0 0x7f46140687a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4624009ae0 tx=0x7f4624008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:03.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.763+0000 7f46317fa700 1 -- 172.21.15.62:0/1949176799 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f461c0506f0 con 0x7f46340cb850 2023-06-09T04:42:03.942 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.935+0000 7f463a4dd700 1 -- 172.21.15.62:0/1949176799 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4634155600 con 0x7f46340cb850 2023-06-09T04:42:03.945 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.939+0000 7f46317fa700 1 -- 172.21.15.62:0/1949176799 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+20180 (secure 0 0 0) 0x7f461c053d10 con 0x7f46340cb850 2023-06-09T04:42:03.946 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:42:03.946 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":30,"fsid":"f7998a1e-e5a9-4202-abaa-70c0eaae1047","created":"2023-06-09T04:40:30.469588+0000","modified":"2023-06-09T04:41:38.495589+0000","last_up_change":"2023-06-09T04:40:43.120747+0000","last_in_change":"2023-06-09T04:40:33.568221+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:40:44.646921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:40:50.006643+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:40:55.031273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:40:55.773517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-09T04:40:58.845383+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bc50bbc0-dd08-42ed-804c-ec3029e36c19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6802","nonce":1295788017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6807","nonce":1295788017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6815","nonce":1295788017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6809","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6811","nonce":1295788017}]},"public_addr":"172.21.15.62:6802/1295788017","cluster_addr":"172.21.15.62:6807/1295788017","heartbeat_back_addr":"172.21.15.62:6815/1295788017","heartbeat_front_addr":"172.21.15.62:6811/1295788017","state":["exists","up"]},{"osd":1,"uuid":"8230b12d-e22f-4985-a584-4cc64404cdbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6825","nonce":4120692006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6827","nonce":4120692006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6831","nonce":4120692006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6829","nonce":4120692006}]},"public_addr":"172.21.15.62:6825/4120692006","cluster_addr":"172.21.15.62:6827/4120692006","heartbeat_back_addr":"172.21.15.62:6831/4120692006","heartbeat_front_addr":"172.21.15.62:6829/4120692006","state":["exists","up"]},{"osd":2,"uuid":"d0202506-dbe9-4e3c-9271-687929abf96a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6801","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6803","nonce":4169607876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6805","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6806","nonce":4169607876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6814","nonce":4169607876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6810","nonce":4169607876}]},"public_addr":"172.21.15.62:6803/4169607876","cluster_addr":"172.21.15.62:6806/4169607876","heartbeat_back_addr":"172.21.15.62:6814/4169607876","heartbeat_front_addr":"172.21.15.62:6810/4169607876","state":["exists","up"]},{"osd":3,"uuid":"f3c0298a-b075-4411-af50-e16cd74fdddb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6817","nonce":3268438986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6819","nonce":3268438986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6823","nonce":3268438986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6821","nonce":3268438986}]},"public_addr":"172.21.15.62:6817/3268438986","cluster_addr":"172.21.15.62:6819/3268438986","heartbeat_back_addr":"172.21.15.62:6823/3268438986","heartbeat_front_addr":"172.21.15.62:6821/3268438986","state":["exists","up"]},{"osd":4,"uuid":"1ab5c5ca-e74f-475a-a309-683cc0029928","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6817","nonce":3139617628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6819","nonce":3139617628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6823","nonce":3139617628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6821","nonce":3139617628}]},"public_addr":"172.21.15.89:6817/3139617628","cluster_addr":"172.21.15.89:6819/3139617628","heartbeat_back_addr":"172.21.15.89:6823/3139617628","heartbeat_front_addr":"172.21.15.89:6821/3139617628","state":["exists","up"]},{"osd":5,"uuid":"a933e184-bd8f-4369-a1ba-a68de53c578c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6825","nonce":2681723596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6827","nonce":2681723596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6831","nonce":2681723596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6829","nonce":2681723596}]},"public_addr":"172.21.15.89:6825/2681723596","cluster_addr":"172.21.15.89:6827/2681723596","heartbeat_back_addr":"172.21.15.89:6831/2681723596","heartbeat_front_addr":"172.21.15.89:6829/2681723596","state":["exists","up"]},{"osd":6,"uuid":"1ed7ad37-2eee-49a6-954c-b537e2b7f0ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6809","nonce":1657136033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6811","nonce":1657136033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6815","nonce":1657136033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6813","nonce":1657136033}]},"public_addr":"172.21.15.89:6809/1657136033","cluster_addr":"172.21.15.89:6811/1657136033","heartbeat_back_addr":"172.21.15.89:6815/1657136033","heartbeat_front_addr":"172.21.15.89:6813/1657136033","state":["exists","up"]},{"osd":7,"uuid":"6ed732e9-33ff-40df-9038-a9f1d1622671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6801","nonce":1710561686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6803","nonce":1710561686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6807","nonce":1710561686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6805","nonce":1710561686}]},"public_addr":"172.21.15.89:6801/1710561686","cluster_addr":"172.21.15.89:6803/1710561686","heartbeat_back_addr":"172.21.15.89:6807/1710561686","heartbeat_front_addr":"172.21.15.89:6805/1710561686","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.335803+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.419788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.179334+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.263310+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.071846+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.375627+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.282277+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.315997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.12","mappings":[{"from":1,"to":2}]},{"pgid":"4.19","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:42:03.950 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.943+0000 7f463a4dd700 1 -- 172.21.15.62:0/1949176799 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f46140662f0 msgr2=0x7f46140687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:03.950 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.943+0000 7f463a4dd700 1 --2- 172.21.15.62:0/1949176799 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f46140662f0 0x7f46140687a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4624009ae0 tx=0x7f4624008040 comp rx=0 tx=0).stop 2023-06-09T04:42:03.950 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.943+0000 7f463a4dd700 1 -- 172.21.15.62:0/1949176799 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46340cb850 msgr2=0x7f46340c5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:03.950 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.943+0000 7f463a4dd700 1 --2- 172.21.15.62:0/1949176799 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46340cb850 0x7f46340c5d10 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f461c00c480 tx=0x7f461c00c840 comp rx=0 tx=0).stop 2023-06-09T04:42:03.950 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.943+0000 7f463a4dd700 1 -- 172.21.15.62:0/1949176799 shutdown_connections 2023-06-09T04:42:03.951 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.943+0000 7f463a4dd700 1 --2- 172.21.15.62:0/1949176799 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f46140662f0 0x7f46140687a0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:03.951 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.943+0000 7f463a4dd700 1 --2- 172.21.15.62:0/1949176799 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4634159c90 0x7f46341532d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:03.951 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.943+0000 7f463a4dd700 1 --2- 172.21.15.62:0/1949176799 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46340cb850 0x7f46340c5d10 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:03.951 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.943+0000 7f463a4dd700 1 --2- 172.21.15.62:0/1949176799 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f46340b08d0 0x7f46340c71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:03.951 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.943+0000 7f463a4dd700 1 -- 172.21.15.62:0/1949176799 >> 172.21.15.62:0/1949176799 conn(0x7f463406a410 msgr2=0x7f46340c9f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:03.951 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.943+0000 7f463a4dd700 1 -- 172.21.15.62:0/1949176799 shutdown_connections 2023-06-09T04:42:03.951 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:03.943+0000 7f463a4dd700 1 -- 172.21.15.62:0/1949176799 wait complete. 2023-06-09T04:42:03.974 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:40:44.646921+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:40:50.006643+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T04:40:55.031273+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T04:40:55.773517+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-09T04:40:58.845383+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-09T04:42:03.975 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:42:04.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.155+0000 7f76f1970700 1 Processor -- start 2023-06-09T04:42:04.161 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.155+0000 7f76f1970700 1 -- start start 2023-06-09T04:42:04.163 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.159+0000 7f76f1970700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76ec0d1f80 0x7f76ec0b3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:04.164 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.159+0000 7f76f1970700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f76ec0cebf0 0x7f76ec0ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:04.164 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.159+0000 7f76f1970700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76ec0b4d50 con 0x7f76ec0cd110 2023-06-09T04:42:04.164 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.159+0000 7f76f1970700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76ec0cd590 con 0x7f76ec0cebf0 2023-06-09T04:42:04.164 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.159+0000 7f76f1970700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76ec0cf040 con 0x7f76ec0d1f80 2023-06-09T04:42:04.165 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.159+0000 7f76ebfff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f76ec0cebf0 0x7f76ec0ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:04.165 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.159+0000 7f76f116f700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f76ec0cd110 0x7f76ec0b2400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.62:54222/0 (socket says 172.21.15.62:54222) 2023-06-09T04:42:04.165 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.159+0000 7f76f116f700 1 -- 172.21.15.62:0/2145072858 learned_addr learned my addr 172.21.15.62:0/2145072858 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:42:04.165 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.159+0000 7f76f096e700 1 --2- 172.21.15.62:0/2145072858 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76ec0d1f80 0x7f76ec0b3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:04.166 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.159+0000 7f76eb7fe700 1 -- 172.21.15.62:0/2145072858 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1538629840 0 0) 0x7f76ec0b4d50 con 0x7f76ec0cd110 2023-06-09T04:42:04.166 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.159+0000 7f76eb7fe700 1 -- 172.21.15.62:0/2145072858 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76dc0035d0 con 0x7f76ec0cd110 2023-06-09T04:42:04.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.159+0000 7f76f096e700 1 -- 172.21.15.62:0/2145072858 >> v2:172.21.15.89:3300/0 conn(0x7f76ec0cebf0 msgr2=0x7f76ec0ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:04.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.159+0000 7f76f096e700 1 --2- 172.21.15.62:0/2145072858 >> v2:172.21.15.89:3300/0 conn(0x7f76ec0cebf0 0x7f76ec0ccbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:04.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.159+0000 7f76f096e700 1 -- 172.21.15.62:0/2145072858 >> v1:172.21.15.89:6789/0 conn(0x7f76ec0cd110 legacy=0x7f76ec0b2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:04.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.159+0000 7f76f096e700 1 -- 172.21.15.62:0/2145072858 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76ec0b4140 con 0x7f76ec0d1f80 2023-06-09T04:42:04.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.159+0000 7f76ebfff700 1 --2- 172.21.15.62:0/2145072858 >> v2:172.21.15.89:3300/0 conn(0x7f76ec0cebf0 0x7f76ec0ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:42:04.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.159+0000 7f76f096e700 1 --2- 172.21.15.62:0/2145072858 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76ec0d1f80 0x7f76ec0b3b20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f76e0009840 tx=0x7f76e0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=614e32ea24aa21b2 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:04.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.159+0000 7f76eb7fe700 1 -- 172.21.15.62:0/2145072858 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e0005e50 con 0x7f76ec0d1f80 2023-06-09T04:42:04.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.163+0000 7f76eb7fe700 1 -- 172.21.15.62:0/2145072858 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76e0006030 con 0x7f76ec0d1f80 2023-06-09T04:42:04.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.163+0000 7f76eb7fe700 1 -- 172.21.15.62:0/2145072858 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e00063c0 con 0x7f76ec0d1f80 2023-06-09T04:42:04.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.163+0000 7f76f1970700 1 -- 172.21.15.62:0/2145072858 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76ec0d1f80 msgr2=0x7f76ec0b3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:04.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.163+0000 7f76f1970700 1 --2- 172.21.15.62:0/2145072858 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76ec0d1f80 0x7f76ec0b3b20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f76e0009840 tx=0x7f76e0009b50 comp rx=0 tx=0).stop 2023-06-09T04:42:04.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.163+0000 7f76f1970700 1 -- 172.21.15.62:0/2145072858 shutdown_connections 2023-06-09T04:42:04.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.163+0000 7f76f1970700 1 --2- 172.21.15.62:0/2145072858 >> v2:172.21.15.89:3300/0 conn(0x7f76ec0cebf0 0x7f76ec0ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:04.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.163+0000 7f76f1970700 1 --2- 172.21.15.62:0/2145072858 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76ec0d1f80 0x7f76ec0b3b20 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:04.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.163+0000 7f76f1970700 1 -- 172.21.15.62:0/2145072858 >> 172.21.15.62:0/2145072858 conn(0x7f76ec071840 msgr2=0x7f76ec09b760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:04.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.163+0000 7f76f1970700 1 -- 172.21.15.62:0/2145072858 shutdown_connections 2023-06-09T04:42:04.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.163+0000 7f76f1970700 1 -- 172.21.15.62:0/2145072858 wait complete. 2023-06-09T04:42:04.172 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.167+0000 7f76f1970700 1 Processor -- start 2023-06-09T04:42:04.173 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.167+0000 7f76f1970700 1 -- start start 2023-06-09T04:42:04.175 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.167+0000 7f76f1970700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76ec0cd110 0x7f76ec1f1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:04.176 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.167+0000 7f76f1970700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76ec0cebf0 0x7f76ec1f5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:04.176 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.171+0000 7f76f1970700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f76ec0d1f80 0x7f76ec0c7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:04.176 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.171+0000 7f76f1970700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76ec1f1590 con 0x7f76ec0cd110 2023-06-09T04:42:04.176 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.171+0000 7f76f1970700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76ec1f55b0 con 0x7f76ec0d1f80 2023-06-09T04:42:04.176 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.171+0000 7f76f1970700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76ec1f2020 con 0x7f76ec0cebf0 2023-06-09T04:42:04.176 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.171+0000 7f76f096e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76ec0cd110 0x7f76ec1f1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:04.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.171+0000 7f76f096e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76ec0cd110 0x7f76ec1f1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53808/0 (socket says 172.21.15.62:53808) 2023-06-09T04:42:04.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.171+0000 7f76f096e700 1 -- 172.21.15.62:0/3054658586 learned_addr learned my addr 172.21.15.62:0/3054658586 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:04.178 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.171+0000 7f76ebfff700 1 --2- 172.21.15.62:0/3054658586 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76ec0cebf0 0x7f76ec1f5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:04.178 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.171+0000 7f76f116f700 1 --2- 172.21.15.62:0/3054658586 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f76ec0d1f80 0x7f76ec0c7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:04.178 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.171+0000 7f76f096e700 1 -- 172.21.15.62:0/3054658586 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76ec0cebf0 msgr2=0x7f76ec1f5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:04.178 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.171+0000 7f76f096e700 1 --2- 172.21.15.62:0/3054658586 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76ec0cebf0 0x7f76ec1f5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:04.178 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.171+0000 7f76f096e700 1 -- 172.21.15.62:0/3054658586 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f76ec0d1f80 msgr2=0x7f76ec0c7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:04.179 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.171+0000 7f76f096e700 1 --2- 172.21.15.62:0/3054658586 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f76ec0d1f80 0x7f76ec0c7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:04.179 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.171+0000 7f76f096e700 1 -- 172.21.15.62:0/3054658586 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76d80094b0 con 0x7f76ec0cd110 2023-06-09T04:42:04.179 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.171+0000 7f76f096e700 1 --2- 172.21.15.62:0/3054658586 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76ec0cd110 0x7f76ec1f1050 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f76ec0cd6d0 tx=0x7f76e0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:04.179 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.171+0000 7f76e97fa700 1 -- 172.21.15.62:0/3054658586 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e00036c0 con 0x7f76ec0cd110 2023-06-09T04:42:04.179 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.171+0000 7f76e97fa700 1 -- 172.21.15.62:0/3054658586 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76e0020070 con 0x7f76ec0cd110 2023-06-09T04:42:04.179 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.171+0000 7f76e97fa700 1 -- 172.21.15.62:0/3054658586 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e0003a60 con 0x7f76ec0cd110 2023-06-09T04:42:04.179 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.171+0000 7f76f1970700 1 -- 172.21.15.62:0/3054658586 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76e0009450 con 0x7f76ec0cd110 2023-06-09T04:42:04.180 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.171+0000 7f76f1970700 1 -- 172.21.15.62:0/3054658586 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76ec0c83c0 con 0x7f76ec0cd110 2023-06-09T04:42:04.180 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.175+0000 7f76f1970700 1 -- 172.21.15.62:0/3054658586 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76ec0739c0 con 0x7f76ec0cd110 2023-06-09T04:42:04.181 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.175+0000 7f76e97fa700 1 -- 172.21.15.62:0/3054658586 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f76e0022030 con 0x7f76ec0cd110 2023-06-09T04:42:04.183 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.179+0000 7f76e97fa700 1 --2- 172.21.15.62:0/3054658586 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f76d0066320 0x7f76d00687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:04.183 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.179+0000 7f76e97fa700 1 -- 172.21.15.62:0/3054658586 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f76e00854d0 con 0x7f76ec0cd110 2023-06-09T04:42:04.184 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.179+0000 7f76ebfff700 1 --2- 172.21.15.62:0/3054658586 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f76d0066320 0x7f76d00687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:04.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.179+0000 7f76ebfff700 1 --2- 172.21.15.62:0/3054658586 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f76d0066320 0x7f76d00687d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f76ec15ab70 tx=0x7f76d8009240 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:04.190 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.183+0000 7f76e97fa700 1 -- 172.21.15.62:0/3054658586 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f76e0052610 con 0x7f76ec0cd110 2023-06-09T04:42:04.363 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.359+0000 7f76f1970700 1 -- 172.21.15.62:0/3054658586 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f76ec151ef0 con 0x7f76ec0cd110 2023-06-09T04:42:04.364 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.359+0000 7f76e97fa700 1 -- 172.21.15.62:0/3054658586 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f76e0055c30 con 0x7f76ec0cd110 2023-06-09T04:42:04.365 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2023-06-09T04:42:04.367 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.359+0000 7f76f1970700 1 -- 172.21.15.62:0/3054658586 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f76d0066320 msgr2=0x7f76d00687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:04.367 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.363+0000 7f76f1970700 1 --2- 172.21.15.62:0/3054658586 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f76d0066320 0x7f76d00687d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f76ec15ab70 tx=0x7f76d8009240 comp rx=0 tx=0).stop 2023-06-09T04:42:04.368 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.363+0000 7f76f1970700 1 -- 172.21.15.62:0/3054658586 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76ec0cd110 msgr2=0x7f76ec1f1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:04.368 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.363+0000 7f76f1970700 1 --2- 172.21.15.62:0/3054658586 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76ec0cd110 0x7f76ec1f1050 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f76ec0cd6d0 tx=0x7f76e0004770 comp rx=0 tx=0).stop 2023-06-09T04:42:04.369 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.363+0000 7f76f1970700 1 -- 172.21.15.62:0/3054658586 shutdown_connections 2023-06-09T04:42:04.369 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.363+0000 7f76f1970700 1 --2- 172.21.15.62:0/3054658586 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f76d0066320 0x7f76d00687d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:04.370 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.363+0000 7f76f1970700 1 --2- 172.21.15.62:0/3054658586 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f76ec0d1f80 0x7f76ec0c7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:04.370 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.363+0000 7f76f1970700 1 --2- 172.21.15.62:0/3054658586 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f76ec0cebf0 0x7f76ec1f5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:04.370 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.363+0000 7f76f1970700 1 --2- 172.21.15.62:0/3054658586 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f76ec0cd110 0x7f76ec1f1050 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:04.370 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.363+0000 7f76f1970700 1 -- 172.21.15.62:0/3054658586 >> 172.21.15.62:0/3054658586 conn(0x7f76ec071840 msgr2=0x7f76ec0b1510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:04.371 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.363+0000 7f76f1970700 1 -- 172.21.15.62:0/3054658586 shutdown_connections 2023-06-09T04:42:04.371 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.363+0000 7f76f1970700 1 -- 172.21.15.62:0/3054658586 wait complete. 2023-06-09T04:42:04.390 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:42:04.569 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.563+0000 7f17925c1700 1 Processor -- start 2023-06-09T04:42:04.569 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.563+0000 7f17925c1700 1 -- start start 2023-06-09T04:42:04.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.563+0000 7f17925c1700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f178c069f00 0x7f178c0cd470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:04.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.563+0000 7f17925c1700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f178c0b0be0 0x7f178c163f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:04.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.563+0000 7f17925c1700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f178c06f7f0 con 0x7f178c1637c0 2023-06-09T04:42:04.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.563+0000 7f17925c1700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f178c0cd9b0 con 0x7f178c069f00 2023-06-09T04:42:04.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.563+0000 7f17925c1700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f178c071a80 con 0x7f178c0b0be0 2023-06-09T04:42:04.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.567+0000 7f178b7fe700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f178c069f00 0x7f178c0cd470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:04.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.567+0000 7f178b7fe700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f178c069f00 0x7f178c0cd470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.62:54748/0 (socket says 172.21.15.62:54748) 2023-06-09T04:42:04.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.567+0000 7f178b7fe700 1 -- 172.21.15.62:0/40269573 learned_addr learned my addr 172.21.15.62:0/40269573 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:04.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.567+0000 7f1790b5e700 1 --2- 172.21.15.62:0/40269573 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f178c0b0be0 0x7f178c163f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:04.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.567+0000 7f1790b5e700 1 -- 172.21.15.62:0/40269573 >> v2:172.21.15.89:3300/0 conn(0x7f178c069f00 msgr2=0x7f178c0cd470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:04.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.567+0000 7f1790b5e700 1 --2- 172.21.15.62:0/40269573 >> v2:172.21.15.89:3300/0 conn(0x7f178c069f00 0x7f178c0cd470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:04.574 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.567+0000 7f1790b5e700 1 -- 172.21.15.62:0/40269573 >> v1:172.21.15.89:6789/0 conn(0x7f178c1637c0 legacy=0x7f178c0697f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:04.574 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.567+0000 7f1790b5e700 1 -- 172.21.15.62:0/40269573 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f178c163b90 con 0x7f178c0b0be0 2023-06-09T04:42:04.574 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.567+0000 7f178b7fe700 1 --2- 172.21.15.62:0/40269573 >> v2:172.21.15.89:3300/0 conn(0x7f178c069f00 0x7f178c0cd470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:42:04.574 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.567+0000 7f178affd700 1 -- 172.21.15.62:0/40269573 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3382307504 0 0) 0x7f178c06f7f0 con 0x7f178c1637c0 2023-06-09T04:42:04.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.567+0000 7f1790b5e700 1 --2- 172.21.15.62:0/40269573 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f178c0b0be0 0x7f178c163f30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1784009d90 tx=0x7f178400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4942cd4d5c5f52a6 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:04.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.567+0000 7f178affd700 1 -- 172.21.15.62:0/40269573 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f178400e070 con 0x7f178c0b0be0 2023-06-09T04:42:04.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.567+0000 7f178affd700 1 -- 172.21.15.62:0/40269573 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f178400bb20 con 0x7f178c0b0be0 2023-06-09T04:42:04.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.567+0000 7f178affd700 1 -- 172.21.15.62:0/40269573 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1784012430 con 0x7f178c0b0be0 2023-06-09T04:42:04.576 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.571+0000 7f17925c1700 1 -- 172.21.15.62:0/40269573 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f178c0b0be0 msgr2=0x7f178c163f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:04.576 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.571+0000 7f17925c1700 1 --2- 172.21.15.62:0/40269573 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f178c0b0be0 0x7f178c163f30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1784009d90 tx=0x7f178400b330 comp rx=0 tx=0).stop 2023-06-09T04:42:04.576 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.571+0000 7f17925c1700 1 -- 172.21.15.62:0/40269573 shutdown_connections 2023-06-09T04:42:04.576 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.571+0000 7f17925c1700 1 --2- 172.21.15.62:0/40269573 >> v2:172.21.15.89:3300/0 conn(0x7f178c069f00 0x7f178c0cd470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:04.576 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.571+0000 7f17925c1700 1 --2- 172.21.15.62:0/40269573 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f178c0b0be0 0x7f178c163f30 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:04.577 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.571+0000 7f17925c1700 1 -- 172.21.15.62:0/40269573 >> 172.21.15.62:0/40269573 conn(0x7f178c06c5d0 msgr2=0x7f178c0cad60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:04.577 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.571+0000 7f17925c1700 1 -- 172.21.15.62:0/40269573 shutdown_connections 2023-06-09T04:42:04.577 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.571+0000 7f17925c1700 1 -- 172.21.15.62:0/40269573 wait complete. 2023-06-09T04:42:04.579 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.575+0000 7f17925c1700 1 Processor -- start 2023-06-09T04:42:04.580 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.575+0000 7f17925c1700 1 -- start start 2023-06-09T04:42:04.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.575+0000 7f17925c1700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f178c069f00 0x7f178c143be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:04.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.575+0000 7f17925c1700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f178c0b0be0 0x7f178c1443f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:04.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.575+0000 7f17925c1700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f178c1637c0 0x7f178c146480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:04.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.575+0000 7f17925c1700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f178c144120 con 0x7f178c0b0be0 2023-06-09T04:42:04.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.575+0000 7f17925c1700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f178c146f20 con 0x7f178c1637c0 2023-06-09T04:42:04.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.575+0000 7f17925c1700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f178c147200 con 0x7f178c069f00 2023-06-09T04:42:04.583 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.575+0000 7f178b7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f178c0b0be0 0x7f178c1443f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:04.584 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.575+0000 7f178b7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f178c0b0be0 0x7f178c1443f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53816/0 (socket says 172.21.15.62:53816) 2023-06-09T04:42:04.584 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.575+0000 7f178b7fe700 1 -- 172.21.15.62:0/220862046 learned_addr learned my addr 172.21.15.62:0/220862046 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:04.584 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.575+0000 7f178bfff700 1 --2- 172.21.15.62:0/220862046 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f178c069f00 0x7f178c143be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:04.584 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.575+0000 7f1790b5e700 1 --2- 172.21.15.62:0/220862046 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f178c1637c0 0x7f178c146480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:04.584 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.579+0000 7f178b7fe700 1 -- 172.21.15.62:0/220862046 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f178c069f00 msgr2=0x7f178c143be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:04.585 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.579+0000 7f178b7fe700 1 --2- 172.21.15.62:0/220862046 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f178c069f00 0x7f178c143be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:04.585 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.579+0000 7f178b7fe700 1 -- 172.21.15.62:0/220862046 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f178c1637c0 msgr2=0x7f178c146480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:04.585 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.579+0000 7f178b7fe700 1 --2- 172.21.15.62:0/220862046 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f178c1637c0 0x7f178c146480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:04.585 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.579+0000 7f178b7fe700 1 -- 172.21.15.62:0/220862046 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1780009570 con 0x7f178c0b0be0 2023-06-09T04:42:04.585 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.579+0000 7f178bfff700 1 --2- 172.21.15.62:0/220862046 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f178c069f00 0x7f178c143be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:42:04.585 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.579+0000 7f178b7fe700 1 --2- 172.21.15.62:0/220862046 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f178c0b0be0 0x7f178c1443f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f178000e9a0 tx=0x7f178000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:04.586 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.579+0000 7f1788ff9700 1 -- 172.21.15.62:0/220862046 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f178000c690 con 0x7f178c0b0be0 2023-06-09T04:42:04.586 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.579+0000 7f1788ff9700 1 -- 172.21.15.62:0/220862046 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f178000c7f0 con 0x7f178c0b0be0 2023-06-09T04:42:04.586 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.579+0000 7f17925c1700 1 -- 172.21.15.62:0/220862046 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1784009a70 con 0x7f178c0b0be0 2023-06-09T04:42:04.586 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.579+0000 7f1788ff9700 1 -- 172.21.15.62:0/220862046 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f178000cb60 con 0x7f178c0b0be0 2023-06-09T04:42:04.587 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.579+0000 7f17925c1700 1 -- 172.21.15.62:0/220862046 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f178c15e9d0 con 0x7f178c0b0be0 2023-06-09T04:42:04.587 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.579+0000 7f17925c1700 1 -- 172.21.15.62:0/220862046 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f178c0739c0 con 0x7f178c0b0be0 2023-06-09T04:42:04.587 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.583+0000 7f1788ff9700 1 -- 172.21.15.62:0/220862046 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f178000ccc0 con 0x7f178c0b0be0 2023-06-09T04:42:04.589 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.583+0000 7f1788ff9700 1 --2- 172.21.15.62:0/220862046 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f17780662f0 0x7f17780687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:04.589 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.583+0000 7f1788ff9700 1 -- 172.21.15.62:0/220862046 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1780083fd0 con 0x7f178c0b0be0 2023-06-09T04:42:04.589 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.583+0000 7f178bfff700 1 --2- 172.21.15.62:0/220862046 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f17780662f0 0x7f17780687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:04.590 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.583+0000 7f178bfff700 1 --2- 172.21.15.62:0/220862046 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f17780662f0 0x7f17780687a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f177c007fd0 tx=0x7f177c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:04.592 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.587+0000 7f1788ff9700 1 -- 172.21.15.62:0/220862046 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1780051110 con 0x7f178c0b0be0 2023-06-09T04:42:04.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.759+0000 7f17925c1700 1 -- 172.21.15.62:0/220862046 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f178c0716e0 con 0x7f178c0b0be0 2023-06-09T04:42:04.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.759+0000 7f1788ff9700 1 -- 172.21.15.62:0/220862046 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1780054730 con 0x7f178c0b0be0 2023-06-09T04:42:04.765 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2023-06-09T04:42:04.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.763+0000 7f17925c1700 1 -- 172.21.15.62:0/220862046 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f17780662f0 msgr2=0x7f17780687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:04.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.763+0000 7f17925c1700 1 --2- 172.21.15.62:0/220862046 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f17780662f0 0x7f17780687a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f177c007fd0 tx=0x7f177c009040 comp rx=0 tx=0).stop 2023-06-09T04:42:04.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.763+0000 7f17925c1700 1 -- 172.21.15.62:0/220862046 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f178c0b0be0 msgr2=0x7f178c1443f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:04.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.763+0000 7f17925c1700 1 --2- 172.21.15.62:0/220862046 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f178c0b0be0 0x7f178c1443f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f178000e9a0 tx=0x7f178000ecb0 comp rx=0 tx=0).stop 2023-06-09T04:42:04.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.763+0000 7f17925c1700 1 -- 172.21.15.62:0/220862046 shutdown_connections 2023-06-09T04:42:04.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.763+0000 7f17925c1700 1 --2- 172.21.15.62:0/220862046 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f17780662f0 0x7f17780687a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:04.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.763+0000 7f17925c1700 1 --2- 172.21.15.62:0/220862046 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f178c1637c0 0x7f178c146480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:04.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.763+0000 7f17925c1700 1 --2- 172.21.15.62:0/220862046 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f178c0b0be0 0x7f178c1443f0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:04.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.763+0000 7f17925c1700 1 --2- 172.21.15.62:0/220862046 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f178c069f00 0x7f178c143be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:04.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.763+0000 7f17925c1700 1 -- 172.21.15.62:0/220862046 >> 172.21.15.62:0/220862046 conn(0x7f178c06c5d0 msgr2=0x7f178c158490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:04.770 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.763+0000 7f17925c1700 1 -- 172.21.15.62:0/220862046 shutdown_connections 2023-06-09T04:42:04.770 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.763+0000 7f17925c1700 1 -- 172.21.15.62:0/220862046 wait complete. 2023-06-09T04:42:04.789 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T04:42:04.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.963+0000 7f7a8dbf6700 1 Processor -- start 2023-06-09T04:42:04.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.963+0000 7f7a8dbf6700 1 -- start start 2023-06-09T04:42:04.973 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.967+0000 7f7a8dbf6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a880d1f80 0x7f7a880b3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:04.974 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.967+0000 7f7a8dbf6700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7a880cd2e0 0x7f7a880d0250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:04.974 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.967+0000 7f7a8dbf6700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a880b4d50 con 0x7f7a880cebf0 2023-06-09T04:42:04.974 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.967+0000 7f7a8dbf6700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a880cf040 con 0x7f7a880cd2e0 2023-06-09T04:42:04.974 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.967+0000 7f7a8dbf6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a880b4140 con 0x7f7a880d1f80 2023-06-09T04:42:04.975 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.967+0000 7f7a87fff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f7a880cebf0 0x7f7a880ccbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:32988/0 (socket says 172.21.15.62:32988) 2023-06-09T04:42:04.975 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.967+0000 7f7a8d3f5700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7a880cd2e0 0x7f7a880d0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:04.975 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.967+0000 7f7a87fff700 1 -- 172.21.15.62:0/2252912305 learned_addr learned my addr 172.21.15.62:0/2252912305 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:42:04.975 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.967+0000 7f7a8cbf4700 1 --2- 172.21.15.62:0/2252912305 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a880d1f80 0x7f7a880b3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:04.978 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.967+0000 7f7a8d3f5700 1 -- 172.21.15.62:0/2252912305 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a880d1f80 msgr2=0x7f7a880b3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:04.978 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.967+0000 7f7a8d3f5700 1 --2- 172.21.15.62:0/2252912305 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a880d1f80 0x7f7a880b3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:04.978 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.967+0000 7f7a877fe700 1 -- 172.21.15.62:0/2252912305 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1551374053 0 0) 0x7f7a880b4d50 con 0x7f7a880cebf0 2023-06-09T04:42:04.978 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.967+0000 7f7a8d3f5700 1 -- 172.21.15.62:0/2252912305 >> v1:172.21.15.62:6789/0 conn(0x7f7a880cebf0 legacy=0x7f7a880ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:04.978 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.967+0000 7f7a8d3f5700 1 -- 172.21.15.62:0/2252912305 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a880b4420 con 0x7f7a880cd2e0 2023-06-09T04:42:04.978 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.967+0000 7f7a8d3f5700 1 --2- 172.21.15.62:0/2252912305 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a880cd2e0 0x7f7a880d0250 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7a80009dc0 tx=0x7f7a8000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e886894b0f28d154 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:04.979 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.967+0000 7f7a877fe700 1 -- 172.21.15.62:0/2252912305 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a8000e070 con 0x7f7a880cd2e0 2023-06-09T04:42:04.979 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.967+0000 7f7a877fe700 1 -- 172.21.15.62:0/2252912305 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a8000bae0 con 0x7f7a880cd2e0 2023-06-09T04:42:04.979 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.967+0000 7f7a877fe700 1 -- 172.21.15.62:0/2252912305 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a8000be90 con 0x7f7a880cd2e0 2023-06-09T04:42:04.979 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.971+0000 7f7a8dbf6700 1 -- 172.21.15.62:0/2252912305 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a880cd2e0 msgr2=0x7f7a880d0250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:04.979 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.971+0000 7f7a8dbf6700 1 --2- 172.21.15.62:0/2252912305 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a880cd2e0 0x7f7a880d0250 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7a80009dc0 tx=0x7f7a8000b330 comp rx=0 tx=0).stop 2023-06-09T04:42:04.979 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.971+0000 7f7a8dbf6700 1 -- 172.21.15.62:0/2252912305 shutdown_connections 2023-06-09T04:42:04.979 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.971+0000 7f7a8dbf6700 1 --2- 172.21.15.62:0/2252912305 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a880cd2e0 0x7f7a880d0250 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:04.980 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.971+0000 7f7a8dbf6700 1 --2- 172.21.15.62:0/2252912305 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a880d1f80 0x7f7a880b3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:04.980 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.971+0000 7f7a8dbf6700 1 -- 172.21.15.62:0/2252912305 >> 172.21.15.62:0/2252912305 conn(0x7f7a88071840 msgr2=0x7f7a8809b760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:04.980 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.971+0000 7f7a8dbf6700 1 -- 172.21.15.62:0/2252912305 shutdown_connections 2023-06-09T04:42:04.980 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.971+0000 7f7a8dbf6700 1 -- 172.21.15.62:0/2252912305 wait complete. 2023-06-09T04:42:04.980 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.971+0000 7f7a8dbf6700 1 Processor -- start 2023-06-09T04:42:04.981 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.971+0000 7f7a8dbf6700 1 -- start start 2023-06-09T04:42:04.982 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.975+0000 7f7a8dbf6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a880cd2e0 0x7f7a880c8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:04.982 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.975+0000 7f7a8dbf6700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a880cebf0 0x7f7a880ca6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:04.982 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.975+0000 7f7a8dbf6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a880d1f80 0x7f7a880cbee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:04.982 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.975+0000 7f7a8dbf6700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a880cbac0 con 0x7f7a880d1f80 2023-06-09T04:42:04.982 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.975+0000 7f7a8dbf6700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a88159fd0 con 0x7f7a880cebf0 2023-06-09T04:42:04.983 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.975+0000 7f7a8dbf6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a880cac10 con 0x7f7a880cd2e0 2023-06-09T04:42:04.983 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.975+0000 7f7a8d3f5700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a880d1f80 0x7f7a880cbee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:04.983 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.975+0000 7f7a8d3f5700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a880d1f80 0x7f7a880cbee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53836/0 (socket says 172.21.15.62:53836) 2023-06-09T04:42:04.983 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.975+0000 7f7a8d3f5700 1 -- 172.21.15.62:0/1257285799 learned_addr learned my addr 172.21.15.62:0/1257285799 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:04.983 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.975+0000 7f7a87fff700 1 --2- 172.21.15.62:0/1257285799 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a880cebf0 0x7f7a880ca6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:04.983 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.975+0000 7f7a8cbf4700 1 --2- 172.21.15.62:0/1257285799 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a880cd2e0 0x7f7a880c8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:04.983 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.975+0000 7f7a8d3f5700 1 -- 172.21.15.62:0/1257285799 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a880cd2e0 msgr2=0x7f7a880c8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:04.984 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.975+0000 7f7a8d3f5700 1 --2- 172.21.15.62:0/1257285799 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a880cd2e0 0x7f7a880c8ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:04.984 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.975+0000 7f7a8d3f5700 1 -- 172.21.15.62:0/1257285799 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a880cebf0 msgr2=0x7f7a880ca6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:04.984 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.975+0000 7f7a8d3f5700 1 --2- 172.21.15.62:0/1257285799 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a880cebf0 0x7f7a880ca6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:04.984 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.975+0000 7f7a8d3f5700 1 -- 172.21.15.62:0/1257285799 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a80009a70 con 0x7f7a880d1f80 2023-06-09T04:42:04.984 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.975+0000 7f7a8cbf4700 1 --2- 172.21.15.62:0/1257285799 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a880cd2e0 0x7f7a880c8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:04.984 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.975+0000 7f7a8d3f5700 1 --2- 172.21.15.62:0/1257285799 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a880d1f80 0x7f7a880cbee0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f7a80014040 tx=0x7f7a80004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:04.984 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.975+0000 7f7a857fa700 1 -- 172.21.15.62:0/1257285799 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a800046c0 con 0x7f7a880d1f80 2023-06-09T04:42:04.985 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.975+0000 7f7a857fa700 1 -- 172.21.15.62:0/1257285799 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a80020070 con 0x7f7a880d1f80 2023-06-09T04:42:04.985 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.975+0000 7f7a857fa700 1 -- 172.21.15.62:0/1257285799 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a80027480 con 0x7f7a880d1f80 2023-06-09T04:42:04.985 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.975+0000 7f7a8dbf6700 1 -- 172.21.15.62:0/1257285799 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a880cae40 con 0x7f7a880d1f80 2023-06-09T04:42:04.985 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.975+0000 7f7a8dbf6700 1 -- 172.21.15.62:0/1257285799 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a880cb400 con 0x7f7a880d1f80 2023-06-09T04:42:04.985 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.979+0000 7f7a8dbf6700 1 -- 172.21.15.62:0/1257285799 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a880cbc00 con 0x7f7a880d1f80 2023-06-09T04:42:04.986 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.979+0000 7f7a857fa700 1 -- 172.21.15.62:0/1257285799 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7a80012430 con 0x7f7a880d1f80 2023-06-09T04:42:04.986 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.979+0000 7f7a857fa700 1 --2- 172.21.15.62:0/1257285799 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f7a6c0662f0 0x7f7a6c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:04.987 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.979+0000 7f7a857fa700 1 -- 172.21.15.62:0/1257285799 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7a80022070 con 0x7f7a880d1f80 2023-06-09T04:42:04.987 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.983+0000 7f7a8cbf4700 1 --2- 172.21.15.62:0/1257285799 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f7a6c0662f0 0x7f7a6c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:04.988 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.983+0000 7f7a8cbf4700 1 --2- 172.21.15.62:0/1257285799 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f7a6c0662f0 0x7f7a6c0687a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c009b90 tx=0x7f7a7c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:04.993 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:04.987+0000 7f7a857fa700 1 -- 172.21.15.62:0/1257285799 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7a800568f0 con 0x7f7a880d1f80 2023-06-09T04:42:05.172 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.167+0000 7f7a8dbf6700 1 -- 172.21.15.62:0/1257285799 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7a880739c0 con 0x7f7a880d1f80 2023-06-09T04:42:05.173 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.167+0000 7f7a857fa700 1 -- 172.21.15.62:0/1257285799 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7a80056480 con 0x7f7a880d1f80 2023-06-09T04:42:05.173 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-06-09T04:42:05.175 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.171+0000 7f7a8dbf6700 1 -- 172.21.15.62:0/1257285799 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f7a6c0662f0 msgr2=0x7f7a6c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:05.176 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.171+0000 7f7a8dbf6700 1 --2- 172.21.15.62:0/1257285799 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f7a6c0662f0 0x7f7a6c0687a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c009b90 tx=0x7f7a7c008040 comp rx=0 tx=0).stop 2023-06-09T04:42:05.176 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.171+0000 7f7a8dbf6700 1 -- 172.21.15.62:0/1257285799 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a880d1f80 msgr2=0x7f7a880cbee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:05.176 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.171+0000 7f7a8dbf6700 1 --2- 172.21.15.62:0/1257285799 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a880d1f80 0x7f7a880cbee0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f7a80014040 tx=0x7f7a80004af0 comp rx=0 tx=0).stop 2023-06-09T04:42:05.176 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.171+0000 7f7a8dbf6700 1 -- 172.21.15.62:0/1257285799 shutdown_connections 2023-06-09T04:42:05.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.171+0000 7f7a8dbf6700 1 --2- 172.21.15.62:0/1257285799 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f7a6c0662f0 0x7f7a6c0687a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:05.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.171+0000 7f7a8dbf6700 1 --2- 172.21.15.62:0/1257285799 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7a880d1f80 0x7f7a880cbee0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:05.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.171+0000 7f7a8dbf6700 1 --2- 172.21.15.62:0/1257285799 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a880cebf0 0x7f7a880ca6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:05.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.171+0000 7f7a8dbf6700 1 --2- 172.21.15.62:0/1257285799 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7a880cd2e0 0x7f7a880c8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:05.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.171+0000 7f7a8dbf6700 1 -- 172.21.15.62:0/1257285799 >> 172.21.15.62:0/1257285799 conn(0x7f7a88071840 msgr2=0x7f7a8815b960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:05.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.171+0000 7f7a8dbf6700 1 -- 172.21.15.62:0/1257285799 shutdown_connections 2023-06-09T04:42:05.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.171+0000 7f7a8dbf6700 1 -- 172.21.15.62:0/1257285799 wait complete. 2023-06-09T04:42:05.200 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T04:42:05.382 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.375+0000 7f39d49a8700 1 Processor -- start 2023-06-09T04:42:05.383 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.375+0000 7f39d49a8700 1 -- start start 2023-06-09T04:42:05.386 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.379+0000 7f39d49a8700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f39d00b3b20 0x7f39d00cebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:05.386 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.379+0000 7f39d49a8700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39d00b4d50 con 0x7f39d00d1f80 2023-06-09T04:42:05.386 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.379+0000 7f39d49a8700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39d00b4140 con 0x7f39d00cd2e0 2023-06-09T04:42:05.386 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.379+0000 7f39d49a8700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39d00b3f40 con 0x7f39d00b3b20 2023-06-09T04:42:05.387 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.379+0000 7f39cf7fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f39d00d1f80 0x7f39d00ccbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:32996/0 (socket says 172.21.15.62:32996) 2023-06-09T04:42:05.387 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.379+0000 7f39cf7fe700 1 -- 172.21.15.62:0/1963904904 learned_addr learned my addr 172.21.15.62:0/1963904904 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:42:05.387 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.379+0000 7f39cffff700 1 --2- 172.21.15.62:0/1963904904 >> v2:172.21.15.89:3300/0 conn(0x7f39d00b3b20 0x7f39d00cebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:05.388 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.383+0000 7f39ce7fc700 1 -- 172.21.15.62:0/1963904904 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3034073826 0 0) 0x7f39d00b4d50 con 0x7f39d00d1f80 2023-06-09T04:42:05.388 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.383+0000 7f39ce7fc700 1 -- 172.21.15.62:0/1963904904 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39b80035d0 con 0x7f39d00d1f80 2023-06-09T04:42:05.388 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.383+0000 7f39cffff700 1 -- 172.21.15.62:0/1963904904 >> v1:172.21.15.89:6789/0 conn(0x7f39d00cd2e0 legacy=0x7f39d00d0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:05.388 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.383+0000 7f39cffff700 1 -- 172.21.15.62:0/1963904904 >> v1:172.21.15.62:6789/0 conn(0x7f39d00d1f80 legacy=0x7f39d00ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:05.388 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.383+0000 7f39cffff700 1 -- 172.21.15.62:0/1963904904 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39d00b4420 con 0x7f39d00b3b20 2023-06-09T04:42:05.389 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.383+0000 7f39cffff700 1 --2- 172.21.15.62:0/1963904904 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39d00b3b20 0x7f39d00cebf0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f39c8009d90 tx=0x7f39c800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4407e358b39f4d76 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:05.389 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.383+0000 7f39ce7fc700 1 -- 172.21.15.62:0/1963904904 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c800e070 con 0x7f39d00b3b20 2023-06-09T04:42:05.389 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.383+0000 7f39ce7fc700 1 -- 172.21.15.62:0/1963904904 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39c800bb20 con 0x7f39d00b3b20 2023-06-09T04:42:05.389 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.383+0000 7f39ce7fc700 1 -- 172.21.15.62:0/1963904904 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c8012430 con 0x7f39d00b3b20 2023-06-09T04:42:05.390 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.383+0000 7f39d49a8700 1 -- 172.21.15.62:0/1963904904 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39d00b3b20 msgr2=0x7f39d00cebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:05.390 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.383+0000 7f39d49a8700 1 --2- 172.21.15.62:0/1963904904 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39d00b3b20 0x7f39d00cebf0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f39c8009d90 tx=0x7f39c800b330 comp rx=0 tx=0).stop 2023-06-09T04:42:05.390 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.383+0000 7f39d49a8700 1 -- 172.21.15.62:0/1963904904 shutdown_connections 2023-06-09T04:42:05.390 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.383+0000 7f39d49a8700 1 --2- 172.21.15.62:0/1963904904 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39d00b3b20 0x7f39d00cebf0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:05.390 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.383+0000 7f39d49a8700 1 -- 172.21.15.62:0/1963904904 >> 172.21.15.62:0/1963904904 conn(0x7f39d0071840 msgr2=0x7f39d009b760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:05.391 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.383+0000 7f39d49a8700 1 -- 172.21.15.62:0/1963904904 shutdown_connections 2023-06-09T04:42:05.391 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.383+0000 7f39d49a8700 1 -- 172.21.15.62:0/1963904904 wait complete. 2023-06-09T04:42:05.392 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.387+0000 7f39d49a8700 1 Processor -- start 2023-06-09T04:42:05.393 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.387+0000 7f39d49a8700 1 -- start start 2023-06-09T04:42:05.394 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.387+0000 7f39d49a8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39d00b3b20 0x7f39d00b5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:05.394 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.387+0000 7f39d49a8700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39d00cd2e0 0x7f39d00b6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:05.394 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.387+0000 7f39d49a8700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39d00d1f80 0x7f39d00c8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:05.394 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.387+0000 7f39d49a8700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d00b6560 con 0x7f39d00b3b20 2023-06-09T04:42:05.395 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.387+0000 7f39d49a8700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d00c89b0 con 0x7f39d00cd2e0 2023-06-09T04:42:05.395 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.387+0000 7f39d49a8700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39d00b58e0 con 0x7f39d00d1f80 2023-06-09T04:42:05.396 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.387+0000 7f39cf7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39d00b3b20 0x7f39d00b5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:05.396 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.387+0000 7f39ceffd700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39d00cd2e0 0x7f39d00b6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:05.396 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.387+0000 7f39cf7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39d00b3b20 0x7f39d00b5300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53850/0 (socket says 172.21.15.62:53850) 2023-06-09T04:42:05.396 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.387+0000 7f39cf7fe700 1 -- 172.21.15.62:0/362605391 learned_addr learned my addr 172.21.15.62:0/362605391 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:05.396 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.387+0000 7f39cffff700 1 --2- 172.21.15.62:0/362605391 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39d00d1f80 0x7f39d00c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:05.396 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.391+0000 7f39cf7fe700 1 -- 172.21.15.62:0/362605391 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39d00d1f80 msgr2=0x7f39d00c8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:05.396 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.391+0000 7f39cf7fe700 1 --2- 172.21.15.62:0/362605391 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39d00d1f80 0x7f39d00c8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:05.397 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.391+0000 7f39cf7fe700 1 -- 172.21.15.62:0/362605391 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39d00cd2e0 msgr2=0x7f39d00b6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:05.397 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.391+0000 7f39cf7fe700 1 --2- 172.21.15.62:0/362605391 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39d00cd2e0 0x7f39d00b6980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:05.397 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.391+0000 7f39cf7fe700 1 -- 172.21.15.62:0/362605391 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39c8009a70 con 0x7f39d00b3b20 2023-06-09T04:42:05.398 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.391+0000 7f39cf7fe700 1 --2- 172.21.15.62:0/362605391 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39d00b3b20 0x7f39d00b5300 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f39c0001260 tx=0x7f39c000c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:05.398 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.391+0000 7f39b7fff700 1 -- 172.21.15.62:0/362605391 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c00074e0 con 0x7f39d00b3b20 2023-06-09T04:42:05.398 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.391+0000 7f39b7fff700 1 -- 172.21.15.62:0/362605391 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39c0007640 con 0x7f39d00b3b20 2023-06-09T04:42:05.398 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.391+0000 7f39d49a8700 1 -- 172.21.15.62:0/362605391 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39d00b5bc0 con 0x7f39d00b3b20 2023-06-09T04:42:05.398 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.391+0000 7f39b7fff700 1 -- 172.21.15.62:0/362605391 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c0005a50 con 0x7f39d00b3b20 2023-06-09T04:42:05.398 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.391+0000 7f39d49a8700 1 -- 172.21.15.62:0/362605391 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39d00b6180 con 0x7f39d00b3b20 2023-06-09T04:42:05.399 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.391+0000 7f39d49a8700 1 -- 172.21.15.62:0/362605391 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39d00b67d0 con 0x7f39d00b3b20 2023-06-09T04:42:05.400 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.395+0000 7f39b7fff700 1 -- 172.21.15.62:0/362605391 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f39c0005bb0 con 0x7f39d00b3b20 2023-06-09T04:42:05.402 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.395+0000 7f39b7fff700 1 --2- 172.21.15.62:0/362605391 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f39bc0662f0 0x7f39bc0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:05.402 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.395+0000 7f39b7fff700 1 -- 172.21.15.62:0/362605391 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f39c0083400 con 0x7f39d00b3b20 2023-06-09T04:42:05.402 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.395+0000 7f39ceffd700 1 --2- 172.21.15.62:0/362605391 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f39bc0662f0 0x7f39bc0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:05.403 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.399+0000 7f39ceffd700 1 --2- 172.21.15.62:0/362605391 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f39bc0662f0 0x7f39bc0687a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f39d00b3790 tx=0x7f39c4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:05.408 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.403+0000 7f39b7fff700 1 -- 172.21.15.62:0/362605391 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f39c0050560 con 0x7f39d00b3b20 2023-06-09T04:42:05.581 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.575+0000 7f39d49a8700 1 -- 172.21.15.62:0/362605391 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f39d00739c0 con 0x7f39d00b3b20 2023-06-09T04:42:05.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.575+0000 7f39b7fff700 1 -- 172.21.15.62:0/362605391 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7f39c0017020 con 0x7f39d00b3b20 2023-06-09T04:42:05.582 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 64 2023-06-09T04:42:05.585 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.579+0000 7f39d49a8700 1 -- 172.21.15.62:0/362605391 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f39bc0662f0 msgr2=0x7f39bc0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:05.585 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.579+0000 7f39d49a8700 1 --2- 172.21.15.62:0/362605391 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f39bc0662f0 0x7f39bc0687a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f39d00b3790 tx=0x7f39c4009040 comp rx=0 tx=0).stop 2023-06-09T04:42:05.585 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.579+0000 7f39d49a8700 1 -- 172.21.15.62:0/362605391 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39d00b3b20 msgr2=0x7f39d00b5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:05.585 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.579+0000 7f39d49a8700 1 --2- 172.21.15.62:0/362605391 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39d00b3b20 0x7f39d00b5300 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f39c0001260 tx=0x7f39c000c9e0 comp rx=0 tx=0).stop 2023-06-09T04:42:05.585 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.579+0000 7f39d49a8700 1 -- 172.21.15.62:0/362605391 shutdown_connections 2023-06-09T04:42:05.586 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.579+0000 7f39d49a8700 1 --2- 172.21.15.62:0/362605391 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f39bc0662f0 0x7f39bc0687a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:05.586 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.579+0000 7f39d49a8700 1 --2- 172.21.15.62:0/362605391 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39d00d1f80 0x7f39d00c8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:05.586 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.579+0000 7f39d49a8700 1 --2- 172.21.15.62:0/362605391 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39d00cd2e0 0x7f39d00b6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:05.586 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.579+0000 7f39d49a8700 1 --2- 172.21.15.62:0/362605391 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39d00b3b20 0x7f39d00b5300 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:05.586 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.579+0000 7f39d49a8700 1 -- 172.21.15.62:0/362605391 >> 172.21.15.62:0/362605391 conn(0x7f39d0071840 msgr2=0x7f39d006a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:05.587 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.579+0000 7f39d49a8700 1 -- 172.21.15.62:0/362605391 shutdown_connections 2023-06-09T04:42:05.587 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.579+0000 7f39d49a8700 1 -- 172.21.15.62:0/362605391 wait complete. 2023-06-09T04:42:05.607 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-09T04:42:05.788 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.783+0000 7fb07759e700 1 Processor -- start 2023-06-09T04:42:05.789 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.783+0000 7fb07759e700 1 -- start start 2023-06-09T04:42:05.790 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.783+0000 7fb07759e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb0780d1f80 0x7fb0780b3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:05.791 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.783+0000 7fb07759e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fb0780cebf0 0x7fb0780ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:05.791 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.783+0000 7fb07759e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0780cf070 con 0x7fb0780cd110 2023-06-09T04:42:05.791 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.783+0000 7fb07759e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0780b4d50 con 0x7fb0780d1f80 2023-06-09T04:42:05.791 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.783+0000 7fb07759e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0780cd550 con 0x7fb0780cebf0 2023-06-09T04:42:05.792 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.783+0000 7fb076d9d700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fb0780cd110 0x7fb0780b2400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:33008/0 (socket says 172.21.15.62:33008) 2023-06-09T04:42:05.792 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.783+0000 7fb076d9d700 1 -- 172.21.15.62:0/1907734008 learned_addr learned my addr 172.21.15.62:0/1907734008 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:42:05.792 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.787+0000 7fb07659c700 1 --2- 172.21.15.62:0/1907734008 >> v2:172.21.15.62:3300/0 conn(0x7fb0780d1f80 0x7fb0780b3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:05.792 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.787+0000 7fb075d9b700 1 --2- 172.21.15.62:0/1907734008 >> v2:172.21.15.89:3300/0 conn(0x7fb0780cebf0 0x7fb0780ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:05.793 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.787+0000 7fb07559a700 1 -- 172.21.15.62:0/1907734008 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 216957131 0 0) 0x7fb0780cf070 con 0x7fb0780cd110 2023-06-09T04:42:05.793 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.787+0000 7fb07559a700 1 -- 172.21.15.62:0/1907734008 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0600035d0 con 0x7fb0780cd110 2023-06-09T04:42:05.793 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.787+0000 7fb07659c700 1 -- 172.21.15.62:0/1907734008 >> v2:172.21.15.89:3300/0 conn(0x7fb0780cebf0 msgr2=0x7fb0780ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:05.793 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.787+0000 7fb07659c700 1 --2- 172.21.15.62:0/1907734008 >> v2:172.21.15.89:3300/0 conn(0x7fb0780cebf0 0x7fb0780ccbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:05.793 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.787+0000 7fb07659c700 1 -- 172.21.15.62:0/1907734008 >> v1:172.21.15.62:6789/0 conn(0x7fb0780cd110 legacy=0x7fb0780b2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:05.793 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.787+0000 7fb07659c700 1 -- 172.21.15.62:0/1907734008 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0780b4140 con 0x7fb0780d1f80 2023-06-09T04:42:05.794 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.787+0000 7fb07659c700 1 --2- 172.21.15.62:0/1907734008 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0780d1f80 0x7fb0780b3b20 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb0780b8580 tx=0x7fb068009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe41ab6719b5595c server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:05.794 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.787+0000 7fb07559a700 1 -- 172.21.15.62:0/1907734008 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb068005e50 con 0x7fb0780d1f80 2023-06-09T04:42:05.794 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.787+0000 7fb07559a700 1 -- 172.21.15.62:0/1907734008 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb068006030 con 0x7fb0780d1f80 2023-06-09T04:42:05.794 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.787+0000 7fb07559a700 1 -- 172.21.15.62:0/1907734008 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0680063c0 con 0x7fb0780d1f80 2023-06-09T04:42:05.795 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.787+0000 7fb07759e700 1 -- 172.21.15.62:0/1907734008 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0780d1f80 msgr2=0x7fb0780b3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:05.795 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.787+0000 7fb07759e700 1 --2- 172.21.15.62:0/1907734008 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0780d1f80 0x7fb0780b3b20 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb0780b8580 tx=0x7fb068009b20 comp rx=0 tx=0).stop 2023-06-09T04:42:05.795 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.787+0000 7fb07759e700 1 -- 172.21.15.62:0/1907734008 shutdown_connections 2023-06-09T04:42:05.795 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.787+0000 7fb07759e700 1 --2- 172.21.15.62:0/1907734008 >> v2:172.21.15.89:3300/0 conn(0x7fb0780cebf0 0x7fb0780ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:05.796 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.787+0000 7fb07759e700 1 --2- 172.21.15.62:0/1907734008 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0780d1f80 0x7fb0780b3b20 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:05.796 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.787+0000 7fb07759e700 1 -- 172.21.15.62:0/1907734008 >> 172.21.15.62:0/1907734008 conn(0x7fb078071840 msgr2=0x7fb07809b760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:05.796 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.787+0000 7fb07759e700 1 -- 172.21.15.62:0/1907734008 shutdown_connections 2023-06-09T04:42:05.796 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.787+0000 7fb07759e700 1 -- 172.21.15.62:0/1907734008 wait complete. 2023-06-09T04:42:05.797 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.791+0000 7fb07759e700 1 Processor -- start 2023-06-09T04:42:05.798 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.791+0000 7fb07759e700 1 -- start start 2023-06-09T04:42:05.799 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.795+0000 7fb07759e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0780cd110 0x7fb0780d04c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:05.799 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.795+0000 7fb07759e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0780cebf0 0x7fb0780c76a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:05.799 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.795+0000 7fb07759e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0780d1f80 0x7fb0781547b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:05.799 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.795+0000 7fb07759e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0780c8110 con 0x7fb0780d1f80 2023-06-09T04:42:05.800 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.795+0000 7fb07759e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0780c83f0 con 0x7fb0780cebf0 2023-06-09T04:42:05.800 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.795+0000 7fb07759e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0780c86d0 con 0x7fb0780cd110 2023-06-09T04:42:05.801 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.795+0000 7fb076d9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0780d1f80 0x7fb0781547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:05.801 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.795+0000 7fb076d9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0780d1f80 0x7fb0781547b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53860/0 (socket says 172.21.15.62:53860) 2023-06-09T04:42:05.801 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.795+0000 7fb076d9d700 1 -- 172.21.15.62:0/523191792 learned_addr learned my addr 172.21.15.62:0/523191792 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:05.801 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.795+0000 7fb07659c700 1 --2- 172.21.15.62:0/523191792 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0780cd110 0x7fb0780d04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:05.801 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.795+0000 7fb075d9b700 1 --2- 172.21.15.62:0/523191792 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0780cebf0 0x7fb0780c76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:05.801 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.795+0000 7fb076d9d700 1 -- 172.21.15.62:0/523191792 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0780cd110 msgr2=0x7fb0780d04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:05.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.795+0000 7fb076d9d700 1 --2- 172.21.15.62:0/523191792 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0780cd110 0x7fb0780d04c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:05.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.795+0000 7fb076d9d700 1 -- 172.21.15.62:0/523191792 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0780cebf0 msgr2=0x7fb0780c76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:05.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.795+0000 7fb076d9d700 1 --2- 172.21.15.62:0/523191792 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0780cebf0 0x7fb0780c76a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:05.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.795+0000 7fb076d9d700 1 -- 172.21.15.62:0/523191792 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb068009450 con 0x7fb0780d1f80 2023-06-09T04:42:05.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.795+0000 7fb076d9d700 1 --2- 172.21.15.62:0/523191792 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0780d1f80 0x7fb0781547b0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb07000cb40 tx=0x7fb07000cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:05.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.795+0000 7fb066ffd700 1 -- 172.21.15.62:0/523191792 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb070007500 con 0x7fb0780d1f80 2023-06-09T04:42:05.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.795+0000 7fb066ffd700 1 -- 172.21.15.62:0/523191792 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb070007660 con 0x7fb0780d1f80 2023-06-09T04:42:05.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.795+0000 7fb07759e700 1 -- 172.21.15.62:0/523191792 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0780c89b0 con 0x7fb0780d1f80 2023-06-09T04:42:05.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.795+0000 7fb066ffd700 1 -- 172.21.15.62:0/523191792 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0700079f0 con 0x7fb0780d1f80 2023-06-09T04:42:05.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.795+0000 7fb07759e700 1 -- 172.21.15.62:0/523191792 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0780d0a00 con 0x7fb0780d1f80 2023-06-09T04:42:05.804 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.799+0000 7fb07759e700 1 -- 172.21.15.62:0/523191792 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0780739c0 con 0x7fb0780d1f80 2023-06-09T04:42:05.805 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.799+0000 7fb066ffd700 1 -- 172.21.15.62:0/523191792 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb07001b3b0 con 0x7fb0780d1f80 2023-06-09T04:42:05.807 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.799+0000 7fb066ffd700 1 --2- 172.21.15.62:0/523191792 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fb0580662f0 0x7fb0580687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:05.807 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.803+0000 7fb066ffd700 1 -- 172.21.15.62:0/523191792 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb070083aa0 con 0x7fb0780d1f80 2023-06-09T04:42:05.807 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.803+0000 7fb07659c700 1 --2- 172.21.15.62:0/523191792 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fb0580662f0 0x7fb0580687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:05.809 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.803+0000 7fb07659c700 1 --2- 172.21.15.62:0/523191792 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fb0580662f0 0x7fb0580687a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb068009b60 tx=0x7fb068008070 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:05.812 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.807+0000 7fb066ffd700 1 -- 172.21.15.62:0/523191792 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb070050be0 con 0x7fb0780d1f80 2023-06-09T04:42:05.982 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.975+0000 7fb07759e700 1 -- 172.21.15.62:0/523191792 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fb0780d16b0 con 0x7fb0780d1f80 2023-06-09T04:42:05.983 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.979+0000 7fb066ffd700 1 -- 172.21.15.62:0/523191792 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb070054200 con 0x7fb0780d1f80 2023-06-09T04:42:05.984 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-06-09T04:42:05.988 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.983+0000 7fb07759e700 1 -- 172.21.15.62:0/523191792 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fb0580662f0 msgr2=0x7fb0580687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:05.988 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.983+0000 7fb07759e700 1 --2- 172.21.15.62:0/523191792 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fb0580662f0 0x7fb0580687a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb068009b60 tx=0x7fb068008070 comp rx=0 tx=0).stop 2023-06-09T04:42:05.988 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.983+0000 7fb07759e700 1 -- 172.21.15.62:0/523191792 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0780d1f80 msgr2=0x7fb0781547b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:05.988 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.983+0000 7fb07759e700 1 --2- 172.21.15.62:0/523191792 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0780d1f80 0x7fb0781547b0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb07000cb40 tx=0x7fb07000cb70 comp rx=0 tx=0).stop 2023-06-09T04:42:05.988 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.983+0000 7fb07759e700 1 -- 172.21.15.62:0/523191792 shutdown_connections 2023-06-09T04:42:05.989 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.983+0000 7fb07759e700 1 --2- 172.21.15.62:0/523191792 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fb0580662f0 0x7fb0580687a0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:05.989 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.983+0000 7fb07759e700 1 --2- 172.21.15.62:0/523191792 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb0780d1f80 0x7fb0781547b0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:05.989 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.983+0000 7fb07759e700 1 --2- 172.21.15.62:0/523191792 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb0780cebf0 0x7fb0780c76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:05.989 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.983+0000 7fb07759e700 1 --2- 172.21.15.62:0/523191792 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb0780cd110 0x7fb0780d04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:05.989 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.983+0000 7fb07759e700 1 -- 172.21.15.62:0/523191792 >> 172.21.15.62:0/523191792 conn(0x7fb078071840 msgr2=0x7fb0780b15c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:05.989 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.983+0000 7fb07759e700 1 -- 172.21.15.62:0/523191792 shutdown_connections 2023-06-09T04:42:05.990 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:05.983+0000 7fb07759e700 1 -- 172.21.15.62:0/523191792 wait complete. 2023-06-09T04:42:06.014 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-09T04:42:06.193 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.187+0000 7fddabcdf700 1 Processor -- start 2023-06-09T04:42:06.194 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.187+0000 7fddabcdf700 1 -- start start 2023-06-09T04:42:06.196 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.191+0000 7fddabcdf700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fdda40ce970 0x7fdda40cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:06.196 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.191+0000 7fddabcdf700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fdda40cd230 0x7fdda40b1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:06.196 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.191+0000 7fddabcdf700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdda40ce4e0 con 0x7fdda40d0270 2023-06-09T04:42:06.196 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.191+0000 7fddabcdf700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdda40cd6b0 con 0x7fdda40cd230 2023-06-09T04:42:06.196 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.191+0000 7fddabcdf700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdda40d25e0 con 0x7fdda40ce970 2023-06-09T04:42:06.197 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.191+0000 7fdda927a700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fdda40ce970 0x7fdda40cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:06.197 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.191+0000 7fddaa27c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fdda40cd230 0x7fdda40b1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:06.197 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.191+0000 7fdda9a7b700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7fdda40d0270 0x7fdda40d0640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.62:54252/0 (socket says 172.21.15.62:54252) 2023-06-09T04:42:06.197 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.191+0000 7fdda9a7b700 1 -- 172.21.15.62:0/2611200414 learned_addr learned my addr 172.21.15.62:0/2611200414 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:42:06.198 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.191+0000 7fddaa27c700 1 -- 172.21.15.62:0/2611200414 >> v2:172.21.15.89:3300/0 conn(0x7fdda40ce970 msgr2=0x7fdda40cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:06.198 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.191+0000 7fddaa27c700 1 --2- 172.21.15.62:0/2611200414 >> v2:172.21.15.89:3300/0 conn(0x7fdda40ce970 0x7fdda40cccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:06.199 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.191+0000 7fddaa27c700 1 -- 172.21.15.62:0/2611200414 >> v1:172.21.15.89:6789/0 conn(0x7fdda40d0270 legacy=0x7fdda40d0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:06.199 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.191+0000 7fddaa27c700 1 -- 172.21.15.62:0/2611200414 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdda40cd8d0 con 0x7fdda40cd230 2023-06-09T04:42:06.199 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.191+0000 7fdda8a79700 1 -- 172.21.15.62:0/2611200414 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2246879634 0 0) 0x7fdda40ce4e0 con 0x7fdda40d0270 2023-06-09T04:42:06.199 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.191+0000 7fddaa27c700 1 --2- 172.21.15.62:0/2611200414 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdda40cd230 0x7fdda40b1fe0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fdda40b5200 tx=0x7fdd9c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe10854a64ff7dc7 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:06.199 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.191+0000 7fdda8a79700 1 -- 172.21.15.62:0/2611200414 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd9c00e070 con 0x7fdda40cd230 2023-06-09T04:42:06.199 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.191+0000 7fdda8a79700 1 -- 172.21.15.62:0/2611200414 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd9c00bb20 con 0x7fdda40cd230 2023-06-09T04:42:06.199 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.191+0000 7fdda8a79700 1 -- 172.21.15.62:0/2611200414 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd9c012430 con 0x7fdda40cd230 2023-06-09T04:42:06.200 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.195+0000 7fddabcdf700 1 -- 172.21.15.62:0/2611200414 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdda40cd230 msgr2=0x7fdda40b1fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:06.200 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.195+0000 7fddabcdf700 1 --2- 172.21.15.62:0/2611200414 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdda40cd230 0x7fdda40b1fe0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fdda40b5200 tx=0x7fdd9c00b330 comp rx=0 tx=0).stop 2023-06-09T04:42:06.200 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.195+0000 7fddabcdf700 1 -- 172.21.15.62:0/2611200414 shutdown_connections 2023-06-09T04:42:06.200 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.195+0000 7fddabcdf700 1 --2- 172.21.15.62:0/2611200414 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdda40cd230 0x7fdda40b1fe0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:06.201 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.195+0000 7fddabcdf700 1 --2- 172.21.15.62:0/2611200414 >> v2:172.21.15.89:3300/0 conn(0x7fdda40ce970 0x7fdda40cccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:06.201 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.195+0000 7fddabcdf700 1 -- 172.21.15.62:0/2611200414 >> 172.21.15.62:0/2611200414 conn(0x7fdda4071840 msgr2=0x7fdda409b970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:06.201 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.195+0000 7fddabcdf700 1 -- 172.21.15.62:0/2611200414 shutdown_connections 2023-06-09T04:42:06.201 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.195+0000 7fddabcdf700 1 -- 172.21.15.62:0/2611200414 wait complete. 2023-06-09T04:42:06.203 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.199+0000 7fddabcdf700 1 Processor -- start 2023-06-09T04:42:06.204 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.199+0000 7fddabcdf700 1 -- start start 2023-06-09T04:42:06.206 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.199+0000 7fddabcdf700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdda40cd230 0x7fdda414ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:06.206 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.199+0000 7fddabcdf700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdda40ce970 0x7fdda40cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:06.206 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.199+0000 7fddabcdf700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdda40d0270 0x7fdda40cbfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:06.206 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.199+0000 7fddabcdf700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda414f2c0 con 0x7fdda40ce970 2023-06-09T04:42:06.206 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.199+0000 7fddabcdf700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda40cb140 con 0x7fdda40cd230 2023-06-09T04:42:06.207 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.199+0000 7fddabcdf700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdda40ca5c0 con 0x7fdda40d0270 2023-06-09T04:42:06.208 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.199+0000 7fdda927a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdda40ce970 0x7fdda40cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:06.208 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.199+0000 7fdda927a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdda40ce970 0x7fdda40cbaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53868/0 (socket says 172.21.15.62:53868) 2023-06-09T04:42:06.208 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.199+0000 7fdda927a700 1 -- 172.21.15.62:0/1221102555 learned_addr learned my addr 172.21.15.62:0/1221102555 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:06.208 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.199+0000 7fdda9a7b700 1 --2- 172.21.15.62:0/1221102555 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdda40cd230 0x7fdda414ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:06.208 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.199+0000 7fddaa27c700 1 --2- 172.21.15.62:0/1221102555 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdda40d0270 0x7fdda40cbfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:06.208 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.203+0000 7fdda927a700 1 -- 172.21.15.62:0/1221102555 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdda40d0270 msgr2=0x7fdda40cbfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:06.209 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.203+0000 7fdda927a700 1 --2- 172.21.15.62:0/1221102555 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdda40d0270 0x7fdda40cbfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:06.209 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.203+0000 7fdda927a700 1 -- 172.21.15.62:0/1221102555 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdda40cd230 msgr2=0x7fdda414ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:06.209 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.203+0000 7fdda927a700 1 --2- 172.21.15.62:0/1221102555 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdda40cd230 0x7fdda414ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:06.209 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.203+0000 7fdda927a700 1 -- 172.21.15.62:0/1221102555 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd9c009a70 con 0x7fdda40ce970 2023-06-09T04:42:06.209 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.203+0000 7fddaa27c700 1 --2- 172.21.15.62:0/1221102555 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdda40d0270 0x7fdda40cbfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:06.209 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.203+0000 7fdda927a700 1 --2- 172.21.15.62:0/1221102555 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdda40ce970 0x7fdda40cbaa0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fdd9400e9d0 tx=0x7fdd9400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:06.210 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.203+0000 7fdd9a7fc700 1 -- 172.21.15.62:0/1221102555 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd94009720 con 0x7fdda40ce970 2023-06-09T04:42:06.210 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.203+0000 7fdd9a7fc700 1 -- 172.21.15.62:0/1221102555 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd9400c850 con 0x7fdda40ce970 2023-06-09T04:42:06.210 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.203+0000 7fddabcdf700 1 -- 172.21.15.62:0/1221102555 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdda40ca8a0 con 0x7fdda40ce970 2023-06-09T04:42:06.210 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.203+0000 7fdd9a7fc700 1 -- 172.21.15.62:0/1221102555 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd9400cbc0 con 0x7fdda40ce970 2023-06-09T04:42:06.210 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.203+0000 7fddabcdf700 1 -- 172.21.15.62:0/1221102555 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdda40cae60 con 0x7fdda40ce970 2023-06-09T04:42:06.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.203+0000 7fddabcdf700 1 -- 172.21.15.62:0/1221102555 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdda404db30 con 0x7fdda40ce970 2023-06-09T04:42:06.212 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.207+0000 7fdd9a7fc700 1 -- 172.21.15.62:0/1221102555 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdd9400cd20 con 0x7fdda40ce970 2023-06-09T04:42:06.214 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.207+0000 7fdd9a7fc700 1 --2- 172.21.15.62:0/1221102555 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fdd88066320 0x7fdd880687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:06.214 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.207+0000 7fdd9a7fc700 1 -- 172.21.15.62:0/1221102555 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fdd94083ff0 con 0x7fdda40ce970 2023-06-09T04:42:06.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.211+0000 7fdda9a7b700 1 --2- 172.21.15.62:0/1221102555 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fdd88066320 0x7fdd880687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:06.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.211+0000 7fdda9a7b700 1 --2- 172.21.15.62:0/1221102555 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fdd88066320 0x7fdd880687d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fdda0000fb0 tx=0x7fdda0007dd0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:06.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.211+0000 7fdd9a7fc700 1 -- 172.21.15.62:0/1221102555 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdd940511d0 con 0x7fdda40ce970 2023-06-09T04:42:06.404 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.399+0000 7fddabcdf700 1 -- 172.21.15.62:0/1221102555 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fdda40cde60 con 0x7fdda40ce970 2023-06-09T04:42:06.405 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.399+0000 7fdd9a7fc700 1 -- 172.21.15.62:0/1221102555 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v30) v1 ==== 80+0+0 (secure 0 0 0) 0x7fdd940547f0 con 0x7fdda40ce970 2023-06-09T04:42:06.408 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.403+0000 7fddabcdf700 1 -- 172.21.15.62:0/1221102555 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fdd88066320 msgr2=0x7fdd880687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:06.408 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.403+0000 7fddabcdf700 1 --2- 172.21.15.62:0/1221102555 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fdd88066320 0x7fdd880687d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fdda0000fb0 tx=0x7fdda0007dd0 comp rx=0 tx=0).stop 2023-06-09T04:42:06.409 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.403+0000 7fddabcdf700 1 -- 172.21.15.62:0/1221102555 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdda40ce970 msgr2=0x7fdda40cbaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:06.409 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.403+0000 7fddabcdf700 1 --2- 172.21.15.62:0/1221102555 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdda40ce970 0x7fdda40cbaa0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fdd9400e9d0 tx=0x7fdd9400ece0 comp rx=0 tx=0).stop 2023-06-09T04:42:06.409 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.403+0000 7fddabcdf700 1 -- 172.21.15.62:0/1221102555 shutdown_connections 2023-06-09T04:42:06.409 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.403+0000 7fddabcdf700 1 --2- 172.21.15.62:0/1221102555 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fdd88066320 0x7fdd880687d0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:06.410 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.403+0000 7fddabcdf700 1 --2- 172.21.15.62:0/1221102555 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdda40d0270 0x7fdda40cbfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:06.410 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.403+0000 7fddabcdf700 1 --2- 172.21.15.62:0/1221102555 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdda40ce970 0x7fdda40cbaa0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:06.410 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.403+0000 7fddabcdf700 1 --2- 172.21.15.62:0/1221102555 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdda40cd230 0x7fdda414ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:06.410 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.403+0000 7fddabcdf700 1 -- 172.21.15.62:0/1221102555 >> 172.21.15.62:0/1221102555 conn(0x7fdda4071840 msgr2=0x7fdda40ccac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:06.411 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.403+0000 7fddabcdf700 1 -- 172.21.15.62:0/1221102555 shutdown_connections 2023-06-09T04:42:06.411 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.403+0000 7fddabcdf700 1 -- 172.21.15.62:0/1221102555 wait complete. 2023-06-09T04:42:06.412 INFO:teuthology.orchestra.run.smithi062.stderr:listed 0 entries 2023-06-09T04:42:06.429 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-06-09T04:42:06.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:06.429 DEBUG:teuthology.orchestra.run.smithi089:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-06-09T04:42:06.526 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi089.front.sepia.ceph.com 2023-06-09T04:42:06.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:06.527 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-06-09T04:42:06.551 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-06-09T04:42:06.552 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:42:06.570 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-06-09T04:42:06.570 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:42:06.631 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-06-09T04:42:06.632 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:42:06.691 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:42:06.925 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.919+0000 7fc5759c3700 1 Processor -- start 2023-06-09T04:42:06.925 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.919+0000 7fc5759c3700 1 -- start start 2023-06-09T04:42:06.927 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.919+0000 7fc5759c3700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc5700cc1a0 0x7fc57006c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:06.927 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.919+0000 7fc5759c3700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc57006c4c0 con 0x7fc57006ce90 2023-06-09T04:42:06.927 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.919+0000 7fc5759c3700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc57006b920 con 0x7fc570158890 2023-06-09T04:42:06.927 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.919+0000 7fc5759c3700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc57006bb90 con 0x7fc5700cc1a0 2023-06-09T04:42:06.928 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.923+0000 7fc56ffff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc5700cc1a0 0x7fc57006c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:06.928 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.923+0000 7fc56ffff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc5700cc1a0 0x7fc57006c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53874/0 (socket says 172.21.15.62:53874) 2023-06-09T04:42:06.928 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.923+0000 7fc56ffff700 1 -- 172.21.15.62:0/1595623472 learned_addr learned my addr 172.21.15.62:0/1595623472 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:06.928 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.923+0000 7fc56ffff700 1 -- 172.21.15.62:0/1595623472 >> v1:172.21.15.89:6789/0 conn(0x7fc570158890 legacy=0x7fc5700cd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:06.929 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.923+0000 7fc56ffff700 1 -- 172.21.15.62:0/1595623472 >> v1:172.21.15.62:6789/0 conn(0x7fc57006ce90 legacy=0x7fc5700c8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:06.929 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.923+0000 7fc56ffff700 1 -- 172.21.15.62:0/1595623472 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc57006be70 con 0x7fc5700cc1a0 2023-06-09T04:42:06.929 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.923+0000 7fc56ffff700 1 --2- 172.21.15.62:0/1595623472 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5700cc1a0 0x7fc57006c950 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fc55c00bbb0 tx=0x7fc55c00bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e0b12e019de1fee server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:06.929 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.923+0000 7fc56f7fe700 1 -- 172.21.15.62:0/1595623472 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc55c00dd50 con 0x7fc5700cc1a0 2023-06-09T04:42:06.930 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.923+0000 7fc56f7fe700 1 -- 172.21.15.62:0/1595623472 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc55c004030 con 0x7fc5700cc1a0 2023-06-09T04:42:06.930 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.923+0000 7fc56f7fe700 1 -- 172.21.15.62:0/1595623472 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc55c0043e0 con 0x7fc5700cc1a0 2023-06-09T04:42:06.930 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.923+0000 7fc5759c3700 1 -- 172.21.15.62:0/1595623472 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5700cc1a0 msgr2=0x7fc57006c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:06.931 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.923+0000 7fc5759c3700 1 --2- 172.21.15.62:0/1595623472 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5700cc1a0 0x7fc57006c950 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fc55c00bbb0 tx=0x7fc55c00bec0 comp rx=0 tx=0).stop 2023-06-09T04:42:06.931 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.923+0000 7fc5759c3700 1 -- 172.21.15.62:0/1595623472 shutdown_connections 2023-06-09T04:42:06.931 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.923+0000 7fc5759c3700 1 --2- 172.21.15.62:0/1595623472 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5700cc1a0 0x7fc57006c950 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:06.931 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.923+0000 7fc5759c3700 1 -- 172.21.15.62:0/1595623472 >> 172.21.15.62:0/1595623472 conn(0x7fc57006a420 msgr2=0x7fc5700afc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:06.931 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.923+0000 7fc5759c3700 1 -- 172.21.15.62:0/1595623472 shutdown_connections 2023-06-09T04:42:06.931 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.923+0000 7fc5759c3700 1 -- 172.21.15.62:0/1595623472 wait complete. 2023-06-09T04:42:06.932 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.927+0000 7fc5759c3700 1 Processor -- start 2023-06-09T04:42:06.932 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.927+0000 7fc5759c3700 1 -- start start 2023-06-09T04:42:06.934 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.927+0000 7fc5759c3700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5700cc1a0 0x7fc5701ed920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:06.934 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.927+0000 7fc5759c3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc570158890 0x7fc5700c6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:06.934 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.927+0000 7fc5759c3700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5700b3930 0x7fc5701ef8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:06.934 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.927+0000 7fc5759c3700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5701ede60 con 0x7fc5700b3930 2023-06-09T04:42:06.935 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.927+0000 7fc5759c3700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5700b1130 con 0x7fc5700cc1a0 2023-06-09T04:42:06.935 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.927+0000 7fc5759c3700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5700b13d0 con 0x7fc570158890 2023-06-09T04:42:06.936 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.927+0000 7fc5751c2700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5700b3930 0x7fc5701ef8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:06.936 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.927+0000 7fc5751c2700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5700b3930 0x7fc5701ef8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53880/0 (socket says 172.21.15.62:53880) 2023-06-09T04:42:06.936 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.927+0000 7fc5751c2700 1 -- 172.21.15.62:0/2997246400 learned_addr learned my addr 172.21.15.62:0/2997246400 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:06.936 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.927+0000 7fc5749c1700 1 --2- 172.21.15.62:0/2997246400 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5700cc1a0 0x7fc5701ed920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:06.936 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.927+0000 7fc56ffff700 1 --2- 172.21.15.62:0/2997246400 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc570158890 0x7fc5700c6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:06.937 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.931+0000 7fc5751c2700 1 -- 172.21.15.62:0/2997246400 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc570158890 msgr2=0x7fc5700c6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:06.937 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.931+0000 7fc5751c2700 1 --2- 172.21.15.62:0/2997246400 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc570158890 0x7fc5700c6ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:06.937 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.931+0000 7fc5751c2700 1 -- 172.21.15.62:0/2997246400 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5700cc1a0 msgr2=0x7fc5701ed920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:06.937 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.931+0000 7fc5751c2700 1 --2- 172.21.15.62:0/2997246400 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5700cc1a0 0x7fc5701ed920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:06.937 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.931+0000 7fc5751c2700 1 -- 172.21.15.62:0/2997246400 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc55c00b810 con 0x7fc5700b3930 2023-06-09T04:42:06.937 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.931+0000 7fc5751c2700 1 --2- 172.21.15.62:0/2997246400 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5700b3930 0x7fc5701ef8f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc56800c4d0 tx=0x7fc56800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:06.938 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.931+0000 7fc56d7fa700 1 -- 172.21.15.62:0/2997246400 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5680052d0 con 0x7fc5700b3930 2023-06-09T04:42:06.938 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.931+0000 7fc56d7fa700 1 -- 172.21.15.62:0/2997246400 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc568005430 con 0x7fc5700b3930 2023-06-09T04:42:06.938 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.931+0000 7fc5759c3700 1 -- 172.21.15.62:0/2997246400 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5700b16b0 con 0x7fc5700b3930 2023-06-09T04:42:06.938 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.931+0000 7fc56d7fa700 1 -- 172.21.15.62:0/2997246400 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5680055a0 con 0x7fc5700b3930 2023-06-09T04:42:06.939 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.931+0000 7fc5759c3700 1 -- 172.21.15.62:0/2997246400 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5700b1c70 con 0x7fc5700b3930 2023-06-09T04:42:06.939 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.931+0000 7fc5759c3700 1 -- 172.21.15.62:0/2997246400 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5700739c0 con 0x7fc5700b3930 2023-06-09T04:42:06.940 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.935+0000 7fc56d7fa700 1 -- 172.21.15.62:0/2997246400 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc5680036a0 con 0x7fc5700b3930 2023-06-09T04:42:06.941 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.935+0000 7fc56d7fa700 1 --2- 172.21.15.62:0/2997246400 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fc554066320 0x7fc5540687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:06.941 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.935+0000 7fc56d7fa700 1 -- 172.21.15.62:0/2997246400 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc5680831e0 con 0x7fc5700b3930 2023-06-09T04:42:06.941 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.935+0000 7fc5749c1700 1 --2- 172.21.15.62:0/2997246400 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fc554066320 0x7fc5540687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:06.943 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.935+0000 7fc5749c1700 1 --2- 172.21.15.62:0/2997246400 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fc554066320 0x7fc5540687d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc5700c5260 tx=0x7fc56400d040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:06.947 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:06.943+0000 7fc56d7fa700 1 -- 172.21.15.62:0/2997246400 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc568050340 con 0x7fc5700b3930 2023-06-09T04:42:07.125 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.119+0000 7fc5759c3700 1 -- 172.21.15.62:0/2997246400 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc5700cbf80 con 0x7fc5700b3930 2023-06-09T04:42:07.128 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.123+0000 7fc56d7fa700 1 -- 172.21.15.62:0/2997246400 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+20180 (secure 0 0 0) 0x7fc568053960 con 0x7fc5700b3930 2023-06-09T04:42:07.129 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:42:07.129 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":30,"fsid":"f7998a1e-e5a9-4202-abaa-70c0eaae1047","created":"2023-06-09T04:40:30.469588+0000","modified":"2023-06-09T04:41:38.495589+0000","last_up_change":"2023-06-09T04:40:43.120747+0000","last_in_change":"2023-06-09T04:40:33.568221+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:40:44.646921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:40:50.006643+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:40:55.031273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:40:55.773517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-09T04:40:58.845383+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bc50bbc0-dd08-42ed-804c-ec3029e36c19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6802","nonce":1295788017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6807","nonce":1295788017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6815","nonce":1295788017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6809","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6811","nonce":1295788017}]},"public_addr":"172.21.15.62:6802/1295788017","cluster_addr":"172.21.15.62:6807/1295788017","heartbeat_back_addr":"172.21.15.62:6815/1295788017","heartbeat_front_addr":"172.21.15.62:6811/1295788017","state":["exists","up"]},{"osd":1,"uuid":"8230b12d-e22f-4985-a584-4cc64404cdbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6825","nonce":4120692006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6827","nonce":4120692006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6831","nonce":4120692006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6829","nonce":4120692006}]},"public_addr":"172.21.15.62:6825/4120692006","cluster_addr":"172.21.15.62:6827/4120692006","heartbeat_back_addr":"172.21.15.62:6831/4120692006","heartbeat_front_addr":"172.21.15.62:6829/4120692006","state":["exists","up"]},{"osd":2,"uuid":"d0202506-dbe9-4e3c-9271-687929abf96a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6801","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6803","nonce":4169607876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6805","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6806","nonce":4169607876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6814","nonce":4169607876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6810","nonce":4169607876}]},"public_addr":"172.21.15.62:6803/4169607876","cluster_addr":"172.21.15.62:6806/4169607876","heartbeat_back_addr":"172.21.15.62:6814/4169607876","heartbeat_front_addr":"172.21.15.62:6810/4169607876","state":["exists","up"]},{"osd":3,"uuid":"f3c0298a-b075-4411-af50-e16cd74fdddb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6817","nonce":3268438986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6819","nonce":3268438986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6823","nonce":3268438986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6821","nonce":3268438986}]},"public_addr":"172.21.15.62:6817/3268438986","cluster_addr":"172.21.15.62:6819/3268438986","heartbeat_back_addr":"172.21.15.62:6823/3268438986","heartbeat_front_addr":"172.21.15.62:6821/3268438986","state":["exists","up"]},{"osd":4,"uuid":"1ab5c5ca-e74f-475a-a309-683cc0029928","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6817","nonce":3139617628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6819","nonce":3139617628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6823","nonce":3139617628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6821","nonce":3139617628}]},"public_addr":"172.21.15.89:6817/3139617628","cluster_addr":"172.21.15.89:6819/3139617628","heartbeat_back_addr":"172.21.15.89:6823/3139617628","heartbeat_front_addr":"172.21.15.89:6821/3139617628","state":["exists","up"]},{"osd":5,"uuid":"a933e184-bd8f-4369-a1ba-a68de53c578c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6825","nonce":2681723596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6827","nonce":2681723596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6831","nonce":2681723596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6829","nonce":2681723596}]},"public_addr":"172.21.15.89:6825/2681723596","cluster_addr":"172.21.15.89:6827/2681723596","heartbeat_back_addr":"172.21.15.89:6831/2681723596","heartbeat_front_addr":"172.21.15.89:6829/2681723596","state":["exists","up"]},{"osd":6,"uuid":"1ed7ad37-2eee-49a6-954c-b537e2b7f0ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6809","nonce":1657136033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6811","nonce":1657136033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6815","nonce":1657136033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6813","nonce":1657136033}]},"public_addr":"172.21.15.89:6809/1657136033","cluster_addr":"172.21.15.89:6811/1657136033","heartbeat_back_addr":"172.21.15.89:6815/1657136033","heartbeat_front_addr":"172.21.15.89:6813/1657136033","state":["exists","up"]},{"osd":7,"uuid":"6ed732e9-33ff-40df-9038-a9f1d1622671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6801","nonce":1710561686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6803","nonce":1710561686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6807","nonce":1710561686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6805","nonce":1710561686}]},"public_addr":"172.21.15.89:6801/1710561686","cluster_addr":"172.21.15.89:6803/1710561686","heartbeat_back_addr":"172.21.15.89:6807/1710561686","heartbeat_front_addr":"172.21.15.89:6805/1710561686","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.335803+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.419788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.179334+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.263310+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.071846+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.375627+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.282277+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.315997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.12","mappings":[{"from":1,"to":2}]},{"pgid":"4.19","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:42:07.132 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.127+0000 7fc5759c3700 1 -- 172.21.15.62:0/2997246400 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fc554066320 msgr2=0x7fc5540687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:07.132 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.127+0000 7fc5759c3700 1 --2- 172.21.15.62:0/2997246400 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fc554066320 0x7fc5540687d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc5700c5260 tx=0x7fc56400d040 comp rx=0 tx=0).stop 2023-06-09T04:42:07.132 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.127+0000 7fc5759c3700 1 -- 172.21.15.62:0/2997246400 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5700b3930 msgr2=0x7fc5701ef8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:07.133 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.127+0000 7fc5759c3700 1 --2- 172.21.15.62:0/2997246400 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5700b3930 0x7fc5701ef8f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc56800c4d0 tx=0x7fc56800c7e0 comp rx=0 tx=0).stop 2023-06-09T04:42:07.133 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.127+0000 7fc5759c3700 1 -- 172.21.15.62:0/2997246400 shutdown_connections 2023-06-09T04:42:07.133 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.127+0000 7fc5759c3700 1 --2- 172.21.15.62:0/2997246400 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fc554066320 0x7fc5540687d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:07.134 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.127+0000 7fc5759c3700 1 --2- 172.21.15.62:0/2997246400 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc5700b3930 0x7fc5701ef8f0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:07.134 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.127+0000 7fc5759c3700 1 --2- 172.21.15.62:0/2997246400 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc570158890 0x7fc5700c6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:07.134 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.127+0000 7fc5759c3700 1 --2- 172.21.15.62:0/2997246400 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5700cc1a0 0x7fc5701ed920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:07.134 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.127+0000 7fc5759c3700 1 -- 172.21.15.62:0/2997246400 >> 172.21.15.62:0/2997246400 conn(0x7fc57006ce90 msgr2=0x7fc5700caa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:07.134 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.127+0000 7fc5759c3700 1 -- 172.21.15.62:0/2997246400 shutdown_connections 2023-06-09T04:42:07.134 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.127+0000 7fc5759c3700 1 -- 172.21.15.62:0/2997246400 wait complete. 2023-06-09T04:42:07.156 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:40:44.646921+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:40:50.006643+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T04:40:55.031273+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T04:40:55.773517+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-09T04:40:58.845383+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-09T04:42:07.157 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:42:07.336 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.331+0000 7f169b59e700 1 Processor -- start 2023-06-09T04:42:07.336 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.331+0000 7f169b59e700 1 -- start start 2023-06-09T04:42:07.340 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.335+0000 7f169b59e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f169c0d1f80 0x7f169c0b3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:07.340 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.335+0000 7f169b59e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f169c0cebf0 0x7f169c0ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:07.341 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.335+0000 7f169b59e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f169c0cf070 con 0x7f169c0cd110 2023-06-09T04:42:07.341 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.335+0000 7f169b59e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f169c0b4d50 con 0x7f169c0d1f80 2023-06-09T04:42:07.341 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.335+0000 7f169b59e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f169c0cd550 con 0x7f169c0cebf0 2023-06-09T04:42:07.341 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.335+0000 7f169a59c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f169c0d1f80 0x7f169c0b3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:07.341 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.335+0000 7f1699d9b700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f169c0cebf0 0x7f169c0ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:07.342 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.335+0000 7f169a59c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f169c0d1f80 0x7f169c0b3b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53894/0 (socket says 172.21.15.62:53894) 2023-06-09T04:42:07.342 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.335+0000 7f169a59c700 1 -- 172.21.15.62:0/2351500108 learned_addr learned my addr 172.21.15.62:0/2351500108 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:07.343 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.335+0000 7f169a59c700 1 -- 172.21.15.62:0/2351500108 >> v2:172.21.15.89:3300/0 conn(0x7f169c0cebf0 msgr2=0x7f169c0ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:07.343 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.335+0000 7f169a59c700 1 --2- 172.21.15.62:0/2351500108 >> v2:172.21.15.89:3300/0 conn(0x7f169c0cebf0 0x7f169c0ccbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:07.343 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.335+0000 7f169a59c700 1 -- 172.21.15.62:0/2351500108 >> v1:172.21.15.89:6789/0 conn(0x7f169c0cd110 legacy=0x7f169c0b2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:07.343 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.335+0000 7f169a59c700 1 -- 172.21.15.62:0/2351500108 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f169c0b4140 con 0x7f169c0d1f80 2023-06-09T04:42:07.343 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.335+0000 7f169a59c700 1 --2- 172.21.15.62:0/2351500108 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f169c0d1f80 0x7f169c0b3b20 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f169c0b8580 tx=0x7f168c009be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b97bafd7e8d19ea server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:07.343 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.335+0000 7f169959a700 1 -- 172.21.15.62:0/2351500108 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168c011830 con 0x7f169c0d1f80 2023-06-09T04:42:07.344 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.335+0000 7f169959a700 1 -- 172.21.15.62:0/2351500108 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f168c011990 con 0x7f169c0d1f80 2023-06-09T04:42:07.344 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.335+0000 7f169959a700 1 -- 172.21.15.62:0/2351500108 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168c011d20 con 0x7f169c0d1f80 2023-06-09T04:42:07.344 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.339+0000 7f169b59e700 1 -- 172.21.15.62:0/2351500108 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f169c0d1f80 msgr2=0x7f169c0b3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:07.345 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.339+0000 7f169b59e700 1 --2- 172.21.15.62:0/2351500108 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f169c0d1f80 0x7f169c0b3b20 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f169c0b8580 tx=0x7f168c009be0 comp rx=0 tx=0).stop 2023-06-09T04:42:07.345 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.339+0000 7f169b59e700 1 -- 172.21.15.62:0/2351500108 shutdown_connections 2023-06-09T04:42:07.345 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.339+0000 7f169b59e700 1 --2- 172.21.15.62:0/2351500108 >> v2:172.21.15.89:3300/0 conn(0x7f169c0cebf0 0x7f169c0ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:07.345 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.339+0000 7f169b59e700 1 --2- 172.21.15.62:0/2351500108 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f169c0d1f80 0x7f169c0b3b20 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:07.345 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.339+0000 7f169b59e700 1 -- 172.21.15.62:0/2351500108 >> 172.21.15.62:0/2351500108 conn(0x7f169c071840 msgr2=0x7f169c09b760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:07.345 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.339+0000 7f169b59e700 1 -- 172.21.15.62:0/2351500108 shutdown_connections 2023-06-09T04:42:07.346 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.339+0000 7f169b59e700 1 -- 172.21.15.62:0/2351500108 wait complete. 2023-06-09T04:42:07.346 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.339+0000 7f169b59e700 1 Processor -- start 2023-06-09T04:42:07.346 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.339+0000 7f169b59e700 1 -- start start 2023-06-09T04:42:07.348 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.343+0000 7f169b59e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f169c0cd110 0x7f169c1f1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:07.349 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.343+0000 7f169b59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f169c0cebf0 0x7f169c1e5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:07.349 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.343+0000 7f169b59e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f169c0d1f80 0x7f169c0b6df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:07.349 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.343+0000 7f169b59e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f169c1e4eb0 con 0x7f169c0cebf0 2023-06-09T04:42:07.349 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.343+0000 7f169b59e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f169c1e4230 con 0x7f169c0d1f80 2023-06-09T04:42:07.349 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.343+0000 7f169b59e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f169c1e4510 con 0x7f169c0cd110 2023-06-09T04:42:07.349 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.343+0000 7f1699d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f169c0cebf0 0x7f169c1e5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:07.350 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.343+0000 7f1699d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f169c0cebf0 0x7f169c1e5af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53908/0 (socket says 172.21.15.62:53908) 2023-06-09T04:42:07.350 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.343+0000 7f1699d9b700 1 -- 172.21.15.62:0/3130511850 learned_addr learned my addr 172.21.15.62:0/3130511850 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:07.350 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.343+0000 7f169a59c700 1 --2- 172.21.15.62:0/3130511850 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f169c0cd110 0x7f169c1f1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:07.350 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.343+0000 7f169ad9d700 1 --2- 172.21.15.62:0/3130511850 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f169c0d1f80 0x7f169c0b6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:07.351 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.343+0000 7f1699d9b700 1 -- 172.21.15.62:0/3130511850 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f169c0cd110 msgr2=0x7f169c1f1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:07.351 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.343+0000 7f1699d9b700 1 --2- 172.21.15.62:0/3130511850 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f169c0cd110 0x7f169c1f1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:07.351 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.343+0000 7f1699d9b700 1 -- 172.21.15.62:0/3130511850 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f169c0d1f80 msgr2=0x7f169c0b6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:07.352 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.343+0000 7f1699d9b700 1 --2- 172.21.15.62:0/3130511850 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f169c0d1f80 0x7f169c0b6df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:07.352 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.343+0000 7f1699d9b700 1 -- 172.21.15.62:0/3130511850 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f168c009510 con 0x7f169c0cebf0 2023-06-09T04:42:07.352 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.343+0000 7f1699d9b700 1 --2- 172.21.15.62:0/3130511850 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f169c0cebf0 0x7f169c1e5af0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f169000e9d0 tx=0x7f169000ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:07.352 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.343+0000 7f168affd700 1 -- 172.21.15.62:0/3130511850 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1690009720 con 0x7f169c0cebf0 2023-06-09T04:42:07.352 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.343+0000 7f168affd700 1 -- 172.21.15.62:0/3130511850 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f169000ee70 con 0x7f169c0cebf0 2023-06-09T04:42:07.352 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.343+0000 7f169b59e700 1 -- 172.21.15.62:0/3130511850 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f169c1e47f0 con 0x7f169c0cebf0 2023-06-09T04:42:07.353 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.343+0000 7f168affd700 1 -- 172.21.15.62:0/3130511850 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169000ca50 con 0x7f169c0cebf0 2023-06-09T04:42:07.353 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.343+0000 7f169b59e700 1 -- 172.21.15.62:0/3130511850 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f169c1e6030 con 0x7f169c0cebf0 2023-06-09T04:42:07.353 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.347+0000 7f169b59e700 1 -- 172.21.15.62:0/3130511850 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f169c0739c0 con 0x7f169c0cebf0 2023-06-09T04:42:07.353 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.347+0000 7f168affd700 1 -- 172.21.15.62:0/3130511850 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f169000cbb0 con 0x7f169c0cebf0 2023-06-09T04:42:07.355 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.347+0000 7f168affd700 1 --2- 172.21.15.62:0/3130511850 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f167c0662f0 0x7f167c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:07.355 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.351+0000 7f168affd700 1 -- 172.21.15.62:0/3130511850 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f16900841b0 con 0x7f169c0cebf0 2023-06-09T04:42:07.356 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.351+0000 7f169a59c700 1 --2- 172.21.15.62:0/3130511850 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f167c0662f0 0x7f167c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:07.357 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.351+0000 7f169a59c700 1 --2- 172.21.15.62:0/3130511850 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f167c0662f0 0x7f167c0687a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f168c000c00 tx=0x7f168c008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:07.361 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.355+0000 7f168affd700 1 -- 172.21.15.62:0/3130511850 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f1690054c70 con 0x7f169c0cebf0 2023-06-09T04:42:07.536 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.531+0000 7f169b59e700 1 -- 172.21.15.62:0/3130511850 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f169c0d0740 con 0x7f169c0cebf0 2023-06-09T04:42:07.536 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.531+0000 7f168affd700 1 -- 172.21.15.62:0/3130511850 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f169000ce60 con 0x7f169c0cebf0 2023-06-09T04:42:07.537 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2023-06-09T04:42:07.541 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.535+0000 7f169b59e700 1 -- 172.21.15.62:0/3130511850 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f167c0662f0 msgr2=0x7f167c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:07.541 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.535+0000 7f169b59e700 1 --2- 172.21.15.62:0/3130511850 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f167c0662f0 0x7f167c0687a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f168c000c00 tx=0x7f168c008030 comp rx=0 tx=0).stop 2023-06-09T04:42:07.541 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.535+0000 7f169b59e700 1 -- 172.21.15.62:0/3130511850 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f169c0cebf0 msgr2=0x7f169c1e5af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:07.541 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.535+0000 7f169b59e700 1 --2- 172.21.15.62:0/3130511850 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f169c0cebf0 0x7f169c1e5af0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f169000e9d0 tx=0x7f169000ece0 comp rx=0 tx=0).stop 2023-06-09T04:42:07.542 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.535+0000 7f169b59e700 1 -- 172.21.15.62:0/3130511850 shutdown_connections 2023-06-09T04:42:07.542 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.535+0000 7f169b59e700 1 --2- 172.21.15.62:0/3130511850 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f167c0662f0 0x7f167c0687a0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:07.542 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.535+0000 7f169b59e700 1 --2- 172.21.15.62:0/3130511850 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f169c0d1f80 0x7f169c0b6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:07.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.535+0000 7f169b59e700 1 --2- 172.21.15.62:0/3130511850 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f169c0cebf0 0x7f169c1e5af0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:07.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.535+0000 7f169b59e700 1 --2- 172.21.15.62:0/3130511850 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f169c0cd110 0x7f169c1f1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:07.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.535+0000 7f169b59e700 1 -- 172.21.15.62:0/3130511850 >> 172.21.15.62:0/3130511850 conn(0x7f169c071840 msgr2=0x7f169c1e71c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:07.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.535+0000 7f169b59e700 1 -- 172.21.15.62:0/3130511850 shutdown_connections 2023-06-09T04:42:07.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.535+0000 7f169b59e700 1 -- 172.21.15.62:0/3130511850 wait complete. 2023-06-09T04:42:07.565 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:42:07.750 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.743+0000 7f663e3a1700 1 Processor -- start 2023-06-09T04:42:07.751 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.743+0000 7f663e3a1700 1 -- start start 2023-06-09T04:42:07.752 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.747+0000 7f663e3a1700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66380b0260 0x7f66380ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:07.753 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.747+0000 7f663e3a1700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f66380c8800 0x7f663806d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:07.753 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.747+0000 7f663e3a1700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6638160730 con 0x7f6638160360 2023-06-09T04:42:07.753 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.747+0000 7f663e3a1700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66380ca860 con 0x7f66380c8800 2023-06-09T04:42:07.753 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.747+0000 7f663e3a1700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66380ca580 con 0x7f66380b0260 2023-06-09T04:42:07.754 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.747+0000 7f663d39f700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f6638160360 0x7f66380afb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:33032/0 (socket says 172.21.15.62:33032) 2023-06-09T04:42:07.754 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.747+0000 7f663d39f700 1 -- 172.21.15.62:0/1166346331 learned_addr learned my addr 172.21.15.62:0/1166346331 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:42:07.754 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.747+0000 7f663dba0700 1 --2- 172.21.15.62:0/1166346331 >> v2:172.21.15.62:3300/0 conn(0x7f66380c8800 0x7f663806d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:07.754 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.747+0000 7f663cb9e700 1 --2- 172.21.15.62:0/1166346331 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66380b0260 0x7f66380ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:07.755 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.747+0000 7f662ffff700 1 -- 172.21.15.62:0/1166346331 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1652288875 0 0) 0x7f6638160730 con 0x7f6638160360 2023-06-09T04:42:07.755 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.747+0000 7f662ffff700 1 -- 172.21.15.62:0/1166346331 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66240035d0 con 0x7f6638160360 2023-06-09T04:42:07.755 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.747+0000 7f663cb9e700 1 -- 172.21.15.62:0/1166346331 >> v2:172.21.15.62:3300/0 conn(0x7f66380c8800 msgr2=0x7f663806d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:07.755 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.747+0000 7f663cb9e700 1 --2- 172.21.15.62:0/1166346331 >> v2:172.21.15.62:3300/0 conn(0x7f66380c8800 0x7f663806d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:07.755 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.747+0000 7f663cb9e700 1 -- 172.21.15.62:0/1166346331 >> v1:172.21.15.62:6789/0 conn(0x7f6638160360 legacy=0x7f66380afb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:07.755 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.747+0000 7f663cb9e700 1 -- 172.21.15.62:0/1166346331 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66380cc070 con 0x7f66380b0260 2023-06-09T04:42:07.756 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.747+0000 7f663cb9e700 1 --2- 172.21.15.62:0/1166346331 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66380b0260 0x7f66380ccb50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6628009850 tx=0x7f6628009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3bdc1066ea023379 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:07.756 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.751+0000 7f662ffff700 1 -- 172.21.15.62:0/1166346331 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6628011830 con 0x7f66380b0260 2023-06-09T04:42:07.756 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.751+0000 7f662ffff700 1 -- 172.21.15.62:0/1166346331 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6628011990 con 0x7f66380b0260 2023-06-09T04:42:07.756 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.751+0000 7f662ffff700 1 -- 172.21.15.62:0/1166346331 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6628011d40 con 0x7f66380b0260 2023-06-09T04:42:07.757 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.751+0000 7f663e3a1700 1 -- 172.21.15.62:0/1166346331 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66380b0260 msgr2=0x7f66380ccb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:07.757 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.751+0000 7f663e3a1700 1 --2- 172.21.15.62:0/1166346331 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66380b0260 0x7f66380ccb50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6628009850 tx=0x7f6628009b60 comp rx=0 tx=0).stop 2023-06-09T04:42:07.758 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.751+0000 7f663e3a1700 1 -- 172.21.15.62:0/1166346331 shutdown_connections 2023-06-09T04:42:07.758 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.751+0000 7f663e3a1700 1 --2- 172.21.15.62:0/1166346331 >> v2:172.21.15.62:3300/0 conn(0x7f66380c8800 0x7f663806d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:07.758 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.751+0000 7f663e3a1700 1 --2- 172.21.15.62:0/1166346331 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66380b0260 0x7f66380ccb50 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:07.759 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.751+0000 7f663e3a1700 1 -- 172.21.15.62:0/1166346331 >> 172.21.15.62:0/1166346331 conn(0x7f66380cab50 msgr2=0x7f66380caf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:07.759 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.751+0000 7f663e3a1700 1 -- 172.21.15.62:0/1166346331 shutdown_connections 2023-06-09T04:42:07.759 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.751+0000 7f663e3a1700 1 -- 172.21.15.62:0/1166346331 wait complete. 2023-06-09T04:42:07.760 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.755+0000 7f663e3a1700 1 Processor -- start 2023-06-09T04:42:07.760 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.755+0000 7f663e3a1700 1 -- start start 2023-06-09T04:42:07.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.755+0000 7f663e3a1700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f66380b0260 0x7f66381f6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:07.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.755+0000 7f663e3a1700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66380c8800 0x7f66381f90c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:07.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.755+0000 7f663e3a1700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6638160360 0x7f66381f9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:07.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.755+0000 7f663e3a1700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66381f6a90 con 0x7f6638160360 2023-06-09T04:42:07.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.755+0000 7f663e3a1700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66380b24c0 con 0x7f66380b0260 2023-06-09T04:42:07.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.755+0000 7f663e3a1700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66380b27a0 con 0x7f66380c8800 2023-06-09T04:42:07.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.755+0000 7f663dba0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6638160360 0x7f66381f9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:07.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.755+0000 7f663dba0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6638160360 0x7f66381f9600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53928/0 (socket says 172.21.15.62:53928) 2023-06-09T04:42:07.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.755+0000 7f663dba0700 1 -- 172.21.15.62:0/1939862447 learned_addr learned my addr 172.21.15.62:0/1939862447 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:07.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.755+0000 7f663d39f700 1 --2- 172.21.15.62:0/1939862447 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f66380b0260 0x7f66381f6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:07.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.755+0000 7f663cb9e700 1 --2- 172.21.15.62:0/1939862447 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66380c8800 0x7f66381f90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:07.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.755+0000 7f663dba0700 1 -- 172.21.15.62:0/1939862447 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66380c8800 msgr2=0x7f66381f90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:07.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.755+0000 7f663dba0700 1 --2- 172.21.15.62:0/1939862447 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66380c8800 0x7f66381f90c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:07.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.755+0000 7f663dba0700 1 -- 172.21.15.62:0/1939862447 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f66380b0260 msgr2=0x7f66381f6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:07.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.755+0000 7f663dba0700 1 --2- 172.21.15.62:0/1939862447 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f66380b0260 0x7f66381f6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:07.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.755+0000 7f663dba0700 1 -- 172.21.15.62:0/1939862447 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66280094b0 con 0x7f6638160360 2023-06-09T04:42:07.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.759+0000 7f663dba0700 1 --2- 172.21.15.62:0/1939862447 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6638160360 0x7f66381f9600 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f663000e7f0 tx=0x7f663000ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:07.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.759+0000 7f662dffb700 1 -- 172.21.15.62:0/1939862447 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6630013680 con 0x7f6638160360 2023-06-09T04:42:07.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.759+0000 7f662dffb700 1 -- 172.21.15.62:0/1939862447 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66300137e0 con 0x7f6638160360 2023-06-09T04:42:07.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.759+0000 7f663e3a1700 1 -- 172.21.15.62:0/1939862447 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66380b2a80 con 0x7f6638160360 2023-06-09T04:42:07.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.759+0000 7f662dffb700 1 -- 172.21.15.62:0/1939862447 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6630013b90 con 0x7f6638160360 2023-06-09T04:42:07.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.759+0000 7f663e3a1700 1 -- 172.21.15.62:0/1939862447 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66380b3040 con 0x7f6638160360 2023-06-09T04:42:07.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.759+0000 7f663e3a1700 1 -- 172.21.15.62:0/1939862447 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66380739c0 con 0x7f6638160360 2023-06-09T04:42:07.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.763+0000 7f662dffb700 1 -- 172.21.15.62:0/1939862447 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f6630013cf0 con 0x7f6638160360 2023-06-09T04:42:07.770 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.763+0000 7f662dffb700 1 --2- 172.21.15.62:0/1939862447 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f661c0662f0 0x7f661c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:07.770 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.763+0000 7f662dffb700 1 -- 172.21.15.62:0/1939862447 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6630083ff0 con 0x7f6638160360 2023-06-09T04:42:07.770 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.763+0000 7f663d39f700 1 --2- 172.21.15.62:0/1939862447 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f661c0662f0 0x7f661c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:07.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.767+0000 7f663d39f700 1 --2- 172.21.15.62:0/1939862447 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f661c0662f0 0x7f661c0687a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6634001560 tx=0x7f6634009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:07.776 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.771+0000 7f662dffb700 1 -- 172.21.15.62:0/1939862447 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f6630054b30 con 0x7f6638160360 2023-06-09T04:42:07.949 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.943+0000 7f663e3a1700 1 -- 172.21.15.62:0/1939862447 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f66380cd4e0 con 0x7f6638160360 2023-06-09T04:42:07.950 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.943+0000 7f662dffb700 1 -- 172.21.15.62:0/1939862447 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6630017020 con 0x7f6638160360 2023-06-09T04:42:07.950 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2023-06-09T04:42:07.956 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.951+0000 7f663e3a1700 1 -- 172.21.15.62:0/1939862447 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f661c0662f0 msgr2=0x7f661c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:07.956 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.951+0000 7f663e3a1700 1 --2- 172.21.15.62:0/1939862447 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f661c0662f0 0x7f661c0687a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6634001560 tx=0x7f6634009040 comp rx=0 tx=0).stop 2023-06-09T04:42:07.956 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.951+0000 7f663e3a1700 1 -- 172.21.15.62:0/1939862447 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6638160360 msgr2=0x7f66381f9600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:07.956 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.951+0000 7f663e3a1700 1 --2- 172.21.15.62:0/1939862447 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6638160360 0x7f66381f9600 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f663000e7f0 tx=0x7f663000ebb0 comp rx=0 tx=0).stop 2023-06-09T04:42:07.956 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.951+0000 7f663e3a1700 1 -- 172.21.15.62:0/1939862447 shutdown_connections 2023-06-09T04:42:07.956 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.951+0000 7f663e3a1700 1 --2- 172.21.15.62:0/1939862447 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f661c0662f0 0x7f661c0687a0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:07.957 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.951+0000 7f663e3a1700 1 --2- 172.21.15.62:0/1939862447 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6638160360 0x7f66381f9600 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:07.957 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.951+0000 7f663e3a1700 1 --2- 172.21.15.62:0/1939862447 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f66380c8800 0x7f66381f90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:07.957 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.951+0000 7f663e3a1700 1 --2- 172.21.15.62:0/1939862447 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f66380b0260 0x7f66381f6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:07.957 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.951+0000 7f663e3a1700 1 -- 172.21.15.62:0/1939862447 >> 172.21.15.62:0/1939862447 conn(0x7f66380cab50 msgr2=0x7f66380adbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:07.957 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.951+0000 7f663e3a1700 1 -- 172.21.15.62:0/1939862447 shutdown_connections 2023-06-09T04:42:07.957 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:07.951+0000 7f663e3a1700 1 -- 172.21.15.62:0/1939862447 wait complete. 2023-06-09T04:42:07.977 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T04:42:08.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.155+0000 7ff9b5816700 1 Processor -- start 2023-06-09T04:42:08.161 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.155+0000 7ff9b5816700 1 -- start start 2023-06-09T04:42:08.164 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.159+0000 7ff9b5816700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff9b00d1f80 0x7ff9b00b3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:08.164 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.159+0000 7ff9b5816700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff9b00cebf0 0x7ff9b00ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:08.164 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.159+0000 7ff9b5816700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9b00cd110 0x7ff9b00b2400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:08.165 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.159+0000 7ff9b5816700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9b00cd590 con 0x7ff9b00d1f80 2023-06-09T04:42:08.165 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.159+0000 7ff9b5816700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9b00cf070 con 0x7ff9b00cebf0 2023-06-09T04:42:08.165 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.159+0000 7ff9b5816700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b00b4d50 con 0x7ff9b00cd110 2023-06-09T04:42:08.166 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.159+0000 7ff9b4814700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff9b00d1f80 0x7ff9b00b3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:08.166 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.159+0000 7ff9b4814700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff9b00d1f80 0x7ff9b00b3b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53944/0 (socket says 172.21.15.62:53944) 2023-06-09T04:42:08.166 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.159+0000 7ff9b4814700 1 -- 172.21.15.62:0/1359683316 learned_addr learned my addr 172.21.15.62:0/1359683316 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:08.166 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.159+0000 7ff9b5015700 1 --2- 172.21.15.62:0/1359683316 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9b00cd110 0x7ff9b00b2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:08.166 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.159+0000 7ff9affff700 1 --2- 172.21.15.62:0/1359683316 >> v2:172.21.15.89:3300/0 conn(0x7ff9b00cebf0 0x7ff9b00ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:08.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.159+0000 7ff9b4814700 1 -- 172.21.15.62:0/1359683316 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9b00cd110 msgr2=0x7ff9b00b2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:08.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.159+0000 7ff9b4814700 1 --2- 172.21.15.62:0/1359683316 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9b00cd110 0x7ff9b00b2400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:08.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.159+0000 7ff9b4814700 1 -- 172.21.15.62:0/1359683316 >> v2:172.21.15.89:3300/0 conn(0x7ff9b00cebf0 msgr2=0x7ff9b00ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:08.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.159+0000 7ff9b4814700 1 --2- 172.21.15.62:0/1359683316 >> v2:172.21.15.89:3300/0 conn(0x7ff9b00cebf0 0x7ff9b00ccbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:08.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.159+0000 7ff9b4814700 1 -- 172.21.15.62:0/1359683316 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9b00b4140 con 0x7ff9b00d1f80 2023-06-09T04:42:08.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.159+0000 7ff9affff700 1 --2- 172.21.15.62:0/1359683316 >> v2:172.21.15.89:3300/0 conn(0x7ff9b00cebf0 0x7ff9b00ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:08.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.159+0000 7ff9b4814700 1 --2- 172.21.15.62:0/1359683316 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff9b00d1f80 0x7ff9b00b3b20 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ff9b00b8580 tx=0x7ff9a4009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cbe99cc17ccdc39 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:08.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.159+0000 7ff9af7fe700 1 -- 172.21.15.62:0/1359683316 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a4005e50 con 0x7ff9b00d1f80 2023-06-09T04:42:08.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.159+0000 7ff9af7fe700 1 -- 172.21.15.62:0/1359683316 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9a4006030 con 0x7ff9b00d1f80 2023-06-09T04:42:08.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.159+0000 7ff9af7fe700 1 -- 172.21.15.62:0/1359683316 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a40063c0 con 0x7ff9b00d1f80 2023-06-09T04:42:08.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.163+0000 7ff9b5816700 1 -- 172.21.15.62:0/1359683316 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff9b00d1f80 msgr2=0x7ff9b00b3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:08.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.163+0000 7ff9b5816700 1 --2- 172.21.15.62:0/1359683316 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff9b00d1f80 0x7ff9b00b3b20 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ff9b00b8580 tx=0x7ff9a4009bf0 comp rx=0 tx=0).stop 2023-06-09T04:42:08.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.163+0000 7ff9b5816700 1 -- 172.21.15.62:0/1359683316 shutdown_connections 2023-06-09T04:42:08.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.163+0000 7ff9b5816700 1 --2- 172.21.15.62:0/1359683316 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9b00cd110 0x7ff9b00b2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:08.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.163+0000 7ff9b5816700 1 --2- 172.21.15.62:0/1359683316 >> v2:172.21.15.89:3300/0 conn(0x7ff9b00cebf0 0x7ff9b00ccbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:08.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.163+0000 7ff9b5816700 1 --2- 172.21.15.62:0/1359683316 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff9b00d1f80 0x7ff9b00b3b20 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:08.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.163+0000 7ff9b5816700 1 -- 172.21.15.62:0/1359683316 >> 172.21.15.62:0/1359683316 conn(0x7ff9b0071840 msgr2=0x7ff9b009b760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:08.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.163+0000 7ff9b5816700 1 -- 172.21.15.62:0/1359683316 shutdown_connections 2023-06-09T04:42:08.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.163+0000 7ff9b5816700 1 -- 172.21.15.62:0/1359683316 wait complete. 2023-06-09T04:42:08.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.167+0000 7ff9b5816700 1 Processor -- start 2023-06-09T04:42:08.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.167+0000 7ff9b5816700 1 -- start start 2023-06-09T04:42:08.173 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.167+0000 7ff9b5816700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff9b00cd110 0x7ff9b015cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:08.174 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.167+0000 7ff9b5816700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9b00cebf0 0x7ff9b0151a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:08.174 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.167+0000 7ff9b5816700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9b00d1f80 0x7ff9b00cbf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:08.174 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.167+0000 7ff9b5816700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b015d610 con 0x7ff9b00cd110 2023-06-09T04:42:08.174 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.167+0000 7ff9b5816700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b00c9d90 con 0x7ff9b00d1f80 2023-06-09T04:42:08.174 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.167+0000 7ff9b5816700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b0151fc0 con 0x7ff9b00cebf0 2023-06-09T04:42:08.175 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.167+0000 7ff9b4814700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff9b00cd110 0x7ff9b015cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:08.176 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.167+0000 7ff9b4814700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff9b00cd110 0x7ff9b015cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53954/0 (socket says 172.21.15.62:53954) 2023-06-09T04:42:08.176 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.167+0000 7ff9b4814700 1 -- 172.21.15.62:0/1054235522 learned_addr learned my addr 172.21.15.62:0/1054235522 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:08.176 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.167+0000 7ff9b5015700 1 --2- 172.21.15.62:0/1054235522 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9b00d1f80 0x7ff9b00cbf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:08.176 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.167+0000 7ff9affff700 1 --2- 172.21.15.62:0/1054235522 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9b00cebf0 0x7ff9b0151a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:08.176 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.167+0000 7ff9b4814700 1 -- 172.21.15.62:0/1054235522 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9b00cebf0 msgr2=0x7ff9b0151a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:08.176 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.167+0000 7ff9b4814700 1 --2- 172.21.15.62:0/1054235522 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9b00cebf0 0x7ff9b0151a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:08.176 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.167+0000 7ff9b4814700 1 -- 172.21.15.62:0/1054235522 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9b00d1f80 msgr2=0x7ff9b00cbf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:08.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.167+0000 7ff9b4814700 1 --2- 172.21.15.62:0/1054235522 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9b00d1f80 0x7ff9b00cbf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:08.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.167+0000 7ff9b4814700 1 -- 172.21.15.62:0/1054235522 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a4009520 con 0x7ff9b00cd110 2023-06-09T04:42:08.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.171+0000 7ff9b4814700 1 --2- 172.21.15.62:0/1054235522 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff9b00cd110 0x7ff9b015cca0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ff9a4009c30 tx=0x7ff9a4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:08.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.171+0000 7ff9ad7fa700 1 -- 172.21.15.62:0/1054235522 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a4004250 con 0x7ff9b00cd110 2023-06-09T04:42:08.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.171+0000 7ff9ad7fa700 1 -- 172.21.15.62:0/1054235522 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9a40043d0 con 0x7ff9b00cd110 2023-06-09T04:42:08.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.171+0000 7ff9ad7fa700 1 -- 172.21.15.62:0/1054235522 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a40036c0 con 0x7ff9b00cd110 2023-06-09T04:42:08.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.171+0000 7ff9b5816700 1 -- 172.21.15.62:0/1054235522 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9b00cc4b0 con 0x7ff9b00cd110 2023-06-09T04:42:08.178 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.171+0000 7ff9b5816700 1 -- 172.21.15.62:0/1054235522 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9b00c9740 con 0x7ff9b00cd110 2023-06-09T04:42:08.178 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.171+0000 7ff9b5816700 1 -- 172.21.15.62:0/1054235522 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9b00c95a0 con 0x7ff9b00cd110 2023-06-09T04:42:08.179 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.171+0000 7ff9ad7fa700 1 -- 172.21.15.62:0/1054235522 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff9a4022070 con 0x7ff9b00cd110 2023-06-09T04:42:08.180 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.175+0000 7ff9ad7fa700 1 --2- 172.21.15.62:0/1054235522 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7ff994066320 0x7ff9940687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:08.181 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.175+0000 7ff9ad7fa700 1 -- 172.21.15.62:0/1054235522 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff9a4085730 con 0x7ff9b00cd110 2023-06-09T04:42:08.181 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.175+0000 7ff9affff700 1 --2- 172.21.15.62:0/1054235522 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7ff994066320 0x7ff9940687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:08.182 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.175+0000 7ff9affff700 1 --2- 172.21.15.62:0/1054235522 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7ff994066320 0x7ff9940687d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff9b00d0b60 tx=0x7ff99c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:08.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.179+0000 7ff9ad7fa700 1 -- 172.21.15.62:0/1054235522 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff9b00c95a0 con 0x7ff9b00cd110 2023-06-09T04:42:08.362 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.355+0000 7ff9b5816700 1 -- 172.21.15.62:0/1054235522 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff9b00c95a0 con 0x7ff9b00cd110 2023-06-09T04:42:08.363 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.355+0000 7ff9ad7fa700 1 -- 172.21.15.62:0/1054235522 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff9b00c95a0 con 0x7ff9b00cd110 2023-06-09T04:42:08.363 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-06-09T04:42:08.365 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.359+0000 7ff9b5816700 1 -- 172.21.15.62:0/1054235522 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7ff994066320 msgr2=0x7ff9940687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:08.366 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.359+0000 7ff9b5816700 1 --2- 172.21.15.62:0/1054235522 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7ff994066320 0x7ff9940687d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff9b00d0b60 tx=0x7ff99c008040 comp rx=0 tx=0).stop 2023-06-09T04:42:08.366 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.359+0000 7ff9b5816700 1 -- 172.21.15.62:0/1054235522 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff9b00cd110 msgr2=0x7ff9b015cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:08.366 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.359+0000 7ff9b5816700 1 --2- 172.21.15.62:0/1054235522 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff9b00cd110 0x7ff9b015cca0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ff9a4009c30 tx=0x7ff9a4004770 comp rx=0 tx=0).stop 2023-06-09T04:42:08.367 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.359+0000 7ff9b5816700 1 -- 172.21.15.62:0/1054235522 shutdown_connections 2023-06-09T04:42:08.367 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.359+0000 7ff9b5816700 1 --2- 172.21.15.62:0/1054235522 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7ff994066320 0x7ff9940687d0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:08.367 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.359+0000 7ff9b5816700 1 --2- 172.21.15.62:0/1054235522 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9b00d1f80 0x7ff9b00cbf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:08.367 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.359+0000 7ff9b5816700 1 --2- 172.21.15.62:0/1054235522 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff9b00cebf0 0x7ff9b0151a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:08.367 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.359+0000 7ff9b5816700 1 --2- 172.21.15.62:0/1054235522 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff9b00cd110 0x7ff9b015cca0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:08.368 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.359+0000 7ff9b5816700 1 -- 172.21.15.62:0/1054235522 >> 172.21.15.62:0/1054235522 conn(0x7ff9b0071840 msgr2=0x7ff9b00d10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:08.368 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.359+0000 7ff9b5816700 1 -- 172.21.15.62:0/1054235522 shutdown_connections 2023-06-09T04:42:08.368 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.359+0000 7ff9b5816700 1 -- 172.21.15.62:0/1054235522 wait complete. 2023-06-09T04:42:08.389 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T04:42:08.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.563+0000 7f0abebe3700 1 Processor -- start 2023-06-09T04:42:08.569 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.563+0000 7f0abebe3700 1 -- start start 2023-06-09T04:42:08.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.563+0000 7f0abebe3700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0ab80b3b20 0x7f0ab80cebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:08.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.563+0000 7f0abebe3700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ab80b4d50 con 0x7f0ab80d1f80 2023-06-09T04:42:08.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.563+0000 7f0abebe3700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ab80b4140 con 0x7f0ab80cd2e0 2023-06-09T04:42:08.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.563+0000 7f0abebe3700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ab80b3f40 con 0x7f0ab80b3b20 2023-06-09T04:42:08.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.567+0000 7f0abdbe1700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f0ab80d1f80 0x7f0ab80ccbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:33040/0 (socket says 172.21.15.62:33040) 2023-06-09T04:42:08.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.567+0000 7f0abdbe1700 1 -- 172.21.15.62:0/3215055264 learned_addr learned my addr 172.21.15.62:0/3215055264 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:42:08.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.567+0000 7f0abe3e2700 1 --2- 172.21.15.62:0/3215055264 >> v2:172.21.15.89:3300/0 conn(0x7f0ab80b3b20 0x7f0ab80cebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:08.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.567+0000 7f0abcbdf700 1 -- 172.21.15.62:0/3215055264 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1042126144 0 0) 0x7f0ab80b4d50 con 0x7f0ab80d1f80 2023-06-09T04:42:08.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.567+0000 7f0abcbdf700 1 -- 172.21.15.62:0/3215055264 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0aa40035d0 con 0x7f0ab80d1f80 2023-06-09T04:42:08.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.567+0000 7f0abe3e2700 1 -- 172.21.15.62:0/3215055264 >> v1:172.21.15.89:6789/0 conn(0x7f0ab80cd2e0 legacy=0x7f0ab80d0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:08.576 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.567+0000 7f0abcbdf700 1 -- 172.21.15.62:0/3215055264 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 127354460 0 0) 0x7f0ab80b4140 con 0x7f0ab80cd2e0 2023-06-09T04:42:08.576 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.567+0000 7f0abe3e2700 1 -- 172.21.15.62:0/3215055264 >> v1:172.21.15.62:6789/0 conn(0x7f0ab80d1f80 legacy=0x7f0ab80ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:08.576 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.567+0000 7f0abe3e2700 1 -- 172.21.15.62:0/3215055264 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ab80b4420 con 0x7f0ab80b3b20 2023-06-09T04:42:08.577 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.567+0000 7f0abe3e2700 1 --2- 172.21.15.62:0/3215055264 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ab80b3b20 0x7f0ab80cebf0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0ab0009d90 tx=0x7f0ab000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f85e34dc006178a server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:08.577 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.567+0000 7f0abcbdf700 1 -- 172.21.15.62:0/3215055264 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab000e070 con 0x7f0ab80b3b20 2023-06-09T04:42:08.577 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.567+0000 7f0abcbdf700 1 -- 172.21.15.62:0/3215055264 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ab000bb20 con 0x7f0ab80b3b20 2023-06-09T04:42:08.578 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.567+0000 7f0abcbdf700 1 -- 172.21.15.62:0/3215055264 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab000bed0 con 0x7f0ab80b3b20 2023-06-09T04:42:08.578 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.567+0000 7f0abebe3700 1 -- 172.21.15.62:0/3215055264 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ab80b3b20 msgr2=0x7f0ab80cebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:08.578 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.567+0000 7f0abebe3700 1 --2- 172.21.15.62:0/3215055264 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ab80b3b20 0x7f0ab80cebf0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0ab0009d90 tx=0x7f0ab000b330 comp rx=0 tx=0).stop 2023-06-09T04:42:08.580 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.571+0000 7f0abebe3700 1 -- 172.21.15.62:0/3215055264 shutdown_connections 2023-06-09T04:42:08.580 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.571+0000 7f0abebe3700 1 --2- 172.21.15.62:0/3215055264 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ab80b3b20 0x7f0ab80cebf0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:08.580 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.571+0000 7f0abebe3700 1 -- 172.21.15.62:0/3215055264 >> 172.21.15.62:0/3215055264 conn(0x7f0ab8071840 msgr2=0x7f0ab809b760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:08.580 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.571+0000 7f0abebe3700 1 -- 172.21.15.62:0/3215055264 shutdown_connections 2023-06-09T04:42:08.580 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.571+0000 7f0abebe3700 1 -- 172.21.15.62:0/3215055264 wait complete. 2023-06-09T04:42:08.581 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.571+0000 7f0abebe3700 1 Processor -- start 2023-06-09T04:42:08.581 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.575+0000 7f0abebe3700 1 -- start start 2023-06-09T04:42:08.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.575+0000 7f0abebe3700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ab80b3b20 0x7f0ab80d0c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:08.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.575+0000 7f0abebe3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0ab80cd2e0 0x7f0ab80ccce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:08.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.575+0000 7f0abebe3700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ab80d1f80 0x7f0ab815e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:08.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.575+0000 7f0abebe3700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab80b5410 con 0x7f0ab80b3b20 2023-06-09T04:42:08.583 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.575+0000 7f0abebe3700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab80b56f0 con 0x7f0ab80d1f80 2023-06-09T04:42:08.583 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.575+0000 7f0abebe3700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab80b59d0 con 0x7f0ab80cd2e0 2023-06-09T04:42:08.583 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.575+0000 7f0abdbe1700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ab80b3b20 0x7f0ab80d0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:08.583 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.575+0000 7f0abdbe1700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ab80b3b20 0x7f0ab80d0c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53956/0 (socket says 172.21.15.62:53956) 2023-06-09T04:42:08.583 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.575+0000 7f0abdbe1700 1 -- 172.21.15.62:0/2878316062 learned_addr learned my addr 172.21.15.62:0/2878316062 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:08.583 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.575+0000 7f0abe3e2700 1 --2- 172.21.15.62:0/2878316062 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ab80d1f80 0x7f0ab815e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:08.583 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.575+0000 7f0abd3e0700 1 --2- 172.21.15.62:0/2878316062 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0ab80cd2e0 0x7f0ab80ccce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:08.584 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.575+0000 7f0abdbe1700 1 -- 172.21.15.62:0/2878316062 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0ab80cd2e0 msgr2=0x7f0ab80ccce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:08.584 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.575+0000 7f0abdbe1700 1 --2- 172.21.15.62:0/2878316062 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0ab80cd2e0 0x7f0ab80ccce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:08.584 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.575+0000 7f0abdbe1700 1 -- 172.21.15.62:0/2878316062 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ab80d1f80 msgr2=0x7f0ab815e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:08.584 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.575+0000 7f0abdbe1700 1 --2- 172.21.15.62:0/2878316062 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ab80d1f80 0x7f0ab815e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:08.584 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.575+0000 7f0abdbe1700 1 -- 172.21.15.62:0/2878316062 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ab0009a70 con 0x7f0ab80b3b20 2023-06-09T04:42:08.585 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.575+0000 7f0abdbe1700 1 --2- 172.21.15.62:0/2878316062 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ab80b3b20 0x7f0ab80d0c30 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f0ab400c680 tx=0x7f0ab400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:08.585 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.579+0000 7f0aae7fc700 1 -- 172.21.15.62:0/2878316062 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab40074e0 con 0x7f0ab80b3b20 2023-06-09T04:42:08.585 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.579+0000 7f0aae7fc700 1 -- 172.21.15.62:0/2878316062 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ab4007660 con 0x7f0ab80b3b20 2023-06-09T04:42:08.585 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.579+0000 7f0aae7fc700 1 -- 172.21.15.62:0/2878316062 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab4005a90 con 0x7f0ab80b3b20 2023-06-09T04:42:08.586 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.579+0000 7f0abebe3700 1 -- 172.21.15.62:0/2878316062 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ab80b5cb0 con 0x7f0ab80b3b20 2023-06-09T04:42:08.586 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.579+0000 7f0abebe3700 1 -- 172.21.15.62:0/2878316062 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ab80d1810 con 0x7f0ab80b3b20 2023-06-09T04:42:08.586 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.579+0000 7f0abebe3700 1 -- 172.21.15.62:0/2878316062 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ab80739c0 con 0x7f0ab80b3b20 2023-06-09T04:42:08.587 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.583+0000 7f0aae7fc700 1 -- 172.21.15.62:0/2878316062 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0ab4005bf0 con 0x7f0ab80b3b20 2023-06-09T04:42:08.588 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.583+0000 7f0aae7fc700 1 --2- 172.21.15.62:0/2878316062 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f0a9c066320 0x7f0a9c0687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:08.589 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.583+0000 7f0aae7fc700 1 -- 172.21.15.62:0/2878316062 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0ab4083450 con 0x7f0ab80b3b20 2023-06-09T04:42:08.589 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.583+0000 7f0abd3e0700 1 --2- 172.21.15.62:0/2878316062 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f0a9c066320 0x7f0a9c0687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:08.590 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.583+0000 7f0abd3e0700 1 --2- 172.21.15.62:0/2878316062 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f0a9c066320 0x7f0a9c0687d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0ab815f500 tx=0x7f0aa8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:08.596 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.591+0000 7f0aae7fc700 1 -- 172.21.15.62:0/2878316062 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0ab4050590 con 0x7f0ab80b3b20 2023-06-09T04:42:08.770 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.763+0000 7f0abebe3700 1 -- 172.21.15.62:0/2878316062 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0ab80b61d0 con 0x7f0ab80b3b20 2023-06-09T04:42:08.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.767+0000 7f0aae7fc700 1 -- 172.21.15.62:0/2878316062 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0ab4053bb0 con 0x7f0ab80b3b20 2023-06-09T04:42:08.772 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 64 2023-06-09T04:42:08.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.767+0000 7f0abebe3700 1 -- 172.21.15.62:0/2878316062 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f0a9c066320 msgr2=0x7f0a9c0687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:08.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.767+0000 7f0abebe3700 1 --2- 172.21.15.62:0/2878316062 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f0a9c066320 0x7f0a9c0687d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0ab815f500 tx=0x7f0aa8009040 comp rx=0 tx=0).stop 2023-06-09T04:42:08.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.767+0000 7f0abebe3700 1 -- 172.21.15.62:0/2878316062 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ab80b3b20 msgr2=0x7f0ab80d0c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:08.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.767+0000 7f0abebe3700 1 --2- 172.21.15.62:0/2878316062 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ab80b3b20 0x7f0ab80d0c30 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f0ab400c680 tx=0x7f0ab400c990 comp rx=0 tx=0).stop 2023-06-09T04:42:08.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.767+0000 7f0abebe3700 1 -- 172.21.15.62:0/2878316062 shutdown_connections 2023-06-09T04:42:08.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.767+0000 7f0abebe3700 1 --2- 172.21.15.62:0/2878316062 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f0a9c066320 0x7f0a9c0687d0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:08.776 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.767+0000 7f0abebe3700 1 --2- 172.21.15.62:0/2878316062 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ab80d1f80 0x7f0ab815e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:08.776 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.767+0000 7f0abebe3700 1 --2- 172.21.15.62:0/2878316062 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0ab80cd2e0 0x7f0ab80ccce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:08.776 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.767+0000 7f0abebe3700 1 --2- 172.21.15.62:0/2878316062 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0ab80b3b20 0x7f0ab80d0c30 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:08.776 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.767+0000 7f0abebe3700 1 -- 172.21.15.62:0/2878316062 >> 172.21.15.62:0/2878316062 conn(0x7f0ab8071840 msgr2=0x7f0ab815a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:08.776 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.767+0000 7f0abebe3700 1 -- 172.21.15.62:0/2878316062 shutdown_connections 2023-06-09T04:42:08.776 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.767+0000 7f0abebe3700 1 -- 172.21.15.62:0/2878316062 wait complete. 2023-06-09T04:42:08.798 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-09T04:42:08.975 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.967+0000 7fdf65891700 1 Processor -- start 2023-06-09T04:42:08.975 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.971+0000 7fdf65891700 1 -- start start 2023-06-09T04:42:08.977 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.971+0000 7fdf65891700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdf60159e10 0x7fdf600b09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:08.978 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.971+0000 7fdf65891700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fdf6015e090 0x7fdf600b2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:08.978 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.971+0000 7fdf65891700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf600cda40 con 0x7fdf6015e500 2023-06-09T04:42:08.978 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.971+0000 7fdf65891700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf600cd830 con 0x7fdf6015e090 2023-06-09T04:42:08.978 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.971+0000 7fdf65891700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf600cdd20 con 0x7fdf60159e10 2023-06-09T04:42:08.979 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.971+0000 7fdf5e7fc700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fdf6015e090 0x7fdf600b2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:08.979 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.971+0000 7fdf5e7fc700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fdf6015e090 0x7fdf600b2ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53966/0 (socket says 172.21.15.62:53966) 2023-06-09T04:42:08.979 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.971+0000 7fdf5effd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdf60159e10 0x7fdf600b09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:08.979 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.971+0000 7fdf5e7fc700 1 -- 172.21.15.62:0/2597975515 learned_addr learned my addr 172.21.15.62:0/2597975515 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:08.980 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.975+0000 7fdf5e7fc700 1 -- 172.21.15.62:0/2597975515 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdf60159e10 msgr2=0x7fdf600b09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:08.980 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.975+0000 7fdf5e7fc700 1 --2- 172.21.15.62:0/2597975515 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdf60159e10 0x7fdf600b09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:08.980 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.975+0000 7fdf5e7fc700 1 -- 172.21.15.62:0/2597975515 >> v1:172.21.15.89:6789/0 conn(0x7fdf6015e500 legacy=0x7fdf600b2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:08.980 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.975+0000 7fdf5e7fc700 1 -- 172.21.15.62:0/2597975515 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf6015d890 con 0x7fdf6015e090 2023-06-09T04:42:08.980 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.975+0000 7fdf5dffb700 1 -- 172.21.15.62:0/2597975515 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2523365653 0 0) 0x7fdf600cda40 con 0x7fdf6015e500 2023-06-09T04:42:08.981 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.975+0000 7fdf5e7fc700 1 --2- 172.21.15.62:0/2597975515 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdf6015e090 0x7fdf600b2ab0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fdf54009910 tx=0x7fdf54009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=433d7918e4bdd626 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:08.981 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.975+0000 7fdf5dffb700 1 -- 172.21.15.62:0/2597975515 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf54011830 con 0x7fdf6015e090 2023-06-09T04:42:08.981 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.975+0000 7fdf5dffb700 1 -- 172.21.15.62:0/2597975515 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf54011990 con 0x7fdf6015e090 2023-06-09T04:42:08.981 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.975+0000 7fdf5dffb700 1 -- 172.21.15.62:0/2597975515 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf54011d40 con 0x7fdf6015e090 2023-06-09T04:42:08.982 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.975+0000 7fdf65891700 1 -- 172.21.15.62:0/2597975515 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdf6015e090 msgr2=0x7fdf600b2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:08.982 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.975+0000 7fdf65891700 1 --2- 172.21.15.62:0/2597975515 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdf6015e090 0x7fdf600b2ab0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fdf54009910 tx=0x7fdf54009c20 comp rx=0 tx=0).stop 2023-06-09T04:42:08.982 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.975+0000 7fdf65891700 1 -- 172.21.15.62:0/2597975515 shutdown_connections 2023-06-09T04:42:08.982 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.975+0000 7fdf65891700 1 --2- 172.21.15.62:0/2597975515 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdf6015e090 0x7fdf600b2ab0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:08.983 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.975+0000 7fdf65891700 1 --2- 172.21.15.62:0/2597975515 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdf60159e10 0x7fdf600b09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:08.983 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.975+0000 7fdf65891700 1 -- 172.21.15.62:0/2597975515 >> 172.21.15.62:0/2597975515 conn(0x7fdf6006c5d0 msgr2=0x7fdf600cad60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:08.983 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.975+0000 7fdf65891700 1 -- 172.21.15.62:0/2597975515 shutdown_connections 2023-06-09T04:42:08.983 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.975+0000 7fdf65891700 1 -- 172.21.15.62:0/2597975515 wait complete. 2023-06-09T04:42:08.985 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.979+0000 7fdf65891700 1 Processor -- start 2023-06-09T04:42:08.985 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.979+0000 7fdf65891700 1 -- start start 2023-06-09T04:42:08.987 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.983+0000 7fdf65891700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdf60159e10 0x7fdf6015cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:08.987 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.983+0000 7fdf65891700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdf6015e090 0x7fdf60157120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:08.988 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.983+0000 7fdf65891700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdf6015e500 0x7fdf600c3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:08.988 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.983+0000 7fdf65891700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf600c4b80 con 0x7fdf60159e10 2023-06-09T04:42:08.988 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.983+0000 7fdf65891700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf6015bf60 con 0x7fdf6015e090 2023-06-09T04:42:08.988 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.983+0000 7fdf65891700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf60157660 con 0x7fdf6015e500 2023-06-09T04:42:08.989 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.983+0000 7fdf5effd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdf60159e10 0x7fdf6015cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:08.989 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.983+0000 7fdf5effd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdf60159e10 0x7fdf6015cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53972/0 (socket says 172.21.15.62:53972) 2023-06-09T04:42:08.989 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.983+0000 7fdf5effd700 1 -- 172.21.15.62:0/3291556527 learned_addr learned my addr 172.21.15.62:0/3291556527 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:08.989 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.983+0000 7fdf5e7fc700 1 --2- 172.21.15.62:0/3291556527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdf6015e090 0x7fdf60157120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:08.990 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.983+0000 7fdf5f7fe700 1 --2- 172.21.15.62:0/3291556527 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdf6015e500 0x7fdf600c3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:08.990 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.983+0000 7fdf5effd700 1 -- 172.21.15.62:0/3291556527 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdf6015e500 msgr2=0x7fdf600c3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:08.990 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.983+0000 7fdf5effd700 1 --2- 172.21.15.62:0/3291556527 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdf6015e500 0x7fdf600c3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:08.990 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.983+0000 7fdf5effd700 1 -- 172.21.15.62:0/3291556527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdf6015e090 msgr2=0x7fdf60157120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:08.990 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.983+0000 7fdf5effd700 1 --2- 172.21.15.62:0/3291556527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdf6015e090 0x7fdf60157120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:08.990 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.983+0000 7fdf5effd700 1 -- 172.21.15.62:0/3291556527 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf54009570 con 0x7fdf60159e10 2023-06-09T04:42:08.990 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.983+0000 7fdf5e7fc700 1 --2- 172.21.15.62:0/3291556527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdf6015e090 0x7fdf60157120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:08.990 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.983+0000 7fdf5effd700 1 --2- 172.21.15.62:0/3291556527 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdf60159e10 0x7fdf6015cc90 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fdf5000efc0 tx=0x7fdf5000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:08.991 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.983+0000 7fdf47fff700 1 -- 172.21.15.62:0/3291556527 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf5000cdc0 con 0x7fdf60159e10 2023-06-09T04:42:08.991 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.983+0000 7fdf47fff700 1 -- 172.21.15.62:0/3291556527 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf5000f040 con 0x7fdf60159e10 2023-06-09T04:42:08.991 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.983+0000 7fdf47fff700 1 -- 172.21.15.62:0/3291556527 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf500146a0 con 0x7fdf60159e10 2023-06-09T04:42:08.991 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.983+0000 7fdf65891700 1 -- 172.21.15.62:0/3291556527 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf600c48a0 con 0x7fdf60159e10 2023-06-09T04:42:08.992 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.983+0000 7fdf65891700 1 -- 172.21.15.62:0/3291556527 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf6015c490 con 0x7fdf60159e10 2023-06-09T04:42:08.992 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.987+0000 7fdf65891700 1 -- 172.21.15.62:0/3291556527 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf600739c0 con 0x7fdf60159e10 2023-06-09T04:42:08.992 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.987+0000 7fdf47fff700 1 -- 172.21.15.62:0/3291556527 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fdf50014800 con 0x7fdf60159e10 2023-06-09T04:42:08.994 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.987+0000 7fdf47fff700 1 --2- 172.21.15.62:0/3291556527 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fdf4c0662f0 0x7fdf4c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:08.994 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.987+0000 7fdf47fff700 1 -- 172.21.15.62:0/3291556527 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fdf500849b0 con 0x7fdf60159e10 2023-06-09T04:42:08.994 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.987+0000 7fdf5e7fc700 1 --2- 172.21.15.62:0/3291556527 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fdf4c0662f0 0x7fdf4c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:08.996 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.991+0000 7fdf5e7fc700 1 --2- 172.21.15.62:0/3291556527 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fdf4c0662f0 0x7fdf4c0687a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fdf6006dc60 tx=0x7fdf54008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:09.001 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:08.995+0000 7fdf47fff700 1 -- 172.21.15.62:0/3291556527 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fdf50051af0 con 0x7fdf60159e10 2023-06-09T04:42:09.176 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.171+0000 7fdf65891700 1 -- 172.21.15.62:0/3291556527 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fdf600b34c0 con 0x7fdf60159e10 2023-06-09T04:42:09.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.171+0000 7fdf47fff700 1 -- 172.21.15.62:0/3291556527 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7fdf50055110 con 0x7fdf60159e10 2023-06-09T04:42:09.177 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-06-09T04:42:09.180 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.175+0000 7fdf65891700 1 -- 172.21.15.62:0/3291556527 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fdf4c0662f0 msgr2=0x7fdf4c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:09.180 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.175+0000 7fdf65891700 1 --2- 172.21.15.62:0/3291556527 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fdf4c0662f0 0x7fdf4c0687a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fdf6006dc60 tx=0x7fdf54008030 comp rx=0 tx=0).stop 2023-06-09T04:42:09.180 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.175+0000 7fdf65891700 1 -- 172.21.15.62:0/3291556527 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdf60159e10 msgr2=0x7fdf6015cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:09.180 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.175+0000 7fdf65891700 1 --2- 172.21.15.62:0/3291556527 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdf60159e10 0x7fdf6015cc90 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fdf5000efc0 tx=0x7fdf5000c3a0 comp rx=0 tx=0).stop 2023-06-09T04:42:09.181 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.175+0000 7fdf65891700 1 -- 172.21.15.62:0/3291556527 shutdown_connections 2023-06-09T04:42:09.181 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.175+0000 7fdf65891700 1 --2- 172.21.15.62:0/3291556527 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fdf4c0662f0 0x7fdf4c0687a0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:09.181 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.175+0000 7fdf65891700 1 --2- 172.21.15.62:0/3291556527 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fdf6015e500 0x7fdf600c3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:09.181 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.175+0000 7fdf65891700 1 --2- 172.21.15.62:0/3291556527 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdf6015e090 0x7fdf60157120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:09.181 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.175+0000 7fdf65891700 1 --2- 172.21.15.62:0/3291556527 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdf60159e10 0x7fdf6015cc90 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:09.181 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.175+0000 7fdf65891700 1 -- 172.21.15.62:0/3291556527 >> 172.21.15.62:0/3291556527 conn(0x7fdf6006c5d0 msgr2=0x7fdf600b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:09.182 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.175+0000 7fdf65891700 1 -- 172.21.15.62:0/3291556527 shutdown_connections 2023-06-09T04:42:09.182 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.175+0000 7fdf65891700 1 -- 172.21.15.62:0/3291556527 wait complete. 2023-06-09T04:42:09.203 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-09T04:42:09.378 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.371+0000 7f0c2d53a700 1 Processor -- start 2023-06-09T04:42:09.378 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.371+0000 7f0c2d53a700 1 -- start start 2023-06-09T04:42:09.381 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.375+0000 7f0c2d53a700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0c280ce970 0x7f0c280cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:09.382 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.375+0000 7f0c2d53a700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f0c280cd230 0x7f0c280b1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:09.382 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.375+0000 7f0c2d53a700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c280ce4e0 con 0x7f0c280d0270 2023-06-09T04:42:09.382 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.375+0000 7f0c2d53a700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c280cd6b0 con 0x7f0c280ce970 2023-06-09T04:42:09.382 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.375+0000 7f0c2d53a700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c280d25e0 con 0x7f0c280cd230 2023-06-09T04:42:09.382 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.375+0000 7f0c1ffff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0c280ce970 0x7f0c280cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:09.383 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.375+0000 7f0c1ffff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0c280ce970 0x7f0c280cccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53978/0 (socket says 172.21.15.62:53978) 2023-06-09T04:42:09.383 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.375+0000 7f0c1ffff700 1 -- 172.21.15.62:0/2105647148 learned_addr learned my addr 172.21.15.62:0/2105647148 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:09.383 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.375+0000 7f0c277fe700 1 --2- 172.21.15.62:0/2105647148 >> v2:172.21.15.89:3300/0 conn(0x7f0c280cd230 0x7f0c280b1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:09.383 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.375+0000 7f0c1ffff700 1 -- 172.21.15.62:0/2105647148 >> v2:172.21.15.89:3300/0 conn(0x7f0c280cd230 msgr2=0x7f0c280b1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:09.384 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.375+0000 7f0c1ffff700 1 --2- 172.21.15.62:0/2105647148 >> v2:172.21.15.89:3300/0 conn(0x7f0c280cd230 0x7f0c280b1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:09.384 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.375+0000 7f0c1ffff700 1 -- 172.21.15.62:0/2105647148 >> v1:172.21.15.62:6789/0 conn(0x7f0c280d0270 legacy=0x7f0c280d0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:09.384 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.375+0000 7f0c1ffff700 1 -- 172.21.15.62:0/2105647148 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c280cd8d0 con 0x7f0c280ce970 2023-06-09T04:42:09.384 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.375+0000 7f0c277fe700 1 --2- 172.21.15.62:0/2105647148 >> v2:172.21.15.89:3300/0 conn(0x7f0c280cd230 0x7f0c280b1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:09.385 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.379+0000 7f0c1ffff700 1 --2- 172.21.15.62:0/2105647148 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c280ce970 0x7f0c280cccf0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f0c280c9700 tx=0x7f0c10009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f088d6d38d9002c server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:09.385 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.379+0000 7f0c267fc700 1 -- 172.21.15.62:0/2105647148 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1000b8a0 con 0x7f0c280ce970 2023-06-09T04:42:09.385 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.379+0000 7f0c267fc700 1 -- 172.21.15.62:0/2105647148 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c1000ba00 con 0x7f0c280ce970 2023-06-09T04:42:09.385 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.379+0000 7f0c267fc700 1 -- 172.21.15.62:0/2105647148 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c1000bd90 con 0x7f0c280ce970 2023-06-09T04:42:09.385 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.379+0000 7f0c2d53a700 1 -- 172.21.15.62:0/2105647148 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c280ce970 msgr2=0x7f0c280cccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:09.385 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.379+0000 7f0c2d53a700 1 --2- 172.21.15.62:0/2105647148 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c280ce970 0x7f0c280cccf0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f0c280c9700 tx=0x7f0c10009bf0 comp rx=0 tx=0).stop 2023-06-09T04:42:09.386 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.379+0000 7f0c2d53a700 1 -- 172.21.15.62:0/2105647148 shutdown_connections 2023-06-09T04:42:09.386 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.379+0000 7f0c2d53a700 1 --2- 172.21.15.62:0/2105647148 >> v2:172.21.15.89:3300/0 conn(0x7f0c280cd230 0x7f0c280b1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:09.386 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.379+0000 7f0c2d53a700 1 --2- 172.21.15.62:0/2105647148 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c280ce970 0x7f0c280cccf0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:09.386 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.379+0000 7f0c2d53a700 1 -- 172.21.15.62:0/2105647148 >> 172.21.15.62:0/2105647148 conn(0x7f0c28071840 msgr2=0x7f0c2809b970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:09.386 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.379+0000 7f0c2d53a700 1 -- 172.21.15.62:0/2105647148 shutdown_connections 2023-06-09T04:42:09.387 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.379+0000 7f0c2d53a700 1 -- 172.21.15.62:0/2105647148 wait complete. 2023-06-09T04:42:09.387 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.383+0000 7f0c2d53a700 1 Processor -- start 2023-06-09T04:42:09.388 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.383+0000 7f0c2d53a700 1 -- start start 2023-06-09T04:42:09.389 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.383+0000 7f0c2d53a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c280cd230 0x7f0c28157b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:09.389 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.383+0000 7f0c2d53a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c280ce970 0x7f0c280b7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:09.389 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.383+0000 7f0c2d53a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c280d0270 0x7f0c280c9770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:09.389 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.383+0000 7f0c2d53a700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c280b6c70 con 0x7f0c280cd230 2023-06-09T04:42:09.389 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.383+0000 7f0c2d53a700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c280b6f10 con 0x7f0c280ce970 2023-06-09T04:42:09.389 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.383+0000 7f0c2d53a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c280b71f0 con 0x7f0c280d0270 2023-06-09T04:42:09.390 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.383+0000 7f0c26ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c280cd230 0x7f0c28157b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:09.391 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.383+0000 7f0c26ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c280cd230 0x7f0c28157b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53990/0 (socket says 172.21.15.62:53990) 2023-06-09T04:42:09.391 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.383+0000 7f0c26ffd700 1 -- 172.21.15.62:0/247214677 learned_addr learned my addr 172.21.15.62:0/247214677 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:09.391 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.383+0000 7f0c277fe700 1 --2- 172.21.15.62:0/247214677 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c280d0270 0x7f0c280c9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:09.391 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.383+0000 7f0c1ffff700 1 --2- 172.21.15.62:0/247214677 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c280ce970 0x7f0c280b7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:09.391 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.383+0000 7f0c26ffd700 1 -- 172.21.15.62:0/247214677 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c280d0270 msgr2=0x7f0c280c9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:09.392 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.383+0000 7f0c26ffd700 1 --2- 172.21.15.62:0/247214677 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c280d0270 0x7f0c280c9770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:09.392 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.383+0000 7f0c26ffd700 1 -- 172.21.15.62:0/247214677 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c280ce970 msgr2=0x7f0c280b7cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:09.392 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.383+0000 7f0c26ffd700 1 --2- 172.21.15.62:0/247214677 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c280ce970 0x7f0c280b7cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:09.392 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.383+0000 7f0c26ffd700 1 -- 172.21.15.62:0/247214677 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c10009570 con 0x7f0c280cd230 2023-06-09T04:42:09.392 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.383+0000 7f0c1ffff700 1 --2- 172.21.15.62:0/247214677 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c280ce970 0x7f0c280b7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:42:09.392 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.383+0000 7f0c26ffd700 1 --2- 172.21.15.62:0/247214677 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c280cd230 0x7f0c28157b00 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f0c18001eb0 tx=0x7f0c1800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:09.392 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.383+0000 7f0c1f7fe700 1 -- 172.21.15.62:0/247214677 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c180054e0 con 0x7f0c280cd230 2023-06-09T04:42:09.392 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.383+0000 7f0c1f7fe700 1 -- 172.21.15.62:0/247214677 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c180036a0 con 0x7f0c280cd230 2023-06-09T04:42:09.393 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.383+0000 7f0c2d53a700 1 -- 172.21.15.62:0/247214677 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c280b74d0 con 0x7f0c280cd230 2023-06-09T04:42:09.393 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.383+0000 7f0c1f7fe700 1 -- 172.21.15.62:0/247214677 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c18003a30 con 0x7f0c280cd230 2023-06-09T04:42:09.393 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.383+0000 7f0c2d53a700 1 -- 172.21.15.62:0/247214677 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c28158040 con 0x7f0c280cd230 2023-06-09T04:42:09.393 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.387+0000 7f0c2d53a700 1 -- 172.21.15.62:0/247214677 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c281581d0 con 0x7f0c280cd230 2023-06-09T04:42:09.393 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.387+0000 7f0c1f7fe700 1 -- 172.21.15.62:0/247214677 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0c18003b90 con 0x7f0c280cd230 2023-06-09T04:42:09.395 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.387+0000 7f0c1f7fe700 1 --2- 172.21.15.62:0/247214677 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f0c08066320 0x7f0c080687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:09.395 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.391+0000 7f0c1f7fe700 1 -- 172.21.15.62:0/247214677 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0c18083110 con 0x7f0c280cd230 2023-06-09T04:42:09.395 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.391+0000 7f0c1ffff700 1 --2- 172.21.15.62:0/247214677 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f0c08066320 0x7f0c080687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:09.397 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.391+0000 7f0c1ffff700 1 --2- 172.21.15.62:0/247214677 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f0c08066320 0x7f0c080687d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0c280d17d0 tx=0x7f0c10008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:09.403 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.399+0000 7f0c1f7fe700 1 -- 172.21.15.62:0/247214677 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0c180501d0 con 0x7f0c280cd230 2023-06-09T04:42:09.591 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.587+0000 7f0c2d53a700 1 -- 172.21.15.62:0/247214677 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f0c2804db30 con 0x7f0c280cd230 2023-06-09T04:42:09.592 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.587+0000 7f0c1f7fe700 1 -- 172.21.15.62:0/247214677 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v30) v1 ==== 80+0+0 (secure 0 0 0) 0x7f0c180537f0 con 0x7f0c280cd230 2023-06-09T04:42:09.596 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.591+0000 7f0c2d53a700 1 -- 172.21.15.62:0/247214677 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f0c08066320 msgr2=0x7f0c080687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:09.596 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.591+0000 7f0c2d53a700 1 --2- 172.21.15.62:0/247214677 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f0c08066320 0x7f0c080687d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f0c280d17d0 tx=0x7f0c10008030 comp rx=0 tx=0).stop 2023-06-09T04:42:09.597 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.591+0000 7f0c2d53a700 1 -- 172.21.15.62:0/247214677 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c280cd230 msgr2=0x7f0c28157b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:09.597 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.591+0000 7f0c2d53a700 1 --2- 172.21.15.62:0/247214677 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c280cd230 0x7f0c28157b00 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f0c18001eb0 tx=0x7f0c1800c860 comp rx=0 tx=0).stop 2023-06-09T04:42:09.597 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.591+0000 7f0c2d53a700 1 -- 172.21.15.62:0/247214677 shutdown_connections 2023-06-09T04:42:09.598 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.591+0000 7f0c2d53a700 1 --2- 172.21.15.62:0/247214677 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f0c08066320 0x7f0c080687d0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:09.598 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.591+0000 7f0c2d53a700 1 --2- 172.21.15.62:0/247214677 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c280d0270 0x7f0c280c9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:09.598 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.591+0000 7f0c2d53a700 1 --2- 172.21.15.62:0/247214677 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c280ce970 0x7f0c280b7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:09.598 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.591+0000 7f0c2d53a700 1 --2- 172.21.15.62:0/247214677 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c280cd230 0x7f0c28157b00 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:09.598 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.591+0000 7f0c2d53a700 1 -- 172.21.15.62:0/247214677 >> 172.21.15.62:0/247214677 conn(0x7f0c28071840 msgr2=0x7f0c2806be20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:09.598 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.591+0000 7f0c2d53a700 1 -- 172.21.15.62:0/247214677 shutdown_connections 2023-06-09T04:42:09.598 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:09.591+0000 7f0c2d53a700 1 -- 172.21.15.62:0/247214677 wait complete. 2023-06-09T04:42:09.600 INFO:teuthology.orchestra.run.smithi062.stderr:listed 0 entries 2023-06-09T04:42:09.620 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-06-09T04:42:09.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:09.621 DEBUG:teuthology.orchestra.run.smithi062:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-06-09T04:42:09.683 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi062.front.sepia.ceph.com 2023-06-09T04:42:09.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:09.684 DEBUG:teuthology.orchestra.run.smithi062:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-06-09T04:42:09.701 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-06-09T04:42:09.701 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:42:09.720 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-06-09T04:42:09.720 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:42:09.777 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-06-09T04:42:09.778 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:42:09.838 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:42:10.013 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.007+0000 7f0c6d74d700 1 Processor -- start 2023-06-09T04:42:10.013 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.007+0000 7f0c6d74d700 1 -- start start 2023-06-09T04:42:10.014 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.007+0000 7f0c6d74d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0c68159c90 0x7f0c68070e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:10.015 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.011+0000 7f0c6d74d700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c6806f9b0 con 0x7f0c680b08d0 2023-06-09T04:42:10.015 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.011+0000 7f0c6d74d700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c6815a060 con 0x7f0c680cb850 2023-06-09T04:42:10.015 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.011+0000 7f0c6d74d700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c6806b960 con 0x7f0c68159c90 2023-06-09T04:42:10.016 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.011+0000 7f0c66ffd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0c68159c90 0x7f0c68070e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:10.016 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.011+0000 7f0c677fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f0c680b08d0 0x7f0c680ca870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:33054/0 (socket says 172.21.15.62:33054) 2023-06-09T04:42:10.016 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.011+0000 7f0c66ffd700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0c68159c90 0x7f0c68070e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:53992/0 (socket says 172.21.15.62:53992) 2023-06-09T04:42:10.016 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.011+0000 7f0c677fe700 1 -- 172.21.15.62:0/81300883 learned_addr learned my addr 172.21.15.62:0/81300883 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:42:10.017 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.011+0000 7f0c66ffd700 1 -- 172.21.15.62:0/81300883 >> v1:172.21.15.89:6789/0 conn(0x7f0c680cb850 legacy=0x7f0c680ca160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:10.017 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.011+0000 7f0c66ffd700 1 -- 172.21.15.62:0/81300883 >> v1:172.21.15.62:6789/0 conn(0x7f0c680b08d0 legacy=0x7f0c680ca870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:10.017 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.011+0000 7f0c66ffd700 1 -- 172.21.15.62:0/81300883 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c680c89e0 con 0x7f0c68159c90 2023-06-09T04:42:10.017 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.011+0000 7f0c65ffb700 1 -- 172.21.15.62:0/81300883 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 846791690 0 0) 0x7f0c6806f9b0 con 0x7f0c680b08d0 2023-06-09T04:42:10.018 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.011+0000 7f0c66ffd700 1 --2- 172.21.15.62:0/81300883 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c68159c90 0x7f0c68070e00 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f0c58009850 tx=0x7f0c58009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=392ed595fed63d50 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:10.018 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.011+0000 7f0c65ffb700 1 -- 172.21.15.62:0/81300883 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c58011830 con 0x7f0c68159c90 2023-06-09T04:42:10.018 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.011+0000 7f0c65ffb700 1 -- 172.21.15.62:0/81300883 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c58011990 con 0x7f0c68159c90 2023-06-09T04:42:10.018 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.011+0000 7f0c65ffb700 1 -- 172.21.15.62:0/81300883 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c58011d20 con 0x7f0c68159c90 2023-06-09T04:42:10.019 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.011+0000 7f0c6d74d700 1 -- 172.21.15.62:0/81300883 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c68159c90 msgr2=0x7f0c68070e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:10.019 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.011+0000 7f0c6d74d700 1 --2- 172.21.15.62:0/81300883 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c68159c90 0x7f0c68070e00 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f0c58009850 tx=0x7f0c58009b60 comp rx=0 tx=0).stop 2023-06-09T04:42:10.019 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.011+0000 7f0c6d74d700 1 -- 172.21.15.62:0/81300883 shutdown_connections 2023-06-09T04:42:10.019 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.011+0000 7f0c6d74d700 1 --2- 172.21.15.62:0/81300883 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c68159c90 0x7f0c68070e00 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:10.019 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.011+0000 7f0c6d74d700 1 -- 172.21.15.62:0/81300883 >> 172.21.15.62:0/81300883 conn(0x7f0c6806a410 msgr2=0x7f0c680afd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:10.019 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.011+0000 7f0c6d74d700 1 -- 172.21.15.62:0/81300883 shutdown_connections 2023-06-09T04:42:10.019 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.011+0000 7f0c6d74d700 1 -- 172.21.15.62:0/81300883 wait complete. 2023-06-09T04:42:10.021 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.015+0000 7f0c6d74d700 1 Processor -- start 2023-06-09T04:42:10.021 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.015+0000 7f0c6d74d700 1 -- start start 2023-06-09T04:42:10.022 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.015+0000 7f0c6d74d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c680b08d0 0x7f0c680ae9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:10.023 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.015+0000 7f0c6d74d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c680cb850 0x7f0c680c6660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:10.023 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.015+0000 7f0c6d74d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c68159c90 0x7f0c680c6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:10.023 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.015+0000 7f0c6d74d700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c680c6450 con 0x7f0c68159c90 2023-06-09T04:42:10.023 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.015+0000 7f0c6d74d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c680c53f0 con 0x7f0c680cb850 2023-06-09T04:42:10.023 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.015+0000 7f0c6d74d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c680c5690 con 0x7f0c680b08d0 2023-06-09T04:42:10.024 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.019+0000 7f0c677fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c68159c90 0x7f0c680c6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:10.024 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.019+0000 7f0c677fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c68159c90 0x7f0c680c6ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54000/0 (socket says 172.21.15.62:54000) 2023-06-09T04:42:10.024 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.019+0000 7f0c677fe700 1 -- 172.21.15.62:0/86274848 learned_addr learned my addr 172.21.15.62:0/86274848 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:10.025 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.019+0000 7f0c66ffd700 1 --2- 172.21.15.62:0/86274848 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c680b08d0 0x7f0c680ae9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:10.025 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.019+0000 7f0c667fc700 1 --2- 172.21.15.62:0/86274848 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c680cb850 0x7f0c680c6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:10.025 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.019+0000 7f0c677fe700 1 -- 172.21.15.62:0/86274848 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c680b08d0 msgr2=0x7f0c680ae9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:10.025 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.019+0000 7f0c677fe700 1 --2- 172.21.15.62:0/86274848 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c680b08d0 0x7f0c680ae9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:10.025 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.019+0000 7f0c677fe700 1 -- 172.21.15.62:0/86274848 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c680cb850 msgr2=0x7f0c680c6660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:10.025 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.019+0000 7f0c677fe700 1 --2- 172.21.15.62:0/86274848 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c680cb850 0x7f0c680c6660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:10.025 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.019+0000 7f0c677fe700 1 -- 172.21.15.62:0/86274848 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c580094b0 con 0x7f0c68159c90 2023-06-09T04:42:10.026 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.019+0000 7f0c667fc700 1 --2- 172.21.15.62:0/86274848 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c680cb850 0x7f0c680c6660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:10.026 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.019+0000 7f0c677fe700 1 --2- 172.21.15.62:0/86274848 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c68159c90 0x7f0c680c6ba0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f0c60002230 tx=0x7f0c6000cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:10.026 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.019+0000 7f0c4f7fe700 1 -- 172.21.15.62:0/86274848 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6000ab70 con 0x7f0c68159c90 2023-06-09T04:42:10.026 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.019+0000 7f0c4f7fe700 1 -- 172.21.15.62:0/86274848 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c6000acf0 con 0x7f0c68159c90 2023-06-09T04:42:10.027 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.019+0000 7f0c6d74d700 1 -- 172.21.15.62:0/86274848 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c680c5970 con 0x7f0c68159c90 2023-06-09T04:42:10.027 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.019+0000 7f0c4f7fe700 1 -- 172.21.15.62:0/86274848 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c60007310 con 0x7f0c68159c90 2023-06-09T04:42:10.027 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.019+0000 7f0c6d74d700 1 -- 172.21.15.62:0/86274848 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c680c5f30 con 0x7f0c68159c90 2023-06-09T04:42:10.027 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.019+0000 7f0c6d74d700 1 -- 172.21.15.62:0/86274848 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c680c6150 con 0x7f0c68159c90 2023-06-09T04:42:10.029 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.023+0000 7f0c4f7fe700 1 -- 172.21.15.62:0/86274848 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0c60007470 con 0x7f0c68159c90 2023-06-09T04:42:10.030 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.023+0000 7f0c4f7fe700 1 --2- 172.21.15.62:0/86274848 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f0c540662f0 0x7f0c540687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:10.030 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.023+0000 7f0c4f7fe700 1 -- 172.21.15.62:0/86274848 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0c60083ab0 con 0x7f0c68159c90 2023-06-09T04:42:10.030 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.023+0000 7f0c66ffd700 1 --2- 172.21.15.62:0/86274848 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f0c540662f0 0x7f0c540687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:10.032 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.027+0000 7f0c66ffd700 1 --2- 172.21.15.62:0/86274848 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f0c540662f0 0x7f0c540687a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0c580090b0 tx=0x7f0c5801c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:10.038 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.031+0000 7f0c4f7fe700 1 -- 172.21.15.62:0/86274848 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0c60050bf0 con 0x7f0c68159c90 2023-06-09T04:42:10.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.203+0000 7f0c6d74d700 1 -- 172.21.15.62:0/86274848 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0c6804db30 con 0x7f0c68159c90 2023-06-09T04:42:10.214 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.207+0000 7f0c4f7fe700 1 -- 172.21.15.62:0/86274848 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+20180 (secure 0 0 0) 0x7f0c6000ae60 con 0x7f0c68159c90 2023-06-09T04:42:10.214 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:42:10.215 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":30,"fsid":"f7998a1e-e5a9-4202-abaa-70c0eaae1047","created":"2023-06-09T04:40:30.469588+0000","modified":"2023-06-09T04:41:38.495589+0000","last_up_change":"2023-06-09T04:40:43.120747+0000","last_in_change":"2023-06-09T04:40:33.568221+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:40:44.646921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:40:50.006643+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:40:55.031273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:40:55.773517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-09T04:40:58.845383+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bc50bbc0-dd08-42ed-804c-ec3029e36c19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6802","nonce":1295788017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6807","nonce":1295788017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6815","nonce":1295788017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6809","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6811","nonce":1295788017}]},"public_addr":"172.21.15.62:6802/1295788017","cluster_addr":"172.21.15.62:6807/1295788017","heartbeat_back_addr":"172.21.15.62:6815/1295788017","heartbeat_front_addr":"172.21.15.62:6811/1295788017","state":["exists","up"]},{"osd":1,"uuid":"8230b12d-e22f-4985-a584-4cc64404cdbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6825","nonce":4120692006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6827","nonce":4120692006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6831","nonce":4120692006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6829","nonce":4120692006}]},"public_addr":"172.21.15.62:6825/4120692006","cluster_addr":"172.21.15.62:6827/4120692006","heartbeat_back_addr":"172.21.15.62:6831/4120692006","heartbeat_front_addr":"172.21.15.62:6829/4120692006","state":["exists","up"]},{"osd":2,"uuid":"d0202506-dbe9-4e3c-9271-687929abf96a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6801","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6803","nonce":4169607876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6805","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6806","nonce":4169607876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6814","nonce":4169607876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6810","nonce":4169607876}]},"public_addr":"172.21.15.62:6803/4169607876","cluster_addr":"172.21.15.62:6806/4169607876","heartbeat_back_addr":"172.21.15.62:6814/4169607876","heartbeat_front_addr":"172.21.15.62:6810/4169607876","state":["exists","up"]},{"osd":3,"uuid":"f3c0298a-b075-4411-af50-e16cd74fdddb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6817","nonce":3268438986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6819","nonce":3268438986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6823","nonce":3268438986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6821","nonce":3268438986}]},"public_addr":"172.21.15.62:6817/3268438986","cluster_addr":"172.21.15.62:6819/3268438986","heartbeat_back_addr":"172.21.15.62:6823/3268438986","heartbeat_front_addr":"172.21.15.62:6821/3268438986","state":["exists","up"]},{"osd":4,"uuid":"1ab5c5ca-e74f-475a-a309-683cc0029928","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6817","nonce":3139617628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6819","nonce":3139617628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6823","nonce":3139617628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6821","nonce":3139617628}]},"public_addr":"172.21.15.89:6817/3139617628","cluster_addr":"172.21.15.89:6819/3139617628","heartbeat_back_addr":"172.21.15.89:6823/3139617628","heartbeat_front_addr":"172.21.15.89:6821/3139617628","state":["exists","up"]},{"osd":5,"uuid":"a933e184-bd8f-4369-a1ba-a68de53c578c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6825","nonce":2681723596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6827","nonce":2681723596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6831","nonce":2681723596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6829","nonce":2681723596}]},"public_addr":"172.21.15.89:6825/2681723596","cluster_addr":"172.21.15.89:6827/2681723596","heartbeat_back_addr":"172.21.15.89:6831/2681723596","heartbeat_front_addr":"172.21.15.89:6829/2681723596","state":["exists","up"]},{"osd":6,"uuid":"1ed7ad37-2eee-49a6-954c-b537e2b7f0ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6809","nonce":1657136033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6811","nonce":1657136033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6815","nonce":1657136033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6813","nonce":1657136033}]},"public_addr":"172.21.15.89:6809/1657136033","cluster_addr":"172.21.15.89:6811/1657136033","heartbeat_back_addr":"172.21.15.89:6815/1657136033","heartbeat_front_addr":"172.21.15.89:6813/1657136033","state":["exists","up"]},{"osd":7,"uuid":"6ed732e9-33ff-40df-9038-a9f1d1622671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6801","nonce":1710561686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6803","nonce":1710561686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6807","nonce":1710561686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6805","nonce":1710561686}]},"public_addr":"172.21.15.89:6801/1710561686","cluster_addr":"172.21.15.89:6803/1710561686","heartbeat_back_addr":"172.21.15.89:6807/1710561686","heartbeat_front_addr":"172.21.15.89:6805/1710561686","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.335803+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.419788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.179334+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.263310+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.071846+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.375627+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.282277+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.315997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.12","mappings":[{"from":1,"to":2}]},{"pgid":"4.19","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:42:10.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.211+0000 7f0c6d74d700 1 -- 172.21.15.62:0/86274848 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f0c540662f0 msgr2=0x7f0c540687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:10.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.211+0000 7f0c6d74d700 1 --2- 172.21.15.62:0/86274848 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f0c540662f0 0x7f0c540687a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0c580090b0 tx=0x7f0c5801c040 comp rx=0 tx=0).stop 2023-06-09T04:42:10.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.211+0000 7f0c6d74d700 1 -- 172.21.15.62:0/86274848 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c68159c90 msgr2=0x7f0c680c6ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:10.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.211+0000 7f0c6d74d700 1 --2- 172.21.15.62:0/86274848 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c68159c90 0x7f0c680c6ba0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f0c60002230 tx=0x7f0c6000cf50 comp rx=0 tx=0).stop 2023-06-09T04:42:10.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.211+0000 7f0c6d74d700 1 -- 172.21.15.62:0/86274848 shutdown_connections 2023-06-09T04:42:10.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.211+0000 7f0c6d74d700 1 --2- 172.21.15.62:0/86274848 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f0c540662f0 0x7f0c540687a0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:10.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.211+0000 7f0c6d74d700 1 --2- 172.21.15.62:0/86274848 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c68159c90 0x7f0c680c6ba0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:10.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.211+0000 7f0c6d74d700 1 --2- 172.21.15.62:0/86274848 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c680cb850 0x7f0c680c6660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:10.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.211+0000 7f0c6d74d700 1 --2- 172.21.15.62:0/86274848 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0c680b08d0 0x7f0c680ae9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:10.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.211+0000 7f0c6d74d700 1 -- 172.21.15.62:0/86274848 >> 172.21.15.62:0/86274848 conn(0x7f0c6806a410 msgr2=0x7f0c68157820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:10.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.211+0000 7f0c6d74d700 1 -- 172.21.15.62:0/86274848 shutdown_connections 2023-06-09T04:42:10.219 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.211+0000 7f0c6d74d700 1 -- 172.21.15.62:0/86274848 wait complete. 2023-06-09T04:42:10.238 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:40:44.646921+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:40:50.006643+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T04:40:55.031273+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T04:40:55.773517+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-09T04:40:58.845383+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-09T04:42:10.239 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:42:10.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.419+0000 7f741bfff700 1 Processor -- start 2023-06-09T04:42:10.424 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.419+0000 7f741bfff700 1 -- start start 2023-06-09T04:42:10.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.423+0000 7f741bfff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f741c160360 0x7f741c0ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:10.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.423+0000 7f741bfff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f741c0c8800 0x7f741c06d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:10.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.423+0000 7f741bfff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f741c0afb50 0x7f741c0affd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:10.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.423+0000 7f741bfff700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f741c0b0510 con 0x7f741c0afb50 2023-06-09T04:42:10.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.423+0000 7f741bfff700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f741c160730 con 0x7f741c160360 2023-06-09T04:42:10.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.423+0000 7f741bfff700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f741c0ca860 con 0x7f741c0c8800 2023-06-09T04:42:10.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.423+0000 7f741b7fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f741c0afb50 0x7f741c0affd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:10.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.423+0000 7f741affd700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f741c160360 0x7f741c0ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:10.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.423+0000 7f741a7fc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f741c0c8800 0x7f741c06d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:10.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.423+0000 7f741a7fc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f741c0c8800 0x7f741c06d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.62:44992/0 (socket says 172.21.15.62:44992) 2023-06-09T04:42:10.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.423+0000 7f741a7fc700 1 -- 172.21.15.62:0/3771410205 learned_addr learned my addr 172.21.15.62:0/3771410205 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:10.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.423+0000 7f741affd700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f741c160360 0x7f741c0ccb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.62:54960/0 (socket says 172.21.15.62:54960) 2023-06-09T04:42:10.430 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.423+0000 7f741b7fe700 1 -- 172.21.15.62:0/3771410205 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f741c0c8800 msgr2=0x7f741c06d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:10.430 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.423+0000 7f741b7fe700 1 --2- 172.21.15.62:0/3771410205 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f741c0c8800 0x7f741c06d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:10.430 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.423+0000 7f741b7fe700 1 -- 172.21.15.62:0/3771410205 >> v2:172.21.15.89:3300/0 conn(0x7f741c160360 msgr2=0x7f741c0ccb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:10.431 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.423+0000 7f741b7fe700 1 --2- 172.21.15.62:0/3771410205 >> v2:172.21.15.89:3300/0 conn(0x7f741c160360 0x7f741c0ccb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:10.431 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.423+0000 7f741b7fe700 1 -- 172.21.15.62:0/3771410205 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f741c0ca580 con 0x7f741c0afb50 2023-06-09T04:42:10.431 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.423+0000 7f741b7fe700 1 --2- 172.21.15.62:0/3771410205 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f741c0afb50 0x7f741c0affd0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f741c0caab0 tx=0x7f741400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b5877d36ce49dcf server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:10.431 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.423+0000 7f7419ffb700 1 -- 172.21.15.62:0/3771410205 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f741400e070 con 0x7f741c0afb50 2023-06-09T04:42:10.431 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.423+0000 7f7419ffb700 1 -- 172.21.15.62:0/3771410205 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f741400bb20 con 0x7f741c0afb50 2023-06-09T04:42:10.431 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.423+0000 7f7419ffb700 1 -- 172.21.15.62:0/3771410205 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7414012430 con 0x7f741c0afb50 2023-06-09T04:42:10.432 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.423+0000 7f741bfff700 1 -- 172.21.15.62:0/3771410205 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f741c0afb50 msgr2=0x7f741c0affd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:10.432 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.423+0000 7f741bfff700 1 --2- 172.21.15.62:0/3771410205 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f741c0afb50 0x7f741c0affd0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f741c0caab0 tx=0x7f741400b330 comp rx=0 tx=0).stop 2023-06-09T04:42:10.432 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.427+0000 7f741bfff700 1 -- 172.21.15.62:0/3771410205 shutdown_connections 2023-06-09T04:42:10.432 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.427+0000 7f741bfff700 1 --2- 172.21.15.62:0/3771410205 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f741c0afb50 0x7f741c0affd0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:10.432 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.427+0000 7f741bfff700 1 --2- 172.21.15.62:0/3771410205 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f741c0c8800 0x7f741c06d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:10.433 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.427+0000 7f741bfff700 1 --2- 172.21.15.62:0/3771410205 >> v2:172.21.15.89:3300/0 conn(0x7f741c160360 0x7f741c0ccb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:10.433 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.427+0000 7f741bfff700 1 -- 172.21.15.62:0/3771410205 >> 172.21.15.62:0/3771410205 conn(0x7f741c0cab50 msgr2=0x7f741c0caf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:10.433 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.427+0000 7f741bfff700 1 -- 172.21.15.62:0/3771410205 shutdown_connections 2023-06-09T04:42:10.433 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.427+0000 7f741bfff700 1 -- 172.21.15.62:0/3771410205 wait complete. 2023-06-09T04:42:10.433 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.427+0000 7f741bfff700 1 Processor -- start 2023-06-09T04:42:10.434 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.427+0000 7f741bfff700 1 -- start start 2023-06-09T04:42:10.435 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.427+0000 7f741bfff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f741c0afb50 0x7f741c0c7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:10.435 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.427+0000 7f741bfff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f741c0c8800 0x7f741c0b2050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:10.435 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.427+0000 7f741bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f741c160360 0x7f741c154d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:10.436 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.427+0000 7f741bfff700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f741c155720 con 0x7f741c160360 2023-06-09T04:42:10.436 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.427+0000 7f741bfff700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f741c0c6ce0 con 0x7f741c0c8800 2023-06-09T04:42:10.436 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.427+0000 7f741bfff700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f741c0c6fc0 con 0x7f741c0afb50 2023-06-09T04:42:10.436 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.431+0000 7f741b7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f741c160360 0x7f741c154d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:10.436 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.431+0000 7f741b7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f741c160360 0x7f741c154d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:54014/0 (socket says 172.21.15.62:54014) 2023-06-09T04:42:10.436 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.431+0000 7f741b7fe700 1 -- 172.21.15.62:0/1647125911 learned_addr learned my addr 172.21.15.62:0/1647125911 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:10.437 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.431+0000 7f741affd700 1 --2- 172.21.15.62:0/1647125911 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f741c0afb50 0x7f741c0c7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:10.437 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.431+0000 7f741a7fc700 1 --2- 172.21.15.62:0/1647125911 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f741c0c8800 0x7f741c0b2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:10.437 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.431+0000 7f741b7fe700 1 -- 172.21.15.62:0/1647125911 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f741c0afb50 msgr2=0x7f741c0c7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:10.438 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.431+0000 7f741b7fe700 1 --2- 172.21.15.62:0/1647125911 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f741c0afb50 0x7f741c0c7aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:10.438 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.431+0000 7f741b7fe700 1 -- 172.21.15.62:0/1647125911 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f741c0c8800 msgr2=0x7f741c0b2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:10.438 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.431+0000 7f741b7fe700 1 --2- 172.21.15.62:0/1647125911 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f741c0c8800 0x7f741c0b2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:10.438 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.431+0000 7f741b7fe700 1 -- 172.21.15.62:0/1647125911 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7414009a70 con 0x7f741c160360 2023-06-09T04:42:10.438 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.431+0000 7f741b7fe700 1 --2- 172.21.15.62:0/1647125911 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f741c160360 0x7f741c154d40 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f7414014040 tx=0x7f7414004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:10.438 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.431+0000 7f74037fe700 1 -- 172.21.15.62:0/1647125911 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74140048b0 con 0x7f741c160360 2023-06-09T04:42:10.438 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.431+0000 7f74037fe700 1 -- 172.21.15.62:0/1647125911 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7414020070 con 0x7f741c160360 2023-06-09T04:42:10.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.431+0000 7f741bfff700 1 -- 172.21.15.62:0/1647125911 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f741c0c72a0 con 0x7f741c160360 2023-06-09T04:42:10.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.431+0000 7f74037fe700 1 -- 172.21.15.62:0/1647125911 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74140276c0 con 0x7f741c160360 2023-06-09T04:42:10.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.431+0000 7f741bfff700 1 -- 172.21.15.62:0/1647125911 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f741c0c7fe0 con 0x7f741c160360 2023-06-09T04:42:10.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.431+0000 7f741bfff700 1 -- 172.21.15.62:0/1647125911 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f741c0c77c0 con 0x7f741c160360 2023-06-09T04:42:10.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.435+0000 7f74037fe700 1 -- 172.21.15.62:0/1647125911 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7414012430 con 0x7f741c160360 2023-06-09T04:42:10.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.435+0000 7f74037fe700 1 --2- 172.21.15.62:0/1647125911 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f74080662f0 0x7f74080687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:10.442 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.435+0000 7f74037fe700 1 -- 172.21.15.62:0/1647125911 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7414022070 con 0x7f741c160360 2023-06-09T04:42:10.442 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.435+0000 7f741affd700 1 --2- 172.21.15.62:0/1647125911 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f74080662f0 0x7f74080687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:10.443 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.439+0000 7f741affd700 1 --2- 172.21.15.62:0/1647125911 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f74080662f0 0x7f74080687a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f740c009bf0 tx=0x7f740c009240 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:10.448 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.443+0000 7f74037fe700 1 -- 172.21.15.62:0/1647125911 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f741c0c77c0 con 0x7f741c160360 2023-06-09T04:42:10.624 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.619+0000 7f741bfff700 1 -- 172.21.15.62:0/1647125911 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f741c0c77c0 con 0x7f741c160360 2023-06-09T04:42:10.624 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.619+0000 7f74037fe700 1 -- 172.21.15.62:0/1647125911 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f741c0c77c0 con 0x7f741c160360 2023-06-09T04:42:10.625 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2023-06-09T04:42:10.627 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.623+0000 7f741bfff700 1 -- 172.21.15.62:0/1647125911 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f74080662f0 msgr2=0x7f74080687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:10.627 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.623+0000 7f741bfff700 1 --2- 172.21.15.62:0/1647125911 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f74080662f0 0x7f74080687a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f740c009bf0 tx=0x7f740c009240 comp rx=0 tx=0).stop 2023-06-09T04:42:10.628 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.623+0000 7f741bfff700 1 -- 172.21.15.62:0/1647125911 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f741c160360 msgr2=0x7f741c154d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:10.628 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.623+0000 7f741bfff700 1 --2- 172.21.15.62:0/1647125911 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f741c160360 0x7f741c154d40 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f7414014040 tx=0x7f7414004af0 comp rx=0 tx=0).stop 2023-06-09T04:42:10.628 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.623+0000 7f741bfff700 1 -- 172.21.15.62:0/1647125911 shutdown_connections 2023-06-09T04:42:10.628 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.623+0000 7f741bfff700 1 --2- 172.21.15.62:0/1647125911 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f74080662f0 0x7f74080687a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:10.629 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.623+0000 7f741bfff700 1 --2- 172.21.15.62:0/1647125911 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f741c160360 0x7f741c154d40 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:10.629 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.623+0000 7f741bfff700 1 --2- 172.21.15.62:0/1647125911 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f741c0c8800 0x7f741c0b2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:10.629 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.623+0000 7f741bfff700 1 --2- 172.21.15.62:0/1647125911 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f741c0afb50 0x7f741c0c7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:10.629 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.623+0000 7f741bfff700 1 -- 172.21.15.62:0/1647125911 >> 172.21.15.62:0/1647125911 conn(0x7f741c0cab50 msgr2=0x7f741c0aedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:10.629 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.623+0000 7f741bfff700 1 -- 172.21.15.62:0/1647125911 shutdown_connections 2023-06-09T04:42:10.629 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.623+0000 7f741bfff700 1 -- 172.21.15.62:0/1647125911 wait complete. 2023-06-09T04:42:10.649 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:42:10.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.823+0000 7fd0e2acf700 1 Processor -- start 2023-06-09T04:42:10.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.827+0000 7fd0e2acf700 1 -- start start 2023-06-09T04:42:10.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.827+0000 7fd0e2acf700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0dc0d1f80 0x7fd0dc0b3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:10.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.827+0000 7fd0e2acf700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd0dc0cd2e0 0x7fd0dc0d0250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:10.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.827+0000 7fd0e2acf700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0dc0b4d50 con 0x7fd0dc0cebf0 2023-06-09T04:42:10.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.827+0000 7fd0e2acf700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0dc0cf040 con 0x7fd0dc0cd2e0 2023-06-09T04:42:10.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.827+0000 7fd0e2acf700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0dc0b4140 con 0x7fd0dc0d1f80 2023-06-09T04:42:10.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.827+0000 7fd0e22ce700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd0dc0cd2e0 0x7fd0dc0d0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:10.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.827+0000 7fd0e1acd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0dc0d1f80 0x7fd0dc0b3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:10.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.827+0000 7fd0e22ce700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd0dc0cd2e0 0x7fd0dc0d0250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40036/0 (socket says 172.21.15.62:40036) 2023-06-09T04:42:10.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.827+0000 7fd0e22ce700 1 -- 172.21.15.62:0/4130840325 learned_addr learned my addr 172.21.15.62:0/4130840325 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:10.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.831+0000 7fd0e22ce700 1 -- 172.21.15.62:0/4130840325 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0dc0d1f80 msgr2=0x7fd0dc0b3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:10.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.831+0000 7fd0e22ce700 1 --2- 172.21.15.62:0/4130840325 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0dc0d1f80 0x7fd0dc0b3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:10.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.831+0000 7fd0e22ce700 1 -- 172.21.15.62:0/4130840325 >> v1:172.21.15.89:6789/0 conn(0x7fd0dc0cebf0 legacy=0x7fd0dc0ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:10.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.831+0000 7fd0e22ce700 1 -- 172.21.15.62:0/4130840325 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0dc0b4420 con 0x7fd0dc0cd2e0 2023-06-09T04:42:10.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.831+0000 7fd0e22ce700 1 --2- 172.21.15.62:0/4130840325 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd0dc0cd2e0 0x7fd0dc0d0250 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd0d4009e80 tx=0x7fd0d400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=375d1ad1a5a3f2cb server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:10.837 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.831+0000 7fd0e0acb700 1 -- 172.21.15.62:0/4130840325 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d400e070 con 0x7fd0dc0cd2e0 2023-06-09T04:42:10.837 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.831+0000 7fd0e0acb700 1 -- 172.21.15.62:0/4130840325 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0d400b8d0 con 0x7fd0dc0cd2e0 2023-06-09T04:42:10.837 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.831+0000 7fd0e0acb700 1 -- 172.21.15.62:0/4130840325 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d400bc80 con 0x7fd0dc0cd2e0 2023-06-09T04:42:10.838 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.831+0000 7fd0e2acf700 1 -- 172.21.15.62:0/4130840325 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd0dc0cd2e0 msgr2=0x7fd0dc0d0250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:10.838 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.831+0000 7fd0e2acf700 1 --2- 172.21.15.62:0/4130840325 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd0dc0cd2e0 0x7fd0dc0d0250 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fd0d4009e80 tx=0x7fd0d400b330 comp rx=0 tx=0).stop 2023-06-09T04:42:10.838 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.831+0000 7fd0e2acf700 1 -- 172.21.15.62:0/4130840325 shutdown_connections 2023-06-09T04:42:10.838 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.831+0000 7fd0e2acf700 1 --2- 172.21.15.62:0/4130840325 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd0dc0cd2e0 0x7fd0dc0d0250 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:10.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.831+0000 7fd0e2acf700 1 --2- 172.21.15.62:0/4130840325 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0dc0d1f80 0x7fd0dc0b3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:10.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.831+0000 7fd0e2acf700 1 -- 172.21.15.62:0/4130840325 >> 172.21.15.62:0/4130840325 conn(0x7fd0dc071840 msgr2=0x7fd0dc09b760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:10.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.831+0000 7fd0e2acf700 1 -- 172.21.15.62:0/4130840325 shutdown_connections 2023-06-09T04:42:10.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.831+0000 7fd0e2acf700 1 -- 172.21.15.62:0/4130840325 wait complete. 2023-06-09T04:42:10.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.835+0000 7fd0e2acf700 1 Processor -- start 2023-06-09T04:42:10.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.835+0000 7fd0e2acf700 1 -- start start 2023-06-09T04:42:10.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.835+0000 7fd0e2acf700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0dc0cd2e0 0x7fd0dc0b2670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:10.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.835+0000 7fd0e2acf700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0dc0cebf0 0x7fd0dc0c74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:10.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.835+0000 7fd0e2acf700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd0dc0d1f80 0x7fd0dc0cb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:10.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.835+0000 7fd0e2acf700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0dc0ca070 con 0x7fd0dc0d1f80 2023-06-09T04:42:10.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.835+0000 7fd0e2acf700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0dc0c9a60 con 0x7fd0dc0cebf0 2023-06-09T04:42:10.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.835+0000 7fd0e2acf700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0dc0cc4b0 con 0x7fd0dc0cd2e0 2023-06-09T04:42:10.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.839+0000 7fd0e22ce700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd0dc0d1f80 0x7fd0dc0cb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:10.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.839+0000 7fd0e1acd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0dc0cd2e0 0x7fd0dc0b2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:10.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.839+0000 7fd0e22ce700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd0dc0d1f80 0x7fd0dc0cb7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40046/0 (socket says 172.21.15.62:40046) 2023-06-09T04:42:10.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.839+0000 7fd0e22ce700 1 -- 172.21.15.62:0/21406801 learned_addr learned my addr 172.21.15.62:0/21406801 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:10.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.839+0000 7fd0e12cc700 1 --2- 172.21.15.62:0/21406801 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0dc0cebf0 0x7fd0dc0c74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:10.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.839+0000 7fd0e22ce700 1 -- 172.21.15.62:0/21406801 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0dc0cd2e0 msgr2=0x7fd0dc0b2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:10.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.839+0000 7fd0e22ce700 1 --2- 172.21.15.62:0/21406801 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0dc0cd2e0 0x7fd0dc0b2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:10.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.839+0000 7fd0e22ce700 1 -- 172.21.15.62:0/21406801 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0dc0cebf0 msgr2=0x7fd0dc0c74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:10.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.839+0000 7fd0e22ce700 1 --2- 172.21.15.62:0/21406801 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0dc0cebf0 0x7fd0dc0c74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:10.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.839+0000 7fd0e22ce700 1 -- 172.21.15.62:0/21406801 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0d4009b30 con 0x7fd0dc0d1f80 2023-06-09T04:42:10.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.839+0000 7fd0e22ce700 1 --2- 172.21.15.62:0/21406801 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd0dc0d1f80 0x7fd0dc0cb7f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fd0d4012000 tx=0x7fd0d4004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:10.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.839+0000 7fd0d27fc700 1 -- 172.21.15.62:0/21406801 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d4004800 con 0x7fd0dc0d1f80 2023-06-09T04:42:10.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.839+0000 7fd0d27fc700 1 -- 172.21.15.62:0/21406801 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0d40099b0 con 0x7fd0dc0d1f80 2023-06-09T04:42:10.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.839+0000 7fd0e2acf700 1 -- 172.21.15.62:0/21406801 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0dc0cc1d0 con 0x7fd0dc0d1f80 2023-06-09T04:42:10.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.839+0000 7fd0d27fc700 1 -- 172.21.15.62:0/21406801 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d401c680 con 0x7fd0dc0d1f80 2023-06-09T04:42:10.847 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.839+0000 7fd0e2acf700 1 -- 172.21.15.62:0/21406801 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0dc0b2bb0 con 0x7fd0dc0d1f80 2023-06-09T04:42:10.847 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.839+0000 7fd0e2acf700 1 -- 172.21.15.62:0/21406801 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0dc0ca220 con 0x7fd0dc0d1f80 2023-06-09T04:42:10.847 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.843+0000 7fd0d27fc700 1 -- 172.21.15.62:0/21406801 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd0d401c7e0 con 0x7fd0dc0d1f80 2023-06-09T04:42:10.849 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.843+0000 7fd0d27fc700 1 --2- 172.21.15.62:0/21406801 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fd0c0066320 0x7fd0c00687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:10.849 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.843+0000 7fd0d27fc700 1 -- 172.21.15.62:0/21406801 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd0d4085900 con 0x7fd0dc0d1f80 2023-06-09T04:42:10.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.843+0000 7fd0e1acd700 1 --2- 172.21.15.62:0/21406801 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fd0c0066320 0x7fd0c00687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:10.851 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.847+0000 7fd0e1acd700 1 --2- 172.21.15.62:0/21406801 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fd0c0066320 0x7fd0c00687d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd0d8009b40 tx=0x7fd0d80091c0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:10.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:10.851+0000 7fd0d27fc700 1 -- 172.21.15.62:0/21406801 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd0dc0ca220 con 0x7fd0dc0d1f80 2023-06-09T04:42:11.029 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.023+0000 7fd0e2acf700 1 -- 172.21.15.62:0/21406801 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd0dc0739c0 con 0x7fd0dc0d1f80 2023-06-09T04:42:11.030 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.023+0000 7fd0d27fc700 1 -- 172.21.15.62:0/21406801 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd0d4052a40 con 0x7fd0dc0d1f80 2023-06-09T04:42:11.031 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2023-06-09T04:42:11.035 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.027+0000 7fd0e2acf700 1 -- 172.21.15.62:0/21406801 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fd0c0066320 msgr2=0x7fd0c00687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:11.035 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.027+0000 7fd0e2acf700 1 --2- 172.21.15.62:0/21406801 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fd0c0066320 0x7fd0c00687d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd0d8009b40 tx=0x7fd0d80091c0 comp rx=0 tx=0).stop 2023-06-09T04:42:11.035 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.027+0000 7fd0e2acf700 1 -- 172.21.15.62:0/21406801 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd0dc0d1f80 msgr2=0x7fd0dc0cb7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:11.035 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.027+0000 7fd0e2acf700 1 --2- 172.21.15.62:0/21406801 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd0dc0d1f80 0x7fd0dc0cb7f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fd0d4012000 tx=0x7fd0d4004af0 comp rx=0 tx=0).stop 2023-06-09T04:42:11.035 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.027+0000 7fd0e2acf700 1 -- 172.21.15.62:0/21406801 shutdown_connections 2023-06-09T04:42:11.035 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.027+0000 7fd0e2acf700 1 --2- 172.21.15.62:0/21406801 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fd0c0066320 0x7fd0c00687d0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:11.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.027+0000 7fd0e2acf700 1 --2- 172.21.15.62:0/21406801 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd0dc0d1f80 0x7fd0dc0cb7f0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:11.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.027+0000 7fd0e2acf700 1 --2- 172.21.15.62:0/21406801 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0dc0cebf0 0x7fd0dc0c74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:11.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.027+0000 7fd0e2acf700 1 --2- 172.21.15.62:0/21406801 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd0dc0cd2e0 0x7fd0dc0b2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:11.037 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.027+0000 7fd0e2acf700 1 -- 172.21.15.62:0/21406801 >> 172.21.15.62:0/21406801 conn(0x7fd0dc071840 msgr2=0x7fd0dc0cf1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:11.037 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.031+0000 7fd0e2acf700 1 -- 172.21.15.62:0/21406801 shutdown_connections 2023-06-09T04:42:11.037 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.031+0000 7fd0e2acf700 1 -- 172.21.15.62:0/21406801 wait complete. 2023-06-09T04:42:11.057 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T04:42:11.234 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.227+0000 7f46cd462700 1 Processor -- start 2023-06-09T04:42:11.235 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.227+0000 7f46cd462700 1 -- start start 2023-06-09T04:42:11.238 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.231+0000 7f46cd462700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f46c80d1f80 0x7f46c80b3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:11.238 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.231+0000 7f46cd462700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f46c80cd2e0 0x7f46c80d0250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:11.238 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.231+0000 7f46cd462700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46c80cf070 con 0x7f46c80cebf0 2023-06-09T04:42:11.239 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.231+0000 7f46cd462700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46c80b4d50 con 0x7f46c80d1f80 2023-06-09T04:42:11.239 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.231+0000 7f46cd462700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46c80b4140 con 0x7f46c80cd2e0 2023-06-09T04:42:11.239 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.231+0000 7f46c67fc700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f46c80cebf0 0x7f46c80ccbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:34194/0 (socket says 172.21.15.62:34194) 2023-06-09T04:42:11.239 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.231+0000 7f46c67fc700 1 -- 172.21.15.62:0/1256974151 learned_addr learned my addr 172.21.15.62:0/1256974151 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:42:11.239 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.235+0000 7f46c77fe700 1 --2- 172.21.15.62:0/1256974151 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f46c80cd2e0 0x7f46c80d0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:11.240 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.235+0000 7f46c6ffd700 1 --2- 172.21.15.62:0/1256974151 >> v2:172.21.15.89:3300/0 conn(0x7f46c80d1f80 0x7f46c80b3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:11.240 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.235+0000 7f46c77fe700 1 -- 172.21.15.62:0/1256974151 >> v2:172.21.15.89:3300/0 conn(0x7f46c80d1f80 msgr2=0x7f46c80b3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:11.240 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.235+0000 7f46c77fe700 1 --2- 172.21.15.62:0/1256974151 >> v2:172.21.15.89:3300/0 conn(0x7f46c80d1f80 0x7f46c80b3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:11.240 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.235+0000 7f46c77fe700 1 -- 172.21.15.62:0/1256974151 >> v1:172.21.15.62:6789/0 conn(0x7f46c80cebf0 legacy=0x7f46c80ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:11.241 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.235+0000 7f46c77fe700 1 -- 172.21.15.62:0/1256974151 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46c80b4420 con 0x7f46c80cd2e0 2023-06-09T04:42:11.241 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.235+0000 7f46c5ffb700 1 -- 172.21.15.62:0/1256974151 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3437799551 0 0) 0x7f46c80cf070 con 0x7f46c80cebf0 2023-06-09T04:42:11.241 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.235+0000 7f46c77fe700 1 --2- 172.21.15.62:0/1256974151 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f46c80cd2e0 0x7f46c80d0250 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f46c0009d90 tx=0x7f46c000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71516893ea0db343 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:11.241 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.235+0000 7f46c5ffb700 1 -- 172.21.15.62:0/1256974151 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c000e070 con 0x7f46c80cd2e0 2023-06-09T04:42:11.242 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.235+0000 7f46c5ffb700 1 -- 172.21.15.62:0/1256974151 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46c000bb20 con 0x7f46c80cd2e0 2023-06-09T04:42:11.242 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.235+0000 7f46c5ffb700 1 -- 172.21.15.62:0/1256974151 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c0012430 con 0x7f46c80cd2e0 2023-06-09T04:42:11.242 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.235+0000 7f46cd462700 1 -- 172.21.15.62:0/1256974151 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f46c80cd2e0 msgr2=0x7f46c80d0250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:11.243 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.235+0000 7f46cd462700 1 --2- 172.21.15.62:0/1256974151 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f46c80cd2e0 0x7f46c80d0250 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f46c0009d90 tx=0x7f46c000b330 comp rx=0 tx=0).stop 2023-06-09T04:42:11.243 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.235+0000 7f46cd462700 1 -- 172.21.15.62:0/1256974151 shutdown_connections 2023-06-09T04:42:11.243 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.235+0000 7f46cd462700 1 --2- 172.21.15.62:0/1256974151 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f46c80cd2e0 0x7f46c80d0250 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:11.243 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.235+0000 7f46cd462700 1 --2- 172.21.15.62:0/1256974151 >> v2:172.21.15.89:3300/0 conn(0x7f46c80d1f80 0x7f46c80b3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:11.243 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.235+0000 7f46cd462700 1 -- 172.21.15.62:0/1256974151 >> 172.21.15.62:0/1256974151 conn(0x7f46c8071840 msgr2=0x7f46c809b760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:11.243 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.235+0000 7f46cd462700 1 -- 172.21.15.62:0/1256974151 shutdown_connections 2023-06-09T04:42:11.243 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.235+0000 7f46cd462700 1 -- 172.21.15.62:0/1256974151 wait complete. 2023-06-09T04:42:11.244 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.239+0000 7f46cd462700 1 Processor -- start 2023-06-09T04:42:11.244 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.239+0000 7f46cd462700 1 -- start start 2023-06-09T04:42:11.245 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.239+0000 7f46cd462700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f46c80cd2e0 0x7f46c80b7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:11.246 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.239+0000 7f46cd462700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f46c80cebf0 0x7f46c81f4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:11.246 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.239+0000 7f46cd462700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46c80d1f80 0x7f46c81f5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:11.246 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.239+0000 7f46cd462700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c80c8890 con 0x7f46c80d1f80 2023-06-09T04:42:11.246 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.239+0000 7f46cd462700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c80c7c10 con 0x7f46c80cebf0 2023-06-09T04:42:11.246 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.239+0000 7f46cd462700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46c80c7ef0 con 0x7f46c80cd2e0 2023-06-09T04:42:11.247 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.239+0000 7f46c77fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46c80d1f80 0x7f46c81f5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:11.247 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.239+0000 7f46c77fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46c80d1f80 0x7f46c81f5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40050/0 (socket says 172.21.15.62:40050) 2023-06-09T04:42:11.247 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.239+0000 7f46c77fe700 1 -- 172.21.15.62:0/1195580271 learned_addr learned my addr 172.21.15.62:0/1195580271 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:11.248 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.239+0000 7f46c6ffd700 1 --2- 172.21.15.62:0/1195580271 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f46c80cd2e0 0x7f46c80b7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:11.248 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.239+0000 7f46c67fc700 1 --2- 172.21.15.62:0/1195580271 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f46c80cebf0 0x7f46c81f4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:11.248 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.239+0000 7f46c77fe700 1 -- 172.21.15.62:0/1195580271 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f46c80cd2e0 msgr2=0x7f46c80b7ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:11.248 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.239+0000 7f46c77fe700 1 --2- 172.21.15.62:0/1195580271 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f46c80cd2e0 0x7f46c80b7ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:11.248 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.239+0000 7f46c77fe700 1 -- 172.21.15.62:0/1195580271 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f46c80cebf0 msgr2=0x7f46c81f4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:11.248 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.239+0000 7f46c77fe700 1 --2- 172.21.15.62:0/1195580271 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f46c80cebf0 0x7f46c81f4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:11.248 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.239+0000 7f46c77fe700 1 -- 172.21.15.62:0/1195580271 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46c0009a70 con 0x7f46c80d1f80 2023-06-09T04:42:11.248 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.239+0000 7f46c67fc700 1 --2- 172.21.15.62:0/1195580271 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f46c80cebf0 0x7f46c81f4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:11.249 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.243+0000 7f46c77fe700 1 --2- 172.21.15.62:0/1195580271 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46c80d1f80 0x7f46c81f5080 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f46c0014040 tx=0x7f46c0004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:11.249 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.243+0000 7f46af7fe700 1 -- 172.21.15.62:0/1195580271 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c0004830 con 0x7f46c80d1f80 2023-06-09T04:42:11.249 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.243+0000 7f46af7fe700 1 -- 172.21.15.62:0/1195580271 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46c0020070 con 0x7f46c80d1f80 2023-06-09T04:42:11.250 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.243+0000 7f46cd462700 1 -- 172.21.15.62:0/1195580271 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46c80c81d0 con 0x7f46c80d1f80 2023-06-09T04:42:11.250 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.243+0000 7f46af7fe700 1 -- 172.21.15.62:0/1195580271 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46c00276c0 con 0x7f46c80d1f80 2023-06-09T04:42:11.250 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.243+0000 7f46cd462700 1 -- 172.21.15.62:0/1195580271 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46c8152520 con 0x7f46c80d1f80 2023-06-09T04:42:11.250 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.243+0000 7f46cd462700 1 -- 172.21.15.62:0/1195580271 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46c80739c0 con 0x7f46c80d1f80 2023-06-09T04:42:11.251 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.247+0000 7f46af7fe700 1 -- 172.21.15.62:0/1195580271 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f46c0012430 con 0x7f46c80d1f80 2023-06-09T04:42:11.252 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.247+0000 7f46af7fe700 1 --2- 172.21.15.62:0/1195580271 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f46b40662f0 0x7f46b40687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:11.253 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.247+0000 7f46af7fe700 1 -- 172.21.15.62:0/1195580271 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f46c0022070 con 0x7f46c80d1f80 2023-06-09T04:42:11.253 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.247+0000 7f46c6ffd700 1 --2- 172.21.15.62:0/1195580271 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f46b40662f0 0x7f46b40687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:11.254 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.247+0000 7f46c6ffd700 1 --2- 172.21.15.62:0/1195580271 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f46b40662f0 0x7f46b40687a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f46b8009b40 tx=0x7f46b80091c0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:11.257 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.251+0000 7f46af7fe700 1 -- 172.21.15.62:0/1195580271 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f46c0052f70 con 0x7f46c80d1f80 2023-06-09T04:42:11.434 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.427+0000 7f46cd462700 1 -- 172.21.15.62:0/1195580271 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f46c80c8bb0 con 0x7f46c80d1f80 2023-06-09T04:42:11.435 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.427+0000 7f46af7fe700 1 -- 172.21.15.62:0/1195580271 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7f46c0056590 con 0x7f46c80d1f80 2023-06-09T04:42:11.435 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-06-09T04:42:11.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.431+0000 7f46cd462700 1 -- 172.21.15.62:0/1195580271 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f46b40662f0 msgr2=0x7f46b40687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:11.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.431+0000 7f46cd462700 1 --2- 172.21.15.62:0/1195580271 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f46b40662f0 0x7f46b40687a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f46b8009b40 tx=0x7f46b80091c0 comp rx=0 tx=0).stop 2023-06-09T04:42:11.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.431+0000 7f46cd462700 1 -- 172.21.15.62:0/1195580271 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46c80d1f80 msgr2=0x7f46c81f5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:11.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.431+0000 7f46cd462700 1 --2- 172.21.15.62:0/1195580271 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46c80d1f80 0x7f46c81f5080 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f46c0014040 tx=0x7f46c0004af0 comp rx=0 tx=0).stop 2023-06-09T04:42:11.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.435+0000 7f46cd462700 1 -- 172.21.15.62:0/1195580271 shutdown_connections 2023-06-09T04:42:11.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.435+0000 7f46cd462700 1 --2- 172.21.15.62:0/1195580271 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f46b40662f0 0x7f46b40687a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:11.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.435+0000 7f46cd462700 1 --2- 172.21.15.62:0/1195580271 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f46c80d1f80 0x7f46c81f5080 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:11.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.435+0000 7f46cd462700 1 --2- 172.21.15.62:0/1195580271 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f46c80cebf0 0x7f46c81f4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:11.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.435+0000 7f46cd462700 1 --2- 172.21.15.62:0/1195580271 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f46c80cd2e0 0x7f46c80b7ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:11.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.435+0000 7f46cd462700 1 -- 172.21.15.62:0/1195580271 >> 172.21.15.62:0/1195580271 conn(0x7f46c8071840 msgr2=0x7f46c80cf100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:11.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.435+0000 7f46cd462700 1 -- 172.21.15.62:0/1195580271 shutdown_connections 2023-06-09T04:42:11.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.435+0000 7f46cd462700 1 -- 172.21.15.62:0/1195580271 wait complete. 2023-06-09T04:42:11.463 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T04:42:11.640 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.635+0000 7efe2f345700 1 Processor -- start 2023-06-09T04:42:11.640 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.635+0000 7efe2f345700 1 -- start start 2023-06-09T04:42:11.642 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.635+0000 7efe2f345700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7efe28071730 0x7efe2806f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:11.642 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.635+0000 7efe2f345700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7efe280b0260 0x7efe280c8720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:11.643 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.635+0000 7efe2f345700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe2815d860 con 0x7efe280ca1c0 2023-06-09T04:42:11.643 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.635+0000 7efe2f345700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe28071b00 con 0x7efe280b0260 2023-06-09T04:42:11.643 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.635+0000 7efe2f345700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe2815dab0 con 0x7efe28071730 2023-06-09T04:42:11.644 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.635+0000 7efe2db42700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7efe280ca1c0 0x7efe280afb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:34196/0 (socket says 172.21.15.62:34196) 2023-06-09T04:42:11.644 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.635+0000 7efe2db42700 1 -- 172.21.15.62:0/1674847636 learned_addr learned my addr 172.21.15.62:0/1674847636 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:42:11.644 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.635+0000 7efe2eb44700 1 --2- 172.21.15.62:0/1674847636 >> v2:172.21.15.62:3300/0 conn(0x7efe280b0260 0x7efe280c8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:11.644 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.639+0000 7efe2e343700 1 --2- 172.21.15.62:0/1674847636 >> v2:172.21.15.89:3300/0 conn(0x7efe28071730 0x7efe2806f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:11.644 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.639+0000 7efe2d341700 1 -- 172.21.15.62:0/1674847636 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 482800724 0 0) 0x7efe2815d860 con 0x7efe280ca1c0 2023-06-09T04:42:11.645 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.639+0000 7efe2d341700 1 -- 172.21.15.62:0/1674847636 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe100035d0 con 0x7efe280ca1c0 2023-06-09T04:42:11.645 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.639+0000 7efe2eb44700 1 -- 172.21.15.62:0/1674847636 >> v2:172.21.15.89:3300/0 conn(0x7efe28071730 msgr2=0x7efe2806f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:11.645 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.639+0000 7efe2eb44700 1 --2- 172.21.15.62:0/1674847636 >> v2:172.21.15.89:3300/0 conn(0x7efe28071730 0x7efe2806f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:11.645 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.639+0000 7efe2eb44700 1 -- 172.21.15.62:0/1674847636 >> v1:172.21.15.62:6789/0 conn(0x7efe280ca1c0 legacy=0x7efe280afb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:11.645 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.639+0000 7efe2eb44700 1 -- 172.21.15.62:0/1674847636 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe2815dd90 con 0x7efe280b0260 2023-06-09T04:42:11.646 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.639+0000 7efe2eb44700 1 --2- 172.21.15.62:0/1674847636 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe280b0260 0x7efe280c8720 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7efe28071d00 tx=0x7efe2000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11d6984df7f9098 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:11.646 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.639+0000 7efe2d341700 1 -- 172.21.15.62:0/1674847636 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe2000e070 con 0x7efe280b0260 2023-06-09T04:42:11.646 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.639+0000 7efe2d341700 1 -- 172.21.15.62:0/1674847636 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe2000bb20 con 0x7efe280b0260 2023-06-09T04:42:11.646 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.639+0000 7efe2d341700 1 -- 172.21.15.62:0/1674847636 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe20012430 con 0x7efe280b0260 2023-06-09T04:42:11.647 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.639+0000 7efe2f345700 1 -- 172.21.15.62:0/1674847636 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe280b0260 msgr2=0x7efe280c8720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:11.647 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.639+0000 7efe2f345700 1 --2- 172.21.15.62:0/1674847636 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe280b0260 0x7efe280c8720 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7efe28071d00 tx=0x7efe2000b330 comp rx=0 tx=0).stop 2023-06-09T04:42:11.648 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.639+0000 7efe2f345700 1 -- 172.21.15.62:0/1674847636 shutdown_connections 2023-06-09T04:42:11.648 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.639+0000 7efe2f345700 1 --2- 172.21.15.62:0/1674847636 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe280b0260 0x7efe280c8720 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:11.648 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.639+0000 7efe2f345700 1 --2- 172.21.15.62:0/1674847636 >> v2:172.21.15.89:3300/0 conn(0x7efe28071730 0x7efe2806f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:11.648 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.639+0000 7efe2f345700 1 -- 172.21.15.62:0/1674847636 >> 172.21.15.62:0/1674847636 conn(0x7efe280cab50 msgr2=0x7efe280caf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:11.648 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.639+0000 7efe2f345700 1 -- 172.21.15.62:0/1674847636 shutdown_connections 2023-06-09T04:42:11.648 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.639+0000 7efe2f345700 1 -- 172.21.15.62:0/1674847636 wait complete. 2023-06-09T04:42:11.649 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.643+0000 7efe2f345700 1 Processor -- start 2023-06-09T04:42:11.650 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.643+0000 7efe2f345700 1 -- start start 2023-06-09T04:42:11.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.647+0000 7efe2f345700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe28071730 0x7efe28148ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:11.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.647+0000 7efe2f345700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe280b0260 0x7efe28149560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:11.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.647+0000 7efe2f345700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efe280ca1c0 0x7efe28149aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:11.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.647+0000 7efe2f345700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe280c2240 con 0x7efe28071730 2023-06-09T04:42:11.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.647+0000 7efe2f345700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe280b21b0 con 0x7efe280b0260 2023-06-09T04:42:11.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.647+0000 7efe2f345700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe280c1f60 con 0x7efe280ca1c0 2023-06-09T04:42:11.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.647+0000 7efe2e343700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe28071730 0x7efe28148ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:11.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.647+0000 7efe2e343700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe28071730 0x7efe28148ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40068/0 (socket says 172.21.15.62:40068) 2023-06-09T04:42:11.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.647+0000 7efe2e343700 1 -- 172.21.15.62:0/2396933390 learned_addr learned my addr 172.21.15.62:0/2396933390 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:11.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.647+0000 7efe2db42700 1 --2- 172.21.15.62:0/2396933390 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe280b0260 0x7efe28149560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:11.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.647+0000 7efe2eb44700 1 --2- 172.21.15.62:0/2396933390 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efe280ca1c0 0x7efe28149aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:11.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.647+0000 7efe2e343700 1 -- 172.21.15.62:0/2396933390 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efe280ca1c0 msgr2=0x7efe28149aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:11.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.647+0000 7efe2e343700 1 --2- 172.21.15.62:0/2396933390 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efe280ca1c0 0x7efe28149aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:11.654 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.647+0000 7efe2e343700 1 -- 172.21.15.62:0/2396933390 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe280b0260 msgr2=0x7efe28149560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:11.654 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.647+0000 7efe2e343700 1 --2- 172.21.15.62:0/2396933390 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe280b0260 0x7efe28149560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:11.654 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.647+0000 7efe2e343700 1 -- 172.21.15.62:0/2396933390 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe20009a70 con 0x7efe28071730 2023-06-09T04:42:11.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.647+0000 7efe2e343700 1 --2- 172.21.15.62:0/2396933390 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe28071730 0x7efe28148ea0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7efe1800e840 tx=0x7efe1800eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:11.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.647+0000 7efe26ffd700 1 -- 172.21.15.62:0/2396933390 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe180095a0 con 0x7efe28071730 2023-06-09T04:42:11.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.647+0000 7efe26ffd700 1 -- 172.21.15.62:0/2396933390 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe18013680 con 0x7efe28071730 2023-06-09T04:42:11.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.647+0000 7efe26ffd700 1 -- 172.21.15.62:0/2396933390 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe180139f0 con 0x7efe28071730 2023-06-09T04:42:11.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.647+0000 7efe2f345700 1 -- 172.21.15.62:0/2396933390 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe280b1b60 con 0x7efe28071730 2023-06-09T04:42:11.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.647+0000 7efe2f345700 1 -- 172.21.15.62:0/2396933390 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe280b1810 con 0x7efe28071730 2023-06-09T04:42:11.656 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.651+0000 7efe2f345700 1 -- 172.21.15.62:0/2396933390 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe280739c0 con 0x7efe28071730 2023-06-09T04:42:11.657 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.651+0000 7efe26ffd700 1 -- 172.21.15.62:0/2396933390 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7efe18013b50 con 0x7efe28071730 2023-06-09T04:42:11.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.655+0000 7efe26ffd700 1 --2- 172.21.15.62:0/2396933390 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7efe14066320 0x7efe140687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:11.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.655+0000 7efe26ffd700 1 -- 172.21.15.62:0/2396933390 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7efe18083e50 con 0x7efe28071730 2023-06-09T04:42:11.660 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.655+0000 7efe2db42700 1 --2- 172.21.15.62:0/2396933390 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7efe14066320 0x7efe140687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:11.661 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.655+0000 7efe2db42700 1 --2- 172.21.15.62:0/2396933390 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7efe14066320 0x7efe140687d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7efe280c8650 tx=0x7efe1c007de0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:11.665 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.659+0000 7efe26ffd700 1 -- 172.21.15.62:0/2396933390 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7efe18054a20 con 0x7efe28071730 2023-06-09T04:42:11.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.835+0000 7efe2f345700 1 -- 172.21.15.62:0/2396933390 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efe280b3240 con 0x7efe28071730 2023-06-09T04:42:11.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.835+0000 7efe26ffd700 1 -- 172.21.15.62:0/2396933390 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7efe18017020 con 0x7efe28071730 2023-06-09T04:42:11.841 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 64 2023-06-09T04:42:11.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.835+0000 7efe2f345700 1 -- 172.21.15.62:0/2396933390 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7efe14066320 msgr2=0x7efe140687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:11.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.835+0000 7efe2f345700 1 --2- 172.21.15.62:0/2396933390 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7efe14066320 0x7efe140687d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7efe280c8650 tx=0x7efe1c007de0 comp rx=0 tx=0).stop 2023-06-09T04:42:11.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.835+0000 7efe2f345700 1 -- 172.21.15.62:0/2396933390 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe28071730 msgr2=0x7efe28148ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:11.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.835+0000 7efe2f345700 1 --2- 172.21.15.62:0/2396933390 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe28071730 0x7efe28148ea0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7efe1800e840 tx=0x7efe1800eb50 comp rx=0 tx=0).stop 2023-06-09T04:42:11.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.839+0000 7efe2f345700 1 -- 172.21.15.62:0/2396933390 shutdown_connections 2023-06-09T04:42:11.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.839+0000 7efe2f345700 1 --2- 172.21.15.62:0/2396933390 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7efe14066320 0x7efe140687d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:11.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.839+0000 7efe2f345700 1 --2- 172.21.15.62:0/2396933390 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efe280ca1c0 0x7efe28149aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:11.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.839+0000 7efe2f345700 1 --2- 172.21.15.62:0/2396933390 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe280b0260 0x7efe28149560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:11.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.839+0000 7efe2f345700 1 --2- 172.21.15.62:0/2396933390 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efe28071730 0x7efe28148ea0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:11.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.839+0000 7efe2f345700 1 -- 172.21.15.62:0/2396933390 >> 172.21.15.62:0/2396933390 conn(0x7efe280cab50 msgr2=0x7efe280ce060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:11.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.839+0000 7efe2f345700 1 -- 172.21.15.62:0/2396933390 shutdown_connections 2023-06-09T04:42:11.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:11.839+0000 7efe2f345700 1 -- 172.21.15.62:0/2396933390 wait complete. 2023-06-09T04:42:11.864 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-09T04:42:12.039 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.031+0000 7fa12f22c700 1 Processor -- start 2023-06-09T04:42:12.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.035+0000 7fa12f22c700 1 -- start start 2023-06-09T04:42:12.042 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.035+0000 7fa12f22c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa128159ec0 0x7fa1280c3f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:12.042 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.035+0000 7fa12f22c700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fa1280c44d0 0x7fa1280ce010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:12.042 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.035+0000 7fa12f22c700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1280ccc00 con 0x7fa12806fee0 2023-06-09T04:42:12.042 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.035+0000 7fa12f22c700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1280cc050 con 0x7fa1280c44d0 2023-06-09T04:42:12.042 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.035+0000 7fa12f22c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1280cc2d0 con 0x7fa128159ec0 2023-06-09T04:42:12.043 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.035+0000 7fa12d7c9700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fa12806fee0 0x7fa1280cd090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:34212/0 (socket says 172.21.15.62:34212) 2023-06-09T04:42:12.043 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.035+0000 7fa12d7c9700 1 -- 172.21.15.62:0/571251083 learned_addr learned my addr 172.21.15.62:0/571251083 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:42:12.044 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.035+0000 7fa12cfc8700 1 --2- 172.21.15.62:0/571251083 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa128159ec0 0x7fa1280c3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:12.044 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.035+0000 7fa127fff700 1 --2- 172.21.15.62:0/571251083 >> v2:172.21.15.89:3300/0 conn(0x7fa1280c44d0 0x7fa1280ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:12.045 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.039+0000 7fa1277fe700 1 -- 172.21.15.62:0/571251083 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2744008529 0 0) 0x7fa1280ccc00 con 0x7fa12806fee0 2023-06-09T04:42:12.045 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.039+0000 7fa1277fe700 1 -- 172.21.15.62:0/571251083 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1180035d0 con 0x7fa12806fee0 2023-06-09T04:42:12.045 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.039+0000 7fa12cfc8700 1 -- 172.21.15.62:0/571251083 >> v2:172.21.15.89:3300/0 conn(0x7fa1280c44d0 msgr2=0x7fa1280ce010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:12.045 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.039+0000 7fa12cfc8700 1 --2- 172.21.15.62:0/571251083 >> v2:172.21.15.89:3300/0 conn(0x7fa1280c44d0 0x7fa1280ce010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:12.045 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.039+0000 7fa12cfc8700 1 -- 172.21.15.62:0/571251083 >> v1:172.21.15.62:6789/0 conn(0x7fa12806fee0 legacy=0x7fa1280cd090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:12.045 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.039+0000 7fa12cfc8700 1 -- 172.21.15.62:0/571251083 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1280cc5b0 con 0x7fa128159ec0 2023-06-09T04:42:12.045 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.039+0000 7fa127fff700 1 --2- 172.21.15.62:0/571251083 >> v2:172.21.15.89:3300/0 conn(0x7fa1280c44d0 0x7fa1280ce010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:42:12.046 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.039+0000 7fa12cfc8700 1 --2- 172.21.15.62:0/571251083 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa128159ec0 0x7fa1280c3f90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa11c009850 tx=0x7fa11c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3deb29bf3c94161 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:12.046 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.039+0000 7fa1277fe700 1 -- 172.21.15.62:0/571251083 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa11c011830 con 0x7fa128159ec0 2023-06-09T04:42:12.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.039+0000 7fa1277fe700 1 -- 172.21.15.62:0/571251083 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa11c011990 con 0x7fa128159ec0 2023-06-09T04:42:12.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.039+0000 7fa1277fe700 1 -- 172.21.15.62:0/571251083 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa11c011d40 con 0x7fa128159ec0 2023-06-09T04:42:12.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.039+0000 7fa12f22c700 1 -- 172.21.15.62:0/571251083 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa128159ec0 msgr2=0x7fa1280c3f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:12.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.039+0000 7fa12f22c700 1 --2- 172.21.15.62:0/571251083 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa128159ec0 0x7fa1280c3f90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa11c009850 tx=0x7fa11c009b60 comp rx=0 tx=0).stop 2023-06-09T04:42:12.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.039+0000 7fa12f22c700 1 -- 172.21.15.62:0/571251083 shutdown_connections 2023-06-09T04:42:12.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.039+0000 7fa12f22c700 1 --2- 172.21.15.62:0/571251083 >> v2:172.21.15.89:3300/0 conn(0x7fa1280c44d0 0x7fa1280ce010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:12.048 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.039+0000 7fa12f22c700 1 --2- 172.21.15.62:0/571251083 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa128159ec0 0x7fa1280c3f90 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:12.048 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.039+0000 7fa12f22c700 1 -- 172.21.15.62:0/571251083 >> 172.21.15.62:0/571251083 conn(0x7fa12806db90 msgr2=0x7fa12806df60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:12.048 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.039+0000 7fa12f22c700 1 -- 172.21.15.62:0/571251083 shutdown_connections 2023-06-09T04:42:12.048 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.039+0000 7fa12f22c700 1 -- 172.21.15.62:0/571251083 wait complete. 2023-06-09T04:42:12.048 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.043+0000 7fa12f22c700 1 Processor -- start 2023-06-09T04:42:12.049 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.043+0000 7fa12f22c700 1 -- start start 2023-06-09T04:42:12.050 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.043+0000 7fa12f22c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa12806fee0 0x7fa1280ac900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:12.050 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.043+0000 7fa12f22c700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa1280c44d0 0x7fa128157930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:12.050 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.043+0000 7fa12f22c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa128159ec0 0x7fa1280c96a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:12.050 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.043+0000 7fa12f22c700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1281f55b0 con 0x7fa12806fee0 2023-06-09T04:42:12.050 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.043+0000 7fa12f22c700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1281f46e0 con 0x7fa1280c44d0 2023-06-09T04:42:12.051 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.043+0000 7fa12f22c700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1281f4930 con 0x7fa128159ec0 2023-06-09T04:42:12.051 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.043+0000 7fa12cfc8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa12806fee0 0x7fa1280ac900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:12.052 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.043+0000 7fa12cfc8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa12806fee0 0x7fa1280ac900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40070/0 (socket says 172.21.15.62:40070) 2023-06-09T04:42:12.052 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.043+0000 7fa12cfc8700 1 -- 172.21.15.62:0/719921158 learned_addr learned my addr 172.21.15.62:0/719921158 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:12.052 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.043+0000 7fa12d7c9700 1 --2- 172.21.15.62:0/719921158 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa128159ec0 0x7fa1280c96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:12.052 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.043+0000 7fa127fff700 1 --2- 172.21.15.62:0/719921158 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa1280c44d0 0x7fa128157930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:12.052 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.047+0000 7fa12cfc8700 1 -- 172.21.15.62:0/719921158 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa128159ec0 msgr2=0x7fa1280c96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:12.053 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.047+0000 7fa12cfc8700 1 --2- 172.21.15.62:0/719921158 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa128159ec0 0x7fa1280c96a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:12.053 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.047+0000 7fa12cfc8700 1 -- 172.21.15.62:0/719921158 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa1280c44d0 msgr2=0x7fa128157930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:12.053 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.047+0000 7fa12cfc8700 1 --2- 172.21.15.62:0/719921158 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa1280c44d0 0x7fa128157930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:12.054 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.047+0000 7fa12cfc8700 1 -- 172.21.15.62:0/719921158 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1140094b0 con 0x7fa12806fee0 2023-06-09T04:42:12.054 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.047+0000 7fa12d7c9700 1 --2- 172.21.15.62:0/719921158 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa128159ec0 0x7fa1280c96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:12.054 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.047+0000 7fa12cfc8700 1 --2- 172.21.15.62:0/719921158 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa12806fee0 0x7fa1280ac900 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa11c014040 tx=0x7fa11c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:12.056 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.047+0000 7fa1257fa700 1 -- 172.21.15.62:0/719921158 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa11c004610 con 0x7fa12806fee0 2023-06-09T04:42:12.056 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.047+0000 7fa1257fa700 1 -- 172.21.15.62:0/719921158 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa11c01e070 con 0x7fa12806fee0 2023-06-09T04:42:12.056 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.047+0000 7fa12f22c700 1 -- 172.21.15.62:0/719921158 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa11c0094b0 con 0x7fa12806fee0 2023-06-09T04:42:12.057 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.047+0000 7fa1257fa700 1 -- 172.21.15.62:0/719921158 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa11c0038e0 con 0x7fa12806fee0 2023-06-09T04:42:12.057 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.047+0000 7fa12f22c700 1 -- 172.21.15.62:0/719921158 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1281f4ef0 con 0x7fa12806fee0 2023-06-09T04:42:12.057 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.047+0000 7fa12f22c700 1 -- 172.21.15.62:0/719921158 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1280739c0 con 0x7fa12806fee0 2023-06-09T04:42:12.058 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.051+0000 7fa1257fa700 1 -- 172.21.15.62:0/719921158 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa11c003a40 con 0x7fa12806fee0 2023-06-09T04:42:12.059 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.051+0000 7fa1257fa700 1 --2- 172.21.15.62:0/719921158 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fa10c0662f0 0x7fa10c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:12.059 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.051+0000 7fa1257fa700 1 -- 172.21.15.62:0/719921158 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa11c020070 con 0x7fa12806fee0 2023-06-09T04:42:12.059 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.051+0000 7fa127fff700 1 --2- 172.21.15.62:0/719921158 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fa10c0662f0 0x7fa10c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:12.060 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.055+0000 7fa127fff700 1 --2- 172.21.15.62:0/719921158 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fa10c0662f0 0x7fa10c0687a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa1281591b0 tx=0x7fa114008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:12.066 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.059+0000 7fa1257fa700 1 -- 172.21.15.62:0/719921158 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa11c052740 con 0x7fa12806fee0 2023-06-09T04:42:12.237 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.231+0000 7fa12f22c700 1 -- 172.21.15.62:0/719921158 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fa1280ced50 con 0x7fa12806fee0 2023-06-09T04:42:12.238 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.231+0000 7fa1257fa700 1 -- 172.21.15.62:0/719921158 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa11c055d60 con 0x7fa12806fee0 2023-06-09T04:42:12.238 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-06-09T04:42:12.241 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.235+0000 7fa12f22c700 1 -- 172.21.15.62:0/719921158 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fa10c0662f0 msgr2=0x7fa10c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:12.241 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.235+0000 7fa12f22c700 1 --2- 172.21.15.62:0/719921158 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fa10c0662f0 0x7fa10c0687a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa1281591b0 tx=0x7fa114008040 comp rx=0 tx=0).stop 2023-06-09T04:42:12.241 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.235+0000 7fa12f22c700 1 -- 172.21.15.62:0/719921158 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa12806fee0 msgr2=0x7fa1280ac900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:12.241 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.235+0000 7fa12f22c700 1 --2- 172.21.15.62:0/719921158 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa12806fee0 0x7fa1280ac900 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa11c014040 tx=0x7fa11c004770 comp rx=0 tx=0).stop 2023-06-09T04:42:12.242 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.235+0000 7fa12f22c700 1 -- 172.21.15.62:0/719921158 shutdown_connections 2023-06-09T04:42:12.242 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.235+0000 7fa12f22c700 1 --2- 172.21.15.62:0/719921158 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fa10c0662f0 0x7fa10c0687a0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:12.242 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.235+0000 7fa12f22c700 1 --2- 172.21.15.62:0/719921158 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa128159ec0 0x7fa1280c96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:12.242 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.235+0000 7fa12f22c700 1 --2- 172.21.15.62:0/719921158 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa1280c44d0 0x7fa128157930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:12.243 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.235+0000 7fa12f22c700 1 --2- 172.21.15.62:0/719921158 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa12806fee0 0x7fa1280ac900 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:12.243 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.235+0000 7fa12f22c700 1 -- 172.21.15.62:0/719921158 >> 172.21.15.62:0/719921158 conn(0x7fa12806db90 msgr2=0x7fa1280b5280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:12.243 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.235+0000 7fa12f22c700 1 -- 172.21.15.62:0/719921158 shutdown_connections 2023-06-09T04:42:12.243 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.235+0000 7fa12f22c700 1 -- 172.21.15.62:0/719921158 wait complete. 2023-06-09T04:42:12.264 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-09T04:42:12.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.435+0000 7fad29645700 1 Processor -- start 2023-06-09T04:42:12.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.435+0000 7fad29645700 1 -- start start 2023-06-09T04:42:12.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.439+0000 7fad29645700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fad24159d30 0x7fad240b1430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:12.445 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.439+0000 7fad29645700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fad24069cb0 0x7fad240b1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:12.445 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.439+0000 7fad29645700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad240cbf90 con 0x7fad240697f0 2023-06-09T04:42:12.445 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.439+0000 7fad29645700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad240b2420 con 0x7fad24069cb0 2023-06-09T04:42:12.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.439+0000 7fad29645700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad240cb6a0 con 0x7fad24159d30 2023-06-09T04:42:12.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.439+0000 7fad227fc700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fad240697f0 0x7fad240cc420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:34220/0 (socket says 172.21.15.62:34220) 2023-06-09T04:42:12.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.439+0000 7fad227fc700 1 -- 172.21.15.62:0/4293620687 learned_addr learned my addr 172.21.15.62:0/4293620687 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:42:12.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.439+0000 7fad23fff700 1 --2- 172.21.15.62:0/4293620687 >> v2:172.21.15.89:3300/0 conn(0x7fad24069cb0 0x7fad240b1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:12.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.439+0000 7fad22ffd700 1 --2- 172.21.15.62:0/4293620687 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fad24159d30 0x7fad240b1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:12.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.439+0000 7fad21ffb700 1 -- 172.21.15.62:0/4293620687 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3678483640 0 0) 0x7fad240cbf90 con 0x7fad240697f0 2023-06-09T04:42:12.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.439+0000 7fad21ffb700 1 -- 172.21.15.62:0/4293620687 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad0c0035d0 con 0x7fad240697f0 2023-06-09T04:42:12.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.439+0000 7fad23fff700 1 -- 172.21.15.62:0/4293620687 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fad24159d30 msgr2=0x7fad240b1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:12.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.439+0000 7fad23fff700 1 --2- 172.21.15.62:0/4293620687 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fad24159d30 0x7fad240b1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:12.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.439+0000 7fad23fff700 1 -- 172.21.15.62:0/4293620687 >> v1:172.21.15.62:6789/0 conn(0x7fad240697f0 legacy=0x7fad240cc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:12.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.439+0000 7fad23fff700 1 -- 172.21.15.62:0/4293620687 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad240aeb70 con 0x7fad24069cb0 2023-06-09T04:42:12.448 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.443+0000 7fad23fff700 1 --2- 172.21.15.62:0/4293620687 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad24069cb0 0x7fad240b1970 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fad1c009850 tx=0x7fad1c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ada3aa40f178ea9 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:12.448 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.443+0000 7fad21ffb700 1 -- 172.21.15.62:0/4293620687 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad1c011830 con 0x7fad24069cb0 2023-06-09T04:42:12.448 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.443+0000 7fad21ffb700 1 -- 172.21.15.62:0/4293620687 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad1c011990 con 0x7fad24069cb0 2023-06-09T04:42:12.448 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.443+0000 7fad21ffb700 1 -- 172.21.15.62:0/4293620687 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad1c011d40 con 0x7fad24069cb0 2023-06-09T04:42:12.449 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.443+0000 7fad29645700 1 -- 172.21.15.62:0/4293620687 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad24069cb0 msgr2=0x7fad240b1970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:12.449 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.443+0000 7fad29645700 1 --2- 172.21.15.62:0/4293620687 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad24069cb0 0x7fad240b1970 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fad1c009850 tx=0x7fad1c009b60 comp rx=0 tx=0).stop 2023-06-09T04:42:12.449 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.443+0000 7fad29645700 1 -- 172.21.15.62:0/4293620687 shutdown_connections 2023-06-09T04:42:12.449 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.443+0000 7fad29645700 1 --2- 172.21.15.62:0/4293620687 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad24069cb0 0x7fad240b1970 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:12.450 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.443+0000 7fad29645700 1 --2- 172.21.15.62:0/4293620687 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fad24159d30 0x7fad240b1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:12.450 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.443+0000 7fad29645700 1 -- 172.21.15.62:0/4293620687 >> 172.21.15.62:0/4293620687 conn(0x7fad2406cf70 msgr2=0x7fad2406d370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:12.450 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.443+0000 7fad29645700 1 -- 172.21.15.62:0/4293620687 shutdown_connections 2023-06-09T04:42:12.450 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.443+0000 7fad29645700 1 -- 172.21.15.62:0/4293620687 wait complete. 2023-06-09T04:42:12.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.447+0000 7fad29645700 1 Processor -- start 2023-06-09T04:42:12.452 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.447+0000 7fad29645700 1 -- start start 2023-06-09T04:42:12.452 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.447+0000 7fad29645700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad240697f0 0x7fad2415ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:12.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.447+0000 7fad29645700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fad24069cb0 0x7fad240b27e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:12.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.447+0000 7fad29645700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad24159d30 0x7fad240b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:12.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.447+0000 7fad29645700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad240b5240 con 0x7fad24159d30 2023-06-09T04:42:12.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.447+0000 7fad29645700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad2415aa40 con 0x7fad240697f0 2023-06-09T04:42:12.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.447+0000 7fad29645700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad240c7990 con 0x7fad24069cb0 2023-06-09T04:42:12.454 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.447+0000 7fad23fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad24159d30 0x7fad240b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:12.454 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.447+0000 7fad23fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad24159d30 0x7fad240b2d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40072/0 (socket says 172.21.15.62:40072) 2023-06-09T04:42:12.454 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.447+0000 7fad23fff700 1 -- 172.21.15.62:0/1061307380 learned_addr learned my addr 172.21.15.62:0/1061307380 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:12.454 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.447+0000 7fad22ffd700 1 --2- 172.21.15.62:0/1061307380 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad240697f0 0x7fad2415ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:12.455 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.447+0000 7fad227fc700 1 --2- 172.21.15.62:0/1061307380 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fad24069cb0 0x7fad240b27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:12.455 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.447+0000 7fad23fff700 1 -- 172.21.15.62:0/1061307380 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fad24069cb0 msgr2=0x7fad240b27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:12.455 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.447+0000 7fad23fff700 1 --2- 172.21.15.62:0/1061307380 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fad24069cb0 0x7fad240b27e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:12.455 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.447+0000 7fad23fff700 1 -- 172.21.15.62:0/1061307380 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad240697f0 msgr2=0x7fad2415ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:12.455 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.447+0000 7fad23fff700 1 --2- 172.21.15.62:0/1061307380 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad240697f0 0x7fad2415ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:12.456 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.447+0000 7fad23fff700 1 -- 172.21.15.62:0/1061307380 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad1c0094b0 con 0x7fad24159d30 2023-06-09T04:42:12.456 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.447+0000 7fad23fff700 1 --2- 172.21.15.62:0/1061307380 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad24159d30 0x7fad240b2d20 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fad1c009eb0 tx=0x7fad1c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:12.457 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.447+0000 7fad0b7fe700 1 -- 172.21.15.62:0/1061307380 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad1c004400 con 0x7fad24159d30 2023-06-09T04:42:12.458 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.447+0000 7fad0b7fe700 1 -- 172.21.15.62:0/1061307380 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad1c01f070 con 0x7fad24159d30 2023-06-09T04:42:12.458 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.447+0000 7fad29645700 1 -- 172.21.15.62:0/1061307380 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad240b49a0 con 0x7fad24159d30 2023-06-09T04:42:12.458 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.447+0000 7fad0b7fe700 1 -- 172.21.15.62:0/1061307380 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad1c003900 con 0x7fad24159d30 2023-06-09T04:42:12.459 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.451+0000 7fad29645700 1 -- 172.21.15.62:0/1061307380 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad240b4f60 con 0x7fad24159d30 2023-06-09T04:42:12.459 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.451+0000 7fad29645700 1 -- 172.21.15.62:0/1061307380 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad2404db30 con 0x7fad24159d30 2023-06-09T04:42:12.459 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.451+0000 7fad0b7fe700 1 -- 172.21.15.62:0/1061307380 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fad1c021030 con 0x7fad24159d30 2023-06-09T04:42:12.461 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.451+0000 7fad0b7fe700 1 --2- 172.21.15.62:0/1061307380 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fad100662f0 0x7fad100687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:12.461 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.451+0000 7fad0b7fe700 1 -- 172.21.15.62:0/1061307380 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fad1c085480 con 0x7fad24159d30 2023-06-09T04:42:12.461 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.455+0000 7fad22ffd700 1 --2- 172.21.15.62:0/1061307380 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fad100662f0 0x7fad100687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:12.462 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.455+0000 7fad22ffd700 1 --2- 172.21.15.62:0/1061307380 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fad100662f0 0x7fad100687a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fad140073f0 tx=0x7fad1400b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:12.465 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.459+0000 7fad0b7fe700 1 -- 172.21.15.62:0/1061307380 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fad1c052660 con 0x7fad24159d30 2023-06-09T04:42:12.650 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.643+0000 7fad29645700 1 -- 172.21.15.62:0/1061307380 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fad240cb910 con 0x7fad24159d30 2023-06-09T04:42:12.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.647+0000 7fad0b7fe700 1 -- 172.21.15.62:0/1061307380 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v30) v1 ==== 80+0+0 (secure 0 0 0) 0x7fad1c055c80 con 0x7fad24159d30 2023-06-09T04:42:12.657 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.651+0000 7fad29645700 1 -- 172.21.15.62:0/1061307380 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fad100662f0 msgr2=0x7fad100687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:12.657 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.651+0000 7fad29645700 1 --2- 172.21.15.62:0/1061307380 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fad100662f0 0x7fad100687a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fad140073f0 tx=0x7fad1400b040 comp rx=0 tx=0).stop 2023-06-09T04:42:12.657 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.651+0000 7fad29645700 1 -- 172.21.15.62:0/1061307380 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad24159d30 msgr2=0x7fad240b2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:12.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.651+0000 7fad29645700 1 --2- 172.21.15.62:0/1061307380 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad24159d30 0x7fad240b2d20 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fad1c009eb0 tx=0x7fad1c004770 comp rx=0 tx=0).stop 2023-06-09T04:42:12.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.651+0000 7fad29645700 1 -- 172.21.15.62:0/1061307380 shutdown_connections 2023-06-09T04:42:12.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.651+0000 7fad29645700 1 --2- 172.21.15.62:0/1061307380 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fad100662f0 0x7fad100687a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:12.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.651+0000 7fad29645700 1 --2- 172.21.15.62:0/1061307380 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad24159d30 0x7fad240b2d20 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:12.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.651+0000 7fad29645700 1 --2- 172.21.15.62:0/1061307380 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fad24069cb0 0x7fad240b27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:12.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.651+0000 7fad29645700 1 --2- 172.21.15.62:0/1061307380 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fad240697f0 0x7fad2415ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:12.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.651+0000 7fad29645700 1 -- 172.21.15.62:0/1061307380 >> 172.21.15.62:0/1061307380 conn(0x7fad2406cf70 msgr2=0x7fad240b15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:12.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.651+0000 7fad29645700 1 -- 172.21.15.62:0/1061307380 shutdown_connections 2023-06-09T04:42:12.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.651+0000 7fad29645700 1 -- 172.21.15.62:0/1061307380 wait complete. 2023-06-09T04:42:12.660 INFO:teuthology.orchestra.run.smithi062.stderr:listed 0 entries 2023-06-09T04:42:12.679 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-06-09T04:42:12.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:12.679 DEBUG:teuthology.orchestra.run.smithi089:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-06-09T04:42:12.762 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi089.front.sepia.ceph.com 2023-06-09T04:42:12.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:12.763 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-06-09T04:42:12.783 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-06-09T04:42:12.783 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-09T04:42:12.961 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.955+0000 7f7586dbb700 1 Processor -- start 2023-06-09T04:42:12.961 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.955+0000 7f7586dbb700 1 -- start start 2023-06-09T04:42:12.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.959+0000 7f7586dbb700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f75800ce9c0 0x7f75800cc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:12.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.959+0000 7f7586dbb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75800ccf20 0x7f7580165730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:12.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.959+0000 7f7586dbb700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75800b51e0 con 0x7f75800d1ac0 2023-06-09T04:42:12.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.959+0000 7f7586dbb700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75800d0190 con 0x7f75800ce9c0 2023-06-09T04:42:12.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.959+0000 7f7586dbb700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75800d29f0 con 0x7f75800ccf20 2023-06-09T04:42:12.966 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.959+0000 7f75855b8700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f75800d1ac0 0x7f75800ced90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:34226/0 (socket says 172.21.15.62:34226) 2023-06-09T04:42:12.966 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.959+0000 7f75855b8700 1 -- 172.21.15.62:0/692154012 learned_addr learned my addr 172.21.15.62:0/692154012 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:42:12.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.959+0000 7f75865ba700 1 --2- 172.21.15.62:0/692154012 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75800ccf20 0x7f7580165730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:12.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.959+0000 7f7585db9700 1 --2- 172.21.15.62:0/692154012 >> v2:172.21.15.89:3300/0 conn(0x7f75800ce9c0 0x7f75800cc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:12.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.959+0000 7f7584db7700 1 -- 172.21.15.62:0/692154012 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2512836017 0 0) 0x7f75800b51e0 con 0x7f75800d1ac0 2023-06-09T04:42:12.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.959+0000 7f7584db7700 1 -- 172.21.15.62:0/692154012 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f756c0035d0 con 0x7f75800d1ac0 2023-06-09T04:42:12.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.959+0000 7f75865ba700 1 -- 172.21.15.62:0/692154012 >> v2:172.21.15.89:3300/0 conn(0x7f75800ce9c0 msgr2=0x7f75800cc9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:12.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.959+0000 7f75865ba700 1 --2- 172.21.15.62:0/692154012 >> v2:172.21.15.89:3300/0 conn(0x7f75800ce9c0 0x7f75800cc9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:12.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.959+0000 7f75865ba700 1 -- 172.21.15.62:0/692154012 >> v1:172.21.15.62:6789/0 conn(0x7f75800d1ac0 legacy=0x7f75800ced90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:12.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.959+0000 7f75865ba700 1 -- 172.21.15.62:0/692154012 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75800d2cd0 con 0x7f75800ccf20 2023-06-09T04:42:12.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.963+0000 7f75865ba700 1 --2- 172.21.15.62:0/692154012 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75800ccf20 0x7f7580165730 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7578009d90 tx=0x7f757800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ea43aaa857fee85 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:12.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.963+0000 7f7584db7700 1 -- 172.21.15.62:0/692154012 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757800e070 con 0x7f75800ccf20 2023-06-09T04:42:12.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.963+0000 7f7584db7700 1 -- 172.21.15.62:0/692154012 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f757800bb20 con 0x7f75800ccf20 2023-06-09T04:42:12.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.963+0000 7f7584db7700 1 -- 172.21.15.62:0/692154012 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7578012430 con 0x7f75800ccf20 2023-06-09T04:42:12.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.963+0000 7f7586dbb700 1 -- 172.21.15.62:0/692154012 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75800ccf20 msgr2=0x7f7580165730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:12.970 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.963+0000 7f7586dbb700 1 --2- 172.21.15.62:0/692154012 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75800ccf20 0x7f7580165730 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7578009d90 tx=0x7f757800b330 comp rx=0 tx=0).stop 2023-06-09T04:42:12.970 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.963+0000 7f7586dbb700 1 -- 172.21.15.62:0/692154012 shutdown_connections 2023-06-09T04:42:12.970 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.963+0000 7f7586dbb700 1 --2- 172.21.15.62:0/692154012 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75800ccf20 0x7f7580165730 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:12.970 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.963+0000 7f7586dbb700 1 --2- 172.21.15.62:0/692154012 >> v2:172.21.15.89:3300/0 conn(0x7f75800ce9c0 0x7f75800cc9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:12.970 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.963+0000 7f7586dbb700 1 -- 172.21.15.62:0/692154012 >> 172.21.15.62:0/692154012 conn(0x7f7580070f20 msgr2=0x7f75800712f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:12.970 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.963+0000 7f7586dbb700 1 -- 172.21.15.62:0/692154012 shutdown_connections 2023-06-09T04:42:12.970 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.963+0000 7f7586dbb700 1 -- 172.21.15.62:0/692154012 wait complete. 2023-06-09T04:42:12.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.967+0000 7f7586dbb700 1 Processor -- start 2023-06-09T04:42:12.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.967+0000 7f7586dbb700 1 -- start start 2023-06-09T04:42:12.973 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.967+0000 7f7586dbb700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75800ce9c0 0x7f75801f0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:12.973 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.967+0000 7f7586dbb700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75800c6430 0x7f758015dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:12.974 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.967+0000 7f7586dbb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f758015e000 0x7f758015c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:12.974 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.967+0000 7f7586dbb700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75800c78f0 con 0x7f75800c6430 2023-06-09T04:42:12.974 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.967+0000 7f7586dbb700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f758015e4a0 con 0x7f75800ce9c0 2023-06-09T04:42:12.974 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.967+0000 7f7586dbb700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75801453a0 con 0x7f758015e000 2023-06-09T04:42:12.975 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.967+0000 7f75855b8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75800c6430 0x7f758015dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:12.975 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.967+0000 7f75855b8700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75800c6430 0x7f758015dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40088/0 (socket says 172.21.15.62:40088) 2023-06-09T04:42:12.975 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.967+0000 7f75855b8700 1 -- 172.21.15.62:0/3580650648 learned_addr learned my addr 172.21.15.62:0/3580650648 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:12.975 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.967+0000 7f75865ba700 1 --2- 172.21.15.62:0/3580650648 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f758015e000 0x7f758015c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:12.976 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.967+0000 7f7585db9700 1 --2- 172.21.15.62:0/3580650648 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75800ce9c0 0x7f75801f0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:12.976 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.967+0000 7f75855b8700 1 -- 172.21.15.62:0/3580650648 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f758015e000 msgr2=0x7f758015c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:12.976 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.967+0000 7f75855b8700 1 --2- 172.21.15.62:0/3580650648 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f758015e000 0x7f758015c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:12.976 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.967+0000 7f75855b8700 1 -- 172.21.15.62:0/3580650648 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75800ce9c0 msgr2=0x7f75801f0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:12.976 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.967+0000 7f75855b8700 1 --2- 172.21.15.62:0/3580650648 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75800ce9c0 0x7f75801f0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:12.976 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.967+0000 7f75855b8700 1 -- 172.21.15.62:0/3580650648 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7578009a70 con 0x7f75800c6430 2023-06-09T04:42:12.976 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.967+0000 7f75865ba700 1 --2- 172.21.15.62:0/3580650648 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f758015e000 0x7f758015c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:12.977 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.967+0000 7f7585db9700 1 --2- 172.21.15.62:0/3580650648 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75800ce9c0 0x7f75801f0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:12.977 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.971+0000 7f75855b8700 1 --2- 172.21.15.62:0/3580650648 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75800c6430 0x7f758015dac0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f757000c730 tx=0x7f757000caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:12.977 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.971+0000 7f75767fc700 1 -- 172.21.15.62:0/3580650648 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7570005d90 con 0x7f75800c6430 2023-06-09T04:42:12.978 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.971+0000 7f75767fc700 1 -- 172.21.15.62:0/3580650648 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75700070d0 con 0x7f75800c6430 2023-06-09T04:42:12.978 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.971+0000 7f7586dbb700 1 -- 172.21.15.62:0/3580650648 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75800c68a0 con 0x7f75800c6430 2023-06-09T04:42:12.978 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.971+0000 7f75767fc700 1 -- 172.21.15.62:0/3580650648 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7570007460 con 0x7f75800c6430 2023-06-09T04:42:12.978 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.971+0000 7f7586dbb700 1 -- 172.21.15.62:0/3580650648 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7580144b00 con 0x7f75800c6430 2023-06-09T04:42:12.978 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.971+0000 7f7586dbb700 1 -- 172.21.15.62:0/3580650648 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75800739c0 con 0x7f75800c6430 2023-06-09T04:42:12.979 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.975+0000 7f75767fc700 1 -- 172.21.15.62:0/3580650648 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f75700075c0 con 0x7f75800c6430 2023-06-09T04:42:12.981 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.975+0000 7f75767fc700 1 --2- 172.21.15.62:0/3580650648 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f7564066320 0x7f75640687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:12.981 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.975+0000 7f75767fc700 1 -- 172.21.15.62:0/3580650648 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f75700835c0 con 0x7f75800c6430 2023-06-09T04:42:12.982 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.975+0000 7f7585db9700 1 --2- 172.21.15.62:0/3580650648 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f7564066320 0x7f75640687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:12.983 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.975+0000 7f7585db9700 1 --2- 172.21.15.62:0/3580650648 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f7564066320 0x7f75640687d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f757c009c40 tx=0x7f757c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:12.988 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:12.983+0000 7f75767fc700 1 -- 172.21.15.62:0/3580650648 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7570050670 con 0x7f75800c6430 2023-06-09T04:42:13.201 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.195+0000 7f7586dbb700 1 -- 172.21.15.62:0/3580650648 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f75800b7ed0 con 0x7f75800c6430 2023-06-09T04:42:13.202 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.195+0000 7f75767fc700 1 -- 172.21.15.62:0/3580650648 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4664 (secure 0 0 0) 0x7f7570053c90 con 0x7f75800c6430 2023-06-09T04:42:13.203 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:42:13.203 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4256,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/2242182358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2242182358},{"type":"v1","addr":"172.21.15.89:6836","nonce":2242182358}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6834/326702802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":326702802},{"type":"v1","addr":"172.21.15.62:6834","nonce":326702802}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4296,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/3851882562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":3851882562},{"type":"v1","addr":"172.21.15.62:6835","nonce":3851882562}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-09T04:40:56.758756+0000","modified":"2023-06-09T04:41:23.381650+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4312},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4312":{"gid":4312,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6837/1496954959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1496954959},{"type":"v1","addr":"172.21.15.89:6837","nonce":1496954959}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-09T04:42:13.205 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.199+0000 7f7586dbb700 1 -- 172.21.15.62:0/3580650648 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f7564066320 msgr2=0x7f75640687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:13.205 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.199+0000 7f7586dbb700 1 --2- 172.21.15.62:0/3580650648 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f7564066320 0x7f75640687d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f757c009c40 tx=0x7f757c008040 comp rx=0 tx=0).stop 2023-06-09T04:42:13.205 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.199+0000 7f7586dbb700 1 -- 172.21.15.62:0/3580650648 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75800c6430 msgr2=0x7f758015dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:13.205 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.199+0000 7f7586dbb700 1 --2- 172.21.15.62:0/3580650648 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75800c6430 0x7f758015dac0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f757000c730 tx=0x7f757000caf0 comp rx=0 tx=0).stop 2023-06-09T04:42:13.205 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.199+0000 7f7586dbb700 1 -- 172.21.15.62:0/3580650648 shutdown_connections 2023-06-09T04:42:13.205 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.199+0000 7f7586dbb700 1 --2- 172.21.15.62:0/3580650648 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f7564066320 0x7f75640687d0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:13.206 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.199+0000 7f7586dbb700 1 --2- 172.21.15.62:0/3580650648 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f758015e000 0x7f758015c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:13.206 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.199+0000 7f7586dbb700 1 --2- 172.21.15.62:0/3580650648 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75800c6430 0x7f758015dac0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:13.206 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.199+0000 7f7586dbb700 1 --2- 172.21.15.62:0/3580650648 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75800ce9c0 0x7f75801f0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:13.206 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.199+0000 7f7586dbb700 1 -- 172.21.15.62:0/3580650648 >> 172.21.15.62:0/3580650648 conn(0x7f7580070f20 msgr2=0x7f75800b3980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:13.206 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.199+0000 7f7586dbb700 1 -- 172.21.15.62:0/3580650648 shutdown_connections 2023-06-09T04:42:13.207 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.199+0000 7f7586dbb700 1 -- 172.21.15.62:0/3580650648 wait complete. 2023-06-09T04:42:13.207 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 9 2023-06-09T04:42:13.227 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:42:13.404 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.399+0000 7fe49abf9700 1 Processor -- start 2023-06-09T04:42:13.404 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.399+0000 7fe49abf9700 1 -- start start 2023-06-09T04:42:13.407 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.403+0000 7fe49abf9700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe4940ce970 0x7fe4940cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:13.407 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.403+0000 7fe49abf9700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4940ce4e0 con 0x7fe4940cd230 2023-06-09T04:42:13.408 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.403+0000 7fe49abf9700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4940d25e0 con 0x7fe4940d0270 2023-06-09T04:42:13.408 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.403+0000 7fe49abf9700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4940cd6b0 con 0x7fe4940ce970 2023-06-09T04:42:13.408 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.403+0000 7fe493fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe4940ce970 0x7fe4940cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:13.409 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.403+0000 7fe499196700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fe4940cd230 0x7fe4940b1fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:34242/0 (socket says 172.21.15.62:34242) 2023-06-09T04:42:13.409 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.403+0000 7fe499196700 1 -- 172.21.15.62:0/4177234058 learned_addr learned my addr 172.21.15.62:0/4177234058 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:42:13.409 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.403+0000 7fe493fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe4940ce970 0x7fe4940cccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40090/0 (socket says 172.21.15.62:40090) 2023-06-09T04:42:13.409 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.403+0000 7fe493fff700 1 -- 172.21.15.62:0/4177234058 >> v1:172.21.15.89:6789/0 conn(0x7fe4940d0270 legacy=0x7fe4940d0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:13.409 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.403+0000 7fe493fff700 1 -- 172.21.15.62:0/4177234058 >> v1:172.21.15.62:6789/0 conn(0x7fe4940cd230 legacy=0x7fe4940b1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:13.409 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.403+0000 7fe4937fe700 1 -- 172.21.15.62:0/4177234058 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3880550322 0 0) 0x7fe4940ce4e0 con 0x7fe4940cd230 2023-06-09T04:42:13.410 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.403+0000 7fe493fff700 1 -- 172.21.15.62:0/4177234058 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4940cd8d0 con 0x7fe4940ce970 2023-06-09T04:42:13.410 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.403+0000 7fe493fff700 1 --2- 172.21.15.62:0/4177234058 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4940ce970 0x7fe4940cccf0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fe480009850 tx=0x7fe480009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36224b41b26d41e8 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:13.411 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.403+0000 7fe4937fe700 1 -- 172.21.15.62:0/4177234058 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe480011830 con 0x7fe4940ce970 2023-06-09T04:42:13.411 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.403+0000 7fe4937fe700 1 -- 172.21.15.62:0/4177234058 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe480011990 con 0x7fe4940ce970 2023-06-09T04:42:13.411 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.403+0000 7fe4937fe700 1 -- 172.21.15.62:0/4177234058 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe480011d20 con 0x7fe4940ce970 2023-06-09T04:42:13.411 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.403+0000 7fe49abf9700 1 -- 172.21.15.62:0/4177234058 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4940ce970 msgr2=0x7fe4940cccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:13.411 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.403+0000 7fe49abf9700 1 --2- 172.21.15.62:0/4177234058 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4940ce970 0x7fe4940cccf0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fe480009850 tx=0x7fe480009b60 comp rx=0 tx=0).stop 2023-06-09T04:42:13.411 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.403+0000 7fe49abf9700 1 -- 172.21.15.62:0/4177234058 shutdown_connections 2023-06-09T04:42:13.411 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.403+0000 7fe49abf9700 1 --2- 172.21.15.62:0/4177234058 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4940ce970 0x7fe4940cccf0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:13.412 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.403+0000 7fe49abf9700 1 -- 172.21.15.62:0/4177234058 >> 172.21.15.62:0/4177234058 conn(0x7fe494071840 msgr2=0x7fe49409b970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:13.412 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.403+0000 7fe49abf9700 1 -- 172.21.15.62:0/4177234058 shutdown_connections 2023-06-09T04:42:13.412 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.403+0000 7fe49abf9700 1 -- 172.21.15.62:0/4177234058 wait complete. 2023-06-09T04:42:13.413 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.407+0000 7fe49abf9700 1 Processor -- start 2023-06-09T04:42:13.413 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.407+0000 7fe49abf9700 1 -- start start 2023-06-09T04:42:13.415 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.407+0000 7fe49abf9700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4940cd230 0x7fe494153320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:13.415 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.407+0000 7fe49abf9700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe4940ce970 0x7fe4940b1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:13.415 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.407+0000 7fe49abf9700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe4940d0270 0x7fe4940b2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:13.415 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.407+0000 7fe49abf9700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4940c6fb0 con 0x7fe4940cd230 2023-06-09T04:42:13.415 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.407+0000 7fe49abf9700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe49415a830 con 0x7fe4940d0270 2023-06-09T04:42:13.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.407+0000 7fe49abf9700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe49415a550 con 0x7fe4940ce970 2023-06-09T04:42:13.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.411+0000 7fe498995700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4940cd230 0x7fe494153320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:13.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.411+0000 7fe498995700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4940cd230 0x7fe494153320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40104/0 (socket says 172.21.15.62:40104) 2023-06-09T04:42:13.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.411+0000 7fe498995700 1 -- 172.21.15.62:0/2650668140 learned_addr learned my addr 172.21.15.62:0/2650668140 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:13.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.411+0000 7fe499196700 1 --2- 172.21.15.62:0/2650668140 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe4940d0270 0x7fe4940b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:13.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.411+0000 7fe493fff700 1 --2- 172.21.15.62:0/2650668140 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe4940ce970 0x7fe4940b1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:13.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.411+0000 7fe498995700 1 -- 172.21.15.62:0/2650668140 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe4940ce970 msgr2=0x7fe4940b1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:13.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.411+0000 7fe498995700 1 --2- 172.21.15.62:0/2650668140 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe4940ce970 0x7fe4940b1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:13.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.411+0000 7fe498995700 1 -- 172.21.15.62:0/2650668140 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe4940d0270 msgr2=0x7fe4940b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:13.418 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.411+0000 7fe498995700 1 --2- 172.21.15.62:0/2650668140 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe4940d0270 0x7fe4940b2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:13.418 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.411+0000 7fe498995700 1 -- 172.21.15.62:0/2650668140 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4800094b0 con 0x7fe4940cd230 2023-06-09T04:42:13.418 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.411+0000 7fe498995700 1 --2- 172.21.15.62:0/2650668140 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4940cd230 0x7fe494153320 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fe48800c4f0 tx=0x7fe48800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:13.418 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.411+0000 7fe4917fa700 1 -- 172.21.15.62:0/2650668140 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4880052d0 con 0x7fe4940cd230 2023-06-09T04:42:13.419 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.411+0000 7fe4917fa700 1 -- 172.21.15.62:0/2650668140 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe488005430 con 0x7fe4940cd230 2023-06-09T04:42:13.419 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.411+0000 7fe49abf9700 1 -- 172.21.15.62:0/2650668140 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4940c6960 con 0x7fe4940cd230 2023-06-09T04:42:13.419 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.411+0000 7fe4917fa700 1 -- 172.21.15.62:0/2650668140 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe488003930 con 0x7fe4940cd230 2023-06-09T04:42:13.419 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.411+0000 7fe49abf9700 1 -- 172.21.15.62:0/2650668140 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe494153860 con 0x7fe4940cd230 2023-06-09T04:42:13.419 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.411+0000 7fe49abf9700 1 -- 172.21.15.62:0/2650668140 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4940c9390 con 0x7fe4940cd230 2023-06-09T04:42:13.420 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.415+0000 7fe4917fa700 1 -- 172.21.15.62:0/2650668140 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe488003a90 con 0x7fe4940cd230 2023-06-09T04:42:13.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.415+0000 7fe4917fa700 1 --2- 172.21.15.62:0/2650668140 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fe4780662f0 0x7fe4780687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:13.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.415+0000 7fe4917fa700 1 -- 172.21.15.62:0/2650668140 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe488083510 con 0x7fe4940cd230 2023-06-09T04:42:13.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.415+0000 7fe493fff700 1 --2- 172.21.15.62:0/2650668140 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fe4780662f0 0x7fe4780687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:13.424 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.419+0000 7fe493fff700 1 --2- 172.21.15.62:0/2650668140 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fe4780662f0 0x7fe4780687a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe4800090b0 tx=0x7fe480008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:13.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.423+0000 7fe4917fa700 1 -- 172.21.15.62:0/2650668140 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe4880506f0 con 0x7fe4940cd230 2023-06-09T04:42:13.607 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.603+0000 7fe49abf9700 1 -- 172.21.15.62:0/2650668140 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe4940b1a70 con 0x7fe4940cd230 2023-06-09T04:42:13.609 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.603+0000 7fe4917fa700 1 -- 172.21.15.62:0/2650668140 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+20180 (secure 0 0 0) 0x7fe488053d10 con 0x7fe4940cd230 2023-06-09T04:42:13.609 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:42:13.610 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":30,"fsid":"f7998a1e-e5a9-4202-abaa-70c0eaae1047","created":"2023-06-09T04:40:30.469588+0000","modified":"2023-06-09T04:41:38.495589+0000","last_up_change":"2023-06-09T04:40:43.120747+0000","last_in_change":"2023-06-09T04:40:33.568221+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:40:44.646921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:40:50.006643+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:40:55.031273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:40:55.773517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-09T04:40:58.845383+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bc50bbc0-dd08-42ed-804c-ec3029e36c19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6802","nonce":1295788017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6807","nonce":1295788017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6815","nonce":1295788017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6809","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6811","nonce":1295788017}]},"public_addr":"172.21.15.62:6802/1295788017","cluster_addr":"172.21.15.62:6807/1295788017","heartbeat_back_addr":"172.21.15.62:6815/1295788017","heartbeat_front_addr":"172.21.15.62:6811/1295788017","state":["exists","up"]},{"osd":1,"uuid":"8230b12d-e22f-4985-a584-4cc64404cdbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6825","nonce":4120692006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6827","nonce":4120692006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6831","nonce":4120692006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6829","nonce":4120692006}]},"public_addr":"172.21.15.62:6825/4120692006","cluster_addr":"172.21.15.62:6827/4120692006","heartbeat_back_addr":"172.21.15.62:6831/4120692006","heartbeat_front_addr":"172.21.15.62:6829/4120692006","state":["exists","up"]},{"osd":2,"uuid":"d0202506-dbe9-4e3c-9271-687929abf96a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6801","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6803","nonce":4169607876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6805","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6806","nonce":4169607876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6814","nonce":4169607876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6810","nonce":4169607876}]},"public_addr":"172.21.15.62:6803/4169607876","cluster_addr":"172.21.15.62:6806/4169607876","heartbeat_back_addr":"172.21.15.62:6814/4169607876","heartbeat_front_addr":"172.21.15.62:6810/4169607876","state":["exists","up"]},{"osd":3,"uuid":"f3c0298a-b075-4411-af50-e16cd74fdddb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6817","nonce":3268438986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6819","nonce":3268438986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6823","nonce":3268438986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6821","nonce":3268438986}]},"public_addr":"172.21.15.62:6817/3268438986","cluster_addr":"172.21.15.62:6819/3268438986","heartbeat_back_addr":"172.21.15.62:6823/3268438986","heartbeat_front_addr":"172.21.15.62:6821/3268438986","state":["exists","up"]},{"osd":4,"uuid":"1ab5c5ca-e74f-475a-a309-683cc0029928","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6817","nonce":3139617628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6819","nonce":3139617628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6823","nonce":3139617628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6821","nonce":3139617628}]},"public_addr":"172.21.15.89:6817/3139617628","cluster_addr":"172.21.15.89:6819/3139617628","heartbeat_back_addr":"172.21.15.89:6823/3139617628","heartbeat_front_addr":"172.21.15.89:6821/3139617628","state":["exists","up"]},{"osd":5,"uuid":"a933e184-bd8f-4369-a1ba-a68de53c578c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6825","nonce":2681723596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6827","nonce":2681723596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6831","nonce":2681723596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6829","nonce":2681723596}]},"public_addr":"172.21.15.89:6825/2681723596","cluster_addr":"172.21.15.89:6827/2681723596","heartbeat_back_addr":"172.21.15.89:6831/2681723596","heartbeat_front_addr":"172.21.15.89:6829/2681723596","state":["exists","up"]},{"osd":6,"uuid":"1ed7ad37-2eee-49a6-954c-b537e2b7f0ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6809","nonce":1657136033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6811","nonce":1657136033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6815","nonce":1657136033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6813","nonce":1657136033}]},"public_addr":"172.21.15.89:6809/1657136033","cluster_addr":"172.21.15.89:6811/1657136033","heartbeat_back_addr":"172.21.15.89:6815/1657136033","heartbeat_front_addr":"172.21.15.89:6813/1657136033","state":["exists","up"]},{"osd":7,"uuid":"6ed732e9-33ff-40df-9038-a9f1d1622671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6801","nonce":1710561686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6803","nonce":1710561686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6807","nonce":1710561686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6805","nonce":1710561686}]},"public_addr":"172.21.15.89:6801/1710561686","cluster_addr":"172.21.15.89:6803/1710561686","heartbeat_back_addr":"172.21.15.89:6807/1710561686","heartbeat_front_addr":"172.21.15.89:6805/1710561686","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.335803+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.419788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.179334+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.263310+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.071846+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.375627+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.282277+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.315997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.12","mappings":[{"from":1,"to":2}]},{"pgid":"4.19","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:42:13.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.607+0000 7fe49abf9700 1 -- 172.21.15.62:0/2650668140 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fe4780662f0 msgr2=0x7fe4780687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:13.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.607+0000 7fe49abf9700 1 --2- 172.21.15.62:0/2650668140 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fe4780662f0 0x7fe4780687a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe4800090b0 tx=0x7fe480008030 comp rx=0 tx=0).stop 2023-06-09T04:42:13.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.607+0000 7fe49abf9700 1 -- 172.21.15.62:0/2650668140 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4940cd230 msgr2=0x7fe494153320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:13.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.607+0000 7fe49abf9700 1 --2- 172.21.15.62:0/2650668140 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4940cd230 0x7fe494153320 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fe48800c4f0 tx=0x7fe48800c8b0 comp rx=0 tx=0).stop 2023-06-09T04:42:13.613 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.607+0000 7fe49abf9700 1 -- 172.21.15.62:0/2650668140 shutdown_connections 2023-06-09T04:42:13.613 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.607+0000 7fe49abf9700 1 --2- 172.21.15.62:0/2650668140 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fe4780662f0 0x7fe4780687a0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:13.613 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.607+0000 7fe49abf9700 1 --2- 172.21.15.62:0/2650668140 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe4940d0270 0x7fe4940b2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:13.613 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.607+0000 7fe49abf9700 1 --2- 172.21.15.62:0/2650668140 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe4940ce970 0x7fe4940b1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:13.613 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.607+0000 7fe49abf9700 1 --2- 172.21.15.62:0/2650668140 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe4940cd230 0x7fe494153320 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:13.613 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.607+0000 7fe49abf9700 1 -- 172.21.15.62:0/2650668140 >> 172.21.15.62:0/2650668140 conn(0x7fe494071840 msgr2=0x7fe4940af640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:13.613 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.607+0000 7fe49abf9700 1 -- 172.21.15.62:0/2650668140 shutdown_connections 2023-06-09T04:42:13.614 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.607+0000 7fe49abf9700 1 -- 172.21.15.62:0/2650668140 wait complete. 2023-06-09T04:42:13.634 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:40:44.646921+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:40:50.006643+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T04:40:55.031273+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T04:40:55.773517+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-09T04:40:58.845383+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-09T04:42:13.635 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:42:13.818 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.811+0000 7f17952e4700 1 Processor -- start 2023-06-09T04:42:13.818 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.811+0000 7f17952e4700 1 -- start start 2023-06-09T04:42:13.820 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.815+0000 7f17952e4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17900c9140 0x7f1790163210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:13.820 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.815+0000 7f17952e4700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1790158a80 con 0x7f1790155d00 2023-06-09T04:42:13.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.815+0000 7f17952e4700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1790158d40 con 0x7f179006d370 2023-06-09T04:42:13.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.815+0000 7f17952e4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1790158890 con 0x7f17900c9140 2023-06-09T04:42:13.822 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.815+0000 7f178ffff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f1790155d00 0x7f179015c7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:34256/0 (socket says 172.21.15.62:34256) 2023-06-09T04:42:13.822 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.815+0000 7f178ffff700 1 -- 172.21.15.62:0/279362535 learned_addr learned my addr 172.21.15.62:0/279362535 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:42:13.822 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.815+0000 7f1794ae3700 1 --2- 172.21.15.62:0/279362535 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17900c9140 0x7f1790163210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:13.822 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.815+0000 7f178effd700 1 -- 172.21.15.62:0/279362535 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3175045150 0 0) 0x7f1790158a80 con 0x7f1790155d00 2023-06-09T04:42:13.822 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.815+0000 7f178effd700 1 -- 172.21.15.62:0/279362535 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17780035d0 con 0x7f1790155d00 2023-06-09T04:42:13.822 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.815+0000 7f1794ae3700 1 -- 172.21.15.62:0/279362535 >> v1:172.21.15.89:6789/0 conn(0x7f179006d370 legacy=0x7f17900c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:13.822 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.815+0000 7f1794ae3700 1 -- 172.21.15.62:0/279362535 >> v1:172.21.15.62:6789/0 conn(0x7f1790155d00 legacy=0x7f179015c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:13.823 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.815+0000 7f178effd700 1 -- 172.21.15.62:0/279362535 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3586433636 0 0) 0x7f17780035d0 con 0x7f1790155d00 2023-06-09T04:42:13.823 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.815+0000 7f1794ae3700 1 -- 172.21.15.62:0/279362535 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1790159020 con 0x7f17900c9140 2023-06-09T04:42:13.823 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.815+0000 7f1794ae3700 1 --2- 172.21.15.62:0/279362535 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17900c9140 0x7f1790163210 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1788009dc0 tx=0x7f178800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57baf91409829c5e server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:13.823 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.815+0000 7f178effd700 1 -- 172.21.15.62:0/279362535 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f178800e070 con 0x7f17900c9140 2023-06-09T04:42:13.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.815+0000 7f178effd700 1 -- 172.21.15.62:0/279362535 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1788003a40 con 0x7f17900c9140 2023-06-09T04:42:13.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.819+0000 7f178effd700 1 -- 172.21.15.62:0/279362535 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1780001670 con 0x7f17900c9140 2023-06-09T04:42:13.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.819+0000 7f17952e4700 1 -- 172.21.15.62:0/279362535 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17900c9140 msgr2=0x7f1790163210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:13.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.819+0000 7f17952e4700 1 --2- 172.21.15.62:0/279362535 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17900c9140 0x7f1790163210 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1788009dc0 tx=0x7f178800b330 comp rx=0 tx=0).stop 2023-06-09T04:42:13.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.819+0000 7f17952e4700 1 -- 172.21.15.62:0/279362535 shutdown_connections 2023-06-09T04:42:13.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.819+0000 7f17952e4700 1 --2- 172.21.15.62:0/279362535 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f17900c9140 0x7f1790163210 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:13.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.819+0000 7f17952e4700 1 -- 172.21.15.62:0/279362535 >> 172.21.15.62:0/279362535 conn(0x7f17900cab50 msgr2=0x7f17900caf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:13.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.819+0000 7f17952e4700 1 -- 172.21.15.62:0/279362535 shutdown_connections 2023-06-09T04:42:13.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.819+0000 7f17952e4700 1 -- 172.21.15.62:0/279362535 wait complete. 2023-06-09T04:42:13.826 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.819+0000 7f17952e4700 1 Processor -- start 2023-06-09T04:42:13.826 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.819+0000 7f17952e4700 1 -- start start 2023-06-09T04:42:13.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.823+0000 7f17952e4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f179006d370 0x7f179015b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:13.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.823+0000 7f17952e4700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17900c9140 0x7f17900af500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:13.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.823+0000 7f17952e4700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1790155d00 0x7f179006f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:13.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.823+0000 7f17952e4700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f179015a470 con 0x7f1790155d00 2023-06-09T04:42:13.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.823+0000 7f17952e4700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f179006f9e0 con 0x7f17900c9140 2023-06-09T04:42:13.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.823+0000 7f17952e4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f179015a6e0 con 0x7f179006d370 2023-06-09T04:42:13.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.823+0000 7f1794ae3700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1790155d00 0x7f179006f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:13.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.823+0000 7f1794ae3700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1790155d00 0x7f179006f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40112/0 (socket says 172.21.15.62:40112) 2023-06-09T04:42:13.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.823+0000 7f1794ae3700 1 -- 172.21.15.62:0/3628005558 learned_addr learned my addr 172.21.15.62:0/3628005558 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:13.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.823+0000 7f178f7fe700 1 --2- 172.21.15.62:0/3628005558 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17900c9140 0x7f17900af500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:13.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.823+0000 7f178ffff700 1 --2- 172.21.15.62:0/3628005558 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f179006d370 0x7f179015b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:13.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.823+0000 7f1794ae3700 1 -- 172.21.15.62:0/3628005558 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f179006d370 msgr2=0x7f179015b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:13.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.823+0000 7f1794ae3700 1 --2- 172.21.15.62:0/3628005558 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f179006d370 0x7f179015b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:13.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.823+0000 7f1794ae3700 1 -- 172.21.15.62:0/3628005558 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17900c9140 msgr2=0x7f17900af500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:13.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.823+0000 7f1794ae3700 1 --2- 172.21.15.62:0/3628005558 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17900c9140 0x7f17900af500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:13.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.823+0000 7f1794ae3700 1 -- 172.21.15.62:0/3628005558 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1788009a70 con 0x7f1790155d00 2023-06-09T04:42:13.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.823+0000 7f178ffff700 1 --2- 172.21.15.62:0/3628005558 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f179006d370 0x7f179015b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:13.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.823+0000 7f178f7fe700 1 --2- 172.21.15.62:0/3628005558 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17900c9140 0x7f17900af500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:13.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.823+0000 7f1794ae3700 1 --2- 172.21.15.62:0/3628005558 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1790155d00 0x7f179006f4a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f178800b370 tx=0x7f1788004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:13.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.823+0000 7f178cff9700 1 -- 172.21.15.62:0/3628005558 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17880046f0 con 0x7f1790155d00 2023-06-09T04:42:13.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.823+0000 7f178cff9700 1 -- 172.21.15.62:0/3628005558 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1788004850 con 0x7f1790155d00 2023-06-09T04:42:13.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.823+0000 7f17952e4700 1 -- 172.21.15.62:0/3628005558 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f179015a9c0 con 0x7f1790155d00 2023-06-09T04:42:13.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.823+0000 7f178cff9700 1 -- 172.21.15.62:0/3628005558 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f178801d690 con 0x7f1790155d00 2023-06-09T04:42:13.832 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.823+0000 7f17952e4700 1 -- 172.21.15.62:0/3628005558 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f179015af80 con 0x7f1790155d00 2023-06-09T04:42:13.832 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.827+0000 7f17952e4700 1 -- 172.21.15.62:0/3628005558 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17900739c0 con 0x7f1790155d00 2023-06-09T04:42:13.832 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.827+0000 7f178cff9700 1 -- 172.21.15.62:0/3628005558 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f178801d7f0 con 0x7f1790155d00 2023-06-09T04:42:13.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.827+0000 7f178cff9700 1 --2- 172.21.15.62:0/3628005558 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f177c0662f0 0x7f177c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:13.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.827+0000 7f178cff9700 1 -- 172.21.15.62:0/3628005558 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1788085480 con 0x7f1790155d00 2023-06-09T04:42:13.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.827+0000 7f178ffff700 1 --2- 172.21.15.62:0/3628005558 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f177c0662f0 0x7f177c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:13.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.831+0000 7f178ffff700 1 --2- 172.21.15.62:0/3628005558 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f177c0662f0 0x7f177c0687a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1780001eb0 tx=0x7f1780001d20 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:13.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:13.835+0000 7f178cff9700 1 -- 172.21.15.62:0/3628005558 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f17880525d0 con 0x7f1790155d00 2023-06-09T04:42:14.013 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.007+0000 7f17952e4700 1 -- 172.21.15.62:0/3628005558 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f179006baa0 con 0x7f1790155d00 2023-06-09T04:42:14.014 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.007+0000 7f178cff9700 1 -- 172.21.15.62:0/3628005558 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1788055bf0 con 0x7f1790155d00 2023-06-09T04:42:14.014 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2023-06-09T04:42:14.017 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.011+0000 7f17952e4700 1 -- 172.21.15.62:0/3628005558 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f177c0662f0 msgr2=0x7f177c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:14.017 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.011+0000 7f17952e4700 1 --2- 172.21.15.62:0/3628005558 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f177c0662f0 0x7f177c0687a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1780001eb0 tx=0x7f1780001d20 comp rx=0 tx=0).stop 2023-06-09T04:42:14.017 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.011+0000 7f17952e4700 1 -- 172.21.15.62:0/3628005558 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1790155d00 msgr2=0x7f179006f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:14.017 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.011+0000 7f17952e4700 1 --2- 172.21.15.62:0/3628005558 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1790155d00 0x7f179006f4a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f178800b370 tx=0x7f1788004af0 comp rx=0 tx=0).stop 2023-06-09T04:42:14.017 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.011+0000 7f17952e4700 1 -- 172.21.15.62:0/3628005558 shutdown_connections 2023-06-09T04:42:14.018 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.011+0000 7f17952e4700 1 --2- 172.21.15.62:0/3628005558 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f177c0662f0 0x7f177c0687a0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:14.018 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.011+0000 7f17952e4700 1 --2- 172.21.15.62:0/3628005558 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1790155d00 0x7f179006f4a0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:14.018 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.011+0000 7f17952e4700 1 --2- 172.21.15.62:0/3628005558 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f17900c9140 0x7f17900af500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:14.018 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.011+0000 7f17952e4700 1 --2- 172.21.15.62:0/3628005558 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f179006d370 0x7f179015b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:14.018 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.011+0000 7f17952e4700 1 -- 172.21.15.62:0/3628005558 >> 172.21.15.62:0/3628005558 conn(0x7f17900cab50 msgr2=0x7f1790152bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:14.019 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.011+0000 7f17952e4700 1 -- 172.21.15.62:0/3628005558 shutdown_connections 2023-06-09T04:42:14.019 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.011+0000 7f17952e4700 1 -- 172.21.15.62:0/3628005558 wait complete. 2023-06-09T04:42:14.038 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:42:14.218 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.211+0000 7f35bdc74700 1 Processor -- start 2023-06-09T04:42:14.219 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.211+0000 7f35bdc74700 1 -- start start 2023-06-09T04:42:14.222 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.215+0000 7f35bdc74700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f35b80cd7f0 0x7f35b806cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:14.223 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.215+0000 7f35bdc74700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35b815d630 con 0x7f35b8153290 2023-06-09T04:42:14.223 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.215+0000 7f35bdc74700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35b815d350 con 0x7f35b815c690 2023-06-09T04:42:14.223 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.215+0000 7f35bdc74700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35b806c8e0 con 0x7f35b80cd7f0 2023-06-09T04:42:14.223 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.215+0000 7f35bcc72700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f35b8153290 0x7f35b80cd0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:34266/0 (socket says 172.21.15.62:34266) 2023-06-09T04:42:14.223 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.215+0000 7f35bcc72700 1 -- 172.21.15.62:0/175800219 learned_addr learned my addr 172.21.15.62:0/175800219 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:42:14.223 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.215+0000 7f35b7fff700 1 --2- 172.21.15.62:0/175800219 >> v2:172.21.15.89:3300/0 conn(0x7f35b80cd7f0 0x7f35b806cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:14.224 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.219+0000 7f35b77fe700 1 -- 172.21.15.62:0/175800219 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2378708306 0 0) 0x7f35b815d630 con 0x7f35b8153290 2023-06-09T04:42:14.224 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.219+0000 7f35b77fe700 1 -- 172.21.15.62:0/175800219 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35a80035d0 con 0x7f35b8153290 2023-06-09T04:42:14.224 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.219+0000 7f35b7fff700 1 -- 172.21.15.62:0/175800219 >> v1:172.21.15.89:6789/0 conn(0x7f35b815c690 legacy=0x7f35b815ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:14.224 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.219+0000 7f35b77fe700 1 -- 172.21.15.62:0/175800219 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2483920847 0 0) 0x7f35b815d350 con 0x7f35b815c690 2023-06-09T04:42:14.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.219+0000 7f35b7fff700 1 -- 172.21.15.62:0/175800219 >> v1:172.21.15.62:6789/0 conn(0x7f35b8153290 legacy=0x7f35b80cd0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:14.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.219+0000 7f35b7fff700 1 -- 172.21.15.62:0/175800219 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35b806c220 con 0x7f35b80cd7f0 2023-06-09T04:42:14.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.219+0000 7f35b7fff700 1 --2- 172.21.15.62:0/175800219 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35b80cd7f0 0x7f35b806cd00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f35a4009850 tx=0x7f35a4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2abf96aa657b7bef server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:14.226 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.219+0000 7f35b77fe700 1 -- 172.21.15.62:0/175800219 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a4011830 con 0x7f35b80cd7f0 2023-06-09T04:42:14.226 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.219+0000 7f35b77fe700 1 -- 172.21.15.62:0/175800219 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35a4011990 con 0x7f35b80cd7f0 2023-06-09T04:42:14.226 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.219+0000 7f35b77fe700 1 -- 172.21.15.62:0/175800219 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a4011d40 con 0x7f35b80cd7f0 2023-06-09T04:42:14.226 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.219+0000 7f35bdc74700 1 -- 172.21.15.62:0/175800219 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35b80cd7f0 msgr2=0x7f35b806cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:14.227 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.219+0000 7f35bdc74700 1 --2- 172.21.15.62:0/175800219 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35b80cd7f0 0x7f35b806cd00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f35a4009850 tx=0x7f35a4009b60 comp rx=0 tx=0).stop 2023-06-09T04:42:14.227 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.219+0000 7f35bdc74700 1 -- 172.21.15.62:0/175800219 shutdown_connections 2023-06-09T04:42:14.227 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.219+0000 7f35bdc74700 1 --2- 172.21.15.62:0/175800219 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35b80cd7f0 0x7f35b806cd00 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:14.227 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.219+0000 7f35bdc74700 1 -- 172.21.15.62:0/175800219 >> 172.21.15.62:0/175800219 conn(0x7f35b80cab50 msgr2=0x7f35b80caf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:14.227 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.219+0000 7f35bdc74700 1 -- 172.21.15.62:0/175800219 shutdown_connections 2023-06-09T04:42:14.227 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.219+0000 7f35bdc74700 1 -- 172.21.15.62:0/175800219 wait complete. 2023-06-09T04:42:14.228 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.223+0000 7f35bdc74700 1 Processor -- start 2023-06-09T04:42:14.229 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.223+0000 7f35bdc74700 1 -- start start 2023-06-09T04:42:14.230 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.223+0000 7f35bdc74700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35b80cd7f0 0x7f35b814b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:14.230 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.223+0000 7f35bdc74700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35b8153290 0x7f35b80adb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:14.231 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.223+0000 7f35bdc74700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35b815c690 0x7f35b815b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:14.231 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.223+0000 7f35bdc74700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35b80b2260 con 0x7f35b815c690 2023-06-09T04:42:14.231 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.223+0000 7f35bdc74700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35b80b3f00 con 0x7f35b80cd7f0 2023-06-09T04:42:14.231 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.223+0000 7f35bdc74700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35b80b3940 con 0x7f35b8153290 2023-06-09T04:42:14.232 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.223+0000 7f35bd473700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35b815c690 0x7f35b815b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:14.232 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.227+0000 7f35bcc72700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35b80cd7f0 0x7f35b814b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:14.232 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.227+0000 7f35b7fff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35b8153290 0x7f35b80adb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:14.232 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.227+0000 7f35bd473700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35b815c690 0x7f35b815b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40120/0 (socket says 172.21.15.62:40120) 2023-06-09T04:42:14.232 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.227+0000 7f35bd473700 1 -- 172.21.15.62:0/2880689953 learned_addr learned my addr 172.21.15.62:0/2880689953 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:14.233 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.227+0000 7f35bd473700 1 -- 172.21.15.62:0/2880689953 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35b8153290 msgr2=0x7f35b80adb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:14.233 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.227+0000 7f35bd473700 1 --2- 172.21.15.62:0/2880689953 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35b8153290 0x7f35b80adb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:14.233 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.227+0000 7f35bd473700 1 -- 172.21.15.62:0/2880689953 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35b80cd7f0 msgr2=0x7f35b814b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:14.233 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.227+0000 7f35bd473700 1 --2- 172.21.15.62:0/2880689953 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35b80cd7f0 0x7f35b814b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:14.233 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.227+0000 7f35bd473700 1 -- 172.21.15.62:0/2880689953 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a40094b0 con 0x7f35b815c690 2023-06-09T04:42:14.234 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.227+0000 7f35bd473700 1 --2- 172.21.15.62:0/2880689953 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35b815c690 0x7f35b815b180 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f35b000cc10 tx=0x7f35b000cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:14.234 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.227+0000 7f35b57fa700 1 -- 172.21.15.62:0/2880689953 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b0003e50 con 0x7f35b815c690 2023-06-09T04:42:14.234 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.227+0000 7f35b57fa700 1 -- 172.21.15.62:0/2880689953 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b000a650 con 0x7f35b815c690 2023-06-09T04:42:14.234 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.227+0000 7f35b57fa700 1 -- 172.21.15.62:0/2880689953 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b000aa00 con 0x7f35b815c690 2023-06-09T04:42:14.234 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.227+0000 7f35bdc74700 1 -- 172.21.15.62:0/2880689953 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35b80b3c20 con 0x7f35b815c690 2023-06-09T04:42:14.235 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.227+0000 7f35bdc74700 1 -- 172.21.15.62:0/2880689953 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35b80b3630 con 0x7f35b815c690 2023-06-09T04:42:14.235 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.227+0000 7f35bdc74700 1 -- 172.21.15.62:0/2880689953 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35b815aac0 con 0x7f35b815c690 2023-06-09T04:42:14.235 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.231+0000 7f35b57fa700 1 -- 172.21.15.62:0/2880689953 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f35b000ab60 con 0x7f35b815c690 2023-06-09T04:42:14.237 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.231+0000 7f35b57fa700 1 --2- 172.21.15.62:0/2880689953 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f359c066320 0x7f359c0687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:14.237 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.231+0000 7f35b57fa700 1 -- 172.21.15.62:0/2880689953 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f35b00839c0 con 0x7f35b815c690 2023-06-09T04:42:14.237 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.231+0000 7f35bcc72700 1 --2- 172.21.15.62:0/2880689953 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f359c066320 0x7f359c0687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:14.238 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.231+0000 7f35bcc72700 1 --2- 172.21.15.62:0/2880689953 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f359c066320 0x7f359c0687d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f35ac007fd0 tx=0x7f35ac007da0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:14.243 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.239+0000 7f35b57fa700 1 -- 172.21.15.62:0/2880689953 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f35b815aac0 con 0x7f35b815c690 2023-06-09T04:42:14.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.411+0000 7f35bdc74700 1 -- 172.21.15.62:0/2880689953 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f35b815aea0 con 0x7f35b815c690 2023-06-09T04:42:14.418 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.411+0000 7f35b57fa700 1 -- 172.21.15.62:0/2880689953 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7f35b0017020 con 0x7f35b815c690 2023-06-09T04:42:14.419 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2023-06-09T04:42:14.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.415+0000 7f35bdc74700 1 -- 172.21.15.62:0/2880689953 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f359c066320 msgr2=0x7f359c0687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:14.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.415+0000 7f35bdc74700 1 --2- 172.21.15.62:0/2880689953 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f359c066320 0x7f359c0687d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f35ac007fd0 tx=0x7f35ac007da0 comp rx=0 tx=0).stop 2023-06-09T04:42:14.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.415+0000 7f35bdc74700 1 -- 172.21.15.62:0/2880689953 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35b815c690 msgr2=0x7f35b815b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:14.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.415+0000 7f35bdc74700 1 --2- 172.21.15.62:0/2880689953 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35b815c690 0x7f35b815b180 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f35b000cc10 tx=0x7f35b000cf20 comp rx=0 tx=0).stop 2023-06-09T04:42:14.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.415+0000 7f35bdc74700 1 -- 172.21.15.62:0/2880689953 shutdown_connections 2023-06-09T04:42:14.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.415+0000 7f35bdc74700 1 --2- 172.21.15.62:0/2880689953 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f359c066320 0x7f359c0687d0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:14.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.415+0000 7f35bdc74700 1 --2- 172.21.15.62:0/2880689953 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f35b815c690 0x7f35b815b180 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:14.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.415+0000 7f35bdc74700 1 --2- 172.21.15.62:0/2880689953 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f35b8153290 0x7f35b80adb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:14.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.415+0000 7f35bdc74700 1 --2- 172.21.15.62:0/2880689953 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f35b80cd7f0 0x7f35b814b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:14.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.415+0000 7f35bdc74700 1 -- 172.21.15.62:0/2880689953 >> 172.21.15.62:0/2880689953 conn(0x7f35b80cab50 msgr2=0x7f35b80702f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:14.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.415+0000 7f35bdc74700 1 -- 172.21.15.62:0/2880689953 shutdown_connections 2023-06-09T04:42:14.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.415+0000 7f35bdc74700 1 -- 172.21.15.62:0/2880689953 wait complete. 2023-06-09T04:42:14.445 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T04:42:14.628 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.623+0000 7f7f76b8b700 1 Processor -- start 2023-06-09T04:42:14.629 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.623+0000 7f7f76b8b700 1 -- start start 2023-06-09T04:42:14.631 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.623+0000 7f7f76b8b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7f700cd2e0 0x7f7f700b3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:14.631 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.623+0000 7f7f76b8b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7f700cebf0 0x7f7f700d0250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:14.631 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.623+0000 7f7f76b8b700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f700b4d50 con 0x7f7f700d1f80 2023-06-09T04:42:14.631 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.623+0000 7f7f76b8b700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f700cf010 con 0x7f7f700cd2e0 2023-06-09T04:42:14.632 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.623+0000 7f7f76b8b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f700b4140 con 0x7f7f700cebf0 2023-06-09T04:42:14.633 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.623+0000 7f7f75388700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7f700cd2e0 0x7f7f700b3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:14.633 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.627+0000 7f7f75388700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7f700cd2e0 0x7f7f700b3b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40130/0 (socket says 172.21.15.62:40130) 2023-06-09T04:42:14.634 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.627+0000 7f7f75388700 1 -- 172.21.15.62:0/3129629059 learned_addr learned my addr 172.21.15.62:0/3129629059 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:14.634 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.627+0000 7f7f7638a700 1 --2- 172.21.15.62:0/3129629059 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7f700cebf0 0x7f7f700d0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:14.634 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.627+0000 7f7f75388700 1 -- 172.21.15.62:0/3129629059 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7f700cebf0 msgr2=0x7f7f700d0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:14.634 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.627+0000 7f7f75388700 1 --2- 172.21.15.62:0/3129629059 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7f700cebf0 0x7f7f700d0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:14.634 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.627+0000 7f7f75388700 1 -- 172.21.15.62:0/3129629059 >> v1:172.21.15.89:6789/0 conn(0x7f7f700d1f80 legacy=0x7f7f700ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:14.635 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.627+0000 7f7f75388700 1 -- 172.21.15.62:0/3129629059 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f700b4420 con 0x7f7f700cd2e0 2023-06-09T04:42:14.635 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.627+0000 7f7f75388700 1 --2- 172.21.15.62:0/3129629059 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7f700cd2e0 0x7f7f700b3b20 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f7f60009910 tx=0x7f7f60009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7390b7aa75d31592 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:14.635 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.627+0000 7f7f74b87700 1 -- 172.21.15.62:0/3129629059 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6000ba60 con 0x7f7f700cd2e0 2023-06-09T04:42:14.635 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.627+0000 7f7f74b87700 1 -- 172.21.15.62:0/3129629059 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f6000bbc0 con 0x7f7f700cd2e0 2023-06-09T04:42:14.636 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.627+0000 7f7f74b87700 1 -- 172.21.15.62:0/3129629059 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f60009e60 con 0x7f7f700cd2e0 2023-06-09T04:42:14.636 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.627+0000 7f7f76b8b700 1 -- 172.21.15.62:0/3129629059 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7f700cd2e0 msgr2=0x7f7f700b3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:14.637 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.627+0000 7f7f76b8b700 1 --2- 172.21.15.62:0/3129629059 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7f700cd2e0 0x7f7f700b3b20 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f7f60009910 tx=0x7f7f60009c20 comp rx=0 tx=0).stop 2023-06-09T04:42:14.637 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.627+0000 7f7f76b8b700 1 -- 172.21.15.62:0/3129629059 shutdown_connections 2023-06-09T04:42:14.637 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.627+0000 7f7f76b8b700 1 --2- 172.21.15.62:0/3129629059 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7f700cd2e0 0x7f7f700b3b20 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:14.637 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.627+0000 7f7f76b8b700 1 --2- 172.21.15.62:0/3129629059 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7f700cebf0 0x7f7f700d0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:14.638 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.627+0000 7f7f76b8b700 1 -- 172.21.15.62:0/3129629059 >> 172.21.15.62:0/3129629059 conn(0x7f7f70071840 msgr2=0x7f7f7009b760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:14.638 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.627+0000 7f7f76b8b700 1 -- 172.21.15.62:0/3129629059 shutdown_connections 2023-06-09T04:42:14.638 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.627+0000 7f7f76b8b700 1 -- 172.21.15.62:0/3129629059 wait complete. 2023-06-09T04:42:14.639 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.631+0000 7f7f76b8b700 1 Processor -- start 2023-06-09T04:42:14.639 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.631+0000 7f7f76b8b700 1 -- start start 2023-06-09T04:42:14.640 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.631+0000 7f7f76b8b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7f700cd2e0 0x7f7f700b0360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:14.640 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.631+0000 7f7f76b8b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7f700cebf0 0x7f7f700d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:14.640 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.631+0000 7f7f76b8b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f700d1f80 0x7f7f700d1190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:14.640 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.635+0000 7f7f76b8b700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f700cc530 con 0x7f7f700cd2e0 2023-06-09T04:42:14.641 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.635+0000 7f7f76b8b700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f700b08a0 con 0x7f7f700d1f80 2023-06-09T04:42:14.641 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.635+0000 7f7f76b8b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f700cb920 con 0x7f7f700cebf0 2023-06-09T04:42:14.642 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.635+0000 7f7f75b89700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7f700cd2e0 0x7f7f700b0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:14.643 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.635+0000 7f7f75b89700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7f700cd2e0 0x7f7f700b0360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40138/0 (socket says 172.21.15.62:40138) 2023-06-09T04:42:14.643 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.635+0000 7f7f75b89700 1 -- 172.21.15.62:0/4073278689 learned_addr learned my addr 172.21.15.62:0/4073278689 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:14.643 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.635+0000 7f7f75388700 1 --2- 172.21.15.62:0/4073278689 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7f700cebf0 0x7f7f700d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:14.643 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.635+0000 7f7f7638a700 1 --2- 172.21.15.62:0/4073278689 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f700d1f80 0x7f7f700d1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:14.644 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.635+0000 7f7f75b89700 1 -- 172.21.15.62:0/4073278689 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7f700cebf0 msgr2=0x7f7f700d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:14.644 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.635+0000 7f7f75b89700 1 --2- 172.21.15.62:0/4073278689 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7f700cebf0 0x7f7f700d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:14.644 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.635+0000 7f7f75b89700 1 -- 172.21.15.62:0/4073278689 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f700d1f80 msgr2=0x7f7f700d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:14.644 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.635+0000 7f7f75b89700 1 --2- 172.21.15.62:0/4073278689 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f700d1f80 0x7f7f700d1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:14.644 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.635+0000 7f7f75b89700 1 -- 172.21.15.62:0/4073278689 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f60009570 con 0x7f7f700cd2e0 2023-06-09T04:42:14.644 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.635+0000 7f7f7638a700 1 --2- 172.21.15.62:0/4073278689 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f700d1f80 0x7f7f700d1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:14.645 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.635+0000 7f7f75b89700 1 --2- 172.21.15.62:0/4073278689 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7f700cd2e0 0x7f7f700b0360 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c00c480 tx=0x7f7f6c00c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:14.645 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.635+0000 7f7f667fc700 1 -- 172.21.15.62:0/4073278689 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6c0052d0 con 0x7f7f700cd2e0 2023-06-09T04:42:14.645 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.635+0000 7f7f667fc700 1 -- 172.21.15.62:0/4073278689 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f6c005430 con 0x7f7f700cd2e0 2023-06-09T04:42:14.645 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.635+0000 7f7f76b8b700 1 -- 172.21.15.62:0/4073278689 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f700cbc00 con 0x7f7f700cd2e0 2023-06-09T04:42:14.645 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.635+0000 7f7f667fc700 1 -- 172.21.15.62:0/4073278689 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6c003930 con 0x7f7f700cd2e0 2023-06-09T04:42:14.645 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.635+0000 7f7f76b8b700 1 -- 172.21.15.62:0/4073278689 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f700cc1c0 con 0x7f7f700cd2e0 2023-06-09T04:42:14.646 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.639+0000 7f7f76b8b700 1 -- 172.21.15.62:0/4073278689 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f700c9110 con 0x7f7f700cd2e0 2023-06-09T04:42:14.646 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.639+0000 7f7f667fc700 1 -- 172.21.15.62:0/4073278689 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7f6c003a90 con 0x7f7f700cd2e0 2023-06-09T04:42:14.647 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.643+0000 7f7f667fc700 1 --2- 172.21.15.62:0/4073278689 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f7f540662f0 0x7f7f540687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:14.647 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.643+0000 7f7f667fc700 1 -- 172.21.15.62:0/4073278689 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7f6c083450 con 0x7f7f700cd2e0 2023-06-09T04:42:14.648 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.643+0000 7f7f75388700 1 --2- 172.21.15.62:0/4073278689 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f7f540662f0 0x7f7f540687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:14.649 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.643+0000 7f7f75388700 1 --2- 172.21.15.62:0/4073278689 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f7f540662f0 0x7f7f540687a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7f60000c00 tx=0x7f7f60008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:14.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.647+0000 7f7f667fc700 1 -- 172.21.15.62:0/4073278689 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7f6c050590 con 0x7f7f700cd2e0 2023-06-09T04:42:14.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.823+0000 7f7f76b8b700 1 -- 172.21.15.62:0/4073278689 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7f700739c0 con 0x7f7f700cd2e0 2023-06-09T04:42:14.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.823+0000 7f7f667fc700 1 -- 172.21.15.62:0/4073278689 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v30) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7f6c053bb0 con 0x7f7f700cd2e0 2023-06-09T04:42:14.828 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-06-09T04:42:14.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.827+0000 7f7f76b8b700 1 -- 172.21.15.62:0/4073278689 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f7f540662f0 msgr2=0x7f7f540687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:14.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.827+0000 7f7f76b8b700 1 --2- 172.21.15.62:0/4073278689 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f7f540662f0 0x7f7f540687a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7f60000c00 tx=0x7f7f60008030 comp rx=0 tx=0).stop 2023-06-09T04:42:14.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.827+0000 7f7f76b8b700 1 -- 172.21.15.62:0/4073278689 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7f700cd2e0 msgr2=0x7f7f700b0360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:14.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.827+0000 7f7f76b8b700 1 --2- 172.21.15.62:0/4073278689 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7f700cd2e0 0x7f7f700b0360 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c00c480 tx=0x7f7f6c00c790 comp rx=0 tx=0).stop 2023-06-09T04:42:14.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.827+0000 7f7f76b8b700 1 -- 172.21.15.62:0/4073278689 shutdown_connections 2023-06-09T04:42:14.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.827+0000 7f7f76b8b700 1 --2- 172.21.15.62:0/4073278689 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f7f540662f0 0x7f7f540687a0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:14.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.827+0000 7f7f76b8b700 1 --2- 172.21.15.62:0/4073278689 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f700d1f80 0x7f7f700d1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:14.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.827+0000 7f7f76b8b700 1 --2- 172.21.15.62:0/4073278689 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7f700cebf0 0x7f7f700d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:14.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.827+0000 7f7f76b8b700 1 --2- 172.21.15.62:0/4073278689 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7f700cd2e0 0x7f7f700b0360 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:14.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.827+0000 7f7f76b8b700 1 -- 172.21.15.62:0/4073278689 >> 172.21.15.62:0/4073278689 conn(0x7f7f70071840 msgr2=0x7f7f7006a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:14.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.827+0000 7f7f76b8b700 1 -- 172.21.15.62:0/4073278689 shutdown_connections 2023-06-09T04:42:14.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:14.827+0000 7f7f76b8b700 1 -- 172.21.15.62:0/4073278689 wait complete. 2023-06-09T04:42:14.858 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T04:42:15.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.031+0000 7efc7ccdf700 1 Processor -- start 2023-06-09T04:42:15.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.031+0000 7efc7ccdf700 1 -- start start 2023-06-09T04:42:15.039 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.031+0000 7efc7ccdf700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7efc780b31c0 0x7efc78164970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:15.039 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.031+0000 7efc7ccdf700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc780b0e50 con 0x7efc780b09b0 2023-06-09T04:42:15.039 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.031+0000 7efc7ccdf700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc780cda40 con 0x7efc78159e10 2023-06-09T04:42:15.039 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.031+0000 7efc7ccdf700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc780cd830 con 0x7efc780b31c0 2023-06-09T04:42:15.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.035+0000 7efc76d9d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7efc780b31c0 0x7efc78164970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:15.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.035+0000 7efc75d9b700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7efc780b09b0 0x7efc780b2ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:34274/0 (socket says 172.21.15.62:34274) 2023-06-09T04:42:15.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.035+0000 7efc75d9b700 1 -- 172.21.15.62:0/2181476210 learned_addr learned my addr 172.21.15.62:0/2181476210 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:42:15.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.035+0000 7efc76d9d700 1 -- 172.21.15.62:0/2181476210 >> v1:172.21.15.89:6789/0 conn(0x7efc78159e10 legacy=0x7efc7815e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:15.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.035+0000 7efc76d9d700 1 -- 172.21.15.62:0/2181476210 >> v1:172.21.15.62:6789/0 conn(0x7efc780b09b0 legacy=0x7efc780b2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:15.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.035+0000 7efc76d9d700 1 -- 172.21.15.62:0/2181476210 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc780cdd20 con 0x7efc780b31c0 2023-06-09T04:42:15.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.035+0000 7efc76d9d700 1 --2- 172.21.15.62:0/2181476210 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc780b31c0 0x7efc78164970 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7efc70009d90 tx=0x7efc7000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15bed73ff1505075 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:15.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.035+0000 7efc7559a700 1 -- 172.21.15.62:0/2181476210 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7000e070 con 0x7efc780b31c0 2023-06-09T04:42:15.042 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.035+0000 7efc7559a700 1 -- 172.21.15.62:0/2181476210 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc7000bbd0 con 0x7efc780b31c0 2023-06-09T04:42:15.042 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.035+0000 7efc7559a700 1 -- 172.21.15.62:0/2181476210 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc70012430 con 0x7efc780b31c0 2023-06-09T04:42:15.042 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.035+0000 7efc7ccdf700 1 -- 172.21.15.62:0/2181476210 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc780b31c0 msgr2=0x7efc78164970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:15.042 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.035+0000 7efc7ccdf700 1 --2- 172.21.15.62:0/2181476210 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc780b31c0 0x7efc78164970 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7efc70009d90 tx=0x7efc7000b330 comp rx=0 tx=0).stop 2023-06-09T04:42:15.043 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.035+0000 7efc7ccdf700 1 -- 172.21.15.62:0/2181476210 shutdown_connections 2023-06-09T04:42:15.043 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.035+0000 7efc7ccdf700 1 --2- 172.21.15.62:0/2181476210 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc780b31c0 0x7efc78164970 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:15.043 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.035+0000 7efc7ccdf700 1 -- 172.21.15.62:0/2181476210 >> 172.21.15.62:0/2181476210 conn(0x7efc7806c5d0 msgr2=0x7efc780cad60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:15.043 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.035+0000 7efc7ccdf700 1 -- 172.21.15.62:0/2181476210 shutdown_connections 2023-06-09T04:42:15.043 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.039+0000 7efc7ccdf700 1 -- 172.21.15.62:0/2181476210 wait complete. 2023-06-09T04:42:15.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.039+0000 7efc7ccdf700 1 Processor -- start 2023-06-09T04:42:15.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.043+0000 7efc7ccdf700 1 -- start start 2023-06-09T04:42:15.049 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.043+0000 7efc7ccdf700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc780b09b0 0x7efc780c5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:15.049 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.043+0000 7efc7ccdf700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc780b31c0 0x7efc780abf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:15.049 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.043+0000 7efc7ccdf700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc78159e10 0x7efc780ac4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:15.049 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.043+0000 7efc7ccdf700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc7815b230 con 0x7efc780b31c0 2023-06-09T04:42:15.049 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.043+0000 7efc7ccdf700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc7814c320 con 0x7efc78159e10 2023-06-09T04:42:15.049 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.043+0000 7efc7ccdf700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc7815b480 con 0x7efc780b09b0 2023-06-09T04:42:15.050 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.043+0000 7efc75d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc780b31c0 0x7efc780abf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:15.050 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.043+0000 7efc75d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc780b31c0 0x7efc780abf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40150/0 (socket says 172.21.15.62:40150) 2023-06-09T04:42:15.050 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.043+0000 7efc75d9b700 1 -- 172.21.15.62:0/442792719 learned_addr learned my addr 172.21.15.62:0/442792719 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:15.051 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.043+0000 7efc7659c700 1 --2- 172.21.15.62:0/442792719 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc780b09b0 0x7efc780c5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:15.051 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.043+0000 7efc76d9d700 1 --2- 172.21.15.62:0/442792719 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc78159e10 0x7efc780ac4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:15.051 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.043+0000 7efc75d9b700 1 -- 172.21.15.62:0/442792719 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc780b09b0 msgr2=0x7efc780c5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:15.051 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.043+0000 7efc75d9b700 1 --2- 172.21.15.62:0/442792719 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc780b09b0 0x7efc780c5c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:15.051 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.043+0000 7efc75d9b700 1 -- 172.21.15.62:0/442792719 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc78159e10 msgr2=0x7efc780ac4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:15.052 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.043+0000 7efc75d9b700 1 --2- 172.21.15.62:0/442792719 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc78159e10 0x7efc780ac4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:15.052 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.043+0000 7efc75d9b700 1 -- 172.21.15.62:0/442792719 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc70009a70 con 0x7efc780b31c0 2023-06-09T04:42:15.052 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.043+0000 7efc75d9b700 1 --2- 172.21.15.62:0/442792719 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc780b31c0 0x7efc780abf80 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7efc6c001eb0 tx=0x7efc6c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:15.052 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.043+0000 7efc66ffd700 1 -- 172.21.15.62:0/442792719 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6c005d90 con 0x7efc780b31c0 2023-06-09T04:42:15.052 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.043+0000 7efc66ffd700 1 -- 172.21.15.62:0/442792719 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc6c0070d0 con 0x7efc780b31c0 2023-06-09T04:42:15.052 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.043+0000 7efc66ffd700 1 -- 172.21.15.62:0/442792719 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6c007440 con 0x7efc780b31c0 2023-06-09T04:42:15.052 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.043+0000 7efc7ccdf700 1 -- 172.21.15.62:0/442792719 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc7815b760 con 0x7efc780b31c0 2023-06-09T04:42:15.053 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.043+0000 7efc7ccdf700 1 -- 172.21.15.62:0/442792719 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc7815bf60 con 0x7efc780b31c0 2023-06-09T04:42:15.053 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.047+0000 7efc7ccdf700 1 -- 172.21.15.62:0/442792719 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc7815e780 con 0x7efc780b31c0 2023-06-09T04:42:15.053 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.047+0000 7efc66ffd700 1 -- 172.21.15.62:0/442792719 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7efc6c0075a0 con 0x7efc780b31c0 2023-06-09T04:42:15.055 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.051+0000 7efc66ffd700 1 --2- 172.21.15.62:0/442792719 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7efc580662f0 0x7efc580687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:15.055 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.051+0000 7efc66ffd700 1 -- 172.21.15.62:0/442792719 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7efc6c083450 con 0x7efc780b31c0 2023-06-09T04:42:15.056 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.051+0000 7efc7659c700 1 --2- 172.21.15.62:0/442792719 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7efc580662f0 0x7efc580687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:15.057 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.051+0000 7efc7659c700 1 --2- 172.21.15.62:0/442792719 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7efc580662f0 0x7efc580687a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7efc68000f60 tx=0x7efc68009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:15.061 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.055+0000 7efc66ffd700 1 -- 172.21.15.62:0/442792719 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7efc7815e780 con 0x7efc780b31c0 2023-06-09T04:42:15.233 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.227+0000 7efc7ccdf700 1 -- 172.21.15.62:0/442792719 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efc7815e780 con 0x7efc780b31c0 2023-06-09T04:42:15.234 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.227+0000 7efc66ffd700 1 -- 172.21.15.62:0/442792719 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v30) v1 ==== 100+0+11 (secure 0 0 0) 0x7efc7815e780 con 0x7efc780b31c0 2023-06-09T04:42:15.235 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 64 2023-06-09T04:42:15.239 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.235+0000 7efc7ccdf700 1 -- 172.21.15.62:0/442792719 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7efc580662f0 msgr2=0x7efc580687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:15.240 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.235+0000 7efc7ccdf700 1 --2- 172.21.15.62:0/442792719 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7efc580662f0 0x7efc580687a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7efc68000f60 tx=0x7efc68009040 comp rx=0 tx=0).stop 2023-06-09T04:42:15.240 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.235+0000 7efc7ccdf700 1 -- 172.21.15.62:0/442792719 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc780b31c0 msgr2=0x7efc780abf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:15.240 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.235+0000 7efc7ccdf700 1 --2- 172.21.15.62:0/442792719 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc780b31c0 0x7efc780abf80 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7efc6c001eb0 tx=0x7efc6c00c860 comp rx=0 tx=0).stop 2023-06-09T04:42:15.240 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.235+0000 7efc7ccdf700 1 -- 172.21.15.62:0/442792719 shutdown_connections 2023-06-09T04:42:15.240 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.235+0000 7efc7ccdf700 1 --2- 172.21.15.62:0/442792719 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7efc580662f0 0x7efc580687a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:15.241 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.235+0000 7efc7ccdf700 1 --2- 172.21.15.62:0/442792719 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc78159e10 0x7efc780ac4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:15.241 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.235+0000 7efc7ccdf700 1 --2- 172.21.15.62:0/442792719 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc780b31c0 0x7efc780abf80 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:15.241 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.235+0000 7efc7ccdf700 1 --2- 172.21.15.62:0/442792719 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc780b09b0 0x7efc780c5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:15.241 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.235+0000 7efc7ccdf700 1 -- 172.21.15.62:0/442792719 >> 172.21.15.62:0/442792719 conn(0x7efc7806c5d0 msgr2=0x7efc78159040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:15.241 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.235+0000 7efc7ccdf700 1 -- 172.21.15.62:0/442792719 shutdown_connections 2023-06-09T04:42:15.242 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.235+0000 7efc7ccdf700 1 -- 172.21.15.62:0/442792719 wait complete. 2023-06-09T04:42:15.260 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-09T04:42:15.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.431+0000 7fc54734f700 1 Processor -- start 2023-06-09T04:42:15.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.435+0000 7fc54734f700 1 -- start start 2023-06-09T04:42:15.443 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.435+0000 7fc54734f700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fc540153290 0x7fc54006cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:15.443 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.435+0000 7fc54734f700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc54015d630 con 0x7fc54015cda0 2023-06-09T04:42:15.443 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.435+0000 7fc54734f700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc54015d350 con 0x7fc5400cd0e0 2023-06-09T04:42:15.443 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.435+0000 7fc54734f700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc54006c8e0 con 0x7fc540153290 2023-06-09T04:42:15.445 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.439+0000 7fc546b4e700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fc54015cda0 0x7fc54006fdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:34276/0 (socket says 172.21.15.62:34276) 2023-06-09T04:42:15.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.439+0000 7fc546b4e700 1 -- 172.21.15.62:0/273898497 learned_addr learned my addr 172.21.15.62:0/273898497 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:42:15.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.439+0000 7fc54634d700 1 --2- 172.21.15.62:0/273898497 >> v2:172.21.15.89:3300/0 conn(0x7fc540153290 0x7fc54006cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:15.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.439+0000 7fc54534b700 1 -- 172.21.15.62:0/273898497 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4099103228 0 0) 0x7fc54015d630 con 0x7fc54015cda0 2023-06-09T04:42:15.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.439+0000 7fc54534b700 1 -- 172.21.15.62:0/273898497 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc52c0057e0 con 0x7fc54015cda0 2023-06-09T04:42:15.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.439+0000 7fc54534b700 1 -- 172.21.15.62:0/273898497 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 495291537 0 0) 0x7fc54015d350 con 0x7fc5400cd0e0 2023-06-09T04:42:15.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.439+0000 7fc54534b700 1 -- 172.21.15.62:0/273898497 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc54015d630 con 0x7fc5400cd0e0 2023-06-09T04:42:15.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.439+0000 7fc54634d700 1 -- 172.21.15.62:0/273898497 >> v1:172.21.15.89:6789/0 conn(0x7fc5400cd0e0 legacy=0x7fc54015c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:15.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.439+0000 7fc54634d700 1 -- 172.21.15.62:0/273898497 >> v1:172.21.15.62:6789/0 conn(0x7fc54015cda0 legacy=0x7fc54006fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:15.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.439+0000 7fc54634d700 1 -- 172.21.15.62:0/273898497 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc54006c220 con 0x7fc540153290 2023-06-09T04:42:15.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.439+0000 7fc54634d700 1 --2- 172.21.15.62:0/273898497 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc540153290 0x7fc54006cd00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc53c009850 tx=0x7fc53c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d183f0071412fcb server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:15.448 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.439+0000 7fc54534b700 1 -- 172.21.15.62:0/273898497 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc53c011830 con 0x7fc540153290 2023-06-09T04:42:15.448 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.439+0000 7fc54534b700 1 -- 172.21.15.62:0/273898497 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc53c011990 con 0x7fc540153290 2023-06-09T04:42:15.448 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.439+0000 7fc54534b700 1 -- 172.21.15.62:0/273898497 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc53c011d40 con 0x7fc540153290 2023-06-09T04:42:15.448 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.439+0000 7fc54734f700 1 -- 172.21.15.62:0/273898497 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc540153290 msgr2=0x7fc54006cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:15.448 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.439+0000 7fc54734f700 1 --2- 172.21.15.62:0/273898497 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc540153290 0x7fc54006cd00 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc53c009850 tx=0x7fc53c009b60 comp rx=0 tx=0).stop 2023-06-09T04:42:15.449 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.443+0000 7fc54734f700 1 -- 172.21.15.62:0/273898497 shutdown_connections 2023-06-09T04:42:15.449 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.443+0000 7fc54734f700 1 --2- 172.21.15.62:0/273898497 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc540153290 0x7fc54006cd00 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:15.449 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.443+0000 7fc54734f700 1 -- 172.21.15.62:0/273898497 >> 172.21.15.62:0/273898497 conn(0x7fc5400cab50 msgr2=0x7fc5400caf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:15.449 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.443+0000 7fc54734f700 1 -- 172.21.15.62:0/273898497 shutdown_connections 2023-06-09T04:42:15.449 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.443+0000 7fc54734f700 1 -- 172.21.15.62:0/273898497 wait complete. 2023-06-09T04:42:15.450 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.443+0000 7fc54734f700 1 Processor -- start 2023-06-09T04:42:15.450 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.443+0000 7fc54734f700 1 -- start start 2023-06-09T04:42:15.452 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.447+0000 7fc54734f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5400cd0e0 0x7fc5400b0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:15.452 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.447+0000 7fc54734f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc540153290 0x7fc5400c4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:15.452 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.447+0000 7fc54734f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc54015cda0 0x7fc54014f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:15.452 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.447+0000 7fc54734f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc540159f90 con 0x7fc54015cda0 2023-06-09T04:42:15.452 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.447+0000 7fc54734f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5400b14e0 con 0x7fc5400cd0e0 2023-06-09T04:42:15.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.447+0000 7fc54734f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5400b17c0 con 0x7fc540153290 2023-06-09T04:42:15.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.447+0000 7fc546b4e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc54015cda0 0x7fc54014f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:15.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.447+0000 7fc546b4e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc54015cda0 0x7fc54014f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40158/0 (socket says 172.21.15.62:40158) 2023-06-09T04:42:15.454 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.447+0000 7fc546b4e700 1 -- 172.21.15.62:0/1638018501 learned_addr learned my addr 172.21.15.62:0/1638018501 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:15.454 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.447+0000 7fc54634d700 1 --2- 172.21.15.62:0/1638018501 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5400cd0e0 0x7fc5400b0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:15.454 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.447+0000 7fc545b4c700 1 --2- 172.21.15.62:0/1638018501 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc540153290 0x7fc5400c4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:15.454 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.447+0000 7fc546b4e700 1 -- 172.21.15.62:0/1638018501 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc540153290 msgr2=0x7fc5400c4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:15.454 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.447+0000 7fc546b4e700 1 --2- 172.21.15.62:0/1638018501 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc540153290 0x7fc5400c4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:15.454 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.447+0000 7fc546b4e700 1 -- 172.21.15.62:0/1638018501 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5400cd0e0 msgr2=0x7fc5400b0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:15.455 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.447+0000 7fc546b4e700 1 --2- 172.21.15.62:0/1638018501 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5400cd0e0 0x7fc5400b0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:15.455 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.447+0000 7fc546b4e700 1 -- 172.21.15.62:0/1638018501 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc53c0094b0 con 0x7fc54015cda0 2023-06-09T04:42:15.455 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.447+0000 7fc546b4e700 1 --2- 172.21.15.62:0/1638018501 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc54015cda0 0x7fc54014f8a0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fc53800caf0 tx=0x7fc53800cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:15.455 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.447+0000 7fc536ffd700 1 -- 172.21.15.62:0/1638018501 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc538007480 con 0x7fc54015cda0 2023-06-09T04:42:15.456 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.447+0000 7fc536ffd700 1 -- 172.21.15.62:0/1638018501 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5380075e0 con 0x7fc54015cda0 2023-06-09T04:42:15.456 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.447+0000 7fc536ffd700 1 -- 172.21.15.62:0/1638018501 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc538007950 con 0x7fc54015cda0 2023-06-09T04:42:15.456 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.447+0000 7fc54734f700 1 -- 172.21.15.62:0/1638018501 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5400b1aa0 con 0x7fc54015cda0 2023-06-09T04:42:15.456 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.447+0000 7fc54734f700 1 -- 172.21.15.62:0/1638018501 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5400c4b60 con 0x7fc54015cda0 2023-06-09T04:42:15.456 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.451+0000 7fc54734f700 1 -- 172.21.15.62:0/1638018501 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc540159d60 con 0x7fc54015cda0 2023-06-09T04:42:15.457 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.451+0000 7fc536ffd700 1 -- 172.21.15.62:0/1638018501 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fc53801b3b0 con 0x7fc54015cda0 2023-06-09T04:42:15.459 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.455+0000 7fc536ffd700 1 --2- 172.21.15.62:0/1638018501 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fc5240662f0 0x7fc5240687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:15.459 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.455+0000 7fc536ffd700 1 -- 172.21.15.62:0/1638018501 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc5380837e0 con 0x7fc54015cda0 2023-06-09T04:42:15.460 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.455+0000 7fc54634d700 1 --2- 172.21.15.62:0/1638018501 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fc5240662f0 0x7fc5240687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:15.461 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.455+0000 7fc54634d700 1 --2- 172.21.15.62:0/1638018501 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fc5240662f0 0x7fc5240687a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc53c0090b0 tx=0x7fc53c008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:15.464 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.459+0000 7fc536ffd700 1 -- 172.21.15.62:0/1638018501 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fc540159d60 con 0x7fc54015cda0 2023-06-09T04:42:15.639 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.631+0000 7fc54734f700 1 -- 172.21.15.62:0/1638018501 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fc540159d60 con 0x7fc54015cda0 2023-06-09T04:42:15.640 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.635+0000 7fc536ffd700 1 -- 172.21.15.62:0/1638018501 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v30) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc540159d60 con 0x7fc54015cda0 2023-06-09T04:42:15.640 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-06-09T04:42:15.643 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.635+0000 7fc54734f700 1 -- 172.21.15.62:0/1638018501 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fc5240662f0 msgr2=0x7fc5240687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:15.643 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.635+0000 7fc54734f700 1 --2- 172.21.15.62:0/1638018501 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fc5240662f0 0x7fc5240687a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc53c0090b0 tx=0x7fc53c008030 comp rx=0 tx=0).stop 2023-06-09T04:42:15.643 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.635+0000 7fc54734f700 1 -- 172.21.15.62:0/1638018501 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc54015cda0 msgr2=0x7fc54014f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:15.643 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.635+0000 7fc54734f700 1 --2- 172.21.15.62:0/1638018501 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc54015cda0 0x7fc54014f8a0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fc53800caf0 tx=0x7fc53800cb20 comp rx=0 tx=0).stop 2023-06-09T04:42:15.644 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.639+0000 7fc54734f700 1 -- 172.21.15.62:0/1638018501 shutdown_connections 2023-06-09T04:42:15.644 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.639+0000 7fc54734f700 1 --2- 172.21.15.62:0/1638018501 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fc5240662f0 0x7fc5240687a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:15.644 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.639+0000 7fc54734f700 1 --2- 172.21.15.62:0/1638018501 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc54015cda0 0x7fc54014f8a0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:15.644 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.639+0000 7fc54734f700 1 --2- 172.21.15.62:0/1638018501 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fc540153290 0x7fc5400c4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:15.644 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.639+0000 7fc54734f700 1 --2- 172.21.15.62:0/1638018501 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc5400cd0e0 0x7fc5400b0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:15.644 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.639+0000 7fc54734f700 1 -- 172.21.15.62:0/1638018501 >> 172.21.15.62:0/1638018501 conn(0x7fc5400cab50 msgr2=0x7fc540157a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:15.645 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.639+0000 7fc54734f700 1 -- 172.21.15.62:0/1638018501 shutdown_connections 2023-06-09T04:42:15.645 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.639+0000 7fc54734f700 1 -- 172.21.15.62:0/1638018501 wait complete. 2023-06-09T04:42:15.664 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-09T04:42:15.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.835+0000 7f533c089700 1 Processor -- start 2023-06-09T04:42:15.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.835+0000 7f533c089700 1 -- start start 2023-06-09T04:42:15.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.835+0000 7f533c089700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5334163570 0x7f53340697f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:15.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.835+0000 7f533c089700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f53340cce90 0x7f5334069d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:15.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.835+0000 7f533c089700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5334163940 0x7f5334070e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:15.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.835+0000 7f533c089700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5334164d80 con 0x7f53340cce90 2023-06-09T04:42:15.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.835+0000 7f533c089700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5334164200 con 0x7f5334163940 2023-06-09T04:42:15.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.835+0000 7f533c089700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53341644e0 con 0x7f5334163570 2023-06-09T04:42:15.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.835+0000 7f5339624700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f53340cce90 0x7f5334069d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:15.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.835+0000 7f5339624700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f53340cce90 0x7f5334069d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40168/0 (socket says 172.21.15.62:40168) 2023-06-09T04:42:15.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.835+0000 7f5339624700 1 -- 172.21.15.62:0/2703706193 learned_addr learned my addr 172.21.15.62:0/2703706193 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:15.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.835+0000 7f533a626700 1 --2- 172.21.15.62:0/2703706193 >> v2:172.21.15.89:3300/0 conn(0x7f5334163940 0x7f5334070e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:15.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.835+0000 7f5339e25700 1 --2- 172.21.15.62:0/2703706193 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5334163570 0x7f53340697f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:15.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.839+0000 7f533a626700 1 -- 172.21.15.62:0/2703706193 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5334163570 msgr2=0x7f53340697f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:15.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.839+0000 7f533a626700 1 --2- 172.21.15.62:0/2703706193 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5334163570 0x7f53340697f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:15.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.839+0000 7f533a626700 1 -- 172.21.15.62:0/2703706193 >> v2:172.21.15.62:3300/0 conn(0x7f53340cce90 msgr2=0x7f5334069d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:15.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.839+0000 7f533a626700 1 --2- 172.21.15.62:0/2703706193 >> v2:172.21.15.62:3300/0 conn(0x7f53340cce90 0x7f5334069d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:15.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.839+0000 7f533a626700 1 -- 172.21.15.62:0/2703706193 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53341647c0 con 0x7f5334163940 2023-06-09T04:42:15.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.839+0000 7f5339624700 1 --2- 172.21.15.62:0/2703706193 >> v2:172.21.15.62:3300/0 conn(0x7f53340cce90 0x7f5334069d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:42:15.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.839+0000 7f533a626700 1 --2- 172.21.15.62:0/2703706193 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5334163940 0x7f5334070e80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f533406a8b0 tx=0x7f532c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5c3ae22acb00d59 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:15.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.839+0000 7f5338e23700 1 -- 172.21.15.62:0/2703706193 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f532c00e070 con 0x7f5334163940 2023-06-09T04:42:15.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.839+0000 7f5338e23700 1 -- 172.21.15.62:0/2703706193 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f532c00bb20 con 0x7f5334163940 2023-06-09T04:42:15.847 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.839+0000 7f5338e23700 1 -- 172.21.15.62:0/2703706193 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f532c012430 con 0x7f5334163940 2023-06-09T04:42:15.847 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.839+0000 7f533c089700 1 -- 172.21.15.62:0/2703706193 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5334163940 msgr2=0x7f5334070e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:15.847 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.839+0000 7f533c089700 1 --2- 172.21.15.62:0/2703706193 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5334163940 0x7f5334070e80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f533406a8b0 tx=0x7f532c00b330 comp rx=0 tx=0).stop 2023-06-09T04:42:15.847 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.839+0000 7f533c089700 1 -- 172.21.15.62:0/2703706193 shutdown_connections 2023-06-09T04:42:15.847 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.839+0000 7f533c089700 1 --2- 172.21.15.62:0/2703706193 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5334163940 0x7f5334070e80 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:15.847 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.839+0000 7f533c089700 1 --2- 172.21.15.62:0/2703706193 >> v2:172.21.15.62:3300/0 conn(0x7f53340cce90 0x7f5334069d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:15.847 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.839+0000 7f533c089700 1 --2- 172.21.15.62:0/2703706193 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5334163570 0x7f53340697f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:15.847 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.839+0000 7f533c089700 1 -- 172.21.15.62:0/2703706193 >> 172.21.15.62:0/2703706193 conn(0x7f53340b1aa0 msgr2=0x7f53340cf2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:15.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.839+0000 7f533c089700 1 -- 172.21.15.62:0/2703706193 shutdown_connections 2023-06-09T04:42:15.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.839+0000 7f533c089700 1 -- 172.21.15.62:0/2703706193 wait complete. 2023-06-09T04:42:15.849 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.843+0000 7f533c089700 1 Processor -- start 2023-06-09T04:42:15.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.843+0000 7f533c089700 1 -- start start 2023-06-09T04:42:15.851 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.847+0000 7f533c089700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f53340cce90 0x7f53340c6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:15.851 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.847+0000 7f533c089700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5334163570 0x7f53340c5540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:15.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.847+0000 7f533c089700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5334163940 0x7f53340c8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:15.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.847+0000 7f533c089700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53340b3550 con 0x7f53340cce90 2023-06-09T04:42:15.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.847+0000 7f533c089700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53340c6430 con 0x7f5334163570 2023-06-09T04:42:15.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.847+0000 7f533c089700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53340c6710 con 0x7f5334163940 2023-06-09T04:42:15.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.847+0000 7f5339e25700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f53340cce90 0x7f53340c6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:15.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.847+0000 7f5339e25700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f53340cce90 0x7f53340c6f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40182/0 (socket says 172.21.15.62:40182) 2023-06-09T04:42:15.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.847+0000 7f5339e25700 1 -- 172.21.15.62:0/3802792283 learned_addr learned my addr 172.21.15.62:0/3802792283 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:15.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.847+0000 7f5339624700 1 --2- 172.21.15.62:0/3802792283 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5334163570 0x7f53340c5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:15.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.847+0000 7f533a626700 1 --2- 172.21.15.62:0/3802792283 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5334163940 0x7f53340c8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:15.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.847+0000 7f5339e25700 1 -- 172.21.15.62:0/3802792283 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5334163940 msgr2=0x7f53340c8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:15.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.847+0000 7f5339e25700 1 --2- 172.21.15.62:0/3802792283 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5334163940 0x7f53340c8d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:15.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.847+0000 7f5339e25700 1 -- 172.21.15.62:0/3802792283 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5334163570 msgr2=0x7f53340c5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:15.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.847+0000 7f5339e25700 1 --2- 172.21.15.62:0/3802792283 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5334163570 0x7f53340c5540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:15.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.847+0000 7f5339e25700 1 -- 172.21.15.62:0/3802792283 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5324009570 con 0x7f53340cce90 2023-06-09T04:42:15.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.847+0000 7f5339e25700 1 --2- 172.21.15.62:0/3802792283 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f53340cce90 0x7f53340c6f10 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f533000e9d0 tx=0x7f533000ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:15.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.847+0000 7f532a7fc700 1 -- 172.21.15.62:0/3802792283 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5330009720 con 0x7f53340cce90 2023-06-09T04:42:15.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.847+0000 7f532a7fc700 1 -- 172.21.15.62:0/3802792283 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f533000c850 con 0x7f53340cce90 2023-06-09T04:42:15.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.847+0000 7f533c089700 1 -- 172.21.15.62:0/3802792283 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f532c009a70 con 0x7f53340cce90 2023-06-09T04:42:15.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.847+0000 7f532a7fc700 1 -- 172.21.15.62:0/3802792283 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f533000cbc0 con 0x7f53340cce90 2023-06-09T04:42:15.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.847+0000 7f533c089700 1 -- 172.21.15.62:0/3802792283 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53340b3830 con 0x7f53340cce90 2023-06-09T04:42:15.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.847+0000 7f533c089700 1 -- 172.21.15.62:0/3802792283 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5334066bb0 con 0x7f53340cce90 2023-06-09T04:42:15.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.851+0000 7f532a7fc700 1 -- 172.21.15.62:0/3802792283 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f533000cd20 con 0x7f53340cce90 2023-06-09T04:42:15.858 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.851+0000 7f532a7fc700 1 --2- 172.21.15.62:0/3802792283 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f53180662f0 0x7f53180687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:15.858 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.851+0000 7f532a7fc700 1 -- 172.21.15.62:0/3802792283 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f5330084170 con 0x7f53340cce90 2023-06-09T04:42:15.859 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.855+0000 7f5339624700 1 --2- 172.21.15.62:0/3802792283 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f53180662f0 0x7f53180687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:15.860 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.855+0000 7f5339624700 1 --2- 172.21.15.62:0/3802792283 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f53180662f0 0x7f53180687a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f53340b0d60 tx=0x7f5324008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:15.863 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:15.859+0000 7f532a7fc700 1 -- 172.21.15.62:0/3802792283 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5330054cb0 con 0x7f53340cce90 2023-06-09T04:42:16.073 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.067+0000 7f533c089700 1 -- 172.21.15.62:0/3802792283 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f53340b5240 con 0x7f53340cce90 2023-06-09T04:42:16.074 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.067+0000 7f532a7fc700 1 -- 172.21.15.62:0/3802792283 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4664 (secure 0 0 0) 0x7f5330054840 con 0x7f53340cce90 2023-06-09T04:42:16.075 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:42:16.075 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4256,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/2242182358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2242182358},{"type":"v1","addr":"172.21.15.89:6836","nonce":2242182358}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6834/326702802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":326702802},{"type":"v1","addr":"172.21.15.62:6834","nonce":326702802}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4296,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/3851882562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":3851882562},{"type":"v1","addr":"172.21.15.62:6835","nonce":3851882562}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-09T04:40:56.758756+0000","modified":"2023-06-09T04:41:23.381650+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4312},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4312":{"gid":4312,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6837/1496954959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1496954959},{"type":"v1","addr":"172.21.15.89:6837","nonce":1496954959}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-09T04:42:16.078 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.071+0000 7f533c089700 1 -- 172.21.15.62:0/3802792283 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f53180662f0 msgr2=0x7f53180687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:16.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.071+0000 7f533c089700 1 --2- 172.21.15.62:0/3802792283 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f53180662f0 0x7f53180687a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f53340b0d60 tx=0x7f5324008040 comp rx=0 tx=0).stop 2023-06-09T04:42:16.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.071+0000 7f533c089700 1 -- 172.21.15.62:0/3802792283 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f53340cce90 msgr2=0x7f53340c6f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:16.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.071+0000 7f533c089700 1 --2- 172.21.15.62:0/3802792283 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f53340cce90 0x7f53340c6f10 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f533000e9d0 tx=0x7f533000ed90 comp rx=0 tx=0).stop 2023-06-09T04:42:16.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.071+0000 7f533c089700 1 -- 172.21.15.62:0/3802792283 shutdown_connections 2023-06-09T04:42:16.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.071+0000 7f533c089700 1 --2- 172.21.15.62:0/3802792283 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f53180662f0 0x7f53180687a0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:16.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.071+0000 7f533c089700 1 --2- 172.21.15.62:0/3802792283 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5334163940 0x7f53340c8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:16.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.071+0000 7f533c089700 1 --2- 172.21.15.62:0/3802792283 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5334163570 0x7f53340c5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:16.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.071+0000 7f533c089700 1 --2- 172.21.15.62:0/3802792283 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f53340cce90 0x7f53340c6f10 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:16.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.071+0000 7f533c089700 1 -- 172.21.15.62:0/3802792283 >> 172.21.15.62:0/3802792283 conn(0x7f53340b1aa0 msgr2=0x7f5334161b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:16.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.071+0000 7f533c089700 1 -- 172.21.15.62:0/3802792283 shutdown_connections 2023-06-09T04:42:16.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.071+0000 7f533c089700 1 -- 172.21.15.62:0/3802792283 wait complete. 2023-06-09T04:42:16.081 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 9 2023-06-09T04:42:16.101 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:42:16.284 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.279+0000 7f0f4cc7d700 1 Processor -- start 2023-06-09T04:42:16.284 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.279+0000 7f0f4cc7d700 1 -- start start 2023-06-09T04:42:16.285 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.279+0000 7f0f4cc7d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f480ce9c0 0x7f0f480cc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:16.286 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.279+0000 7f0f4cc7d700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f480b51e0 con 0x7f0f480ccf20 2023-06-09T04:42:16.286 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.279+0000 7f0f4cc7d700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f480d0190 con 0x7f0f480d1ac0 2023-06-09T04:42:16.286 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.279+0000 7f0f4cc7d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f480d29f0 con 0x7f0f480ce9c0 2023-06-09T04:42:16.287 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.279+0000 7f0f47fff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f0f480ccf20 0x7f0f48165730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:34286/0 (socket says 172.21.15.62:34286) 2023-06-09T04:42:16.287 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.279+0000 7f0f477fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f480ce9c0 0x7f0f480cc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:16.287 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.279+0000 7f0f47fff700 1 -- 172.21.15.62:0/3420226749 learned_addr learned my addr 172.21.15.62:0/3420226749 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:42:16.288 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.283+0000 7f0f477fe700 1 -- 172.21.15.62:0/3420226749 >> v1:172.21.15.89:6789/0 conn(0x7f0f480d1ac0 legacy=0x7f0f480ced90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:16.288 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.283+0000 7f0f477fe700 1 -- 172.21.15.62:0/3420226749 >> v1:172.21.15.62:6789/0 conn(0x7f0f480ccf20 legacy=0x7f0f48165730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:16.288 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.283+0000 7f0f477fe700 1 -- 172.21.15.62:0/3420226749 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f480d2cd0 con 0x7f0f480ce9c0 2023-06-09T04:42:16.288 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.283+0000 7f0f467fc700 1 -- 172.21.15.62:0/3420226749 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1929837856 0 0) 0x7f0f480b51e0 con 0x7f0f480ccf20 2023-06-09T04:42:16.289 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.283+0000 7f0f477fe700 1 --2- 172.21.15.62:0/3420226749 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f480ce9c0 0x7f0f480cc9e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0f38009880 tx=0x7f0f38009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18bc0cd0e0eb0270 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:16.289 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.283+0000 7f0f467fc700 1 -- 172.21.15.62:0/3420226749 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f38011830 con 0x7f0f480ce9c0 2023-06-09T04:42:16.289 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.283+0000 7f0f467fc700 1 -- 172.21.15.62:0/3420226749 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f38011990 con 0x7f0f480ce9c0 2023-06-09T04:42:16.289 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.283+0000 7f0f467fc700 1 -- 172.21.15.62:0/3420226749 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f38011d20 con 0x7f0f480ce9c0 2023-06-09T04:42:16.290 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.283+0000 7f0f4cc7d700 1 -- 172.21.15.62:0/3420226749 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f480ce9c0 msgr2=0x7f0f480cc9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:16.290 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.283+0000 7f0f4cc7d700 1 --2- 172.21.15.62:0/3420226749 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f480ce9c0 0x7f0f480cc9e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0f38009880 tx=0x7f0f38009b90 comp rx=0 tx=0).stop 2023-06-09T04:42:16.290 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.283+0000 7f0f4cc7d700 1 -- 172.21.15.62:0/3420226749 shutdown_connections 2023-06-09T04:42:16.290 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.283+0000 7f0f4cc7d700 1 --2- 172.21.15.62:0/3420226749 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f480ce9c0 0x7f0f480cc9e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:16.290 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.283+0000 7f0f4cc7d700 1 -- 172.21.15.62:0/3420226749 >> 172.21.15.62:0/3420226749 conn(0x7f0f48070f20 msgr2=0x7f0f480712f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:16.291 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.283+0000 7f0f4cc7d700 1 -- 172.21.15.62:0/3420226749 shutdown_connections 2023-06-09T04:42:16.291 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.283+0000 7f0f4cc7d700 1 -- 172.21.15.62:0/3420226749 wait complete. 2023-06-09T04:42:16.292 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.287+0000 7f0f4cc7d700 1 Processor -- start 2023-06-09T04:42:16.292 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.287+0000 7f0f4cc7d700 1 -- start start 2023-06-09T04:42:16.294 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.287+0000 7f0f4cc7d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0f480ce9c0 0x7f0f481484d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:16.294 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.287+0000 7f0f4cc7d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f480b6900 0x7f0f480c8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:16.294 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.287+0000 7f0f4cc7d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f480c5ec0 0x7f0f480c6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:16.294 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.287+0000 7f0f4cc7d700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f480c6870 con 0x7f0f480ce9c0 2023-06-09T04:42:16.294 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.287+0000 7f0f4cc7d700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f481492a0 con 0x7f0f480b6900 2023-06-09T04:42:16.294 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.287+0000 7f0f4cc7d700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f480b6e00 con 0x7f0f480c5ec0 2023-06-09T04:42:16.295 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.287+0000 7f0f477fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0f480ce9c0 0x7f0f481484d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:16.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.287+0000 7f0f477fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0f480ce9c0 0x7f0f481484d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40188/0 (socket says 172.21.15.62:40188) 2023-06-09T04:42:16.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.287+0000 7f0f477fe700 1 -- 172.21.15.62:0/1220910777 learned_addr learned my addr 172.21.15.62:0/1220910777 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:16.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.287+0000 7f0f47fff700 1 --2- 172.21.15.62:0/1220910777 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f480c5ec0 0x7f0f480c6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:16.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.287+0000 7f0f46ffd700 1 --2- 172.21.15.62:0/1220910777 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f480b6900 0x7f0f480c8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:16.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.287+0000 7f0f477fe700 1 -- 172.21.15.62:0/1220910777 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f480c5ec0 msgr2=0x7f0f480c6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:16.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.287+0000 7f0f477fe700 1 --2- 172.21.15.62:0/1220910777 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f480c5ec0 0x7f0f480c6330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:16.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.287+0000 7f0f477fe700 1 -- 172.21.15.62:0/1220910777 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f480b6900 msgr2=0x7f0f480c8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:16.297 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.287+0000 7f0f477fe700 1 --2- 172.21.15.62:0/1220910777 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f480b6900 0x7f0f480c8b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:16.297 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.291+0000 7f0f477fe700 1 -- 172.21.15.62:0/1220910777 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f380094b0 con 0x7f0f480ce9c0 2023-06-09T04:42:16.297 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.291+0000 7f0f477fe700 1 --2- 172.21.15.62:0/1220910777 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0f480ce9c0 0x7f0f481484d0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f0f380097d0 tx=0x7f0f38004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:16.297 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.291+0000 7f0f2ffff700 1 -- 172.21.15.62:0/1220910777 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f3800bbd0 con 0x7f0f480ce9c0 2023-06-09T04:42:16.298 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.291+0000 7f0f4cc7d700 1 -- 172.21.15.62:0/1220910777 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f480b70e0 con 0x7f0f480ce9c0 2023-06-09T04:42:16.298 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.291+0000 7f0f2ffff700 1 -- 172.21.15.62:0/1220910777 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f3801f070 con 0x7f0f480ce9c0 2023-06-09T04:42:16.298 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.291+0000 7f0f2ffff700 1 -- 172.21.15.62:0/1220910777 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f3801a430 con 0x7f0f480ce9c0 2023-06-09T04:42:16.298 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.291+0000 7f0f4cc7d700 1 -- 172.21.15.62:0/1220910777 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f48148a10 con 0x7f0f480ce9c0 2023-06-09T04:42:16.298 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.291+0000 7f0f4cc7d700 1 -- 172.21.15.62:0/1220910777 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f48148d90 con 0x7f0f480ce9c0 2023-06-09T04:42:16.300 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.295+0000 7f0f2ffff700 1 -- 172.21.15.62:0/1220910777 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0f3801a590 con 0x7f0f480ce9c0 2023-06-09T04:42:16.301 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.295+0000 7f0f2ffff700 1 --2- 172.21.15.62:0/1220910777 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f0f340662f0 0x7f0f340687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:16.301 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.295+0000 7f0f2ffff700 1 -- 172.21.15.62:0/1220910777 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0f38021070 con 0x7f0f480ce9c0 2023-06-09T04:42:16.302 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.295+0000 7f0f46ffd700 1 --2- 172.21.15.62:0/1220910777 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f0f340662f0 0x7f0f340687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:16.303 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.299+0000 7f0f46ffd700 1 --2- 172.21.15.62:0/1220910777 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f0f340662f0 0x7f0f340687a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0f480b6560 tx=0x7f0f3c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:16.307 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.303+0000 7f0f2ffff700 1 -- 172.21.15.62:0/1220910777 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0f48148d90 con 0x7f0f480ce9c0 2023-06-09T04:42:16.485 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.479+0000 7f0f4cc7d700 1 -- 172.21.15.62:0/1220910777 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0f48148d90 con 0x7f0f480ce9c0 2023-06-09T04:42:16.487 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.479+0000 7f0f2ffff700 1 -- 172.21.15.62:0/1220910777 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+20180 (secure 0 0 0) 0x7f0f48148d90 con 0x7f0f480ce9c0 2023-06-09T04:42:16.488 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:42:16.488 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":30,"fsid":"f7998a1e-e5a9-4202-abaa-70c0eaae1047","created":"2023-06-09T04:40:30.469588+0000","modified":"2023-06-09T04:41:38.495589+0000","last_up_change":"2023-06-09T04:40:43.120747+0000","last_in_change":"2023-06-09T04:40:33.568221+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:40:44.646921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:40:50.006643+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:40:55.031273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:40:55.773517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-09T04:40:58.845383+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bc50bbc0-dd08-42ed-804c-ec3029e36c19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6802","nonce":1295788017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6807","nonce":1295788017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6815","nonce":1295788017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6809","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6811","nonce":1295788017}]},"public_addr":"172.21.15.62:6802/1295788017","cluster_addr":"172.21.15.62:6807/1295788017","heartbeat_back_addr":"172.21.15.62:6815/1295788017","heartbeat_front_addr":"172.21.15.62:6811/1295788017","state":["exists","up"]},{"osd":1,"uuid":"8230b12d-e22f-4985-a584-4cc64404cdbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6825","nonce":4120692006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6827","nonce":4120692006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6831","nonce":4120692006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6829","nonce":4120692006}]},"public_addr":"172.21.15.62:6825/4120692006","cluster_addr":"172.21.15.62:6827/4120692006","heartbeat_back_addr":"172.21.15.62:6831/4120692006","heartbeat_front_addr":"172.21.15.62:6829/4120692006","state":["exists","up"]},{"osd":2,"uuid":"d0202506-dbe9-4e3c-9271-687929abf96a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6801","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6803","nonce":4169607876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6805","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6806","nonce":4169607876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6814","nonce":4169607876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6810","nonce":4169607876}]},"public_addr":"172.21.15.62:6803/4169607876","cluster_addr":"172.21.15.62:6806/4169607876","heartbeat_back_addr":"172.21.15.62:6814/4169607876","heartbeat_front_addr":"172.21.15.62:6810/4169607876","state":["exists","up"]},{"osd":3,"uuid":"f3c0298a-b075-4411-af50-e16cd74fdddb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6817","nonce":3268438986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6819","nonce":3268438986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6823","nonce":3268438986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6821","nonce":3268438986}]},"public_addr":"172.21.15.62:6817/3268438986","cluster_addr":"172.21.15.62:6819/3268438986","heartbeat_back_addr":"172.21.15.62:6823/3268438986","heartbeat_front_addr":"172.21.15.62:6821/3268438986","state":["exists","up"]},{"osd":4,"uuid":"1ab5c5ca-e74f-475a-a309-683cc0029928","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6817","nonce":3139617628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6819","nonce":3139617628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6823","nonce":3139617628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6821","nonce":3139617628}]},"public_addr":"172.21.15.89:6817/3139617628","cluster_addr":"172.21.15.89:6819/3139617628","heartbeat_back_addr":"172.21.15.89:6823/3139617628","heartbeat_front_addr":"172.21.15.89:6821/3139617628","state":["exists","up"]},{"osd":5,"uuid":"a933e184-bd8f-4369-a1ba-a68de53c578c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6825","nonce":2681723596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6827","nonce":2681723596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6831","nonce":2681723596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6829","nonce":2681723596}]},"public_addr":"172.21.15.89:6825/2681723596","cluster_addr":"172.21.15.89:6827/2681723596","heartbeat_back_addr":"172.21.15.89:6831/2681723596","heartbeat_front_addr":"172.21.15.89:6829/2681723596","state":["exists","up"]},{"osd":6,"uuid":"1ed7ad37-2eee-49a6-954c-b537e2b7f0ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6809","nonce":1657136033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6811","nonce":1657136033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6815","nonce":1657136033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6813","nonce":1657136033}]},"public_addr":"172.21.15.89:6809/1657136033","cluster_addr":"172.21.15.89:6811/1657136033","heartbeat_back_addr":"172.21.15.89:6815/1657136033","heartbeat_front_addr":"172.21.15.89:6813/1657136033","state":["exists","up"]},{"osd":7,"uuid":"6ed732e9-33ff-40df-9038-a9f1d1622671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6801","nonce":1710561686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6803","nonce":1710561686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6807","nonce":1710561686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6805","nonce":1710561686}]},"public_addr":"172.21.15.89:6801/1710561686","cluster_addr":"172.21.15.89:6803/1710561686","heartbeat_back_addr":"172.21.15.89:6807/1710561686","heartbeat_front_addr":"172.21.15.89:6805/1710561686","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.335803+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.419788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.179334+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.263310+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.071846+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.375627+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.282277+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.315997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.12","mappings":[{"from":1,"to":2}]},{"pgid":"4.19","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:42:16.490 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.483+0000 7f0f4cc7d700 1 -- 172.21.15.62:0/1220910777 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f0f340662f0 msgr2=0x7f0f340687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:16.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.483+0000 7f0f4cc7d700 1 --2- 172.21.15.62:0/1220910777 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f0f340662f0 0x7f0f340687a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0f480b6560 tx=0x7f0f3c009040 comp rx=0 tx=0).stop 2023-06-09T04:42:16.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.483+0000 7f0f4cc7d700 1 -- 172.21.15.62:0/1220910777 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0f480ce9c0 msgr2=0x7f0f481484d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:16.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.483+0000 7f0f4cc7d700 1 --2- 172.21.15.62:0/1220910777 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0f480ce9c0 0x7f0f481484d0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f0f380097d0 tx=0x7f0f38004770 comp rx=0 tx=0).stop 2023-06-09T04:42:16.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.483+0000 7f0f4cc7d700 1 -- 172.21.15.62:0/1220910777 shutdown_connections 2023-06-09T04:42:16.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.483+0000 7f0f4cc7d700 1 --2- 172.21.15.62:0/1220910777 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f0f340662f0 0x7f0f340687a0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:16.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.483+0000 7f0f4cc7d700 1 --2- 172.21.15.62:0/1220910777 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f0f480c5ec0 0x7f0f480c6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:16.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.483+0000 7f0f4cc7d700 1 --2- 172.21.15.62:0/1220910777 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0f480b6900 0x7f0f480c8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:16.492 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.483+0000 7f0f4cc7d700 1 --2- 172.21.15.62:0/1220910777 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0f480ce9c0 0x7f0f481484d0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:16.492 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.483+0000 7f0f4cc7d700 1 -- 172.21.15.62:0/1220910777 >> 172.21.15.62:0/1220910777 conn(0x7f0f48070f20 msgr2=0x7f0f480b51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:16.492 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.483+0000 7f0f4cc7d700 1 -- 172.21.15.62:0/1220910777 shutdown_connections 2023-06-09T04:42:16.493 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.483+0000 7f0f4cc7d700 1 -- 172.21.15.62:0/1220910777 wait complete. 2023-06-09T04:42:16.513 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-06-09T04:42:16.514 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-09T04:42:16.694 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.687+0000 7f93f1fec700 1 Processor -- start 2023-06-09T04:42:16.694 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.687+0000 7f93f1fec700 1 -- start start 2023-06-09T04:42:16.697 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.691+0000 7f93f1fec700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f93ec0cc030 0x7f93ec0cd750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:16.698 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.691+0000 7f93f1fec700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f93ec0c8840 0x7f93ec0cdc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:16.698 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.691+0000 7f93f1fec700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f93ec0cc400 0x7f93ec0ca090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:16.698 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.691+0000 7f93f1fec700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93ec0cb6c0 con 0x7f93ec0cc030 2023-06-09T04:42:16.699 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.691+0000 7f93f1fec700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93ec0ccfe0 con 0x7f93ec0cc400 2023-06-09T04:42:16.699 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.691+0000 7f93f1fec700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93ec0c1360 con 0x7f93ec0c8840 2023-06-09T04:42:16.699 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.691+0000 7f93eb7fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f93ec0cc030 0x7f93ec0cd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:16.699 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.691+0000 7f93eb7fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f93ec0cc030 0x7f93ec0cd750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40202/0 (socket says 172.21.15.62:40202) 2023-06-09T04:42:16.700 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.691+0000 7f93eb7fe700 1 -- 172.21.15.62:0/2009263886 learned_addr learned my addr 172.21.15.62:0/2009263886 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:16.700 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.691+0000 7f93ebfff700 1 --2- 172.21.15.62:0/2009263886 >> v2:172.21.15.89:3300/0 conn(0x7f93ec0cc400 0x7f93ec0ca090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:16.700 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.691+0000 7f93e3fff700 1 --2- 172.21.15.62:0/2009263886 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f93ec0c8840 0x7f93ec0cdc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:16.702 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.691+0000 7f93eb7fe700 1 -- 172.21.15.62:0/2009263886 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f93ec0c8840 msgr2=0x7f93ec0cdc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:16.702 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.691+0000 7f93eb7fe700 1 --2- 172.21.15.62:0/2009263886 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f93ec0c8840 0x7f93ec0cdc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:16.703 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.691+0000 7f93eb7fe700 1 -- 172.21.15.62:0/2009263886 >> v2:172.21.15.89:3300/0 conn(0x7f93ec0cc400 msgr2=0x7f93ec0ca090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:16.703 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.691+0000 7f93eb7fe700 1 --2- 172.21.15.62:0/2009263886 >> v2:172.21.15.89:3300/0 conn(0x7f93ec0cc400 0x7f93ec0ca090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:16.703 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.691+0000 7f93eb7fe700 1 -- 172.21.15.62:0/2009263886 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93ec0c1080 con 0x7f93ec0cc030 2023-06-09T04:42:16.703 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.691+0000 7f93eb7fe700 1 --2- 172.21.15.62:0/2009263886 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f93ec0cc030 0x7f93ec0cd750 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f93ec06c850 tx=0x7f93dc009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=838469abc65ba085 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:16.703 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.695+0000 7f93eaffd700 1 -- 172.21.15.62:0/2009263886 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93dc011830 con 0x7f93ec0cc030 2023-06-09T04:42:16.703 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.695+0000 7f93eaffd700 1 -- 172.21.15.62:0/2009263886 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93dc011990 con 0x7f93ec0cc030 2023-06-09T04:42:16.704 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.695+0000 7f93eaffd700 1 -- 172.21.15.62:0/2009263886 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93dc011d20 con 0x7f93ec0cc030 2023-06-09T04:42:16.704 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.695+0000 7f93f1fec700 1 -- 172.21.15.62:0/2009263886 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f93ec0cc030 msgr2=0x7f93ec0cd750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:16.704 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.695+0000 7f93f1fec700 1 --2- 172.21.15.62:0/2009263886 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f93ec0cc030 0x7f93ec0cd750 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f93ec06c850 tx=0x7f93dc009bf0 comp rx=0 tx=0).stop 2023-06-09T04:42:16.704 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.695+0000 7f93f1fec700 1 -- 172.21.15.62:0/2009263886 shutdown_connections 2023-06-09T04:42:16.704 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.695+0000 7f93f1fec700 1 --2- 172.21.15.62:0/2009263886 >> v2:172.21.15.89:3300/0 conn(0x7f93ec0cc400 0x7f93ec0ca090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:16.704 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.695+0000 7f93f1fec700 1 --2- 172.21.15.62:0/2009263886 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f93ec0c8840 0x7f93ec0cdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:16.704 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.695+0000 7f93f1fec700 1 --2- 172.21.15.62:0/2009263886 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f93ec0cc030 0x7f93ec0cd750 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:16.705 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.695+0000 7f93f1fec700 1 -- 172.21.15.62:0/2009263886 >> 172.21.15.62:0/2009263886 conn(0x7f93ec06a410 msgr2=0x7f93ec0afd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:16.705 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.695+0000 7f93f1fec700 1 -- 172.21.15.62:0/2009263886 shutdown_connections 2023-06-09T04:42:16.705 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.695+0000 7f93f1fec700 1 -- 172.21.15.62:0/2009263886 wait complete. 2023-06-09T04:42:16.706 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.695+0000 7f93f1fec700 1 Processor -- start 2023-06-09T04:42:16.706 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.695+0000 7f93f1fec700 1 -- start start 2023-06-09T04:42:16.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.699+0000 7f93f1fec700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f93ec0c8840 0x7f93ec1547d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:16.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.699+0000 7f93f1fec700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f93ec0cc030 0x7f93ec0c3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:16.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.699+0000 7f93f1fec700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93ec0cc400 0x7f93ec0c55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:16.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.699+0000 7f93f1fec700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93ec0b21a0 con 0x7f93ec0cc030 2023-06-09T04:42:16.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.699+0000 7f93f1fec700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93ec0b1590 con 0x7f93ec0cc400 2023-06-09T04:42:16.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.699+0000 7f93f1fec700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93ec0b1870 con 0x7f93ec0c8840 2023-06-09T04:42:16.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.699+0000 7f93e3fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f93ec0cc030 0x7f93ec0c3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:16.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.699+0000 7f93e3fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f93ec0cc030 0x7f93ec0c3c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40214/0 (socket says 172.21.15.62:40214) 2023-06-09T04:42:16.708 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.699+0000 7f93e3fff700 1 -- 172.21.15.62:0/2957943984 learned_addr learned my addr 172.21.15.62:0/2957943984 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:16.708 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.699+0000 7f93eb7fe700 1 --2- 172.21.15.62:0/2957943984 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f93ec0c8840 0x7f93ec1547d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:16.708 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.699+0000 7f93ebfff700 1 --2- 172.21.15.62:0/2957943984 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93ec0cc400 0x7f93ec0c55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:16.708 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.699+0000 7f93e3fff700 1 -- 172.21.15.62:0/2957943984 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f93ec0c8840 msgr2=0x7f93ec1547d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:16.708 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.699+0000 7f93e3fff700 1 --2- 172.21.15.62:0/2957943984 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f93ec0c8840 0x7f93ec1547d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:16.708 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.699+0000 7f93e3fff700 1 -- 172.21.15.62:0/2957943984 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93ec0cc400 msgr2=0x7f93ec0c55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:16.708 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.699+0000 7f93e3fff700 1 --2- 172.21.15.62:0/2957943984 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93ec0cc400 0x7f93ec0c55e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:16.709 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.699+0000 7f93e3fff700 1 -- 172.21.15.62:0/2957943984 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93dc009570 con 0x7f93ec0cc030 2023-06-09T04:42:16.709 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.699+0000 7f93e3fff700 1 --2- 172.21.15.62:0/2957943984 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f93ec0cc030 0x7f93ec0c3c70 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f93d400d800 tx=0x7f93d400db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:16.709 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.699+0000 7f93e8ff9700 1 -- 172.21.15.62:0/2957943984 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d40125f0 con 0x7f93ec0cc030 2023-06-09T04:42:16.709 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.699+0000 7f93f1fec700 1 -- 172.21.15.62:0/2957943984 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93ec0b1b50 con 0x7f93ec0cc030 2023-06-09T04:42:16.709 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.699+0000 7f93e8ff9700 1 -- 172.21.15.62:0/2957943984 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93d4012750 con 0x7f93ec0cc030 2023-06-09T04:42:16.709 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.699+0000 7f93e8ff9700 1 -- 172.21.15.62:0/2957943984 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d4012ae0 con 0x7f93ec0cc030 2023-06-09T04:42:16.709 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.699+0000 7f93f1fec700 1 -- 172.21.15.62:0/2957943984 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93ec0c2ff0 con 0x7f93ec0cc030 2023-06-09T04:42:16.710 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.703+0000 7f93f1fec700 1 -- 172.21.15.62:0/2957943984 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93ec0b2350 con 0x7f93ec0cc030 2023-06-09T04:42:16.710 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.703+0000 7f93e8ff9700 1 -- 172.21.15.62:0/2957943984 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f93d4012c40 con 0x7f93ec0cc030 2023-06-09T04:42:16.711 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.707+0000 7f93e8ff9700 1 --2- 172.21.15.62:0/2957943984 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f93cc0662f0 0x7f93cc0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:16.711 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.707+0000 7f93e8ff9700 1 -- 172.21.15.62:0/2957943984 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f93d4084390 con 0x7f93ec0cc030 2023-06-09T04:42:16.712 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.707+0000 7f93eb7fe700 1 --2- 172.21.15.62:0/2957943984 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f93cc0662f0 0x7f93cc0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:16.713 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.707+0000 7f93eb7fe700 1 --2- 172.21.15.62:0/2957943984 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f93cc0662f0 0x7f93cc0687a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f93dc000c00 tx=0x7f93dc008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:16.718 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.711+0000 7f93e8ff9700 1 -- 172.21.15.62:0/2957943984 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f93ec0b2350 con 0x7f93ec0cc030 2023-06-09T04:42:16.935 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.927+0000 7f93f1fec700 1 -- 172.21.15.62:0/2957943984 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f93ec04db30 con 0x7f93ec0cc030 2023-06-09T04:42:16.936 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.931+0000 7f93e8ff9700 1 -- 172.21.15.62:0/2957943984 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4664 (secure 0 0 0) 0x7f93d40513c0 con 0x7f93ec0cc030 2023-06-09T04:42:16.937 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:42:16.937 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4256,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/2242182358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2242182358},{"type":"v1","addr":"172.21.15.89:6836","nonce":2242182358}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6834/326702802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":326702802},{"type":"v1","addr":"172.21.15.62:6834","nonce":326702802}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4296,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/3851882562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":3851882562},{"type":"v1","addr":"172.21.15.62:6835","nonce":3851882562}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-09T04:40:56.758756+0000","modified":"2023-06-09T04:41:23.381650+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4312},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4312":{"gid":4312,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6837/1496954959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1496954959},{"type":"v1","addr":"172.21.15.89:6837","nonce":1496954959}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-09T04:42:16.939 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.931+0000 7f93f1fec700 1 -- 172.21.15.62:0/2957943984 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f93cc0662f0 msgr2=0x7f93cc0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:16.939 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.931+0000 7f93f1fec700 1 --2- 172.21.15.62:0/2957943984 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f93cc0662f0 0x7f93cc0687a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f93dc000c00 tx=0x7f93dc008030 comp rx=0 tx=0).stop 2023-06-09T04:42:16.939 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.931+0000 7f93f1fec700 1 -- 172.21.15.62:0/2957943984 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f93ec0cc030 msgr2=0x7f93ec0c3c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:16.940 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.931+0000 7f93f1fec700 1 --2- 172.21.15.62:0/2957943984 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f93ec0cc030 0x7f93ec0c3c70 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f93d400d800 tx=0x7f93d400db10 comp rx=0 tx=0).stop 2023-06-09T04:42:16.940 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.935+0000 7f93f1fec700 1 -- 172.21.15.62:0/2957943984 shutdown_connections 2023-06-09T04:42:16.940 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.935+0000 7f93f1fec700 1 --2- 172.21.15.62:0/2957943984 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f93cc0662f0 0x7f93cc0687a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:16.940 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.935+0000 7f93f1fec700 1 --2- 172.21.15.62:0/2957943984 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93ec0cc400 0x7f93ec0c55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:16.940 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.935+0000 7f93f1fec700 1 --2- 172.21.15.62:0/2957943984 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f93ec0cc030 0x7f93ec0c3c70 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:16.940 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.935+0000 7f93f1fec700 1 --2- 172.21.15.62:0/2957943984 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f93ec0c8840 0x7f93ec1547d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:16.940 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.935+0000 7f93f1fec700 1 -- 172.21.15.62:0/2957943984 >> 172.21.15.62:0/2957943984 conn(0x7f93ec06a410 msgr2=0x7f93ec0ca090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:16.941 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.935+0000 7f93f1fec700 1 -- 172.21.15.62:0/2957943984 shutdown_connections 2023-06-09T04:42:16.941 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:16.935+0000 7f93f1fec700 1 -- 172.21.15.62:0/2957943984 wait complete. 2023-06-09T04:42:16.942 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 9 2023-06-09T04:42:16.962 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-09T04:42:17.141 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.135+0000 7fbda98b2700 1 Processor -- start 2023-06-09T04:42:17.142 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.135+0000 7fbda98b2700 1 -- start start 2023-06-09T04:42:17.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.139+0000 7fbda98b2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbda40cee40 0x7fbda40ce6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:17.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.139+0000 7fbda98b2700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbda40b5280 0x7fbda40d12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:17.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.139+0000 7fbda98b2700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbda40cec10 con 0x7fbda406afc0 2023-06-09T04:42:17.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.139+0000 7fbda98b2700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbda40ccb20 con 0x7fbda40b5280 2023-06-09T04:42:17.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.139+0000 7fbda98b2700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbda40cce00 con 0x7fbda40cee40 2023-06-09T04:42:17.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.139+0000 7fbda90b1700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbda40b5280 0x7fbda40d12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:17.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.139+0000 7fbda90b1700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbda40b5280 0x7fbda40d12b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40226/0 (socket says 172.21.15.62:40226) 2023-06-09T04:42:17.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.139+0000 7fbda90b1700 1 -- 172.21.15.62:0/2009463641 learned_addr learned my addr 172.21.15.62:0/2009463641 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:17.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.139+0000 7fbda3fff700 1 --1- 172.21.15.62:0/2009463641 >> v1:172.21.15.62:6789/0 conn(0x7fbda406afc0 0x7fbda40cf210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:34288/0 (socket says 172.21.15.62:34288) 2023-06-09T04:42:17.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.139+0000 7fbda88b0700 1 --2- 172.21.15.62:0/2009463641 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbda40cee40 0x7fbda40ce6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:17.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.139+0000 7fbda37fe700 1 -- 172.21.15.62:0/2009463641 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1280652773 0 0) 0x7fbda40cec10 con 0x7fbda406afc0 2023-06-09T04:42:17.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.139+0000 7fbda37fe700 1 -- 172.21.15.62:0/2009463641 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd940035d0 con 0x7fbda406afc0 2023-06-09T04:42:17.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.139+0000 7fbda90b1700 1 -- 172.21.15.62:0/2009463641 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbda40cee40 msgr2=0x7fbda40ce6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:17.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.139+0000 7fbda90b1700 1 --2- 172.21.15.62:0/2009463641 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbda40cee40 0x7fbda40ce6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:17.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.139+0000 7fbda90b1700 1 -- 172.21.15.62:0/2009463641 >> v1:172.21.15.62:6789/0 conn(0x7fbda406afc0 legacy=0x7fbda40cf210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:17.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.139+0000 7fbda90b1700 1 -- 172.21.15.62:0/2009463641 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda40cd0e0 con 0x7fbda40b5280 2023-06-09T04:42:17.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.139+0000 7fbda90b1700 1 --2- 172.21.15.62:0/2009463641 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbda40b5280 0x7fbda40d12b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c009e50 tx=0x7fbd9c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6b47f010d2ebd1 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:17.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.139+0000 7fbda37fe700 1 -- 172.21.15.62:0/2009463641 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd9c00e070 con 0x7fbda40b5280 2023-06-09T04:42:17.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.139+0000 7fbda37fe700 1 -- 172.21.15.62:0/2009463641 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd9c00b910 con 0x7fbda40b5280 2023-06-09T04:42:17.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.139+0000 7fbda37fe700 1 -- 172.21.15.62:0/2009463641 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd9c00bcc0 con 0x7fbda40b5280 2023-06-09T04:42:17.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.143+0000 7fbda98b2700 1 -- 172.21.15.62:0/2009463641 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbda40b5280 msgr2=0x7fbda40d12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:17.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.143+0000 7fbda98b2700 1 --2- 172.21.15.62:0/2009463641 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbda40b5280 0x7fbda40d12b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c009e50 tx=0x7fbd9c00b330 comp rx=0 tx=0).stop 2023-06-09T04:42:17.149 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.143+0000 7fbda98b2700 1 -- 172.21.15.62:0/2009463641 shutdown_connections 2023-06-09T04:42:17.149 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.143+0000 7fbda98b2700 1 --2- 172.21.15.62:0/2009463641 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbda40b5280 0x7fbda40d12b0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:17.149 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.143+0000 7fbda98b2700 1 --2- 172.21.15.62:0/2009463641 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbda40cee40 0x7fbda40ce6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:17.149 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.143+0000 7fbda98b2700 1 -- 172.21.15.62:0/2009463641 >> 172.21.15.62:0/2009463641 conn(0x7fbda406a4b0 msgr2=0x7fbda406a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:17.149 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.143+0000 7fbda98b2700 1 -- 172.21.15.62:0/2009463641 shutdown_connections 2023-06-09T04:42:17.149 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.143+0000 7fbda98b2700 1 -- 172.21.15.62:0/2009463641 wait complete. 2023-06-09T04:42:17.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.143+0000 7fbda98b2700 1 Processor -- start 2023-06-09T04:42:17.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.143+0000 7fbda98b2700 1 -- start start 2023-06-09T04:42:17.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.147+0000 7fbda98b2700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbda406afc0 0x7fbda40cbd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:17.152 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.147+0000 7fbda98b2700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbda40b5280 0x7fbda41523e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:17.152 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.147+0000 7fbda98b2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbda40cee40 0x7fbda40c9e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:17.152 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.147+0000 7fbda98b2700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda40c7760 con 0x7fbda406afc0 2023-06-09T04:42:17.152 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.147+0000 7fbda98b2700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda40cc640 con 0x7fbda40b5280 2023-06-09T04:42:17.152 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.147+0000 7fbda98b2700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbda40cc360 con 0x7fbda40cee40 2023-06-09T04:42:17.153 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.147+0000 7fbda88b0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbda406afc0 0x7fbda40cbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:17.153 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.147+0000 7fbda88b0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbda406afc0 0x7fbda40cbd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40234/0 (socket says 172.21.15.62:40234) 2023-06-09T04:42:17.153 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.147+0000 7fbda88b0700 1 -- 172.21.15.62:0/1305181133 learned_addr learned my addr 172.21.15.62:0/1305181133 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:17.153 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.147+0000 7fbda90b1700 1 --2- 172.21.15.62:0/1305181133 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbda40cee40 0x7fbda40c9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:17.154 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.147+0000 7fbda3fff700 1 --2- 172.21.15.62:0/1305181133 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbda40b5280 0x7fbda41523e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:17.154 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.147+0000 7fbda88b0700 1 -- 172.21.15.62:0/1305181133 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbda40cee40 msgr2=0x7fbda40c9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:17.154 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.147+0000 7fbda88b0700 1 --2- 172.21.15.62:0/1305181133 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbda40cee40 0x7fbda40c9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:17.154 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.147+0000 7fbda88b0700 1 -- 172.21.15.62:0/1305181133 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbda40b5280 msgr2=0x7fbda41523e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:17.154 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.147+0000 7fbda88b0700 1 --2- 172.21.15.62:0/1305181133 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbda40b5280 0x7fbda41523e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:17.154 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.147+0000 7fbda88b0700 1 -- 172.21.15.62:0/1305181133 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd9c009b30 con 0x7fbda406afc0 2023-06-09T04:42:17.154 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.147+0000 7fbda88b0700 1 --2- 172.21.15.62:0/1305181133 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbda406afc0 0x7fbda40cbd80 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fbd9800e870 tx=0x7fbd9800ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:17.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.147+0000 7fbda17fa700 1 -- 172.21.15.62:0/1305181133 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd980095a0 con 0x7fbda406afc0 2023-06-09T04:42:17.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.147+0000 7fbda17fa700 1 -- 172.21.15.62:0/1305181133 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd9800ee70 con 0x7fbda406afc0 2023-06-09T04:42:17.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.147+0000 7fbda98b2700 1 -- 172.21.15.62:0/1305181133 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbda40c70a0 con 0x7fbda406afc0 2023-06-09T04:42:17.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.147+0000 7fbda17fa700 1 -- 172.21.15.62:0/1305181133 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd9800ca50 con 0x7fbda406afc0 2023-06-09T04:42:17.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.147+0000 7fbda98b2700 1 -- 172.21.15.62:0/1305181133 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbda4152af0 con 0x7fbda406afc0 2023-06-09T04:42:17.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.151+0000 7fbda98b2700 1 -- 172.21.15.62:0/1305181133 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbda40c78a0 con 0x7fbda406afc0 2023-06-09T04:42:17.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.151+0000 7fbda17fa700 1 -- 172.21.15.62:0/1305181133 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fbd9800cbb0 con 0x7fbda406afc0 2023-06-09T04:42:17.158 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.151+0000 7fbda17fa700 1 --2- 172.21.15.62:0/1305181133 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fbd880662f0 0x7fbd880687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:17.158 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.151+0000 7fbda17fa700 1 -- 172.21.15.62:0/1305181133 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fbd98083f50 con 0x7fbda406afc0 2023-06-09T04:42:17.159 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.155+0000 7fbda3fff700 1 --2- 172.21.15.62:0/1305181133 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fbd880662f0 0x7fbd880687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:17.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.155+0000 7fbda3fff700 1 --2- 172.21.15.62:0/1305181133 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fbd880662f0 0x7fbd880687a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fbda40c5a60 tx=0x7fbd90007c00 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:17.164 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.159+0000 7fbda17fa700 1 -- 172.21.15.62:0/1305181133 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fbda40c78a0 con 0x7fbda406afc0 2023-06-09T04:42:17.376 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.371+0000 7fbda98b2700 1 -- 172.21.15.62:0/1305181133 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbda40c78a0 con 0x7fbda406afc0 2023-06-09T04:42:17.377 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.371+0000 7fbda17fa700 1 -- 172.21.15.62:0/1305181133 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4664 (secure 0 0 0) 0x7fbd98017090 con 0x7fbda406afc0 2023-06-09T04:42:17.378 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:42:17.378 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4256,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6836/2242182358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":2242182358},{"type":"v1","addr":"172.21.15.89:6836","nonce":2242182358}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4293,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6834/326702802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":326702802},{"type":"v1","addr":"172.21.15.62:6834","nonce":326702802}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4296,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/3851882562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":3851882562},{"type":"v1","addr":"172.21.15.62:6835","nonce":3851882562}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-09T04:40:56.758756+0000","modified":"2023-06-09T04:41:23.381650+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4312},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4312":{"gid":4312,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.89:6837/1496954959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6835","nonce":1496954959},{"type":"v1","addr":"172.21.15.89:6837","nonce":1496954959}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-09T04:42:17.380 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.375+0000 7fbda98b2700 1 -- 172.21.15.62:0/1305181133 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fbd880662f0 msgr2=0x7fbd880687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:17.380 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.375+0000 7fbda98b2700 1 --2- 172.21.15.62:0/1305181133 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fbd880662f0 0x7fbd880687a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fbda40c5a60 tx=0x7fbd90007c00 comp rx=0 tx=0).stop 2023-06-09T04:42:17.380 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.375+0000 7fbda98b2700 1 -- 172.21.15.62:0/1305181133 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbda406afc0 msgr2=0x7fbda40cbd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:17.380 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.375+0000 7fbda98b2700 1 --2- 172.21.15.62:0/1305181133 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbda406afc0 0x7fbda40cbd80 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fbd9800e870 tx=0x7fbd9800ec30 comp rx=0 tx=0).stop 2023-06-09T04:42:17.381 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.375+0000 7fbda98b2700 1 -- 172.21.15.62:0/1305181133 shutdown_connections 2023-06-09T04:42:17.381 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.375+0000 7fbda98b2700 1 --2- 172.21.15.62:0/1305181133 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fbd880662f0 0x7fbd880687a0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:17.381 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.375+0000 7fbda98b2700 1 --2- 172.21.15.62:0/1305181133 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fbda40cee40 0x7fbda40c9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:17.381 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.375+0000 7fbda98b2700 1 --2- 172.21.15.62:0/1305181133 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbda40b5280 0x7fbda41523e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:17.382 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.375+0000 7fbda98b2700 1 --2- 172.21.15.62:0/1305181133 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbda406afc0 0x7fbda40cbd80 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:17.382 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.375+0000 7fbda98b2700 1 -- 172.21.15.62:0/1305181133 >> 172.21.15.62:0/1305181133 conn(0x7fbda406a4b0 msgr2=0x7fbda40cffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:17.382 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.375+0000 7fbda98b2700 1 -- 172.21.15.62:0/1305181133 shutdown_connections 2023-06-09T04:42:17.382 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.375+0000 7fbda98b2700 1 -- 172.21.15.62:0/1305181133 wait complete. 2023-06-09T04:42:17.383 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 9 2023-06-09T04:42:17.405 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:42:17.580 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.575+0000 7f9784ab2700 1 Processor -- start 2023-06-09T04:42:17.581 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.575+0000 7f9784ab2700 1 -- start start 2023-06-09T04:42:17.584 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.579+0000 7f9784ab2700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9780160340 0x7f97800caa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:17.584 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.579+0000 7f9784ab2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97800caf80 0x7f9780163df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:17.584 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.579+0000 7f9784ab2700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97800cdc20 con 0x7f978015ff70 2023-06-09T04:42:17.585 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.579+0000 7f9784ab2700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97800cb400 con 0x7f9780160340 2023-06-09T04:42:17.585 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.579+0000 7f9784ab2700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97800cd330 con 0x7f97800caf80 2023-06-09T04:42:17.585 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.579+0000 7f9777fff700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f9780160340 0x7f97800caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:17.586 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.579+0000 7f977ffff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97800caf80 0x7f9780163df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:17.586 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.579+0000 7f977f7fe700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f978015ff70 0x7f97800c9cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.62:52740/0 (socket says 172.21.15.62:52740) 2023-06-09T04:42:17.586 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.579+0000 7f977f7fe700 1 -- 172.21.15.62:0/175115890 learned_addr learned my addr 172.21.15.62:0/175115890 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:42:17.586 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.579+0000 7f977effd700 1 -- 172.21.15.62:0/175115890 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 608723825 0 0) 0x7f97800cdc20 con 0x7f978015ff70 2023-06-09T04:42:17.586 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.579+0000 7f977effd700 1 -- 172.21.15.62:0/175115890 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f976c0035d0 con 0x7f978015ff70 2023-06-09T04:42:17.586 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.579+0000 7f9777fff700 1 -- 172.21.15.62:0/175115890 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97800caf80 msgr2=0x7f9780163df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:17.587 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.579+0000 7f9777fff700 1 --2- 172.21.15.62:0/175115890 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97800caf80 0x7f9780163df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:17.587 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.579+0000 7f9777fff700 1 -- 172.21.15.62:0/175115890 >> v1:172.21.15.89:6789/0 conn(0x7f978015ff70 legacy=0x7f97800c9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:17.587 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.579+0000 7f9777fff700 1 -- 172.21.15.62:0/175115890 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97800cd5d0 con 0x7f9780160340 2023-06-09T04:42:17.587 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.579+0000 7f977ffff700 1 --2- 172.21.15.62:0/175115890 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97800caf80 0x7f9780163df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:42:17.587 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.579+0000 7f9777fff700 1 --2- 172.21.15.62:0/175115890 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9780160340 0x7f97800caa40 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9768009850 tx=0x7f9768009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9aff4e9d733a75d server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:17.588 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.583+0000 7f977effd700 1 -- 172.21.15.62:0/175115890 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9768011830 con 0x7f9780160340 2023-06-09T04:42:17.588 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.583+0000 7f977effd700 1 -- 172.21.15.62:0/175115890 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9768011990 con 0x7f9780160340 2023-06-09T04:42:17.588 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.583+0000 7f977effd700 1 -- 172.21.15.62:0/175115890 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9768011d40 con 0x7f9780160340 2023-06-09T04:42:17.589 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.583+0000 7f9784ab2700 1 -- 172.21.15.62:0/175115890 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9780160340 msgr2=0x7f97800caa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:17.589 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.583+0000 7f9784ab2700 1 --2- 172.21.15.62:0/175115890 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9780160340 0x7f97800caa40 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9768009850 tx=0x7f9768009b60 comp rx=0 tx=0).stop 2023-06-09T04:42:17.589 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.583+0000 7f9784ab2700 1 -- 172.21.15.62:0/175115890 shutdown_connections 2023-06-09T04:42:17.589 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.583+0000 7f9784ab2700 1 --2- 172.21.15.62:0/175115890 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9780160340 0x7f97800caa40 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:17.590 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.583+0000 7f9784ab2700 1 --2- 172.21.15.62:0/175115890 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f97800caf80 0x7f9780163df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:17.590 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.583+0000 7f9784ab2700 1 -- 172.21.15.62:0/175115890 >> 172.21.15.62:0/175115890 conn(0x7f978006a420 msgr2=0x7f97800afc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:17.590 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.583+0000 7f9784ab2700 1 -- 172.21.15.62:0/175115890 shutdown_connections 2023-06-09T04:42:17.590 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.583+0000 7f9784ab2700 1 -- 172.21.15.62:0/175115890 wait complete. 2023-06-09T04:42:17.591 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.587+0000 7f9784ab2700 1 Processor -- start 2023-06-09T04:42:17.592 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.587+0000 7f9784ab2700 1 -- start start 2023-06-09T04:42:17.593 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.587+0000 7f9784ab2700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f978015ff70 0x7f97801f56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:17.593 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.587+0000 7f9784ab2700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9780160340 0x7f97800c1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:17.593 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.587+0000 7f9784ab2700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9780154f70 0x7f9780160780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:17.593 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.587+0000 7f9784ab2700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97801f5c30 con 0x7f9780160340 2023-06-09T04:42:17.594 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.587+0000 7f9784ab2700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9780154de0 con 0x7f9780154f70 2023-06-09T04:42:17.594 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.587+0000 7f9784ab2700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97800c2360 con 0x7f978015ff70 2023-06-09T04:42:17.594 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.587+0000 7f9777fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9780160340 0x7f97800c1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:17.595 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.587+0000 7f977f7fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f978015ff70 0x7f97801f56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:17.595 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.587+0000 7f977f7fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f978015ff70 0x7f97801f56f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.62:47000/0 (socket says 172.21.15.62:47000) 2023-06-09T04:42:17.595 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.587+0000 7f9777fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9780160340 0x7f97800c1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40240/0 (socket says 172.21.15.62:40240) 2023-06-09T04:42:17.595 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.587+0000 7f977f7fe700 1 -- 172.21.15.62:0/1566191341 learned_addr learned my addr 172.21.15.62:0/1566191341 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:17.595 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.587+0000 7f977ffff700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9780154f70 0x7f9780160780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:17.595 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.587+0000 7f9777fff700 1 -- 172.21.15.62:0/1566191341 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f978015ff70 msgr2=0x7f97801f56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:17.595 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.587+0000 7f9777fff700 1 --2- 172.21.15.62:0/1566191341 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f978015ff70 0x7f97801f56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:17.596 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.587+0000 7f9777fff700 1 -- 172.21.15.62:0/1566191341 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9780154f70 msgr2=0x7f9780160780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:17.596 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.587+0000 7f9777fff700 1 --2- 172.21.15.62:0/1566191341 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9780154f70 0x7f9780160780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:17.596 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.587+0000 7f9777fff700 1 -- 172.21.15.62:0/1566191341 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9778009a70 con 0x7f9780160340 2023-06-09T04:42:17.596 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.591+0000 7f9777fff700 1 --2- 172.21.15.62:0/1566191341 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9780160340 0x7f97800c1e20 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f9768016000 tx=0x7f9768004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:17.597 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.591+0000 7f977cff9700 1 -- 172.21.15.62:0/1566191341 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9768004450 con 0x7f9780160340 2023-06-09T04:42:17.597 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.591+0000 7f977cff9700 1 -- 172.21.15.62:0/1566191341 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f976801f070 con 0x7f9780160340 2023-06-09T04:42:17.597 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.591+0000 7f9784ab2700 1 -- 172.21.15.62:0/1566191341 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97680094b0 con 0x7f9780160340 2023-06-09T04:42:17.597 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.591+0000 7f977cff9700 1 -- 172.21.15.62:0/1566191341 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9768003900 con 0x7f9780160340 2023-06-09T04:42:17.597 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.591+0000 7f9784ab2700 1 -- 172.21.15.62:0/1566191341 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97800c3900 con 0x7f9780160340 2023-06-09T04:42:17.598 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.591+0000 7f9784ab2700 1 -- 172.21.15.62:0/1566191341 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97800c3a90 con 0x7f9780160340 2023-06-09T04:42:17.600 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.595+0000 7f977cff9700 1 -- 172.21.15.62:0/1566191341 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9768003a60 con 0x7f9780160340 2023-06-09T04:42:17.601 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.595+0000 7f977cff9700 1 --2- 172.21.15.62:0/1566191341 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f97600662f0 0x7f97600687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:17.601 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.595+0000 7f977cff9700 1 -- 172.21.15.62:0/1566191341 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9768021070 con 0x7f9780160340 2023-06-09T04:42:17.602 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.595+0000 7f977f7fe700 1 --2- 172.21.15.62:0/1566191341 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f97600662f0 0x7f97600687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:17.603 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.599+0000 7f977f7fe700 1 --2- 172.21.15.62:0/1566191341 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f97600662f0 0x7f97600687a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9770005930 tx=0x7f9770009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:17.609 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.603+0000 7f977cff9700 1 -- 172.21.15.62:0/1566191341 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9768052670 con 0x7f9780160340 2023-06-09T04:42:17.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.783+0000 7f9784ab2700 1 -- 172.21.15.62:0/1566191341 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f97800739c0 con 0x7f9780160340 2023-06-09T04:42:17.790 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.783+0000 7f977cff9700 1 -- 172.21.15.62:0/1566191341 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+20180 (secure 0 0 0) 0x7f97680045d0 con 0x7f9780160340 2023-06-09T04:42:17.791 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:42:17.791 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":30,"fsid":"f7998a1e-e5a9-4202-abaa-70c0eaae1047","created":"2023-06-09T04:40:30.469588+0000","modified":"2023-06-09T04:41:38.495589+0000","last_up_change":"2023-06-09T04:40:43.120747+0000","last_in_change":"2023-06-09T04:40:33.568221+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:40:44.646921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:40:50.006643+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:40:55.031273+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-09T04:40:55.773517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-09T04:40:58.845383+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bc50bbc0-dd08-42ed-804c-ec3029e36c19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6802","nonce":1295788017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6807","nonce":1295788017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6815","nonce":1295788017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6809","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6811","nonce":1295788017}]},"public_addr":"172.21.15.62:6802/1295788017","cluster_addr":"172.21.15.62:6807/1295788017","heartbeat_back_addr":"172.21.15.62:6815/1295788017","heartbeat_front_addr":"172.21.15.62:6811/1295788017","state":["exists","up"]},{"osd":1,"uuid":"8230b12d-e22f-4985-a584-4cc64404cdbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6825","nonce":4120692006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6827","nonce":4120692006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6831","nonce":4120692006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6829","nonce":4120692006}]},"public_addr":"172.21.15.62:6825/4120692006","cluster_addr":"172.21.15.62:6827/4120692006","heartbeat_back_addr":"172.21.15.62:6831/4120692006","heartbeat_front_addr":"172.21.15.62:6829/4120692006","state":["exists","up"]},{"osd":2,"uuid":"d0202506-dbe9-4e3c-9271-687929abf96a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6801","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6803","nonce":4169607876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6805","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6806","nonce":4169607876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6814","nonce":4169607876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6810","nonce":4169607876}]},"public_addr":"172.21.15.62:6803/4169607876","cluster_addr":"172.21.15.62:6806/4169607876","heartbeat_back_addr":"172.21.15.62:6814/4169607876","heartbeat_front_addr":"172.21.15.62:6810/4169607876","state":["exists","up"]},{"osd":3,"uuid":"f3c0298a-b075-4411-af50-e16cd74fdddb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6817","nonce":3268438986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6819","nonce":3268438986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6823","nonce":3268438986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6821","nonce":3268438986}]},"public_addr":"172.21.15.62:6817/3268438986","cluster_addr":"172.21.15.62:6819/3268438986","heartbeat_back_addr":"172.21.15.62:6823/3268438986","heartbeat_front_addr":"172.21.15.62:6821/3268438986","state":["exists","up"]},{"osd":4,"uuid":"1ab5c5ca-e74f-475a-a309-683cc0029928","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6817","nonce":3139617628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6819","nonce":3139617628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6823","nonce":3139617628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6821","nonce":3139617628}]},"public_addr":"172.21.15.89:6817/3139617628","cluster_addr":"172.21.15.89:6819/3139617628","heartbeat_back_addr":"172.21.15.89:6823/3139617628","heartbeat_front_addr":"172.21.15.89:6821/3139617628","state":["exists","up"]},{"osd":5,"uuid":"a933e184-bd8f-4369-a1ba-a68de53c578c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6825","nonce":2681723596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6827","nonce":2681723596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6831","nonce":2681723596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6829","nonce":2681723596}]},"public_addr":"172.21.15.89:6825/2681723596","cluster_addr":"172.21.15.89:6827/2681723596","heartbeat_back_addr":"172.21.15.89:6831/2681723596","heartbeat_front_addr":"172.21.15.89:6829/2681723596","state":["exists","up"]},{"osd":6,"uuid":"1ed7ad37-2eee-49a6-954c-b537e2b7f0ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6809","nonce":1657136033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6811","nonce":1657136033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6815","nonce":1657136033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6813","nonce":1657136033}]},"public_addr":"172.21.15.89:6809/1657136033","cluster_addr":"172.21.15.89:6811/1657136033","heartbeat_back_addr":"172.21.15.89:6815/1657136033","heartbeat_front_addr":"172.21.15.89:6813/1657136033","state":["exists","up"]},{"osd":7,"uuid":"6ed732e9-33ff-40df-9038-a9f1d1622671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6801","nonce":1710561686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6803","nonce":1710561686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6807","nonce":1710561686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6805","nonce":1710561686}]},"public_addr":"172.21.15.89:6801/1710561686","cluster_addr":"172.21.15.89:6803/1710561686","heartbeat_back_addr":"172.21.15.89:6807/1710561686","heartbeat_front_addr":"172.21.15.89:6805/1710561686","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.335803+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.419788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.179334+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.263310+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.071846+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.375627+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.282277+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.315997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.12","mappings":[{"from":1,"to":2}]},{"pgid":"4.19","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:42:17.793 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.787+0000 7f9784ab2700 1 -- 172.21.15.62:0/1566191341 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f97600662f0 msgr2=0x7f97600687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:17.794 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.787+0000 7f9784ab2700 1 --2- 172.21.15.62:0/1566191341 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f97600662f0 0x7f97600687a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9770005930 tx=0x7f9770009040 comp rx=0 tx=0).stop 2023-06-09T04:42:17.794 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.787+0000 7f9784ab2700 1 -- 172.21.15.62:0/1566191341 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9780160340 msgr2=0x7f97800c1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:17.794 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.787+0000 7f9784ab2700 1 --2- 172.21.15.62:0/1566191341 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9780160340 0x7f97800c1e20 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f9768016000 tx=0x7f9768004770 comp rx=0 tx=0).stop 2023-06-09T04:42:17.794 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.787+0000 7f9784ab2700 1 -- 172.21.15.62:0/1566191341 shutdown_connections 2023-06-09T04:42:17.795 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.787+0000 7f9784ab2700 1 --2- 172.21.15.62:0/1566191341 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f97600662f0 0x7f97600687a0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:17.795 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.787+0000 7f9784ab2700 1 --2- 172.21.15.62:0/1566191341 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9780154f70 0x7f9780160780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:17.795 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.787+0000 7f9784ab2700 1 --2- 172.21.15.62:0/1566191341 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9780160340 0x7f97800c1e20 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:17.795 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.787+0000 7f9784ab2700 1 --2- 172.21.15.62:0/1566191341 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f978015ff70 0x7f97801f56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:17.795 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.787+0000 7f9784ab2700 1 -- 172.21.15.62:0/1566191341 >> 172.21.15.62:0/1566191341 conn(0x7f97800caf80 msgr2=0x7f9780158a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:17.795 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.787+0000 7f9784ab2700 1 -- 172.21.15.62:0/1566191341 shutdown_connections 2023-06-09T04:42:17.796 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.787+0000 7f9784ab2700 1 -- 172.21.15.62:0/1566191341 wait complete. 2023-06-09T04:42:17.818 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-06-09T04:42:17.995 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.987+0000 7f8d9d8a6700 1 Processor -- start 2023-06-09T04:42:17.995 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.991+0000 7f8d9d8a6700 1 -- start start 2023-06-09T04:42:17.997 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.991+0000 7f8d9d8a6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d980cd4f0 0x7f8d980cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:17.998 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.991+0000 7f8d9d8a6700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8d980c9ea0 0x7f8d980ca320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:17.998 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.991+0000 7f8d9d8a6700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d98071180 con 0x7f8d98159a40 2023-06-09T04:42:17.998 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.991+0000 7f8d9d8a6700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d980cbc00 con 0x7f8d980c9ea0 2023-06-09T04:42:17.998 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.991+0000 7f8d9d8a6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d980ca860 con 0x7f8d980cd4f0 2023-06-09T04:42:17.999 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.991+0000 7f8d9d0a5700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8d980c9ea0 0x7f8d980ca320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:17.999 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.991+0000 7f8d8ffff700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d980cd4f0 0x7f8d980cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:17.999 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.991+0000 7f8d9c8a4700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f8d98159a40 0x7f8d98070a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.62:52756/0 (socket says 172.21.15.62:52756) 2023-06-09T04:42:17.999 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.991+0000 7f8d9c8a4700 1 -- 172.21.15.62:0/3228041503 learned_addr learned my addr 172.21.15.62:0/3228041503 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:42:18.000 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.995+0000 7f8d8f7fe700 1 -- 172.21.15.62:0/3228041503 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 703622807 0 0) 0x7f8d94001110 con 0x7f8d98159a40 2023-06-09T04:42:18.000 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.995+0000 7f8d8f7fe700 1 -- 172.21.15.62:0/3228041503 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d800035d0 con 0x7f8d98159a40 2023-06-09T04:42:18.000 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.995+0000 7f8d9d0a5700 1 -- 172.21.15.62:0/3228041503 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d980cd4f0 msgr2=0x7f8d980cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:18.000 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.995+0000 7f8d9d0a5700 1 --2- 172.21.15.62:0/3228041503 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d980cd4f0 0x7f8d980cc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:18.000 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.995+0000 7f8d9d0a5700 1 -- 172.21.15.62:0/3228041503 >> v1:172.21.15.89:6789/0 conn(0x7f8d98159a40 legacy=0x7f8d98070a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:18.001 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.995+0000 7f8d9d0a5700 1 -- 172.21.15.62:0/3228041503 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d980cc180 con 0x7f8d980c9ea0 2023-06-09T04:42:18.001 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.995+0000 7f8d8ffff700 1 --2- 172.21.15.62:0/3228041503 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d980cd4f0 0x7f8d980cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:42:18.001 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.995+0000 7f8d9d0a5700 1 --2- 172.21.15.62:0/3228041503 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d980c9ea0 0x7f8d980ca320 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f8d90009d90 tx=0x7f8d9000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0404153d403a043 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:18.002 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.995+0000 7f8d8f7fe700 1 -- 172.21.15.62:0/3228041503 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d9000e070 con 0x7f8d980c9ea0 2023-06-09T04:42:18.002 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.995+0000 7f8d8f7fe700 1 -- 172.21.15.62:0/3228041503 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d9000bb20 con 0x7f8d980c9ea0 2023-06-09T04:42:18.002 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.995+0000 7f8d8f7fe700 1 -- 172.21.15.62:0/3228041503 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d90012430 con 0x7f8d980c9ea0 2023-06-09T04:42:18.002 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.995+0000 7f8d9d8a6700 1 -- 172.21.15.62:0/3228041503 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d980c9ea0 msgr2=0x7f8d980ca320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:18.003 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.995+0000 7f8d9d8a6700 1 --2- 172.21.15.62:0/3228041503 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d980c9ea0 0x7f8d980ca320 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f8d90009d90 tx=0x7f8d9000b330 comp rx=0 tx=0).stop 2023-06-09T04:42:18.003 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.995+0000 7f8d9d8a6700 1 -- 172.21.15.62:0/3228041503 shutdown_connections 2023-06-09T04:42:18.003 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.995+0000 7f8d9d8a6700 1 --2- 172.21.15.62:0/3228041503 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d980c9ea0 0x7f8d980ca320 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:18.003 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.995+0000 7f8d9d8a6700 1 --2- 172.21.15.62:0/3228041503 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d980cd4f0 0x7f8d980cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:18.003 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.995+0000 7f8d9d8a6700 1 -- 172.21.15.62:0/3228041503 >> 172.21.15.62:0/3228041503 conn(0x7f8d9806a420 msgr2=0x7f8d980afc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:18.003 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.995+0000 7f8d9d8a6700 1 -- 172.21.15.62:0/3228041503 shutdown_connections 2023-06-09T04:42:18.003 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.995+0000 7f8d9d8a6700 1 -- 172.21.15.62:0/3228041503 wait complete. 2023-06-09T04:42:18.004 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.999+0000 7f8d9d8a6700 1 Processor -- start 2023-06-09T04:42:18.005 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.999+0000 7f8d9d8a6700 1 -- start start 2023-06-09T04:42:18.007 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.999+0000 7f8d9d8a6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d980cd4f0 0x7f8d980c9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:18.007 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.999+0000 7f8d9d8a6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d98159a40 0x7f8d98156090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:18.007 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.999+0000 7f8d9d8a6700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d9814a620 0x7f8d980c7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:18.007 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.999+0000 7f8d9d8a6700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d980c5100 con 0x7f8d98159a40 2023-06-09T04:42:18.007 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.999+0000 7f8d9d8a6700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d981568e0 con 0x7f8d9814a620 2023-06-09T04:42:18.007 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:17.999+0000 7f8d9d8a6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d98156bc0 con 0x7f8d980cd4f0 2023-06-09T04:42:18.008 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:18.003+0000 7f8d8ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d98159a40 0x7f8d98156090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:18.009 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:18.003+0000 7f8d8ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d98159a40 0x7f8d98156090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40258/0 (socket says 172.21.15.62:40258) 2023-06-09T04:42:18.009 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:18.003+0000 7f8d8ffff700 1 -- 172.21.15.62:0/1334866768 learned_addr learned my addr 172.21.15.62:0/1334866768 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:18.009 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:18.003+0000 7f8d9c8a4700 1 --2- 172.21.15.62:0/1334866768 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d980cd4f0 0x7f8d980c9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:18.009 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:18.003+0000 7f8d9d0a5700 1 --2- 172.21.15.62:0/1334866768 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d9814a620 0x7f8d980c7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:18.009 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:18.003+0000 7f8d8ffff700 1 -- 172.21.15.62:0/1334866768 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d980cd4f0 msgr2=0x7f8d980c9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:18.009 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:18.003+0000 7f8d8ffff700 1 --2- 172.21.15.62:0/1334866768 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d980cd4f0 0x7f8d980c9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:18.009 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:18.003+0000 7f8d8ffff700 1 -- 172.21.15.62:0/1334866768 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d9814a620 msgr2=0x7f8d980c7380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:18.010 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:18.003+0000 7f8d8ffff700 1 --2- 172.21.15.62:0/1334866768 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d9814a620 0x7f8d980c7380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:18.010 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:18.003+0000 7f8d8ffff700 1 -- 172.21.15.62:0/1334866768 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d880094b0 con 0x7f8d98159a40 2023-06-09T04:42:18.010 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:18.003+0000 7f8d8ffff700 1 --2- 172.21.15.62:0/1334866768 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d98159a40 0x7f8d98156090 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f8d8800ebe0 tx=0x7f8d8800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:18.010 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:18.003+0000 7f8d8d7fa700 1 -- 172.21.15.62:0/1334866768 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d88009770 con 0x7f8d98159a40 2023-06-09T04:42:18.011 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:18.003+0000 7f8d8d7fa700 1 -- 172.21.15.62:0/1334866768 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d8800c850 con 0x7f8d98159a40 2023-06-09T04:42:18.011 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:18.003+0000 7f8d9d8a6700 1 -- 172.21.15.62:0/1334866768 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d90009a70 con 0x7f8d98159a40 2023-06-09T04:42:18.011 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:18.003+0000 7f8d8d7fa700 1 -- 172.21.15.62:0/1334866768 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d8800cbe0 con 0x7f8d98159a40 2023-06-09T04:42:18.011 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:18.003+0000 7f8d9d8a6700 1 -- 172.21.15.62:0/1334866768 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d980c5350 con 0x7f8d98159a40 2023-06-09T04:42:18.011 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:18.003+0000 7f8d9d8a6700 1 -- 172.21.15.62:0/1334866768 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d980670a0 con 0x7f8d98159a40 2023-06-09T04:42:18.012 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:18.007+0000 7f8d8d7fa700 1 -- 172.21.15.62:0/1334866768 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8d8800cd40 con 0x7f8d98159a40 2023-06-09T04:42:18.013 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:18.007+0000 7f8d8d7fa700 1 --2- 172.21.15.62:0/1334866768 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f8d840662f0 0x7f8d840687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:18.014 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:18.007+0000 7f8d8d7fa700 1 -- 172.21.15.62:0/1334866768 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f8d88083ff0 con 0x7f8d98159a40 2023-06-09T04:42:18.014 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:18.007+0000 7f8d9c8a4700 1 --2- 172.21.15.62:0/1334866768 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f8d840662f0 0x7f8d840687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:18.015 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:18.011+0000 7f8d9c8a4700 1 --2- 172.21.15.62:0/1334866768 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f8d840662f0 0x7f8d840687a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8d94007fd0 tx=0x7f8d94007c60 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:18.021 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:18.015+0000 7f8d8d7fa700 1 -- 172.21.15.62:0/1334866768 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8d88051190 con 0x7f8d98159a40 2023-06-09T04:42:18.230 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:18.223+0000 7f8d9d8a6700 1 -- 172.21.15.62:0/1334866768 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f8d980cbde0 con 0x7f8d98159a40 2023-06-09T04:42:18.846 INFO:tasks.ceph.mon.a.smithi062.stderr:2023-06-09T04:42:18.843+0000 7f79195f9700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-06-09T04:42:18.860 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:18.855+0000 7f8d8d7fa700 1 -- 172.21.15.62:0/1334866768 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7f8d880547b0 con 0x7f8d98159a40 2023-06-09T04:42:18.864 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:18.859+0000 7f8d9d8a6700 1 -- 172.21.15.62:0/1334866768 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f8d840662f0 msgr2=0x7f8d840687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:18.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:18.859+0000 7f8d9d8a6700 1 --2- 172.21.15.62:0/1334866768 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f8d840662f0 0x7f8d840687a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8d94007fd0 tx=0x7f8d94007c60 comp rx=0 tx=0).stop 2023-06-09T04:42:18.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:18.859+0000 7f8d9d8a6700 1 -- 172.21.15.62:0/1334866768 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d98159a40 msgr2=0x7f8d98156090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:18.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:18.859+0000 7f8d9d8a6700 1 --2- 172.21.15.62:0/1334866768 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d98159a40 0x7f8d98156090 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f8d8800ebe0 tx=0x7f8d8800eef0 comp rx=0 tx=0).stop 2023-06-09T04:42:18.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:18.859+0000 7f8d9d8a6700 1 -- 172.21.15.62:0/1334866768 shutdown_connections 2023-06-09T04:42:18.866 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:18.859+0000 7f8d9d8a6700 1 --2- 172.21.15.62:0/1334866768 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f8d840662f0 0x7f8d840687a0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:18.866 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:18.859+0000 7f8d9d8a6700 1 --2- 172.21.15.62:0/1334866768 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d9814a620 0x7f8d980c7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:18.866 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:18.859+0000 7f8d9d8a6700 1 --2- 172.21.15.62:0/1334866768 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d98159a40 0x7f8d98156090 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:18.866 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:18.859+0000 7f8d9d8a6700 1 --2- 172.21.15.62:0/1334866768 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8d980cd4f0 0x7f8d980c9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:18.866 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:18.859+0000 7f8d9d8a6700 1 -- 172.21.15.62:0/1334866768 >> 172.21.15.62:0/1334866768 conn(0x7f8d980c9ea0 msgr2=0x7f8d980b2040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:18.866 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:18.859+0000 7f8d9d8a6700 1 -- 172.21.15.62:0/1334866768 shutdown_connections 2023-06-09T04:42:18.866 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:18.859+0000 7f8d9d8a6700 1 -- 172.21.15.62:0/1334866768 wait complete. 2023-06-09T04:42:18.868 INFO:teuthology.orchestra.run.smithi062.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-06-09T04:42:18.876 INFO:tasks.ceph.mds.d.smithi089.stderr: -5415> 2023-06-09T04:41:02.429+0000 7f0643603700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-06-09T04:42:18.893 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-06-09T04:42:18.941 INFO:tasks.ceph.mds.d.smithi089.stdout:starting mds.d at 2023-06-09T04:42:19.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:19.075+0000 7f5192958700 1 Processor -- start 2023-06-09T04:42:19.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:19.075+0000 7f5192958700 1 -- start start 2023-06-09T04:42:19.083 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:19.083+0000 7f5192958700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f518c0b0260 0x7f518c0ccb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:19.084 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:19.083+0000 7f5192958700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f518c160730 con 0x7f518c160360 2023-06-09T04:42:19.084 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:19.083+0000 7f5192958700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f518c0ca860 con 0x7f518c0c8800 2023-06-09T04:42:19.084 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:19.083+0000 7f5192958700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f518c0ca580 con 0x7f518c0b0260 2023-06-09T04:42:19.085 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:19.083+0000 7f5191155700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f518c0b0260 0x7f518c0ccb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:19.085 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:19.083+0000 7f5191956700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f518c160360 0x7f518c0afb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:34296/0 (socket says 172.21.15.62:34296) 2023-06-09T04:42:19.085 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:19.083+0000 7f5191956700 1 -- 172.21.15.62:0/1504336306 learned_addr learned my addr 172.21.15.62:0/1504336306 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:42:19.085 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:19.083+0000 7f5191155700 1 -- 172.21.15.62:0/1504336306 >> v1:172.21.15.89:6789/0 conn(0x7f518c0c8800 legacy=0x7f518c0705b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:19.085 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:19.083+0000 7f5191155700 1 -- 172.21.15.62:0/1504336306 >> v1:172.21.15.62:6789/0 conn(0x7f518c160360 legacy=0x7f518c0afb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:19.085 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:19.083+0000 7f5191155700 1 -- 172.21.15.62:0/1504336306 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f518c0cc070 con 0x7f518c0b0260 2023-06-09T04:42:19.086 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:19.083+0000 7f5191155700 1 --2- 172.21.15.62:0/1504336306 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f518c0b0260 0x7f518c0ccb50 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f517c009850 tx=0x7f517c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73a8665f1b11f357 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:19.086 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:19.083+0000 7f5190954700 1 -- 172.21.15.62:0/1504336306 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f517c011830 con 0x7f518c0b0260 2023-06-09T04:42:19.087 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:19.083+0000 7f5190954700 1 -- 172.21.15.62:0/1504336306 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f517c011990 con 0x7f518c0b0260 2023-06-09T04:42:19.087 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:19.083+0000 7f5190954700 1 -- 172.21.15.62:0/1504336306 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f517c011d20 con 0x7f518c0b0260 2023-06-09T04:42:19.087 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:19.083+0000 7f5192958700 1 -- 172.21.15.62:0/1504336306 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f518c0b0260 msgr2=0x7f518c0ccb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:19.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:19.083+0000 7f5192958700 1 --2- 172.21.15.62:0/1504336306 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f518c0b0260 0x7f518c0ccb50 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f517c009850 tx=0x7f517c009b60 comp rx=0 tx=0).stop 2023-06-09T04:42:19.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:19.083+0000 7f5192958700 1 -- 172.21.15.62:0/1504336306 shutdown_connections 2023-06-09T04:42:19.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:19.083+0000 7f5192958700 1 --2- 172.21.15.62:0/1504336306 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f518c0b0260 0x7f518c0ccb50 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:19.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:19.083+0000 7f5192958700 1 -- 172.21.15.62:0/1504336306 >> 172.21.15.62:0/1504336306 conn(0x7f518c0cab50 msgr2=0x7f518c0caf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:19.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:19.083+0000 7f5192958700 1 -- 172.21.15.62:0/1504336306 shutdown_connections 2023-06-09T04:42:19.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:19.083+0000 7f5192958700 1 -- 172.21.15.62:0/1504336306 wait complete. 2023-06-09T04:42:19.089 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:19.083+0000 7f5192958700 1 Processor -- start 2023-06-09T04:42:19.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:19.083+0000 7f5192958700 1 -- start start 2023-06-09T04:42:19.091 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:19.083+0000 7f5192958700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f518c0b0260 0x7f518c1f95f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:19.091 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:19.083+0000 7f5192958700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f518c0c8800 0x7f518c15a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:19.091 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:19.087+0000 7f5192958700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f518c160360 0x7f518c0b22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:19.091 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:19.087+0000 7f5192958700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f518c0b1dd0 con 0x7f518c0b0260 2023-06-09T04:42:19.092 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:19.087+0000 7f5192958700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f518c1f9b30 con 0x7f518c0c8800 2023-06-09T04:42:19.092 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:19.087+0000 7f5192958700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f518c0c1dd0 con 0x7f518c160360 2023-06-09T04:42:19.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:19.087+0000 7f5191956700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f518c0b0260 0x7f518c1f95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:19.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:19.087+0000 7f5191155700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f518c0c8800 0x7f518c15a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:19.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:19.087+0000 7f5191956700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f518c0b0260 0x7f518c1f95f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40278/0 (socket says 172.21.15.62:40278) 2023-06-09T04:42:19.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:19.087+0000 7f5191956700 1 -- 172.21.15.62:0/3497741648 learned_addr learned my addr 172.21.15.62:0/3497741648 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:19.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:19.087+0000 7f5192157700 1 --2- 172.21.15.62:0/3497741648 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f518c160360 0x7f518c0b22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:19.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:19.087+0000 7f5191956700 1 -- 172.21.15.62:0/3497741648 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f518c160360 msgr2=0x7f518c0b22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:19.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:19.087+0000 7f5191956700 1 --2- 172.21.15.62:0/3497741648 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f518c160360 0x7f518c0b22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:19.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:19.087+0000 7f5191956700 1 -- 172.21.15.62:0/3497741648 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f518c0c8800 msgr2=0x7f518c15a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:19.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:19.087+0000 7f5191956700 1 --2- 172.21.15.62:0/3497741648 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f518c0c8800 0x7f518c15a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:19.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:19.087+0000 7f5191956700 1 -- 172.21.15.62:0/3497741648 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f517c0094b0 con 0x7f518c0b0260 2023-06-09T04:42:19.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:19.087+0000 7f5191155700 1 --2- 172.21.15.62:0/3497741648 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f518c0c8800 0x7f518c15a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:42:19.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:19.087+0000 7f5191956700 1 --2- 172.21.15.62:0/3497741648 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f518c0b0260 0x7f518c1f95f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f5188001eb0 tx=0x7f518800c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:19.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:19.087+0000 7f51827fc700 1 -- 172.21.15.62:0/3497741648 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5188005d90 con 0x7f518c0b0260 2023-06-09T04:42:19.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:19.087+0000 7f51827fc700 1 -- 172.21.15.62:0/3497741648 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51880070d0 con 0x7f518c0b0260 2023-06-09T04:42:19.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:19.087+0000 7f5192958700 1 -- 172.21.15.62:0/3497741648 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f518c0b0f00 con 0x7f518c0b0260 2023-06-09T04:42:19.096 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:19.087+0000 7f51827fc700 1 -- 172.21.15.62:0/3497741648 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5188007440 con 0x7f518c0b0260 2023-06-09T04:42:19.096 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:19.087+0000 7f5192958700 1 -- 172.21.15.62:0/3497741648 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f518c0b1430 con 0x7f518c0b0260 2023-06-09T04:42:19.096 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:19.091+0000 7f5192958700 1 -- 172.21.15.62:0/3497741648 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f518c0b1f10 con 0x7f518c0b0260 2023-06-09T04:42:19.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:19.091+0000 7f51827fc700 1 -- 172.21.15.62:0/3497741648 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f51880075a0 con 0x7f518c0b0260 2023-06-09T04:42:19.099 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:19.091+0000 7f51827fc700 1 --2- 172.21.15.62:0/3497741648 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f51700662f0 0x7f51700687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:19.099 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:19.095+0000 7f51827fc700 1 -- 172.21.15.62:0/3497741648 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6957+0+0 (secure 0 0 0) 0x7f5188083310 con 0x7f518c0b0260 2023-06-09T04:42:19.100 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:19.095+0000 7f5191155700 1 --2- 172.21.15.62:0/3497741648 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f51700662f0 0x7f51700687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:19.101 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:19.095+0000 7f5191155700 1 --2- 172.21.15.62:0/3497741648 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f51700662f0 0x7f51700687a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f518c0b0650 tx=0x7f517c008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:19.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:19.099+0000 7f51827fc700 1 -- 172.21.15.62:0/3497741648 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f518c0b1f10 con 0x7f518c0b0260 2023-06-09T04:42:19.326 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:19.319+0000 7f5192958700 1 -- 172.21.15.62:0/3497741648 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f518c0b1f10 con 0x7f518c0b0260 2023-06-09T04:42:19.864 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:19.858+0000 7f51827fc700 1 -- 172.21.15.62:0/3497741648 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5188050420 con 0x7f518c0b0260 2023-06-09T04:42:19.869 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:19.866+0000 7f5192958700 1 -- 172.21.15.62:0/3497741648 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f51700662f0 msgr2=0x7f51700687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:19.869 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:19.866+0000 7f5192958700 1 --2- 172.21.15.62:0/3497741648 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f51700662f0 0x7f51700687a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f518c0b0650 tx=0x7f517c008030 comp rx=0 tx=0).stop 2023-06-09T04:42:19.869 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:19.866+0000 7f5192958700 1 -- 172.21.15.62:0/3497741648 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f518c0b0260 msgr2=0x7f518c1f95f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:19.869 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:19.866+0000 7f5192958700 1 --2- 172.21.15.62:0/3497741648 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f518c0b0260 0x7f518c1f95f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f5188001eb0 tx=0x7f518800c7b0 comp rx=0 tx=0).stop 2023-06-09T04:42:19.869 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:19.866+0000 7f5192958700 1 -- 172.21.15.62:0/3497741648 shutdown_connections 2023-06-09T04:42:19.870 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:19.866+0000 7f5192958700 1 --2- 172.21.15.62:0/3497741648 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f51700662f0 0x7f51700687a0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:19.870 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:19.866+0000 7f5192958700 1 --2- 172.21.15.62:0/3497741648 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f518c160360 0x7f518c0b22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:19.870 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:19.866+0000 7f5192958700 1 --2- 172.21.15.62:0/3497741648 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f518c0c8800 0x7f518c15a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:19.870 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:19.866+0000 7f5192958700 1 --2- 172.21.15.62:0/3497741648 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f518c0b0260 0x7f518c1f95f0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:19.870 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:19.866+0000 7f5192958700 1 -- 172.21.15.62:0/3497741648 >> 172.21.15.62:0/3497741648 conn(0x7f518c0cab50 msgr2=0x7f518c15e020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:19.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:19.866+0000 7f5192958700 1 -- 172.21.15.62:0/3497741648 shutdown_connections 2023-06-09T04:42:19.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:19.866+0000 7f5192958700 1 -- 172.21.15.62:0/3497741648 wait complete. 2023-06-09T04:42:19.895 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-06-09T04:42:20.085 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:20.082+0000 7f77b0a2b700 1 Processor -- start 2023-06-09T04:42:20.086 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:20.082+0000 7f77b0a2b700 1 -- start start 2023-06-09T04:42:20.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:20.086+0000 7f77b0a2b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f77ac0cf610 0x7f77ac0d1c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:20.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:20.086+0000 7f77b0a2b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f77ac0b1af0 0x7f77ac0ccde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:20.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:20.086+0000 7f77b0a2b700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77ac160360 con 0x7f77ac0b7d70 2023-06-09T04:42:20.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:20.086+0000 7f77b0a2b700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77ac160640 con 0x7f77ac0b1af0 2023-06-09T04:42:20.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:20.086+0000 7f77b0a2b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77ac0d00d0 con 0x7f77ac0cf610 2023-06-09T04:42:20.091 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:20.086+0000 7f77ab59e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f77ac0b1af0 0x7f77ac0ccde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:20.091 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:20.086+0000 7f77aad9d700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f77ac0b7d70 0x7f77ac0cef00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:34302/0 (socket says 172.21.15.62:34302) 2023-06-09T04:42:20.091 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:20.086+0000 7f77aad9d700 1 -- 172.21.15.62:0/1503981671 learned_addr learned my addr 172.21.15.62:0/1503981671 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:42:20.091 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:20.086+0000 7f77aa59c700 1 --2- 172.21.15.62:0/1503981671 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f77ac0cf610 0x7f77ac0d1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:20.092 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:20.086+0000 7f77a9d9b700 1 -- 172.21.15.62:0/1503981671 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2343642412 0 0) 0x7f77ac160360 con 0x7f77ac0b7d70 2023-06-09T04:42:20.092 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:20.086+0000 7f77ab59e700 1 -- 172.21.15.62:0/1503981671 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f77ac0cf610 msgr2=0x7f77ac0d1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:20.092 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:20.086+0000 7f77ab59e700 1 --2- 172.21.15.62:0/1503981671 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f77ac0cf610 0x7f77ac0d1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:20.092 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:20.086+0000 7f77ab59e700 1 -- 172.21.15.62:0/1503981671 >> v1:172.21.15.62:6789/0 conn(0x7f77ac0b7d70 legacy=0x7f77ac0cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:20.092 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:20.086+0000 7f77ab59e700 1 -- 172.21.15.62:0/1503981671 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77ac0d03b0 con 0x7f77ac0b1af0 2023-06-09T04:42:20.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:20.090+0000 7f77ab59e700 1 --2- 172.21.15.62:0/1503981671 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f77ac0b1af0 0x7f77ac0ccde0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f77a4009d90 tx=0x7f77a400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f44a0fee839cae8 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:20.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:20.090+0000 7f77a9d9b700 1 -- 172.21.15.62:0/1503981671 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a400e070 con 0x7f77ac0b1af0 2023-06-09T04:42:20.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:20.090+0000 7f77a9d9b700 1 -- 172.21.15.62:0/1503981671 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77a400bb20 con 0x7f77ac0b1af0 2023-06-09T04:42:20.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:20.090+0000 7f77a9d9b700 1 -- 172.21.15.62:0/1503981671 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a4012430 con 0x7f77ac0b1af0 2023-06-09T04:42:20.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:20.090+0000 7f77b0a2b700 1 -- 172.21.15.62:0/1503981671 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f77ac0b1af0 msgr2=0x7f77ac0ccde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:20.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:20.090+0000 7f77b0a2b700 1 --2- 172.21.15.62:0/1503981671 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f77ac0b1af0 0x7f77ac0ccde0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f77a4009d90 tx=0x7f77a400b330 comp rx=0 tx=0).stop 2023-06-09T04:42:20.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:20.090+0000 7f77b0a2b700 1 -- 172.21.15.62:0/1503981671 shutdown_connections 2023-06-09T04:42:20.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:20.090+0000 7f77b0a2b700 1 --2- 172.21.15.62:0/1503981671 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f77ac0b1af0 0x7f77ac0ccde0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:20.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:20.090+0000 7f77b0a2b700 1 --2- 172.21.15.62:0/1503981671 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f77ac0cf610 0x7f77ac0d1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:20.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:20.090+0000 7f77b0a2b700 1 -- 172.21.15.62:0/1503981671 >> 172.21.15.62:0/1503981671 conn(0x7f77ac0657d0 msgr2=0x7f77ac070f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:20.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:20.090+0000 7f77b0a2b700 1 -- 172.21.15.62:0/1503981671 shutdown_connections 2023-06-09T04:42:20.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:20.090+0000 7f77b0a2b700 1 -- 172.21.15.62:0/1503981671 wait complete. 2023-06-09T04:42:20.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:20.094+0000 7f77b0a2b700 1 Processor -- start 2023-06-09T04:42:20.098 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:20.094+0000 7f77b0a2b700 1 -- start start 2023-06-09T04:42:20.099 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:20.094+0000 7f77b0a2b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77ac0b1af0 0x7f77ac0c9d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:20.099 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:20.094+0000 7f77b0a2b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f77ac0b7d70 0x7f77ac15d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:20.099 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:20.094+0000 7f77b0a2b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f77ac0cf610 0x7f77ac15deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:20.099 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:20.094+0000 7f77b0a2b700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77ac146310 con 0x7f77ac0b7d70 2023-06-09T04:42:20.099 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:20.094+0000 7f77b0a2b700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77ac149820 con 0x7f77ac0b1af0 2023-06-09T04:42:20.099 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:20.094+0000 7f77b0a2b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77ac149180 con 0x7f77ac0cf610 2023-06-09T04:42:20.100 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:20.094+0000 7f77aa59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f77ac0b7d70 0x7f77ac15d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:20.100 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:20.094+0000 7f77aa59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f77ac0b7d70 0x7f77ac15d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:40302/0 (socket says 172.21.15.62:40302) 2023-06-09T04:42:20.100 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:20.094+0000 7f77aa59c700 1 -- 172.21.15.62:0/1626288582 learned_addr learned my addr 172.21.15.62:0/1626288582 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:20.101 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:20.094+0000 7f77ab59e700 1 --2- 172.21.15.62:0/1626288582 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f77ac0cf610 0x7f77ac15deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:20.101 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:20.094+0000 7f77aad9d700 1 --2- 172.21.15.62:0/1626288582 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77ac0b1af0 0x7f77ac0c9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:20.101 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:20.094+0000 7f77aa59c700 1 -- 172.21.15.62:0/1626288582 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f77ac0cf610 msgr2=0x7f77ac15deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:20.101 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:20.094+0000 7f77aa59c700 1 --2- 172.21.15.62:0/1626288582 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f77ac0cf610 0x7f77ac15deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:20.101 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:20.094+0000 7f77aa59c700 1 -- 172.21.15.62:0/1626288582 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77ac0b1af0 msgr2=0x7f77ac0c9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:20.101 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:20.094+0000 7f77aa59c700 1 --2- 172.21.15.62:0/1626288582 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77ac0b1af0 0x7f77ac0c9d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:20.101 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:20.094+0000 7f77aa59c700 1 -- 172.21.15.62:0/1626288582 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a4009a70 con 0x7f77ac0b7d70 2023-06-09T04:42:20.102 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:20.094+0000 7f77aa59c700 1 --2- 172.21.15.62:0/1626288582 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f77ac0b7d70 0x7f77ac15d970 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f77a000e840 tx=0x7f77a000eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:20.102 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:20.094+0000 7f77937fe700 1 -- 172.21.15.62:0/1626288582 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a00095a0 con 0x7f77ac0b7d70 2023-06-09T04:42:20.102 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:20.094+0000 7f77937fe700 1 -- 172.21.15.62:0/1626288582 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77a0013680 con 0x7f77ac0b7d70 2023-06-09T04:42:20.102 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:20.094+0000 7f77b0a2b700 1 -- 172.21.15.62:0/1626288582 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77ac146560 con 0x7f77ac0b7d70 2023-06-09T04:42:20.103 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:20.094+0000 7f77937fe700 1 -- 172.21.15.62:0/1626288582 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a0013a30 con 0x7f77ac0b7d70 2023-06-09T04:42:20.103 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:20.094+0000 7f77b0a2b700 1 -- 172.21.15.62:0/1626288582 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77ac146b20 con 0x7f77ac0b7d70 2023-06-09T04:42:20.103 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:20.098+0000 7f77b0a2b700 1 -- 172.21.15.62:0/1626288582 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77ac04db30 con 0x7f77ac0b7d70 2023-06-09T04:42:20.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:20.098+0000 7f77937fe700 1 -- 172.21.15.62:0/1626288582 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f77a0013b90 con 0x7f77ac0b7d70 2023-06-09T04:42:20.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:20.102+0000 7f77937fe700 1 --2- 172.21.15.62:0/1626288582 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f77980662f0 0x7f77980687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:20.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:20.102+0000 7f77937fe700 1 -- 172.21.15.62:0/1626288582 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6957+0+0 (secure 0 0 0) 0x7f77a0083ee0 con 0x7f77ac0b7d70 2023-06-09T04:42:20.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:20.102+0000 7f77aad9d700 1 --2- 172.21.15.62:0/1626288582 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f77980662f0 0x7f77980687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:20.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:20.102+0000 7f77aad9d700 1 --2- 172.21.15.62:0/1626288582 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f77980662f0 0x7f77980687a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f779c000f60 tx=0x7f779c007e00 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:20.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:20.110+0000 7f77937fe700 1 -- 172.21.15.62:0/1626288582 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f77a0054a60 con 0x7f77ac0b7d70 2023-06-09T04:42:20.285 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:20.282+0000 7f77b0a2b700 1 -- 172.21.15.62:0/1626288582 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f77ac06b350 con 0x7f77ac0b7d70 2023-06-09T04:42:20.527 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:42:20.535 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:42:20.867 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:20.862+0000 7f77937fe700 1 -- 172.21.15.62:0/1626288582 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v32) v1 ==== 181+0+0 (secure 0 0 0) 0x7f77a00170d0 con 0x7f77ac0b7d70 2023-06-09T04:42:20.872 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:20.870+0000 7f77b0a2b700 1 -- 172.21.15.62:0/1626288582 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f77980662f0 msgr2=0x7f77980687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:20.873 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:20.870+0000 7f77b0a2b700 1 --2- 172.21.15.62:0/1626288582 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f77980662f0 0x7f77980687a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f779c000f60 tx=0x7f779c007e00 comp rx=0 tx=0).stop 2023-06-09T04:42:20.873 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:20.870+0000 7f77b0a2b700 1 -- 172.21.15.62:0/1626288582 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f77ac0b7d70 msgr2=0x7f77ac15d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:20.873 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:20.870+0000 7f77b0a2b700 1 --2- 172.21.15.62:0/1626288582 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f77ac0b7d70 0x7f77ac15d970 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f77a000e840 tx=0x7f77a000eb50 comp rx=0 tx=0).stop 2023-06-09T04:42:20.873 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:20.870+0000 7f77b0a2b700 1 -- 172.21.15.62:0/1626288582 shutdown_connections 2023-06-09T04:42:20.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:20.870+0000 7f77b0a2b700 1 --2- 172.21.15.62:0/1626288582 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f77980662f0 0x7f77980687a0 secure :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f779c000f60 tx=0x7f779c007e00 comp rx=0 tx=0).stop 2023-06-09T04:42:20.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:20.870+0000 7f77b0a2b700 1 --2- 172.21.15.62:0/1626288582 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f77ac0cf610 0x7f77ac15deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:20.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:20.870+0000 7f77b0a2b700 1 --2- 172.21.15.62:0/1626288582 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f77ac0b7d70 0x7f77ac15d970 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:20.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:20.870+0000 7f77b0a2b700 1 --2- 172.21.15.62:0/1626288582 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f77ac0b1af0 0x7f77ac0c9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:20.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:20.870+0000 7f77b0a2b700 1 -- 172.21.15.62:0/1626288582 >> 172.21.15.62:0/1626288582 conn(0x7f77ac0657d0 msgr2=0x7f77ac0ccde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:20.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:20.870+0000 7f77b0a2b700 1 -- 172.21.15.62:0/1626288582 shutdown_connections 2023-06-09T04:42:20.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:20.870+0000 7f77b0a2b700 1 -- 172.21.15.62:0/1626288582 wait complete. 2023-06-09T04:42:20.876 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_metadata' removed 2023-06-09T04:42:20.897 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-06-09T04:42:21.083 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:21.082+0000 7fed1e2cb700 1 Processor -- start 2023-06-09T04:42:21.084 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:21.082+0000 7fed1e2cb700 1 -- start start 2023-06-09T04:42:21.087 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:21.086+0000 7fed1e2cb700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fed180cd280 0x7fed18167260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:21.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:21.086+0000 7fed1e2cb700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed180b8470 con 0x7fed180d0f80 2023-06-09T04:42:21.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:21.086+0000 7fed1e2cb700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed180cd870 con 0x7fed180b80a0 2023-06-09T04:42:21.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:21.086+0000 7fed1e2cb700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed180d2020 con 0x7fed180cd280 2023-06-09T04:42:21.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:21.086+0000 7fed1daca700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fed180cd280 0x7fed18167260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:21.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:21.086+0000 7fed1daca700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fed180cd280 0x7fed18167260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42934/0 (socket says 172.21.15.62:42934) 2023-06-09T04:42:21.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:21.086+0000 7fed1daca700 1 -- 172.21.15.62:0/3822892017 learned_addr learned my addr 172.21.15.62:0/3822892017 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:21.089 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:21.086+0000 7fed1daca700 1 -- 172.21.15.62:0/3822892017 >> v1:172.21.15.89:6789/0 conn(0x7fed180b80a0 legacy=0x7fed180ccb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:21.089 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:21.086+0000 7fed1daca700 1 -- 172.21.15.62:0/3822892017 >> v1:172.21.15.62:6789/0 conn(0x7fed180d0f80 legacy=0x7fed18163b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:21.089 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:21.086+0000 7fed1daca700 1 -- 172.21.15.62:0/3822892017 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed180d1410 con 0x7fed180cd280 2023-06-09T04:42:21.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:21.086+0000 7fed1daca700 1 --2- 172.21.15.62:0/3822892017 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fed180cd280 0x7fed18167260 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fed10009e50 tx=0x7fed1000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c55be0671079647 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:21.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:21.086+0000 7fed0ffff700 1 -- 172.21.15.62:0/3822892017 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed1000e070 con 0x7fed180cd280 2023-06-09T04:42:21.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:21.086+0000 7fed0ffff700 1 -- 172.21.15.62:0/3822892017 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed1000b9c0 con 0x7fed180cd280 2023-06-09T04:42:21.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:21.086+0000 7fed0ffff700 1 -- 172.21.15.62:0/3822892017 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed1000bd70 con 0x7fed180cd280 2023-06-09T04:42:21.091 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:21.086+0000 7fed1e2cb700 1 -- 172.21.15.62:0/3822892017 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fed180cd280 msgr2=0x7fed18167260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:21.091 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:21.086+0000 7fed1e2cb700 1 --2- 172.21.15.62:0/3822892017 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fed180cd280 0x7fed18167260 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fed10009e50 tx=0x7fed1000b330 comp rx=0 tx=0).stop 2023-06-09T04:42:21.091 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:21.090+0000 7fed1e2cb700 1 -- 172.21.15.62:0/3822892017 shutdown_connections 2023-06-09T04:42:21.091 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:21.090+0000 7fed1e2cb700 1 --2- 172.21.15.62:0/3822892017 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fed180cd280 0x7fed18167260 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:21.091 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:21.090+0000 7fed1e2cb700 1 -- 172.21.15.62:0/3822892017 >> 172.21.15.62:0/3822892017 conn(0x7fed1809b830 msgr2=0x7fed180d2520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:21.092 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:21.090+0000 7fed1e2cb700 1 -- 172.21.15.62:0/3822892017 shutdown_connections 2023-06-09T04:42:21.092 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:21.090+0000 7fed1e2cb700 1 -- 172.21.15.62:0/3822892017 wait complete. 2023-06-09T04:42:21.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:21.090+0000 7fed1e2cb700 1 Processor -- start 2023-06-09T04:42:21.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:21.094+0000 7fed1e2cb700 1 -- start start 2023-06-09T04:42:21.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:21.094+0000 7fed1e2cb700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed180b80a0 0x7fed1815b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:21.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:21.094+0000 7fed1e2cb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed180cd280 0x7fed1809e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:21.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:21.094+0000 7fed1e2cb700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fed180d0f80 0x7fed1809e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:21.098 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:21.094+0000 7fed1e2cb700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed1815b8f0 con 0x7fed180d0f80 2023-06-09T04:42:21.098 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:21.094+0000 7fed1e2cb700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed180c83c0 con 0x7fed180b80a0 2023-06-09T04:42:21.098 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:21.094+0000 7fed1e2cb700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed180b6950 con 0x7fed180cd280 2023-06-09T04:42:21.099 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:21.094+0000 7fed1daca700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fed180d0f80 0x7fed1809e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:21.099 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:21.094+0000 7fed1daca700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fed180d0f80 0x7fed1809e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42936/0 (socket says 172.21.15.62:42936) 2023-06-09T04:42:21.099 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:21.094+0000 7fed1daca700 1 -- 172.21.15.62:0/2576302110 learned_addr learned my addr 172.21.15.62:0/2576302110 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:21.099 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:21.094+0000 7fed1d2c9700 1 --2- 172.21.15.62:0/2576302110 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed180b80a0 0x7fed1815b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:21.099 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:21.094+0000 7fed1cac8700 1 --2- 172.21.15.62:0/2576302110 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed180cd280 0x7fed1809e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:21.100 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:21.094+0000 7fed1daca700 1 -- 172.21.15.62:0/2576302110 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed180cd280 msgr2=0x7fed1809e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:21.100 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:21.094+0000 7fed1daca700 1 --2- 172.21.15.62:0/2576302110 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed180cd280 0x7fed1809e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:21.100 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:21.094+0000 7fed1daca700 1 -- 172.21.15.62:0/2576302110 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed180b80a0 msgr2=0x7fed1815b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:21.100 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:21.094+0000 7fed1daca700 1 --2- 172.21.15.62:0/2576302110 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed180b80a0 0x7fed1815b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:21.100 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:21.094+0000 7fed1daca700 1 -- 172.21.15.62:0/2576302110 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed10009b30 con 0x7fed180d0f80 2023-06-09T04:42:21.100 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:21.094+0000 7fed1d2c9700 1 --2- 172.21.15.62:0/2576302110 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed180b80a0 0x7fed1815b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:21.100 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:21.094+0000 7fed1cac8700 1 --2- 172.21.15.62:0/2576302110 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed180cd280 0x7fed1809e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:21.101 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:21.098+0000 7fed1daca700 1 --2- 172.21.15.62:0/2576302110 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fed180d0f80 0x7fed1809e620 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fed10012000 tx=0x7fed10004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:21.101 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:21.098+0000 7fed0dffb700 1 -- 172.21.15.62:0/2576302110 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed10004960 con 0x7fed180d0f80 2023-06-09T04:42:21.101 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:21.098+0000 7fed0dffb700 1 -- 172.21.15.62:0/2576302110 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed100092e0 con 0x7fed180d0f80 2023-06-09T04:42:21.102 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:21.098+0000 7fed1e2cb700 1 -- 172.21.15.62:0/2576302110 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed180c7e00 con 0x7fed180d0f80 2023-06-09T04:42:21.102 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:21.098+0000 7fed0dffb700 1 -- 172.21.15.62:0/2576302110 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed1001c660 con 0x7fed180d0f80 2023-06-09T04:42:21.102 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:21.098+0000 7fed1e2cb700 1 -- 172.21.15.62:0/2576302110 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed180c5f40 con 0x7fed180d0f80 2023-06-09T04:42:21.102 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:21.098+0000 7fed1e2cb700 1 -- 172.21.15.62:0/2576302110 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed1804db30 con 0x7fed180d0f80 2023-06-09T04:42:21.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:21.102+0000 7fed0dffb700 1 -- 172.21.15.62:0/2576302110 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fed1001c7c0 con 0x7fed180d0f80 2023-06-09T04:42:21.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:21.106+0000 7fed0dffb700 1 --2- 172.21.15.62:0/2576302110 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fecfc0662f0 0x7fecfc0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:21.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:21.106+0000 7fed0dffb700 1 -- 172.21.15.62:0/2576302110 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6519+0+0 (secure 0 0 0) 0x7fed10085d10 con 0x7fed180d0f80 2023-06-09T04:42:21.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:21.106+0000 7fed1d2c9700 1 --2- 172.21.15.62:0/2576302110 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fecfc0662f0 0x7fecfc0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:21.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:21.106+0000 7fed1d2c9700 1 --2- 172.21.15.62:0/2576302110 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fecfc0662f0 0x7fecfc0687a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fed1815bf40 tx=0x7fed14009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:21.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:21.110+0000 7fed0dffb700 1 -- 172.21.15.62:0/2576302110 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fed10052fb0 con 0x7fed180d0f80 2023-06-09T04:42:21.300 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:21.298+0000 7fed1e2cb700 1 -- 172.21.15.62:0/2576302110 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fed180d2ff0 con 0x7fed180d0f80 2023-06-09T04:42:21.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:21.874+0000 7fed0dffb700 1 -- 172.21.15.62:0/2576302110 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v33) v1 ==== 169+0+0 (secure 0 0 0) 0x7fed100565d0 con 0x7fed180d0f80 2023-06-09T04:42:21.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:21.878+0000 7fed1e2cb700 1 -- 172.21.15.62:0/2576302110 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fecfc0662f0 msgr2=0x7fecfc0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:21.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:21.878+0000 7fed1e2cb700 1 --2- 172.21.15.62:0/2576302110 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fecfc0662f0 0x7fecfc0687a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fed1815bf40 tx=0x7fed14009040 comp rx=0 tx=0).stop 2023-06-09T04:42:21.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:21.878+0000 7fed1e2cb700 1 -- 172.21.15.62:0/2576302110 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fed180d0f80 msgr2=0x7fed1809e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:21.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:21.878+0000 7fed1e2cb700 1 --2- 172.21.15.62:0/2576302110 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fed180d0f80 0x7fed1809e620 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fed10012000 tx=0x7fed10004af0 comp rx=0 tx=0).stop 2023-06-09T04:42:21.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:21.878+0000 7fed1e2cb700 1 -- 172.21.15.62:0/2576302110 shutdown_connections 2023-06-09T04:42:21.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:21.878+0000 7fed1e2cb700 1 --2- 172.21.15.62:0/2576302110 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fecfc0662f0 0x7fecfc0687a0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:21.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:21.878+0000 7fed1e2cb700 1 --2- 172.21.15.62:0/2576302110 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fed180d0f80 0x7fed1809e620 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:21.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:21.878+0000 7fed1e2cb700 1 --2- 172.21.15.62:0/2576302110 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fed180cd280 0x7fed1809e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:21.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:21.878+0000 7fed1e2cb700 1 --2- 172.21.15.62:0/2576302110 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed180b80a0 0x7fed1815b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:21.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:21.878+0000 7fed1e2cb700 1 -- 172.21.15.62:0/2576302110 >> 172.21.15.62:0/2576302110 conn(0x7fed1809b830 msgr2=0x7fed180b42f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:21.883 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:21.878+0000 7fed1e2cb700 1 -- 172.21.15.62:0/2576302110 shutdown_connections 2023-06-09T04:42:21.883 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:21.878+0000 7fed1e2cb700 1 -- 172.21.15.62:0/2576302110 wait complete. 2023-06-09T04:42:21.885 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_data' removed 2023-06-09T04:42:21.905 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-06-09T04:42:22.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:22.086+0000 7f3ddc77f700 1 Processor -- start 2023-06-09T04:42:22.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:22.086+0000 7f3ddc77f700 1 -- start start 2023-06-09T04:42:22.092 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:22.090+0000 7f3ddc77f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3dd4162840 0x7f3dd4164c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:22.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:22.090+0000 7f3ddc77f700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dd40cb890 con 0x7f3dd4159bf0 2023-06-09T04:42:22.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:22.090+0000 7f3ddc77f700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dd40b10d0 con 0x7f3dd4070f20 2023-06-09T04:42:22.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:22.090+0000 7f3ddc77f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd40b3b30 con 0x7f3dd4162840 2023-06-09T04:42:22.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:22.090+0000 7f3dda51b700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f3dd4159bf0 0x7f3dd40ceb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:49336/0 (socket says 172.21.15.62:49336) 2023-06-09T04:42:22.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:22.090+0000 7f3dda51b700 1 -- 172.21.15.62:0/2484790437 learned_addr learned my addr 172.21.15.62:0/2484790437 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:42:22.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:22.090+0000 7f3ddad1c700 1 --2- 172.21.15.62:0/2484790437 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3dd4162840 0x7f3dd4164c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:22.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:22.090+0000 7f3dd9519700 1 -- 172.21.15.62:0/2484790437 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 607969428 0 0) 0x7f3dd40cb890 con 0x7f3dd4159bf0 2023-06-09T04:42:22.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:22.090+0000 7f3dd9519700 1 -- 172.21.15.62:0/2484790437 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3dc00035d0 con 0x7f3dd4159bf0 2023-06-09T04:42:22.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:22.090+0000 7f3ddad1c700 1 -- 172.21.15.62:0/2484790437 >> v1:172.21.15.89:6789/0 conn(0x7f3dd4070f20 legacy=0x7f3dd40713a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:22.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:22.090+0000 7f3ddad1c700 1 -- 172.21.15.62:0/2484790437 >> v1:172.21.15.62:6789/0 conn(0x7f3dd4159bf0 legacy=0x7f3dd40ceb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:22.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:22.090+0000 7f3ddad1c700 1 -- 172.21.15.62:0/2484790437 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dd40b3e10 con 0x7f3dd4162840 2023-06-09T04:42:22.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:22.090+0000 7f3ddad1c700 1 --2- 172.21.15.62:0/2484790437 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3dd4162840 0x7f3dd4164c20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc009dc0 tx=0x7f3dcc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5e7105a122c33ea server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:22.096 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:22.094+0000 7f3dd9519700 1 -- 172.21.15.62:0/2484790437 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc00e070 con 0x7f3dd4162840 2023-06-09T04:42:22.096 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:22.094+0000 7f3dd9519700 1 -- 172.21.15.62:0/2484790437 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dcc00bb20 con 0x7f3dd4162840 2023-06-09T04:42:22.096 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:22.094+0000 7f3dd9519700 1 -- 172.21.15.62:0/2484790437 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc012430 con 0x7f3dd4162840 2023-06-09T04:42:22.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:22.094+0000 7f3ddc77f700 1 -- 172.21.15.62:0/2484790437 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3dd4162840 msgr2=0x7f3dd4164c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:22.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:22.094+0000 7f3ddc77f700 1 --2- 172.21.15.62:0/2484790437 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3dd4162840 0x7f3dd4164c20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc009dc0 tx=0x7f3dcc00b330 comp rx=0 tx=0).stop 2023-06-09T04:42:22.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:22.094+0000 7f3ddc77f700 1 -- 172.21.15.62:0/2484790437 shutdown_connections 2023-06-09T04:42:22.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:22.094+0000 7f3ddc77f700 1 --2- 172.21.15.62:0/2484790437 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3dd4162840 0x7f3dd4164c20 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:22.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:22.094+0000 7f3ddc77f700 1 -- 172.21.15.62:0/2484790437 >> 172.21.15.62:0/2484790437 conn(0x7f3dd40697f0 msgr2=0x7f3dd4069bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:22.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:22.094+0000 7f3ddc77f700 1 -- 172.21.15.62:0/2484790437 shutdown_connections 2023-06-09T04:42:22.098 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:22.094+0000 7f3ddc77f700 1 -- 172.21.15.62:0/2484790437 wait complete. 2023-06-09T04:42:22.100 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:22.098+0000 7f3ddc77f700 1 Processor -- start 2023-06-09T04:42:22.100 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:22.098+0000 7f3ddc77f700 1 -- start start 2023-06-09T04:42:22.102 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:22.098+0000 7f3ddc77f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3dd4070f20 0x7f3dd414f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:22.103 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:22.098+0000 7f3ddc77f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3dd4159bf0 0x7f3dd4155010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:22.103 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:22.098+0000 7f3ddc77f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3dd4162840 0x7f3dd40cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:22.103 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:22.098+0000 7f3ddc77f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd40cccf0 con 0x7f3dd4162840 2023-06-09T04:42:22.103 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:22.098+0000 7f3ddc77f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd4150dc0 con 0x7f3dd4159bf0 2023-06-09T04:42:22.104 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:22.098+0000 7f3ddc77f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd4155550 con 0x7f3dd4070f20 2023-06-09T04:42:22.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:22.098+0000 7f3ddad1c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3dd4162840 0x7f3dd40cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:22.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:22.098+0000 7f3ddad1c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3dd4162840 0x7f3dd40cbe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42946/0 (socket says 172.21.15.62:42946) 2023-06-09T04:42:22.106 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:22.098+0000 7f3ddad1c700 1 -- 172.21.15.62:0/387554647 learned_addr learned my addr 172.21.15.62:0/387554647 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:22.106 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:22.098+0000 7f3dda51b700 1 --2- 172.21.15.62:0/387554647 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3dd4070f20 0x7f3dd414f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:22.106 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:22.098+0000 7f3dd9d1a700 1 --2- 172.21.15.62:0/387554647 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3dd4159bf0 0x7f3dd4155010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:22.106 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:22.102+0000 7f3ddad1c700 1 -- 172.21.15.62:0/387554647 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3dd4070f20 msgr2=0x7f3dd414f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:22.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:22.102+0000 7f3ddad1c700 1 --2- 172.21.15.62:0/387554647 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3dd4070f20 0x7f3dd414f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:22.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:22.102+0000 7f3ddad1c700 1 -- 172.21.15.62:0/387554647 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3dd4159bf0 msgr2=0x7f3dd4155010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:22.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:22.102+0000 7f3ddad1c700 1 --2- 172.21.15.62:0/387554647 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3dd4159bf0 0x7f3dd4155010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:22.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:22.102+0000 7f3ddad1c700 1 -- 172.21.15.62:0/387554647 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dcc009a70 con 0x7f3dd4162840 2023-06-09T04:42:22.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:22.102+0000 7f3dda51b700 1 --2- 172.21.15.62:0/387554647 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3dd4070f20 0x7f3dd414f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:22.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:22.102+0000 7f3ddad1c700 1 --2- 172.21.15.62:0/387554647 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3dd4162840 0x7f3dd40cbe70 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f3dd406a640 tx=0x7f3dcc004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:22.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:22.102+0000 7f3dcaffd700 1 -- 172.21.15.62:0/387554647 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc012430 con 0x7f3dd4162840 2023-06-09T04:42:22.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:22.102+0000 7f3dcaffd700 1 -- 172.21.15.62:0/387554647 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dcc020070 con 0x7f3dd4162840 2023-06-09T04:42:22.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:22.102+0000 7f3dcaffd700 1 -- 172.21.15.62:0/387554647 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dcc004280 con 0x7f3dd4162840 2023-06-09T04:42:22.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:22.102+0000 7f3ddc77f700 1 -- 172.21.15.62:0/387554647 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dd4155a90 con 0x7f3dd4162840 2023-06-09T04:42:22.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:22.102+0000 7f3ddc77f700 1 -- 172.21.15.62:0/387554647 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dd4150770 con 0x7f3dd4162840 2023-06-09T04:42:22.110 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:22.102+0000 7f3ddc77f700 1 -- 172.21.15.62:0/387554647 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dd4067800 con 0x7f3dd4162840 2023-06-09T04:42:22.110 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:22.106+0000 7f3dcaffd700 1 -- 172.21.15.62:0/387554647 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3dcc0043e0 con 0x7f3dd4162840 2023-06-09T04:42:22.110 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:22.106+0000 7f3dcaffd700 1 --2- 172.21.15.62:0/387554647 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f3db80662f0 0x7f3db80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:22.110 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:22.106+0000 7f3dcaffd700 1 -- 172.21.15.62:0/387554647 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f3dcc022070 con 0x7f3dd4162840 2023-06-09T04:42:22.110 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:22.106+0000 7f3dda51b700 1 --2- 172.21.15.62:0/387554647 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f3db80662f0 0x7f3db80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:22.111 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:22.110+0000 7f3dda51b700 1 --2- 172.21.15.62:0/387554647 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f3db80662f0 0x7f3db80687a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3dd00011e0 tx=0x7f3dd0009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:22.112 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:22.110+0000 7f3dcaffd700 1 -- 172.21.15.62:0/387554647 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3dcc052ee0 con 0x7f3dd4162840 2023-06-09T04:42:22.307 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:22.302+0000 7f3ddc77f700 1 -- 172.21.15.62:0/387554647 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3dd404db30 con 0x7f3dd4162840 2023-06-09T04:42:22.899 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:22.894+0000 7f3dcaffd700 1 -- 172.21.15.62:0/387554647 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v34) v1 ==== 178+0+0 (secure 0 0 0) 0x7f3dcc056500 con 0x7f3dd4162840 2023-06-09T04:42:22.903 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:22.898+0000 7f3ddc77f700 1 -- 172.21.15.62:0/387554647 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f3db80662f0 msgr2=0x7f3db80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:22.903 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:22.898+0000 7f3ddc77f700 1 --2- 172.21.15.62:0/387554647 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f3db80662f0 0x7f3db80687a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3dd00011e0 tx=0x7f3dd0009040 comp rx=0 tx=0).stop 2023-06-09T04:42:22.904 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:22.898+0000 7f3ddc77f700 1 -- 172.21.15.62:0/387554647 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3dd4162840 msgr2=0x7f3dd40cbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:22.904 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:22.898+0000 7f3ddc77f700 1 --2- 172.21.15.62:0/387554647 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3dd4162840 0x7f3dd40cbe70 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f3dd406a640 tx=0x7f3dcc004af0 comp rx=0 tx=0).stop 2023-06-09T04:42:22.904 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:22.902+0000 7f3ddc77f700 1 -- 172.21.15.62:0/387554647 shutdown_connections 2023-06-09T04:42:22.904 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:22.902+0000 7f3ddc77f700 1 --2- 172.21.15.62:0/387554647 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f3db80662f0 0x7f3db80687a0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:22.904 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:22.902+0000 7f3ddc77f700 1 --2- 172.21.15.62:0/387554647 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3dd4162840 0x7f3dd40cbe70 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:22.904 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:22.902+0000 7f3ddc77f700 1 --2- 172.21.15.62:0/387554647 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3dd4159bf0 0x7f3dd4155010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:22.905 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:22.902+0000 7f3ddc77f700 1 --2- 172.21.15.62:0/387554647 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3dd4070f20 0x7f3dd414f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:22.905 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:22.902+0000 7f3ddc77f700 1 -- 172.21.15.62:0/387554647 >> 172.21.15.62:0/387554647 conn(0x7f3dd40697f0 msgr2=0x7f3dd40afd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:22.905 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:22.902+0000 7f3ddc77f700 1 -- 172.21.15.62:0/387554647 shutdown_connections 2023-06-09T04:42:22.905 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:22.902+0000 7f3ddc77f700 1 -- 172.21.15.62:0/387554647 wait complete. 2023-06-09T04:42:22.905 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_data_ec' removed 2023-06-09T04:42:22.925 INFO:tasks.ceph.mds.a:Restarting daemon 2023-06-09T04:42:22.925 INFO:tasks.ceph.mds.a:Stopping old one... 2023-06-09T04:42:22.926 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-06-09T04:42:22.926 INFO:teuthology.orchestra.run:waiting for 300 2023-06-09T04:42:22.926 INFO:tasks.ceph.mds.c:Restarting daemon 2023-06-09T04:42:22.926 INFO:tasks.ceph.mds.c:Stopping old one... 2023-06-09T04:42:22.926 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-06-09T04:42:22.927 INFO:teuthology.orchestra.run:waiting for 300 2023-06-09T04:42:22.927 INFO:tasks.ceph.mds.b:Restarting daemon 2023-06-09T04:42:22.927 INFO:tasks.ceph.mds.b:Stopping old one... 2023-06-09T04:42:22.927 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-06-09T04:42:22.927 INFO:teuthology.orchestra.run:waiting for 300 2023-06-09T04:42:22.928 INFO:tasks.ceph.mds.d:Restarting daemon 2023-06-09T04:42:22.928 INFO:tasks.ceph.mds.d:Stopping old one... 2023-06-09T04:42:22.928 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-06-09T04:42:22.929 INFO:teuthology.orchestra.run:waiting for 300 2023-06-09T04:42:22.945 INFO:tasks.ceph.mds.c:Stopped 2023-06-09T04:42:22.946 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-06-09T04:42:22.948 INFO:tasks.ceph.mds.a:Stopped 2023-06-09T04:42:22.948 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-06-09T04:42:22.956 INFO:tasks.ceph.mds.b:Stopped 2023-06-09T04:42:22.956 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-06-09T04:42:22.957 INFO:tasks.ceph.mds.d:Stopped 2023-06-09T04:42:22.957 DEBUG:teuthology.orchestra.run.smithi089:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-06-09T04:42:23.001 INFO:tasks.ceph.mds.c:Started 2023-06-09T04:42:23.001 DEBUG:teuthology.parallel:result is None 2023-06-09T04:42:23.004 INFO:tasks.ceph.mds.b:Started 2023-06-09T04:42:23.005 DEBUG:teuthology.parallel:result is None 2023-06-09T04:42:23.007 INFO:tasks.ceph.mds.a:Started 2023-06-09T04:42:23.007 DEBUG:teuthology.parallel:result is None 2023-06-09T04:42:23.009 INFO:tasks.ceph.mds.d:Started 2023-06-09T04:42:23.009 DEBUG:teuthology.parallel:result is None 2023-06-09T04:42:23.010 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-06-09T04:42:23.121 INFO:tasks.ceph.mds.a.smithi062.stdout:starting mds.a at 2023-06-09T04:42:23.121 INFO:tasks.ceph.mds.b.smithi089.stdout:starting mds.b at 2023-06-09T04:42:23.123 INFO:tasks.ceph.mds.c.smithi062.stdout:starting mds.c at 2023-06-09T04:42:23.126 INFO:tasks.ceph.mds.d.smithi089.stdout:starting mds.d at 2023-06-09T04:42:23.195 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:23.190+0000 7f2d6d31a700 1 Processor -- start 2023-06-09T04:42:23.195 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:23.190+0000 7f2d6d31a700 1 -- start start 2023-06-09T04:42:23.196 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:23.194+0000 7f2d6d31a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2d68159a40 0x7f2d680cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:23.197 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:23.194+0000 7f2d6d31a700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f2d680cd4f0 0x7f2d68070a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:23.197 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:23.194+0000 7f2d6d31a700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d680cc180 con 0x7f2d680c9ea0 2023-06-09T04:42:23.197 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:23.194+0000 7f2d6d31a700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d680cbc00 con 0x7f2d680cd4f0 2023-06-09T04:42:23.197 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:23.194+0000 7f2d6d31a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d680713c0 con 0x7f2d68159a40 2023-06-09T04:42:23.198 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:23.194+0000 7f2d677fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f2d680c9ea0 0x7f2d6815d6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:49366/0 (socket says 172.21.15.62:49366) 2023-06-09T04:42:23.198 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:23.194+0000 7f2d677fe700 1 -- 172.21.15.62:0/1784479593 learned_addr learned my addr 172.21.15.62:0/1784479593 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:42:23.198 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:23.194+0000 7f2d66ffd700 1 --2- 172.21.15.62:0/1784479593 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2d68159a40 0x7f2d680cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:23.198 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:23.194+0000 7f2d667fc700 1 --2- 172.21.15.62:0/1784479593 >> v2:172.21.15.89:3300/0 conn(0x7f2d680cd4f0 0x7f2d68070a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:23.198 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:23.194+0000 7f2d65ffb700 1 -- 172.21.15.62:0/1784479593 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 23760453 0 0) 0x7f2d680cc180 con 0x7f2d680c9ea0 2023-06-09T04:42:23.198 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:23.194+0000 7f2d65ffb700 1 -- 172.21.15.62:0/1784479593 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d500035d0 con 0x7f2d680c9ea0 2023-06-09T04:42:23.199 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:23.194+0000 7f2d66ffd700 1 -- 172.21.15.62:0/1784479593 >> v2:172.21.15.89:3300/0 conn(0x7f2d680cd4f0 msgr2=0x7f2d68070a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:23.199 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:23.194+0000 7f2d66ffd700 1 --2- 172.21.15.62:0/1784479593 >> v2:172.21.15.89:3300/0 conn(0x7f2d680cd4f0 0x7f2d68070a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:23.199 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:23.194+0000 7f2d66ffd700 1 -- 172.21.15.62:0/1784479593 >> v1:172.21.15.62:6789/0 conn(0x7f2d680c9ea0 legacy=0x7f2d6815d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:23.199 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:23.194+0000 7f2d65ffb700 1 -- 172.21.15.62:0/1784479593 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3931671879 0 0) 0x7f2d500035d0 con 0x7f2d680c9ea0 2023-06-09T04:42:23.199 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:23.194+0000 7f2d66ffd700 1 -- 172.21.15.62:0/1784479593 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d680716a0 con 0x7f2d68159a40 2023-06-09T04:42:23.200 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:23.198+0000 7f2d66ffd700 1 --2- 172.21.15.62:0/1784479593 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2d68159a40 0x7f2d680cc610 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2d58009850 tx=0x7f2d58009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3e6dd1da3e5cf58 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:23.200 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:23.198+0000 7f2d65ffb700 1 -- 172.21.15.62:0/1784479593 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d600019f0 con 0x7f2d68159a40 2023-06-09T04:42:23.200 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:23.198+0000 7f2d65ffb700 1 -- 172.21.15.62:0/1784479593 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d58004030 con 0x7f2d68159a40 2023-06-09T04:42:23.201 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:23.198+0000 7f2d65ffb700 1 -- 172.21.15.62:0/1784479593 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d580043e0 con 0x7f2d68159a40 2023-06-09T04:42:23.201 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:23.198+0000 7f2d6d31a700 1 -- 172.21.15.62:0/1784479593 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2d68159a40 msgr2=0x7f2d680cc610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:23.201 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:23.198+0000 7f2d6d31a700 1 --2- 172.21.15.62:0/1784479593 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2d68159a40 0x7f2d680cc610 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2d58009850 tx=0x7f2d58009b60 comp rx=0 tx=0).stop 2023-06-09T04:42:23.202 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:23.198+0000 7f2d6d31a700 1 -- 172.21.15.62:0/1784479593 shutdown_connections 2023-06-09T04:42:23.202 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:23.198+0000 7f2d6d31a700 1 --2- 172.21.15.62:0/1784479593 >> v2:172.21.15.89:3300/0 conn(0x7f2d680cd4f0 0x7f2d68070a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:23.202 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:23.198+0000 7f2d6d31a700 1 --2- 172.21.15.62:0/1784479593 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2d68159a40 0x7f2d680cc610 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:23.202 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:23.198+0000 7f2d6d31a700 1 -- 172.21.15.62:0/1784479593 >> 172.21.15.62:0/1784479593 conn(0x7f2d6806a420 msgr2=0x7f2d680afc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:23.202 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:23.198+0000 7f2d6d31a700 1 -- 172.21.15.62:0/1784479593 shutdown_connections 2023-06-09T04:42:23.202 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:23.198+0000 7f2d6d31a700 1 -- 172.21.15.62:0/1784479593 wait complete. 2023-06-09T04:42:23.203 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:23.202+0000 7f2d6d31a700 1 Processor -- start 2023-06-09T04:42:23.204 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:23.202+0000 7f2d6d31a700 1 -- start start 2023-06-09T04:42:23.205 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:23.202+0000 7f2d6d31a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d680cd4f0 0x7f2d68146870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:23.205 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:23.202+0000 7f2d6d31a700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2d68159a40 0x7f2d680a7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:23.205 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:23.202+0000 7f2d6d31a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d680a80f0 0x7f2d6815bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:23.206 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:23.202+0000 7f2d6d31a700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d68149f20 con 0x7f2d680cd4f0 2023-06-09T04:42:23.206 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:23.202+0000 7f2d6d31a700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d68146db0 con 0x7f2d680a80f0 2023-06-09T04:42:23.206 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:23.202+0000 7f2d6d31a700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d681492a0 con 0x7f2d68159a40 2023-06-09T04:42:23.207 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:23.202+0000 7f2d66ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d680cd4f0 0x7f2d68146870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:23.208 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:23.202+0000 7f2d66ffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d680cd4f0 0x7f2d68146870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42984/0 (socket says 172.21.15.62:42984) 2023-06-09T04:42:23.208 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:23.202+0000 7f2d66ffd700 1 -- 172.21.15.62:0/3189328743 learned_addr learned my addr 172.21.15.62:0/3189328743 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:23.208 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:23.202+0000 7f2d677fe700 1 --2- 172.21.15.62:0/3189328743 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d680a80f0 0x7f2d6815bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:23.208 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:23.202+0000 7f2d667fc700 1 --2- 172.21.15.62:0/3189328743 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2d68159a40 0x7f2d680a7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:23.208 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:23.202+0000 7f2d66ffd700 1 -- 172.21.15.62:0/3189328743 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2d68159a40 msgr2=0x7f2d680a7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:23.208 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:23.202+0000 7f2d66ffd700 1 --2- 172.21.15.62:0/3189328743 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2d68159a40 0x7f2d680a7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:23.209 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:23.202+0000 7f2d66ffd700 1 -- 172.21.15.62:0/3189328743 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d680a80f0 msgr2=0x7f2d6815bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:23.209 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:23.202+0000 7f2d66ffd700 1 --2- 172.21.15.62:0/3189328743 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d680a80f0 0x7f2d6815bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:23.209 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:23.202+0000 7f2d66ffd700 1 -- 172.21.15.62:0/3189328743 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d580094b0 con 0x7f2d680cd4f0 2023-06-09T04:42:23.209 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:23.202+0000 7f2d66ffd700 1 --2- 172.21.15.62:0/3189328743 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d680cd4f0 0x7f2d68146870 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f2d680cbd40 tx=0x7f2d58004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:23.209 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:23.206+0000 7f2d4f7fe700 1 -- 172.21.15.62:0/3189328743 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d58003e70 con 0x7f2d680cd4f0 2023-06-09T04:42:23.209 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:23.206+0000 7f2d4f7fe700 1 -- 172.21.15.62:0/3189328743 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d5801f070 con 0x7f2d680cd4f0 2023-06-09T04:42:23.209 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:23.206+0000 7f2d6d31a700 1 -- 172.21.15.62:0/3189328743 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d68149580 con 0x7f2d680cd4f0 2023-06-09T04:42:23.209 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:23.206+0000 7f2d4f7fe700 1 -- 172.21.15.62:0/3189328743 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d58011870 con 0x7f2d680cd4f0 2023-06-09T04:42:23.210 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:23.206+0000 7f2d6d31a700 1 -- 172.21.15.62:0/3189328743 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d68149b40 con 0x7f2d680cd4f0 2023-06-09T04:42:23.210 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:23.206+0000 7f2d6d31a700 1 -- 172.21.15.62:0/3189328743 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d6814a060 con 0x7f2d680cd4f0 2023-06-09T04:42:23.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:23.210+0000 7f2d4f7fe700 1 -- 172.21.15.62:0/3189328743 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2d580119d0 con 0x7f2d680cd4f0 2023-06-09T04:42:23.213 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:23.210+0000 7f2d4f7fe700 1 --2- 172.21.15.62:0/3189328743 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f2d540662f0 0x7f2d540687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:23.213 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:23.210+0000 7f2d4f7fe700 1 -- 172.21.15.62:0/3189328743 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f2d58021070 con 0x7f2d680cd4f0 2023-06-09T04:42:23.214 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:23.210+0000 7f2d667fc700 1 --2- 172.21.15.62:0/3189328743 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f2d540662f0 0x7f2d540687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:23.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:23.210+0000 7f2d667fc700 1 --2- 172.21.15.62:0/3189328743 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f2d540662f0 0x7f2d540687a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2d680b3b00 tx=0x7f2d5c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:23.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:23.214+0000 7f2d4f7fe700 1 -- 172.21.15.62:0/3189328743 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f2d6814a060 con 0x7f2d680cd4f0 2023-06-09T04:42:23.405 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:23.402+0000 7f2d6d31a700 1 -- 172.21.15.62:0/3189328743 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f2d6814a060 con 0x7f2d680cd4f0 2023-06-09T04:42:24.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.182+0000 7f2d4f7fe700 1 -- 172.21.15.62:0/3189328743 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v39) v1 ==== 97+0+0 (secure 0 0 0) 0x7f2d6814a060 con 0x7f2d680cd4f0 2023-06-09T04:42:24.189 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.186+0000 7f2d6d31a700 1 -- 172.21.15.62:0/3189328743 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f2d540662f0 msgr2=0x7f2d540687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:24.189 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.186+0000 7f2d6d31a700 1 --2- 172.21.15.62:0/3189328743 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f2d540662f0 0x7f2d540687a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2d680b3b00 tx=0x7f2d5c008040 comp rx=0 tx=0).stop 2023-06-09T04:42:24.190 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.186+0000 7f2d6d31a700 1 -- 172.21.15.62:0/3189328743 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d680cd4f0 msgr2=0x7f2d68146870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:24.190 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.186+0000 7f2d6d31a700 1 --2- 172.21.15.62:0/3189328743 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d680cd4f0 0x7f2d68146870 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f2d680cbd40 tx=0x7f2d58004770 comp rx=0 tx=0).stop 2023-06-09T04:42:24.190 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.186+0000 7f2d6d31a700 1 -- 172.21.15.62:0/3189328743 shutdown_connections 2023-06-09T04:42:24.190 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.186+0000 7f2d6d31a700 1 --2- 172.21.15.62:0/3189328743 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f2d540662f0 0x7f2d540687a0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:24.190 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.186+0000 7f2d6d31a700 1 --2- 172.21.15.62:0/3189328743 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d680a80f0 0x7f2d6815bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:24.190 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.186+0000 7f2d6d31a700 1 --2- 172.21.15.62:0/3189328743 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2d68159a40 0x7f2d680a7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:24.190 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.186+0000 7f2d6d31a700 1 --2- 172.21.15.62:0/3189328743 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2d680cd4f0 0x7f2d68146870 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:24.191 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.186+0000 7f2d6d31a700 1 -- 172.21.15.62:0/3189328743 >> 172.21.15.62:0/3189328743 conn(0x7f2d680c9ea0 msgr2=0x7f2d680adf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:24.191 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.186+0000 7f2d6d31a700 1 -- 172.21.15.62:0/3189328743 shutdown_connections 2023-06-09T04:42:24.191 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.186+0000 7f2d6d31a700 1 -- 172.21.15.62:0/3189328743 wait complete. 2023-06-09T04:42:24.191 INFO:teuthology.orchestra.run.smithi062.stderr: removed all blocklist entries 2023-06-09T04:42:24.211 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-06-09T04:42:24.388 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.386+0000 7f4039c9f700 1 Processor -- start 2023-06-09T04:42:24.388 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.386+0000 7f4039c9f700 1 -- start start 2023-06-09T04:42:24.391 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.386+0000 7f4039c9f700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f40340ca5b0 0x7f40340cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:24.391 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.390+0000 7f4039c9f700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4034071180 con 0x7f40340cd4f0 2023-06-09T04:42:24.392 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.390+0000 7f4039c9f700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40340cc180 con 0x7f4034159a40 2023-06-09T04:42:24.392 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.390+0000 7f4039c9f700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40340cbc00 con 0x7f40340ca5b0 2023-06-09T04:42:24.395 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.390+0000 7f4033fff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f40340cd4f0 0x7f40340c9ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:49370/0 (socket says 172.21.15.62:49370) 2023-06-09T04:42:24.395 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.390+0000 7f4033fff700 1 -- 172.21.15.62:0/2571328230 learned_addr learned my addr 172.21.15.62:0/2571328230 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:42:24.395 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.390+0000 7f403949e700 1 --2- 172.21.15.62:0/2571328230 >> v2:172.21.15.89:3300/0 conn(0x7f40340ca5b0 0x7f40340cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:24.395 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.390+0000 7f40337fe700 1 -- 172.21.15.62:0/2571328230 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 585098795 0 0) 0x7f4020001110 con 0x7f40340cd4f0 2023-06-09T04:42:24.396 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.390+0000 7f40337fe700 1 -- 172.21.15.62:0/2571328230 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40240035d0 con 0x7f40340cd4f0 2023-06-09T04:42:24.396 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.390+0000 7f40337fe700 1 -- 172.21.15.62:0/2571328230 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4138873088 0 0) 0x7f40340cc180 con 0x7f4034159a40 2023-06-09T04:42:24.396 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.390+0000 7f40337fe700 1 -- 172.21.15.62:0/2571328230 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4020001110 con 0x7f4034159a40 2023-06-09T04:42:24.397 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.390+0000 7f40337fe700 1 -- 172.21.15.62:0/2571328230 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3227436933 0 0) 0x7f40240035d0 con 0x7f40340cd4f0 2023-06-09T04:42:24.397 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.390+0000 7f40337fe700 1 -- 172.21.15.62:0/2571328230 >> v2:172.21.15.89:3300/0 conn(0x7f40340ca5b0 msgr2=0x7f40340cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:24.397 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.390+0000 7f40337fe700 1 --2- 172.21.15.62:0/2571328230 >> v2:172.21.15.89:3300/0 conn(0x7f40340ca5b0 0x7f40340cc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:24.397 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.390+0000 7f40337fe700 1 -- 172.21.15.62:0/2571328230 >> v1:172.21.15.89:6789/0 conn(0x7f4034159a40 legacy=0x7f4034070a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:24.398 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.390+0000 7f40337fe700 1 -- 172.21.15.62:0/2571328230 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40340713c0 con 0x7f40340cd4f0 2023-06-09T04:42:24.398 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.390+0000 7f40337fe700 1 -- 172.21.15.62:0/2571328230 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 540845019 0 0) 0x7f4020001800 con 0x7f40340cd4f0 2023-06-09T04:42:24.398 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.390+0000 7f40337fe700 1 -- 172.21.15.62:0/2571328230 >> v1:172.21.15.62:6789/0 conn(0x7f40340cd4f0 legacy=0x7f40340c9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:24.398 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.390+0000 7f40337fe700 1 --2- 172.21.15.62:0/2571328230 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4024003be0 0x7f4024003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:24.399 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.390+0000 7f40337fe700 1 --2- 172.21.15.62:0/2571328230 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4024004870 0x7f4024004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:24.399 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.390+0000 7f40337fe700 1 --2- 172.21.15.62:0/2571328230 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4024005220 0x7f402400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:24.399 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.390+0000 7f40337fe700 1 -- 172.21.15.62:0/2571328230 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40340cbc00 con 0x7f4024003be0 2023-06-09T04:42:24.399 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.390+0000 7f40337fe700 1 -- 172.21.15.62:0/2571328230 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f402400c0b0 con 0x7f4024004870 2023-06-09T04:42:24.400 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.390+0000 7f40337fe700 1 -- 172.21.15.62:0/2571328230 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f402400c270 con 0x7f4024005220 2023-06-09T04:42:24.400 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.390+0000 7f403949e700 1 --2- 172.21.15.62:0/2571328230 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4024005220 0x7f402400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:24.400 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.390+0000 7f4038c9d700 1 --2- 172.21.15.62:0/2571328230 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4024003be0 0x7f4024003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:24.400 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.390+0000 7f4033fff700 1 --2- 172.21.15.62:0/2571328230 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4024004870 0x7f4024004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:24.405 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.390+0000 7f403949e700 1 -- 172.21.15.62:0/2571328230 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4024004870 msgr2=0x7f4024004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:24.405 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.394+0000 7f403949e700 1 --2- 172.21.15.62:0/2571328230 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4024004870 0x7f4024004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:24.405 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.394+0000 7f403949e700 1 -- 172.21.15.62:0/2571328230 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4024003be0 msgr2=0x7f4024003fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:24.406 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.394+0000 7f403949e700 1 --2- 172.21.15.62:0/2571328230 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4024003be0 0x7f4024003fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:24.406 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.394+0000 7f403949e700 1 -- 172.21.15.62:0/2571328230 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40240035d0 con 0x7f4024005220 2023-06-09T04:42:24.406 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.394+0000 7f403949e700 1 -- 172.21.15.62:0/2571328230 reap_dead start 2023-06-09T04:42:24.406 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.394+0000 7f403949e700 1 --2- 172.21.15.62:0/2571328230 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4024005220 0x7f402400ba30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f40340ca9a0 tx=0x7f40240058a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=76be7e384da927e1 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:24.407 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.394+0000 7f40337fe700 1 -- 172.21.15.62:0/2571328230 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f402c018070 con 0x7f4024005220 2023-06-09T04:42:24.407 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.394+0000 7f40337fe700 1 -- 172.21.15.62:0/2571328230 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f402c00f040 con 0x7f4024005220 2023-06-09T04:42:24.407 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.394+0000 7f40337fe700 1 -- 172.21.15.62:0/2571328230 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f402c00ec10 con 0x7f4024005220 2023-06-09T04:42:24.407 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.394+0000 7f4039c9f700 1 -- 172.21.15.62:0/2571328230 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4024005220 msgr2=0x7f402400ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:24.408 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.394+0000 7f4039c9f700 1 --2- 172.21.15.62:0/2571328230 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4024005220 0x7f402400ba30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f40340ca9a0 tx=0x7f40240058a0 comp rx=0 tx=0).stop 2023-06-09T04:42:24.408 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.394+0000 7f4039c9f700 1 -- 172.21.15.62:0/2571328230 shutdown_connections 2023-06-09T04:42:24.408 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.394+0000 7f4039c9f700 1 --2- 172.21.15.62:0/2571328230 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4024005220 0x7f402400ba30 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:24.409 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.394+0000 7f4039c9f700 1 -- 172.21.15.62:0/2571328230 >> 172.21.15.62:0/2571328230 conn(0x7f403406a420 msgr2=0x7f40340afc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:24.409 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.394+0000 7f4039c9f700 1 -- 172.21.15.62:0/2571328230 shutdown_connections 2023-06-09T04:42:24.409 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.394+0000 7f4039c9f700 1 -- 172.21.15.62:0/2571328230 wait complete. 2023-06-09T04:42:24.409 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.398+0000 7f4039c9f700 1 Processor -- start 2023-06-09T04:42:24.410 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.398+0000 7f4039c9f700 1 -- start start 2023-06-09T04:42:24.410 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.398+0000 7f4039c9f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f403415c360 0x7f40341587a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:24.410 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.398+0000 7f4039c9f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f403415c730 0x7f4034146ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:24.410 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.398+0000 7f4039c9f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f40341473e0 0x7f40341f0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:24.411 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.398+0000 7f4039c9f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4034147850 con 0x7f403415c360 2023-06-09T04:42:24.411 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.398+0000 7f4039c9f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4034156bc0 con 0x7f403415c730 2023-06-09T04:42:24.411 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.398+0000 7f4039c9f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4034156ea0 con 0x7f40341473e0 2023-06-09T04:42:24.411 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.398+0000 7f4038c9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f403415c360 0x7f40341587a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:24.412 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.398+0000 7f4038c9d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f403415c360 0x7f40341587a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42992/0 (socket says 172.21.15.62:42992) 2023-06-09T04:42:24.412 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.398+0000 7f4038c9d700 1 -- 172.21.15.62:0/2929714604 learned_addr learned my addr 172.21.15.62:0/2929714604 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:24.412 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.398+0000 7f4033fff700 1 --2- 172.21.15.62:0/2929714604 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f403415c730 0x7f4034146ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:24.413 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.398+0000 7f403949e700 1 --2- 172.21.15.62:0/2929714604 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f40341473e0 0x7f40341f0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:24.413 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.398+0000 7f4038c9d700 1 -- 172.21.15.62:0/2929714604 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f40341473e0 msgr2=0x7f40341f0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:24.413 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.398+0000 7f4038c9d700 1 --2- 172.21.15.62:0/2929714604 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f40341473e0 0x7f40341f0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:24.413 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.398+0000 7f4038c9d700 1 -- 172.21.15.62:0/2929714604 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f403415c730 msgr2=0x7f4034146ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:24.414 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.398+0000 7f4038c9d700 1 --2- 172.21.15.62:0/2929714604 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f403415c730 0x7f4034146ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:24.414 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.402+0000 7f4038c9d700 1 -- 172.21.15.62:0/2929714604 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4034157180 con 0x7f403415c360 2023-06-09T04:42:24.414 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.402+0000 7f4033fff700 1 --2- 172.21.15.62:0/2929714604 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f403415c730 0x7f4034146ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:24.414 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.402+0000 7f403949e700 1 --2- 172.21.15.62:0/2929714604 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f40341473e0 0x7f40341f0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:24.415 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.402+0000 7f4038c9d700 1 --2- 172.21.15.62:0/2929714604 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f403415c360 0x7f40341587a0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f402800f750 tx=0x7f402800fb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:24.415 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.402+0000 7f40317fa700 1 -- 172.21.15.62:0/2929714604 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4028005320 con 0x7f403415c360 2023-06-09T04:42:24.415 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.402+0000 7f40317fa700 1 -- 172.21.15.62:0/2929714604 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40280054a0 con 0x7f403415c360 2023-06-09T04:42:24.415 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.402+0000 7f40317fa700 1 -- 172.21.15.62:0/2929714604 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4028006ac0 con 0x7f403415c360 2023-06-09T04:42:24.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.402+0000 7f4039c9f700 1 -- 172.21.15.62:0/2929714604 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4034157460 con 0x7f403415c360 2023-06-09T04:42:24.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.402+0000 7f4039c9f700 1 -- 172.21.15.62:0/2929714604 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40341567f0 con 0x7f403415c360 2023-06-09T04:42:24.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.402+0000 7f4039c9f700 1 -- 172.21.15.62:0/2929714604 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40340739c0 con 0x7f403415c360 2023-06-09T04:42:24.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.406+0000 7f40317fa700 1 -- 172.21.15.62:0/2929714604 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4028006c20 con 0x7f403415c360 2023-06-09T04:42:24.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.406+0000 7f40317fa700 1 --2- 172.21.15.62:0/2929714604 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f40180662f0 0x7f40180687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:24.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.406+0000 7f40317fa700 1 -- 172.21.15.62:0/2929714604 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f4028083100 con 0x7f403415c360 2023-06-09T04:42:24.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.406+0000 7f4033fff700 1 --2- 172.21.15.62:0/2929714604 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f40180662f0 0x7f40180687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:24.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.406+0000 7f4033fff700 1 --2- 172.21.15.62:0/2929714604 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f40180662f0 0x7f40180687a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f40340c99b0 tx=0x7f4020009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:24.418 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.414+0000 7f40317fa700 1 -- 172.21.15.62:0/2929714604 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f40280506f0 con 0x7f403415c360 2023-06-09T04:42:24.649 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.646+0000 7f4039c9f700 1 -- 172.21.15.62:0/2929714604 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f403415a110 con 0x7f403415c360 2023-06-09T04:42:24.650 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.646+0000 7f40317fa700 1 -- 172.21.15.62:0/2929714604 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v8) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f4028053d10 con 0x7f403415c360 2023-06-09T04:42:24.651 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:42:24.651 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2023-06-09T04:42:24.651 INFO:teuthology.orchestra.run.smithi062.stdout: "auth_dump": [ 2023-06-09T04:42:24.651 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-06-09T04:42:24.651 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "mds.a", 2023-06-09T04:42:24.651 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQAZrYJk42iDFxAA+c2CwYweXtVaFzUMyaacNQ==", 2023-06-09T04:42:24.651 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-06-09T04:42:24.652 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2023-06-09T04:42:24.652 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2023-06-09T04:42:24.652 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2023-06-09T04:42:24.652 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2023-06-09T04:42:24.652 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-06-09T04:42:24.652 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-06-09T04:42:24.653 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-06-09T04:42:24.653 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "mds.b", 2023-06-09T04:42:24.653 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQAZrYJkvFH5KhAA4Pl4utP88ZxAE4zdkXdjjw==", 2023-06-09T04:42:24.653 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-06-09T04:42:24.653 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2023-06-09T04:42:24.653 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2023-06-09T04:42:24.653 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2023-06-09T04:42:24.653 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2023-06-09T04:42:24.654 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-06-09T04:42:24.654 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-06-09T04:42:24.654 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-06-09T04:42:24.654 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "mds.c", 2023-06-09T04:42:24.654 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQAZrYJkooeaIhAAMlbe2ux/81h5CzYjg+Ulsw==", 2023-06-09T04:42:24.654 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-06-09T04:42:24.654 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2023-06-09T04:42:24.654 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2023-06-09T04:42:24.655 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2023-06-09T04:42:24.655 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2023-06-09T04:42:24.655 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-06-09T04:42:24.655 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-06-09T04:42:24.655 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-06-09T04:42:24.655 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "mds.d", 2023-06-09T04:42:24.655 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQAZrYJkRA6kNRAACD2W4V91yXmgwVDZ5dQddA==", 2023-06-09T04:42:24.656 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-06-09T04:42:24.656 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2023-06-09T04:42:24.656 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2023-06-09T04:42:24.656 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2023-06-09T04:42:24.656 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2023-06-09T04:42:24.656 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-06-09T04:42:24.656 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-06-09T04:42:24.657 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-06-09T04:42:24.657 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.0", 2023-06-09T04:42:24.657 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQAdrYJkRss1JhAAcdLrgbERFQVCiEykWwPVPw==", 2023-06-09T04:42:24.657 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-06-09T04:42:24.657 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow profile osd", 2023-06-09T04:42:24.657 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile osd", 2023-06-09T04:42:24.657 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2023-06-09T04:42:24.657 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-06-09T04:42:24.658 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-06-09T04:42:24.658 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-06-09T04:42:24.658 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.1", 2023-06-09T04:42:24.658 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQAgrYJkvHfvNBAASz7iQzBaI2LSpPqYEjbLAA==", 2023-06-09T04:42:24.658 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-06-09T04:42:24.658 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow profile osd", 2023-06-09T04:42:24.658 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile osd", 2023-06-09T04:42:24.659 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2023-06-09T04:42:24.659 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-06-09T04:42:24.659 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-06-09T04:42:24.659 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-06-09T04:42:24.659 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.2", 2023-06-09T04:42:24.659 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQAkrYJk/WTmBhAAlrHI/fMDgRMA+2a4fTxW2w==", 2023-06-09T04:42:24.659 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-06-09T04:42:24.659 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow profile osd", 2023-06-09T04:42:24.660 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile osd", 2023-06-09T04:42:24.660 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2023-06-09T04:42:24.660 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-06-09T04:42:24.660 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-06-09T04:42:24.660 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-06-09T04:42:24.660 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.3", 2023-06-09T04:42:24.660 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQAnrYJkcZyVFBAAlH7++y04LZmd2DKV1ZbYgQ==", 2023-06-09T04:42:24.660 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-06-09T04:42:24.661 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow profile osd", 2023-06-09T04:42:24.661 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile osd", 2023-06-09T04:42:24.661 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2023-06-09T04:42:24.661 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-06-09T04:42:24.661 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-06-09T04:42:24.661 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-06-09T04:42:24.661 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.4", 2023-06-09T04:42:24.662 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQAtrYJkWJvLKhAALJUSOqdOW7z4nLtu71072A==", 2023-06-09T04:42:24.662 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-06-09T04:42:24.662 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow profile osd", 2023-06-09T04:42:24.662 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile osd", 2023-06-09T04:42:24.662 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2023-06-09T04:42:24.662 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-06-09T04:42:24.662 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-06-09T04:42:24.662 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-06-09T04:42:24.663 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.5", 2023-06-09T04:42:24.663 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQAwrYJkFdt8OBAAOcWVsLco9sD6WUxNxYuW/g==", 2023-06-09T04:42:24.663 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-06-09T04:42:24.663 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow profile osd", 2023-06-09T04:42:24.663 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile osd", 2023-06-09T04:42:24.663 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2023-06-09T04:42:24.663 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-06-09T04:42:24.663 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-06-09T04:42:24.664 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-06-09T04:42:24.664 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.6", 2023-06-09T04:42:24.664 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA0rYJkx2eRCRAA3KTwiARC9abe6rjN99Erew==", 2023-06-09T04:42:24.664 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-06-09T04:42:24.664 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow profile osd", 2023-06-09T04:42:24.664 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile osd", 2023-06-09T04:42:24.664 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2023-06-09T04:42:24.665 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-06-09T04:42:24.665 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-06-09T04:42:24.665 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-06-09T04:42:24.665 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.7", 2023-06-09T04:42:24.665 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA3rYJkSsaGFxAAVncX4e/ABMEcJ4hqiqHZCg==", 2023-06-09T04:42:24.665 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-06-09T04:42:24.665 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow profile osd", 2023-06-09T04:42:24.665 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile osd", 2023-06-09T04:42:24.666 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2023-06-09T04:42:24.666 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-06-09T04:42:24.666 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-06-09T04:42:24.666 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-06-09T04:42:24.666 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.0", 2023-06-09T04:42:24.666 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQAarYJkIa0DARAAVRIC7NMEOq/Qp+fO+wQe5w==", 2023-06-09T04:42:24.666 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-06-09T04:42:24.667 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2023-06-09T04:42:24.667 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow r", 2023-06-09T04:42:24.667 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow rw", 2023-06-09T04:42:24.667 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow rwx" 2023-06-09T04:42:24.667 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-06-09T04:42:24.667 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-06-09T04:42:24.667 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-06-09T04:42:24.667 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.1", 2023-06-09T04:42:24.668 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQAarYJkWbxgDRAA0769AOxjUqgFIfhLTSHVrw==", 2023-06-09T04:42:24.668 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-06-09T04:42:24.668 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2023-06-09T04:42:24.668 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow r", 2023-06-09T04:42:24.668 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow rw", 2023-06-09T04:42:24.668 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow rwx" 2023-06-09T04:42:24.668 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-06-09T04:42:24.668 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-06-09T04:42:24.669 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-06-09T04:42:24.669 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.2", 2023-06-09T04:42:24.669 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQAarYJksGznBhAAmyV0iiUHFGmesplmEY9tjw==", 2023-06-09T04:42:24.669 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-06-09T04:42:24.669 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2023-06-09T04:42:24.669 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow r", 2023-06-09T04:42:24.669 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow rw", 2023-06-09T04:42:24.669 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow rwx" 2023-06-09T04:42:24.670 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-06-09T04:42:24.670 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-06-09T04:42:24.670 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-06-09T04:42:24.670 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.3", 2023-06-09T04:42:24.670 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQAarYJktADAExAA2lvRbNjB4bH/EE8bL0rtGg==", 2023-06-09T04:42:24.670 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-06-09T04:42:24.670 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2023-06-09T04:42:24.670 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow r", 2023-06-09T04:42:24.671 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow rw", 2023-06-09T04:42:24.671 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow rwx" 2023-06-09T04:42:24.671 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-06-09T04:42:24.671 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-06-09T04:42:24.671 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-06-09T04:42:24.671 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.admin", 2023-06-09T04:42:24.671 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw==", 2023-06-09T04:42:24.672 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-06-09T04:42:24.672 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow *", 2023-06-09T04:42:24.672 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2023-06-09T04:42:24.672 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2023-06-09T04:42:24.672 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2023-06-09T04:42:24.672 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-06-09T04:42:24.672 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-06-09T04:42:24.673 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-06-09T04:42:24.673 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.bootstrap-mds", 2023-06-09T04:42:24.673 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA+rYJkuBUNHBAA/L4mJothtdm/Rm/oW6dV0A==", 2023-06-09T04:42:24.673 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-06-09T04:42:24.673 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile bootstrap-mds" 2023-06-09T04:42:24.673 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-06-09T04:42:24.673 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-06-09T04:42:24.673 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-06-09T04:42:24.674 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.bootstrap-mgr", 2023-06-09T04:42:24.674 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA+rYJkUyoNHBAAChdSQjfZ3mm2VCTnVASQ1Q==", 2023-06-09T04:42:24.674 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-06-09T04:42:24.674 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile bootstrap-mgr" 2023-06-09T04:42:24.674 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-06-09T04:42:24.674 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-06-09T04:42:24.674 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-06-09T04:42:24.674 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.bootstrap-osd", 2023-06-09T04:42:24.675 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA+rYJkGDwNHBAAKvQPVvcv04vFRnyK8e/imQ==", 2023-06-09T04:42:24.675 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-06-09T04:42:24.675 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile bootstrap-osd" 2023-06-09T04:42:24.675 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-06-09T04:42:24.675 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-06-09T04:42:24.675 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-06-09T04:42:24.675 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.bootstrap-rbd", 2023-06-09T04:42:24.675 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA+rYJkDlANHBAAXDi5jx2o4YX8LHQUzPxZ9A==", 2023-06-09T04:42:24.676 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-06-09T04:42:24.676 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile bootstrap-rbd" 2023-06-09T04:42:24.676 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-06-09T04:42:24.676 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-06-09T04:42:24.676 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-06-09T04:42:24.676 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-06-09T04:42:24.676 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA+rYJkEGINHBAANJ15jzcZt/Zv2nFg13xjPA==", 2023-06-09T04:42:24.676 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-06-09T04:42:24.677 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-06-09T04:42:24.677 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-06-09T04:42:24.677 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-06-09T04:42:24.677 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-06-09T04:42:24.677 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.bootstrap-rgw", 2023-06-09T04:42:24.677 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA+rYJkxnQNHBAAnM/ebOseuPOlVvX+w3+SOA==", 2023-06-09T04:42:24.677 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-06-09T04:42:24.678 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile bootstrap-rgw" 2023-06-09T04:42:24.678 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-06-09T04:42:24.678 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-06-09T04:42:24.678 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-06-09T04:42:24.678 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "mgr.x", 2023-06-09T04:42:24.678 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQAZrYJkMv+HEBAAuyUeDIJdP2fkpuI+XkvVNw==", 2023-06-09T04:42:24.678 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-06-09T04:42:24.678 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow *", 2023-06-09T04:42:24.679 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile mgr", 2023-06-09T04:42:24.679 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2023-06-09T04:42:24.679 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-06-09T04:42:24.679 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-06-09T04:42:24.679 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-06-09T04:42:24.679 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "mgr.y", 2023-06-09T04:42:24.679 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQAZrYJkiH83ChAAC28n3BSdrXf3XU+7S34z0w==", 2023-06-09T04:42:24.679 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-06-09T04:42:24.680 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow *", 2023-06-09T04:42:24.680 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile mgr", 2023-06-09T04:42:24.680 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2023-06-09T04:42:24.680 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-06-09T04:42:24.680 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-06-09T04:42:24.680 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2023-06-09T04:42:24.680 INFO:teuthology.orchestra.run.smithi062.stdout:} 2023-06-09T04:42:24.682 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.650+0000 7f4039c9f700 1 -- 172.21.15.62:0/2929714604 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f40180662f0 msgr2=0x7f40180687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:24.682 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.650+0000 7f4039c9f700 1 --2- 172.21.15.62:0/2929714604 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f40180662f0 0x7f40180687a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f40340c99b0 tx=0x7f4020009040 comp rx=0 tx=0).stop 2023-06-09T04:42:24.682 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.650+0000 7f4039c9f700 1 -- 172.21.15.62:0/2929714604 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f403415c360 msgr2=0x7f40341587a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:24.682 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.650+0000 7f4039c9f700 1 --2- 172.21.15.62:0/2929714604 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f403415c360 0x7f40341587a0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f402800f750 tx=0x7f402800fb10 comp rx=0 tx=0).stop 2023-06-09T04:42:24.682 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.654+0000 7f4039c9f700 1 -- 172.21.15.62:0/2929714604 shutdown_connections 2023-06-09T04:42:24.682 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.654+0000 7f4039c9f700 1 --2- 172.21.15.62:0/2929714604 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f40180662f0 0x7f40180687a0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:24.683 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.654+0000 7f4039c9f700 1 --2- 172.21.15.62:0/2929714604 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f40341473e0 0x7f40341f0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:24.683 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.654+0000 7f4039c9f700 1 --2- 172.21.15.62:0/2929714604 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f403415c730 0x7f4034146ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:24.683 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.654+0000 7f4039c9f700 1 --2- 172.21.15.62:0/2929714604 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f403415c360 0x7f40341587a0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:24.683 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.654+0000 7f4039c9f700 1 -- 172.21.15.62:0/2929714604 >> 172.21.15.62:0/2929714604 conn(0x7f4024005220 msgr2=0x7f40340b30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:24.683 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.654+0000 7f4039c9f700 1 -- 172.21.15.62:0/2929714604 shutdown_connections 2023-06-09T04:42:24.683 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.654+0000 7f4039c9f700 1 -- 172.21.15.62:0/2929714604 wait complete. 2023-06-09T04:42:24.684 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-06-09T04:42:24.860 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.858+0000 7f9a16b8b700 1 Processor -- start 2023-06-09T04:42:24.860 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.858+0000 7f9a16b8b700 1 -- start start 2023-06-09T04:42:24.862 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.858+0000 7f9a16b8b700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9a10160340 0x7f9a100caa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:24.862 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.858+0000 7f9a16b8b700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a100cdc20 con 0x7f9a1015ff70 2023-06-09T04:42:24.863 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.858+0000 7f9a16b8b700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a100cd330 con 0x7f9a100caf80 2023-06-09T04:42:24.863 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.858+0000 7f9a16b8b700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a100cb400 con 0x7f9a10160340 2023-06-09T04:42:24.863 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.858+0000 7f9a15b89700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f9a1015ff70 0x7f9a100c9cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:49380/0 (socket says 172.21.15.62:49380) 2023-06-09T04:42:24.863 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.858+0000 7f9a15b89700 1 -- 172.21.15.62:0/1709418593 learned_addr learned my addr 172.21.15.62:0/1709418593 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:42:24.864 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.862+0000 7f9a15388700 1 --2- 172.21.15.62:0/1709418593 >> v2:172.21.15.62:3300/0 conn(0x7f9a10160340 0x7f9a100caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:24.864 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.862+0000 7f9a14b87700 1 -- 172.21.15.62:0/1709418593 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2689516473 0 0) 0x7f9a100cdc20 con 0x7f9a1015ff70 2023-06-09T04:42:24.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.862+0000 7f9a14b87700 1 -- 172.21.15.62:0/1709418593 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99fc0035d0 con 0x7f9a1015ff70 2023-06-09T04:42:24.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.862+0000 7f9a14b87700 1 -- 172.21.15.62:0/1709418593 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2482359293 0 0) 0x7f9a100cd330 con 0x7f9a100caf80 2023-06-09T04:42:24.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.862+0000 7f9a14b87700 1 -- 172.21.15.62:0/1709418593 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a100cdc20 con 0x7f9a100caf80 2023-06-09T04:42:24.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.862+0000 7f9a15388700 1 -- 172.21.15.62:0/1709418593 >> v1:172.21.15.89:6789/0 conn(0x7f9a100caf80 legacy=0x7f9a10163df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:24.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.862+0000 7f9a15388700 1 -- 172.21.15.62:0/1709418593 >> v1:172.21.15.62:6789/0 conn(0x7f9a1015ff70 legacy=0x7f9a100c9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:24.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.862+0000 7f9a15388700 1 -- 172.21.15.62:0/1709418593 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a100cd5d0 con 0x7f9a10160340 2023-06-09T04:42:24.866 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.862+0000 7f9a15388700 1 --2- 172.21.15.62:0/1709418593 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a10160340 0x7f9a100caa40 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f9a00009850 tx=0x7f9a00009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66f51fd6322767b6 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:24.866 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.862+0000 7f9a14b87700 1 -- 172.21.15.62:0/1709418593 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a00011830 con 0x7f9a10160340 2023-06-09T04:42:24.866 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.862+0000 7f9a14b87700 1 -- 172.21.15.62:0/1709418593 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a00011990 con 0x7f9a10160340 2023-06-09T04:42:24.866 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.862+0000 7f9a14b87700 1 -- 172.21.15.62:0/1709418593 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a00011d40 con 0x7f9a10160340 2023-06-09T04:42:24.867 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.862+0000 7f9a16b8b700 1 -- 172.21.15.62:0/1709418593 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a10160340 msgr2=0x7f9a100caa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:24.867 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.862+0000 7f9a16b8b700 1 --2- 172.21.15.62:0/1709418593 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a10160340 0x7f9a100caa40 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f9a00009850 tx=0x7f9a00009b60 comp rx=0 tx=0).stop 2023-06-09T04:42:24.867 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.862+0000 7f9a16b8b700 1 -- 172.21.15.62:0/1709418593 shutdown_connections 2023-06-09T04:42:24.868 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.862+0000 7f9a16b8b700 1 --2- 172.21.15.62:0/1709418593 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a10160340 0x7f9a100caa40 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:24.868 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.862+0000 7f9a16b8b700 1 -- 172.21.15.62:0/1709418593 >> 172.21.15.62:0/1709418593 conn(0x7f9a1006a420 msgr2=0x7f9a100afc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:24.868 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.862+0000 7f9a16b8b700 1 -- 172.21.15.62:0/1709418593 shutdown_connections 2023-06-09T04:42:24.868 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.866+0000 7f9a16b8b700 1 -- 172.21.15.62:0/1709418593 wait complete. 2023-06-09T04:42:24.869 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.866+0000 7f9a16b8b700 1 Processor -- start 2023-06-09T04:42:24.870 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.866+0000 7f9a16b8b700 1 -- start start 2023-06-09T04:42:24.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.870+0000 7f9a16b8b700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a1015ff70 0x7f9a100b1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:24.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.870+0000 7f9a16b8b700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9a10160340 0x7f9a101630f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:24.872 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.870+0000 7f9a16b8b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a10156f30 0x7f9a100b31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:24.872 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.870+0000 7f9a16b8b700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a10160ce0 con 0x7f9a10156f30 2023-06-09T04:42:24.872 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.870+0000 7f9a16b8b700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a100b2510 con 0x7f9a1015ff70 2023-06-09T04:42:24.872 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.870+0000 7f9a16b8b700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a10163630 con 0x7f9a10160340 2023-06-09T04:42:24.873 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.870+0000 7f9a1638a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a10156f30 0x7f9a100b31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:24.873 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.870+0000 7f9a1638a700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a10156f30 0x7f9a100b31d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43018/0 (socket says 172.21.15.62:43018) 2023-06-09T04:42:24.873 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.870+0000 7f9a1638a700 1 -- 172.21.15.62:0/2953486158 learned_addr learned my addr 172.21.15.62:0/2953486158 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:24.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.870+0000 7f9a15b89700 1 --2- 172.21.15.62:0/2953486158 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a1015ff70 0x7f9a100b1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:24.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.870+0000 7f9a15388700 1 --2- 172.21.15.62:0/2953486158 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9a10160340 0x7f9a101630f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:24.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.870+0000 7f9a1638a700 1 -- 172.21.15.62:0/2953486158 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9a10160340 msgr2=0x7f9a101630f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:24.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.870+0000 7f9a1638a700 1 --2- 172.21.15.62:0/2953486158 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9a10160340 0x7f9a101630f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:24.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.870+0000 7f9a1638a700 1 -- 172.21.15.62:0/2953486158 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a1015ff70 msgr2=0x7f9a100b1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:24.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.870+0000 7f9a1638a700 1 --2- 172.21.15.62:0/2953486158 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a1015ff70 0x7f9a100b1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:24.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.870+0000 7f9a1638a700 1 -- 172.21.15.62:0/2953486158 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a000094b0 con 0x7f9a10156f30 2023-06-09T04:42:24.875 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.870+0000 7f9a1638a700 1 --2- 172.21.15.62:0/2953486158 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a10156f30 0x7f9a100b31d0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f9a0800cbc0 tx=0x7f9a0800ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:24.875 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.870+0000 7f9a067fc700 1 -- 172.21.15.62:0/2953486158 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a08003c20 con 0x7f9a10156f30 2023-06-09T04:42:24.875 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.870+0000 7f9a067fc700 1 -- 172.21.15.62:0/2953486158 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a08003d80 con 0x7f9a10156f30 2023-06-09T04:42:24.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.870+0000 7f9a16b8b700 1 -- 172.21.15.62:0/2953486158 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a100b1f50 con 0x7f9a10156f30 2023-06-09T04:42:24.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.870+0000 7f9a067fc700 1 -- 172.21.15.62:0/2953486158 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a0800aaa0 con 0x7f9a10156f30 2023-06-09T04:42:24.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.870+0000 7f9a16b8b700 1 -- 172.21.15.62:0/2953486158 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a10160900 con 0x7f9a10156f30 2023-06-09T04:42:24.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.874+0000 7f9a16b8b700 1 -- 172.21.15.62:0/2953486158 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a10160e20 con 0x7f9a10156f30 2023-06-09T04:42:24.877 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.874+0000 7f9a067fc700 1 -- 172.21.15.62:0/2953486158 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9a0800ac00 con 0x7f9a10156f30 2023-06-09T04:42:24.879 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.878+0000 7f9a067fc700 1 --2- 172.21.15.62:0/2953486158 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f99f40662f0 0x7f99f40687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:24.880 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.878+0000 7f9a067fc700 1 -- 172.21.15.62:0/2953486158 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f9a08083ab0 con 0x7f9a10156f30 2023-06-09T04:42:24.880 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.878+0000 7f9a15b89700 1 --2- 172.21.15.62:0/2953486158 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f99f40662f0 0x7f99f40687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:24.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.878+0000 7f9a15b89700 1 --2- 172.21.15.62:0/2953486158 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f99f40662f0 0x7f99f40687a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c007fd0 tx=0x7f9a0c007de0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:24.884 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:24.882+0000 7f9a067fc700 1 -- 172.21.15.62:0/2953486158 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9a08051130 con 0x7f9a10156f30 2023-06-09T04:42:25.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.114+0000 7f9a16b8b700 1 -- 172.21.15.62:0/2953486158 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f9a100739c0 con 0x7f9a10156f30 2023-06-09T04:42:25.125 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.122+0000 7f9a067fc700 1 -- 172.21.15.62:0/2953486158 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f9a08054750 con 0x7f9a10156f30 2023-06-09T04:42:25.128 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.126+0000 7f9a16b8b700 1 -- 172.21.15.62:0/2953486158 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f99f40662f0 msgr2=0x7f99f40687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:25.129 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.126+0000 7f9a16b8b700 1 --2- 172.21.15.62:0/2953486158 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f99f40662f0 0x7f99f40687a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c007fd0 tx=0x7f9a0c007de0 comp rx=0 tx=0).stop 2023-06-09T04:42:25.129 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.126+0000 7f9a16b8b700 1 -- 172.21.15.62:0/2953486158 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a10156f30 msgr2=0x7f9a100b31d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:25.129 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.126+0000 7f9a16b8b700 1 --2- 172.21.15.62:0/2953486158 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a10156f30 0x7f9a100b31d0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f9a0800cbc0 tx=0x7f9a0800ced0 comp rx=0 tx=0).stop 2023-06-09T04:42:25.129 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.126+0000 7f9a16b8b700 1 -- 172.21.15.62:0/2953486158 shutdown_connections 2023-06-09T04:42:25.129 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.126+0000 7f9a16b8b700 1 --2- 172.21.15.62:0/2953486158 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f99f40662f0 0x7f99f40687a0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:25.129 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.126+0000 7f9a16b8b700 1 --2- 172.21.15.62:0/2953486158 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a10156f30 0x7f9a100b31d0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:25.129 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.126+0000 7f9a16b8b700 1 --2- 172.21.15.62:0/2953486158 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9a10160340 0x7f9a101630f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:25.130 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.126+0000 7f9a16b8b700 1 --2- 172.21.15.62:0/2953486158 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9a1015ff70 0x7f9a100b1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:25.130 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.126+0000 7f9a16b8b700 1 -- 172.21.15.62:0/2953486158 >> 172.21.15.62:0/2953486158 conn(0x7f9a100caf80 msgr2=0x7f9a100ce010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:25.130 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.126+0000 7f9a16b8b700 1 -- 172.21.15.62:0/2953486158 shutdown_connections 2023-06-09T04:42:25.130 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.126+0000 7f9a16b8b700 1 -- 172.21.15.62:0/2953486158 wait complete. 2023-06-09T04:42:25.152 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-06-09T04:42:25.328 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.326+0000 7f950e2a6700 1 Processor -- start 2023-06-09T04:42:25.329 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.326+0000 7f950e2a6700 1 -- start start 2023-06-09T04:42:25.330 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.326+0000 7f950e2a6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f950815ff70 0x7f95080c9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:25.331 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.326+0000 7f950e2a6700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f95080cb150 0x7f9508163df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:25.331 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.326+0000 7f950e2a6700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95080cdc20 con 0x7f9508160340 2023-06-09T04:42:25.331 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.326+0000 7f950e2a6700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95080cd330 con 0x7f95080cb150 2023-06-09T04:42:25.331 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.326+0000 7f950e2a6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95080cd5d0 con 0x7f950815ff70 2023-06-09T04:42:25.333 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.330+0000 7f950caa3700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f9508160340 0x7f95080caa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:49382/0 (socket says 172.21.15.62:49382) 2023-06-09T04:42:25.333 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.330+0000 7f950caa3700 1 -- 172.21.15.62:0/2069974687 learned_addr learned my addr 172.21.15.62:0/2069974687 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:42:25.333 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.330+0000 7f950d2a4700 1 --2- 172.21.15.62:0/2069974687 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f950815ff70 0x7f95080c9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:25.333 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.330+0000 7f950daa5700 1 --2- 172.21.15.62:0/2069974687 >> v2:172.21.15.89:3300/0 conn(0x7f95080cb150 0x7f9508163df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:25.333 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.330+0000 7f94fffff700 1 -- 172.21.15.62:0/2069974687 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2210288194 0 0) 0x7f95080cdc20 con 0x7f9508160340 2023-06-09T04:42:25.334 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.330+0000 7f94fffff700 1 -- 172.21.15.62:0/2069974687 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94f40035d0 con 0x7f9508160340 2023-06-09T04:42:25.334 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.330+0000 7f94fffff700 1 -- 172.21.15.62:0/2069974687 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 238201736 0 0) 0x7f94f40035d0 con 0x7f9508160340 2023-06-09T04:42:25.334 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.330+0000 7f94fffff700 1 -- 172.21.15.62:0/2069974687 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f950815ff70 msgr2=0x7f95080c9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:25.334 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.330+0000 7f94fffff700 1 --2- 172.21.15.62:0/2069974687 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f950815ff70 0x7f95080c9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:25.334 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.330+0000 7f94fffff700 1 -- 172.21.15.62:0/2069974687 >> v2:172.21.15.89:3300/0 conn(0x7f95080cb150 msgr2=0x7f9508163df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:25.334 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.330+0000 7f94fffff700 1 --2- 172.21.15.62:0/2069974687 >> v2:172.21.15.89:3300/0 conn(0x7f95080cb150 0x7f9508163df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:25.334 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.330+0000 7f94fffff700 1 -- 172.21.15.62:0/2069974687 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95080cd8b0 con 0x7f9508160340 2023-06-09T04:42:25.334 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.330+0000 7f94fffff700 1 -- 172.21.15.62:0/2069974687 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 540845019 0 0) 0x7f94f8001670 con 0x7f9508160340 2023-06-09T04:42:25.335 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.330+0000 7f94fffff700 1 -- 172.21.15.62:0/2069974687 >> v1:172.21.15.62:6789/0 conn(0x7f9508160340 legacy=0x7f95080caa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:25.335 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.330+0000 7f94fffff700 1 --2- 172.21.15.62:0/2069974687 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94f4003a20 0x7f94f4003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:25.335 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.330+0000 7f94fffff700 1 --2- 172.21.15.62:0/2069974687 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f94f4004450 0x7f94f4004910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:25.335 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.330+0000 7f94fffff700 1 --2- 172.21.15.62:0/2069974687 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f950815ff70 0x7f94f4004fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:25.335 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.330+0000 7f94fffff700 1 -- 172.21.15.62:0/2069974687 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95080cd330 con 0x7f94f4003a20 2023-06-09T04:42:25.335 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.330+0000 7f94fffff700 1 -- 172.21.15.62:0/2069974687 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95080cd5d0 con 0x7f94f4004450 2023-06-09T04:42:25.336 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.330+0000 7f94fffff700 1 -- 172.21.15.62:0/2069974687 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94f400ba30 con 0x7f950815ff70 2023-06-09T04:42:25.337 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.330+0000 7f950daa5700 1 --2- 172.21.15.62:0/2069974687 >> v2:172.21.15.89:3300/0 conn(0x7f95080cb150 0x7f9508163df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:42:25.337 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.330+0000 7f950d2a4700 1 --2- 172.21.15.62:0/2069974687 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94f4003a20 0x7f94f4003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:25.337 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.330+0000 7f950caa3700 1 --2- 172.21.15.62:0/2069974687 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f94f4004450 0x7f94f4004910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:25.337 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.330+0000 7f950daa5700 1 --2- 172.21.15.62:0/2069974687 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f950815ff70 0x7f94f4004fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:25.337 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.330+0000 7f950d2a4700 1 -- 172.21.15.62:0/2069974687 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f950815ff70 msgr2=0x7f94f4004fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:25.337 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.330+0000 7f950d2a4700 1 --2- 172.21.15.62:0/2069974687 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f950815ff70 0x7f94f4004fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:25.337 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.330+0000 7f950d2a4700 1 -- 172.21.15.62:0/2069974687 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f94f4004450 msgr2=0x7f94f4004910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:25.338 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.330+0000 7f950d2a4700 1 --2- 172.21.15.62:0/2069974687 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f94f4004450 0x7f94f4004910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:25.338 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.330+0000 7f950d2a4700 1 -- 172.21.15.62:0/2069974687 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94f40035d0 con 0x7f94f4003a20 2023-06-09T04:42:25.338 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.330+0000 7f950d2a4700 1 --2- 172.21.15.62:0/2069974687 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94f4003a20 0x7f94f4003e30 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9504009b70 tx=0x7f94f40058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdfeb010bfbb6e96 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:25.338 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.334+0000 7f94fffff700 1 -- 172.21.15.62:0/2069974687 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f950400e6c0 con 0x7f94f4003a20 2023-06-09T04:42:25.338 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.334+0000 7f94fffff700 1 -- 172.21.15.62:0/2069974687 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f950400e820 con 0x7f94f4003a20 2023-06-09T04:42:25.338 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.334+0000 7f94fffff700 1 -- 172.21.15.62:0/2069974687 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f950400eb90 con 0x7f94f4003a20 2023-06-09T04:42:25.338 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.334+0000 7f950e2a6700 1 -- 172.21.15.62:0/2069974687 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94f4003a20 msgr2=0x7f94f4003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:25.338 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.334+0000 7f950e2a6700 1 --2- 172.21.15.62:0/2069974687 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f94f4003a20 0x7f94f4003e30 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9504009b70 tx=0x7f94f40058a0 comp rx=0 tx=0).stop 2023-06-09T04:42:25.339 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.334+0000 7f950daa5700 1 -- 172.21.15.62:0/2069974687 reap_dead start 2023-06-09T04:42:25.339 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.334+0000 7f950e2a6700 1 -- 172.21.15.62:0/2069974687 shutdown_connections 2023-06-09T04:42:25.339 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.334+0000 7f950e2a6700 1 -- 172.21.15.62:0/2069974687 >> 172.21.15.62:0/2069974687 conn(0x7f950806a420 msgr2=0x7f95080afc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:25.339 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.334+0000 7f950e2a6700 1 -- 172.21.15.62:0/2069974687 shutdown_connections 2023-06-09T04:42:25.339 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.334+0000 7f950e2a6700 1 -- 172.21.15.62:0/2069974687 wait complete. 2023-06-09T04:42:25.340 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.338+0000 7f950e2a6700 1 Processor -- start 2023-06-09T04:42:25.340 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.338+0000 7f950e2a6700 1 -- start start 2023-06-09T04:42:25.342 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.338+0000 7f950e2a6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f95081610e0 0x7f95080c5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:25.342 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.338+0000 7f950e2a6700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95081614b0 0x7f9508161e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:25.343 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.338+0000 7f950e2a6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9508162380 0x7f950815d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:25.343 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.338+0000 7f950e2a6700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9508162900 con 0x7f95081610e0 2023-06-09T04:42:25.343 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.338+0000 7f950e2a6700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95080b0f20 con 0x7f95081614b0 2023-06-09T04:42:25.343 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.338+0000 7f950e2a6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95080b1200 con 0x7f9508162380 2023-06-09T04:42:25.344 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.338+0000 7f950d2a4700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f95081610e0 0x7f95080c5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:25.344 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.338+0000 7f950d2a4700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f95081610e0 0x7f95080c5100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43046/0 (socket says 172.21.15.62:43046) 2023-06-09T04:42:25.344 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.338+0000 7f950d2a4700 1 -- 172.21.15.62:0/3758407420 learned_addr learned my addr 172.21.15.62:0/3758407420 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:25.344 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.342+0000 7f950daa5700 1 --2- 172.21.15.62:0/3758407420 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9508162380 0x7f950815d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:25.344 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.342+0000 7f950caa3700 1 --2- 172.21.15.62:0/3758407420 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95081614b0 0x7f9508161e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:25.345 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.342+0000 7f950d2a4700 1 -- 172.21.15.62:0/3758407420 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9508162380 msgr2=0x7f950815d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:25.345 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.342+0000 7f950d2a4700 1 --2- 172.21.15.62:0/3758407420 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9508162380 0x7f950815d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:25.345 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.342+0000 7f950d2a4700 1 -- 172.21.15.62:0/3758407420 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95081614b0 msgr2=0x7f9508161e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:25.345 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.342+0000 7f950d2a4700 1 --2- 172.21.15.62:0/3758407420 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95081614b0 0x7f9508161e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:25.345 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.342+0000 7f950d2a4700 1 -- 172.21.15.62:0/3758407420 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95080b14e0 con 0x7f95081610e0 2023-06-09T04:42:25.345 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.342+0000 7f950caa3700 1 --2- 172.21.15.62:0/3758407420 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95081614b0 0x7f9508161e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:25.345 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.342+0000 7f950d2a4700 1 --2- 172.21.15.62:0/3758407420 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f95081610e0 0x7f95080c5100 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f9504009a90 tx=0x7f95040047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:25.346 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.342+0000 7f94fdffb700 1 -- 172.21.15.62:0/3758407420 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f950400e6c0 con 0x7f95081610e0 2023-06-09T04:42:25.346 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.342+0000 7f94fdffb700 1 -- 172.21.15.62:0/3758407420 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9504013de0 con 0x7f95081610e0 2023-06-09T04:42:25.346 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.342+0000 7f950e2a6700 1 -- 172.21.15.62:0/3758407420 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95080b17c0 con 0x7f95081610e0 2023-06-09T04:42:25.346 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.342+0000 7f94fdffb700 1 -- 172.21.15.62:0/3758407420 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9504004290 con 0x7f95081610e0 2023-06-09T04:42:25.347 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.342+0000 7f950e2a6700 1 -- 172.21.15.62:0/3758407420 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f950815e0f0 con 0x7f95081610e0 2023-06-09T04:42:25.347 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.342+0000 7f950e2a6700 1 -- 172.21.15.62:0/3758407420 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95080739c0 con 0x7f95081610e0 2023-06-09T04:42:25.347 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.346+0000 7f94fdffb700 1 -- 172.21.15.62:0/3758407420 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f95040043f0 con 0x7f95081610e0 2023-06-09T04:42:25.349 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.346+0000 7f94fdffb700 1 --2- 172.21.15.62:0/3758407420 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f94ec066320 0x7f94ec0687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:25.349 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.346+0000 7f94fdffb700 1 -- 172.21.15.62:0/3758407420 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f9504085240 con 0x7f95081610e0 2023-06-09T04:42:25.349 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.346+0000 7f950caa3700 1 --2- 172.21.15.62:0/3758407420 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f94ec066320 0x7f94ec0687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:25.350 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.346+0000 7f950caa3700 1 --2- 172.21.15.62:0/3758407420 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f94ec066320 0x7f94ec0687d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f94f8000c00 tx=0x7f94f8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:25.353 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.350+0000 7f94fdffb700 1 -- 172.21.15.62:0/3758407420 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9504052a80 con 0x7f95081610e0 2023-06-09T04:42:25.581 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.578+0000 7f950e2a6700 1 -- 172.21.15.62:0/3758407420 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f95080b1950 con 0x7f95081610e0 2023-06-09T04:42:25.591 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.586+0000 7f94fdffb700 1 -- 172.21.15.62:0/3758407420 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f95040560a0 con 0x7f95081610e0 2023-06-09T04:42:25.594 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.590+0000 7f950e2a6700 1 -- 172.21.15.62:0/3758407420 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f94ec066320 msgr2=0x7f94ec0687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:25.594 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.590+0000 7f950e2a6700 1 --2- 172.21.15.62:0/3758407420 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f94ec066320 0x7f94ec0687d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f94f8000c00 tx=0x7f94f8009040 comp rx=0 tx=0).stop 2023-06-09T04:42:25.594 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.590+0000 7f950e2a6700 1 -- 172.21.15.62:0/3758407420 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f95081610e0 msgr2=0x7f95080c5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:25.595 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.590+0000 7f950e2a6700 1 --2- 172.21.15.62:0/3758407420 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f95081610e0 0x7f95080c5100 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f9504009a90 tx=0x7f95040047e0 comp rx=0 tx=0).stop 2023-06-09T04:42:25.595 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.590+0000 7f950e2a6700 1 -- 172.21.15.62:0/3758407420 shutdown_connections 2023-06-09T04:42:25.595 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.590+0000 7f950e2a6700 1 --2- 172.21.15.62:0/3758407420 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f94ec066320 0x7f94ec0687d0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:25.595 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.590+0000 7f950e2a6700 1 --2- 172.21.15.62:0/3758407420 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9508162380 0x7f950815d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:25.595 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.590+0000 7f950e2a6700 1 --2- 172.21.15.62:0/3758407420 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f95081614b0 0x7f9508161e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:25.595 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.590+0000 7f950e2a6700 1 --2- 172.21.15.62:0/3758407420 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f95081610e0 0x7f95080c5100 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:25.595 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.590+0000 7f950e2a6700 1 -- 172.21.15.62:0/3758407420 >> 172.21.15.62:0/3758407420 conn(0x7f94f4003a20 msgr2=0x7f95080c1b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:25.596 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.590+0000 7f950e2a6700 1 -- 172.21.15.62:0/3758407420 shutdown_connections 2023-06-09T04:42:25.596 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.590+0000 7f950e2a6700 1 -- 172.21.15.62:0/3758407420 wait complete. 2023-06-09T04:42:25.615 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-06-09T04:42:25.797 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.794+0000 7efc659ed700 1 Processor -- start 2023-06-09T04:42:25.797 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.794+0000 7efc659ed700 1 -- start start 2023-06-09T04:42:25.800 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.798+0000 7efc659ed700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7efc60159a40 0x7efc600cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:25.800 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.798+0000 7efc659ed700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7efc600c9ea0 0x7efc600ca320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:25.800 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.798+0000 7efc659ed700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc60071180 con 0x7efc600cd4f0 2023-06-09T04:42:25.801 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.798+0000 7efc659ed700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc600cbc00 con 0x7efc600c9ea0 2023-06-09T04:42:25.801 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.798+0000 7efc659ed700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc600ca860 con 0x7efc60159a40 2023-06-09T04:42:25.801 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.798+0000 7efc5f7fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7efc600c9ea0 0x7efc600ca320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:25.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.798+0000 7efc57fff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7efc600cd4f0 0x7efc60070a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:49394/0 (socket says 172.21.15.62:49394) 2023-06-09T04:42:25.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.798+0000 7efc57fff700 1 -- 172.21.15.62:0/3987444960 learned_addr learned my addr 172.21.15.62:0/3987444960 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:42:25.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.798+0000 7efc5effd700 1 --2- 172.21.15.62:0/3987444960 >> v2:172.21.15.89:3300/0 conn(0x7efc60159a40 0x7efc600cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:25.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.798+0000 7efc5f7fe700 1 -- 172.21.15.62:0/3987444960 >> v2:172.21.15.89:3300/0 conn(0x7efc60159a40 msgr2=0x7efc600cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:25.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.798+0000 7efc5f7fe700 1 --2- 172.21.15.62:0/3987444960 >> v2:172.21.15.89:3300/0 conn(0x7efc60159a40 0x7efc600cc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:25.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.798+0000 7efc5f7fe700 1 -- 172.21.15.62:0/3987444960 >> v1:172.21.15.62:6789/0 conn(0x7efc600cd4f0 legacy=0x7efc60070a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:25.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.798+0000 7efc5f7fe700 1 -- 172.21.15.62:0/3987444960 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc600cc180 con 0x7efc600c9ea0 2023-06-09T04:42:25.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.798+0000 7efc5e7fc700 1 -- 172.21.15.62:0/3987444960 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2103684395 0 0) 0x7efc48001110 con 0x7efc600cd4f0 2023-06-09T04:42:25.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.798+0000 7efc5f7fe700 1 --2- 172.21.15.62:0/3987444960 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc600c9ea0 0x7efc600ca320 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7efc6006f3a0 tx=0x7efc5800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97f98ae6a038c335 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:25.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.798+0000 7efc5e7fc700 1 -- 172.21.15.62:0/3987444960 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc5800e070 con 0x7efc600c9ea0 2023-06-09T04:42:25.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.798+0000 7efc5e7fc700 1 -- 172.21.15.62:0/3987444960 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc5800bb20 con 0x7efc600c9ea0 2023-06-09T04:42:25.804 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.798+0000 7efc5e7fc700 1 -- 172.21.15.62:0/3987444960 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc58012430 con 0x7efc600c9ea0 2023-06-09T04:42:25.804 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.802+0000 7efc659ed700 1 -- 172.21.15.62:0/3987444960 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc600c9ea0 msgr2=0x7efc600ca320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:25.804 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.802+0000 7efc659ed700 1 --2- 172.21.15.62:0/3987444960 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc600c9ea0 0x7efc600ca320 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7efc6006f3a0 tx=0x7efc5800b330 comp rx=0 tx=0).stop 2023-06-09T04:42:25.804 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.802+0000 7efc659ed700 1 -- 172.21.15.62:0/3987444960 shutdown_connections 2023-06-09T04:42:25.805 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.802+0000 7efc659ed700 1 --2- 172.21.15.62:0/3987444960 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc600c9ea0 0x7efc600ca320 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:25.805 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.802+0000 7efc659ed700 1 --2- 172.21.15.62:0/3987444960 >> v2:172.21.15.89:3300/0 conn(0x7efc60159a40 0x7efc600cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:25.805 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.802+0000 7efc659ed700 1 -- 172.21.15.62:0/3987444960 >> 172.21.15.62:0/3987444960 conn(0x7efc6006a420 msgr2=0x7efc600afc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:25.805 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.802+0000 7efc659ed700 1 -- 172.21.15.62:0/3987444960 shutdown_connections 2023-06-09T04:42:25.805 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.802+0000 7efc659ed700 1 -- 172.21.15.62:0/3987444960 wait complete. 2023-06-09T04:42:25.806 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.802+0000 7efc659ed700 1 Processor -- start 2023-06-09T04:42:25.806 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.802+0000 7efc659ed700 1 -- start start 2023-06-09T04:42:25.808 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.806+0000 7efc659ed700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc600cd4f0 0x7efc601f4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:25.808 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.806+0000 7efc659ed700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc60159a40 0x7efc60153ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:25.808 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.806+0000 7efc659ed700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc60154420 0x7efc60156d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:25.808 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.806+0000 7efc659ed700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc601548c0 con 0x7efc60154420 2023-06-09T04:42:25.809 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.806+0000 7efc659ed700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc60157ad0 con 0x7efc60159a40 2023-06-09T04:42:25.809 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.806+0000 7efc659ed700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc60157db0 con 0x7efc600cd4f0 2023-06-09T04:42:25.809 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.806+0000 7efc5f7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc60154420 0x7efc60156d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:25.810 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.806+0000 7efc5f7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc60154420 0x7efc60156d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43060/0 (socket says 172.21.15.62:43060) 2023-06-09T04:42:25.810 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.806+0000 7efc5f7fe700 1 -- 172.21.15.62:0/862604561 learned_addr learned my addr 172.21.15.62:0/862604561 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:25.810 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.806+0000 7efc57fff700 1 --2- 172.21.15.62:0/862604561 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc60159a40 0x7efc60153ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:25.810 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.806+0000 7efc5effd700 1 --2- 172.21.15.62:0/862604561 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc600cd4f0 0x7efc601f4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:25.810 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.806+0000 7efc5f7fe700 1 -- 172.21.15.62:0/862604561 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc600cd4f0 msgr2=0x7efc601f4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:25.810 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.806+0000 7efc5f7fe700 1 --2- 172.21.15.62:0/862604561 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc600cd4f0 0x7efc601f4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:25.811 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.806+0000 7efc5f7fe700 1 -- 172.21.15.62:0/862604561 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc60159a40 msgr2=0x7efc60153ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:25.811 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.806+0000 7efc5f7fe700 1 --2- 172.21.15.62:0/862604561 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc60159a40 0x7efc60153ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:25.811 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.806+0000 7efc5f7fe700 1 -- 172.21.15.62:0/862604561 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc58009a70 con 0x7efc60154420 2023-06-09T04:42:25.811 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.806+0000 7efc57fff700 1 --2- 172.21.15.62:0/862604561 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc60159a40 0x7efc60153ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:25.811 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.806+0000 7efc5f7fe700 1 --2- 172.21.15.62:0/862604561 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc60154420 0x7efc60156d10 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7efc58014040 tx=0x7efc58004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:25.812 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.806+0000 7efc5cff9700 1 -- 172.21.15.62:0/862604561 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc58012430 con 0x7efc60154420 2023-06-09T04:42:25.812 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.806+0000 7efc5cff9700 1 -- 172.21.15.62:0/862604561 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc58020070 con 0x7efc60154420 2023-06-09T04:42:25.812 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.806+0000 7efc659ed700 1 -- 172.21.15.62:0/862604561 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc60158090 con 0x7efc60154420 2023-06-09T04:42:25.812 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.806+0000 7efc5cff9700 1 -- 172.21.15.62:0/862604561 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc58004280 con 0x7efc60154420 2023-06-09T04:42:25.812 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.806+0000 7efc659ed700 1 -- 172.21.15.62:0/862604561 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc60151cb0 con 0x7efc60154420 2023-06-09T04:42:25.812 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.810+0000 7efc659ed700 1 -- 172.21.15.62:0/862604561 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc60151ed0 con 0x7efc60154420 2023-06-09T04:42:25.814 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.810+0000 7efc5cff9700 1 -- 172.21.15.62:0/862604561 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7efc580043e0 con 0x7efc60154420 2023-06-09T04:42:25.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.814+0000 7efc5cff9700 1 --2- 172.21.15.62:0/862604561 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7efc400662f0 0x7efc400687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:25.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.814+0000 7efc5cff9700 1 -- 172.21.15.62:0/862604561 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5530+0+0 (secure 0 0 0) 0x7efc58022070 con 0x7efc60154420 2023-06-09T04:42:25.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.814+0000 7efc5effd700 1 --2- 172.21.15.62:0/862604561 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7efc400662f0 0x7efc400687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:25.818 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.814+0000 7efc5effd700 1 --2- 172.21.15.62:0/862604561 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7efc400662f0 0x7efc400687a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7efc50009b80 tx=0x7efc50008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:25.822 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:25.818+0000 7efc5cff9700 1 -- 172.21.15.62:0/862604561 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7efc58052f40 con 0x7efc60154420 2023-06-09T04:42:26.055 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.050+0000 7efc659ed700 1 -- 172.21.15.62:0/862604561 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7efc600739c0 con 0x7efc60154420 2023-06-09T04:42:26.064 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.062+0000 7efc5cff9700 1 -- 172.21.15.62:0/862604561 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v11) v1 ==== 90+0+0 (secure 0 0 0) 0x7efc58056560 con 0x7efc60154420 2023-06-09T04:42:26.068 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.066+0000 7efc659ed700 1 -- 172.21.15.62:0/862604561 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7efc400662f0 msgr2=0x7efc400687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:26.068 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.066+0000 7efc659ed700 1 --2- 172.21.15.62:0/862604561 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7efc400662f0 0x7efc400687a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7efc50009b80 tx=0x7efc50008040 comp rx=0 tx=0).stop 2023-06-09T04:42:26.068 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.066+0000 7efc659ed700 1 -- 172.21.15.62:0/862604561 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc60154420 msgr2=0x7efc60156d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:26.068 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.066+0000 7efc659ed700 1 --2- 172.21.15.62:0/862604561 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc60154420 0x7efc60156d10 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7efc58014040 tx=0x7efc58004af0 comp rx=0 tx=0).stop 2023-06-09T04:42:26.068 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.066+0000 7efc659ed700 1 -- 172.21.15.62:0/862604561 shutdown_connections 2023-06-09T04:42:26.068 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.066+0000 7efc659ed700 1 --2- 172.21.15.62:0/862604561 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7efc400662f0 0x7efc400687a0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:26.068 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.066+0000 7efc659ed700 1 --2- 172.21.15.62:0/862604561 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efc60154420 0x7efc60156d10 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:26.069 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.066+0000 7efc659ed700 1 --2- 172.21.15.62:0/862604561 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efc60159a40 0x7efc60153ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:26.069 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.066+0000 7efc659ed700 1 --2- 172.21.15.62:0/862604561 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7efc600cd4f0 0x7efc601f4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:26.069 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.066+0000 7efc659ed700 1 -- 172.21.15.62:0/862604561 >> 172.21.15.62:0/862604561 conn(0x7efc600c9ea0 msgr2=0x7efc6006d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:26.069 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.066+0000 7efc659ed700 1 -- 172.21.15.62:0/862604561 shutdown_connections 2023-06-09T04:42:26.070 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.066+0000 7efc659ed700 1 -- 172.21.15.62:0/862604561 wait complete. 2023-06-09T04:42:26.092 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-06-09T04:42:26.270 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.266+0000 7f828ac14700 1 Processor -- start 2023-06-09T04:42:26.271 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.266+0000 7f828ac14700 1 -- start start 2023-06-09T04:42:26.273 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.270+0000 7f828ac14700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f828415ff70 0x7f82840c9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:26.273 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.270+0000 7f828ac14700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8284160340 0x7f82840caa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:26.273 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.270+0000 7f828ac14700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f82840ca210 0x7f82840caf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:26.274 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.270+0000 7f828ac14700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82840cdc20 con 0x7f828415ff70 2023-06-09T04:42:26.274 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.270+0000 7f828ac14700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82840cd330 con 0x7f82840ca210 2023-06-09T04:42:26.274 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.270+0000 7f828ac14700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82840cd5d0 con 0x7f8284160340 2023-06-09T04:42:26.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.270+0000 7f8289c12700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f828415ff70 0x7f82840c9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:26.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.270+0000 7f828a413700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f82840ca210 0x7f82840caf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:26.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.270+0000 7f8289411700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8284160340 0x7f82840caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:26.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.270+0000 7f8289c12700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f828415ff70 0x7f82840c9cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43066/0 (socket says 172.21.15.62:43066) 2023-06-09T04:42:26.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.270+0000 7f8289c12700 1 -- 172.21.15.62:0/1329816522 learned_addr learned my addr 172.21.15.62:0/1329816522 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:26.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.270+0000 7f8289c12700 1 -- 172.21.15.62:0/1329816522 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8284160340 msgr2=0x7f82840caa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:26.276 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.270+0000 7f8289c12700 1 --2- 172.21.15.62:0/1329816522 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8284160340 0x7f82840caa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:26.276 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.270+0000 7f8289c12700 1 -- 172.21.15.62:0/1329816522 >> v2:172.21.15.89:3300/0 conn(0x7f82840ca210 msgr2=0x7f82840caf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:26.276 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.270+0000 7f8289c12700 1 --2- 172.21.15.62:0/1329816522 >> v2:172.21.15.89:3300/0 conn(0x7f82840ca210 0x7f82840caf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:26.276 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.270+0000 7f8289c12700 1 -- 172.21.15.62:0/1329816522 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82840cd8b0 con 0x7f828415ff70 2023-06-09T04:42:26.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.274+0000 7f8289c12700 1 --2- 172.21.15.62:0/1329816522 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f828415ff70 0x7f82840c9cd0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f82840b41e0 tx=0x7f8280009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d15d2e0733bfe4 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:26.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.274+0000 7f8288c10700 1 -- 172.21.15.62:0/1329816522 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8280011830 con 0x7f828415ff70 2023-06-09T04:42:26.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.274+0000 7f8288c10700 1 -- 172.21.15.62:0/1329816522 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8280011990 con 0x7f828415ff70 2023-06-09T04:42:26.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.274+0000 7f8288c10700 1 -- 172.21.15.62:0/1329816522 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8280011d20 con 0x7f828415ff70 2023-06-09T04:42:26.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.274+0000 7f828ac14700 1 -- 172.21.15.62:0/1329816522 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f828415ff70 msgr2=0x7f82840c9cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:26.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.274+0000 7f828ac14700 1 --2- 172.21.15.62:0/1329816522 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f828415ff70 0x7f82840c9cd0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f82840b41e0 tx=0x7f8280009bf0 comp rx=0 tx=0).stop 2023-06-09T04:42:26.278 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.274+0000 7f828ac14700 1 -- 172.21.15.62:0/1329816522 shutdown_connections 2023-06-09T04:42:26.278 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.274+0000 7f828ac14700 1 --2- 172.21.15.62:0/1329816522 >> v2:172.21.15.89:3300/0 conn(0x7f82840ca210 0x7f82840caf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:26.278 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.274+0000 7f828ac14700 1 --2- 172.21.15.62:0/1329816522 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8284160340 0x7f82840caa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:26.279 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.274+0000 7f828ac14700 1 --2- 172.21.15.62:0/1329816522 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f828415ff70 0x7f82840c9cd0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:26.279 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.274+0000 7f828ac14700 1 -- 172.21.15.62:0/1329816522 >> 172.21.15.62:0/1329816522 conn(0x7f828406a420 msgr2=0x7f82840afc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:26.279 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.274+0000 7f828ac14700 1 -- 172.21.15.62:0/1329816522 shutdown_connections 2023-06-09T04:42:26.279 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.274+0000 7f828ac14700 1 -- 172.21.15.62:0/1329816522 wait complete. 2023-06-09T04:42:26.279 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.278+0000 7f828ac14700 1 Processor -- start 2023-06-09T04:42:26.280 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.278+0000 7f828ac14700 1 -- start start 2023-06-09T04:42:26.281 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.278+0000 7f828ac14700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f828415ff70 0x7f8284163230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:26.281 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.278+0000 7f828ac14700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8284160340 0x7f82840c6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:26.281 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.278+0000 7f828ac14700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82840c5190 0x7f82840c74a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:26.282 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.278+0000 7f828ac14700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8284162e10 con 0x7f828415ff70 2023-06-09T04:42:26.282 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.278+0000 7f828ac14700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8284162190 con 0x7f8284160340 2023-06-09T04:42:26.282 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.278+0000 7f828ac14700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8284162470 con 0x7f82840c5190 2023-06-09T04:42:26.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.278+0000 7f8289c12700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f828415ff70 0x7f8284163230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:26.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.278+0000 7f8289411700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8284160340 0x7f82840c6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:26.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.278+0000 7f828a413700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82840c5190 0x7f82840c74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:26.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.278+0000 7f828a413700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82840c5190 0x7f82840c74a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.62:35958/0 (socket says 172.21.15.62:35958) 2023-06-09T04:42:26.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.278+0000 7f828a413700 1 -- 172.21.15.62:0/546384166 learned_addr learned my addr 172.21.15.62:0/546384166 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:26.284 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.278+0000 7f828a413700 1 -- 172.21.15.62:0/546384166 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8284160340 msgr2=0x7f82840c6320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:26.284 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.278+0000 7f828a413700 1 --2- 172.21.15.62:0/546384166 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8284160340 0x7f82840c6320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:26.284 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.278+0000 7f828a413700 1 -- 172.21.15.62:0/546384166 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f828415ff70 msgr2=0x7f8284163230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:26.284 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.278+0000 7f828a413700 1 --2- 172.21.15.62:0/546384166 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f828415ff70 0x7f8284163230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:26.284 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.278+0000 7f828a413700 1 -- 172.21.15.62:0/546384166 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8280009570 con 0x7f82840c5190 2023-06-09T04:42:26.285 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.282+0000 7f828a413700 1 --2- 172.21.15.62:0/546384166 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82840c5190 0x7f82840c74a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f827c00efc0 tx=0x7f827c00c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:26.285 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.282+0000 7f827a7fc700 1 -- 172.21.15.62:0/546384166 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827c009ea0 con 0x7f82840c5190 2023-06-09T04:42:26.285 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.282+0000 7f827a7fc700 1 -- 172.21.15.62:0/546384166 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f827c00f040 con 0x7f82840c5190 2023-06-09T04:42:26.285 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.282+0000 7f827a7fc700 1 -- 172.21.15.62:0/546384166 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827c00ced0 con 0x7f82840c5190 2023-06-09T04:42:26.285 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.282+0000 7f828ac14700 1 -- 172.21.15.62:0/546384166 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8284162750 con 0x7f82840c5190 2023-06-09T04:42:26.286 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.282+0000 7f828ac14700 1 -- 172.21.15.62:0/546384166 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8284163770 con 0x7f82840c5190 2023-06-09T04:42:26.286 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.282+0000 7f828ac14700 1 -- 172.21.15.62:0/546384166 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8284162f50 con 0x7f82840c5190 2023-06-09T04:42:26.288 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.286+0000 7f827a7fc700 1 -- 172.21.15.62:0/546384166 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f827c03b020 con 0x7f82840c5190 2023-06-09T04:42:26.290 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.286+0000 7f827a7fc700 1 --2- 172.21.15.62:0/546384166 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f82680662f0 0x7f82680687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:26.290 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.286+0000 7f827a7fc700 1 -- 172.21.15.62:0/546384166 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f827c0845d0 con 0x7f82840c5190 2023-06-09T04:42:26.290 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.286+0000 7f8289c12700 1 --2- 172.21.15.62:0/546384166 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f82680662f0 0x7f82680687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:26.292 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.290+0000 7f8289c12700 1 --2- 172.21.15.62:0/546384166 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f82680662f0 0x7f82680687a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f8280000c00 tx=0x7f8280008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:26.295 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.294+0000 7f827a7fc700 1 -- 172.21.15.62:0/546384166 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f827c051cd0 con 0x7f82840c5190 2023-06-09T04:42:26.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.526+0000 7f828ac14700 1 -- 172.21.15.62:0/546384166 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f8284162f50 con 0x7f82840c5190 2023-06-09T04:42:26.541 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.538+0000 7f827a7fc700 1 -- 172.21.15.62:0/546384166 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f8284162f50 con 0x7f82840c5190 2023-06-09T04:42:26.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.542+0000 7f828ac14700 1 -- 172.21.15.62:0/546384166 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f82680662f0 msgr2=0x7f82680687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:26.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.542+0000 7f828ac14700 1 --2- 172.21.15.62:0/546384166 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f82680662f0 0x7f82680687a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f8280000c00 tx=0x7f8280008030 comp rx=0 tx=0).stop 2023-06-09T04:42:26.545 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.542+0000 7f828ac14700 1 -- 172.21.15.62:0/546384166 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82840c5190 msgr2=0x7f82840c74a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:26.545 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.542+0000 7f828ac14700 1 --2- 172.21.15.62:0/546384166 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82840c5190 0x7f82840c74a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f827c00efc0 tx=0x7f827c00c3a0 comp rx=0 tx=0).stop 2023-06-09T04:42:26.545 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.542+0000 7f828ac14700 1 -- 172.21.15.62:0/546384166 shutdown_connections 2023-06-09T04:42:26.545 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.542+0000 7f828ac14700 1 --2- 172.21.15.62:0/546384166 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f82680662f0 0x7f82680687a0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:26.546 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.542+0000 7f828ac14700 1 --2- 172.21.15.62:0/546384166 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f82840c5190 0x7f82840c74a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:26.546 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.542+0000 7f828ac14700 1 --2- 172.21.15.62:0/546384166 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8284160340 0x7f82840c6320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:26.546 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.542+0000 7f828ac14700 1 --2- 172.21.15.62:0/546384166 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f828415ff70 0x7f8284163230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:26.546 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.542+0000 7f828ac14700 1 -- 172.21.15.62:0/546384166 >> 172.21.15.62:0/546384166 conn(0x7f82840ca210 msgr2=0x7f82840cbe00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:26.546 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.542+0000 7f828ac14700 1 -- 172.21.15.62:0/546384166 shutdown_connections 2023-06-09T04:42:26.546 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.542+0000 7f828ac14700 1 -- 172.21.15.62:0/546384166 wait complete. 2023-06-09T04:42:26.567 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-06-09T04:42:26.747 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.742+0000 7fcb5f59e700 1 Processor -- start 2023-06-09T04:42:26.747 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.746+0000 7fcb5f59e700 1 -- start start 2023-06-09T04:42:26.749 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.746+0000 7fcb5f59e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fcb60164730 0x7fcb60166b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:26.749 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.746+0000 7fcb5f59e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb600b51e0 con 0x7fcb600d1ac0 2023-06-09T04:42:26.749 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.746+0000 7fcb5f59e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb600d0190 con 0x7fcb600ce9c0 2023-06-09T04:42:26.750 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.746+0000 7fcb5f59e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb600cd0f0 con 0x7fcb60164730 2023-06-09T04:42:26.750 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.746+0000 7fcb5dd9b700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fcb600d1ac0 0x7fcb600ced90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:49410/0 (socket says 172.21.15.62:49410) 2023-06-09T04:42:26.750 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.746+0000 7fcb5dd9b700 1 -- 172.21.15.62:0/1639402561 learned_addr learned my addr 172.21.15.62:0/1639402561 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:42:26.751 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.746+0000 7fcb5ed9d700 1 --2- 172.21.15.62:0/1639402561 >> v2:172.21.15.89:3300/0 conn(0x7fcb60164730 0x7fcb60166b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:26.751 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.746+0000 7fcb5d59a700 1 -- 172.21.15.62:0/1639402561 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2443955153 0 0) 0x7fcb600b51e0 con 0x7fcb600d1ac0 2023-06-09T04:42:26.751 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.746+0000 7fcb5d59a700 1 -- 172.21.15.62:0/1639402561 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb480035d0 con 0x7fcb600d1ac0 2023-06-09T04:42:26.751 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.746+0000 7fcb5d59a700 1 -- 172.21.15.62:0/1639402561 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3852111129 0 0) 0x7fcb600d0190 con 0x7fcb600ce9c0 2023-06-09T04:42:26.751 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.746+0000 7fcb5d59a700 1 -- 172.21.15.62:0/1639402561 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb600b51e0 con 0x7fcb600ce9c0 2023-06-09T04:42:26.752 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.746+0000 7fcb5d59a700 1 -- 172.21.15.62:0/1639402561 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 203035172 0 0) 0x7fcb480035d0 con 0x7fcb600d1ac0 2023-06-09T04:42:26.752 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.746+0000 7fcb5d59a700 1 -- 172.21.15.62:0/1639402561 >> v2:172.21.15.89:3300/0 conn(0x7fcb60164730 msgr2=0x7fcb60166b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:26.752 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.746+0000 7fcb5d59a700 1 --2- 172.21.15.62:0/1639402561 >> v2:172.21.15.89:3300/0 conn(0x7fcb60164730 0x7fcb60166b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:26.753 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.746+0000 7fcb5d59a700 1 -- 172.21.15.62:0/1639402561 >> v1:172.21.15.89:6789/0 conn(0x7fcb600ce9c0 legacy=0x7fcb600cc9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:26.753 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.746+0000 7fcb5d59a700 1 -- 172.21.15.62:0/1639402561 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb600d29f0 con 0x7fcb600d1ac0 2023-06-09T04:42:26.753 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.746+0000 7fcb5d59a700 1 -- 172.21.15.62:0/1639402561 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 540845019 0 0) 0x7fcb54001670 con 0x7fcb600d1ac0 2023-06-09T04:42:26.753 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.746+0000 7fcb5d59a700 1 -- 172.21.15.62:0/1639402561 >> v1:172.21.15.62:6789/0 conn(0x7fcb600d1ac0 legacy=0x7fcb600ced90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:26.753 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.746+0000 7fcb5d59a700 1 --2- 172.21.15.62:0/1639402561 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb48003bb0 0x7fcb48003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:26.753 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.750+0000 7fcb5d59a700 1 --2- 172.21.15.62:0/1639402561 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcb48004870 0x7fcb48004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:26.753 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.750+0000 7fcb5d59a700 1 --2- 172.21.15.62:0/1639402561 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb48005220 0x7fcb4800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:26.753 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.750+0000 7fcb5d59a700 1 -- 172.21.15.62:0/1639402561 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb600cd0f0 con 0x7fcb48004870 2023-06-09T04:42:26.754 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.750+0000 7fcb5d59a700 1 -- 172.21.15.62:0/1639402561 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb4800c130 con 0x7fcb48005220 2023-06-09T04:42:26.754 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.750+0000 7fcb5d59a700 1 -- 172.21.15.62:0/1639402561 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb4800c2f0 con 0x7fcb48003bb0 2023-06-09T04:42:26.754 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.750+0000 7fcb5dd9b700 1 --2- 172.21.15.62:0/1639402561 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcb48004870 0x7fcb48004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:26.754 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.750+0000 7fcb5ed9d700 1 --2- 172.21.15.62:0/1639402561 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb48005220 0x7fcb4800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:26.754 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.750+0000 7fcb5e59c700 1 --2- 172.21.15.62:0/1639402561 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb48003bb0 0x7fcb48003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:26.755 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.750+0000 7fcb5dd9b700 1 -- 172.21.15.62:0/1639402561 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb48003bb0 msgr2=0x7fcb48003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:26.756 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.750+0000 7fcb5dd9b700 1 --2- 172.21.15.62:0/1639402561 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb48003bb0 0x7fcb48003fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:26.756 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.750+0000 7fcb5dd9b700 1 -- 172.21.15.62:0/1639402561 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb48005220 msgr2=0x7fcb4800ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:26.756 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.750+0000 7fcb5dd9b700 1 --2- 172.21.15.62:0/1639402561 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb48005220 0x7fcb4800ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:26.756 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.750+0000 7fcb5dd9b700 1 -- 172.21.15.62:0/1639402561 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb480035d0 con 0x7fcb48004870 2023-06-09T04:42:26.756 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.750+0000 7fcb5ed9d700 1 -- 172.21.15.62:0/1639402561 reap_dead start 2023-06-09T04:42:26.756 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.750+0000 7fcb5dd9b700 1 --2- 172.21.15.62:0/1639402561 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcb48004870 0x7fcb48004ce0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fcb5400c210 tx=0x7fcb480058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bebf9fcd322d2ac1 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:26.756 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.750+0000 7fcb5d59a700 1 -- 172.21.15.62:0/1639402561 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5400cd10 con 0x7fcb48004870 2023-06-09T04:42:26.757 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.750+0000 7fcb5d59a700 1 -- 172.21.15.62:0/1639402561 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb5400ce90 con 0x7fcb48004870 2023-06-09T04:42:26.757 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.750+0000 7fcb5d59a700 1 -- 172.21.15.62:0/1639402561 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb54005bc0 con 0x7fcb48004870 2023-06-09T04:42:26.757 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.750+0000 7fcb5f59e700 1 -- 172.21.15.62:0/1639402561 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcb48004870 msgr2=0x7fcb48004ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:26.757 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.750+0000 7fcb5f59e700 1 --2- 172.21.15.62:0/1639402561 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcb48004870 0x7fcb48004ce0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fcb5400c210 tx=0x7fcb480058a0 comp rx=0 tx=0).stop 2023-06-09T04:42:26.757 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.750+0000 7fcb5f59e700 1 -- 172.21.15.62:0/1639402561 shutdown_connections 2023-06-09T04:42:26.757 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.750+0000 7fcb5f59e700 1 --2- 172.21.15.62:0/1639402561 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcb48004870 0x7fcb48004ce0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:26.757 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.750+0000 7fcb5f59e700 1 -- 172.21.15.62:0/1639402561 >> 172.21.15.62:0/1639402561 conn(0x7fcb60070f20 msgr2=0x7fcb600712f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:26.758 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.750+0000 7fcb5f59e700 1 -- 172.21.15.62:0/1639402561 shutdown_connections 2023-06-09T04:42:26.758 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.754+0000 7fcb5f59e700 1 -- 172.21.15.62:0/1639402561 wait complete. 2023-06-09T04:42:26.758 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.754+0000 7fcb5f59e700 1 Processor -- start 2023-06-09T04:42:26.758 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.754+0000 7fcb5f59e700 1 -- start start 2023-06-09T04:42:26.759 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.758+0000 7fcb5f59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcb48004870 0x7fcb6014ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:26.760 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.758+0000 7fcb5f59e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb6015ab20 0x7fcb6015af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:26.760 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.758+0000 7fcb5f59e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb600c7100 0x7fcb600c7570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:26.760 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.758+0000 7fcb5f59e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6015b4d0 con 0x7fcb48004870 2023-06-09T04:42:26.760 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.758+0000 7fcb5f59e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb600c84f0 con 0x7fcb600c7100 2023-06-09T04:42:26.760 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.758+0000 7fcb5f59e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb601558b0 con 0x7fcb6015ab20 2023-06-09T04:42:26.761 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.758+0000 7fcb5e59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcb48004870 0x7fcb6014ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:26.761 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.758+0000 7fcb5e59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcb48004870 0x7fcb6014ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43076/0 (socket says 172.21.15.62:43076) 2023-06-09T04:42:26.761 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.758+0000 7fcb5e59c700 1 -- 172.21.15.62:0/2099568533 learned_addr learned my addr 172.21.15.62:0/2099568533 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:26.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.758+0000 7fcb5dd9b700 1 --2- 172.21.15.62:0/2099568533 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb6015ab20 0x7fcb6015af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:26.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.758+0000 7fcb5ed9d700 1 --2- 172.21.15.62:0/2099568533 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb600c7100 0x7fcb600c7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:26.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.758+0000 7fcb5e59c700 1 -- 172.21.15.62:0/2099568533 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb6015ab20 msgr2=0x7fcb6015af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:26.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.758+0000 7fcb5e59c700 1 --2- 172.21.15.62:0/2099568533 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb6015ab20 0x7fcb6015af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:26.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.758+0000 7fcb5e59c700 1 -- 172.21.15.62:0/2099568533 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb600c7100 msgr2=0x7fcb600c7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:26.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.758+0000 7fcb5e59c700 1 --2- 172.21.15.62:0/2099568533 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb600c7100 0x7fcb600c7570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:26.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.758+0000 7fcb5e59c700 1 -- 172.21.15.62:0/2099568533 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb600c7f30 con 0x7fcb48004870 2023-06-09T04:42:26.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.758+0000 7fcb5e59c700 1 --2- 172.21.15.62:0/2099568533 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcb48004870 0x7fcb6014ad00 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fcb5000f7d0 tx=0x7fcb5000fae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:26.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.758+0000 7fcb4effd700 1 -- 172.21.15.62:0/2099568533 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb50005320 con 0x7fcb48004870 2023-06-09T04:42:26.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.758+0000 7fcb4effd700 1 -- 172.21.15.62:0/2099568533 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb50005480 con 0x7fcb48004870 2023-06-09T04:42:26.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.758+0000 7fcb5f59e700 1 -- 172.21.15.62:0/2099568533 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb600c8210 con 0x7fcb48004870 2023-06-09T04:42:26.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.758+0000 7fcb4effd700 1 -- 172.21.15.62:0/2099568533 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb50006ac0 con 0x7fcb48004870 2023-06-09T04:42:26.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.758+0000 7fcb5f59e700 1 -- 172.21.15.62:0/2099568533 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb600c7ab0 con 0x7fcb48004870 2023-06-09T04:42:26.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.762+0000 7fcb5f59e700 1 -- 172.21.15.62:0/2099568533 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb600739c0 con 0x7fcb48004870 2023-06-09T04:42:26.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.762+0000 7fcb4effd700 1 -- 172.21.15.62:0/2099568533 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcb50006c20 con 0x7fcb48004870 2023-06-09T04:42:26.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.762+0000 7fcb4effd700 1 --2- 172.21.15.62:0/2099568533 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fcb40066320 0x7fcb400687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:26.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.762+0000 7fcb4effd700 1 -- 172.21.15.62:0/2099568533 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fcb50082e60 con 0x7fcb48004870 2023-06-09T04:42:26.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.766+0000 7fcb5dd9b700 1 --2- 172.21.15.62:0/2099568533 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fcb40066320 0x7fcb400687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:26.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.766+0000 7fcb5dd9b700 1 --2- 172.21.15.62:0/2099568533 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fcb40066320 0x7fcb400687d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fcb600b6f80 tx=0x7fcb5400a000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:26.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:26.770+0000 7fcb4effd700 1 -- 172.21.15.62:0/2099568533 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcb500504e0 con 0x7fcb48004870 2023-06-09T04:42:27.011 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.006+0000 7fcb5f59e700 1 -- 172.21.15.62:0/2099568533 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fcb601590a0 con 0x7fcb48004870 2023-06-09T04:42:27.020 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.018+0000 7fcb4effd700 1 -- 172.21.15.62:0/2099568533 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v13) v1 ==== 97+0+0 (secure 0 0 0) 0x7fcb5001a0a0 con 0x7fcb48004870 2023-06-09T04:42:27.025 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.022+0000 7fcb5f59e700 1 -- 172.21.15.62:0/2099568533 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fcb40066320 msgr2=0x7fcb400687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:27.025 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.022+0000 7fcb5f59e700 1 --2- 172.21.15.62:0/2099568533 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fcb40066320 0x7fcb400687d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fcb600b6f80 tx=0x7fcb5400a000 comp rx=0 tx=0).stop 2023-06-09T04:42:27.025 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.022+0000 7fcb5f59e700 1 -- 172.21.15.62:0/2099568533 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcb48004870 msgr2=0x7fcb6014ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:27.025 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.022+0000 7fcb5f59e700 1 --2- 172.21.15.62:0/2099568533 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcb48004870 0x7fcb6014ad00 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fcb5000f7d0 tx=0x7fcb5000fae0 comp rx=0 tx=0).stop 2023-06-09T04:42:27.026 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.022+0000 7fcb5f59e700 1 -- 172.21.15.62:0/2099568533 shutdown_connections 2023-06-09T04:42:27.026 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.022+0000 7fcb5f59e700 1 --2- 172.21.15.62:0/2099568533 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fcb40066320 0x7fcb400687d0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:27.026 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.022+0000 7fcb5f59e700 1 --2- 172.21.15.62:0/2099568533 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb600c7100 0x7fcb600c7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:27.026 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.022+0000 7fcb5f59e700 1 --2- 172.21.15.62:0/2099568533 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb6015ab20 0x7fcb6015af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:27.026 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.022+0000 7fcb5f59e700 1 --2- 172.21.15.62:0/2099568533 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcb48004870 0x7fcb6014ad00 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:27.026 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.022+0000 7fcb5f59e700 1 -- 172.21.15.62:0/2099568533 >> 172.21.15.62:0/2099568533 conn(0x7fcb60070f20 msgr2=0x7fcb60158990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:27.026 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.022+0000 7fcb5f59e700 1 -- 172.21.15.62:0/2099568533 shutdown_connections 2023-06-09T04:42:27.027 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.022+0000 7fcb5f59e700 1 -- 172.21.15.62:0/2099568533 wait complete. 2023-06-09T04:42:27.046 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-06-09T04:42:27.224 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.222+0000 7f36b5cfb700 1 Processor -- start 2023-06-09T04:42:27.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.222+0000 7f36b5cfb700 1 -- start start 2023-06-09T04:42:27.227 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.226+0000 7f36b5cfb700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f36b0160340 0x7f36b00caa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:27.228 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.226+0000 7f36b5cfb700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36b00cdc20 con 0x7f36b00caf80 2023-06-09T04:42:27.228 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.226+0000 7f36b5cfb700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36b00cd330 con 0x7f36b015ff70 2023-06-09T04:42:27.228 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.226+0000 7f36b5cfb700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36b00cb400 con 0x7f36b0160340 2023-06-09T04:42:27.228 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.226+0000 7f36b54fa700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f36b00caf80 0x7f36b0163df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:49422/0 (socket says 172.21.15.62:49422) 2023-06-09T04:42:27.229 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.226+0000 7f36b54fa700 1 -- 172.21.15.62:0/2584156414 learned_addr learned my addr 172.21.15.62:0/2584156414 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:42:27.229 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.226+0000 7f36affff700 1 --2- 172.21.15.62:0/2584156414 >> v2:172.21.15.62:3300/0 conn(0x7f36b0160340 0x7f36b00caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:27.229 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.226+0000 7f36affff700 1 -- 172.21.15.62:0/2584156414 >> v1:172.21.15.89:6789/0 conn(0x7f36b015ff70 legacy=0x7f36b00c9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:27.230 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.226+0000 7f36affff700 1 -- 172.21.15.62:0/2584156414 >> v1:172.21.15.62:6789/0 conn(0x7f36b00caf80 legacy=0x7f36b0163df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:27.230 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.226+0000 7f36af7fe700 1 -- 172.21.15.62:0/2584156414 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3304555426 0 0) 0x7f36b00cdc20 con 0x7f36b00caf80 2023-06-09T04:42:27.230 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.226+0000 7f36affff700 1 -- 172.21.15.62:0/2584156414 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36b00cd5d0 con 0x7f36b0160340 2023-06-09T04:42:27.230 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.226+0000 7f36affff700 1 --2- 172.21.15.62:0/2584156414 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36b0160340 0x7f36b00caa40 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f369c009850 tx=0x7f369c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32ccdd9f04a1245e server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:27.230 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.226+0000 7f36af7fe700 1 -- 172.21.15.62:0/2584156414 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369c011830 con 0x7f36b0160340 2023-06-09T04:42:27.231 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.226+0000 7f36af7fe700 1 -- 172.21.15.62:0/2584156414 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f369c011990 con 0x7f36b0160340 2023-06-09T04:42:27.231 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.226+0000 7f36af7fe700 1 -- 172.21.15.62:0/2584156414 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369c011d20 con 0x7f36b0160340 2023-06-09T04:42:27.231 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.230+0000 7f36b5cfb700 1 -- 172.21.15.62:0/2584156414 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36b0160340 msgr2=0x7f36b00caa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:27.231 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.230+0000 7f36b5cfb700 1 --2- 172.21.15.62:0/2584156414 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36b0160340 0x7f36b00caa40 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f369c009850 tx=0x7f369c009b60 comp rx=0 tx=0).stop 2023-06-09T04:42:27.232 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.230+0000 7f36b5cfb700 1 -- 172.21.15.62:0/2584156414 shutdown_connections 2023-06-09T04:42:27.232 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.230+0000 7f36b5cfb700 1 --2- 172.21.15.62:0/2584156414 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36b0160340 0x7f36b00caa40 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:27.232 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.230+0000 7f36b5cfb700 1 -- 172.21.15.62:0/2584156414 >> 172.21.15.62:0/2584156414 conn(0x7f36b006a420 msgr2=0x7f36b00afc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:27.232 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.230+0000 7f36b5cfb700 1 -- 172.21.15.62:0/2584156414 shutdown_connections 2023-06-09T04:42:27.232 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.230+0000 7f36b5cfb700 1 -- 172.21.15.62:0/2584156414 wait complete. 2023-06-09T04:42:27.235 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.234+0000 7f36b5cfb700 1 Processor -- start 2023-06-09T04:42:27.236 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.234+0000 7f36b5cfb700 1 -- start start 2023-06-09T04:42:27.237 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.234+0000 7f36b5cfb700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f36b015ff70 0x7f36b01556d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:27.237 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.234+0000 7f36b5cfb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f36b0160340 0x7f36b00c7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:27.237 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.234+0000 7f36b5cfb700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36b0070e40 0x7f36b00712c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:27.237 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.234+0000 7f36b5cfb700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b0071800 con 0x7f36b0070e40 2023-06-09T04:42:27.238 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.234+0000 7f36b5cfb700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36b0161c50 con 0x7f36b015ff70 2023-06-09T04:42:27.238 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.234+0000 7f36b5cfb700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36b0161f30 con 0x7f36b0160340 2023-06-09T04:42:27.239 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.234+0000 7f36b54fa700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36b0070e40 0x7f36b00712c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:27.239 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.234+0000 7f36b54fa700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36b0070e40 0x7f36b00712c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43086/0 (socket says 172.21.15.62:43086) 2023-06-09T04:42:27.239 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.234+0000 7f36b54fa700 1 -- 172.21.15.62:0/2725585701 learned_addr learned my addr 172.21.15.62:0/2725585701 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:27.239 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.234+0000 7f36affff700 1 --2- 172.21.15.62:0/2725585701 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f36b0160340 0x7f36b00c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:27.239 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.234+0000 7f36b4cf9700 1 --2- 172.21.15.62:0/2725585701 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f36b015ff70 0x7f36b01556d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:27.239 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.234+0000 7f36b54fa700 1 -- 172.21.15.62:0/2725585701 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f36b0160340 msgr2=0x7f36b00c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:27.240 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.234+0000 7f36b54fa700 1 --2- 172.21.15.62:0/2725585701 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f36b0160340 0x7f36b00c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:27.240 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.234+0000 7f36b54fa700 1 -- 172.21.15.62:0/2725585701 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f36b015ff70 msgr2=0x7f36b01556d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:27.240 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.234+0000 7f36b54fa700 1 --2- 172.21.15.62:0/2725585701 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f36b015ff70 0x7f36b01556d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:27.240 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.234+0000 7f36b54fa700 1 -- 172.21.15.62:0/2725585701 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f369c0094b0 con 0x7f36b0070e40 2023-06-09T04:42:27.240 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.234+0000 7f36b54fa700 1 --2- 172.21.15.62:0/2725585701 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36b0070e40 0x7f36b00712c0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f36a800cb60 tx=0x7f36a800cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:27.240 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.234+0000 7f36ad7fa700 1 -- 172.21.15.62:0/2725585701 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a800ab50 con 0x7f36b0070e40 2023-06-09T04:42:27.240 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.234+0000 7f36ad7fa700 1 -- 172.21.15.62:0/2725585701 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36a800acb0 con 0x7f36b0070e40 2023-06-09T04:42:27.241 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.234+0000 7f36b5cfb700 1 -- 172.21.15.62:0/2725585701 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36b0162210 con 0x7f36b0070e40 2023-06-09T04:42:27.241 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.238+0000 7f36ad7fa700 1 -- 172.21.15.62:0/2725585701 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a8007310 con 0x7f36b0070e40 2023-06-09T04:42:27.241 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.238+0000 7f36b5cfb700 1 -- 172.21.15.62:0/2725585701 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36b01627d0 con 0x7f36b0070e40 2023-06-09T04:42:27.241 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.238+0000 7f36b5cfb700 1 -- 172.21.15.62:0/2725585701 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36b00739c0 con 0x7f36b0070e40 2023-06-09T04:42:27.242 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.238+0000 7f36ad7fa700 1 -- 172.21.15.62:0/2725585701 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f36a8007470 con 0x7f36b0070e40 2023-06-09T04:42:27.243 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.242+0000 7f36ad7fa700 1 --2- 172.21.15.62:0/2725585701 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f36940662f0 0x7f36940687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:27.243 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.242+0000 7f36ad7fa700 1 -- 172.21.15.62:0/2725585701 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f36a8083970 con 0x7f36b0070e40 2023-06-09T04:42:27.244 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.242+0000 7f36b4cf9700 1 --2- 172.21.15.62:0/2725585701 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f36940662f0 0x7f36940687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:27.245 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.242+0000 7f36b4cf9700 1 --2- 172.21.15.62:0/2725585701 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f36940662f0 0x7f36940687a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f36a4000f60 tx=0x7f36a4009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:27.249 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.246+0000 7f36ad7fa700 1 -- 172.21.15.62:0/2725585701 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f36a8050f60 con 0x7f36b0070e40 2023-06-09T04:42:27.482 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.478+0000 7f36b5cfb700 1 -- 172.21.15.62:0/2725585701 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f36b00af520 con 0x7f36b0070e40 2023-06-09T04:42:27.492 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.490+0000 7f36ad7fa700 1 -- 172.21.15.62:0/2725585701 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v14) v1 ==== 90+0+0 (secure 0 0 0) 0x7f36a80180a0 con 0x7f36b0070e40 2023-06-09T04:42:27.495 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.494+0000 7f36b5cfb700 1 -- 172.21.15.62:0/2725585701 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f36940662f0 msgr2=0x7f36940687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:27.495 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.494+0000 7f36b5cfb700 1 --2- 172.21.15.62:0/2725585701 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f36940662f0 0x7f36940687a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f36a4000f60 tx=0x7f36a4009040 comp rx=0 tx=0).stop 2023-06-09T04:42:27.495 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.494+0000 7f36b5cfb700 1 -- 172.21.15.62:0/2725585701 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36b0070e40 msgr2=0x7f36b00712c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:27.496 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.494+0000 7f36b5cfb700 1 --2- 172.21.15.62:0/2725585701 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36b0070e40 0x7f36b00712c0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f36a800cb60 tx=0x7f36a800cf20 comp rx=0 tx=0).stop 2023-06-09T04:42:27.496 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.494+0000 7f36b5cfb700 1 -- 172.21.15.62:0/2725585701 shutdown_connections 2023-06-09T04:42:27.497 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.494+0000 7f36b5cfb700 1 --2- 172.21.15.62:0/2725585701 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f36940662f0 0x7f36940687a0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:27.497 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.494+0000 7f36b5cfb700 1 --2- 172.21.15.62:0/2725585701 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36b0070e40 0x7f36b00712c0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:27.497 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.494+0000 7f36b5cfb700 1 --2- 172.21.15.62:0/2725585701 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f36b0160340 0x7f36b00c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:27.497 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.494+0000 7f36b5cfb700 1 --2- 172.21.15.62:0/2725585701 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f36b015ff70 0x7f36b01556d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:27.497 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.494+0000 7f36b5cfb700 1 -- 172.21.15.62:0/2725585701 >> 172.21.15.62:0/2725585701 conn(0x7f36b00caf80 msgr2=0x7f36b00cc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:27.497 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.494+0000 7f36b5cfb700 1 -- 172.21.15.62:0/2725585701 shutdown_connections 2023-06-09T04:42:27.497 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.494+0000 7f36b5cfb700 1 -- 172.21.15.62:0/2725585701 wait complete. 2023-06-09T04:42:27.518 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:42:27.701 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.698+0000 7f75f49bb700 1 Processor -- start 2023-06-09T04:42:27.701 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.698+0000 7f75f49bb700 1 -- start start 2023-06-09T04:42:27.705 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.702+0000 7f75f49bb700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f75f00cd4f0 0x7f75f00cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:27.705 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.702+0000 7f75f49bb700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75f0071180 con 0x7f75f0159a40 2023-06-09T04:42:27.706 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.702+0000 7f75ef7fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f75f0159a40 0x7f75f0070a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:49438/0 (socket says 172.21.15.62:49438) 2023-06-09T04:42:27.706 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.702+0000 7f75f49bb700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75f00cc180 con 0x7f75f00c9ea0 2023-06-09T04:42:27.706 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.702+0000 7f75f49bb700 1 -- 172.21.15.62:0/3532794838 --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75f00cbc00 con 0x7f75f00cd4f0 2023-06-09T04:42:27.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.702+0000 7f75ef7fe700 1 -- 172.21.15.62:0/3532794838 learned_addr learned my addr 172.21.15.62:0/3532794838 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:42:27.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.702+0000 7f75e7fff700 1 --2- 172.21.15.62:0/3532794838 >> v2:172.21.15.62:3300/0 conn(0x7f75f00cd4f0 0x7f75f00cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:27.709 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.702+0000 7f75eeffd700 1 -- 172.21.15.62:0/3532794838 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1756305926 0 0) 0x7f75e0001110 con 0x7f75f0159a40 2023-06-09T04:42:27.709 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.702+0000 7f75eeffd700 1 -- 172.21.15.62:0/3532794838 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75dc0035d0 con 0x7f75f0159a40 2023-06-09T04:42:27.709 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.702+0000 7f75e7fff700 1 -- 172.21.15.62:0/3532794838 >> v1:172.21.15.89:6789/0 conn(0x7f75f00c9ea0 legacy=0x7f75f015d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:27.710 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.702+0000 7f75e7fff700 1 -- 172.21.15.62:0/3532794838 >> v1:172.21.15.62:6789/0 conn(0x7f75f0159a40 legacy=0x7f75f0070a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:27.710 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.702+0000 7f75e7fff700 1 -- 172.21.15.62:0/3532794838 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75f00713c0 con 0x7f75f00cd4f0 2023-06-09T04:42:27.710 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.702+0000 7f75e7fff700 1 --2- 172.21.15.62:0/3532794838 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75f00cd4f0 0x7f75f00cc610 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f75d8009850 tx=0x7f75d8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57e56dafcf7425a2 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:27.710 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.702+0000 7f75eeffd700 1 -- 172.21.15.62:0/3532794838 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d8011830 con 0x7f75f00cd4f0 2023-06-09T04:42:27.711 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.706+0000 7f75eeffd700 1 -- 172.21.15.62:0/3532794838 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75d8011990 con 0x7f75f00cd4f0 2023-06-09T04:42:27.711 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.706+0000 7f75eeffd700 1 -- 172.21.15.62:0/3532794838 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d8011d40 con 0x7f75f00cd4f0 2023-06-09T04:42:27.711 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.706+0000 7f75f49bb700 1 -- 172.21.15.62:0/3532794838 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75f00cd4f0 msgr2=0x7f75f00cc610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:27.711 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.706+0000 7f75f49bb700 1 --2- 172.21.15.62:0/3532794838 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75f00cd4f0 0x7f75f00cc610 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f75d8009850 tx=0x7f75d8009b60 comp rx=0 tx=0).stop 2023-06-09T04:42:27.711 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.706+0000 7f75f49bb700 1 -- 172.21.15.62:0/3532794838 shutdown_connections 2023-06-09T04:42:27.711 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.706+0000 7f75f49bb700 1 --2- 172.21.15.62:0/3532794838 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75f00cd4f0 0x7f75f00cc610 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:27.711 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.706+0000 7f75f49bb700 1 -- 172.21.15.62:0/3532794838 >> 172.21.15.62:0/3532794838 conn(0x7f75f006a420 msgr2=0x7f75f00afc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:27.712 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.706+0000 7f75f49bb700 1 -- 172.21.15.62:0/3532794838 shutdown_connections 2023-06-09T04:42:27.712 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.706+0000 7f75f49bb700 1 -- 172.21.15.62:0/3532794838 wait complete. 2023-06-09T04:42:27.712 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.710+0000 7f75f49bb700 1 Processor -- start 2023-06-09T04:42:27.712 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.710+0000 7f75f49bb700 1 -- start start 2023-06-09T04:42:27.714 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.710+0000 7f75f49bb700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75f00cd4f0 0x7f75f0156cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:27.714 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.710+0000 7f75f49bb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75f0159a40 0x7f75f0149480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:27.714 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.710+0000 7f75f49bb700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75f01523f0 0x7f75f00b35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:27.714 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.710+0000 7f75f49bb700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f0157210 con 0x7f75f01523f0 2023-06-09T04:42:27.714 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.710+0000 7f75f49bb700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f0152ad0 con 0x7f75f00cd4f0 2023-06-09T04:42:27.714 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.710+0000 7f75f49bb700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75f01499c0 con 0x7f75f0159a40 2023-06-09T04:42:27.715 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.710+0000 7f75effff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75f01523f0 0x7f75f00b35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:27.715 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.710+0000 7f75effff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75f01523f0 0x7f75f00b35d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43098/0 (socket says 172.21.15.62:43098) 2023-06-09T04:42:27.716 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.710+0000 7f75effff700 1 -- 172.21.15.62:0/3803403224 learned_addr learned my addr 172.21.15.62:0/3803403224 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:27.716 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.710+0000 7f75ef7fe700 1 --2- 172.21.15.62:0/3803403224 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75f00cd4f0 0x7f75f0156cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:27.716 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.710+0000 7f75e7fff700 1 --2- 172.21.15.62:0/3803403224 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75f0159a40 0x7f75f0149480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:27.716 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.710+0000 7f75effff700 1 -- 172.21.15.62:0/3803403224 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75f0159a40 msgr2=0x7f75f0149480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:27.716 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.710+0000 7f75effff700 1 --2- 172.21.15.62:0/3803403224 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75f0159a40 0x7f75f0149480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:27.716 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.710+0000 7f75effff700 1 -- 172.21.15.62:0/3803403224 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75f00cd4f0 msgr2=0x7f75f0156cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:27.716 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.710+0000 7f75effff700 1 --2- 172.21.15.62:0/3803403224 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75f00cd4f0 0x7f75f0156cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:27.717 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.710+0000 7f75effff700 1 -- 172.21.15.62:0/3803403224 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75d80094b0 con 0x7f75f01523f0 2023-06-09T04:42:27.717 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.714+0000 7f75effff700 1 --2- 172.21.15.62:0/3803403224 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75f01523f0 0x7f75f00b35d0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f75e800cb50 tx=0x7f75e800ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:27.717 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.714+0000 7f75ecff9700 1 -- 172.21.15.62:0/3803403224 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e8003c20 con 0x7f75f01523f0 2023-06-09T04:42:27.717 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.714+0000 7f75ecff9700 1 -- 172.21.15.62:0/3803403224 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75e8003d80 con 0x7f75f01523f0 2023-06-09T04:42:27.718 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.714+0000 7f75ecff9700 1 -- 172.21.15.62:0/3803403224 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e800aac0 con 0x7f75f01523f0 2023-06-09T04:42:27.718 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.714+0000 7f75f49bb700 1 -- 172.21.15.62:0/3803403224 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75f0157440 con 0x7f75f01523f0 2023-06-09T04:42:27.718 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.714+0000 7f75f49bb700 1 -- 172.21.15.62:0/3803403224 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75f0157a00 con 0x7f75f01523f0 2023-06-09T04:42:27.718 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.714+0000 7f75f49bb700 1 -- 172.21.15.62:0/3803403224 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75f00739c0 con 0x7f75f01523f0 2023-06-09T04:42:27.719 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.718+0000 7f75ecff9700 1 -- 172.21.15.62:0/3803403224 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f75e800ac20 con 0x7f75f01523f0 2023-06-09T04:42:27.721 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.718+0000 7f75ecff9700 1 --2- 172.21.15.62:0/3803403224 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f75d00662f0 0x7f75d00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:27.721 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.718+0000 7f75ecff9700 1 -- 172.21.15.62:0/3803403224 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f75e8083b00 con 0x7f75f01523f0 2023-06-09T04:42:27.721 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.718+0000 7f75ef7fe700 1 --2- 172.21.15.62:0/3803403224 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f75d00662f0 0x7f75d00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:27.722 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.718+0000 7f75ef7fe700 1 --2- 172.21.15.62:0/3803403224 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f75d00662f0 0x7f75d00687a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f75e0007fd0 tx=0x7f75e0007c60 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:27.725 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.722+0000 7f75ecff9700 1 -- 172.21.15.62:0/3803403224 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f75e8051130 con 0x7f75f01523f0 2023-06-09T04:42:27.897 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.894+0000 7f75f49bb700 1 -- 172.21.15.62:0/3803403224 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f75f015d300 con 0x7f75f01523f0 2023-06-09T04:42:27.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.898+0000 7f75ecff9700 1 -- 172.21.15.62:0/3803403224 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+14808 (secure 0 0 0) 0x7f75e8054750 con 0x7f75f01523f0 2023-06-09T04:42:27.900 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:42:27.900 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":39,"fsid":"f7998a1e-e5a9-4202-abaa-70c0eaae1047","created":"2023-06-09T04:40:30.469588+0000","modified":"2023-06-09T04:42:24.173633+0000","last_up_change":"2023-06-09T04:40:43.120747+0000","last_in_change":"2023-06-09T04:40:33.568221+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:40:44.646921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:40:50.006643+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bc50bbc0-dd08-42ed-804c-ec3029e36c19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6802","nonce":1295788017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6807","nonce":1295788017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6815","nonce":1295788017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6809","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6811","nonce":1295788017}]},"public_addr":"172.21.15.62:6802/1295788017","cluster_addr":"172.21.15.62:6807/1295788017","heartbeat_back_addr":"172.21.15.62:6815/1295788017","heartbeat_front_addr":"172.21.15.62:6811/1295788017","state":["exists","up"]},{"osd":1,"uuid":"8230b12d-e22f-4985-a584-4cc64404cdbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6825","nonce":4120692006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6827","nonce":4120692006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6831","nonce":4120692006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6829","nonce":4120692006}]},"public_addr":"172.21.15.62:6825/4120692006","cluster_addr":"172.21.15.62:6827/4120692006","heartbeat_back_addr":"172.21.15.62:6831/4120692006","heartbeat_front_addr":"172.21.15.62:6829/4120692006","state":["exists","up"]},{"osd":2,"uuid":"d0202506-dbe9-4e3c-9271-687929abf96a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6801","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6803","nonce":4169607876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6805","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6806","nonce":4169607876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6814","nonce":4169607876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6810","nonce":4169607876}]},"public_addr":"172.21.15.62:6803/4169607876","cluster_addr":"172.21.15.62:6806/4169607876","heartbeat_back_addr":"172.21.15.62:6814/4169607876","heartbeat_front_addr":"172.21.15.62:6810/4169607876","state":["exists","up"]},{"osd":3,"uuid":"f3c0298a-b075-4411-af50-e16cd74fdddb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6817","nonce":3268438986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6819","nonce":3268438986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6823","nonce":3268438986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6821","nonce":3268438986}]},"public_addr":"172.21.15.62:6817/3268438986","cluster_addr":"172.21.15.62:6819/3268438986","heartbeat_back_addr":"172.21.15.62:6823/3268438986","heartbeat_front_addr":"172.21.15.62:6821/3268438986","state":["exists","up"]},{"osd":4,"uuid":"1ab5c5ca-e74f-475a-a309-683cc0029928","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6817","nonce":3139617628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6819","nonce":3139617628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6823","nonce":3139617628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6821","nonce":3139617628}]},"public_addr":"172.21.15.89:6817/3139617628","cluster_addr":"172.21.15.89:6819/3139617628","heartbeat_back_addr":"172.21.15.89:6823/3139617628","heartbeat_front_addr":"172.21.15.89:6821/3139617628","state":["exists","up"]},{"osd":5,"uuid":"a933e184-bd8f-4369-a1ba-a68de53c578c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6825","nonce":2681723596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6827","nonce":2681723596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6831","nonce":2681723596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6829","nonce":2681723596}]},"public_addr":"172.21.15.89:6825/2681723596","cluster_addr":"172.21.15.89:6827/2681723596","heartbeat_back_addr":"172.21.15.89:6831/2681723596","heartbeat_front_addr":"172.21.15.89:6829/2681723596","state":["exists","up"]},{"osd":6,"uuid":"1ed7ad37-2eee-49a6-954c-b537e2b7f0ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6809","nonce":1657136033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6811","nonce":1657136033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6815","nonce":1657136033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6813","nonce":1657136033}]},"public_addr":"172.21.15.89:6809/1657136033","cluster_addr":"172.21.15.89:6811/1657136033","heartbeat_back_addr":"172.21.15.89:6815/1657136033","heartbeat_front_addr":"172.21.15.89:6813/1657136033","state":["exists","up"]},{"osd":7,"uuid":"6ed732e9-33ff-40df-9038-a9f1d1622671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6801","nonce":1710561686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6803","nonce":1710561686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6807","nonce":1710561686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6805","nonce":1710561686}]},"public_addr":"172.21.15.89:6801/1710561686","cluster_addr":"172.21.15.89:6803/1710561686","heartbeat_back_addr":"172.21.15.89:6807/1710561686","heartbeat_front_addr":"172.21.15.89:6805/1710561686","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.335803+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.419788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.179334+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.263310+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.071846+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.375627+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.282277+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.315997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:42:27.905 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.902+0000 7f75f49bb700 1 -- 172.21.15.62:0/3803403224 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f75d00662f0 msgr2=0x7f75d00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:27.905 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.902+0000 7f75f49bb700 1 --2- 172.21.15.62:0/3803403224 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f75d00662f0 0x7f75d00687a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f75e0007fd0 tx=0x7f75e0007c60 comp rx=0 tx=0).stop 2023-06-09T04:42:27.905 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.902+0000 7f75f49bb700 1 -- 172.21.15.62:0/3803403224 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75f01523f0 msgr2=0x7f75f00b35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:27.905 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.902+0000 7f75f49bb700 1 --2- 172.21.15.62:0/3803403224 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75f01523f0 0x7f75f00b35d0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f75e800cb50 tx=0x7f75e800ce60 comp rx=0 tx=0).stop 2023-06-09T04:42:27.905 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.902+0000 7f75f49bb700 1 -- 172.21.15.62:0/3803403224 shutdown_connections 2023-06-09T04:42:27.905 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.902+0000 7f75f49bb700 1 --2- 172.21.15.62:0/3803403224 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f75d00662f0 0x7f75d00687a0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:27.905 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.902+0000 7f75f49bb700 1 --2- 172.21.15.62:0/3803403224 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75f01523f0 0x7f75f00b35d0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:27.906 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.902+0000 7f75f49bb700 1 --2- 172.21.15.62:0/3803403224 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f75f0159a40 0x7f75f0149480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:27.906 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.902+0000 7f75f49bb700 1 --2- 172.21.15.62:0/3803403224 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f75f00cd4f0 0x7f75f0156cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:27.906 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.902+0000 7f75f49bb700 1 -- 172.21.15.62:0/3803403224 >> 172.21.15.62:0/3803403224 conn(0x7f75f00c9ea0 msgr2=0x7f75f0152e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:27.906 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.902+0000 7f75f49bb700 1 -- 172.21.15.62:0/3803403224 shutdown_connections 2023-06-09T04:42:27.906 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:27.902+0000 7f75f49bb700 1 -- 172.21.15.62:0/3803403224 wait complete. 2023-06-09T04:42:27.927 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:40:44.646921+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:40:50.006643+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-09T04:42:27.928 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T04:42:28.110 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.106+0000 7f3b1359e700 1 Processor -- start 2023-06-09T04:42:28.111 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.106+0000 7f3b1359e700 1 -- start start 2023-06-09T04:42:28.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.110+0000 7f3b1359e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3b1415ddc0 0x7f3b140b4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:28.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.110+0000 7f3b1359e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3b140b1410 0x7f3b140ae710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:28.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.110+0000 7f3b1359e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b140b28a0 con 0x7f3b140b1040 2023-06-09T04:42:28.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.110+0000 7f3b1359e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b1406d970 con 0x7f3b140b1410 2023-06-09T04:42:28.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.110+0000 7f3b1359e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b140aec50 con 0x7f3b1415ddc0 2023-06-09T04:42:28.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.110+0000 7f3b12d9d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3b140b1410 0x7f3b140ae710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:28.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.110+0000 7f3b12d9d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3b140b1410 0x7f3b140ae710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43108/0 (socket says 172.21.15.62:43108) 2023-06-09T04:42:28.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.110+0000 7f3b12d9d700 1 -- 172.21.15.62:0/1052558077 learned_addr learned my addr 172.21.15.62:0/1052558077 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:28.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.110+0000 7f3b0bfff700 1 --2- 172.21.15.62:0/1052558077 >> v2:172.21.15.89:3300/0 conn(0x7f3b1415ddc0 0x7f3b140b4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:28.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.110+0000 7f3b1259c700 1 --1- 172.21.15.62:0/1052558077 >> v1:172.21.15.89:6789/0 conn(0x7f3b140b1040 0x7f3b1415d6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.62:51472/0 (socket says 172.21.15.62:51472) 2023-06-09T04:42:28.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.110+0000 7f3b12d9d700 1 -- 172.21.15.62:0/1052558077 >> v2:172.21.15.89:3300/0 conn(0x7f3b1415ddc0 msgr2=0x7f3b140b4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:28.117 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.110+0000 7f3b12d9d700 1 --2- 172.21.15.62:0/1052558077 >> v2:172.21.15.89:3300/0 conn(0x7f3b1415ddc0 0x7f3b140b4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:28.117 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.110+0000 7f3b12d9d700 1 -- 172.21.15.62:0/1052558077 >> v1:172.21.15.89:6789/0 conn(0x7f3b140b1040 legacy=0x7f3b1415d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:28.117 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.110+0000 7f3b12d9d700 1 -- 172.21.15.62:0/1052558077 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b140cfed0 con 0x7f3b140b1410 2023-06-09T04:42:28.117 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.110+0000 7f3b11d9b700 1 -- 172.21.15.62:0/1052558077 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3484662948 0 0) 0x7f3b140b28a0 con 0x7f3b140b1040 2023-06-09T04:42:28.118 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.114+0000 7f3b12d9d700 1 --2- 172.21.15.62:0/1052558077 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3b140b1410 0x7f3b140ae710 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f3b14164d20 tx=0x7f3b0c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83a02d9303a1b80d server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:28.118 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.114+0000 7f3b11d9b700 1 -- 172.21.15.62:0/1052558077 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0c00e070 con 0x7f3b140b1410 2023-06-09T04:42:28.118 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.114+0000 7f3b11d9b700 1 -- 172.21.15.62:0/1052558077 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b0c00b8d0 con 0x7f3b140b1410 2023-06-09T04:42:28.118 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.114+0000 7f3b11d9b700 1 -- 172.21.15.62:0/1052558077 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0c00bc80 con 0x7f3b140b1410 2023-06-09T04:42:28.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.114+0000 7f3b1359e700 1 -- 172.21.15.62:0/1052558077 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3b140b1410 msgr2=0x7f3b140ae710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:28.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.114+0000 7f3b1359e700 1 --2- 172.21.15.62:0/1052558077 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3b140b1410 0x7f3b140ae710 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f3b14164d20 tx=0x7f3b0c00b330 comp rx=0 tx=0).stop 2023-06-09T04:42:28.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.114+0000 7f3b1359e700 1 -- 172.21.15.62:0/1052558077 shutdown_connections 2023-06-09T04:42:28.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.114+0000 7f3b1359e700 1 --2- 172.21.15.62:0/1052558077 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3b140b1410 0x7f3b140ae710 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:28.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.114+0000 7f3b1359e700 1 --2- 172.21.15.62:0/1052558077 >> v2:172.21.15.89:3300/0 conn(0x7f3b1415ddc0 0x7f3b140b4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:28.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.114+0000 7f3b1359e700 1 -- 172.21.15.62:0/1052558077 >> 172.21.15.62:0/1052558077 conn(0x7f3b1406dd10 msgr2=0x7f3b1406e110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:28.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.114+0000 7f3b1359e700 1 -- 172.21.15.62:0/1052558077 shutdown_connections 2023-06-09T04:42:28.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.114+0000 7f3b1359e700 1 -- 172.21.15.62:0/1052558077 wait complete. 2023-06-09T04:42:28.120 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.118+0000 7f3b1359e700 1 Processor -- start 2023-06-09T04:42:28.120 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.118+0000 7f3b1359e700 1 -- start start 2023-06-09T04:42:28.122 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.118+0000 7f3b1359e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3b140b1040 0x7f3b1414fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:28.122 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.118+0000 7f3b1359e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3b140b1410 0x7f3b1415f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:28.122 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.118+0000 7f3b1359e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b1415ddc0 0x7f3b1415fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:28.123 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.118+0000 7f3b1359e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b141f8dd0 con 0x7f3b140b1040 2023-06-09T04:42:28.123 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.118+0000 7f3b1359e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b14152a10 con 0x7f3b1415ddc0 2023-06-09T04:42:28.123 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.118+0000 7f3b1359e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b140ccf40 con 0x7f3b140b1410 2023-06-09T04:42:28.123 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.118+0000 7f3b1259c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3b140b1040 0x7f3b1414fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:28.123 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.118+0000 7f3b1259c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3b140b1040 0x7f3b1414fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43120/0 (socket says 172.21.15.62:43120) 2023-06-09T04:42:28.123 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.118+0000 7f3b1259c700 1 -- 172.21.15.62:0/2983625636 learned_addr learned my addr 172.21.15.62:0/2983625636 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:28.124 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.118+0000 7f3b0bfff700 1 --2- 172.21.15.62:0/2983625636 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3b140b1410 0x7f3b1415f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:28.124 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.118+0000 7f3b12d9d700 1 --2- 172.21.15.62:0/2983625636 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b1415ddc0 0x7f3b1415fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:28.125 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.118+0000 7f3b1259c700 1 -- 172.21.15.62:0/2983625636 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3b140b1410 msgr2=0x7f3b1415f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:28.125 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.118+0000 7f3b1259c700 1 --2- 172.21.15.62:0/2983625636 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3b140b1410 0x7f3b1415f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:28.125 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.122+0000 7f3b1259c700 1 -- 172.21.15.62:0/2983625636 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b1415ddc0 msgr2=0x7f3b1415fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:28.125 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.122+0000 7f3b1259c700 1 --2- 172.21.15.62:0/2983625636 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b1415ddc0 0x7f3b1415fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:28.125 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.122+0000 7f3b1259c700 1 -- 172.21.15.62:0/2983625636 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b0c009b30 con 0x7f3b140b1040 2023-06-09T04:42:28.125 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.122+0000 7f3b1259c700 1 --2- 172.21.15.62:0/2983625636 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3b140b1040 0x7f3b1414fe70 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f3b0400c580 tx=0x7f3b0400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:28.125 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.122+0000 7f3b0affd700 1 -- 172.21.15.62:0/2983625636 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b04004ca0 con 0x7f3b140b1040 2023-06-09T04:42:28.126 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.122+0000 7f3b0affd700 1 -- 172.21.15.62:0/2983625636 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b04004e20 con 0x7f3b140b1040 2023-06-09T04:42:28.126 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.122+0000 7f3b1359e700 1 -- 172.21.15.62:0/2983625636 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b140cd220 con 0x7f3b140b1040 2023-06-09T04:42:28.126 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.122+0000 7f3b0affd700 1 -- 172.21.15.62:0/2983625636 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b04007310 con 0x7f3b140b1040 2023-06-09T04:42:28.126 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.122+0000 7f3b1359e700 1 -- 172.21.15.62:0/2983625636 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b14152cf0 con 0x7f3b140b1040 2023-06-09T04:42:28.126 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.122+0000 7f3b1359e700 1 -- 172.21.15.62:0/2983625636 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b140739c0 con 0x7f3b140b1040 2023-06-09T04:42:28.127 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.126+0000 7f3b0affd700 1 -- 172.21.15.62:0/2983625636 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3b04007470 con 0x7f3b140b1040 2023-06-09T04:42:28.129 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.126+0000 7f3b0affd700 1 --2- 172.21.15.62:0/2983625636 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f3af40662f0 0x7f3af40687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:28.129 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.126+0000 7f3b0affd700 1 -- 172.21.15.62:0/2983625636 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f3b040838d0 con 0x7f3b140b1040 2023-06-09T04:42:28.130 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.126+0000 7f3b0bfff700 1 --2- 172.21.15.62:0/2983625636 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f3af40662f0 0x7f3af40687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:28.131 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.130+0000 7f3b0bfff700 1 --2- 172.21.15.62:0/2983625636 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f3af40662f0 0x7f3af40687a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3b141f9ab0 tx=0x7f3afc009240 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:28.135 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.134+0000 7f3b0affd700 1 -- 172.21.15.62:0/2983625636 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3b04050ec0 con 0x7f3b140b1040 2023-06-09T04:42:28.311 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.306+0000 7f3b1359e700 1 -- 172.21.15.62:0/2983625636 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3b1415ac30 con 0x7f3b140b1040 2023-06-09T04:42:28.312 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.310+0000 7f3b0affd700 1 -- 172.21.15.62:0/2983625636 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3b04007720 con 0x7f3b140b1040 2023-06-09T04:42:28.312 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2023-06-09T04:42:28.314 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.310+0000 7f3b1359e700 1 -- 172.21.15.62:0/2983625636 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f3af40662f0 msgr2=0x7f3af40687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:28.315 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.310+0000 7f3b1359e700 1 --2- 172.21.15.62:0/2983625636 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f3af40662f0 0x7f3af40687a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f3b141f9ab0 tx=0x7f3afc009240 comp rx=0 tx=0).stop 2023-06-09T04:42:28.315 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.310+0000 7f3b1359e700 1 -- 172.21.15.62:0/2983625636 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3b140b1040 msgr2=0x7f3b1414fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:28.315 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.310+0000 7f3b1359e700 1 --2- 172.21.15.62:0/2983625636 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3b140b1040 0x7f3b1414fe70 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f3b0400c580 tx=0x7f3b0400c890 comp rx=0 tx=0).stop 2023-06-09T04:42:28.315 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.310+0000 7f3b1359e700 1 -- 172.21.15.62:0/2983625636 shutdown_connections 2023-06-09T04:42:28.316 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.310+0000 7f3b1359e700 1 --2- 172.21.15.62:0/2983625636 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f3af40662f0 0x7f3af40687a0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:28.316 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.310+0000 7f3b1359e700 1 --2- 172.21.15.62:0/2983625636 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3b1415ddc0 0x7f3b1415fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:28.316 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.310+0000 7f3b1359e700 1 --2- 172.21.15.62:0/2983625636 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3b140b1410 0x7f3b1415f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:28.316 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.310+0000 7f3b1359e700 1 --2- 172.21.15.62:0/2983625636 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3b140b1040 0x7f3b1414fe70 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:28.316 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.310+0000 7f3b1359e700 1 -- 172.21.15.62:0/2983625636 >> 172.21.15.62:0/2983625636 conn(0x7f3b1406dd10 msgr2=0x7f3b1415d480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:28.316 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.314+0000 7f3b1359e700 1 -- 172.21.15.62:0/2983625636 shutdown_connections 2023-06-09T04:42:28.316 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.314+0000 7f3b1359e700 1 -- 172.21.15.62:0/2983625636 wait complete. 2023-06-09T04:42:28.336 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T04:42:28.516 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.514+0000 7f5e76358700 1 Processor -- start 2023-06-09T04:42:28.517 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.514+0000 7f5e76358700 1 -- start start 2023-06-09T04:42:28.521 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.518+0000 7f5e76358700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5e701562c0 0x7f5e701603f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:28.521 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.518+0000 7f5e76358700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5e7006b880 0x7f5e700afb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:28.521 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.518+0000 7f5e76358700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e7015cd90 con 0x7f5e700b0090 2023-06-09T04:42:28.522 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.518+0000 7f5e76358700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e70160930 con 0x7f5e7006b880 2023-06-09T04:42:28.522 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.518+0000 7f5e76358700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e700b04b0 con 0x7f5e701562c0 2023-06-09T04:42:28.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.518+0000 7f5e74b55700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5e7006b880 0x7f5e700afb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:28.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.518+0000 7f5e75b57700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f5e700b0090 0x7f5e700cbfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:49444/0 (socket says 172.21.15.62:49444) 2023-06-09T04:42:28.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.518+0000 7f5e75b57700 1 -- 172.21.15.62:0/3818977536 learned_addr learned my addr 172.21.15.62:0/3818977536 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:42:28.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.518+0000 7f5e75356700 1 --2- 172.21.15.62:0/3818977536 >> v2:172.21.15.89:3300/0 conn(0x7f5e701562c0 0x7f5e701603f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:28.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.518+0000 7f5e67fff700 1 -- 172.21.15.62:0/3818977536 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2389467708 0 0) 0x7f5e7015cd90 con 0x7f5e700b0090 2023-06-09T04:42:28.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.518+0000 7f5e67fff700 1 -- 172.21.15.62:0/3818977536 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e5c0035d0 con 0x7f5e700b0090 2023-06-09T04:42:28.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.518+0000 7f5e74b55700 1 -- 172.21.15.62:0/3818977536 >> v2:172.21.15.89:3300/0 conn(0x7f5e701562c0 msgr2=0x7f5e701603f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:28.526 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.518+0000 7f5e74b55700 1 --2- 172.21.15.62:0/3818977536 >> v2:172.21.15.89:3300/0 conn(0x7f5e701562c0 0x7f5e701603f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:28.526 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.518+0000 7f5e74b55700 1 -- 172.21.15.62:0/3818977536 >> v1:172.21.15.62:6789/0 conn(0x7f5e700b0090 legacy=0x7f5e700cbfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:28.526 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.518+0000 7f5e74b55700 1 -- 172.21.15.62:0/3818977536 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e7006bd10 con 0x7f5e7006b880 2023-06-09T04:42:28.526 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.518+0000 7f5e75356700 1 --2- 172.21.15.62:0/3818977536 >> v2:172.21.15.89:3300/0 conn(0x7f5e701562c0 0x7f5e701603f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:42:28.526 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.518+0000 7f5e74b55700 1 --2- 172.21.15.62:0/3818977536 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5e7006b880 0x7f5e700afb50 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f5e700ada00 tx=0x7f5e60009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffd794d5457e1ec8 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:28.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.518+0000 7f5e67fff700 1 -- 172.21.15.62:0/3818977536 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e60011830 con 0x7f5e7006b880 2023-06-09T04:42:28.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.522+0000 7f5e67fff700 1 -- 172.21.15.62:0/3818977536 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e60011990 con 0x7f5e7006b880 2023-06-09T04:42:28.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.522+0000 7f5e67fff700 1 -- 172.21.15.62:0/3818977536 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e60011d20 con 0x7f5e7006b880 2023-06-09T04:42:28.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.522+0000 7f5e76358700 1 -- 172.21.15.62:0/3818977536 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5e7006b880 msgr2=0x7f5e700afb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:28.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.522+0000 7f5e76358700 1 --2- 172.21.15.62:0/3818977536 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5e7006b880 0x7f5e700afb50 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f5e700ada00 tx=0x7f5e60009b30 comp rx=0 tx=0).stop 2023-06-09T04:42:28.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.522+0000 7f5e76358700 1 -- 172.21.15.62:0/3818977536 shutdown_connections 2023-06-09T04:42:28.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.522+0000 7f5e76358700 1 --2- 172.21.15.62:0/3818977536 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5e7006b880 0x7f5e700afb50 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:28.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.522+0000 7f5e76358700 1 --2- 172.21.15.62:0/3818977536 >> v2:172.21.15.89:3300/0 conn(0x7f5e701562c0 0x7f5e701603f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:28.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.522+0000 7f5e76358700 1 -- 172.21.15.62:0/3818977536 >> 172.21.15.62:0/3818977536 conn(0x7f5e700cab50 msgr2=0x7f5e700caf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:28.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.522+0000 7f5e76358700 1 -- 172.21.15.62:0/3818977536 shutdown_connections 2023-06-09T04:42:28.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.522+0000 7f5e76358700 1 -- 172.21.15.62:0/3818977536 wait complete. 2023-06-09T04:42:28.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.522+0000 7f5e76358700 1 Processor -- start 2023-06-09T04:42:28.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.522+0000 7f5e76358700 1 -- start start 2023-06-09T04:42:28.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.526+0000 7f5e76358700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e7006b880 0x7f5e70152640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:28.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.526+0000 7f5e76358700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5e700b0090 0x7f5e700c2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:28.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.526+0000 7f5e76358700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5e701562c0 0x7f5e700b32a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:28.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.526+0000 7f5e76358700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7015d220 con 0x7f5e701562c0 2023-06-09T04:42:28.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.526+0000 7f5e76358700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7015d470 con 0x7f5e7006b880 2023-06-09T04:42:28.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.526+0000 7f5e76358700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7015d750 con 0x7f5e700b0090 2023-06-09T04:42:28.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.526+0000 7f5e75b57700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5e701562c0 0x7f5e700b32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:28.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.526+0000 7f5e75356700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e7006b880 0x7f5e70152640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:28.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.526+0000 7f5e74b55700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5e700b0090 0x7f5e700c2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:28.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.526+0000 7f5e75356700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e7006b880 0x7f5e70152640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.62:58046/0 (socket says 172.21.15.62:58046) 2023-06-09T04:42:28.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.526+0000 7f5e75b57700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5e701562c0 0x7f5e700b32a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43144/0 (socket says 172.21.15.62:43144) 2023-06-09T04:42:28.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.526+0000 7f5e75356700 1 -- 172.21.15.62:0/977510833 learned_addr learned my addr 172.21.15.62:0/977510833 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:28.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.526+0000 7f5e75b57700 1 -- 172.21.15.62:0/977510833 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5e700b0090 msgr2=0x7f5e700c2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:28.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.526+0000 7f5e75b57700 1 --2- 172.21.15.62:0/977510833 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5e700b0090 0x7f5e700c2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:28.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.526+0000 7f5e75b57700 1 -- 172.21.15.62:0/977510833 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e7006b880 msgr2=0x7f5e70152640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:28.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.526+0000 7f5e75b57700 1 --2- 172.21.15.62:0/977510833 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e7006b880 0x7f5e70152640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:28.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.526+0000 7f5e75b57700 1 -- 172.21.15.62:0/977510833 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e6c0094b0 con 0x7f5e701562c0 2023-06-09T04:42:28.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.526+0000 7f5e75b57700 1 --2- 172.21.15.62:0/977510833 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5e701562c0 0x7f5e700b32a0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f5e6800ca80 tx=0x7f5e6800cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:28.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.526+0000 7f5e65ffb700 1 -- 172.21.15.62:0/977510833 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e68007480 con 0x7f5e701562c0 2023-06-09T04:42:28.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.526+0000 7f5e65ffb700 1 -- 172.21.15.62:0/977510833 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e680075e0 con 0x7f5e701562c0 2023-06-09T04:42:28.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.526+0000 7f5e76358700 1 -- 172.21.15.62:0/977510833 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e600094b0 con 0x7f5e701562c0 2023-06-09T04:42:28.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.526+0000 7f5e65ffb700 1 -- 172.21.15.62:0/977510833 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e68007950 con 0x7f5e701562c0 2023-06-09T04:42:28.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.530+0000 7f5e76358700 1 -- 172.21.15.62:0/977510833 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e7015dd10 con 0x7f5e701562c0 2023-06-09T04:42:28.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.530+0000 7f5e76358700 1 -- 172.21.15.62:0/977510833 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e7015ca00 con 0x7f5e701562c0 2023-06-09T04:42:28.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.530+0000 7f5e65ffb700 1 -- 172.21.15.62:0/977510833 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f5e6801b3b0 con 0x7f5e701562c0 2023-06-09T04:42:28.536 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.534+0000 7f5e65ffb700 1 --2- 172.21.15.62:0/977510833 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f5e540662f0 0x7f5e540687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:28.536 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.534+0000 7f5e65ffb700 1 -- 172.21.15.62:0/977510833 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f5e68083250 con 0x7f5e701562c0 2023-06-09T04:42:28.536 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.534+0000 7f5e75356700 1 --2- 172.21.15.62:0/977510833 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f5e540662f0 0x7f5e540687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:28.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.534+0000 7f5e75356700 1 --2- 172.21.15.62:0/977510833 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f5e540662f0 0x7f5e540687a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c009e80 tx=0x7f5e6c009240 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:28.541 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.538+0000 7f5e65ffb700 1 -- 172.21.15.62:0/977510833 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f5e7015ca00 con 0x7f5e701562c0 2023-06-09T04:42:28.715 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.710+0000 7f5e76358700 1 -- 172.21.15.62:0/977510833 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5e7015ca00 con 0x7f5e701562c0 2023-06-09T04:42:28.716 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.714+0000 7f5e65ffb700 1 -- 172.21.15.62:0/977510833 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v39) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5e7015ca00 con 0x7f5e701562c0 2023-06-09T04:42:28.717 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2023-06-09T04:42:28.719 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.714+0000 7f5e76358700 1 -- 172.21.15.62:0/977510833 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f5e540662f0 msgr2=0x7f5e540687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:28.720 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.714+0000 7f5e76358700 1 --2- 172.21.15.62:0/977510833 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f5e540662f0 0x7f5e540687a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f5e6c009e80 tx=0x7f5e6c009240 comp rx=0 tx=0).stop 2023-06-09T04:42:28.720 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.714+0000 7f5e76358700 1 -- 172.21.15.62:0/977510833 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5e701562c0 msgr2=0x7f5e700b32a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:28.720 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.714+0000 7f5e76358700 1 --2- 172.21.15.62:0/977510833 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5e701562c0 0x7f5e700b32a0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f5e6800ca80 tx=0x7f5e6800cab0 comp rx=0 tx=0).stop 2023-06-09T04:42:28.721 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.718+0000 7f5e76358700 1 -- 172.21.15.62:0/977510833 shutdown_connections 2023-06-09T04:42:28.721 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.718+0000 7f5e76358700 1 --2- 172.21.15.62:0/977510833 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f5e540662f0 0x7f5e540687a0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:28.721 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.718+0000 7f5e76358700 1 --2- 172.21.15.62:0/977510833 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5e701562c0 0x7f5e700b32a0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:28.721 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.718+0000 7f5e76358700 1 --2- 172.21.15.62:0/977510833 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f5e700b0090 0x7f5e700c2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:28.722 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.718+0000 7f5e76358700 1 --2- 172.21.15.62:0/977510833 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5e7006b880 0x7f5e70152640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:28.722 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.718+0000 7f5e76358700 1 -- 172.21.15.62:0/977510833 >> 172.21.15.62:0/977510833 conn(0x7f5e700cab50 msgr2=0x7f5e700ab8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:28.722 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.718+0000 7f5e76358700 1 -- 172.21.15.62:0/977510833 shutdown_connections 2023-06-09T04:42:28.722 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.718+0000 7f5e76358700 1 -- 172.21.15.62:0/977510833 wait complete. 2023-06-09T04:42:28.742 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-06-09T04:42:28.919 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.918+0000 7f31f4f9e700 1 Processor -- start 2023-06-09T04:42:28.920 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.918+0000 7f31f4f9e700 1 -- start start 2023-06-09T04:42:28.922 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.918+0000 7f31f4f9e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f31f0159910 0x7f31f00c8680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:28.922 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.918+0000 7f31f4f9e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f31f00cacf0 0x7f31f015fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:28.923 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.918+0000 7f31f4f9e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31f00cbf30 con 0x7f31f00ad1a0 2023-06-09T04:42:28.924 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.918+0000 7f31f4f9e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31f015d1c0 con 0x7f31f00cacf0 2023-06-09T04:42:28.924 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.918+0000 7f31f4f9e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31f015c640 con 0x7f31f0159910 2023-06-09T04:42:28.924 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.918+0000 7f31effff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f31f00cacf0 0x7f31f015fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:28.924 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.922+0000 7f31eeffd700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f31f00ad1a0 0x7f31f00ca5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:49456/0 (socket says 172.21.15.62:49456) 2023-06-09T04:42:28.924 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.922+0000 7f31effff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f31f00cacf0 0x7f31f015fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43154/0 (socket says 172.21.15.62:43154) 2023-06-09T04:42:28.925 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.922+0000 7f31eeffd700 1 -- 172.21.15.62:0/3945566910 learned_addr learned my addr 172.21.15.62:0/3945566910 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:42:28.925 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.922+0000 7f31ef7fe700 1 --2- 172.21.15.62:0/3945566910 >> v2:172.21.15.89:3300/0 conn(0x7f31f0159910 0x7f31f00c8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:28.925 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.922+0000 7f31effff700 1 -- 172.21.15.62:0/3945566910 >> v2:172.21.15.89:3300/0 conn(0x7f31f0159910 msgr2=0x7f31f00c8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:28.925 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.922+0000 7f31effff700 1 --2- 172.21.15.62:0/3945566910 >> v2:172.21.15.89:3300/0 conn(0x7f31f0159910 0x7f31f00c8680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:28.925 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.922+0000 7f31effff700 1 -- 172.21.15.62:0/3945566910 >> v1:172.21.15.62:6789/0 conn(0x7f31f00ad1a0 legacy=0x7f31f00ca5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:28.925 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.922+0000 7f31effff700 1 -- 172.21.15.62:0/3945566910 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31f015c920 con 0x7f31f00cacf0 2023-06-09T04:42:28.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.922+0000 7f31effff700 1 --2- 172.21.15.62:0/3945566910 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31f00cacf0 0x7f31f015fbc0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f31f0071bd0 tx=0x7f31e800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdc52fc84276394e server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:28.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.922+0000 7f31ee7fc700 1 -- 172.21.15.62:0/3945566910 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e800e070 con 0x7f31f00cacf0 2023-06-09T04:42:28.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.922+0000 7f31ee7fc700 1 -- 172.21.15.62:0/3945566910 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31e800bb20 con 0x7f31f00cacf0 2023-06-09T04:42:28.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.922+0000 7f31ee7fc700 1 -- 172.21.15.62:0/3945566910 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e8012430 con 0x7f31f00cacf0 2023-06-09T04:42:28.927 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.922+0000 7f31f4f9e700 1 -- 172.21.15.62:0/3945566910 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31f00cacf0 msgr2=0x7f31f015fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:28.927 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.922+0000 7f31f4f9e700 1 --2- 172.21.15.62:0/3945566910 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31f00cacf0 0x7f31f015fbc0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f31f0071bd0 tx=0x7f31e800b330 comp rx=0 tx=0).stop 2023-06-09T04:42:28.927 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.922+0000 7f31f4f9e700 1 -- 172.21.15.62:0/3945566910 shutdown_connections 2023-06-09T04:42:28.927 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.922+0000 7f31f4f9e700 1 --2- 172.21.15.62:0/3945566910 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31f00cacf0 0x7f31f015fbc0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:28.927 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.922+0000 7f31f4f9e700 1 --2- 172.21.15.62:0/3945566910 >> v2:172.21.15.89:3300/0 conn(0x7f31f0159910 0x7f31f00c8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:28.927 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.922+0000 7f31f4f9e700 1 -- 172.21.15.62:0/3945566910 >> 172.21.15.62:0/3945566910 conn(0x7f31f006a420 msgr2=0x7f31f00afc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:28.927 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.922+0000 7f31f4f9e700 1 -- 172.21.15.62:0/3945566910 shutdown_connections 2023-06-09T04:42:28.928 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.922+0000 7f31f4f9e700 1 -- 172.21.15.62:0/3945566910 wait complete. 2023-06-09T04:42:28.928 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.926+0000 7f31f4f9e700 1 Processor -- start 2023-06-09T04:42:28.929 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.926+0000 7f31f4f9e700 1 -- start start 2023-06-09T04:42:28.930 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.926+0000 7f31f4f9e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f31f00cacf0 0x7f31f01f4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:28.931 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.926+0000 7f31f4f9e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31f0159910 0x7f31f015d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:28.931 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.926+0000 7f31f4f9e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f31f01f1cd0 0x7f31f00c9380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:28.931 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.926+0000 7f31f4f9e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31f015dea0 con 0x7f31f0159910 2023-06-09T04:42:28.931 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.926+0000 7f31f4f9e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31f015eca0 con 0x7f31f01f1cd0 2023-06-09T04:42:28.931 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.926+0000 7f31f4f9e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31f01f2170 con 0x7f31f00cacf0 2023-06-09T04:42:28.932 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.930+0000 7f31eeffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31f0159910 0x7f31f015d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:28.932 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.930+0000 7f31eeffd700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31f0159910 0x7f31f015d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43160/0 (socket says 172.21.15.62:43160) 2023-06-09T04:42:28.932 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.930+0000 7f31eeffd700 1 -- 172.21.15.62:0/3734430548 learned_addr learned my addr 172.21.15.62:0/3734430548 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:28.933 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.930+0000 7f31effff700 1 --2- 172.21.15.62:0/3734430548 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f31f01f1cd0 0x7f31f00c9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:28.933 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.930+0000 7f31ef7fe700 1 --2- 172.21.15.62:0/3734430548 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f31f00cacf0 0x7f31f01f4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:28.933 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.930+0000 7f31eeffd700 1 -- 172.21.15.62:0/3734430548 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f31f00cacf0 msgr2=0x7f31f01f4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:28.933 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.930+0000 7f31eeffd700 1 --2- 172.21.15.62:0/3734430548 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f31f00cacf0 0x7f31f01f4160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:28.933 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.930+0000 7f31eeffd700 1 -- 172.21.15.62:0/3734430548 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f31f01f1cd0 msgr2=0x7f31f00c9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:28.933 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.930+0000 7f31eeffd700 1 --2- 172.21.15.62:0/3734430548 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f31f01f1cd0 0x7f31f00c9380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:28.933 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.930+0000 7f31eeffd700 1 -- 172.21.15.62:0/3734430548 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e8009a70 con 0x7f31f0159910 2023-06-09T04:42:28.934 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.930+0000 7f31ef7fe700 1 --2- 172.21.15.62:0/3734430548 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f31f00cacf0 0x7f31f01f4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:42:28.934 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.930+0000 7f31effff700 1 --2- 172.21.15.62:0/3734430548 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f31f01f1cd0 0x7f31f00c9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:28.934 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.930+0000 7f31eeffd700 1 --2- 172.21.15.62:0/3734430548 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31f0159910 0x7f31f015d960 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f31e0001eb0 tx=0x7f31e000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:28.937 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.934+0000 7f31d7fff700 1 -- 172.21.15.62:0/3734430548 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e0005d90 con 0x7f31f0159910 2023-06-09T04:42:28.937 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.934+0000 7f31f4f9e700 1 -- 172.21.15.62:0/3734430548 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31f015e090 con 0x7f31f0159910 2023-06-09T04:42:28.937 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.934+0000 7f31d7fff700 1 -- 172.21.15.62:0/3734430548 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31e00070d0 con 0x7f31f0159910 2023-06-09T04:42:28.937 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.934+0000 7f31d7fff700 1 -- 172.21.15.62:0/3734430548 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e0007440 con 0x7f31f0159910 2023-06-09T04:42:28.937 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.934+0000 7f31f4f9e700 1 -- 172.21.15.62:0/3734430548 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31f015e650 con 0x7f31f0159910 2023-06-09T04:42:28.938 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.934+0000 7f31f4f9e700 1 -- 172.21.15.62:0/3734430548 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31f00739c0 con 0x7f31f0159910 2023-06-09T04:42:28.940 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.938+0000 7f31d7fff700 1 -- 172.21.15.62:0/3734430548 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f31e00075a0 con 0x7f31f0159910 2023-06-09T04:42:28.942 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.938+0000 7f31d7fff700 1 --2- 172.21.15.62:0/3734430548 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f31dc0662f0 0x7f31dc0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:28.942 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.938+0000 7f31d7fff700 1 -- 172.21.15.62:0/3734430548 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f31e0082f30 con 0x7f31f0159910 2023-06-09T04:42:28.943 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.938+0000 7f31ef7fe700 1 --2- 172.21.15.62:0/3734430548 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f31dc0662f0 0x7f31dc0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:28.944 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.942+0000 7f31ef7fe700 1 --2- 172.21.15.62:0/3734430548 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f31dc0662f0 0x7f31dc0687a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f31f0158fb0 tx=0x7f31e4008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:28.950 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:28.946+0000 7f31d7fff700 1 -- 172.21.15.62:0/3734430548 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f31e00505d0 con 0x7f31f0159910 2023-06-09T04:42:29.127 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.122+0000 7f31f4f9e700 1 -- 172.21.15.62:0/3734430548 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f31f01f2380 con 0x7f31f0159910 2023-06-09T04:42:29.127 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.126+0000 7f31d7fff700 1 -- 172.21.15.62:0/3734430548 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v39) v1 ==== 84+0+126 (secure 0 0 0) 0x7f31e0053bf0 con 0x7f31f0159910 2023-06-09T04:42:29.128 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:42:29.128 INFO:teuthology.orchestra.run.smithi062.stdout:[ 2023-06-09T04:42:29.128 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-06-09T04:42:29.128 INFO:teuthology.orchestra.run.smithi062.stdout: "poolnum": 1, 2023-06-09T04:42:29.128 INFO:teuthology.orchestra.run.smithi062.stdout: "poolname": ".mgr" 2023-06-09T04:42:29.129 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-06-09T04:42:29.129 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-06-09T04:42:29.129 INFO:teuthology.orchestra.run.smithi062.stdout: "poolnum": 2, 2023-06-09T04:42:29.129 INFO:teuthology.orchestra.run.smithi062.stdout: "poolname": "rbd" 2023-06-09T04:42:29.129 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-06-09T04:42:29.129 INFO:teuthology.orchestra.run.smithi062.stdout:] 2023-06-09T04:42:29.130 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.126+0000 7f31f4f9e700 1 -- 172.21.15.62:0/3734430548 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f31dc0662f0 msgr2=0x7f31dc0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:29.130 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.126+0000 7f31f4f9e700 1 --2- 172.21.15.62:0/3734430548 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f31dc0662f0 0x7f31dc0687a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f31f0158fb0 tx=0x7f31e4008040 comp rx=0 tx=0).stop 2023-06-09T04:42:29.130 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.126+0000 7f31f4f9e700 1 -- 172.21.15.62:0/3734430548 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31f0159910 msgr2=0x7f31f015d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:29.130 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.126+0000 7f31f4f9e700 1 --2- 172.21.15.62:0/3734430548 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31f0159910 0x7f31f015d960 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f31e0001eb0 tx=0x7f31e000c860 comp rx=0 tx=0).stop 2023-06-09T04:42:29.131 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.126+0000 7f31f4f9e700 1 -- 172.21.15.62:0/3734430548 shutdown_connections 2023-06-09T04:42:29.131 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.126+0000 7f31f4f9e700 1 --2- 172.21.15.62:0/3734430548 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f31dc0662f0 0x7f31dc0687a0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:29.131 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.126+0000 7f31f4f9e700 1 --2- 172.21.15.62:0/3734430548 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f31f01f1cd0 0x7f31f00c9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:29.131 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.126+0000 7f31f4f9e700 1 --2- 172.21.15.62:0/3734430548 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f31f0159910 0x7f31f015d960 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:29.131 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.126+0000 7f31f4f9e700 1 --2- 172.21.15.62:0/3734430548 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f31f00cacf0 0x7f31f01f4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:29.132 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.126+0000 7f31f4f9e700 1 -- 172.21.15.62:0/3734430548 >> 172.21.15.62:0/3734430548 conn(0x7f31f00ad1a0 msgr2=0x7f31f015b020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:29.132 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.126+0000 7f31f4f9e700 1 -- 172.21.15.62:0/3734430548 shutdown_connections 2023-06-09T04:42:29.132 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.126+0000 7f31f4f9e700 1 -- 172.21.15.62:0/3734430548 wait complete. 2023-06-09T04:42:29.156 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-06-09T04:42:29.156 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-06-09T04:42:29.338 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.334+0000 7f3ce97ca700 1 Processor -- start 2023-06-09T04:42:29.338 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.334+0000 7f3ce97ca700 1 -- start start 2023-06-09T04:42:29.341 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.338+0000 7f3ce97ca700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3ce40b7d70 0x7f3ce40d1c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:29.341 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.338+0000 7f3ce97ca700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f3ce40b1af0 0x7f3ce40cef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:29.342 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.338+0000 7f3ce97ca700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ce40cf880 con 0x7f3ce40cf440 2023-06-09T04:42:29.342 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.338+0000 7f3ce97ca700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ce4160360 con 0x7f3ce40b7d70 2023-06-09T04:42:29.342 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.338+0000 7f3ce97ca700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ce4160640 con 0x7f3ce40b1af0 2023-06-09T04:42:29.343 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.338+0000 7f3ce8fc9700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f3ce40cf440 0x7f3ce40b3f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:49458/0 (socket says 172.21.15.62:49458) 2023-06-09T04:42:29.343 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.338+0000 7f3ce3fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3ce40b7d70 0x7f3ce40d1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:29.343 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.338+0000 7f3ce8fc9700 1 -- 172.21.15.62:0/918259105 learned_addr learned my addr 172.21.15.62:0/918259105 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:42:29.343 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.338+0000 7f3cdb7fe700 1 --2- 172.21.15.62:0/918259105 >> v2:172.21.15.89:3300/0 conn(0x7f3ce40b1af0 0x7f3ce40cef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:29.344 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.338+0000 7f3ce37fe700 1 -- 172.21.15.62:0/918259105 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 786608452 0 0) 0x7f3ce40cf880 con 0x7f3ce40cf440 2023-06-09T04:42:29.344 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.338+0000 7f3ce3fff700 1 -- 172.21.15.62:0/918259105 >> v2:172.21.15.89:3300/0 conn(0x7f3ce40b1af0 msgr2=0x7f3ce40cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:29.344 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.338+0000 7f3ce3fff700 1 --2- 172.21.15.62:0/918259105 >> v2:172.21.15.89:3300/0 conn(0x7f3ce40b1af0 0x7f3ce40cef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:29.344 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.338+0000 7f3ce3fff700 1 -- 172.21.15.62:0/918259105 >> v1:172.21.15.62:6789/0 conn(0x7f3ce40cf440 legacy=0x7f3ce40b3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:29.344 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.338+0000 7f3ce3fff700 1 -- 172.21.15.62:0/918259105 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ce40d00d0 con 0x7f3ce40b7d70 2023-06-09T04:42:29.345 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.342+0000 7f3ce3fff700 1 --2- 172.21.15.62:0/918259105 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ce40b7d70 0x7f3ce40d1c30 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f3ce408b4b0 tx=0x7f3cd4009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81cd8f0fb5a299ab server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:29.345 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.342+0000 7f3ce37fe700 1 -- 172.21.15.62:0/918259105 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd4011830 con 0x7f3ce40b7d70 2023-06-09T04:42:29.345 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.342+0000 7f3ce37fe700 1 -- 172.21.15.62:0/918259105 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cd4011990 con 0x7f3ce40b7d70 2023-06-09T04:42:29.345 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.342+0000 7f3ce37fe700 1 -- 172.21.15.62:0/918259105 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd4011d20 con 0x7f3ce40b7d70 2023-06-09T04:42:29.346 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.342+0000 7f3ce97ca700 1 -- 172.21.15.62:0/918259105 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ce40b7d70 msgr2=0x7f3ce40d1c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:29.346 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.342+0000 7f3ce97ca700 1 --2- 172.21.15.62:0/918259105 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ce40b7d70 0x7f3ce40d1c30 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f3ce408b4b0 tx=0x7f3cd4009b30 comp rx=0 tx=0).stop 2023-06-09T04:42:29.346 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.342+0000 7f3ce97ca700 1 -- 172.21.15.62:0/918259105 shutdown_connections 2023-06-09T04:42:29.346 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.342+0000 7f3ce97ca700 1 --2- 172.21.15.62:0/918259105 >> v2:172.21.15.89:3300/0 conn(0x7f3ce40b1af0 0x7f3ce40cef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:29.346 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.342+0000 7f3ce97ca700 1 --2- 172.21.15.62:0/918259105 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ce40b7d70 0x7f3ce40d1c30 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:29.346 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.342+0000 7f3ce97ca700 1 -- 172.21.15.62:0/918259105 >> 172.21.15.62:0/918259105 conn(0x7f3ce40657d0 msgr2=0x7f3ce4070f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:29.347 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.342+0000 7f3ce97ca700 1 -- 172.21.15.62:0/918259105 shutdown_connections 2023-06-09T04:42:29.347 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.342+0000 7f3ce97ca700 1 -- 172.21.15.62:0/918259105 wait complete. 2023-06-09T04:42:29.347 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.346+0000 7f3ce97ca700 1 Processor -- start 2023-06-09T04:42:29.347 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.346+0000 7f3ce97ca700 1 -- start start 2023-06-09T04:42:29.349 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.346+0000 7f3ce97ca700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ce40b1af0 0x7f3ce415ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:29.349 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.346+0000 7f3ce97ca700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ce40b7d70 0x7f3ce4159380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:29.349 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.346+0000 7f3ce97ca700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ce40cf440 0x7f3ce415a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:29.349 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.346+0000 7f3ce97ca700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce41f5670 con 0x7f3ce40b1af0 2023-06-09T04:42:29.349 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.346+0000 7f3ce97ca700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce415f1d0 con 0x7f3ce40b7d70 2023-06-09T04:42:29.350 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.346+0000 7f3ce97ca700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce4159e50 con 0x7f3ce40cf440 2023-06-09T04:42:29.351 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.346+0000 7f3ce3fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ce40b1af0 0x7f3ce415ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:29.351 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.346+0000 7f3ce3fff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ce40b1af0 0x7f3ce415ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43182/0 (socket says 172.21.15.62:43182) 2023-06-09T04:42:29.351 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.346+0000 7f3ce3fff700 1 -- 172.21.15.62:0/1342675252 learned_addr learned my addr 172.21.15.62:0/1342675252 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:29.351 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.346+0000 7f3cdb7fe700 1 --2- 172.21.15.62:0/1342675252 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ce40b7d70 0x7f3ce4159380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:29.351 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.346+0000 7f3ce3fff700 1 -- 172.21.15.62:0/1342675252 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ce40cf440 msgr2=0x7f3ce415a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:29.352 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.346+0000 7f3ce3fff700 1 --2- 172.21.15.62:0/1342675252 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ce40cf440 0x7f3ce415a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:29.352 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.346+0000 7f3ce3fff700 1 -- 172.21.15.62:0/1342675252 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ce40b7d70 msgr2=0x7f3ce4159380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:29.352 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.346+0000 7f3ce3fff700 1 --2- 172.21.15.62:0/1342675252 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ce40b7d70 0x7f3ce4159380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:29.352 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.346+0000 7f3ce3fff700 1 -- 172.21.15.62:0/1342675252 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd40094b0 con 0x7f3ce40b1af0 2023-06-09T04:42:29.352 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.346+0000 7f3cdb7fe700 1 --2- 172.21.15.62:0/1342675252 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ce40b7d70 0x7f3ce4159380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:42:29.352 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.346+0000 7f3ce3fff700 1 --2- 172.21.15.62:0/1342675252 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ce40b1af0 0x7f3ce415ec90 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f3cd4009fd0 tx=0x7f3cd4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:29.352 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.346+0000 7f3ce17fa700 1 -- 172.21.15.62:0/1342675252 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd40045b0 con 0x7f3ce40b1af0 2023-06-09T04:42:29.353 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.346+0000 7f3ce17fa700 1 -- 172.21.15.62:0/1342675252 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cd401f070 con 0x7f3ce40b1af0 2023-06-09T04:42:29.353 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.346+0000 7f3ce97ca700 1 -- 172.21.15.62:0/1342675252 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ce41f4af0 con 0x7f3ce40b1af0 2023-06-09T04:42:29.353 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.346+0000 7f3ce17fa700 1 -- 172.21.15.62:0/1342675252 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd40038e0 con 0x7f3ce40b1af0 2023-06-09T04:42:29.353 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.350+0000 7f3ce97ca700 1 -- 172.21.15.62:0/1342675252 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ce41f50b0 con 0x7f3ce40b1af0 2023-06-09T04:42:29.353 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.350+0000 7f3ce97ca700 1 -- 172.21.15.62:0/1342675252 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ce404db30 con 0x7f3ce40b1af0 2023-06-09T04:42:29.354 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.350+0000 7f3ce17fa700 1 -- 172.21.15.62:0/1342675252 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f3cd4021030 con 0x7f3ce40b1af0 2023-06-09T04:42:29.356 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.354+0000 7f3ce17fa700 1 --2- 172.21.15.62:0/1342675252 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f3cc40662f0 0x7f3cc40687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:29.356 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.354+0000 7f3ce17fa700 1 -- 172.21.15.62:0/1342675252 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f3cd4085010 con 0x7f3ce40b1af0 2023-06-09T04:42:29.357 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.354+0000 7f3cdb7fe700 1 --2- 172.21.15.62:0/1342675252 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f3cc40662f0 0x7f3cc40687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:29.358 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.354+0000 7f3cdb7fe700 1 --2- 172.21.15.62:0/1342675252 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f3cc40662f0 0x7f3cc40687a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3ce4071140 tx=0x7f3ccc00b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:29.363 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.362+0000 7f3ce17fa700 1 -- 172.21.15.62:0/1342675252 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f3cd4052850 con 0x7f3ce40b1af0 2023-06-09T04:42:29.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.534+0000 7f3ce97ca700 1 -- 172.21.15.62:0/1342675252 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f3ce406b350 con 0x7f3ce40b1af0 2023-06-09T04:42:29.960 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.958+0000 7f3ce17fa700 1 -- 172.21.15.62:0/1342675252 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v40) v1 ==== 138+0+0 (secure 0 0 0) 0x7f3cd4055e70 con 0x7f3ce40b1af0 2023-06-09T04:42:29.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.962+0000 7f3ce97ca700 1 -- 172.21.15.62:0/1342675252 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f3cc40662f0 msgr2=0x7f3cc40687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:29.966 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.962+0000 7f3ce97ca700 1 --2- 172.21.15.62:0/1342675252 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f3cc40662f0 0x7f3cc40687a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3ce4071140 tx=0x7f3ccc00b040 comp rx=0 tx=0).stop 2023-06-09T04:42:29.966 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.962+0000 7f3ce97ca700 1 -- 172.21.15.62:0/1342675252 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ce40b1af0 msgr2=0x7f3ce415ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:29.966 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.962+0000 7f3ce97ca700 1 --2- 172.21.15.62:0/1342675252 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ce40b1af0 0x7f3ce415ec90 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f3cd4009fd0 tx=0x7f3cd4004770 comp rx=0 tx=0).stop 2023-06-09T04:42:29.966 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.962+0000 7f3ce97ca700 1 -- 172.21.15.62:0/1342675252 shutdown_connections 2023-06-09T04:42:29.966 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.962+0000 7f3ce97ca700 1 --2- 172.21.15.62:0/1342675252 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f3cc40662f0 0x7f3cc40687a0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:29.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.962+0000 7f3ce97ca700 1 --2- 172.21.15.62:0/1342675252 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f3ce40cf440 0x7f3ce415a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:29.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.962+0000 7f3ce97ca700 1 --2- 172.21.15.62:0/1342675252 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3ce40b7d70 0x7f3ce4159380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:29.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.962+0000 7f3ce97ca700 1 --2- 172.21.15.62:0/1342675252 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3ce40b1af0 0x7f3ce415ec90 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:29.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.962+0000 7f3ce97ca700 1 -- 172.21.15.62:0/1342675252 >> 172.21.15.62:0/1342675252 conn(0x7f3ce40657d0 msgr2=0x7f3ce40b45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:29.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.966+0000 7f3ce97ca700 1 -- 172.21.15.62:0/1342675252 shutdown_connections 2023-06-09T04:42:29.970 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:29.966+0000 7f3ce97ca700 1 -- 172.21.15.62:0/1342675252 wait complete. 2023-06-09T04:42:29.972 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_metadata' created 2023-06-09T04:42:29.993 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-06-09T04:42:30.189 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:30.186+0000 7f576b5c1700 1 Processor -- start 2023-06-09T04:42:30.189 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:30.186+0000 7f576b5c1700 1 -- start start 2023-06-09T04:42:30.191 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:30.190+0000 7f576b5c1700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f5764160660 0x7f5764164940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:30.192 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:30.190+0000 7f576b5c1700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f576406c480 0x7f5764070750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:30.192 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:30.190+0000 7f576b5c1700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57640ccf30 con 0x7f5764160290 2023-06-09T04:42:30.192 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:30.190+0000 7f576b5c1700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5764164e80 con 0x7f576406c480 2023-06-09T04:42:30.192 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:30.190+0000 7f576b5c1700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57640cd210 con 0x7f5764160660 2023-06-09T04:42:30.193 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:30.190+0000 7f5769b5e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f576406c480 0x7f5764070750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:30.193 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:30.190+0000 7f5769b5e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f576406c480 0x7f5764070750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43186/0 (socket says 172.21.15.62:43186) 2023-06-09T04:42:30.193 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:30.190+0000 7f5769b5e700 1 -- 172.21.15.62:0/2020386108 learned_addr learned my addr 172.21.15.62:0/2020386108 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:30.194 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:30.190+0000 7f5768b5c700 1 --2- 172.21.15.62:0/2020386108 >> v2:172.21.15.89:3300/0 conn(0x7f5764160660 0x7f5764164940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:30.194 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:30.190+0000 7f5769b5e700 1 -- 172.21.15.62:0/2020386108 >> v2:172.21.15.89:3300/0 conn(0x7f5764160660 msgr2=0x7f5764164940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:30.194 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:30.190+0000 7f5769b5e700 1 --2- 172.21.15.62:0/2020386108 >> v2:172.21.15.89:3300/0 conn(0x7f5764160660 0x7f5764164940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:30.194 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:30.190+0000 7f5769b5e700 1 -- 172.21.15.62:0/2020386108 >> v1:172.21.15.89:6789/0 conn(0x7f5764160290 legacy=0x7f57640afbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:30.194 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:30.190+0000 7f5769b5e700 1 -- 172.21.15.62:0/2020386108 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57640cd4f0 con 0x7f576406c480 2023-06-09T04:42:30.194 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:30.190+0000 7f5769b5e700 1 --2- 172.21.15.62:0/2020386108 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f576406c480 0x7f5764070750 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f57640adb50 tx=0x7f575c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e855957d74402f3b server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:30.196 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:30.190+0000 7f575bfff700 1 -- 172.21.15.62:0/2020386108 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575c00e070 con 0x7f576406c480 2023-06-09T04:42:30.196 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:30.190+0000 7f575bfff700 1 -- 172.21.15.62:0/2020386108 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f575c00b9c0 con 0x7f576406c480 2023-06-09T04:42:30.196 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:30.190+0000 7f575bfff700 1 -- 172.21.15.62:0/2020386108 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575c00bd70 con 0x7f576406c480 2023-06-09T04:42:30.196 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:30.194+0000 7f576b5c1700 1 -- 172.21.15.62:0/2020386108 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f576406c480 msgr2=0x7f5764070750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:30.196 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:30.194+0000 7f576b5c1700 1 --2- 172.21.15.62:0/2020386108 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f576406c480 0x7f5764070750 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f57640adb50 tx=0x7f575c00b330 comp rx=0 tx=0).stop 2023-06-09T04:42:30.196 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:30.194+0000 7f576b5c1700 1 -- 172.21.15.62:0/2020386108 shutdown_connections 2023-06-09T04:42:30.197 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:30.194+0000 7f576b5c1700 1 --2- 172.21.15.62:0/2020386108 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f576406c480 0x7f5764070750 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:30.197 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:30.194+0000 7f576b5c1700 1 --2- 172.21.15.62:0/2020386108 >> v2:172.21.15.89:3300/0 conn(0x7f5764160660 0x7f5764164940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:30.197 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:30.194+0000 7f576b5c1700 1 -- 172.21.15.62:0/2020386108 >> 172.21.15.62:0/2020386108 conn(0x7f57640697f0 msgr2=0x7f5764069bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:30.197 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:30.194+0000 7f576b5c1700 1 -- 172.21.15.62:0/2020386108 shutdown_connections 2023-06-09T04:42:30.197 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:30.194+0000 7f576b5c1700 1 -- 172.21.15.62:0/2020386108 wait complete. 2023-06-09T04:42:30.199 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:30.194+0000 7f576b5c1700 1 Processor -- start 2023-06-09T04:42:30.199 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:30.198+0000 7f576b5c1700 1 -- start start 2023-06-09T04:42:30.201 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:30.198+0000 7f576b5c1700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f576406c480 0x7f576414fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:30.202 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:30.198+0000 7f576b5c1700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5764160290 0x7f57640c27b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:30.202 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:30.198+0000 7f576b5c1700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5764160660 0x7f57640b1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:30.202 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:30.198+0000 7f576b5c1700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57641500d0 con 0x7f5764160290 2023-06-09T04:42:30.203 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:30.198+0000 7f576b5c1700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57640c4d50 con 0x7f5764160660 2023-06-09T04:42:30.203 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:30.198+0000 7f576b5c1700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57640c4a70 con 0x7f576406c480 2023-06-09T04:42:30.203 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:30.198+0000 7f576935d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f576406c480 0x7f576414fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:30.203 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:30.198+0000 7f576935d700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f576406c480 0x7f576414fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.62:36030/0 (socket says 172.21.15.62:36030) 2023-06-09T04:42:30.203 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:30.198+0000 7f576935d700 1 -- 172.21.15.62:0/3879092572 learned_addr learned my addr 172.21.15.62:0/3879092572 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:30.203 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:30.198+0000 7f5768b5c700 1 --2- 172.21.15.62:0/3879092572 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5764160290 0x7f57640c27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:30.203 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:30.198+0000 7f5769b5e700 1 --2- 172.21.15.62:0/3879092572 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5764160660 0x7f57640b1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:30.204 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:30.202+0000 7f5769b5e700 1 -- 172.21.15.62:0/3879092572 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f576406c480 msgr2=0x7f576414fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:30.204 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:30.202+0000 7f5769b5e700 1 --2- 172.21.15.62:0/3879092572 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f576406c480 0x7f576414fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:30.205 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:30.202+0000 7f5769b5e700 1 -- 172.21.15.62:0/3879092572 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5764160290 msgr2=0x7f57640c27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:30.205 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:30.202+0000 7f5769b5e700 1 --2- 172.21.15.62:0/3879092572 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5764160290 0x7f57640c27b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:30.205 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:30.202+0000 7f5769b5e700 1 -- 172.21.15.62:0/3879092572 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f575c009b30 con 0x7f5764160660 2023-06-09T04:42:30.205 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:30.202+0000 7f576935d700 1 --2- 172.21.15.62:0/3879092572 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f576406c480 0x7f576414fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:42:30.205 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:30.202+0000 7f5769b5e700 1 --2- 172.21.15.62:0/3879092572 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5764160660 0x7f57640b1a50 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f576406f540 tx=0x7f575c004af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:30.206 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:30.202+0000 7f5759ffb700 1 -- 172.21.15.62:0/3879092572 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575c004840 con 0x7f5764160660 2023-06-09T04:42:30.206 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:30.202+0000 7f5759ffb700 1 -- 172.21.15.62:0/3879092572 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f575c0099b0 con 0x7f5764160660 2023-06-09T04:42:30.206 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:30.202+0000 7f5759ffb700 1 -- 172.21.15.62:0/3879092572 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575c01c680 con 0x7f5764160660 2023-06-09T04:42:30.206 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:30.202+0000 7f576b5c1700 1 -- 172.21.15.62:0/3879092572 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57640c1cd0 con 0x7f5764160660 2023-06-09T04:42:30.206 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:30.202+0000 7f576b5c1700 1 -- 172.21.15.62:0/3879092572 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57640c2290 con 0x7f5764160660 2023-06-09T04:42:30.207 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:30.202+0000 7f576b5c1700 1 -- 172.21.15.62:0/3879092572 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f576406f220 con 0x7f5764160660 2023-06-09T04:42:30.209 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:30.206+0000 7f5759ffb700 1 -- 172.21.15.62:0/3879092572 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f575c01c7e0 con 0x7f5764160660 2023-06-09T04:42:30.210 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:30.206+0000 7f5759ffb700 1 --2- 172.21.15.62:0/3879092572 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f57480662f0 0x7f57480687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:30.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:30.206+0000 7f5759ffb700 1 -- 172.21.15.62:0/3879092572 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5900+0+0 (secure 0 0 0) 0x7f575c085a80 con 0x7f5764160660 2023-06-09T04:42:30.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:30.210+0000 7f576935d700 1 --2- 172.21.15.62:0/3879092572 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f57480662f0 0x7f57480687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:30.212 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:30.210+0000 7f576935d700 1 --2- 172.21.15.62:0/3879092572 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f57480662f0 0x7f57480687a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f5760001d30 tx=0x7f5760009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:30.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:30.214+0000 7f5759ffb700 1 -- 172.21.15.62:0/3879092572 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f575c053130 con 0x7f5764160660 2023-06-09T04:42:30.399 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:30.394+0000 7f576b5c1700 1 -- 172.21.15.62:0/3879092572 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f57640c9410 con 0x7f5764160660 2023-06-09T04:42:30.984 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:30.978+0000 7f5759ffb700 1 -- 172.21.15.62:0/3879092572 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v41) v1 ==== 170+0+0 (secure 0 0 0) 0x7f575c056750 con 0x7f5764160660 2023-06-09T04:42:31.000 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:30.998+0000 7f576b5c1700 1 -- 172.21.15.62:0/3879092572 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f57480662f0 msgr2=0x7f57480687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:31.001 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:30.998+0000 7f576b5c1700 1 --2- 172.21.15.62:0/3879092572 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f57480662f0 0x7f57480687a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f5760001d30 tx=0x7f5760009040 comp rx=0 tx=0).stop 2023-06-09T04:42:31.001 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:30.998+0000 7f576b5c1700 1 -- 172.21.15.62:0/3879092572 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5764160660 msgr2=0x7f57640b1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:31.001 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:30.998+0000 7f576b5c1700 1 --2- 172.21.15.62:0/3879092572 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5764160660 0x7f57640b1a50 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f576406f540 tx=0x7f575c004af0 comp rx=0 tx=0).stop 2023-06-09T04:42:31.002 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:30.998+0000 7f576b5c1700 1 -- 172.21.15.62:0/3879092572 shutdown_connections 2023-06-09T04:42:31.002 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:30.998+0000 7f576b5c1700 1 --2- 172.21.15.62:0/3879092572 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f57480662f0 0x7f57480687a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:31.002 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:30.998+0000 7f576b5c1700 1 --2- 172.21.15.62:0/3879092572 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5764160660 0x7f57640b1a50 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:31.003 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:30.998+0000 7f576b5c1700 1 --2- 172.21.15.62:0/3879092572 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5764160290 0x7f57640c27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:31.003 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:30.998+0000 7f576b5c1700 1 --2- 172.21.15.62:0/3879092572 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f576406c480 0x7f576414fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:31.003 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:30.998+0000 7f576b5c1700 1 -- 172.21.15.62:0/3879092572 >> 172.21.15.62:0/3879092572 conn(0x7f57640697f0 msgr2=0x7f576415eb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:31.003 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:30.998+0000 7f576b5c1700 1 -- 172.21.15.62:0/3879092572 shutdown_connections 2023-06-09T04:42:31.003 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:30.998+0000 7f576b5c1700 1 -- 172.21.15.62:0/3879092572 wait complete. 2023-06-09T04:42:31.005 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_data' created 2023-06-09T04:42:31.022 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-06-09T04:42:31.206 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.202+0000 7f163e0e4700 1 Processor -- start 2023-06-09T04:42:31.206 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.202+0000 7f163e0e4700 1 -- start start 2023-06-09T04:42:31.209 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.206+0000 7f163e0e4700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f1638071730 0x7f163806f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:31.210 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.206+0000 7f163e0e4700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f163815d860 con 0x7f16380ca1c0 2023-06-09T04:42:31.210 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.206+0000 7f163e0e4700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1638071b00 con 0x7f16380b0260 2023-06-09T04:42:31.210 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.206+0000 7f163e0e4700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f163815dab0 con 0x7f1638071730 2023-06-09T04:42:31.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.206+0000 7f163c8e1700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f16380ca1c0 0x7f16380afb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:59690/0 (socket says 172.21.15.62:59690) 2023-06-09T04:42:31.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.206+0000 7f163c8e1700 1 -- 172.21.15.62:0/1785419485 learned_addr learned my addr 172.21.15.62:0/1785419485 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:42:31.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.206+0000 7f163d0e2700 1 --2- 172.21.15.62:0/1785419485 >> v2:172.21.15.89:3300/0 conn(0x7f1638071730 0x7f163806f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:31.212 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.210+0000 7f162ffff700 1 -- 172.21.15.62:0/1785419485 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2186209717 0 0) 0x7f163815d860 con 0x7f16380ca1c0 2023-06-09T04:42:31.212 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.210+0000 7f162ffff700 1 -- 172.21.15.62:0/1785419485 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16240035d0 con 0x7f16380ca1c0 2023-06-09T04:42:31.212 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.210+0000 7f162ffff700 1 -- 172.21.15.62:0/1785419485 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2258857608 0 0) 0x7f1638071b00 con 0x7f16380b0260 2023-06-09T04:42:31.212 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.210+0000 7f162ffff700 1 -- 172.21.15.62:0/1785419485 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f163815d860 con 0x7f16380b0260 2023-06-09T04:42:31.213 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.210+0000 7f163d0e2700 1 -- 172.21.15.62:0/1785419485 >> v1:172.21.15.89:6789/0 conn(0x7f16380b0260 legacy=0x7f16380c8720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:31.213 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.210+0000 7f163d0e2700 1 -- 172.21.15.62:0/1785419485 >> v1:172.21.15.62:6789/0 conn(0x7f16380ca1c0 legacy=0x7f16380afb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:31.213 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.210+0000 7f163d0e2700 1 -- 172.21.15.62:0/1785419485 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f163815dd90 con 0x7f1638071730 2023-06-09T04:42:31.214 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.210+0000 7f163d0e2700 1 --2- 172.21.15.62:0/1785419485 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1638071730 0x7f163806f610 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1634009850 tx=0x7f1634009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71367c019b36594e server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:31.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.210+0000 7f162ffff700 1 -- 172.21.15.62:0/1785419485 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1634011830 con 0x7f1638071730 2023-06-09T04:42:31.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.210+0000 7f162ffff700 1 -- 172.21.15.62:0/1785419485 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1634011990 con 0x7f1638071730 2023-06-09T04:42:31.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.210+0000 7f162ffff700 1 -- 172.21.15.62:0/1785419485 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1634011d40 con 0x7f1638071730 2023-06-09T04:42:31.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.210+0000 7f163e0e4700 1 -- 172.21.15.62:0/1785419485 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1638071730 msgr2=0x7f163806f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:31.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.210+0000 7f163e0e4700 1 --2- 172.21.15.62:0/1785419485 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1638071730 0x7f163806f610 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1634009850 tx=0x7f1634009b60 comp rx=0 tx=0).stop 2023-06-09T04:42:31.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.210+0000 7f163e0e4700 1 -- 172.21.15.62:0/1785419485 shutdown_connections 2023-06-09T04:42:31.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.210+0000 7f163e0e4700 1 --2- 172.21.15.62:0/1785419485 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1638071730 0x7f163806f610 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:31.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.210+0000 7f163e0e4700 1 -- 172.21.15.62:0/1785419485 >> 172.21.15.62:0/1785419485 conn(0x7f16380cab50 msgr2=0x7f16380caf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:31.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.210+0000 7f163e0e4700 1 -- 172.21.15.62:0/1785419485 shutdown_connections 2023-06-09T04:42:31.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.210+0000 7f163e0e4700 1 -- 172.21.15.62:0/1785419485 wait complete. 2023-06-09T04:42:31.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.214+0000 7f163e0e4700 1 Processor -- start 2023-06-09T04:42:31.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.214+0000 7f163e0e4700 1 -- start start 2023-06-09T04:42:31.219 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.214+0000 7f163e0e4700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1638071730 0x7f16381566d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:31.219 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.214+0000 7f163e0e4700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f16380b0260 0x7f16380c1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:31.219 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.214+0000 7f163e0e4700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16380ca1c0 0x7f16380ac900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:31.219 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.214+0000 7f163e0e4700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f163815cca0 con 0x7f16380b0260 2023-06-09T04:42:31.220 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.214+0000 7f163e0e4700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f163815d190 con 0x7f16380ca1c0 2023-06-09T04:42:31.220 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.214+0000 7f163e0e4700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f163815ceb0 con 0x7f1638071730 2023-06-09T04:42:31.220 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.214+0000 7f163c8e1700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f16380b0260 0x7f16380c1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:31.220 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.214+0000 7f163c8e1700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f16380b0260 0x7f16380c1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:36956/0 (socket says 172.21.15.62:36956) 2023-06-09T04:42:31.220 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.214+0000 7f163c8e1700 1 -- 172.21.15.62:0/1991743935 learned_addr learned my addr 172.21.15.62:0/1991743935 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:31.221 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.214+0000 7f163d8e3700 1 --2- 172.21.15.62:0/1991743935 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16380ca1c0 0x7f16380ac900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:31.221 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.214+0000 7f163d0e2700 1 --2- 172.21.15.62:0/1991743935 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1638071730 0x7f16381566d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:31.222 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.218+0000 7f163c8e1700 1 -- 172.21.15.62:0/1991743935 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1638071730 msgr2=0x7f16381566d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:31.222 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.218+0000 7f163c8e1700 1 --2- 172.21.15.62:0/1991743935 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1638071730 0x7f16381566d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:31.223 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.218+0000 7f163c8e1700 1 -- 172.21.15.62:0/1991743935 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16380ca1c0 msgr2=0x7f16380ac900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:31.223 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.218+0000 7f163c8e1700 1 --2- 172.21.15.62:0/1991743935 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16380ca1c0 0x7f16380ac900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:31.223 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.218+0000 7f163c8e1700 1 -- 172.21.15.62:0/1991743935 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16340094b0 con 0x7f16380b0260 2023-06-09T04:42:31.223 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.218+0000 7f163c8e1700 1 --2- 172.21.15.62:0/1991743935 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f16380b0260 0x7f16380c1bc0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f162800c560 tx=0x7f162800c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:31.223 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.218+0000 7f162dffb700 1 -- 172.21.15.62:0/1991743935 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1628005d90 con 0x7f16380b0260 2023-06-09T04:42:31.224 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.218+0000 7f162dffb700 1 -- 172.21.15.62:0/1991743935 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16280070d0 con 0x7f16380b0260 2023-06-09T04:42:31.224 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.218+0000 7f163e0e4700 1 -- 172.21.15.62:0/1991743935 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f163815b080 con 0x7f16380b0260 2023-06-09T04:42:31.224 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.218+0000 7f162dffb700 1 -- 172.21.15.62:0/1991743935 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1628007460 con 0x7f16380b0260 2023-06-09T04:42:31.224 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.218+0000 7f163e0e4700 1 -- 172.21.15.62:0/1991743935 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16381573f0 con 0x7f16380b0260 2023-06-09T04:42:31.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.218+0000 7f163e0e4700 1 -- 172.21.15.62:0/1991743935 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f163815aee0 con 0x7f16380b0260 2023-06-09T04:42:31.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.222+0000 7f162dffb700 1 -- 172.21.15.62:0/1991743935 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f16280075c0 con 0x7f16380b0260 2023-06-09T04:42:31.226 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.222+0000 7f162dffb700 1 --2- 172.21.15.62:0/1991743935 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f161c0662f0 0x7f161c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:31.226 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.222+0000 7f162dffb700 1 -- 172.21.15.62:0/1991743935 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6282+0+0 (secure 0 0 0) 0x7f1628083350 con 0x7f16380b0260 2023-06-09T04:42:31.227 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.222+0000 7f163d0e2700 1 --2- 172.21.15.62:0/1991743935 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f161c0662f0 0x7f161c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:31.228 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.226+0000 7f163d0e2700 1 --2- 172.21.15.62:0/1991743935 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f161c0662f0 0x7f161c0687a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f16340090b0 tx=0x7f163401c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:31.234 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.230+0000 7f162dffb700 1 -- 172.21.15.62:0/1991743935 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f163815aee0 con 0x7f16380b0260 2023-06-09T04:42:31.448 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.446+0000 7f163e0e4700 1 -- 172.21.15.62:0/1991743935 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f163815aee0 con 0x7f16380b0260 2023-06-09T04:42:31.463 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.458+0000 7f162dffb700 1 -- 172.21.15.62:0/1991743935 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7f163815aee0 con 0x7f16380b0260 2023-06-09T04:42:31.472 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.470+0000 7f163e0e4700 1 -- 172.21.15.62:0/1991743935 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f161c0662f0 msgr2=0x7f161c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:31.472 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.470+0000 7f163e0e4700 1 --2- 172.21.15.62:0/1991743935 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f161c0662f0 0x7f161c0687a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f16340090b0 tx=0x7f163401c040 comp rx=0 tx=0).stop 2023-06-09T04:42:31.472 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.470+0000 7f163e0e4700 1 -- 172.21.15.62:0/1991743935 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f16380b0260 msgr2=0x7f16380c1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:31.473 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.470+0000 7f163e0e4700 1 --2- 172.21.15.62:0/1991743935 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f16380b0260 0x7f16380c1bc0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f162800c560 tx=0x7f162800c870 comp rx=0 tx=0).stop 2023-06-09T04:42:31.475 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.474+0000 7f163e0e4700 1 -- 172.21.15.62:0/1991743935 shutdown_connections 2023-06-09T04:42:31.475 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.474+0000 7f163e0e4700 1 --2- 172.21.15.62:0/1991743935 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f161c0662f0 0x7f161c0687a0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:31.475 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.474+0000 7f163e0e4700 1 --2- 172.21.15.62:0/1991743935 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16380ca1c0 0x7f16380ac900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:31.475 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.474+0000 7f163e0e4700 1 --2- 172.21.15.62:0/1991743935 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f16380b0260 0x7f16380c1bc0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:31.476 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.474+0000 7f163e0e4700 1 --2- 172.21.15.62:0/1991743935 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f1638071730 0x7f16381566d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:31.476 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.474+0000 7f163e0e4700 1 -- 172.21.15.62:0/1991743935 >> 172.21.15.62:0/1991743935 conn(0x7f16380cab50 msgr2=0x7f1638070f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:31.476 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.474+0000 7f163e0e4700 1 -- 172.21.15.62:0/1991743935 shutdown_connections 2023-06-09T04:42:31.476 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.474+0000 7f163e0e4700 1 -- 172.21.15.62:0/1991743935 wait complete. 2023-06-09T04:42:31.479 INFO:teuthology.orchestra.run.smithi062.stderr:new fs with metadata pool 6 and data pool 7 2023-06-09T04:42:31.513 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:42:31.682 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.678+0000 7f7bda29f700 1 Processor -- start 2023-06-09T04:42:31.682 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.678+0000 7f7bda29f700 1 -- start start 2023-06-09T04:42:31.685 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.682+0000 7f7bda29f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7bd4160340 0x7f7bd40caa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:31.685 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.682+0000 7f7bda29f700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bd40cdc20 con 0x7f7bd40caf80 2023-06-09T04:42:31.686 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.682+0000 7f7bda29f700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bd40cd330 con 0x7f7bd415ff70 2023-06-09T04:42:31.686 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.682+0000 7f7bda29f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd40cb400 con 0x7f7bd4160340 2023-06-09T04:42:31.686 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.682+0000 7f7bd9a9e700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f7bd40caf80 0x7f7bd4163df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:59706/0 (socket says 172.21.15.62:59706) 2023-06-09T04:42:31.686 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.682+0000 7f7bd9a9e700 1 -- 172.21.15.62:0/900362388 learned_addr learned my addr 172.21.15.62:0/900362388 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:42:31.687 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.682+0000 7f7bd8a9c700 1 --2- 172.21.15.62:0/900362388 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7bd4160340 0x7f7bd40caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:31.687 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.682+0000 7f7bcbfff700 1 -- 172.21.15.62:0/900362388 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2305383211 0 0) 0x7f7bd40cdc20 con 0x7f7bd40caf80 2023-06-09T04:42:31.687 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.682+0000 7f7bd8a9c700 1 -- 172.21.15.62:0/900362388 >> v1:172.21.15.89:6789/0 conn(0x7f7bd415ff70 legacy=0x7f7bd40c9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:31.687 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.682+0000 7f7bd8a9c700 1 -- 172.21.15.62:0/900362388 >> v1:172.21.15.62:6789/0 conn(0x7f7bd40caf80 legacy=0x7f7bd4163df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:31.688 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.682+0000 7f7bd8a9c700 1 -- 172.21.15.62:0/900362388 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bd40cd5d0 con 0x7f7bd4160340 2023-06-09T04:42:31.688 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.686+0000 7f7bd8a9c700 1 --2- 172.21.15.62:0/900362388 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7bd4160340 0x7f7bd40caa40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7bc4009880 tx=0x7f7bc4009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25573126695bd3f server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:31.688 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.686+0000 7f7bcbfff700 1 -- 172.21.15.62:0/900362388 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc4011830 con 0x7f7bd4160340 2023-06-09T04:42:31.689 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.686+0000 7f7bcbfff700 1 -- 172.21.15.62:0/900362388 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bc4011990 con 0x7f7bd4160340 2023-06-09T04:42:31.689 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.686+0000 7f7bcbfff700 1 -- 172.21.15.62:0/900362388 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc4011d20 con 0x7f7bd4160340 2023-06-09T04:42:31.689 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.686+0000 7f7bda29f700 1 -- 172.21.15.62:0/900362388 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7bd4160340 msgr2=0x7f7bd40caa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:31.690 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.686+0000 7f7bda29f700 1 --2- 172.21.15.62:0/900362388 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7bd4160340 0x7f7bd40caa40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7bc4009880 tx=0x7f7bc4009b90 comp rx=0 tx=0).stop 2023-06-09T04:42:31.690 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.686+0000 7f7bda29f700 1 -- 172.21.15.62:0/900362388 shutdown_connections 2023-06-09T04:42:31.690 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.686+0000 7f7bda29f700 1 --2- 172.21.15.62:0/900362388 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7bd4160340 0x7f7bd40caa40 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:31.690 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.686+0000 7f7bda29f700 1 -- 172.21.15.62:0/900362388 >> 172.21.15.62:0/900362388 conn(0x7f7bd406a420 msgr2=0x7f7bd40afc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:31.690 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.686+0000 7f7bda29f700 1 -- 172.21.15.62:0/900362388 shutdown_connections 2023-06-09T04:42:31.690 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.686+0000 7f7bda29f700 1 -- 172.21.15.62:0/900362388 wait complete. 2023-06-09T04:42:31.692 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.690+0000 7f7bda29f700 1 Processor -- start 2023-06-09T04:42:31.692 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.690+0000 7f7bda29f700 1 -- start start 2023-06-09T04:42:31.694 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.690+0000 7f7bda29f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bd415ff70 0x7f7bd40b39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:31.694 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.690+0000 7f7bda29f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7bd4160340 0x7f7bd41547e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:31.694 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.690+0000 7f7bda29f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7bd40c6d90 0x7f7bd4162820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:31.695 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.690+0000 7f7bda29f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd40b3f20 con 0x7f7bd415ff70 2023-06-09T04:42:31.695 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.690+0000 7f7bda29f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd4154d20 con 0x7f7bd4160340 2023-06-09T04:42:31.695 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.690+0000 7f7bda29f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd40c78f0 con 0x7f7bd40c6d90 2023-06-09T04:42:31.696 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.690+0000 7f7bd929d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bd415ff70 0x7f7bd40b39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:31.696 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.690+0000 7f7bd929d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bd415ff70 0x7f7bd40b39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:36958/0 (socket says 172.21.15.62:36958) 2023-06-09T04:42:31.696 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.690+0000 7f7bd929d700 1 -- 172.21.15.62:0/1644583509 learned_addr learned my addr 172.21.15.62:0/1644583509 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:31.696 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.690+0000 7f7bd9a9e700 1 --2- 172.21.15.62:0/1644583509 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7bd40c6d90 0x7f7bd4162820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:31.697 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.694+0000 7f7bd8a9c700 1 --2- 172.21.15.62:0/1644583509 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7bd4160340 0x7f7bd41547e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:31.697 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.694+0000 7f7bd929d700 1 -- 172.21.15.62:0/1644583509 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7bd40c6d90 msgr2=0x7f7bd4162820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:31.697 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.694+0000 7f7bd929d700 1 --2- 172.21.15.62:0/1644583509 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7bd40c6d90 0x7f7bd4162820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:31.697 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.694+0000 7f7bd929d700 1 -- 172.21.15.62:0/1644583509 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7bd4160340 msgr2=0x7f7bd41547e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:31.697 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.694+0000 7f7bd929d700 1 --2- 172.21.15.62:0/1644583509 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7bd4160340 0x7f7bd41547e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:31.697 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.694+0000 7f7bd929d700 1 -- 172.21.15.62:0/1644583509 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc40094b0 con 0x7f7bd415ff70 2023-06-09T04:42:31.697 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.694+0000 7f7bd9a9e700 1 --2- 172.21.15.62:0/1644583509 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7bd40c6d90 0x7f7bd4162820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:31.698 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.694+0000 7f7bd929d700 1 --2- 172.21.15.62:0/1644583509 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bd415ff70 0x7f7bd40b39e0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f7bd000c500 tx=0x7f7bd000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:31.698 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.694+0000 7f7bc9ffb700 1 -- 172.21.15.62:0/1644583509 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd00052d0 con 0x7f7bd415ff70 2023-06-09T04:42:31.698 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.694+0000 7f7bc9ffb700 1 -- 172.21.15.62:0/1644583509 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bd0005430 con 0x7f7bd415ff70 2023-06-09T04:42:31.698 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.694+0000 7f7bda29f700 1 -- 172.21.15.62:0/1644583509 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bd40c7330 con 0x7f7bd415ff70 2023-06-09T04:42:31.698 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.694+0000 7f7bc9ffb700 1 -- 172.21.15.62:0/1644583509 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd00055a0 con 0x7f7bd415ff70 2023-06-09T04:42:31.705 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.694+0000 7f7bda29f700 1 -- 172.21.15.62:0/1644583509 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bd4160820 con 0x7f7bd415ff70 2023-06-09T04:42:31.705 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.694+0000 7f7bda29f700 1 -- 172.21.15.62:0/1644583509 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bd40739c0 con 0x7f7bd415ff70 2023-06-09T04:42:31.705 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.694+0000 7f7bc9ffb700 1 -- 172.21.15.62:0/1644583509 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f7bd00038e0 con 0x7f7bd415ff70 2023-06-09T04:42:31.705 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.698+0000 7f7bc9ffb700 1 --2- 172.21.15.62:0/1644583509 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f7bb80662f0 0x7f7bb80687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:31.705 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.698+0000 7f7bc9ffb700 1 -- 172.21.15.62:0/1644583509 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f7bd00833e0 con 0x7f7bd415ff70 2023-06-09T04:42:31.705 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.698+0000 7f7bd8a9c700 1 --2- 172.21.15.62:0/1644583509 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f7bb80662f0 0x7f7bb80687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:31.706 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.698+0000 7f7bd8a9c700 1 --2- 172.21.15.62:0/1644583509 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f7bb80662f0 0x7f7bb80687a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7bd4160750 tx=0x7f7bc4008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:31.706 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.702+0000 7f7bc9ffb700 1 -- 172.21.15.62:0/1644583509 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f7bd0050680 con 0x7f7bd415ff70 2023-06-09T04:42:31.883 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.878+0000 7f7bda29f700 1 -- 172.21.15.62:0/1644583509 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7bd406cd20 con 0x7f7bd415ff70 2023-06-09T04:42:31.886 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.882+0000 7f7bc9ffb700 1 -- 172.21.15.62:0/1644583509 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+18477 (secure 0 0 0) 0x7f7bd0053ca0 con 0x7f7bd415ff70 2023-06-09T04:42:31.887 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:42:31.887 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":42,"fsid":"f7998a1e-e5a9-4202-abaa-70c0eaae1047","created":"2023-06-09T04:40:30.469588+0000","modified":"2023-06-09T04:42:31.448917+0000","last_up_change":"2023-06-09T04:40:43.120747+0000","last_in_change":"2023-06-09T04:40:33.568221+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:40:44.646921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:40:50.006643+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:42:29.603206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-06-09T04:42:30.461627+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bc50bbc0-dd08-42ed-804c-ec3029e36c19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6802","nonce":1295788017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6807","nonce":1295788017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6815","nonce":1295788017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6809","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6811","nonce":1295788017}]},"public_addr":"172.21.15.62:6802/1295788017","cluster_addr":"172.21.15.62:6807/1295788017","heartbeat_back_addr":"172.21.15.62:6815/1295788017","heartbeat_front_addr":"172.21.15.62:6811/1295788017","state":["exists","up"]},{"osd":1,"uuid":"8230b12d-e22f-4985-a584-4cc64404cdbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6825","nonce":4120692006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6827","nonce":4120692006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6831","nonce":4120692006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6829","nonce":4120692006}]},"public_addr":"172.21.15.62:6825/4120692006","cluster_addr":"172.21.15.62:6827/4120692006","heartbeat_back_addr":"172.21.15.62:6831/4120692006","heartbeat_front_addr":"172.21.15.62:6829/4120692006","state":["exists","up"]},{"osd":2,"uuid":"d0202506-dbe9-4e3c-9271-687929abf96a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6801","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6803","nonce":4169607876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6805","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6806","nonce":4169607876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6814","nonce":4169607876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6810","nonce":4169607876}]},"public_addr":"172.21.15.62:6803/4169607876","cluster_addr":"172.21.15.62:6806/4169607876","heartbeat_back_addr":"172.21.15.62:6814/4169607876","heartbeat_front_addr":"172.21.15.62:6810/4169607876","state":["exists","up"]},{"osd":3,"uuid":"f3c0298a-b075-4411-af50-e16cd74fdddb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6817","nonce":3268438986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6819","nonce":3268438986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6823","nonce":3268438986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6821","nonce":3268438986}]},"public_addr":"172.21.15.62:6817/3268438986","cluster_addr":"172.21.15.62:6819/3268438986","heartbeat_back_addr":"172.21.15.62:6823/3268438986","heartbeat_front_addr":"172.21.15.62:6821/3268438986","state":["exists","up"]},{"osd":4,"uuid":"1ab5c5ca-e74f-475a-a309-683cc0029928","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6817","nonce":3139617628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6819","nonce":3139617628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6823","nonce":3139617628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6821","nonce":3139617628}]},"public_addr":"172.21.15.89:6817/3139617628","cluster_addr":"172.21.15.89:6819/3139617628","heartbeat_back_addr":"172.21.15.89:6823/3139617628","heartbeat_front_addr":"172.21.15.89:6821/3139617628","state":["exists","up"]},{"osd":5,"uuid":"a933e184-bd8f-4369-a1ba-a68de53c578c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6825","nonce":2681723596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6827","nonce":2681723596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6831","nonce":2681723596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6829","nonce":2681723596}]},"public_addr":"172.21.15.89:6825/2681723596","cluster_addr":"172.21.15.89:6827/2681723596","heartbeat_back_addr":"172.21.15.89:6831/2681723596","heartbeat_front_addr":"172.21.15.89:6829/2681723596","state":["exists","up"]},{"osd":6,"uuid":"1ed7ad37-2eee-49a6-954c-b537e2b7f0ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6809","nonce":1657136033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6811","nonce":1657136033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6815","nonce":1657136033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6813","nonce":1657136033}]},"public_addr":"172.21.15.89:6809/1657136033","cluster_addr":"172.21.15.89:6811/1657136033","heartbeat_back_addr":"172.21.15.89:6815/1657136033","heartbeat_front_addr":"172.21.15.89:6813/1657136033","state":["exists","up"]},{"osd":7,"uuid":"6ed732e9-33ff-40df-9038-a9f1d1622671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6801","nonce":1710561686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6803","nonce":1710561686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6807","nonce":1710561686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6805","nonce":1710561686}]},"public_addr":"172.21.15.89:6801/1710561686","cluster_addr":"172.21.15.89:6803/1710561686","heartbeat_back_addr":"172.21.15.89:6807/1710561686","heartbeat_front_addr":"172.21.15.89:6805/1710561686","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.335803+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.419788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.179334+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.263310+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.071846+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.375627+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.282277+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.315997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:42:31.891 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.886+0000 7f7bda29f700 1 -- 172.21.15.62:0/1644583509 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f7bb80662f0 msgr2=0x7f7bb80687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:31.891 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.886+0000 7f7bda29f700 1 --2- 172.21.15.62:0/1644583509 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f7bb80662f0 0x7f7bb80687a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7bd4160750 tx=0x7f7bc4008030 comp rx=0 tx=0).stop 2023-06-09T04:42:31.891 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.886+0000 7f7bda29f700 1 -- 172.21.15.62:0/1644583509 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bd415ff70 msgr2=0x7f7bd40b39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:31.892 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.886+0000 7f7bda29f700 1 --2- 172.21.15.62:0/1644583509 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bd415ff70 0x7f7bd40b39e0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f7bd000c500 tx=0x7f7bd000c8c0 comp rx=0 tx=0).stop 2023-06-09T04:42:31.892 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.890+0000 7f7bda29f700 1 -- 172.21.15.62:0/1644583509 shutdown_connections 2023-06-09T04:42:31.892 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.890+0000 7f7bda29f700 1 --2- 172.21.15.62:0/1644583509 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f7bb80662f0 0x7f7bb80687a0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:31.892 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.890+0000 7f7bda29f700 1 --2- 172.21.15.62:0/1644583509 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f7bd40c6d90 0x7f7bd4162820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:31.892 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.890+0000 7f7bda29f700 1 --2- 172.21.15.62:0/1644583509 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7bd4160340 0x7f7bd41547e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:31.892 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.890+0000 7f7bda29f700 1 --2- 172.21.15.62:0/1644583509 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bd415ff70 0x7f7bd40b39e0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:31.893 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.890+0000 7f7bda29f700 1 -- 172.21.15.62:0/1644583509 >> 172.21.15.62:0/1644583509 conn(0x7f7bd40caf80 msgr2=0x7f7bd40cbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:31.893 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.890+0000 7f7bda29f700 1 -- 172.21.15.62:0/1644583509 shutdown_connections 2023-06-09T04:42:31.893 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:31.890+0000 7f7bda29f700 1 -- 172.21.15.62:0/1644583509 wait complete. 2023-06-09T04:42:31.912 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:42:32.089 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.086+0000 7f4e65262700 1 Processor -- start 2023-06-09T04:42:32.089 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.086+0000 7f4e65262700 1 -- start start 2023-06-09T04:42:32.091 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.086+0000 7f4e65262700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4e600cb850 0x7f4e600ca160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:32.091 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.086+0000 7f4e65262700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4e600b08d0 0x7f4e600ca6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:32.091 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.086+0000 7f4e65262700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e6006f9b0 con 0x7f4e60159c90 2023-06-09T04:42:32.091 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.086+0000 7f4e65262700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e6006b960 con 0x7f4e600b08d0 2023-06-09T04:42:32.091 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.086+0000 7f4e65262700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6015a060 con 0x7f4e600cb850 2023-06-09T04:42:32.092 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.090+0000 7f4e5effd700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f4e60159c90 0x7f4e60070e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:59722/0 (socket says 172.21.15.62:59722) 2023-06-09T04:42:32.092 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.090+0000 7f4e5effd700 1 -- 172.21.15.62:0/1536571915 learned_addr learned my addr 172.21.15.62:0/1536571915 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:42:32.092 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.090+0000 7f4e5e7fc700 1 --2- 172.21.15.62:0/1536571915 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4e600cb850 0x7f4e600ca160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:32.092 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.090+0000 7f4e5f7fe700 1 --2- 172.21.15.62:0/1536571915 >> v2:172.21.15.62:3300/0 conn(0x7f4e600b08d0 0x7f4e600ca6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:32.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.090+0000 7f4e5dffb700 1 -- 172.21.15.62:0/1536571915 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1102601203 0 0) 0x7f4e6006f9b0 con 0x7f4e60159c90 2023-06-09T04:42:32.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.090+0000 7f4e5dffb700 1 -- 172.21.15.62:0/1536571915 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e480035d0 con 0x7f4e60159c90 2023-06-09T04:42:32.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.090+0000 7f4e5e7fc700 1 -- 172.21.15.62:0/1536571915 >> v2:172.21.15.62:3300/0 conn(0x7f4e600b08d0 msgr2=0x7f4e600ca6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:32.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.090+0000 7f4e5e7fc700 1 --2- 172.21.15.62:0/1536571915 >> v2:172.21.15.62:3300/0 conn(0x7f4e600b08d0 0x7f4e600ca6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:32.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.090+0000 7f4e5e7fc700 1 -- 172.21.15.62:0/1536571915 >> v1:172.21.15.62:6789/0 conn(0x7f4e60159c90 legacy=0x7f4e60070e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:32.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.090+0000 7f4e5e7fc700 1 -- 172.21.15.62:0/1536571915 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e600c89e0 con 0x7f4e600cb850 2023-06-09T04:42:32.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.090+0000 7f4e5e7fc700 1 --2- 172.21.15.62:0/1536571915 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4e600cb850 0x7f4e600ca160 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4e54009850 tx=0x7f4e54009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c93428add9e7e986 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:32.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.090+0000 7f4e5dffb700 1 -- 172.21.15.62:0/1536571915 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e54011830 con 0x7f4e600cb850 2023-06-09T04:42:32.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.090+0000 7f4e5dffb700 1 -- 172.21.15.62:0/1536571915 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e54011990 con 0x7f4e600cb850 2023-06-09T04:42:32.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.090+0000 7f4e5dffb700 1 -- 172.21.15.62:0/1536571915 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e54011d40 con 0x7f4e600cb850 2023-06-09T04:42:32.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.090+0000 7f4e65262700 1 -- 172.21.15.62:0/1536571915 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4e600cb850 msgr2=0x7f4e600ca160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:32.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.090+0000 7f4e65262700 1 --2- 172.21.15.62:0/1536571915 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4e600cb850 0x7f4e600ca160 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4e54009850 tx=0x7f4e54009b60 comp rx=0 tx=0).stop 2023-06-09T04:42:32.096 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.090+0000 7f4e65262700 1 -- 172.21.15.62:0/1536571915 shutdown_connections 2023-06-09T04:42:32.096 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.090+0000 7f4e65262700 1 --2- 172.21.15.62:0/1536571915 >> v2:172.21.15.62:3300/0 conn(0x7f4e600b08d0 0x7f4e600ca6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:32.096 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.090+0000 7f4e65262700 1 --2- 172.21.15.62:0/1536571915 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4e600cb850 0x7f4e600ca160 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:32.096 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.090+0000 7f4e65262700 1 -- 172.21.15.62:0/1536571915 >> 172.21.15.62:0/1536571915 conn(0x7f4e6006a410 msgr2=0x7f4e600afd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:32.096 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.090+0000 7f4e65262700 1 -- 172.21.15.62:0/1536571915 shutdown_connections 2023-06-09T04:42:32.096 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.090+0000 7f4e65262700 1 -- 172.21.15.62:0/1536571915 wait complete. 2023-06-09T04:42:32.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.094+0000 7f4e65262700 1 Processor -- start 2023-06-09T04:42:32.098 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.094+0000 7f4e65262700 1 -- start start 2023-06-09T04:42:32.099 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.098+0000 7f4e65262700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4e600b08d0 0x7f4e600ab8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:32.099 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.098+0000 7f4e65262700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e600cb850 0x7f4e60152a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:32.100 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.098+0000 7f4e65262700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4e60159c90 0x7f4e601f15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:32.100 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.098+0000 7f4e65262700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e600acbc0 con 0x7f4e60159c90 2023-06-09T04:42:32.100 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.098+0000 7f4e65262700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e600abf40 con 0x7f4e600cb850 2023-06-09T04:42:32.100 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.098+0000 7f4e65262700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e600ac220 con 0x7f4e600b08d0 2023-06-09T04:42:32.101 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.098+0000 7f4e5f7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4e60159c90 0x7f4e601f15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:32.102 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.098+0000 7f4e5f7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4e60159c90 0x7f4e601f15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:36970/0 (socket says 172.21.15.62:36970) 2023-06-09T04:42:32.103 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.098+0000 7f4e5f7fe700 1 -- 172.21.15.62:0/2906320596 learned_addr learned my addr 172.21.15.62:0/2906320596 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:32.103 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.098+0000 7f4e5e7fc700 1 --2- 172.21.15.62:0/2906320596 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e600cb850 0x7f4e60152a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:32.103 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.098+0000 7f4e5effd700 1 --2- 172.21.15.62:0/2906320596 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4e600b08d0 0x7f4e600ab8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:32.103 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.098+0000 7f4e5f7fe700 1 -- 172.21.15.62:0/2906320596 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4e600b08d0 msgr2=0x7f4e600ab8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:32.103 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.098+0000 7f4e5f7fe700 1 --2- 172.21.15.62:0/2906320596 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4e600b08d0 0x7f4e600ab8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:32.103 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.098+0000 7f4e5f7fe700 1 -- 172.21.15.62:0/2906320596 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e600cb850 msgr2=0x7f4e60152a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:32.103 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.098+0000 7f4e5f7fe700 1 --2- 172.21.15.62:0/2906320596 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e600cb850 0x7f4e60152a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:32.104 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.098+0000 7f4e5f7fe700 1 -- 172.21.15.62:0/2906320596 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e540094b0 con 0x7f4e60159c90 2023-06-09T04:42:32.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.098+0000 7f4e5f7fe700 1 --2- 172.21.15.62:0/2906320596 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4e60159c90 0x7f4e601f15d0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f4e5800efc0 tx=0x7f4e5800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:32.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.098+0000 7f4e477fe700 1 -- 172.21.15.62:0/2906320596 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e58009ea0 con 0x7f4e60159c90 2023-06-09T04:42:32.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.098+0000 7f4e477fe700 1 -- 172.21.15.62:0/2906320596 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e5800f040 con 0x7f4e60159c90 2023-06-09T04:42:32.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.098+0000 7f4e65262700 1 -- 172.21.15.62:0/2906320596 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e600ac500 con 0x7f4e60159c90 2023-06-09T04:42:32.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.098+0000 7f4e477fe700 1 -- 172.21.15.62:0/2906320596 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5800ced0 con 0x7f4e60159c90 2023-06-09T04:42:32.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.098+0000 7f4e65262700 1 -- 172.21.15.62:0/2906320596 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e60152fc0 con 0x7f4e60159c90 2023-06-09T04:42:32.106 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.102+0000 7f4e65262700 1 -- 172.21.15.62:0/2906320596 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e6004db30 con 0x7f4e60159c90 2023-06-09T04:42:32.106 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.102+0000 7f4e477fe700 1 -- 172.21.15.62:0/2906320596 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4e58014480 con 0x7f4e60159c90 2023-06-09T04:42:32.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.106+0000 7f4e477fe700 1 --2- 172.21.15.62:0/2906320596 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f4e4c0662f0 0x7f4e4c0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:32.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.106+0000 7f4e477fe700 1 -- 172.21.15.62:0/2906320596 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f4e58084660 con 0x7f4e60159c90 2023-06-09T04:42:32.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.106+0000 7f4e5effd700 1 --2- 172.21.15.62:0/2906320596 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f4e4c0662f0 0x7f4e4c0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:32.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.106+0000 7f4e5effd700 1 --2- 172.21.15.62:0/2906320596 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f4e4c0662f0 0x7f4e4c0687a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4e50007fd0 tx=0x7f4e50007de0 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:32.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.110+0000 7f4e477fe700 1 -- 172.21.15.62:0/2906320596 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f4e58051a40 con 0x7f4e60159c90 2023-06-09T04:42:32.286 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.282+0000 7f4e65262700 1 -- 172.21.15.62:0/2906320596 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4e600c5010 con 0x7f4e60159c90 2023-06-09T04:42:32.288 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.286+0000 7f4e477fe700 1 -- 172.21.15.62:0/2906320596 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+18477 (secure 0 0 0) 0x7f4e58055060 con 0x7f4e60159c90 2023-06-09T04:42:32.289 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:42:32.289 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":42,"fsid":"f7998a1e-e5a9-4202-abaa-70c0eaae1047","created":"2023-06-09T04:40:30.469588+0000","modified":"2023-06-09T04:42:31.448917+0000","last_up_change":"2023-06-09T04:40:43.120747+0000","last_in_change":"2023-06-09T04:40:33.568221+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:40:44.646921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:40:50.006643+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:42:29.603206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-06-09T04:42:30.461627+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bc50bbc0-dd08-42ed-804c-ec3029e36c19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6802","nonce":1295788017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6807","nonce":1295788017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6815","nonce":1295788017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6809","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6811","nonce":1295788017}]},"public_addr":"172.21.15.62:6802/1295788017","cluster_addr":"172.21.15.62:6807/1295788017","heartbeat_back_addr":"172.21.15.62:6815/1295788017","heartbeat_front_addr":"172.21.15.62:6811/1295788017","state":["exists","up"]},{"osd":1,"uuid":"8230b12d-e22f-4985-a584-4cc64404cdbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6825","nonce":4120692006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6827","nonce":4120692006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6831","nonce":4120692006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6829","nonce":4120692006}]},"public_addr":"172.21.15.62:6825/4120692006","cluster_addr":"172.21.15.62:6827/4120692006","heartbeat_back_addr":"172.21.15.62:6831/4120692006","heartbeat_front_addr":"172.21.15.62:6829/4120692006","state":["exists","up"]},{"osd":2,"uuid":"d0202506-dbe9-4e3c-9271-687929abf96a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6801","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6803","nonce":4169607876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6805","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6806","nonce":4169607876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6814","nonce":4169607876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6810","nonce":4169607876}]},"public_addr":"172.21.15.62:6803/4169607876","cluster_addr":"172.21.15.62:6806/4169607876","heartbeat_back_addr":"172.21.15.62:6814/4169607876","heartbeat_front_addr":"172.21.15.62:6810/4169607876","state":["exists","up"]},{"osd":3,"uuid":"f3c0298a-b075-4411-af50-e16cd74fdddb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6817","nonce":3268438986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6819","nonce":3268438986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6823","nonce":3268438986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6821","nonce":3268438986}]},"public_addr":"172.21.15.62:6817/3268438986","cluster_addr":"172.21.15.62:6819/3268438986","heartbeat_back_addr":"172.21.15.62:6823/3268438986","heartbeat_front_addr":"172.21.15.62:6821/3268438986","state":["exists","up"]},{"osd":4,"uuid":"1ab5c5ca-e74f-475a-a309-683cc0029928","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6817","nonce":3139617628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6819","nonce":3139617628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6823","nonce":3139617628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6821","nonce":3139617628}]},"public_addr":"172.21.15.89:6817/3139617628","cluster_addr":"172.21.15.89:6819/3139617628","heartbeat_back_addr":"172.21.15.89:6823/3139617628","heartbeat_front_addr":"172.21.15.89:6821/3139617628","state":["exists","up"]},{"osd":5,"uuid":"a933e184-bd8f-4369-a1ba-a68de53c578c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6825","nonce":2681723596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6827","nonce":2681723596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6831","nonce":2681723596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6829","nonce":2681723596}]},"public_addr":"172.21.15.89:6825/2681723596","cluster_addr":"172.21.15.89:6827/2681723596","heartbeat_back_addr":"172.21.15.89:6831/2681723596","heartbeat_front_addr":"172.21.15.89:6829/2681723596","state":["exists","up"]},{"osd":6,"uuid":"1ed7ad37-2eee-49a6-954c-b537e2b7f0ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6809","nonce":1657136033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6811","nonce":1657136033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6815","nonce":1657136033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6813","nonce":1657136033}]},"public_addr":"172.21.15.89:6809/1657136033","cluster_addr":"172.21.15.89:6811/1657136033","heartbeat_back_addr":"172.21.15.89:6815/1657136033","heartbeat_front_addr":"172.21.15.89:6813/1657136033","state":["exists","up"]},{"osd":7,"uuid":"6ed732e9-33ff-40df-9038-a9f1d1622671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6801","nonce":1710561686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6803","nonce":1710561686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6807","nonce":1710561686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6805","nonce":1710561686}]},"public_addr":"172.21.15.89:6801/1710561686","cluster_addr":"172.21.15.89:6803/1710561686","heartbeat_back_addr":"172.21.15.89:6807/1710561686","heartbeat_front_addr":"172.21.15.89:6805/1710561686","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.335803+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.419788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.179334+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.263310+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.071846+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.375627+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.282277+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.315997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:42:32.291 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.290+0000 7f4e65262700 1 -- 172.21.15.62:0/2906320596 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f4e4c0662f0 msgr2=0x7f4e4c0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:32.292 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.290+0000 7f4e65262700 1 --2- 172.21.15.62:0/2906320596 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f4e4c0662f0 0x7f4e4c0687a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4e50007fd0 tx=0x7f4e50007de0 comp rx=0 tx=0).stop 2023-06-09T04:42:32.292 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.290+0000 7f4e65262700 1 -- 172.21.15.62:0/2906320596 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4e60159c90 msgr2=0x7f4e601f15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:32.292 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.290+0000 7f4e65262700 1 --2- 172.21.15.62:0/2906320596 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4e60159c90 0x7f4e601f15d0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f4e5800efc0 tx=0x7f4e5800c3a0 comp rx=0 tx=0).stop 2023-06-09T04:42:32.292 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.290+0000 7f4e65262700 1 -- 172.21.15.62:0/2906320596 shutdown_connections 2023-06-09T04:42:32.292 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.290+0000 7f4e65262700 1 --2- 172.21.15.62:0/2906320596 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f4e4c0662f0 0x7f4e4c0687a0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:32.292 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.290+0000 7f4e65262700 1 --2- 172.21.15.62:0/2906320596 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4e60159c90 0x7f4e601f15d0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:32.293 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.290+0000 7f4e65262700 1 --2- 172.21.15.62:0/2906320596 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4e600cb850 0x7f4e60152a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:32.293 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.290+0000 7f4e65262700 1 --2- 172.21.15.62:0/2906320596 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f4e600b08d0 0x7f4e600ab8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:32.293 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.290+0000 7f4e65262700 1 -- 172.21.15.62:0/2906320596 >> 172.21.15.62:0/2906320596 conn(0x7f4e6006a410 msgr2=0x7f4e601575b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:32.293 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.290+0000 7f4e65262700 1 -- 172.21.15.62:0/2906320596 shutdown_connections 2023-06-09T04:42:32.293 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.290+0000 7f4e65262700 1 -- 172.21.15.62:0/2906320596 wait complete. 2023-06-09T04:42:32.314 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-06-09T04:42:32.487 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.486+0000 7fb8d359e700 1 Processor -- start 2023-06-09T04:42:32.488 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.486+0000 7fb8d359e700 1 -- start start 2023-06-09T04:42:32.490 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.486+0000 7fb8d359e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb8d40b55b0 0x7fb8d40ca8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:32.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.486+0000 7fb8d359e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8d40cd670 con 0x7fb8d415ab60 2023-06-09T04:42:32.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.486+0000 7fb8d359e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8d40cd0e0 con 0x7fb8d40ccc90 2023-06-09T04:42:32.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.486+0000 7fb8d359e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d40cd390 con 0x7fb8d40b55b0 2023-06-09T04:42:32.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.486+0000 7fb8d2d9d700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fb8d415ab60 0x7fb8d415c210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:59738/0 (socket says 172.21.15.62:59738) 2023-06-09T04:42:32.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.486+0000 7fb8d2d9d700 1 -- 172.21.15.62:0/3686639788 learned_addr learned my addr 172.21.15.62:0/3686639788 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:42:32.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.486+0000 7fb8d259c700 1 --2- 172.21.15.62:0/3686639788 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb8d40b55b0 0x7fb8d40ca8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:32.492 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.490+0000 7fb8d159a700 1 -- 172.21.15.62:0/3686639788 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1952587972 0 0) 0x7fb8d40cd0e0 con 0x7fb8d40ccc90 2023-06-09T04:42:32.492 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.490+0000 7fb8d159a700 1 -- 172.21.15.62:0/3686639788 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8bc0035d0 con 0x7fb8d40ccc90 2023-06-09T04:42:32.493 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.490+0000 7fb8d159a700 1 -- 172.21.15.62:0/3686639788 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4092713853 0 0) 0x7fb8d40cd670 con 0x7fb8d415ab60 2023-06-09T04:42:32.493 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.490+0000 7fb8d159a700 1 -- 172.21.15.62:0/3686639788 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8d40cd0e0 con 0x7fb8d415ab60 2023-06-09T04:42:32.493 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.490+0000 7fb8d259c700 1 -- 172.21.15.62:0/3686639788 >> v1:172.21.15.89:6789/0 conn(0x7fb8d40ccc90 legacy=0x7fb8d415a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:32.493 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.490+0000 7fb8d259c700 1 -- 172.21.15.62:0/3686639788 >> v1:172.21.15.62:6789/0 conn(0x7fb8d415ab60 legacy=0x7fb8d415c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:32.493 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.490+0000 7fb8d259c700 1 -- 172.21.15.62:0/3686639788 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8d415b730 con 0x7fb8d40b55b0 2023-06-09T04:42:32.493 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.490+0000 7fb8d259c700 1 --2- 172.21.15.62:0/3686639788 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb8d40b55b0 0x7fb8d40ca8b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb8c4009880 tx=0x7fb8c4009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f835aeb3b7ee6cc5 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:32.494 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.490+0000 7fb8d159a700 1 -- 172.21.15.62:0/3686639788 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c4011830 con 0x7fb8d40b55b0 2023-06-09T04:42:32.494 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.490+0000 7fb8d159a700 1 -- 172.21.15.62:0/3686639788 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8c4011990 con 0x7fb8d40b55b0 2023-06-09T04:42:32.494 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.490+0000 7fb8d159a700 1 -- 172.21.15.62:0/3686639788 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c4011d20 con 0x7fb8d40b55b0 2023-06-09T04:42:32.494 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.490+0000 7fb8d359e700 1 -- 172.21.15.62:0/3686639788 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb8d40b55b0 msgr2=0x7fb8d40ca8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:32.494 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.490+0000 7fb8d359e700 1 --2- 172.21.15.62:0/3686639788 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb8d40b55b0 0x7fb8d40ca8b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb8c4009880 tx=0x7fb8c4009b90 comp rx=0 tx=0).stop 2023-06-09T04:42:32.495 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.490+0000 7fb8d359e700 1 -- 172.21.15.62:0/3686639788 shutdown_connections 2023-06-09T04:42:32.495 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.490+0000 7fb8d359e700 1 --2- 172.21.15.62:0/3686639788 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb8d40b55b0 0x7fb8d40ca8b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:32.495 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.490+0000 7fb8d359e700 1 -- 172.21.15.62:0/3686639788 >> 172.21.15.62:0/3686639788 conn(0x7fb8d406d830 msgr2=0x7fb8d406dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:32.495 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.490+0000 7fb8d359e700 1 -- 172.21.15.62:0/3686639788 shutdown_connections 2023-06-09T04:42:32.496 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.490+0000 7fb8d359e700 1 -- 172.21.15.62:0/3686639788 wait complete. 2023-06-09T04:42:32.498 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.494+0000 7fb8d359e700 1 Processor -- start 2023-06-09T04:42:32.499 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.494+0000 7fb8d359e700 1 -- start start 2023-06-09T04:42:32.501 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.498+0000 7fb8d359e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8d40b55b0 0x7fb8d4156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:32.501 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.498+0000 7fb8d359e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8d40ccc90 0x7fb8d4151930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:32.501 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.498+0000 7fb8d359e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb8d415ab60 0x7fb8d41e46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:32.502 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.498+0000 7fb8d359e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d4157130 con 0x7fb8d40ccc90 2023-06-09T04:42:32.502 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.498+0000 7fb8d359e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d40cee00 con 0x7fb8d40b55b0 2023-06-09T04:42:32.502 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.498+0000 7fb8d359e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d40cf0e0 con 0x7fb8d415ab60 2023-06-09T04:42:32.504 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.498+0000 7fb8d1d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8d40ccc90 0x7fb8d4151930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:32.504 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.498+0000 7fb8d1d9b700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8d40ccc90 0x7fb8d4151930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:36976/0 (socket says 172.21.15.62:36976) 2023-06-09T04:42:32.504 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.498+0000 7fb8d1d9b700 1 -- 172.21.15.62:0/3257969883 learned_addr learned my addr 172.21.15.62:0/3257969883 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:32.504 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.498+0000 7fb8d259c700 1 --2- 172.21.15.62:0/3257969883 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8d40b55b0 0x7fb8d4156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:32.505 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.498+0000 7fb8d2d9d700 1 --2- 172.21.15.62:0/3257969883 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb8d415ab60 0x7fb8d41e46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:32.505 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.498+0000 7fb8d1d9b700 1 -- 172.21.15.62:0/3257969883 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb8d415ab60 msgr2=0x7fb8d41e46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:32.505 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.498+0000 7fb8d1d9b700 1 --2- 172.21.15.62:0/3257969883 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb8d415ab60 0x7fb8d41e46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:32.505 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.498+0000 7fb8d1d9b700 1 -- 172.21.15.62:0/3257969883 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8d40b55b0 msgr2=0x7fb8d4156bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:32.505 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.498+0000 7fb8d1d9b700 1 --2- 172.21.15.62:0/3257969883 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8d40b55b0 0x7fb8d4156bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:32.506 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.498+0000 7fb8d1d9b700 1 -- 172.21.15.62:0/3257969883 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8c40094b0 con 0x7fb8d40ccc90 2023-06-09T04:42:32.506 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.498+0000 7fb8d2d9d700 1 --2- 172.21.15.62:0/3257969883 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb8d415ab60 0x7fb8d41e46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:32.506 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.498+0000 7fb8d1d9b700 1 --2- 172.21.15.62:0/3257969883 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8d40ccc90 0x7fb8d4151930 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fb8c80010e0 tx=0x7fb8c800c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:32.506 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.498+0000 7fb8c2ffd700 1 -- 172.21.15.62:0/3257969883 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c80052d0 con 0x7fb8d40ccc90 2023-06-09T04:42:32.506 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.498+0000 7fb8c2ffd700 1 -- 172.21.15.62:0/3257969883 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8c8005430 con 0x7fb8d40ccc90 2023-06-09T04:42:32.507 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.498+0000 7fb8c2ffd700 1 -- 172.21.15.62:0/3257969883 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c80055a0 con 0x7fb8d40ccc90 2023-06-09T04:42:32.507 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.498+0000 7fb8d359e700 1 -- 172.21.15.62:0/3257969883 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8d40cf3c0 con 0x7fb8d40ccc90 2023-06-09T04:42:32.507 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.502+0000 7fb8d359e700 1 -- 172.21.15.62:0/3257969883 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8d4152210 con 0x7fb8d40ccc90 2023-06-09T04:42:32.508 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.502+0000 7fb8d359e700 1 -- 172.21.15.62:0/3257969883 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8d40cf8e0 con 0x7fb8d40ccc90 2023-06-09T04:42:32.508 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.506+0000 7fb8c2ffd700 1 -- 172.21.15.62:0/3257969883 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb8c80038e0 con 0x7fb8d40ccc90 2023-06-09T04:42:32.509 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.506+0000 7fb8c2ffd700 1 --2- 172.21.15.62:0/3257969883 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fb8b40662f0 0x7fb8b40687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:32.509 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.506+0000 7fb8c2ffd700 1 -- 172.21.15.62:0/3257969883 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fb8c80832e0 con 0x7fb8d40ccc90 2023-06-09T04:42:32.509 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.506+0000 7fb8d259c700 1 --2- 172.21.15.62:0/3257969883 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fb8b40662f0 0x7fb8b40687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:32.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.506+0000 7fb8d259c700 1 --2- 172.21.15.62:0/3257969883 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fb8b40662f0 0x7fb8b40687a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb8c40090b0 tx=0x7fb8c401c040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:32.515 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.514+0000 7fb8c2ffd700 1 -- 172.21.15.62:0/3257969883 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb8d40cf8e0 con 0x7fb8d40ccc90 2023-06-09T04:42:32.730 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:32.726+0000 7fb8d359e700 1 -- 172.21.15.62:0/3257969883 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fb8d40cf8e0 con 0x7fb8d40ccc90 2023-06-09T04:42:33.481 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:33.478+0000 7fb8c2ffd700 1 -- 172.21.15.62:0/3257969883 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7fb8d40cf8e0 con 0x7fb8d40ccc90 2023-06-09T04:42:33.486 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:33.482+0000 7fb8d359e700 1 -- 172.21.15.62:0/3257969883 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fb8b40662f0 msgr2=0x7fb8b40687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:33.486 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:33.482+0000 7fb8d359e700 1 --2- 172.21.15.62:0/3257969883 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fb8b40662f0 0x7fb8b40687a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb8c40090b0 tx=0x7fb8c401c040 comp rx=0 tx=0).stop 2023-06-09T04:42:33.487 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:33.482+0000 7fb8d359e700 1 -- 172.21.15.62:0/3257969883 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8d40ccc90 msgr2=0x7fb8d4151930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:33.487 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:33.482+0000 7fb8d359e700 1 --2- 172.21.15.62:0/3257969883 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8d40ccc90 0x7fb8d4151930 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fb8c80010e0 tx=0x7fb8c800c9e0 comp rx=0 tx=0).stop 2023-06-09T04:42:33.487 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:33.482+0000 7fb8d359e700 1 -- 172.21.15.62:0/3257969883 shutdown_connections 2023-06-09T04:42:33.487 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:33.482+0000 7fb8d359e700 1 --2- 172.21.15.62:0/3257969883 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fb8b40662f0 0x7fb8b40687a0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:33.487 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:33.482+0000 7fb8d359e700 1 --2- 172.21.15.62:0/3257969883 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fb8d415ab60 0x7fb8d41e46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:33.487 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:33.482+0000 7fb8d359e700 1 --2- 172.21.15.62:0/3257969883 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8d40ccc90 0x7fb8d4151930 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:33.487 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:33.482+0000 7fb8d359e700 1 --2- 172.21.15.62:0/3257969883 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8d40b55b0 0x7fb8d4156bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:33.488 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:33.482+0000 7fb8d359e700 1 -- 172.21.15.62:0/3257969883 >> 172.21.15.62:0/3257969883 conn(0x7fb8d406d830 msgr2=0x7fb8d415cbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:33.488 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:33.482+0000 7fb8d359e700 1 -- 172.21.15.62:0/3257969883 shutdown_connections 2023-06-09T04:42:33.488 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:33.482+0000 7fb8d359e700 1 -- 172.21.15.62:0/3257969883 wait complete. 2023-06-09T04:42:33.512 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-06-09T04:42:33.513 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-06-09T04:42:33.706 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:33.702+0000 7fcb719eb700 1 Processor -- start 2023-06-09T04:42:33.706 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:33.702+0000 7fcb719eb700 1 -- start start 2023-06-09T04:42:33.709 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:33.706+0000 7fcb719eb700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fcb6c071730 0x7fcb6c06f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:33.710 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:33.706+0000 7fcb719eb700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fcb6c0ca1c0 0x7fcb6c0afb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:33.710 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:33.706+0000 7fcb719eb700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb6c0b04f0 con 0x7fcb6c0b0090 2023-06-09T04:42:33.710 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:33.706+0000 7fcb719eb700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb6c15d860 con 0x7fcb6c071730 2023-06-09T04:42:33.710 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:33.706+0000 7fcb719eb700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb6c071b00 con 0x7fcb6c0ca1c0 2023-06-09T04:42:33.711 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:33.706+0000 7fcb709e9700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fcb6c071730 0x7fcb6c06f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:33.711 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:33.706+0000 7fcb711ea700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fcb6c0b0090 0x7fcb6c0cbfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:59750/0 (socket says 172.21.15.62:59750) 2023-06-09T04:42:33.711 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:33.706+0000 7fcb711ea700 1 -- 172.21.15.62:0/3819542736 learned_addr learned my addr 172.21.15.62:0/3819542736 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:42:33.712 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:33.706+0000 7fcb6bfff700 1 --2- 172.21.15.62:0/3819542736 >> v2:172.21.15.89:3300/0 conn(0x7fcb6c0ca1c0 0x7fcb6c0afb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:33.712 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:33.706+0000 7fcb6b7fe700 1 -- 172.21.15.62:0/3819542736 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 204313587 0 0) 0x7fcb6c0b04f0 con 0x7fcb6c0b0090 2023-06-09T04:42:33.712 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:33.706+0000 7fcb6b7fe700 1 -- 172.21.15.62:0/3819542736 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb5c0035d0 con 0x7fcb6c0b0090 2023-06-09T04:42:33.712 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:33.706+0000 7fcb6bfff700 1 -- 172.21.15.62:0/3819542736 >> v2:172.21.15.62:3300/0 conn(0x7fcb6c071730 msgr2=0x7fcb6c06f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:33.712 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:33.706+0000 7fcb6bfff700 1 --2- 172.21.15.62:0/3819542736 >> v2:172.21.15.62:3300/0 conn(0x7fcb6c071730 0x7fcb6c06f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:33.713 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:33.706+0000 7fcb6bfff700 1 -- 172.21.15.62:0/3819542736 >> v1:172.21.15.62:6789/0 conn(0x7fcb6c0b0090 legacy=0x7fcb6c0cbfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:33.713 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:33.706+0000 7fcb6bfff700 1 -- 172.21.15.62:0/3819542736 --> v2:172.21.15.89:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb6c15dab0 con 0x7fcb6c0ca1c0 2023-06-09T04:42:33.714 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:33.710+0000 7fcb6bfff700 1 --2- 172.21.15.62:0/3819542736 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb6c0ca1c0 0x7fcb6c0afb50 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c06f110 tx=0x7fcb58009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63e81c45a7916b50 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:33.714 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:33.710+0000 7fcb6b7fe700 1 -- 172.21.15.62:0/3819542736 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb58011830 con 0x7fcb6c0ca1c0 2023-06-09T04:42:33.714 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:33.710+0000 7fcb6b7fe700 1 -- 172.21.15.62:0/3819542736 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb58011990 con 0x7fcb6c0ca1c0 2023-06-09T04:42:33.714 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:33.710+0000 7fcb6b7fe700 1 -- 172.21.15.62:0/3819542736 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb58011d20 con 0x7fcb6c0ca1c0 2023-06-09T04:42:33.714 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:33.710+0000 7fcb719eb700 1 -- 172.21.15.62:0/3819542736 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb6c0ca1c0 msgr2=0x7fcb6c0afb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:33.714 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:33.710+0000 7fcb719eb700 1 --2- 172.21.15.62:0/3819542736 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb6c0ca1c0 0x7fcb6c0afb50 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c06f110 tx=0x7fcb58009b30 comp rx=0 tx=0).stop 2023-06-09T04:42:33.714 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:33.710+0000 7fcb719eb700 1 -- 172.21.15.62:0/3819542736 shutdown_connections 2023-06-09T04:42:33.715 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:33.710+0000 7fcb719eb700 1 --2- 172.21.15.62:0/3819542736 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb6c0ca1c0 0x7fcb6c0afb50 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:33.715 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:33.710+0000 7fcb719eb700 1 --2- 172.21.15.62:0/3819542736 >> v2:172.21.15.62:3300/0 conn(0x7fcb6c071730 0x7fcb6c06f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:33.715 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:33.710+0000 7fcb719eb700 1 -- 172.21.15.62:0/3819542736 >> 172.21.15.62:0/3819542736 conn(0x7fcb6c0cab50 msgr2=0x7fcb6c0caf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:33.715 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:33.710+0000 7fcb719eb700 1 -- 172.21.15.62:0/3819542736 shutdown_connections 2023-06-09T04:42:33.715 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:33.710+0000 7fcb719eb700 1 -- 172.21.15.62:0/3819542736 wait complete. 2023-06-09T04:42:33.716 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:33.714+0000 7fcb719eb700 1 Processor -- start 2023-06-09T04:42:33.716 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:33.714+0000 7fcb719eb700 1 -- start start 2023-06-09T04:42:33.716 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:33.714+0000 7fcb719eb700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb6c071730 0x7fcb6c156a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:33.717 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:33.714+0000 7fcb719eb700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcb6c0b0090 0x7fcb6c157db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:33.718 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:33.714+0000 7fcb719eb700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb6c0ca1c0 0x7fcb6c1582f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:33.718 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:33.714+0000 7fcb719eb700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6c1f5840 con 0x7fcb6c0b0090 2023-06-09T04:42:33.718 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:33.714+0000 7fcb719eb700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6c1f4ee0 con 0x7fcb6c071730 2023-06-09T04:42:33.718 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:33.714+0000 7fcb719eb700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6c15d310 con 0x7fcb6c0ca1c0 2023-06-09T04:42:33.718 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:33.714+0000 7fcb6bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcb6c0b0090 0x7fcb6c157db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:33.719 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:33.714+0000 7fcb6bfff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcb6c0b0090 0x7fcb6c157db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:36982/0 (socket says 172.21.15.62:36982) 2023-06-09T04:42:33.719 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:33.714+0000 7fcb6bfff700 1 -- 172.21.15.62:0/3019711563 learned_addr learned my addr 172.21.15.62:0/3019711563 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:33.719 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:33.714+0000 7fcb709e9700 1 --2- 172.21.15.62:0/3019711563 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb6c071730 0x7fcb6c156a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:33.719 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:33.714+0000 7fcb711ea700 1 --2- 172.21.15.62:0/3019711563 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb6c0ca1c0 0x7fcb6c1582f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:33.719 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:33.714+0000 7fcb6bfff700 1 -- 172.21.15.62:0/3019711563 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb6c0ca1c0 msgr2=0x7fcb6c1582f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:33.719 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:33.714+0000 7fcb6bfff700 1 --2- 172.21.15.62:0/3019711563 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb6c0ca1c0 0x7fcb6c1582f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:33.720 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:33.714+0000 7fcb6bfff700 1 -- 172.21.15.62:0/3019711563 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb6c071730 msgr2=0x7fcb6c156a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:33.720 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:33.714+0000 7fcb6bfff700 1 --2- 172.21.15.62:0/3019711563 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb6c071730 0x7fcb6c156a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:33.720 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:33.714+0000 7fcb6bfff700 1 -- 172.21.15.62:0/3019711563 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb580094b0 con 0x7fcb6c0b0090 2023-06-09T04:42:33.721 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:33.714+0000 7fcb6bfff700 1 --2- 172.21.15.62:0/3019711563 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcb6c0b0090 0x7fcb6c157db0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fcb58009b70 tx=0x7fcb58004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:33.721 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:33.714+0000 7fcb697fa700 1 -- 172.21.15.62:0/3019711563 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb58004520 con 0x7fcb6c0b0090 2023-06-09T04:42:33.721 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:33.714+0000 7fcb697fa700 1 -- 172.21.15.62:0/3019711563 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb5801f070 con 0x7fcb6c0b0090 2023-06-09T04:42:33.721 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:33.714+0000 7fcb697fa700 1 -- 172.21.15.62:0/3019711563 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb580038e0 con 0x7fcb6c0b0090 2023-06-09T04:42:33.721 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:33.714+0000 7fcb719eb700 1 -- 172.21.15.62:0/3019711563 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb6c1f5c60 con 0x7fcb6c0b0090 2023-06-09T04:42:33.722 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:33.718+0000 7fcb719eb700 1 -- 172.21.15.62:0/3019711563 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb6c1f5460 con 0x7fcb6c0b0090 2023-06-09T04:42:33.722 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:33.718+0000 7fcb719eb700 1 -- 172.21.15.62:0/3019711563 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb6c0739c0 con 0x7fcb6c0b0090 2023-06-09T04:42:33.722 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:33.718+0000 7fcb697fa700 1 -- 172.21.15.62:0/3019711563 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fcb58003a40 con 0x7fcb6c0b0090 2023-06-09T04:42:33.723 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:33.722+0000 7fcb697fa700 1 --2- 172.21.15.62:0/3019711563 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fcb50066320 0x7fcb500687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:33.724 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:33.722+0000 7fcb697fa700 1 -- 172.21.15.62:0/3019711563 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fcb58021070 con 0x7fcb6c0b0090 2023-06-09T04:42:33.724 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:33.722+0000 7fcb709e9700 1 --2- 172.21.15.62:0/3019711563 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fcb50066320 0x7fcb500687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:33.725 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:33.722+0000 7fcb709e9700 1 --2- 172.21.15.62:0/3019711563 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fcb50066320 0x7fcb500687d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fcb60009b50 tx=0x7fcb60009240 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:33.729 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:33.726+0000 7fcb697fa700 1 -- 172.21.15.62:0/3019711563 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fcb58052600 con 0x7fcb6c0b0090 2023-06-09T04:42:33.914 INFO:tasks.ceph.mds.c.smithi062.stderr:2023-06-09T04:42:33.910+0000 7f5068dcf700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-06-09T04:42:33.938 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:33.934+0000 7fcb719eb700 1 -- 172.21.15.62:0/3019711563 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fcb6c0b1dc0 con 0x7fcb6c0b0090 2023-06-09T04:42:34.488 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.486+0000 7fcb697fa700 1 -- 172.21.15.62:0/3019711563 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7fcb58055c20 con 0x7fcb6c0b0090 2023-06-09T04:42:34.493 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.490+0000 7fcb719eb700 1 -- 172.21.15.62:0/3019711563 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fcb50066320 msgr2=0x7fcb500687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:34.493 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.490+0000 7fcb719eb700 1 --2- 172.21.15.62:0/3019711563 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fcb50066320 0x7fcb500687d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fcb60009b50 tx=0x7fcb60009240 comp rx=0 tx=0).stop 2023-06-09T04:42:34.493 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.490+0000 7fcb719eb700 1 -- 172.21.15.62:0/3019711563 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcb6c0b0090 msgr2=0x7fcb6c157db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:34.493 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.490+0000 7fcb719eb700 1 --2- 172.21.15.62:0/3019711563 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcb6c0b0090 0x7fcb6c157db0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fcb58009b70 tx=0x7fcb58004770 comp rx=0 tx=0).stop 2023-06-09T04:42:34.494 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.490+0000 7fcb719eb700 1 -- 172.21.15.62:0/3019711563 shutdown_connections 2023-06-09T04:42:34.494 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.490+0000 7fcb719eb700 1 --2- 172.21.15.62:0/3019711563 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fcb50066320 0x7fcb500687d0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:34.494 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.490+0000 7fcb719eb700 1 --2- 172.21.15.62:0/3019711563 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fcb6c0ca1c0 0x7fcb6c1582f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:34.494 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.490+0000 7fcb719eb700 1 --2- 172.21.15.62:0/3019711563 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcb6c0b0090 0x7fcb6c157db0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:34.495 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.490+0000 7fcb719eb700 1 --2- 172.21.15.62:0/3019711563 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb6c071730 0x7fcb6c156a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:34.495 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.490+0000 7fcb719eb700 1 -- 172.21.15.62:0/3019711563 >> 172.21.15.62:0/3019711563 conn(0x7fcb6c0cab50 msgr2=0x7fcb6c0caf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:34.495 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.490+0000 7fcb719eb700 1 -- 172.21.15.62:0/3019711563 shutdown_connections 2023-06-09T04:42:34.495 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.490+0000 7fcb719eb700 1 -- 172.21.15.62:0/3019711563 wait complete. 2023-06-09T04:42:34.517 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-06-09T04:42:34.517 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-09T04:42:34.691 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.686+0000 7f4651b70700 1 Processor -- start 2023-06-09T04:42:34.691 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.686+0000 7f4651b70700 1 -- start start 2023-06-09T04:42:34.694 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.690+0000 7f4651b70700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f464c0c9d10 0x7f464c06c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:34.694 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.690+0000 7f4651b70700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f464c0cbc10 con 0x7f464c06d160 2023-06-09T04:42:34.694 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.690+0000 7f4651b70700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f464c0cbe60 con 0x7f464c15be40 2023-06-09T04:42:34.695 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.690+0000 7f4651b70700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f464c06cd10 con 0x7f464c0c9d10 2023-06-09T04:42:34.697 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.690+0000 7f465136f700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f464c06d160 0x7f464c069bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:59752/0 (socket says 172.21.15.62:59752) 2023-06-09T04:42:34.697 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.690+0000 7f465136f700 1 -- 172.21.15.62:0/1794378838 learned_addr learned my addr 172.21.15.62:0/1794378838 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:42:34.698 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.690+0000 7f464bfff700 1 --2- 172.21.15.62:0/1794378838 >> v2:172.21.15.89:3300/0 conn(0x7f464c0c9d10 0x7f464c06c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:34.698 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.690+0000 7f464b7fe700 1 -- 172.21.15.62:0/1794378838 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3555643869 0 0) 0x7f464c0cbc10 con 0x7f464c06d160 2023-06-09T04:42:34.698 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.694+0000 7f464b7fe700 1 -- 172.21.15.62:0/1794378838 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f463c0035d0 con 0x7f464c06d160 2023-06-09T04:42:34.698 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.694+0000 7f464b7fe700 1 -- 172.21.15.62:0/1794378838 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1601968616 0 0) 0x7f464c0cbe60 con 0x7f464c15be40 2023-06-09T04:42:34.699 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.694+0000 7f464b7fe700 1 -- 172.21.15.62:0/1794378838 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f464c0cbc10 con 0x7f464c15be40 2023-06-09T04:42:34.699 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.694+0000 7f464b7fe700 1 -- 172.21.15.62:0/1794378838 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1106436950 0 0) 0x7f463c0035d0 con 0x7f464c06d160 2023-06-09T04:42:34.699 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.694+0000 7f464b7fe700 1 -- 172.21.15.62:0/1794378838 >> v2:172.21.15.89:3300/0 conn(0x7f464c0c9d10 msgr2=0x7f464c06c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:34.699 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.694+0000 7f464b7fe700 1 --2- 172.21.15.62:0/1794378838 >> v2:172.21.15.89:3300/0 conn(0x7f464c0c9d10 0x7f464c06c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:34.700 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.694+0000 7f464b7fe700 1 -- 172.21.15.62:0/1794378838 >> v1:172.21.15.89:6789/0 conn(0x7f464c15be40 legacy=0x7f464c0c9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:34.700 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.694+0000 7f464b7fe700 1 -- 172.21.15.62:0/1794378838 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f464c0cc140 con 0x7f464c06d160 2023-06-09T04:42:34.700 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.694+0000 7f464b7fe700 1 -- 172.21.15.62:0/1794378838 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 540845019 0 0) 0x7f46440019f0 con 0x7f464c06d160 2023-06-09T04:42:34.700 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.694+0000 7f464b7fe700 1 -- 172.21.15.62:0/1794378838 >> v1:172.21.15.62:6789/0 conn(0x7f464c06d160 legacy=0x7f464c069bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:34.700 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.694+0000 7f464b7fe700 1 --2- 172.21.15.62:0/1794378838 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f463c003c00 0x7f463c003ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:34.701 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.694+0000 7f464b7fe700 1 --2- 172.21.15.62:0/1794378838 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f463c004870 0x7f463c004ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:34.701 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.694+0000 7f464b7fe700 1 --2- 172.21.15.62:0/1794378838 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f463c005220 0x7f463c00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:34.701 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.694+0000 7f464b7fe700 1 -- 172.21.15.62:0/1794378838 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f464c06cd10 con 0x7f463c003c00 2023-06-09T04:42:34.701 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.694+0000 7f464b7fe700 1 -- 172.21.15.62:0/1794378838 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f463c00c100 con 0x7f463c004870 2023-06-09T04:42:34.702 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.694+0000 7f464b7fe700 1 -- 172.21.15.62:0/1794378838 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f463c00c290 con 0x7f463c005220 2023-06-09T04:42:34.702 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.694+0000 7f4650b6e700 1 --2- 172.21.15.62:0/1794378838 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f463c003c00 0x7f463c003ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:34.702 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.694+0000 7f464bfff700 1 --2- 172.21.15.62:0/1794378838 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f463c004870 0x7f463c004ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:34.702 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.694+0000 7f465136f700 1 --2- 172.21.15.62:0/1794378838 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f463c005220 0x7f463c00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:34.703 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.694+0000 7f4650b6e700 1 -- 172.21.15.62:0/1794378838 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f463c005220 msgr2=0x7f463c00ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:34.703 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.694+0000 7f4650b6e700 1 --2- 172.21.15.62:0/1794378838 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f463c005220 0x7f463c00ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:34.703 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.694+0000 7f4650b6e700 1 -- 172.21.15.62:0/1794378838 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f463c004870 msgr2=0x7f463c004ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:34.703 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.694+0000 7f4650b6e700 1 --2- 172.21.15.62:0/1794378838 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f463c004870 0x7f463c004ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:34.703 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.694+0000 7f4650b6e700 1 -- 172.21.15.62:0/1794378838 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f463c0035d0 con 0x7f463c003c00 2023-06-09T04:42:34.704 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.694+0000 7f465136f700 1 -- 172.21.15.62:0/1794378838 reap_dead start 2023-06-09T04:42:34.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.694+0000 7f4650b6e700 1 --2- 172.21.15.62:0/1794378838 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f463c003c00 0x7f463c003ff0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f4640007fd0 tx=0x7f463c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73f0638a066e230f server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:34.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.694+0000 7f464b7fe700 1 -- 172.21.15.62:0/1794378838 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4640001450 con 0x7f463c003c00 2023-06-09T04:42:34.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.694+0000 7f464b7fe700 1 -- 172.21.15.62:0/1794378838 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46400052f0 con 0x7f463c003c00 2023-06-09T04:42:34.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.694+0000 7f464b7fe700 1 -- 172.21.15.62:0/1794378838 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4640001d60 con 0x7f463c003c00 2023-06-09T04:42:34.708 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.694+0000 7f4651b70700 1 -- 172.21.15.62:0/1794378838 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f463c003c00 msgr2=0x7f463c003ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:34.708 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.694+0000 7f4651b70700 1 --2- 172.21.15.62:0/1794378838 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f463c003c00 0x7f463c003ff0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f4640007fd0 tx=0x7f463c0058a0 comp rx=0 tx=0).stop 2023-06-09T04:42:34.708 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.694+0000 7f4651b70700 1 -- 172.21.15.62:0/1794378838 shutdown_connections 2023-06-09T04:42:34.708 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.694+0000 7f4651b70700 1 --2- 172.21.15.62:0/1794378838 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f463c003c00 0x7f463c003ff0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:34.709 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.694+0000 7f4651b70700 1 -- 172.21.15.62:0/1794378838 >> 172.21.15.62:0/1794378838 conn(0x7f464c0cf4f0 msgr2=0x7f464c0cb2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:34.709 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.694+0000 7f4651b70700 1 -- 172.21.15.62:0/1794378838 shutdown_connections 2023-06-09T04:42:34.709 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.698+0000 7f4651b70700 1 -- 172.21.15.62:0/1794378838 wait complete. 2023-06-09T04:42:34.709 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.698+0000 7f4651b70700 1 Processor -- start 2023-06-09T04:42:34.709 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.702+0000 7f4651b70700 1 -- start start 2023-06-09T04:42:34.710 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.702+0000 7f4651b70700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f463c003c00 0x7f464c147b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:34.710 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.702+0000 7f4651b70700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f464c150fe0 0x7f464c0c6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:34.710 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.702+0000 7f4651b70700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f464c151890 0x7f464c151d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:34.710 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.702+0000 7f4651b70700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f464c152240 con 0x7f463c003c00 2023-06-09T04:42:34.711 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.702+0000 7f4651b70700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f464c0c8070 con 0x7f464c150fe0 2023-06-09T04:42:34.711 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.702+0000 7f4651b70700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f464c1480a0 con 0x7f464c151890 2023-06-09T04:42:34.711 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.702+0000 7f4650b6e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f463c003c00 0x7f464c147b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:34.711 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.702+0000 7f4650b6e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f463c003c00 0x7f464c147b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:37000/0 (socket says 172.21.15.62:37000) 2023-06-09T04:42:34.711 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.702+0000 7f4650b6e700 1 -- 172.21.15.62:0/2585720949 learned_addr learned my addr 172.21.15.62:0/2585720949 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:34.712 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.702+0000 7f464bfff700 1 --2- 172.21.15.62:0/2585720949 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f464c150fe0 0x7f464c0c6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:34.712 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.702+0000 7f465136f700 1 --2- 172.21.15.62:0/2585720949 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f464c151890 0x7f464c151d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:34.712 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.702+0000 7f464bfff700 1 -- 172.21.15.62:0/2585720949 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f464c151890 msgr2=0x7f464c151d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:34.712 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.702+0000 7f464bfff700 1 --2- 172.21.15.62:0/2585720949 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f464c151890 0x7f464c151d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:34.713 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.702+0000 7f464bfff700 1 -- 172.21.15.62:0/2585720949 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f463c003c00 msgr2=0x7f464c147b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:34.713 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.702+0000 7f464bfff700 1 --2- 172.21.15.62:0/2585720949 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f463c003c00 0x7f464c147b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:34.713 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.702+0000 7f464bfff700 1 -- 172.21.15.62:0/2585720949 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f464c0c7530 con 0x7f464c150fe0 2023-06-09T04:42:34.713 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.702+0000 7f464bfff700 1 --2- 172.21.15.62:0/2585720949 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f464c150fe0 0x7f464c0c6ff0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4638011a00 tx=0x7f4638011d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:34.715 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.706+0000 7f46497fa700 1 -- 172.21.15.62:0/2585720949 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4638011e40 con 0x7f464c150fe0 2023-06-09T04:42:34.715 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.706+0000 7f46497fa700 1 -- 172.21.15.62:0/2585720949 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4638004240 con 0x7f464c150fe0 2023-06-09T04:42:34.716 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.706+0000 7f4651b70700 1 -- 172.21.15.62:0/2585720949 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f464c0c77d0 con 0x7f464c150fe0 2023-06-09T04:42:34.716 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.706+0000 7f46497fa700 1 -- 172.21.15.62:0/2585720949 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46380036c0 con 0x7f464c150fe0 2023-06-09T04:42:34.716 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.706+0000 7f4651b70700 1 -- 172.21.15.62:0/2585720949 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f464c0c7d90 con 0x7f464c150fe0 2023-06-09T04:42:34.716 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.706+0000 7f4651b70700 1 -- 172.21.15.62:0/2585720949 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f464c0739c0 con 0x7f464c150fe0 2023-06-09T04:42:34.717 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.706+0000 7f46497fa700 1 -- 172.21.15.62:0/2585720949 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f4638003820 con 0x7f464c150fe0 2023-06-09T04:42:34.717 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.710+0000 7f46497fa700 1 --2- 172.21.15.62:0/2585720949 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f4630066320 0x7f46300687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:34.717 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.710+0000 7f46497fa700 1 -- 172.21.15.62:0/2585720949 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f46380846c0 con 0x7f464c150fe0 2023-06-09T04:42:34.717 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.710+0000 7f4650b6e700 1 --2- 172.21.15.62:0/2585720949 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f4630066320 0x7f46300687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:34.717 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.710+0000 7f4650b6e700 1 --2- 172.21.15.62:0/2585720949 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f4630066320 0x7f46300687d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4640015040 tx=0x7f464000a000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:34.718 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.714+0000 7f46497fa700 1 -- 172.21.15.62:0/2585720949 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f46380519e0 con 0x7f464c150fe0 2023-06-09T04:42:34.932 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.930+0000 7f4651b70700 1 -- 172.21.15.62:0/2585720949 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f464c0cb9f0 con 0x7f464c150fe0 2023-06-09T04:42:34.933 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.930+0000 7f46497fa700 1 -- 172.21.15.62:0/2585720949 <== mon.1 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4665 (secure 0 0 0) 0x7f4638055000 con 0x7f464c150fe0 2023-06-09T04:42:34.934 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:42:34.934 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5383,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6833/554108593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":554108593},{"type":"v1","addr":"172.21.15.62:6833","nonce":554108593}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5386,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/1751549647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1751549647},{"type":"v1","addr":"172.21.15.89:6835","nonce":1751549647}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5392,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/518828005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":518828005},{"type":"v1","addr":"172.21.15.89:6837","nonce":518828005}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-09T04:42:31.449850+0000","modified":"2023-06-09T04:42:34.479192+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5478},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5478":{"gid":5478,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.62:6835/3437129940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":3437129940},{"type":"v1","addr":"172.21.15.62:6835","nonce":3437129940}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-06-09T04:42:34.939 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.934+0000 7f4651b70700 1 -- 172.21.15.62:0/2585720949 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f4630066320 msgr2=0x7f46300687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:34.939 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.934+0000 7f4651b70700 1 --2- 172.21.15.62:0/2585720949 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f4630066320 0x7f46300687d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4640015040 tx=0x7f464000a000 comp rx=0 tx=0).stop 2023-06-09T04:42:34.939 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.934+0000 7f4651b70700 1 -- 172.21.15.62:0/2585720949 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f464c150fe0 msgr2=0x7f464c0c6ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:34.939 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.934+0000 7f4651b70700 1 --2- 172.21.15.62:0/2585720949 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f464c150fe0 0x7f464c0c6ff0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4638011a00 tx=0x7f4638011d10 comp rx=0 tx=0).stop 2023-06-09T04:42:34.940 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.938+0000 7f4651b70700 1 -- 172.21.15.62:0/2585720949 shutdown_connections 2023-06-09T04:42:34.940 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.938+0000 7f4651b70700 1 --2- 172.21.15.62:0/2585720949 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f4630066320 0x7f46300687d0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:34.940 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.938+0000 7f4651b70700 1 --2- 172.21.15.62:0/2585720949 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f464c151890 0x7f464c151d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:34.940 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.938+0000 7f4651b70700 1 --2- 172.21.15.62:0/2585720949 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f464c150fe0 0x7f464c0c6ff0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:34.940 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.938+0000 7f4651b70700 1 --2- 172.21.15.62:0/2585720949 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f463c003c00 0x7f464c147b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:34.941 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.938+0000 7f4651b70700 1 -- 172.21.15.62:0/2585720949 >> 172.21.15.62:0/2585720949 conn(0x7f464c0cf4f0 msgr2=0x7f464c06fcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:34.941 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.938+0000 7f4651b70700 1 -- 172.21.15.62:0/2585720949 shutdown_connections 2023-06-09T04:42:34.941 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:34.938+0000 7f4651b70700 1 -- 172.21.15.62:0/2585720949 wait complete. 2023-06-09T04:42:34.942 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 17 2023-06-09T04:42:34.959 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T04:42:35.133 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.130+0000 7fa32b691700 1 Processor -- start 2023-06-09T04:42:35.133 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.130+0000 7fa32b691700 1 -- start start 2023-06-09T04:42:35.136 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.134+0000 7fa32b691700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa32415c0f0 0x7fa3240cbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:35.136 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.134+0000 7fa32b691700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa3240cb1f0 0x7fa3240c8840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:35.137 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.134+0000 7fa32b691700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa32415fa30 con 0x7fa3240ad480 2023-06-09T04:42:35.137 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.134+0000 7fa32b691700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3240cc300 con 0x7fa32415c0f0 2023-06-09T04:42:35.137 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.134+0000 7fa32b691700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3240ad2f0 con 0x7fa3240cb1f0 2023-06-09T04:42:35.137 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.134+0000 7fa32942d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa32415c0f0 0x7fa3240cbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:35.137 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.134+0000 7fa32942d700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa32415c0f0 0x7fa3240cbdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:37012/0 (socket says 172.21.15.62:37012) 2023-06-09T04:42:35.137 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.134+0000 7fa32942d700 1 -- 172.21.15.62:0/562187175 learned_addr learned my addr 172.21.15.62:0/562187175 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:35.138 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.134+0000 7fa329c2e700 1 --2- 172.21.15.62:0/562187175 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa3240cb1f0 0x7fa3240c8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:35.138 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.134+0000 7fa32942d700 1 -- 172.21.15.62:0/562187175 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa3240cb1f0 msgr2=0x7fa3240c8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:35.138 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.134+0000 7fa32942d700 1 --2- 172.21.15.62:0/562187175 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa3240cb1f0 0x7fa3240c8840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:35.139 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.134+0000 7fa32942d700 1 -- 172.21.15.62:0/562187175 >> v1:172.21.15.89:6789/0 conn(0x7fa3240ad480 legacy=0x7fa3240caae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:35.139 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.134+0000 7fa32942d700 1 -- 172.21.15.62:0/562187175 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3240ad920 con 0x7fa32415c0f0 2023-06-09T04:42:35.139 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.134+0000 7fa32942d700 1 --2- 172.21.15.62:0/562187175 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa32415c0f0 0x7fa3240cbdc0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fa320009e50 tx=0x7fa32000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e305e0732191753f server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:35.139 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.134+0000 7fa31bfff700 1 -- 172.21.15.62:0/562187175 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa32000e070 con 0x7fa32415c0f0 2023-06-09T04:42:35.139 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.134+0000 7fa31bfff700 1 -- 172.21.15.62:0/562187175 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa32000b910 con 0x7fa32415c0f0 2023-06-09T04:42:35.139 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.134+0000 7fa31bfff700 1 -- 172.21.15.62:0/562187175 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa32000bcc0 con 0x7fa32415c0f0 2023-06-09T04:42:35.140 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.138+0000 7fa32b691700 1 -- 172.21.15.62:0/562187175 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa32415c0f0 msgr2=0x7fa3240cbdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:35.141 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.138+0000 7fa32b691700 1 --2- 172.21.15.62:0/562187175 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa32415c0f0 0x7fa3240cbdc0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fa320009e50 tx=0x7fa32000b330 comp rx=0 tx=0).stop 2023-06-09T04:42:35.141 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.138+0000 7fa32b691700 1 -- 172.21.15.62:0/562187175 shutdown_connections 2023-06-09T04:42:35.141 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.138+0000 7fa32b691700 1 --2- 172.21.15.62:0/562187175 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa3240cb1f0 0x7fa3240c8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:35.141 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.138+0000 7fa32b691700 1 --2- 172.21.15.62:0/562187175 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa32415c0f0 0x7fa3240cbdc0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:35.141 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.138+0000 7fa32b691700 1 -- 172.21.15.62:0/562187175 >> 172.21.15.62:0/562187175 conn(0x7fa32406a410 msgr2=0x7fa3240afd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:35.141 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.138+0000 7fa32b691700 1 -- 172.21.15.62:0/562187175 shutdown_connections 2023-06-09T04:42:35.142 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.138+0000 7fa32b691700 1 -- 172.21.15.62:0/562187175 wait complete. 2023-06-09T04:42:35.142 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.138+0000 7fa32b691700 1 Processor -- start 2023-06-09T04:42:35.142 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.138+0000 7fa32b691700 1 -- start start 2023-06-09T04:42:35.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.142+0000 7fa32b691700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3240ad480 0x7fa3241f11d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:35.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.142+0000 7fa32b691700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa3240cb1f0 0x7fa3240b3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:35.145 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.142+0000 7fa32b691700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa32415c0f0 0x7fa3240c1a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:35.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.142+0000 7fa32b691700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa324156e20 con 0x7fa32415c0f0 2023-06-09T04:42:35.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.142+0000 7fa32b691700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3240c1fb0 con 0x7fa3240ad480 2023-06-09T04:42:35.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.142+0000 7fa32b691700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3240c21e0 con 0x7fa3240cb1f0 2023-06-09T04:42:35.146 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.142+0000 7fa329c2e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa32415c0f0 0x7fa3240c1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:35.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.142+0000 7fa329c2e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa32415c0f0 0x7fa3240c1a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:37016/0 (socket says 172.21.15.62:37016) 2023-06-09T04:42:35.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.142+0000 7fa329c2e700 1 -- 172.21.15.62:0/2074809788 learned_addr learned my addr 172.21.15.62:0/2074809788 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:35.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.142+0000 7fa328c2c700 1 --2- 172.21.15.62:0/2074809788 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa3240cb1f0 0x7fa3240b3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:35.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.142+0000 7fa32942d700 1 --2- 172.21.15.62:0/2074809788 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3240ad480 0x7fa3241f11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:35.149 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.142+0000 7fa329c2e700 1 -- 172.21.15.62:0/2074809788 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa3240cb1f0 msgr2=0x7fa3240b3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:35.149 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.142+0000 7fa329c2e700 1 --2- 172.21.15.62:0/2074809788 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa3240cb1f0 0x7fa3240b3970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:35.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.142+0000 7fa329c2e700 1 -- 172.21.15.62:0/2074809788 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3240ad480 msgr2=0x7fa3241f11d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:35.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.142+0000 7fa329c2e700 1 --2- 172.21.15.62:0/2074809788 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3240ad480 0x7fa3241f11d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:35.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.142+0000 7fa329c2e700 1 -- 172.21.15.62:0/2074809788 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa320009b30 con 0x7fa32415c0f0 2023-06-09T04:42:35.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.142+0000 7fa329c2e700 1 --2- 172.21.15.62:0/2074809788 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa32415c0f0 0x7fa3240c1a70 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fa31c00eb60 tx=0x7fa31c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:35.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.142+0000 7fa319ffb700 1 -- 172.21.15.62:0/2074809788 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa31c009740 con 0x7fa32415c0f0 2023-06-09T04:42:35.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.142+0000 7fa319ffb700 1 -- 172.21.15.62:0/2074809788 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa31c009e00 con 0x7fa32415c0f0 2023-06-09T04:42:35.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.142+0000 7fa32b691700 1 -- 172.21.15.62:0/2074809788 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3240c24c0 con 0x7fa32415c0f0 2023-06-09T04:42:35.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.142+0000 7fa319ffb700 1 -- 172.21.15.62:0/2074809788 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa31c00ca70 con 0x7fa32415c0f0 2023-06-09T04:42:35.151 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.142+0000 7fa32b691700 1 -- 172.21.15.62:0/2074809788 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3240c2a80 con 0x7fa32415c0f0 2023-06-09T04:42:35.152 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.146+0000 7fa32b691700 1 -- 172.21.15.62:0/2074809788 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa32404db30 con 0x7fa32415c0f0 2023-06-09T04:42:35.152 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.146+0000 7fa319ffb700 1 -- 172.21.15.62:0/2074809788 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fa31c00cbd0 con 0x7fa32415c0f0 2023-06-09T04:42:35.152 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.150+0000 7fa319ffb700 1 --2- 172.21.15.62:0/2074809788 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fa3080662f0 0x7fa3080687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:35.152 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.150+0000 7fa319ffb700 1 -- 172.21.15.62:0/2074809788 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fa31c083e70 con 0x7fa32415c0f0 2023-06-09T04:42:35.153 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.150+0000 7fa32942d700 1 --2- 172.21.15.62:0/2074809788 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fa3080662f0 0x7fa3080687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:35.153 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.150+0000 7fa32942d700 1 --2- 172.21.15.62:0/2074809788 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fa3080662f0 0x7fa3080687a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa32000b370 tx=0x7fa320009000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:35.159 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.158+0000 7fa319ffb700 1 -- 172.21.15.62:0/2074809788 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fa31c054ba0 con 0x7fa32415c0f0 2023-06-09T04:42:35.334 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.330+0000 7fa32b691700 1 -- 172.21.15.62:0/2074809788 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa3240b4170 con 0x7fa32415c0f0 2023-06-09T04:42:35.337 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.334+0000 7fa319ffb700 1 -- 172.21.15.62:0/2074809788 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+18464 (secure 0 0 0) 0x7fa31c017090 con 0x7fa32415c0f0 2023-06-09T04:42:35.338 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:42:35.338 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":43,"fsid":"f7998a1e-e5a9-4202-abaa-70c0eaae1047","created":"2023-06-09T04:40:30.469588+0000","modified":"2023-06-09T04:42:32.455405+0000","last_up_change":"2023-06-09T04:40:43.120747+0000","last_in_change":"2023-06-09T04:40:33.568221+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:40:44.646921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:40:50.006643+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:42:29.603206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-06-09T04:42:30.461627+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bc50bbc0-dd08-42ed-804c-ec3029e36c19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6802","nonce":1295788017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6807","nonce":1295788017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6815","nonce":1295788017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6809","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6811","nonce":1295788017}]},"public_addr":"172.21.15.62:6802/1295788017","cluster_addr":"172.21.15.62:6807/1295788017","heartbeat_back_addr":"172.21.15.62:6815/1295788017","heartbeat_front_addr":"172.21.15.62:6811/1295788017","state":["exists","up"]},{"osd":1,"uuid":"8230b12d-e22f-4985-a584-4cc64404cdbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6825","nonce":4120692006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6827","nonce":4120692006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6831","nonce":4120692006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6829","nonce":4120692006}]},"public_addr":"172.21.15.62:6825/4120692006","cluster_addr":"172.21.15.62:6827/4120692006","heartbeat_back_addr":"172.21.15.62:6831/4120692006","heartbeat_front_addr":"172.21.15.62:6829/4120692006","state":["exists","up"]},{"osd":2,"uuid":"d0202506-dbe9-4e3c-9271-687929abf96a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6801","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6803","nonce":4169607876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6805","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6806","nonce":4169607876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6814","nonce":4169607876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6810","nonce":4169607876}]},"public_addr":"172.21.15.62:6803/4169607876","cluster_addr":"172.21.15.62:6806/4169607876","heartbeat_back_addr":"172.21.15.62:6814/4169607876","heartbeat_front_addr":"172.21.15.62:6810/4169607876","state":["exists","up"]},{"osd":3,"uuid":"f3c0298a-b075-4411-af50-e16cd74fdddb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6817","nonce":3268438986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6819","nonce":3268438986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6823","nonce":3268438986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6821","nonce":3268438986}]},"public_addr":"172.21.15.62:6817/3268438986","cluster_addr":"172.21.15.62:6819/3268438986","heartbeat_back_addr":"172.21.15.62:6823/3268438986","heartbeat_front_addr":"172.21.15.62:6821/3268438986","state":["exists","up"]},{"osd":4,"uuid":"1ab5c5ca-e74f-475a-a309-683cc0029928","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6817","nonce":3139617628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6819","nonce":3139617628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6823","nonce":3139617628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6821","nonce":3139617628}]},"public_addr":"172.21.15.89:6817/3139617628","cluster_addr":"172.21.15.89:6819/3139617628","heartbeat_back_addr":"172.21.15.89:6823/3139617628","heartbeat_front_addr":"172.21.15.89:6821/3139617628","state":["exists","up"]},{"osd":5,"uuid":"a933e184-bd8f-4369-a1ba-a68de53c578c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6825","nonce":2681723596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6827","nonce":2681723596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6831","nonce":2681723596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6829","nonce":2681723596}]},"public_addr":"172.21.15.89:6825/2681723596","cluster_addr":"172.21.15.89:6827/2681723596","heartbeat_back_addr":"172.21.15.89:6831/2681723596","heartbeat_front_addr":"172.21.15.89:6829/2681723596","state":["exists","up"]},{"osd":6,"uuid":"1ed7ad37-2eee-49a6-954c-b537e2b7f0ed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6809","nonce":1657136033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6811","nonce":1657136033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6815","nonce":1657136033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6813","nonce":1657136033}]},"public_addr":"172.21.15.89:6809/1657136033","cluster_addr":"172.21.15.89:6811/1657136033","heartbeat_back_addr":"172.21.15.89:6815/1657136033","heartbeat_front_addr":"172.21.15.89:6813/1657136033","state":["exists","up"]},{"osd":7,"uuid":"6ed732e9-33ff-40df-9038-a9f1d1622671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6801","nonce":1710561686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6803","nonce":1710561686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6807","nonce":1710561686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6805","nonce":1710561686}]},"public_addr":"172.21.15.89:6801/1710561686","cluster_addr":"172.21.15.89:6803/1710561686","heartbeat_back_addr":"172.21.15.89:6807/1710561686","heartbeat_front_addr":"172.21.15.89:6805/1710561686","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.335803+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.419788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.179334+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.263310+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.071846+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.375627+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.282277+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.315997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T04:42:35.341 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.338+0000 7fa32b691700 1 -- 172.21.15.62:0/2074809788 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fa3080662f0 msgr2=0x7fa3080687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:35.341 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.338+0000 7fa32b691700 1 --2- 172.21.15.62:0/2074809788 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fa3080662f0 0x7fa3080687a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa32000b370 tx=0x7fa320009000 comp rx=0 tx=0).stop 2023-06-09T04:42:35.341 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.338+0000 7fa32b691700 1 -- 172.21.15.62:0/2074809788 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa32415c0f0 msgr2=0x7fa3240c1a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:35.342 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.338+0000 7fa32b691700 1 --2- 172.21.15.62:0/2074809788 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa32415c0f0 0x7fa3240c1a70 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fa31c00eb60 tx=0x7fa31c00ee70 comp rx=0 tx=0).stop 2023-06-09T04:42:35.342 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.338+0000 7fa32b691700 1 -- 172.21.15.62:0/2074809788 shutdown_connections 2023-06-09T04:42:35.342 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.338+0000 7fa32b691700 1 --2- 172.21.15.62:0/2074809788 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fa3080662f0 0x7fa3080687a0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:35.342 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.338+0000 7fa32b691700 1 --2- 172.21.15.62:0/2074809788 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa32415c0f0 0x7fa3240c1a70 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:35.342 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.338+0000 7fa32b691700 1 --2- 172.21.15.62:0/2074809788 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fa3240cb1f0 0x7fa3240b3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:35.342 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.338+0000 7fa32b691700 1 --2- 172.21.15.62:0/2074809788 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa3240ad480 0x7fa3241f11d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:35.342 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.338+0000 7fa32b691700 1 -- 172.21.15.62:0/2074809788 >> 172.21.15.62:0/2074809788 conn(0x7fa32406a410 msgr2=0x7fa32406b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:35.343 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.338+0000 7fa32b691700 1 -- 172.21.15.62:0/2074809788 shutdown_connections 2023-06-09T04:42:35.343 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.338+0000 7fa32b691700 1 -- 172.21.15.62:0/2074809788 wait complete. 2023-06-09T04:42:35.364 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-06-09T04:42:35.365 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-09T04:42:35.540 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.538+0000 7f255a958700 1 Processor -- start 2023-06-09T04:42:35.541 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.538+0000 7f255a958700 1 -- start start 2023-06-09T04:42:35.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.542+0000 7f255a958700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f25540b23d0 0x7f25540cf480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:35.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.542+0000 7f255a958700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2554159df0 0x7f255415e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:35.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.542+0000 7f255a958700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f255415d730 con 0x7f2554159a20 2023-06-09T04:42:35.545 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.542+0000 7f255a958700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f255415dcf0 con 0x7f2554159df0 2023-06-09T04:42:35.545 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.542+0000 7f255a958700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25540cfaf0 con 0x7f25540b23d0 2023-06-09T04:42:35.547 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.542+0000 7f2559155700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f25540b23d0 0x7f25540cf480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:35.547 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.542+0000 7f2559956700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f2554159a20 0x7f25540b1cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.62:50972/0 (socket says 172.21.15.62:50972) 2023-06-09T04:42:35.547 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.542+0000 7f2559956700 1 -- 172.21.15.62:0/2876969832 learned_addr learned my addr 172.21.15.62:0/2876969832 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:42:35.547 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.542+0000 7f255a157700 1 --2- 172.21.15.62:0/2876969832 >> v2:172.21.15.62:3300/0 conn(0x7f2554159df0 0x7f255415e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:35.548 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.542+0000 7f255a157700 1 -- 172.21.15.62:0/2876969832 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f25540b23d0 msgr2=0x7f25540cf480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:35.548 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.542+0000 7f255a157700 1 --2- 172.21.15.62:0/2876969832 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f25540b23d0 0x7f25540cf480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:35.548 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.542+0000 7f255a157700 1 -- 172.21.15.62:0/2876969832 >> v1:172.21.15.89:6789/0 conn(0x7f2554159a20 legacy=0x7f25540b1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:35.549 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.542+0000 7f255a157700 1 -- 172.21.15.62:0/2876969832 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25540cfdd0 con 0x7f2554159df0 2023-06-09T04:42:35.549 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.542+0000 7f255a157700 1 --2- 172.21.15.62:0/2876969832 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2554159df0 0x7f255415e180 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f254c009d90 tx=0x7f254c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dfc26d972c54a40 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:35.549 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.542+0000 7f2558954700 1 -- 172.21.15.62:0/2876969832 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254c00e070 con 0x7f2554159df0 2023-06-09T04:42:35.549 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.542+0000 7f2558954700 1 -- 172.21.15.62:0/2876969832 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f254c003a40 con 0x7f2554159df0 2023-06-09T04:42:35.550 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.542+0000 7f2558954700 1 -- 172.21.15.62:0/2876969832 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254c003df0 con 0x7f2554159df0 2023-06-09T04:42:35.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.546+0000 7f255a958700 1 -- 172.21.15.62:0/2876969832 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2554159df0 msgr2=0x7f255415e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:35.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.546+0000 7f255a958700 1 --2- 172.21.15.62:0/2876969832 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2554159df0 0x7f255415e180 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f254c009d90 tx=0x7f254c00b330 comp rx=0 tx=0).stop 2023-06-09T04:42:35.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.546+0000 7f255a958700 1 -- 172.21.15.62:0/2876969832 shutdown_connections 2023-06-09T04:42:35.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.546+0000 7f255a958700 1 --2- 172.21.15.62:0/2876969832 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2554159df0 0x7f255415e180 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:35.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.546+0000 7f255a958700 1 --2- 172.21.15.62:0/2876969832 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f25540b23d0 0x7f25540cf480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:35.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.546+0000 7f255a958700 1 -- 172.21.15.62:0/2876969832 >> 172.21.15.62:0/2876969832 conn(0x7f25540cccc0 msgr2=0x7f25540cd0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:35.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.546+0000 7f255a958700 1 -- 172.21.15.62:0/2876969832 shutdown_connections 2023-06-09T04:42:35.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.546+0000 7f255a958700 1 -- 172.21.15.62:0/2876969832 wait complete. 2023-06-09T04:42:35.553 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.550+0000 7f255a958700 1 Processor -- start 2023-06-09T04:42:35.553 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.550+0000 7f255a958700 1 -- start start 2023-06-09T04:42:35.553 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.550+0000 7f255a958700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25540b23d0 0x7f255415a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:35.554 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.550+0000 7f255a958700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2554159a20 0x7f2554157b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:35.554 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.550+0000 7f255a958700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2554159df0 0x7f255415b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:35.554 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.550+0000 7f255a958700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f255415b550 con 0x7f2554159a20 2023-06-09T04:42:35.554 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.550+0000 7f255a958700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2554158c70 con 0x7f25540b23d0 2023-06-09T04:42:35.554 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.550+0000 7f255a958700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f255415a8d0 con 0x7f2554159df0 2023-06-09T04:42:35.555 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.550+0000 7f2559155700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2554159a20 0x7f2554157b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:35.555 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.550+0000 7f2559155700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2554159a20 0x7f2554157b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:37046/0 (socket says 172.21.15.62:37046) 2023-06-09T04:42:35.555 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.550+0000 7f2559155700 1 -- 172.21.15.62:0/1737116796 learned_addr learned my addr 172.21.15.62:0/1737116796 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:35.555 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.550+0000 7f2559956700 1 --2- 172.21.15.62:0/1737116796 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25540b23d0 0x7f255415a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:35.556 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.550+0000 7f255a157700 1 --2- 172.21.15.62:0/1737116796 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2554159df0 0x7f255415b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:35.556 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.550+0000 7f2559155700 1 -- 172.21.15.62:0/1737116796 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2554159df0 msgr2=0x7f255415b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:35.556 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.550+0000 7f2559155700 1 --2- 172.21.15.62:0/1737116796 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2554159df0 0x7f255415b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:35.556 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.550+0000 7f2559155700 1 -- 172.21.15.62:0/1737116796 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25540b23d0 msgr2=0x7f255415a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:35.556 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.550+0000 7f2559155700 1 --2- 172.21.15.62:0/1737116796 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25540b23d0 0x7f255415a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:35.556 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.550+0000 7f2559155700 1 -- 172.21.15.62:0/1737116796 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f254c009a70 con 0x7f2554159a20 2023-06-09T04:42:35.556 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.550+0000 7f2559956700 1 --2- 172.21.15.62:0/1737116796 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25540b23d0 0x7f255415a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:35.557 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.554+0000 7f2559155700 1 --2- 172.21.15.62:0/1737116796 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2554159a20 0x7f2554157b50 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f254400e9a0 tx=0x7f254400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:35.557 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.554+0000 7f254a7fc700 1 -- 172.21.15.62:0/1737116796 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2544009720 con 0x7f2554159a20 2023-06-09T04:42:35.557 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.554+0000 7f254a7fc700 1 -- 172.21.15.62:0/1737116796 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f254400c850 con 0x7f2554159a20 2023-06-09T04:42:35.558 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.554+0000 7f255a958700 1 -- 172.21.15.62:0/1737116796 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f255415abb0 con 0x7f2554159a20 2023-06-09T04:42:35.558 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.554+0000 7f254a7fc700 1 -- 172.21.15.62:0/1737116796 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254400cc00 con 0x7f2554159a20 2023-06-09T04:42:35.558 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.554+0000 7f255a958700 1 -- 172.21.15.62:0/1737116796 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f255415b170 con 0x7f2554159a20 2023-06-09T04:42:35.558 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.554+0000 7f255a958700 1 -- 172.21.15.62:0/1737116796 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f255415b690 con 0x7f2554159a20 2023-06-09T04:42:35.560 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.558+0000 7f254a7fc700 1 -- 172.21.15.62:0/1737116796 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f2544013470 con 0x7f2554159a20 2023-06-09T04:42:35.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.558+0000 7f254a7fc700 1 --2- 172.21.15.62:0/1737116796 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f2538066320 0x7f25380687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:35.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.558+0000 7f254a7fc700 1 -- 172.21.15.62:0/1737116796 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f2544083f60 con 0x7f2554159a20 2023-06-09T04:42:35.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.558+0000 7f2559956700 1 --2- 172.21.15.62:0/1737116796 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f2538066320 0x7f25380687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:35.563 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.562+0000 7f2559956700 1 --2- 172.21.15.62:0/1737116796 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f2538066320 0x7f25380687d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f25500070a0 tx=0x7f2550007e30 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:35.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.566+0000 7f254a7fc700 1 -- 172.21.15.62:0/1737116796 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f255415b690 con 0x7f2554159a20 2023-06-09T04:42:35.740 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.738+0000 7f255a958700 1 -- 172.21.15.62:0/1737116796 --> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f255415d980 con 0x7f2538066320 2023-06-09T04:42:35.757 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.754+0000 7f254a7fc700 1 -- 172.21.15.62:0/1737116796 <== mgr.4106 v2:172.21.15.89:6832/3073446405 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+309035 (secure 0 0 0) 0x7f2550005cd0 con 0x7f2538066320 2023-06-09T04:42:35.759 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:42:35.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.762+0000 7f255a958700 1 -- 172.21.15.62:0/1737116796 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f2538066320 msgr2=0x7f25380687d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:35.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.762+0000 7f255a958700 1 --2- 172.21.15.62:0/1737116796 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f2538066320 0x7f25380687d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f25500070a0 tx=0x7f2550007e30 comp rx=0 tx=0).stop 2023-06-09T04:42:35.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.762+0000 7f255a958700 1 -- 172.21.15.62:0/1737116796 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2554159a20 msgr2=0x7f2554157b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:35.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.762+0000 7f255a958700 1 --2- 172.21.15.62:0/1737116796 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2554159a20 0x7f2554157b50 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f254400e9a0 tx=0x7f254400ecb0 comp rx=0 tx=0).stop 2023-06-09T04:42:35.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.762+0000 7f255a958700 1 -- 172.21.15.62:0/1737116796 shutdown_connections 2023-06-09T04:42:35.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.762+0000 7f255a958700 1 --2- 172.21.15.62:0/1737116796 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f2538066320 0x7f25380687d0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:35.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.762+0000 7f255a958700 1 --2- 172.21.15.62:0/1737116796 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f2554159df0 0x7f255415b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:35.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.762+0000 7f255a958700 1 --2- 172.21.15.62:0/1737116796 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2554159a20 0x7f2554157b50 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:35.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.762+0000 7f255a958700 1 --2- 172.21.15.62:0/1737116796 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f25540b23d0 0x7f255415a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:35.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.762+0000 7f255a958700 1 -- 172.21.15.62:0/1737116796 >> 172.21.15.62:0/1737116796 conn(0x7f25540cccc0 msgr2=0x7f25540cd090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:35.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.762+0000 7f255a958700 1 -- 172.21.15.62:0/1737116796 shutdown_connections 2023-06-09T04:42:35.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:35.762+0000 7f255a958700 1 -- 172.21.15.62:0/1737116796 wait complete. 2023-06-09T04:42:35.767 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2023-06-09T04:42:35.786 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":92,"stamp":"2023-06-09T04:42:34.601901+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":136,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220744,"kb_used_data":5128,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754753976,"statfs":{"total":773094113280,"available":772868071424,"internally_reserved":0,"allocated":5251072,"data_stored":2973036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":45,"apply_latency_ms":45,"commit_latency_ns":45000000,"apply_latency_ns":45000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.642959"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.564134+0000","last_change":"2023-06-09T04:42:31.479344+0000","last_active":"2023-06-09T04:42:32.564134+0000","last_peered":"2023-06-09T04:42:32.564134+0000","last_clean":"2023-06-09T04:42:32.564134+0000","last_became_active":"2023-06-09T04:42:31.479058+0000","last_became_peered":"2023-06-09T04:42:31.479058+0000","last_unstale":"2023-06-09T04:42:32.564134+0000","last_undegraded":"2023-06-09T04:42:32.564134+0000","last_fullsized":"2023-06-09T04:42:32.564134+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:21:33.761909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.563734+0000","last_change":"2023-06-09T04:42:31.498634+0000","last_active":"2023-06-09T04:42:32.563734+0000","last_peered":"2023-06-09T04:42:32.563734+0000","last_clean":"2023-06-09T04:42:32.563734+0000","last_became_active":"2023-06-09T04:42:31.498184+0000","last_became_peered":"2023-06-09T04:42:31.498184+0000","last_unstale":"2023-06-09T04:42:32.563734+0000","last_undegraded":"2023-06-09T04:42:32.563734+0000","last_fullsized":"2023-06-09T04:42:32.563734+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:55:06.041733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.479258+0000","last_change":"2023-06-09T04:42:31.484967+0000","last_active":"2023-06-09T04:42:32.479258+0000","last_peered":"2023-06-09T04:42:32.479258+0000","last_clean":"2023-06-09T04:42:32.479258+0000","last_became_active":"2023-06-09T04:42:31.484439+0000","last_became_peered":"2023-06-09T04:42:31.484439+0000","last_unstale":"2023-06-09T04:42:32.479258+0000","last_undegraded":"2023-06-09T04:42:32.479258+0000","last_fullsized":"2023-06-09T04:42:32.479258+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:24:53.096922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.562257+0000","last_change":"2023-06-09T04:42:31.495543+0000","last_active":"2023-06-09T04:42:32.562257+0000","last_peered":"2023-06-09T04:42:32.562257+0000","last_clean":"2023-06-09T04:42:32.562257+0000","last_became_active":"2023-06-09T04:42:31.495297+0000","last_became_peered":"2023-06-09T04:42:31.495297+0000","last_unstale":"2023-06-09T04:42:32.562257+0000","last_undegraded":"2023-06-09T04:42:32.562257+0000","last_fullsized":"2023-06-09T04:42:32.562257+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:38:33.398228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.563184+0000","last_change":"2023-06-09T04:42:31.504927+0000","last_active":"2023-06-09T04:42:32.563184+0000","last_peered":"2023-06-09T04:42:32.563184+0000","last_clean":"2023-06-09T04:42:32.563184+0000","last_became_active":"2023-06-09T04:42:31.504590+0000","last_became_peered":"2023-06-09T04:42:31.504590+0000","last_unstale":"2023-06-09T04:42:32.563184+0000","last_undegraded":"2023-06-09T04:42:32.563184+0000","last_fullsized":"2023-06-09T04:42:32.563184+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:52:34.959948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.561628+0000","last_change":"2023-06-09T04:42:31.476868+0000","last_active":"2023-06-09T04:42:32.561628+0000","last_peered":"2023-06-09T04:42:32.561628+0000","last_clean":"2023-06-09T04:42:32.561628+0000","last_became_active":"2023-06-09T04:42:31.476589+0000","last_became_peered":"2023-06-09T04:42:31.476589+0000","last_unstale":"2023-06-09T04:42:32.561628+0000","last_undegraded":"2023-06-09T04:42:32.561628+0000","last_fullsized":"2023-06-09T04:42:32.561628+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:33:27.897310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.564232+0000","last_change":"2023-06-09T04:42:31.481515+0000","last_active":"2023-06-09T04:42:32.564232+0000","last_peered":"2023-06-09T04:42:32.564232+0000","last_clean":"2023-06-09T04:42:32.564232+0000","last_became_active":"2023-06-09T04:42:31.481252+0000","last_became_peered":"2023-06-09T04:42:31.481252+0000","last_unstale":"2023-06-09T04:42:32.564232+0000","last_undegraded":"2023-06-09T04:42:32.564232+0000","last_fullsized":"2023-06-09T04:42:32.564232+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T04:43:40.750824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.561040+0000","last_change":"2023-06-09T04:42:31.500591+0000","last_active":"2023-06-09T04:42:32.561040+0000","last_peered":"2023-06-09T04:42:32.561040+0000","last_clean":"2023-06-09T04:42:32.561040+0000","last_became_active":"2023-06-09T04:42:31.499588+0000","last_became_peered":"2023-06-09T04:42:31.499588+0000","last_unstale":"2023-06-09T04:42:32.561040+0000","last_undegraded":"2023-06-09T04:42:32.561040+0000","last_fullsized":"2023-06-09T04:42:32.561040+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:04:37.944946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.563326+0000","last_change":"2023-06-09T04:42:31.500484+0000","last_active":"2023-06-09T04:42:32.563326+0000","last_peered":"2023-06-09T04:42:32.563326+0000","last_clean":"2023-06-09T04:42:32.563326+0000","last_became_active":"2023-06-09T04:42:31.500008+0000","last_became_peered":"2023-06-09T04:42:31.500008+0000","last_unstale":"2023-06-09T04:42:32.563326+0000","last_undegraded":"2023-06-09T04:42:32.563326+0000","last_fullsized":"2023-06-09T04:42:32.563326+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:52:34.959948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.562868+0000","last_change":"2023-06-09T04:42:31.501587+0000","last_active":"2023-06-09T04:42:32.562868+0000","last_peered":"2023-06-09T04:42:32.562868+0000","last_clean":"2023-06-09T04:42:32.562868+0000","last_became_active":"2023-06-09T04:42:31.499750+0000","last_became_peered":"2023-06-09T04:42:31.499750+0000","last_unstale":"2023-06-09T04:42:32.562868+0000","last_undegraded":"2023-06-09T04:42:32.562868+0000","last_fullsized":"2023-06-09T04:42:32.562868+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:33:27.897310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.563208+0000","last_change":"2023-06-09T04:42:31.492189+0000","last_active":"2023-06-09T04:42:32.563208+0000","last_peered":"2023-06-09T04:42:32.563208+0000","last_clean":"2023-06-09T04:42:32.563208+0000","last_became_active":"2023-06-09T04:42:31.491804+0000","last_became_peered":"2023-06-09T04:42:31.491804+0000","last_unstale":"2023-06-09T04:42:32.563208+0000","last_undegraded":"2023-06-09T04:42:32.563208+0000","last_fullsized":"2023-06-09T04:42:32.563208+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:24:41.913943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.563563+0000","last_change":"2023-06-09T04:42:31.491443+0000","last_active":"2023-06-09T04:42:32.563563+0000","last_peered":"2023-06-09T04:42:32.563563+0000","last_clean":"2023-06-09T04:42:32.563563+0000","last_became_active":"2023-06-09T04:42:31.491149+0000","last_became_peered":"2023-06-09T04:42:31.491149+0000","last_unstale":"2023-06-09T04:42:32.563563+0000","last_undegraded":"2023-06-09T04:42:32.563563+0000","last_fullsized":"2023-06-09T04:42:32.563563+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:27:25.413089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.471470+0000","last_change":"2023-06-09T04:42:31.487452+0000","last_active":"2023-06-09T04:42:32.471470+0000","last_peered":"2023-06-09T04:42:32.471470+0000","last_clean":"2023-06-09T04:42:32.471470+0000","last_became_active":"2023-06-09T04:42:31.487047+0000","last_became_peered":"2023-06-09T04:42:31.487047+0000","last_unstale":"2023-06-09T04:42:32.471470+0000","last_undegraded":"2023-06-09T04:42:32.471470+0000","last_fullsized":"2023-06-09T04:42:32.471470+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:04:53.826017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.561521+0000","last_change":"2023-06-09T04:42:31.483914+0000","last_active":"2023-06-09T04:42:32.561521+0000","last_peered":"2023-06-09T04:42:32.561521+0000","last_clean":"2023-06-09T04:42:32.561521+0000","last_became_active":"2023-06-09T04:42:31.482784+0000","last_became_peered":"2023-06-09T04:42:31.482784+0000","last_unstale":"2023-06-09T04:42:32.561521+0000","last_undegraded":"2023-06-09T04:42:32.561521+0000","last_fullsized":"2023-06-09T04:42:32.561521+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:07:58.405912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.562181+0000","last_change":"2023-06-09T04:42:31.477517+0000","last_active":"2023-06-09T04:42:32.562181+0000","last_peered":"2023-06-09T04:42:32.562181+0000","last_clean":"2023-06-09T04:42:32.562181+0000","last_became_active":"2023-06-09T04:42:31.477044+0000","last_became_peered":"2023-06-09T04:42:31.477044+0000","last_unstale":"2023-06-09T04:42:32.562181+0000","last_undegraded":"2023-06-09T04:42:32.562181+0000","last_fullsized":"2023-06-09T04:42:32.562181+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:52:34.959948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.478727+0000","last_change":"2023-06-09T04:42:31.500595+0000","last_active":"2023-06-09T04:42:32.478727+0000","last_peered":"2023-06-09T04:42:32.478727+0000","last_clean":"2023-06-09T04:42:32.478727+0000","last_became_active":"2023-06-09T04:42:31.500292+0000","last_became_peered":"2023-06-09T04:42:31.500292+0000","last_unstale":"2023-06-09T04:42:32.478727+0000","last_undegraded":"2023-06-09T04:42:32.478727+0000","last_fullsized":"2023-06-09T04:42:32.478727+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:25:33.163147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.479645+0000","last_change":"2023-06-09T04:42:31.478530+0000","last_active":"2023-06-09T04:42:32.479645+0000","last_peered":"2023-06-09T04:42:32.479645+0000","last_clean":"2023-06-09T04:42:32.479645+0000","last_became_active":"2023-06-09T04:42:31.478189+0000","last_became_peered":"2023-06-09T04:42:31.478189+0000","last_unstale":"2023-06-09T04:42:32.479645+0000","last_undegraded":"2023-06-09T04:42:32.479645+0000","last_fullsized":"2023-06-09T04:42:32.479645+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:26:02.891756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.479487+0000","last_change":"2023-06-09T04:42:31.494844+0000","last_active":"2023-06-09T04:42:32.479487+0000","last_peered":"2023-06-09T04:42:32.479487+0000","last_clean":"2023-06-09T04:42:32.479487+0000","last_became_active":"2023-06-09T04:42:31.494570+0000","last_became_peered":"2023-06-09T04:42:31.494570+0000","last_unstale":"2023-06-09T04:42:32.479487+0000","last_undegraded":"2023-06-09T04:42:32.479487+0000","last_fullsized":"2023-06-09T04:42:32.479487+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:12:55.044632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.480604+0000","last_change":"2023-06-09T04:42:31.495741+0000","last_active":"2023-06-09T04:42:32.480604+0000","last_peered":"2023-06-09T04:42:32.480604+0000","last_clean":"2023-06-09T04:42:32.480604+0000","last_became_active":"2023-06-09T04:42:31.495445+0000","last_became_peered":"2023-06-09T04:42:31.495445+0000","last_unstale":"2023-06-09T04:42:32.480604+0000","last_undegraded":"2023-06-09T04:42:32.480604+0000","last_fullsized":"2023-06-09T04:42:32.480604+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:53:05.716291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.471675+0000","last_change":"2023-06-09T04:42:31.501606+0000","last_active":"2023-06-09T04:42:32.471675+0000","last_peered":"2023-06-09T04:42:32.471675+0000","last_clean":"2023-06-09T04:42:32.471675+0000","last_became_active":"2023-06-09T04:42:31.501197+0000","last_became_peered":"2023-06-09T04:42:31.501197+0000","last_unstale":"2023-06-09T04:42:32.471675+0000","last_undegraded":"2023-06-09T04:42:32.471675+0000","last_fullsized":"2023-06-09T04:42:32.471675+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:01:15.130085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.562125+0000","last_change":"2023-06-09T04:42:31.493087+0000","last_active":"2023-06-09T04:42:32.562125+0000","last_peered":"2023-06-09T04:42:32.562125+0000","last_clean":"2023-06-09T04:42:32.562125+0000","last_became_active":"2023-06-09T04:42:31.492811+0000","last_became_peered":"2023-06-09T04:42:31.492811+0000","last_unstale":"2023-06-09T04:42:32.562125+0000","last_undegraded":"2023-06-09T04:42:32.562125+0000","last_fullsized":"2023-06-09T04:42:32.562125+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:24:41.913943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.561737+0000","last_change":"2023-06-09T04:42:31.496215+0000","last_active":"2023-06-09T04:42:32.561737+0000","last_peered":"2023-06-09T04:42:32.561737+0000","last_clean":"2023-06-09T04:42:32.561737+0000","last_became_active":"2023-06-09T04:42:31.495940+0000","last_became_peered":"2023-06-09T04:42:31.495940+0000","last_unstale":"2023-06-09T04:42:32.561737+0000","last_undegraded":"2023-06-09T04:42:32.561737+0000","last_fullsized":"2023-06-09T04:42:32.561737+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:15:16.784831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.479679+0000","last_change":"2023-06-09T04:42:31.477341+0000","last_active":"2023-06-09T04:42:32.479679+0000","last_peered":"2023-06-09T04:42:32.479679+0000","last_clean":"2023-06-09T04:42:32.479679+0000","last_became_active":"2023-06-09T04:42:31.476581+0000","last_became_peered":"2023-06-09T04:42:31.476581+0000","last_unstale":"2023-06-09T04:42:32.479679+0000","last_undegraded":"2023-06-09T04:42:32.479679+0000","last_fullsized":"2023-06-09T04:42:32.479679+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:04:39.065206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.478862+0000","last_change":"2023-06-09T04:42:31.476939+0000","last_active":"2023-06-09T04:42:32.478862+0000","last_peered":"2023-06-09T04:42:32.478862+0000","last_clean":"2023-06-09T04:42:32.478862+0000","last_became_active":"2023-06-09T04:42:31.476596+0000","last_became_peered":"2023-06-09T04:42:31.476596+0000","last_unstale":"2023-06-09T04:42:32.478862+0000","last_undegraded":"2023-06-09T04:42:32.478862+0000","last_fullsized":"2023-06-09T04:42:32.478862+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:51:10.102526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.480410+0000","last_change":"2023-06-09T04:42:31.488653+0000","last_active":"2023-06-09T04:42:32.480410+0000","last_peered":"2023-06-09T04:42:32.480410+0000","last_clean":"2023-06-09T04:42:32.480410+0000","last_became_active":"2023-06-09T04:42:31.485262+0000","last_became_peered":"2023-06-09T04:42:31.485262+0000","last_unstale":"2023-06-09T04:42:32.480410+0000","last_undegraded":"2023-06-09T04:42:32.480410+0000","last_fullsized":"2023-06-09T04:42:32.480410+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:44:21.810252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.472166+0000","last_change":"2023-06-09T04:42:31.488751+0000","last_active":"2023-06-09T04:42:32.472166+0000","last_peered":"2023-06-09T04:42:32.472166+0000","last_clean":"2023-06-09T04:42:32.472166+0000","last_became_active":"2023-06-09T04:42:31.488478+0000","last_became_peered":"2023-06-09T04:42:31.488478+0000","last_unstale":"2023-06-09T04:42:32.472166+0000","last_undegraded":"2023-06-09T04:42:32.472166+0000","last_fullsized":"2023-06-09T04:42:32.472166+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:19:37.505923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.479334+0000","last_change":"2023-06-09T04:42:31.478231+0000","last_active":"2023-06-09T04:42:32.479334+0000","last_peered":"2023-06-09T04:42:32.479334+0000","last_clean":"2023-06-09T04:42:32.479334+0000","last_became_active":"2023-06-09T04:42:31.477949+0000","last_became_peered":"2023-06-09T04:42:31.477949+0000","last_unstale":"2023-06-09T04:42:32.479334+0000","last_undegraded":"2023-06-09T04:42:32.479334+0000","last_fullsized":"2023-06-09T04:42:32.479334+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:43:31.155528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.563829+0000","last_change":"2023-06-09T04:42:31.491116+0000","last_active":"2023-06-09T04:42:32.563829+0000","last_peered":"2023-06-09T04:42:32.563829+0000","last_clean":"2023-06-09T04:42:32.563829+0000","last_became_active":"2023-06-09T04:42:31.490837+0000","last_became_peered":"2023-06-09T04:42:31.490837+0000","last_unstale":"2023-06-09T04:42:32.563829+0000","last_undegraded":"2023-06-09T04:42:32.563829+0000","last_fullsized":"2023-06-09T04:42:32.563829+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:00:22.568885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.480352+0000","last_change":"2023-06-09T04:42:31.478565+0000","last_active":"2023-06-09T04:42:32.480352+0000","last_peered":"2023-06-09T04:42:32.480352+0000","last_clean":"2023-06-09T04:42:32.480352+0000","last_became_active":"2023-06-09T04:42:31.478016+0000","last_became_peered":"2023-06-09T04:42:31.478016+0000","last_unstale":"2023-06-09T04:42:32.480352+0000","last_undegraded":"2023-06-09T04:42:32.480352+0000","last_fullsized":"2023-06-09T04:42:32.480352+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:01:46.303791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.479116+0000","last_change":"2023-06-09T04:42:31.478815+0000","last_active":"2023-06-09T04:42:32.479116+0000","last_peered":"2023-06-09T04:42:32.479116+0000","last_clean":"2023-06-09T04:42:32.479116+0000","last_became_active":"2023-06-09T04:42:31.478551+0000","last_became_peered":"2023-06-09T04:42:31.478551+0000","last_unstale":"2023-06-09T04:42:32.479116+0000","last_undegraded":"2023-06-09T04:42:32.479116+0000","last_fullsized":"2023-06-09T04:42:32.479116+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:45:50.291024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.562319+0000","last_change":"2023-06-09T04:42:31.477292+0000","last_active":"2023-06-09T04:42:32.562319+0000","last_peered":"2023-06-09T04:42:32.562319+0000","last_clean":"2023-06-09T04:42:32.562319+0000","last_became_active":"2023-06-09T04:42:31.476754+0000","last_became_peered":"2023-06-09T04:42:31.476754+0000","last_unstale":"2023-06-09T04:42:32.562319+0000","last_undegraded":"2023-06-09T04:42:32.562319+0000","last_fullsized":"2023-06-09T04:42:32.562319+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:40:00.279793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.471125+0000","last_change":"2023-06-09T04:42:31.483828+0000","last_active":"2023-06-09T04:42:32.471125+0000","last_peered":"2023-06-09T04:42:32.471125+0000","last_clean":"2023-06-09T04:42:32.471125+0000","last_became_active":"2023-06-09T04:42:31.483566+0000","last_became_peered":"2023-06-09T04:42:31.483566+0000","last_unstale":"2023-06-09T04:42:32.471125+0000","last_undegraded":"2023-06-09T04:42:32.471125+0000","last_fullsized":"2023-06-09T04:42:32.471125+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:24:06.467092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.560268+0000","last_change":"2023-06-09T04:42:31.478762+0000","last_active":"2023-06-09T04:42:32.560268+0000","last_peered":"2023-06-09T04:42:32.560268+0000","last_clean":"2023-06-09T04:42:32.560268+0000","last_became_active":"2023-06-09T04:42:31.478313+0000","last_became_peered":"2023-06-09T04:42:31.478313+0000","last_unstale":"2023-06-09T04:42:32.560268+0000","last_undegraded":"2023-06-09T04:42:32.560268+0000","last_fullsized":"2023-06-09T04:42:32.560268+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:34:02.137046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"42'4","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.562686+0000","last_change":"2023-06-09T04:42:30.999201+0000","last_active":"2023-06-09T04:42:32.562686+0000","last_peered":"2023-06-09T04:42:32.562686+0000","last_clean":"2023-06-09T04:42:32.562686+0000","last_became_active":"2023-06-09T04:42:30.998923+0000","last_became_peered":"2023-06-09T04:42:30.998923+0000","last_unstale":"2023-06-09T04:42:32.562686+0000","last_undegraded":"2023-06-09T04:42:32.562686+0000","last_fullsized":"2023-06-09T04:42:32.562686+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_clean_scrub_stamp":"2023-06-09T04:42:29.940868+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:00:21.553743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.480489+0000","last_change":"2023-06-09T04:42:31.488254+0000","last_active":"2023-06-09T04:42:32.480489+0000","last_peered":"2023-06-09T04:42:32.480489+0000","last_clean":"2023-06-09T04:42:32.480489+0000","last_became_active":"2023-06-09T04:42:31.485188+0000","last_became_peered":"2023-06-09T04:42:31.485188+0000","last_unstale":"2023-06-09T04:42:32.480489+0000","last_undegraded":"2023-06-09T04:42:32.480489+0000","last_fullsized":"2023-06-09T04:42:32.480489+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:53:34.906721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"42'1","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.479650+0000","last_change":"2023-06-09T04:42:30.998307+0000","last_active":"2023-06-09T04:42:32.479650+0000","last_peered":"2023-06-09T04:42:32.479650+0000","last_clean":"2023-06-09T04:42:32.479650+0000","last_became_active":"2023-06-09T04:42:30.997825+0000","last_became_peered":"2023-06-09T04:42:30.997825+0000","last_unstale":"2023-06-09T04:42:32.479650+0000","last_undegraded":"2023-06-09T04:42:32.479650+0000","last_fullsized":"2023-06-09T04:42:32.479650+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_clean_scrub_stamp":"2023-06-09T04:42:29.940868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:59:35.204244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.563986+0000","last_change":"2023-06-09T04:42:31.484449+0000","last_active":"2023-06-09T04:42:32.563986+0000","last_peered":"2023-06-09T04:42:32.563986+0000","last_clean":"2023-06-09T04:42:32.563986+0000","last_became_active":"2023-06-09T04:42:31.484162+0000","last_became_peered":"2023-06-09T04:42:31.484162+0000","last_unstale":"2023-06-09T04:42:32.563986+0000","last_undegraded":"2023-06-09T04:42:32.563986+0000","last_fullsized":"2023-06-09T04:42:32.563986+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:41:39.853833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"42'2","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.560421+0000","last_change":"2023-06-09T04:42:30.998607+0000","last_active":"2023-06-09T04:42:32.560421+0000","last_peered":"2023-06-09T04:42:32.560421+0000","last_clean":"2023-06-09T04:42:32.560421+0000","last_became_active":"2023-06-09T04:42:30.997529+0000","last_became_peered":"2023-06-09T04:42:30.997529+0000","last_unstale":"2023-06-09T04:42:32.560421+0000","last_undegraded":"2023-06-09T04:42:32.560421+0000","last_fullsized":"2023-06-09T04:42:32.560421+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_clean_scrub_stamp":"2023-06-09T04:42:29.940868+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:40:16.903368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.560479+0000","last_change":"2023-06-09T04:42:31.489531+0000","last_active":"2023-06-09T04:42:32.560479+0000","last_peered":"2023-06-09T04:42:32.560479+0000","last_clean":"2023-06-09T04:42:32.560479+0000","last_became_active":"2023-06-09T04:42:31.489248+0000","last_became_peered":"2023-06-09T04:42:31.489248+0000","last_unstale":"2023-06-09T04:42:32.560479+0000","last_undegraded":"2023-06-09T04:42:32.560479+0000","last_fullsized":"2023-06-09T04:42:32.560479+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:07:58.405912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"42'2","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.564258+0000","last_change":"2023-06-09T04:42:30.992544+0000","last_active":"2023-06-09T04:42:32.564258+0000","last_peered":"2023-06-09T04:42:32.564258+0000","last_clean":"2023-06-09T04:42:32.564258+0000","last_became_active":"2023-06-09T04:42:30.992227+0000","last_became_peered":"2023-06-09T04:42:30.992227+0000","last_unstale":"2023-06-09T04:42:32.564258+0000","last_undegraded":"2023-06-09T04:42:32.564258+0000","last_fullsized":"2023-06-09T04:42:32.564258+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_clean_scrub_stamp":"2023-06-09T04:42:29.940868+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:26:40.814962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.478984+0000","last_change":"2023-06-09T04:42:31.496893+0000","last_active":"2023-06-09T04:42:32.478984+0000","last_peered":"2023-06-09T04:42:32.478984+0000","last_clean":"2023-06-09T04:42:32.478984+0000","last_became_active":"2023-06-09T04:42:31.496624+0000","last_became_peered":"2023-06-09T04:42:31.496624+0000","last_unstale":"2023-06-09T04:42:32.478984+0000","last_undegraded":"2023-06-09T04:42:32.478984+0000","last_fullsized":"2023-06-09T04:42:32.478984+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:33:34.176799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"42'1","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.562545+0000","last_change":"2023-06-09T04:42:30.993281+0000","last_active":"2023-06-09T04:42:32.562545+0000","last_peered":"2023-06-09T04:42:32.562545+0000","last_clean":"2023-06-09T04:42:32.562545+0000","last_became_active":"2023-06-09T04:42:30.993007+0000","last_became_peered":"2023-06-09T04:42:30.993007+0000","last_unstale":"2023-06-09T04:42:32.562545+0000","last_undegraded":"2023-06-09T04:42:32.562545+0000","last_fullsized":"2023-06-09T04:42:32.562545+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_clean_scrub_stamp":"2023-06-09T04:42:29.940868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:55:05.026590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.561906+0000","last_change":"2023-06-09T04:42:31.491770+0000","last_active":"2023-06-09T04:42:32.561906+0000","last_peered":"2023-06-09T04:42:32.561906+0000","last_clean":"2023-06-09T04:42:32.561906+0000","last_became_active":"2023-06-09T04:42:31.491394+0000","last_became_peered":"2023-06-09T04:42:31.491394+0000","last_unstale":"2023-06-09T04:42:32.561906+0000","last_undegraded":"2023-06-09T04:42:32.561906+0000","last_fullsized":"2023-06-09T04:42:32.561906+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:22:20.474949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"42'1","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.479253+0000","last_change":"2023-06-09T04:42:30.992420+0000","last_active":"2023-06-09T04:42:32.479253+0000","last_peered":"2023-06-09T04:42:32.479253+0000","last_clean":"2023-06-09T04:42:32.479253+0000","last_became_active":"2023-06-09T04:42:30.992161+0000","last_became_peered":"2023-06-09T04:42:30.992161+0000","last_unstale":"2023-06-09T04:42:32.479253+0000","last_undegraded":"2023-06-09T04:42:32.479253+0000","last_fullsized":"2023-06-09T04:42:32.479253+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_clean_scrub_stamp":"2023-06-09T04:42:29.940868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:17:44.035751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.561125+0000","last_change":"2023-06-09T04:42:31.500359+0000","last_active":"2023-06-09T04:42:32.561125+0000","last_peered":"2023-06-09T04:42:32.561125+0000","last_clean":"2023-06-09T04:42:32.561125+0000","last_became_active":"2023-06-09T04:42:31.496279+0000","last_became_peered":"2023-06-09T04:42:31.496279+0000","last_unstale":"2023-06-09T04:42:32.561125+0000","last_undegraded":"2023-06-09T04:42:32.561125+0000","last_fullsized":"2023-06-09T04:42:32.561125+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:01:38.471310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.562944+0000","last_change":"2023-06-09T04:42:30.998026+0000","last_active":"2023-06-09T04:42:32.562944+0000","last_peered":"2023-06-09T04:42:32.562944+0000","last_clean":"2023-06-09T04:42:32.562944+0000","last_became_active":"2023-06-09T04:42:30.997598+0000","last_became_peered":"2023-06-09T04:42:30.997598+0000","last_unstale":"2023-06-09T04:42:32.562944+0000","last_undegraded":"2023-06-09T04:42:32.562944+0000","last_fullsized":"2023-06-09T04:42:32.562944+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_clean_scrub_stamp":"2023-06-09T04:42:29.940868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T04:55:58.055395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.479520+0000","last_change":"2023-06-09T04:42:31.485495+0000","last_active":"2023-06-09T04:42:32.479520+0000","last_peered":"2023-06-09T04:42:32.479520+0000","last_clean":"2023-06-09T04:42:32.479520+0000","last_became_active":"2023-06-09T04:42:31.484092+0000","last_became_peered":"2023-06-09T04:42:31.484092+0000","last_unstale":"2023-06-09T04:42:32.479520+0000","last_undegraded":"2023-06-09T04:42:32.479520+0000","last_fullsized":"2023-06-09T04:42:32.479520+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:35:55.163527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.561238+0000","last_change":"2023-06-09T04:42:30.996410+0000","last_active":"2023-06-09T04:42:32.561238+0000","last_peered":"2023-06-09T04:42:32.561238+0000","last_clean":"2023-06-09T04:42:32.561238+0000","last_became_active":"2023-06-09T04:42:30.995903+0000","last_became_peered":"2023-06-09T04:42:30.995903+0000","last_unstale":"2023-06-09T04:42:32.561238+0000","last_undegraded":"2023-06-09T04:42:32.561238+0000","last_fullsized":"2023-06-09T04:42:32.561238+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_clean_scrub_stamp":"2023-06-09T04:42:29.940868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:34:01.121903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.479644+0000","last_change":"2023-06-09T04:42:31.495619+0000","last_active":"2023-06-09T04:42:32.479644+0000","last_peered":"2023-06-09T04:42:32.479644+0000","last_clean":"2023-06-09T04:42:32.479644+0000","last_became_active":"2023-06-09T04:42:31.495363+0000","last_became_peered":"2023-06-09T04:42:31.495363+0000","last_unstale":"2023-06-09T04:42:32.479644+0000","last_undegraded":"2023-06-09T04:42:32.479644+0000","last_fullsized":"2023-06-09T04:42:32.479644+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:56:06.788007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.480072+0000","last_change":"2023-06-09T04:42:30.994339+0000","last_active":"2023-06-09T04:42:32.480072+0000","last_peered":"2023-06-09T04:42:32.480072+0000","last_clean":"2023-06-09T04:42:32.480072+0000","last_became_active":"2023-06-09T04:42:30.994042+0000","last_became_peered":"2023-06-09T04:42:30.994042+0000","last_unstale":"2023-06-09T04:42:32.480072+0000","last_undegraded":"2023-06-09T04:42:32.480072+0000","last_fullsized":"2023-06-09T04:42:32.480072+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_clean_scrub_stamp":"2023-06-09T04:42:29.940868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:13:34.025727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.564407+0000","last_change":"2023-06-09T04:42:31.478765+0000","last_active":"2023-06-09T04:42:32.564407+0000","last_peered":"2023-06-09T04:42:32.564407+0000","last_clean":"2023-06-09T04:42:32.564407+0000","last_became_active":"2023-06-09T04:42:31.477876+0000","last_became_peered":"2023-06-09T04:42:31.477876+0000","last_unstale":"2023-06-09T04:42:32.564407+0000","last_undegraded":"2023-06-09T04:42:32.564407+0000","last_fullsized":"2023-06-09T04:42:32.564407+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:29:12.130785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.563123+0000","last_change":"2023-06-09T04:42:30.998878+0000","last_active":"2023-06-09T04:42:32.563123+0000","last_peered":"2023-06-09T04:42:32.563123+0000","last_clean":"2023-06-09T04:42:32.563123+0000","last_became_active":"2023-06-09T04:42:30.998574+0000","last_became_peered":"2023-06-09T04:42:30.998574+0000","last_unstale":"2023-06-09T04:42:32.563123+0000","last_undegraded":"2023-06-09T04:42:32.563123+0000","last_fullsized":"2023-06-09T04:42:32.563123+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_clean_scrub_stamp":"2023-06-09T04:42:29.940868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T04:55:58.055395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.562840+0000","last_change":"2023-06-09T04:42:31.490068+0000","last_active":"2023-06-09T04:42:32.562840+0000","last_peered":"2023-06-09T04:42:32.562840+0000","last_clean":"2023-06-09T04:42:32.562840+0000","last_became_active":"2023-06-09T04:42:31.489608+0000","last_became_peered":"2023-06-09T04:42:31.489608+0000","last_unstale":"2023-06-09T04:42:32.562840+0000","last_undegraded":"2023-06-09T04:42:32.562840+0000","last_fullsized":"2023-06-09T04:42:32.562840+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:40:39.931202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"42'3","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.564355+0000","last_change":"2023-06-09T04:42:31.000506+0000","last_active":"2023-06-09T04:42:32.564355+0000","last_peered":"2023-06-09T04:42:32.564355+0000","last_clean":"2023-06-09T04:42:32.564355+0000","last_became_active":"2023-06-09T04:42:31.000243+0000","last_became_peered":"2023-06-09T04:42:31.000243+0000","last_unstale":"2023-06-09T04:42:32.564355+0000","last_undegraded":"2023-06-09T04:42:32.564355+0000","last_fullsized":"2023-06-09T04:42:32.564355+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_clean_scrub_stamp":"2023-06-09T04:42:29.940868+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:55:05.573347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.564198+0000","last_change":"2023-06-09T04:42:31.482514+0000","last_active":"2023-06-09T04:42:32.564198+0000","last_peered":"2023-06-09T04:42:32.564198+0000","last_clean":"2023-06-09T04:42:32.564198+0000","last_became_active":"2023-06-09T04:42:31.482183+0000","last_became_peered":"2023-06-09T04:42:31.482183+0000","last_unstale":"2023-06-09T04:42:32.564198+0000","last_undegraded":"2023-06-09T04:42:32.564198+0000","last_fullsized":"2023-06-09T04:42:32.564198+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:37:40.949770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"42'6","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.471768+0000","last_change":"2023-06-09T04:42:30.993703+0000","last_active":"2023-06-09T04:42:32.471768+0000","last_peered":"2023-06-09T04:42:32.471768+0000","last_clean":"2023-06-09T04:42:32.471768+0000","last_became_active":"2023-06-09T04:42:30.993424+0000","last_became_peered":"2023-06-09T04:42:30.993424+0000","last_unstale":"2023-06-09T04:42:32.471768+0000","last_undegraded":"2023-06-09T04:42:32.471768+0000","last_fullsized":"2023-06-09T04:42:32.471768+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_clean_scrub_stamp":"2023-06-09T04:42:29.940868+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:58:03.068259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.479973+0000","last_change":"2023-06-09T04:42:31.489392+0000","last_active":"2023-06-09T04:42:32.479973+0000","last_peered":"2023-06-09T04:42:32.479973+0000","last_clean":"2023-06-09T04:42:32.479973+0000","last_became_active":"2023-06-09T04:42:31.489105+0000","last_became_peered":"2023-06-09T04:42:31.489105+0000","last_unstale":"2023-06-09T04:42:32.479973+0000","last_undegraded":"2023-06-09T04:42:32.479973+0000","last_fullsized":"2023-06-09T04:42:32.479973+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:25:13.016490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"42'2","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.562763+0000","last_change":"2023-06-09T04:42:31.002540+0000","last_active":"2023-06-09T04:42:32.562763+0000","last_peered":"2023-06-09T04:42:32.562763+0000","last_clean":"2023-06-09T04:42:32.562763+0000","last_became_active":"2023-06-09T04:42:31.002260+0000","last_became_peered":"2023-06-09T04:42:31.002260+0000","last_unstale":"2023-06-09T04:42:32.562763+0000","last_undegraded":"2023-06-09T04:42:32.562763+0000","last_fullsized":"2023-06-09T04:42:32.562763+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_clean_scrub_stamp":"2023-06-09T04:42:29.940868+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:41:38.838691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.562096+0000","last_change":"2023-06-09T04:42:31.482284+0000","last_active":"2023-06-09T04:42:32.562096+0000","last_peered":"2023-06-09T04:42:32.562096+0000","last_clean":"2023-06-09T04:42:32.562096+0000","last_became_active":"2023-06-09T04:42:31.481968+0000","last_became_peered":"2023-06-09T04:42:31.481968+0000","last_unstale":"2023-06-09T04:42:32.562096+0000","last_undegraded":"2023-06-09T04:42:32.562096+0000","last_fullsized":"2023-06-09T04:42:32.562096+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:42:16.281590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.564197+0000","last_change":"2023-06-09T04:42:30.993560+0000","last_active":"2023-06-09T04:42:32.564197+0000","last_peered":"2023-06-09T04:42:32.564197+0000","last_clean":"2023-06-09T04:42:32.564197+0000","last_became_active":"2023-06-09T04:42:30.993239+0000","last_became_peered":"2023-06-09T04:42:30.993239+0000","last_unstale":"2023-06-09T04:42:32.564197+0000","last_undegraded":"2023-06-09T04:42:32.564197+0000","last_fullsized":"2023-06-09T04:42:32.564197+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_clean_scrub_stamp":"2023-06-09T04:42:29.940868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:35:58.058048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.561399+0000","last_change":"2023-06-09T04:42:31.488129+0000","last_active":"2023-06-09T04:42:32.561399+0000","last_peered":"2023-06-09T04:42:32.561399+0000","last_clean":"2023-06-09T04:42:32.561399+0000","last_became_active":"2023-06-09T04:42:31.487824+0000","last_became_peered":"2023-06-09T04:42:31.487824+0000","last_unstale":"2023-06-09T04:42:32.561399+0000","last_undegraded":"2023-06-09T04:42:32.561399+0000","last_fullsized":"2023-06-09T04:42:32.561399+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:20:39.543980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.562449+0000","last_change":"2023-06-09T04:42:31.003354+0000","last_active":"2023-06-09T04:42:32.562449+0000","last_peered":"2023-06-09T04:42:32.562449+0000","last_clean":"2023-06-09T04:42:32.562449+0000","last_became_active":"2023-06-09T04:42:31.003093+0000","last_became_peered":"2023-06-09T04:42:31.003093+0000","last_unstale":"2023-06-09T04:42:32.562449+0000","last_undegraded":"2023-06-09T04:42:32.562449+0000","last_fullsized":"2023-06-09T04:42:32.562449+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_clean_scrub_stamp":"2023-06-09T04:42:29.940868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:20:57.735736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.563640+0000","last_change":"2023-06-09T04:42:31.497178+0000","last_active":"2023-06-09T04:42:32.563640+0000","last_peered":"2023-06-09T04:42:32.563640+0000","last_clean":"2023-06-09T04:42:32.563640+0000","last_became_active":"2023-06-09T04:42:31.496823+0000","last_became_peered":"2023-06-09T04:42:31.496823+0000","last_unstale":"2023-06-09T04:42:32.563640+0000","last_undegraded":"2023-06-09T04:42:32.563640+0000","last_fullsized":"2023-06-09T04:42:32.563640+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:40:39.931202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"42'8","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.561333+0000","last_change":"2023-06-09T04:42:30.996186+0000","last_active":"2023-06-09T04:42:32.561333+0000","last_peered":"2023-06-09T04:42:32.561333+0000","last_clean":"2023-06-09T04:42:32.561333+0000","last_became_active":"2023-06-09T04:42:30.995519+0000","last_became_peered":"2023-06-09T04:42:30.995519+0000","last_unstale":"2023-06-09T04:42:32.561333+0000","last_undegraded":"2023-06-09T04:42:32.561333+0000","last_fullsized":"2023-06-09T04:42:32.561333+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_clean_scrub_stamp":"2023-06-09T04:42:29.940868+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:28:52.295148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.472100+0000","last_change":"2023-06-09T04:42:31.482251+0000","last_active":"2023-06-09T04:42:32.472100+0000","last_peered":"2023-06-09T04:42:32.472100+0000","last_clean":"2023-06-09T04:42:32.472100+0000","last_became_active":"2023-06-09T04:42:31.481991+0000","last_became_peered":"2023-06-09T04:42:31.481991+0000","last_unstale":"2023-06-09T04:42:32.472100+0000","last_undegraded":"2023-06-09T04:42:32.472100+0000","last_fullsized":"2023-06-09T04:42:32.472100+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:42:54.453446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"42'1","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.472172+0000","last_change":"2023-06-09T04:42:30.997952+0000","last_active":"2023-06-09T04:42:32.472172+0000","last_peered":"2023-06-09T04:42:32.472172+0000","last_clean":"2023-06-09T04:42:32.472172+0000","last_became_active":"2023-06-09T04:42:30.997680+0000","last_became_peered":"2023-06-09T04:42:30.997680+0000","last_unstale":"2023-06-09T04:42:32.472172+0000","last_undegraded":"2023-06-09T04:42:32.472172+0000","last_fullsized":"2023-06-09T04:42:32.472172+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_clean_scrub_stamp":"2023-06-09T04:42:29.940868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:51:05.281032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.563373+0000","last_change":"2023-06-09T04:42:31.491677+0000","last_active":"2023-06-09T04:42:32.563373+0000","last_peered":"2023-06-09T04:42:32.563373+0000","last_clean":"2023-06-09T04:42:32.563373+0000","last_became_active":"2023-06-09T04:42:31.491269+0000","last_became_peered":"2023-06-09T04:42:31.491269+0000","last_unstale":"2023-06-09T04:42:32.563373+0000","last_undegraded":"2023-06-09T04:42:32.563373+0000","last_fullsized":"2023-06-09T04:42:32.563373+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:40:00.279793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"42'2","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.480435+0000","last_change":"2023-06-09T04:42:30.997230+0000","last_active":"2023-06-09T04:42:32.480435+0000","last_peered":"2023-06-09T04:42:32.480435+0000","last_clean":"2023-06-09T04:42:32.480435+0000","last_became_active":"2023-06-09T04:42:30.996903+0000","last_became_peered":"2023-06-09T04:42:30.996903+0000","last_unstale":"2023-06-09T04:42:32.480435+0000","last_undegraded":"2023-06-09T04:42:32.480435+0000","last_fullsized":"2023-06-09T04:42:32.480435+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_clean_scrub_stamp":"2023-06-09T04:42:29.940868+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:06:28.367823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.480391+0000","last_change":"2023-06-09T04:42:31.488055+0000","last_active":"2023-06-09T04:42:32.480391+0000","last_peered":"2023-06-09T04:42:32.480391+0000","last_clean":"2023-06-09T04:42:32.480391+0000","last_became_active":"2023-06-09T04:42:31.487745+0000","last_became_peered":"2023-06-09T04:42:31.487745+0000","last_unstale":"2023-06-09T04:42:32.480391+0000","last_undegraded":"2023-06-09T04:42:32.480391+0000","last_fullsized":"2023-06-09T04:42:32.480391+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T04:53:16.885700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"42'1","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.563917+0000","last_change":"2023-06-09T04:42:30.997900+0000","last_active":"2023-06-09T04:42:32.563917+0000","last_peered":"2023-06-09T04:42:32.563917+0000","last_clean":"2023-06-09T04:42:32.563917+0000","last_became_active":"2023-06-09T04:42:30.997604+0000","last_became_peered":"2023-06-09T04:42:30.997604+0000","last_unstale":"2023-06-09T04:42:32.563917+0000","last_undegraded":"2023-06-09T04:42:32.563917+0000","last_fullsized":"2023-06-09T04:42:32.563917+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_clean_scrub_stamp":"2023-06-09T04:42:29.940868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:16:11.588557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.480203+0000","last_change":"2023-06-09T04:42:31.488567+0000","last_active":"2023-06-09T04:42:32.480203+0000","last_peered":"2023-06-09T04:42:32.480203+0000","last_clean":"2023-06-09T04:42:32.480203+0000","last_became_active":"2023-06-09T04:42:31.485296+0000","last_became_peered":"2023-06-09T04:42:31.485296+0000","last_unstale":"2023-06-09T04:42:32.480203+0000","last_undegraded":"2023-06-09T04:42:32.480203+0000","last_fullsized":"2023-06-09T04:42:32.480203+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:22:56.756161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.562943+0000","last_change":"2023-06-09T04:42:30.998358+0000","last_active":"2023-06-09T04:42:32.562943+0000","last_peered":"2023-06-09T04:42:32.562943+0000","last_clean":"2023-06-09T04:42:32.562943+0000","last_became_active":"2023-06-09T04:42:30.998052+0000","last_became_peered":"2023-06-09T04:42:30.998052+0000","last_unstale":"2023-06-09T04:42:32.562943+0000","last_undegraded":"2023-06-09T04:42:32.562943+0000","last_fullsized":"2023-06-09T04:42:32.562943+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_clean_scrub_stamp":"2023-06-09T04:42:29.940868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:46:50.843413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.561815+0000","last_change":"2023-06-09T04:42:31.485913+0000","last_active":"2023-06-09T04:42:32.561815+0000","last_peered":"2023-06-09T04:42:32.561815+0000","last_clean":"2023-06-09T04:42:32.561815+0000","last_became_active":"2023-06-09T04:42:31.485638+0000","last_became_peered":"2023-06-09T04:42:31.485638+0000","last_unstale":"2023-06-09T04:42:32.561815+0000","last_undegraded":"2023-06-09T04:42:32.561815+0000","last_fullsized":"2023-06-09T04:42:32.561815+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:35:28.103518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"42'2","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.562757+0000","last_change":"2023-06-09T04:42:30.994778+0000","last_active":"2023-06-09T04:42:32.562757+0000","last_peered":"2023-06-09T04:42:32.562757+0000","last_clean":"2023-06-09T04:42:32.562757+0000","last_became_active":"2023-06-09T04:42:30.994466+0000","last_became_peered":"2023-06-09T04:42:30.994466+0000","last_unstale":"2023-06-09T04:42:32.562757+0000","last_undegraded":"2023-06-09T04:42:32.562757+0000","last_fullsized":"2023-06-09T04:42:32.562757+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_clean_scrub_stamp":"2023-06-09T04:42:29.940868+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:16:11.588557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.560637+0000","last_change":"2023-06-09T04:42:31.473998+0000","last_active":"2023-06-09T04:42:32.560637+0000","last_peered":"2023-06-09T04:42:32.560637+0000","last_clean":"2023-06-09T04:42:32.560637+0000","last_became_active":"2023-06-09T04:42:31.473704+0000","last_became_peered":"2023-06-09T04:42:31.473704+0000","last_unstale":"2023-06-09T04:42:32.560637+0000","last_undegraded":"2023-06-09T04:42:32.560637+0000","last_fullsized":"2023-06-09T04:42:32.560637+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:01:39.426150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.562899+0000","last_change":"2023-06-09T04:42:31.000017+0000","last_active":"2023-06-09T04:42:32.562899+0000","last_peered":"2023-06-09T04:42:32.562899+0000","last_clean":"2023-06-09T04:42:32.562899+0000","last_became_active":"2023-06-09T04:42:30.999712+0000","last_became_peered":"2023-06-09T04:42:30.999712+0000","last_unstale":"2023-06-09T04:42:32.562899+0000","last_undegraded":"2023-06-09T04:42:32.562899+0000","last_fullsized":"2023-06-09T04:42:32.562899+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_clean_scrub_stamp":"2023-06-09T04:42:29.940868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:35:27.088375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.471310+0000","last_change":"2023-06-09T04:42:31.485131+0000","last_active":"2023-06-09T04:42:32.471310+0000","last_peered":"2023-06-09T04:42:32.471310+0000","last_clean":"2023-06-09T04:42:32.471310+0000","last_became_active":"2023-06-09T04:42:31.484843+0000","last_became_peered":"2023-06-09T04:42:31.484843+0000","last_unstale":"2023-06-09T04:42:32.471310+0000","last_undegraded":"2023-06-09T04:42:32.471310+0000","last_fullsized":"2023-06-09T04:42:32.471310+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:33:35.739370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.561949+0000","last_change":"2023-06-09T04:42:30.998935+0000","last_active":"2023-06-09T04:42:32.561949+0000","last_peered":"2023-06-09T04:42:32.561949+0000","last_clean":"2023-06-09T04:42:32.561949+0000","last_became_active":"2023-06-09T04:42:30.998565+0000","last_became_peered":"2023-06-09T04:42:30.998565+0000","last_unstale":"2023-06-09T04:42:32.561949+0000","last_undegraded":"2023-06-09T04:42:32.561949+0000","last_fullsized":"2023-06-09T04:42:32.561949+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_clean_scrub_stamp":"2023-06-09T04:42:29.940868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:12:25.173918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.561765+0000","last_change":"2023-06-09T04:42:31.484442+0000","last_active":"2023-06-09T04:42:32.561765+0000","last_peered":"2023-06-09T04:42:32.561765+0000","last_clean":"2023-06-09T04:42:32.561765+0000","last_became_active":"2023-06-09T04:42:31.484167+0000","last_became_peered":"2023-06-09T04:42:31.484167+0000","last_unstale":"2023-06-09T04:42:32.561765+0000","last_undegraded":"2023-06-09T04:42:32.561765+0000","last_fullsized":"2023-06-09T04:42:32.561765+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:01:39.426150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.562775+0000","last_change":"2023-06-09T04:42:30.993642+0000","last_active":"2023-06-09T04:42:32.562775+0000","last_peered":"2023-06-09T04:42:32.562775+0000","last_clean":"2023-06-09T04:42:32.562775+0000","last_became_active":"2023-06-09T04:42:30.993330+0000","last_became_peered":"2023-06-09T04:42:30.993330+0000","last_unstale":"2023-06-09T04:42:32.562775+0000","last_undegraded":"2023-06-09T04:42:32.562775+0000","last_fullsized":"2023-06-09T04:42:32.562775+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_clean_scrub_stamp":"2023-06-09T04:42:29.940868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:00:21.553743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.562002+0000","last_change":"2023-06-09T04:42:31.479528+0000","last_active":"2023-06-09T04:42:32.562002+0000","last_peered":"2023-06-09T04:42:32.562002+0000","last_clean":"2023-06-09T04:42:32.562002+0000","last_became_active":"2023-06-09T04:42:31.478609+0000","last_became_peered":"2023-06-09T04:42:31.478609+0000","last_unstale":"2023-06-09T04:42:32.562002+0000","last_undegraded":"2023-06-09T04:42:32.562002+0000","last_fullsized":"2023-06-09T04:42:32.562002+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T04:55:59.070537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.563996+0000","last_change":"2023-06-09T04:42:30.999017+0000","last_active":"2023-06-09T04:42:32.563996+0000","last_peered":"2023-06-09T04:42:32.563996+0000","last_clean":"2023-06-09T04:42:32.563996+0000","last_became_active":"2023-06-09T04:42:30.998764+0000","last_became_peered":"2023-06-09T04:42:30.998764+0000","last_unstale":"2023-06-09T04:42:32.563996+0000","last_undegraded":"2023-06-09T04:42:32.563996+0000","last_fullsized":"2023-06-09T04:42:32.563996+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_clean_scrub_stamp":"2023-06-09T04:42:29.940868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:46:50.843413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":55,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.480632+0000","last_change":"2023-06-09T04:40:51.254956+0000","last_active":"2023-06-09T04:42:32.480632+0000","last_peered":"2023-06-09T04:42:32.480632+0000","last_clean":"2023-06-09T04:42:32.480632+0000","last_became_active":"2023-06-09T04:40:51.254627+0000","last_became_peered":"2023-06-09T04:40:51.254627+0000","last_unstale":"2023-06-09T04:42:32.480632+0000","last_undegraded":"2023-06-09T04:42:32.480632+0000","last_fullsized":"2023-06-09T04:42:32.480632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_clean_scrub_stamp":"2023-06-09T04:40:50.211713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:21:31.993744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.562328+0000","last_change":"2023-06-09T04:42:31.490683+0000","last_active":"2023-06-09T04:42:32.562328+0000","last_peered":"2023-06-09T04:42:32.562328+0000","last_clean":"2023-06-09T04:42:32.562328+0000","last_became_active":"2023-06-09T04:42:31.490385+0000","last_became_peered":"2023-06-09T04:42:31.490385+0000","last_unstale":"2023-06-09T04:42:32.562328+0000","last_undegraded":"2023-06-09T04:42:32.562328+0000","last_fullsized":"2023-06-09T04:42:32.562328+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:27:25.413089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.479237+0000","last_change":"2023-06-09T04:42:30.998190+0000","last_active":"2023-06-09T04:42:32.479237+0000","last_peered":"2023-06-09T04:42:32.479237+0000","last_clean":"2023-06-09T04:42:32.479237+0000","last_became_active":"2023-06-09T04:42:30.997883+0000","last_became_peered":"2023-06-09T04:42:30.997883+0000","last_unstale":"2023-06-09T04:42:32.479237+0000","last_undegraded":"2023-06-09T04:42:32.479237+0000","last_fullsized":"2023-06-09T04:42:32.479237+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_clean_scrub_stamp":"2023-06-09T04:42:29.940868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:50:02.023206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":51,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.560504+0000","last_change":"2023-06-09T04:40:51.247235+0000","last_active":"2023-06-09T04:42:32.560504+0000","last_peered":"2023-06-09T04:42:32.560504+0000","last_clean":"2023-06-09T04:42:32.560504+0000","last_became_active":"2023-06-09T04:40:51.246657+0000","last_became_peered":"2023-06-09T04:40:51.246657+0000","last_unstale":"2023-06-09T04:42:32.560504+0000","last_undegraded":"2023-06-09T04:42:32.560504+0000","last_fullsized":"2023-06-09T04:42:32.560504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_clean_scrub_stamp":"2023-06-09T04:40:50.211713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:13:36.040533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.562807+0000","last_change":"2023-06-09T04:42:31.481796+0000","last_active":"2023-06-09T04:42:32.562807+0000","last_peered":"2023-06-09T04:42:32.562807+0000","last_clean":"2023-06-09T04:42:32.562807+0000","last_became_active":"2023-06-09T04:42:31.481526+0000","last_became_peered":"2023-06-09T04:42:31.481526+0000","last_unstale":"2023-06-09T04:42:32.562807+0000","last_undegraded":"2023-06-09T04:42:32.562807+0000","last_fullsized":"2023-06-09T04:42:32.562807+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:33:27.897310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.560404+0000","last_change":"2023-06-09T04:42:31.001041+0000","last_active":"2023-06-09T04:42:32.560404+0000","last_peered":"2023-06-09T04:42:32.560404+0000","last_clean":"2023-06-09T04:42:32.560404+0000","last_became_active":"2023-06-09T04:42:31.000730+0000","last_became_peered":"2023-06-09T04:42:31.000730+0000","last_unstale":"2023-06-09T04:42:32.560404+0000","last_undegraded":"2023-06-09T04:42:32.560404+0000","last_fullsized":"2023-06-09T04:42:32.560404+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_clean_scrub_stamp":"2023-06-09T04:42:29.940868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:28:52.295148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":51,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.564538+0000","last_change":"2023-06-09T04:40:51.254461+0000","last_active":"2023-06-09T04:42:32.564538+0000","last_peered":"2023-06-09T04:42:32.564538+0000","last_clean":"2023-06-09T04:42:32.564538+0000","last_became_active":"2023-06-09T04:40:51.254070+0000","last_became_peered":"2023-06-09T04:40:51.254070+0000","last_unstale":"2023-06-09T04:42:32.564538+0000","last_undegraded":"2023-06-09T04:42:32.564538+0000","last_fullsized":"2023-06-09T04:42:32.564538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_clean_scrub_stamp":"2023-06-09T04:40:50.211713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:52:58.836389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.478953+0000","last_change":"2023-06-09T04:42:31.484629+0000","last_active":"2023-06-09T04:42:32.478953+0000","last_peered":"2023-06-09T04:42:32.478953+0000","last_clean":"2023-06-09T04:42:32.478953+0000","last_became_active":"2023-06-09T04:42:31.484309+0000","last_became_peered":"2023-06-09T04:42:31.484309+0000","last_unstale":"2023-06-09T04:42:32.478953+0000","last_undegraded":"2023-06-09T04:42:32.478953+0000","last_fullsized":"2023-06-09T04:42:32.478953+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:45:42.135804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.561421+0000","last_change":"2023-06-09T04:42:31.003016+0000","last_active":"2023-06-09T04:42:32.561421+0000","last_peered":"2023-06-09T04:42:32.561421+0000","last_clean":"2023-06-09T04:42:32.561421+0000","last_became_active":"2023-06-09T04:42:31.002168+0000","last_became_peered":"2023-06-09T04:42:31.002168+0000","last_unstale":"2023-06-09T04:42:32.561421+0000","last_undegraded":"2023-06-09T04:42:32.561421+0000","last_fullsized":"2023-06-09T04:42:32.561421+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_clean_scrub_stamp":"2023-06-09T04:42:29.940868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:40:16.903368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":51,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.560118+0000","last_change":"2023-06-09T04:40:51.246536+0000","last_active":"2023-06-09T04:42:32.560118+0000","last_peered":"2023-06-09T04:42:32.560118+0000","last_clean":"2023-06-09T04:42:32.560118+0000","last_became_active":"2023-06-09T04:40:51.245999+0000","last_became_peered":"2023-06-09T04:40:51.245999+0000","last_unstale":"2023-06-09T04:42:32.560118+0000","last_undegraded":"2023-06-09T04:42:32.560118+0000","last_fullsized":"2023-06-09T04:42:32.560118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_clean_scrub_stamp":"2023-06-09T04:40:50.211713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:59:57.727013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.480686+0000","last_change":"2023-06-09T04:42:31.500460+0000","last_active":"2023-06-09T04:42:32.480686+0000","last_peered":"2023-06-09T04:42:32.480686+0000","last_clean":"2023-06-09T04:42:32.480686+0000","last_became_active":"2023-06-09T04:42:31.500133+0000","last_became_peered":"2023-06-09T04:42:31.500133+0000","last_unstale":"2023-06-09T04:42:32.480686+0000","last_undegraded":"2023-06-09T04:42:32.480686+0000","last_fullsized":"2023-06-09T04:42:32.480686+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:09:37.127627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"43'1","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:33.137776+0000","last_change":"2023-06-09T04:42:30.992547+0000","last_active":"2023-06-09T04:42:33.137776+0000","last_peered":"2023-06-09T04:42:33.137776+0000","last_clean":"2023-06-09T04:42:33.137776+0000","last_became_active":"2023-06-09T04:42:30.992218+0000","last_became_peered":"2023-06-09T04:42:30.992218+0000","last_unstale":"2023-06-09T04:42:33.137776+0000","last_undegraded":"2023-06-09T04:42:33.137776+0000","last_fullsized":"2023-06-09T04:42:33.137776+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_clean_scrub_stamp":"2023-06-09T04:42:29.940868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:26:40.814962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":47,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.563078+0000","last_change":"2023-06-09T04:40:51.256393+0000","last_active":"2023-06-09T04:42:32.563078+0000","last_peered":"2023-06-09T04:42:32.563078+0000","last_clean":"2023-06-09T04:42:32.563078+0000","last_became_active":"2023-06-09T04:40:51.255964+0000","last_became_peered":"2023-06-09T04:40:51.255964+0000","last_unstale":"2023-06-09T04:42:32.563078+0000","last_undegraded":"2023-06-09T04:42:32.563078+0000","last_fullsized":"2023-06-09T04:42:32.563078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_clean_scrub_stamp":"2023-06-09T04:40:50.211713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:23:01.169645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.562332+0000","last_change":"2023-06-09T04:42:31.495518+0000","last_active":"2023-06-09T04:42:32.562332+0000","last_peered":"2023-06-09T04:42:32.562332+0000","last_clean":"2023-06-09T04:42:32.562332+0000","last_became_active":"2023-06-09T04:42:31.492036+0000","last_became_peered":"2023-06-09T04:42:31.492036+0000","last_unstale":"2023-06-09T04:42:32.562332+0000","last_undegraded":"2023-06-09T04:42:32.562332+0000","last_fullsized":"2023-06-09T04:42:32.562332+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:20:39.543980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.564451+0000","last_change":"2023-06-09T04:42:31.000288+0000","last_active":"2023-06-09T04:42:32.564451+0000","last_peered":"2023-06-09T04:42:32.564451+0000","last_clean":"2023-06-09T04:42:32.564451+0000","last_became_active":"2023-06-09T04:42:30.999984+0000","last_became_peered":"2023-06-09T04:42:30.999984+0000","last_unstale":"2023-06-09T04:42:32.564451+0000","last_undegraded":"2023-06-09T04:42:32.564451+0000","last_fullsized":"2023-06-09T04:42:32.564451+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_clean_scrub_stamp":"2023-06-09T04:42:29.940868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:52:52.535827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":51,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.471050+0000","last_change":"2023-06-09T04:40:51.582053+0000","last_active":"2023-06-09T04:42:32.471050+0000","last_peered":"2023-06-09T04:42:32.471050+0000","last_clean":"2023-06-09T04:42:32.471050+0000","last_became_active":"2023-06-09T04:40:51.581476+0000","last_became_peered":"2023-06-09T04:40:51.581476+0000","last_unstale":"2023-06-09T04:42:32.471050+0000","last_undegraded":"2023-06-09T04:42:32.471050+0000","last_fullsized":"2023-06-09T04:42:32.471050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_clean_scrub_stamp":"2023-06-09T04:40:50.211713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:52:17.293355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.564420+0000","last_change":"2023-06-09T04:42:31.491055+0000","last_active":"2023-06-09T04:42:32.564420+0000","last_peered":"2023-06-09T04:42:32.564420+0000","last_clean":"2023-06-09T04:42:32.564420+0000","last_became_active":"2023-06-09T04:42:31.490798+0000","last_became_peered":"2023-06-09T04:42:31.490798+0000","last_unstale":"2023-06-09T04:42:32.564420+0000","last_undegraded":"2023-06-09T04:42:32.564420+0000","last_fullsized":"2023-06-09T04:42:32.564420+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:30:03.105125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.560093+0000","last_change":"2023-06-09T04:42:30.996496+0000","last_active":"2023-06-09T04:42:32.560093+0000","last_peered":"2023-06-09T04:42:32.560093+0000","last_clean":"2023-06-09T04:42:32.560093+0000","last_became_active":"2023-06-09T04:42:30.996218+0000","last_became_peered":"2023-06-09T04:42:30.996218+0000","last_unstale":"2023-06-09T04:42:32.560093+0000","last_undegraded":"2023-06-09T04:42:32.560093+0000","last_fullsized":"2023-06-09T04:42:32.560093+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_clean_scrub_stamp":"2023-06-09T04:42:29.940868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:04:36.929804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":51,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.562830+0000","last_change":"2023-06-09T04:40:51.256342+0000","last_active":"2023-06-09T04:42:32.562830+0000","last_peered":"2023-06-09T04:42:32.562830+0000","last_clean":"2023-06-09T04:42:32.562830+0000","last_became_active":"2023-06-09T04:40:51.256010+0000","last_became_peered":"2023-06-09T04:40:51.256010+0000","last_unstale":"2023-06-09T04:42:32.562830+0000","last_undegraded":"2023-06-09T04:42:32.562830+0000","last_fullsized":"2023-06-09T04:42:32.562830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_clean_scrub_stamp":"2023-06-09T04:40:50.211713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:14:31.859402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.563091+0000","last_change":"2023-06-09T04:42:31.491659+0000","last_active":"2023-06-09T04:42:32.563091+0000","last_peered":"2023-06-09T04:42:32.563091+0000","last_clean":"2023-06-09T04:42:32.563091+0000","last_became_active":"2023-06-09T04:42:31.491250+0000","last_became_peered":"2023-06-09T04:42:31.491250+0000","last_unstale":"2023-06-09T04:42:32.563091+0000","last_undegraded":"2023-06-09T04:42:32.563091+0000","last_fullsized":"2023-06-09T04:42:32.563091+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:35:28.103518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"42'2","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.563622+0000","last_change":"2023-06-09T04:42:31.004702+0000","last_active":"2023-06-09T04:42:32.563622+0000","last_peered":"2023-06-09T04:42:32.563622+0000","last_clean":"2023-06-09T04:42:32.563622+0000","last_became_active":"2023-06-09T04:42:31.004482+0000","last_became_peered":"2023-06-09T04:42:31.004482+0000","last_unstale":"2023-06-09T04:42:32.563622+0000","last_undegraded":"2023-06-09T04:42:32.563622+0000","last_fullsized":"2023-06-09T04:42:32.563622+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_clean_scrub_stamp":"2023-06-09T04:42:29.940868+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:20:57.735736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":47,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.563404+0000","last_change":"2023-06-09T04:40:51.253269+0000","last_active":"2023-06-09T04:42:32.563404+0000","last_peered":"2023-06-09T04:42:32.563404+0000","last_clean":"2023-06-09T04:42:32.563404+0000","last_became_active":"2023-06-09T04:40:51.252908+0000","last_became_peered":"2023-06-09T04:40:51.252908+0000","last_unstale":"2023-06-09T04:42:32.563404+0000","last_undegraded":"2023-06-09T04:42:32.563404+0000","last_fullsized":"2023-06-09T04:42:32.563404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_clean_scrub_stamp":"2023-06-09T04:40:50.211713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:38:19.535495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":207,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.562964+0000","last_change":"2023-06-09T04:40:46.286764+0000","last_active":"2023-06-09T04:42:32.562964+0000","last_peered":"2023-06-09T04:42:32.562964+0000","last_clean":"2023-06-09T04:42:32.562964+0000","last_became_active":"2023-06-09T04:40:46.285285+0000","last_became_peered":"2023-06-09T04:40:46.285285+0000","last_unstale":"2023-06-09T04:42:32.562964+0000","last_undegraded":"2023-06-09T04:42:32.562964+0000","last_fullsized":"2023-06-09T04:42:32.562964+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:45.151406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:45.151406+0000","last_clean_scrub_stamp":"2023-06-09T04:40:45.151406+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:39:54.049229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28024,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343816,"statfs":{"total":96636764160,"available":96608067584,"internally_reserved":0,"allocated":1097728,"data_stored":813905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:41:46 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.177,"15min":1.177},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.657,"5min":1.657,"15min":1.657},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":2.512,"5min":2.512,"15min":2.512},"last":1.355}]},{"osd":1,"last update":"Fri Jun 9 04:41:46 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.097,"15min":1.097},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.504,"5min":1.504,"15min":1.504},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.92600000000000005}]},{"osd":2,"last update":"Fri Jun 9 04:41:46 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":1.3029999999999999},{"interface":"front","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.605,"5min":1.605,"15min":1.605},"last":1.1759999999999999}]},{"osd":3,"last update":"Fri Jun 9 04:41:46 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.266,"15min":1.266},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.4139999999999999},{"interface":"front","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":1.145,"5min":1.145,"15min":1.145},"max":{"1min":1.7869999999999999,"5min":1.7869999999999999,"15min":1.7869999999999999},"last":1.131}]},{"osd":4,"last update":"Fri Jun 9 04:41:46 2023","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":2.423,"5min":2.423,"15min":2.423},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":1.734,"5min":1.734,"15min":1.734},"last":1.2230000000000001}]},{"osd":5,"last update":"Fri Jun 9 04:41:46 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"max":{"1min":1.923,"5min":1.923,"15min":1.923},"last":1.333},{"interface":"front","average":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"min":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"max":{"1min":2.117,"5min":2.117,"15min":2.117},"last":1.4610000000000001}]},{"osd":6,"last update":"Fri Jun 9 04:41:46 2023","interfaces":[{"interface":"back","average":{"1min":1.597,"5min":1.597,"15min":1.597},"min":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"max":{"1min":2.3199999999999998,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":1.1919999999999999},{"interface":"front","average":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"min":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":3.1440000000000001,"5min":3.1440000000000001,"15min":3.1440000000000001},"last":1.4950000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":496,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":507904,"data_stored":224119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:41:44 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":1.218},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.9830000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.272}]},{"osd":1,"last update":"Fri Jun 9 04:41:44 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":2.4980000000000002,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":1.0600000000000001}]},{"osd":2,"last update":"Fri Jun 9 04:41:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":1.125},{"interface":"front","average":{"1min":1.177,"5min":1.177,"15min":1.177},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.556,"5min":1.556,"15min":1.556},"last":1.4359999999999999}]},{"osd":3,"last update":"Fri Jun 9 04:41:44 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.6030000000000002,"5min":2.6030000000000002,"15min":2.6030000000000002},"last":1.4059999999999999},{"interface":"front","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.7769999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":1.341}]},{"osd":4,"last update":"Fri Jun 9 04:41:44 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.163,"15min":1.163},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.9950000000000001,"5min":1.9950000000000001,"15min":1.9950000000000001},"last":1.167},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":2.556,"5min":2.556,"15min":2.556},"last":1.2949999999999999}]},{"osd":5,"last update":"Fri Jun 9 04:41:44 2023","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.871,"5min":0.871,"15min":0.871},"max":{"1min":1.925,"5min":1.925,"15min":1.925},"last":1.645},{"interface":"front","average":{"1min":1.367,"5min":1.367,"15min":1.367},"min":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"max":{"1min":2.1600000000000001,"5min":2.1600000000000001,"15min":2.1600000000000001},"last":1.5860000000000001}]},{"osd":7,"last update":"Fri Jun 9 04:41:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"max":{"1min":2.4300000000000002,"5min":2.4300000000000002,"15min":2.4300000000000002},"last":1.544},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"min":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"max":{"1min":2.0800000000000001,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":1.474}]}]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":503808,"data_stored":223517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:41:48 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":2.2149999999999999,"5min":2.2149999999999999,"15min":2.2149999999999999},"last":1.4470000000000001},{"interface":"front","average":{"1min":1.222,"5min":1.222,"15min":1.222},"min":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"max":{"1min":1.976,"5min":1.976,"15min":1.976},"last":1.5629999999999999}]},{"osd":1,"last update":"Fri Jun 9 04:41:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":1.389},{"interface":"front","average":{"1min":1.153,"5min":1.153,"15min":1.153},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":1.266}]},{"osd":2,"last update":"Fri Jun 9 04:41:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":2.0619999999999998,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":1.321},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.738,"5min":1.738,"15min":1.738},"last":1.125}]},{"osd":3,"last update":"Fri Jun 9 04:41:48 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":1.7509999999999999,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":1.3540000000000001},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.6379999999999999,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":1.302}]},{"osd":4,"last update":"Fri Jun 9 04:41:48 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":2.375,"5min":2.375,"15min":2.375},"last":1.089},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":1.9039999999999999,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":1.4199999999999999}]},{"osd":6,"last update":"Fri Jun 9 04:41:48 2023","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":1.264,"15min":1.264},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":1.71,"5min":1.71,"15min":1.71},"last":1.6020000000000001},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":1.526}]},{"osd":7,"last update":"Fri Jun 9 04:41:48 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.288,"15min":1.288},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.855,"5min":1.855,"15min":1.855},"last":1.179},{"interface":"front","average":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"min":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":1.482}]}]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":500,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":512000,"data_stored":225011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:41:43 2023","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"min":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.069}]},{"osd":1,"last update":"Fri Jun 9 04:41:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":1.012},{"interface":"front","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.98799999999999999}]},{"osd":2,"last update":"Fri Jun 9 04:41:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"min":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.91100000000000003},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"min":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.94099999999999995}]},{"osd":3,"last update":"Fri Jun 9 04:41:43 2023","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":1.27,"15min":1.27},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":2.093,"5min":2.093,"15min":2.093},"last":0.80900000000000005},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":2.3660000000000001,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":0.82299999999999995}]},{"osd":5,"last update":"Fri Jun 9 04:41:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"min":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.73899999999999999}]},{"osd":6,"last update":"Fri Jun 9 04:41:43 2023","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.256,"15min":1.256},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.921,"5min":1.921,"15min":1.921},"last":0.68799999999999994},{"interface":"front","average":{"1min":1.335,"5min":1.335,"15min":1.335},"min":{"1min":1.054,"5min":1.054,"15min":1.054},"max":{"1min":1.8149999999999999,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":0.76200000000000001}]},{"osd":7,"last update":"Fri Jun 9 04:41:43 2023","interfaces":[{"interface":"back","average":{"1min":1.329,"5min":1.329,"15min":1.329},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.58099999999999996},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":1.853,"5min":1.853,"15min":1.853},"last":0.96599999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574873,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":500,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":512000,"data_stored":224085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:41:44 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.65400000000000003},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":2.6309999999999998,"5min":2.6309999999999998,"15min":2.6309999999999998},"last":1.3300000000000001}]},{"osd":1,"last update":"Fri Jun 9 04:41:44 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.746,"5min":1.746,"15min":1.746},"last":1.2829999999999999},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":2.8199999999999998,"5min":2.8199999999999998,"15min":2.8199999999999998},"last":0.68899999999999995}]},{"osd":2,"last update":"Fri Jun 9 04:41:44 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":2.3610000000000002,"5min":2.3610000000000002,"15min":2.3610000000000002},"last":1},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":2.4340000000000002,"5min":2.4340000000000002,"15min":2.4340000000000002},"last":0.60899999999999999}]},{"osd":4,"last update":"Fri Jun 9 04:41:44 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"min":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":1.1220000000000001},{"interface":"front","average":{"1min":1.355,"5min":1.355,"15min":1.355},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":2.5190000000000001,"5min":2.5190000000000001,"15min":2.5190000000000001},"last":1.0840000000000001}]},{"osd":5,"last update":"Fri Jun 9 04:41:44 2023","interfaces":[{"interface":"back","average":{"1min":1.516,"5min":1.516,"15min":1.516},"min":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"max":{"1min":2.5019999999999998,"5min":2.5019999999999998,"15min":2.5019999999999998},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"min":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":2.569,"5min":2.569,"15min":2.569},"last":1.234}]},{"osd":6,"last update":"Fri Jun 9 04:41:44 2023","interfaces":[{"interface":"back","average":{"1min":1.677,"5min":1.677,"15min":1.677},"min":{"1min":1.016,"5min":1.016,"15min":1.016},"max":{"1min":5.6959999999999997,"5min":5.6959999999999997,"15min":5.6959999999999997},"last":1.3640000000000001},{"interface":"front","average":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"min":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"max":{"1min":2.4660000000000002,"5min":2.4660000000000002,"15min":2.4660000000000002},"last":1.052}]},{"osd":7,"last update":"Fri Jun 9 04:41:44 2023","interfaces":[{"interface":"back","average":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"min":{"1min":1.153,"5min":1.153,"15min":1.153},"max":{"1min":2.5249999999999999,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":1.4159999999999999},{"interface":"front","average":{"1min":1.8180000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"min":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"max":{"1min":5.5,"5min":5.5,"15min":5.5},"last":1.194}]}]},{"osd":2,"up_from":13,"seq":55834574872,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":504,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":516096,"data_stored":225033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.58499999999999996},{"interface":"front","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":3.1400000000000001,"5min":3.1400000000000001,"15min":3.1400000000000001},"last":0.90900000000000003}]},{"osd":1,"last update":"Fri Jun 9 04:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.97899999999999998},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.95199999999999996}]},{"osd":3,"last update":"Fri Jun 9 04:41:45 2023","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":1.2609999999999999},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":2.7570000000000001,"5min":2.7570000000000001,"15min":2.7570000000000001},"last":1.2310000000000001}]},{"osd":4,"last update":"Fri Jun 9 04:41:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"min":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"max":{"1min":2.0059999999999998,"5min":2.0059999999999998,"15min":2.0059999999999998},"last":1.339},{"interface":"front","average":{"1min":1.454,"5min":1.454,"15min":1.454},"min":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"max":{"1min":2.968,"5min":2.968,"15min":2.968},"last":1.2969999999999999}]},{"osd":5,"last update":"Fri Jun 9 04:41:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"min":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"max":{"1min":2.8109999999999999,"5min":2.8109999999999999,"15min":2.8109999999999999},"last":1.556},{"interface":"front","average":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"min":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":2.9329999999999998,"5min":2.9329999999999998,"15min":2.9329999999999998},"last":1.504}]},{"osd":6,"last update":"Fri Jun 9 04:41:45 2023","interfaces":[{"interface":"back","average":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"min":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"max":{"1min":3.0430000000000001,"5min":3.0430000000000001,"15min":3.0430000000000001},"last":1.3979999999999999},{"interface":"front","average":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"min":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":2.6110000000000002,"5min":2.6110000000000002,"15min":2.6110000000000002},"last":1.464}]},{"osd":7,"last update":"Fri Jun 9 04:41:45 2023","interfaces":[{"interface":"back","average":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"min":{"1min":1.056,"5min":1.056,"15min":1.056},"max":{"1min":3.0960000000000001,"5min":3.0960000000000001,"15min":3.0960000000000001},"last":1.448},{"interface":"front","average":{"1min":1.629,"5min":1.629,"15min":1.629},"min":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"max":{"1min":3.1920000000000002,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":1.371}]}]},{"osd":1,"up_from":13,"seq":55834574872,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":503808,"data_stored":223517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:41:44 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.64800000000000002}]},{"osd":2,"last update":"Fri Jun 9 04:41:44 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.53900000000000003},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.98599999999999999}]},{"osd":3,"last update":"Fri Jun 9 04:41:44 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.1639999999999999},{"interface":"front","average":{"1min":1.163,"5min":1.163,"15min":1.163},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.6379999999999999,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":1.113}]},{"osd":4,"last update":"Fri Jun 9 04:41:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.9410000000000001,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":0.92900000000000005}]},{"osd":5,"last update":"Fri Jun 9 04:41:44 2023","interfaces":[{"interface":"back","average":{"1min":1.403,"5min":1.403,"15min":1.403},"min":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":1.7649999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":0.90200000000000002},{"interface":"front","average":{"1min":1.375,"5min":1.375,"15min":1.375},"min":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"max":{"1min":2.056,"5min":2.056,"15min":2.056},"last":1.379}]},{"osd":6,"last update":"Fri Jun 9 04:41:44 2023","interfaces":[{"interface":"back","average":{"1min":1.419,"5min":1.419,"15min":1.419},"min":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":1.2230000000000001},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"min":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":1.948,"5min":1.948,"15min":1.948},"last":1.143}]},{"osd":7,"last update":"Fri Jun 9 04:41:44 2023","interfaces":[{"interface":"back","average":{"1min":1.52,"5min":1.52,"15min":1.52},"min":{"1min":1.089,"5min":1.089,"15min":1.089},"max":{"1min":1.9410000000000001,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.532,"5min":1.532,"15min":1.532},"min":{"1min":1.02,"5min":1.02,"15min":1.02},"max":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":1.292}]}]},{"osd":0,"up_from":13,"seq":55834574874,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28024,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343816,"statfs":{"total":96636764160,"available":96608067584,"internally_reserved":0,"allocated":1097728,"data_stored":813849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jun 9 04:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":2.4159999999999999,"5min":2.4159999999999999,"15min":2.4159999999999999},"last":1.554},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.742,"5min":1.742,"15min":1.742},"last":0.85099999999999998}]},{"osd":2,"last update":"Fri Jun 9 04:41:47 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.7370000000000001,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":1.4359999999999999},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.91200000000000003}]},{"osd":3,"last update":"Fri Jun 9 04:41:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":2.9809999999999999,"5min":2.9809999999999999,"15min":2.9809999999999999},"last":0.873},{"interface":"front","average":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":4.1280000000000001,"5min":4.1280000000000001,"15min":4.1280000000000001},"last":1.264}]},{"osd":4,"last update":"Fri Jun 9 04:41:47 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.792,"5min":1.792,"15min":1.792},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.6160000000000001,"5min":1.6160000000000001,"15min":1.6160000000000001},"min":{"1min":1.002,"5min":1.002,"15min":1.002},"max":{"1min":4.2949999999999999,"5min":4.2949999999999999,"15min":4.2949999999999999},"last":1.619}]},{"osd":5,"last update":"Fri Jun 9 04:41:47 2023","interfaces":[{"interface":"back","average":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"min":{"1min":1.016,"5min":1.016,"15min":1.016},"max":{"1min":2.2240000000000002,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":1.46},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"min":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"max":{"1min":1.9299999999999999,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":1.5780000000000001}]},{"osd":6,"last update":"Fri Jun 9 04:41:47 2023","interfaces":[{"interface":"back","average":{"1min":1.647,"5min":1.647,"15min":1.647},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":5.8529999999999998,"5min":5.8529999999999998,"15min":5.8529999999999998},"last":2.157},{"interface":"front","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"max":{"1min":2.4670000000000001,"5min":2.4670000000000001,"15min":2.4670000000000001},"last":1.5169999999999999}]},{"osd":7,"last update":"Fri Jun 9 04:41:47 2023","interfaces":[{"interface":"back","average":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"min":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"max":{"1min":2.5899999999999999,"5min":2.5899999999999999,"15min":2.5899999999999999},"last":1.494},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"min":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"max":{"1min":2.0550000000000002,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":1.6100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-09T04:42:35.794 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-09T04:42:36.004 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.002+0000 7f8fb91a1700 1 Processor -- start 2023-06-09T04:42:36.004 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.002+0000 7f8fb91a1700 1 -- start start 2023-06-09T04:42:36.005 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.002+0000 7f8fb91a1700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8fb4159a40 0x7f8fb40cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:36.005 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.002+0000 7f8fb91a1700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f8fb40c9ea0 0x7f8fb40ca320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:36.006 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.002+0000 7f8fb91a1700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fb4071180 con 0x7f8fb40cd4f0 2023-06-09T04:42:36.006 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.002+0000 7f8fb91a1700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fb40cbc00 con 0x7f8fb4159a40 2023-06-09T04:42:36.006 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.002+0000 7f8fb91a1700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fb40ca860 con 0x7f8fb40c9ea0 2023-06-09T04:42:36.007 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.002+0000 7f8fb3fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8fb4159a40 0x7f8fb40cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:36.007 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.002+0000 7f8fb3fff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8fb4159a40 0x7f8fb40cc610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:37062/0 (socket says 172.21.15.62:37062) 2023-06-09T04:42:36.007 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.002+0000 7f8fb3fff700 1 -- 172.21.15.62:0/597058546 learned_addr learned my addr 172.21.15.62:0/597058546 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:36.007 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.002+0000 7f8fb89a0700 1 --2- 172.21.15.62:0/597058546 >> v2:172.21.15.89:3300/0 conn(0x7f8fb40c9ea0 0x7f8fb40ca320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:36.007 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.002+0000 7f8fb3fff700 1 -- 172.21.15.62:0/597058546 >> v2:172.21.15.89:3300/0 conn(0x7f8fb40c9ea0 msgr2=0x7f8fb40ca320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:36.007 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.002+0000 7f8fb3fff700 1 --2- 172.21.15.62:0/597058546 >> v2:172.21.15.89:3300/0 conn(0x7f8fb40c9ea0 0x7f8fb40ca320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:36.007 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.002+0000 7f8fb3fff700 1 -- 172.21.15.62:0/597058546 >> v1:172.21.15.89:6789/0 conn(0x7f8fb40cd4f0 legacy=0x7f8fb4070a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:36.008 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.002+0000 7f8fb3fff700 1 -- 172.21.15.62:0/597058546 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb40cc180 con 0x7f8fb4159a40 2023-06-09T04:42:36.008 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.002+0000 7f8fb89a0700 1 --2- 172.21.15.62:0/597058546 >> v2:172.21.15.89:3300/0 conn(0x7f8fb40c9ea0 0x7f8fb40ca320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:42:36.009 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.002+0000 7f8fb3fff700 1 --2- 172.21.15.62:0/597058546 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8fb4159a40 0x7f8fb40cc610 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f8fb40cd9a0 tx=0x7f8fa4009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be8ec91826307b3d server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:36.009 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.006+0000 7f8fb2ffd700 1 -- 172.21.15.62:0/597058546 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa400b8a0 con 0x7f8fb4159a40 2023-06-09T04:42:36.009 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.006+0000 7f8fb2ffd700 1 -- 172.21.15.62:0/597058546 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa400ba00 con 0x7f8fb4159a40 2023-06-09T04:42:36.009 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.006+0000 7f8fb2ffd700 1 -- 172.21.15.62:0/597058546 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa400bd90 con 0x7f8fb4159a40 2023-06-09T04:42:36.009 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.006+0000 7f8fb91a1700 1 -- 172.21.15.62:0/597058546 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8fb4159a40 msgr2=0x7f8fb40cc610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:36.009 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.006+0000 7f8fb91a1700 1 --2- 172.21.15.62:0/597058546 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8fb4159a40 0x7f8fb40cc610 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f8fb40cd9a0 tx=0x7f8fa4009bf0 comp rx=0 tx=0).stop 2023-06-09T04:42:36.009 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.006+0000 7f8fb91a1700 1 -- 172.21.15.62:0/597058546 shutdown_connections 2023-06-09T04:42:36.010 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.006+0000 7f8fb91a1700 1 --2- 172.21.15.62:0/597058546 >> v2:172.21.15.89:3300/0 conn(0x7f8fb40c9ea0 0x7f8fb40ca320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:36.010 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.006+0000 7f8fb91a1700 1 --2- 172.21.15.62:0/597058546 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8fb4159a40 0x7f8fb40cc610 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:36.010 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.006+0000 7f8fb91a1700 1 -- 172.21.15.62:0/597058546 >> 172.21.15.62:0/597058546 conn(0x7f8fb406a420 msgr2=0x7f8fb40afc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:36.010 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.006+0000 7f8fb91a1700 1 -- 172.21.15.62:0/597058546 shutdown_connections 2023-06-09T04:42:36.010 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.006+0000 7f8fb91a1700 1 -- 172.21.15.62:0/597058546 wait complete. 2023-06-09T04:42:36.011 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.010+0000 7f8fb91a1700 1 Processor -- start 2023-06-09T04:42:36.011 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.010+0000 7f8fb91a1700 1 -- start start 2023-06-09T04:42:36.013 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.010+0000 7f8fb91a1700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8fb40cd4f0 0x7f8fb414cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:36.013 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.010+0000 7f8fb91a1700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8fb4159a40 0x7f8fb406cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:36.013 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.010+0000 7f8fb91a1700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8fb414d2a0 0x7f8fb41f09d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:36.013 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.010+0000 7f8fb91a1700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb414d080 con 0x7f8fb414d2a0 2023-06-09T04:42:36.014 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.010+0000 7f8fb91a1700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb406d1b0 con 0x7f8fb4159a40 2023-06-09T04:42:36.014 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.010+0000 7f8fb91a1700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb406bbd0 con 0x7f8fb40cd4f0 2023-06-09T04:42:36.014 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.010+0000 7f8fb89a0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8fb414d2a0 0x7f8fb41f09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:36.015 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.010+0000 7f8fb89a0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8fb414d2a0 0x7f8fb41f09d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:37072/0 (socket says 172.21.15.62:37072) 2023-06-09T04:42:36.015 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.010+0000 7f8fb89a0700 1 -- 172.21.15.62:0/129304469 learned_addr learned my addr 172.21.15.62:0/129304469 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:36.015 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.010+0000 7f8fb37fe700 1 --2- 172.21.15.62:0/129304469 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8fb4159a40 0x7f8fb406cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:36.015 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.010+0000 7f8fb3fff700 1 --2- 172.21.15.62:0/129304469 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8fb40cd4f0 0x7f8fb414cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:36.015 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.010+0000 7f8fb37fe700 1 -- 172.21.15.62:0/129304469 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8fb40cd4f0 msgr2=0x7f8fb414cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:36.015 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.010+0000 7f8fb37fe700 1 --2- 172.21.15.62:0/129304469 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8fb40cd4f0 0x7f8fb414cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:36.015 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.010+0000 7f8fb37fe700 1 -- 172.21.15.62:0/129304469 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8fb414d2a0 msgr2=0x7f8fb41f09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:36.015 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.010+0000 7f8fb37fe700 1 --2- 172.21.15.62:0/129304469 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8fb414d2a0 0x7f8fb41f09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:36.016 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.010+0000 7f8fb37fe700 1 -- 172.21.15.62:0/129304469 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa4009570 con 0x7f8fb4159a40 2023-06-09T04:42:36.016 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.010+0000 7f8fb37fe700 1 --2- 172.21.15.62:0/129304469 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8fb4159a40 0x7f8fb406cc70 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8fa800c400 tx=0x7f8fa800c710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:36.016 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.014+0000 7f8fb0ff9700 1 -- 172.21.15.62:0/129304469 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa80052d0 con 0x7f8fb4159a40 2023-06-09T04:42:36.017 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.014+0000 7f8fb0ff9700 1 -- 172.21.15.62:0/129304469 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa8005450 con 0x7f8fb4159a40 2023-06-09T04:42:36.017 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.014+0000 7f8fb0ff9700 1 -- 172.21.15.62:0/129304469 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa8006ac0 con 0x7f8fb4159a40 2023-06-09T04:42:36.017 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.014+0000 7f8fb91a1700 1 -- 172.21.15.62:0/129304469 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fb406beb0 con 0x7f8fb4159a40 2023-06-09T04:42:36.017 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.014+0000 7f8fb91a1700 1 -- 172.21.15.62:0/129304469 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fb406c470 con 0x7f8fb4159a40 2023-06-09T04:42:36.018 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.014+0000 7f8fb91a1700 1 -- 172.21.15.62:0/129304469 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fb40739c0 con 0x7f8fb4159a40 2023-06-09T04:42:36.020 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.018+0000 7f8fb0ff9700 1 -- 172.21.15.62:0/129304469 <== mon.1 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8fa80036a0 con 0x7f8fb4159a40 2023-06-09T04:42:36.021 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.018+0000 7f8fb0ff9700 1 --2- 172.21.15.62:0/129304469 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f8fa00662f0 0x7f8fa00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:36.021 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.018+0000 7f8fb0ff9700 1 -- 172.21.15.62:0/129304469 <== mon.1 v2:172.21.15.89:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f8fa8082e70 con 0x7f8fb4159a40 2023-06-09T04:42:36.021 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.018+0000 7f8fb3fff700 1 --2- 172.21.15.62:0/129304469 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f8fa00662f0 0x7f8fa00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:36.023 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.022+0000 7f8fb3fff700 1 --2- 172.21.15.62:0/129304469 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f8fa00662f0 0x7f8fa00687a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f8fa4000c00 tx=0x7f8fa4008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:36.029 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.026+0000 7f8fb0ff9700 1 -- 172.21.15.62:0/129304469 <== mon.1 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f8fa8050090 con 0x7f8fb4159a40 2023-06-09T04:42:36.201 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.198+0000 7f8fb91a1700 1 -- 172.21.15.62:0/129304469 --> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8fb40716a0 con 0x7f8fa00662f0 2023-06-09T04:42:36.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.214+0000 7f8fb0ff9700 1 -- 172.21.15.62:0/129304469 <== mgr.4106 v2:172.21.15.89:6832/3073446405 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+309035 (secure 0 0 0) 0x7f8fa40040f0 con 0x7f8fa00662f0 2023-06-09T04:42:36.219 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:42:36.226 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.222+0000 7f8fb91a1700 1 -- 172.21.15.62:0/129304469 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f8fa00662f0 msgr2=0x7f8fa00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:36.226 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.222+0000 7f8fb91a1700 1 --2- 172.21.15.62:0/129304469 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f8fa00662f0 0x7f8fa00687a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f8fa4000c00 tx=0x7f8fa4008030 comp rx=0 tx=0).stop 2023-06-09T04:42:36.226 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.222+0000 7f8fb91a1700 1 -- 172.21.15.62:0/129304469 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8fb4159a40 msgr2=0x7f8fb406cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:36.226 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.222+0000 7f8fb91a1700 1 --2- 172.21.15.62:0/129304469 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8fb4159a40 0x7f8fb406cc70 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8fa800c400 tx=0x7f8fa800c710 comp rx=0 tx=0).stop 2023-06-09T04:42:36.226 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.222+0000 7f8fb91a1700 1 -- 172.21.15.62:0/129304469 shutdown_connections 2023-06-09T04:42:36.226 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.222+0000 7f8fb91a1700 1 --2- 172.21.15.62:0/129304469 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f8fa00662f0 0x7f8fa00687a0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:36.226 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.222+0000 7f8fb91a1700 1 --2- 172.21.15.62:0/129304469 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8fb414d2a0 0x7f8fb41f09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:36.227 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.222+0000 7f8fb91a1700 1 --2- 172.21.15.62:0/129304469 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8fb4159a40 0x7f8fb406cc70 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:36.227 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.222+0000 7f8fb91a1700 1 --2- 172.21.15.62:0/129304469 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f8fb40cd4f0 0x7f8fb414cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:36.227 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.222+0000 7f8fb91a1700 1 -- 172.21.15.62:0/129304469 >> 172.21.15.62:0/129304469 conn(0x7f8fb40c9ea0 msgr2=0x7f8fb40caa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:36.227 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.222+0000 7f8fb91a1700 1 -- 172.21.15.62:0/129304469 shutdown_connections 2023-06-09T04:42:36.227 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.222+0000 7f8fb91a1700 1 -- 172.21.15.62:0/129304469 wait complete. 2023-06-09T04:42:36.227 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2023-06-09T04:42:36.248 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":92,"stamp":"2023-06-09T04:42:34.601901+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":136,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220744,"kb_used_data":5128,"kb_used_omap":0,"kb_used_meta":215552,"kb_avail":754753976,"statfs":{"total":773094113280,"available":772868071424,"internally_reserved":0,"allocated":5251072,"data_stored":2973036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":220725248},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":45,"apply_latency_ms":45,"commit_latency_ns":45000000,"apply_latency_ns":45000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.642959"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.564134+0000","last_change":"2023-06-09T04:42:31.479344+0000","last_active":"2023-06-09T04:42:32.564134+0000","last_peered":"2023-06-09T04:42:32.564134+0000","last_clean":"2023-06-09T04:42:32.564134+0000","last_became_active":"2023-06-09T04:42:31.479058+0000","last_became_peered":"2023-06-09T04:42:31.479058+0000","last_unstale":"2023-06-09T04:42:32.564134+0000","last_undegraded":"2023-06-09T04:42:32.564134+0000","last_fullsized":"2023-06-09T04:42:32.564134+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:21:33.761909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.563734+0000","last_change":"2023-06-09T04:42:31.498634+0000","last_active":"2023-06-09T04:42:32.563734+0000","last_peered":"2023-06-09T04:42:32.563734+0000","last_clean":"2023-06-09T04:42:32.563734+0000","last_became_active":"2023-06-09T04:42:31.498184+0000","last_became_peered":"2023-06-09T04:42:31.498184+0000","last_unstale":"2023-06-09T04:42:32.563734+0000","last_undegraded":"2023-06-09T04:42:32.563734+0000","last_fullsized":"2023-06-09T04:42:32.563734+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:55:06.041733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.479258+0000","last_change":"2023-06-09T04:42:31.484967+0000","last_active":"2023-06-09T04:42:32.479258+0000","last_peered":"2023-06-09T04:42:32.479258+0000","last_clean":"2023-06-09T04:42:32.479258+0000","last_became_active":"2023-06-09T04:42:31.484439+0000","last_became_peered":"2023-06-09T04:42:31.484439+0000","last_unstale":"2023-06-09T04:42:32.479258+0000","last_undegraded":"2023-06-09T04:42:32.479258+0000","last_fullsized":"2023-06-09T04:42:32.479258+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:24:53.096922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.562257+0000","last_change":"2023-06-09T04:42:31.495543+0000","last_active":"2023-06-09T04:42:32.562257+0000","last_peered":"2023-06-09T04:42:32.562257+0000","last_clean":"2023-06-09T04:42:32.562257+0000","last_became_active":"2023-06-09T04:42:31.495297+0000","last_became_peered":"2023-06-09T04:42:31.495297+0000","last_unstale":"2023-06-09T04:42:32.562257+0000","last_undegraded":"2023-06-09T04:42:32.562257+0000","last_fullsized":"2023-06-09T04:42:32.562257+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:38:33.398228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.563184+0000","last_change":"2023-06-09T04:42:31.504927+0000","last_active":"2023-06-09T04:42:32.563184+0000","last_peered":"2023-06-09T04:42:32.563184+0000","last_clean":"2023-06-09T04:42:32.563184+0000","last_became_active":"2023-06-09T04:42:31.504590+0000","last_became_peered":"2023-06-09T04:42:31.504590+0000","last_unstale":"2023-06-09T04:42:32.563184+0000","last_undegraded":"2023-06-09T04:42:32.563184+0000","last_fullsized":"2023-06-09T04:42:32.563184+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:52:34.959948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.561628+0000","last_change":"2023-06-09T04:42:31.476868+0000","last_active":"2023-06-09T04:42:32.561628+0000","last_peered":"2023-06-09T04:42:32.561628+0000","last_clean":"2023-06-09T04:42:32.561628+0000","last_became_active":"2023-06-09T04:42:31.476589+0000","last_became_peered":"2023-06-09T04:42:31.476589+0000","last_unstale":"2023-06-09T04:42:32.561628+0000","last_undegraded":"2023-06-09T04:42:32.561628+0000","last_fullsized":"2023-06-09T04:42:32.561628+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:33:27.897310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.564232+0000","last_change":"2023-06-09T04:42:31.481515+0000","last_active":"2023-06-09T04:42:32.564232+0000","last_peered":"2023-06-09T04:42:32.564232+0000","last_clean":"2023-06-09T04:42:32.564232+0000","last_became_active":"2023-06-09T04:42:31.481252+0000","last_became_peered":"2023-06-09T04:42:31.481252+0000","last_unstale":"2023-06-09T04:42:32.564232+0000","last_undegraded":"2023-06-09T04:42:32.564232+0000","last_fullsized":"2023-06-09T04:42:32.564232+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T04:43:40.750824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.561040+0000","last_change":"2023-06-09T04:42:31.500591+0000","last_active":"2023-06-09T04:42:32.561040+0000","last_peered":"2023-06-09T04:42:32.561040+0000","last_clean":"2023-06-09T04:42:32.561040+0000","last_became_active":"2023-06-09T04:42:31.499588+0000","last_became_peered":"2023-06-09T04:42:31.499588+0000","last_unstale":"2023-06-09T04:42:32.561040+0000","last_undegraded":"2023-06-09T04:42:32.561040+0000","last_fullsized":"2023-06-09T04:42:32.561040+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:04:37.944946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.563326+0000","last_change":"2023-06-09T04:42:31.500484+0000","last_active":"2023-06-09T04:42:32.563326+0000","last_peered":"2023-06-09T04:42:32.563326+0000","last_clean":"2023-06-09T04:42:32.563326+0000","last_became_active":"2023-06-09T04:42:31.500008+0000","last_became_peered":"2023-06-09T04:42:31.500008+0000","last_unstale":"2023-06-09T04:42:32.563326+0000","last_undegraded":"2023-06-09T04:42:32.563326+0000","last_fullsized":"2023-06-09T04:42:32.563326+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:52:34.959948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.562868+0000","last_change":"2023-06-09T04:42:31.501587+0000","last_active":"2023-06-09T04:42:32.562868+0000","last_peered":"2023-06-09T04:42:32.562868+0000","last_clean":"2023-06-09T04:42:32.562868+0000","last_became_active":"2023-06-09T04:42:31.499750+0000","last_became_peered":"2023-06-09T04:42:31.499750+0000","last_unstale":"2023-06-09T04:42:32.562868+0000","last_undegraded":"2023-06-09T04:42:32.562868+0000","last_fullsized":"2023-06-09T04:42:32.562868+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:33:27.897310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.563208+0000","last_change":"2023-06-09T04:42:31.492189+0000","last_active":"2023-06-09T04:42:32.563208+0000","last_peered":"2023-06-09T04:42:32.563208+0000","last_clean":"2023-06-09T04:42:32.563208+0000","last_became_active":"2023-06-09T04:42:31.491804+0000","last_became_peered":"2023-06-09T04:42:31.491804+0000","last_unstale":"2023-06-09T04:42:32.563208+0000","last_undegraded":"2023-06-09T04:42:32.563208+0000","last_fullsized":"2023-06-09T04:42:32.563208+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:24:41.913943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.563563+0000","last_change":"2023-06-09T04:42:31.491443+0000","last_active":"2023-06-09T04:42:32.563563+0000","last_peered":"2023-06-09T04:42:32.563563+0000","last_clean":"2023-06-09T04:42:32.563563+0000","last_became_active":"2023-06-09T04:42:31.491149+0000","last_became_peered":"2023-06-09T04:42:31.491149+0000","last_unstale":"2023-06-09T04:42:32.563563+0000","last_undegraded":"2023-06-09T04:42:32.563563+0000","last_fullsized":"2023-06-09T04:42:32.563563+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:27:25.413089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.471470+0000","last_change":"2023-06-09T04:42:31.487452+0000","last_active":"2023-06-09T04:42:32.471470+0000","last_peered":"2023-06-09T04:42:32.471470+0000","last_clean":"2023-06-09T04:42:32.471470+0000","last_became_active":"2023-06-09T04:42:31.487047+0000","last_became_peered":"2023-06-09T04:42:31.487047+0000","last_unstale":"2023-06-09T04:42:32.471470+0000","last_undegraded":"2023-06-09T04:42:32.471470+0000","last_fullsized":"2023-06-09T04:42:32.471470+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:04:53.826017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.561521+0000","last_change":"2023-06-09T04:42:31.483914+0000","last_active":"2023-06-09T04:42:32.561521+0000","last_peered":"2023-06-09T04:42:32.561521+0000","last_clean":"2023-06-09T04:42:32.561521+0000","last_became_active":"2023-06-09T04:42:31.482784+0000","last_became_peered":"2023-06-09T04:42:31.482784+0000","last_unstale":"2023-06-09T04:42:32.561521+0000","last_undegraded":"2023-06-09T04:42:32.561521+0000","last_fullsized":"2023-06-09T04:42:32.561521+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:07:58.405912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.562181+0000","last_change":"2023-06-09T04:42:31.477517+0000","last_active":"2023-06-09T04:42:32.562181+0000","last_peered":"2023-06-09T04:42:32.562181+0000","last_clean":"2023-06-09T04:42:32.562181+0000","last_became_active":"2023-06-09T04:42:31.477044+0000","last_became_peered":"2023-06-09T04:42:31.477044+0000","last_unstale":"2023-06-09T04:42:32.562181+0000","last_undegraded":"2023-06-09T04:42:32.562181+0000","last_fullsized":"2023-06-09T04:42:32.562181+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:52:34.959948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.478727+0000","last_change":"2023-06-09T04:42:31.500595+0000","last_active":"2023-06-09T04:42:32.478727+0000","last_peered":"2023-06-09T04:42:32.478727+0000","last_clean":"2023-06-09T04:42:32.478727+0000","last_became_active":"2023-06-09T04:42:31.500292+0000","last_became_peered":"2023-06-09T04:42:31.500292+0000","last_unstale":"2023-06-09T04:42:32.478727+0000","last_undegraded":"2023-06-09T04:42:32.478727+0000","last_fullsized":"2023-06-09T04:42:32.478727+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:25:33.163147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.479645+0000","last_change":"2023-06-09T04:42:31.478530+0000","last_active":"2023-06-09T04:42:32.479645+0000","last_peered":"2023-06-09T04:42:32.479645+0000","last_clean":"2023-06-09T04:42:32.479645+0000","last_became_active":"2023-06-09T04:42:31.478189+0000","last_became_peered":"2023-06-09T04:42:31.478189+0000","last_unstale":"2023-06-09T04:42:32.479645+0000","last_undegraded":"2023-06-09T04:42:32.479645+0000","last_fullsized":"2023-06-09T04:42:32.479645+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:26:02.891756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.479487+0000","last_change":"2023-06-09T04:42:31.494844+0000","last_active":"2023-06-09T04:42:32.479487+0000","last_peered":"2023-06-09T04:42:32.479487+0000","last_clean":"2023-06-09T04:42:32.479487+0000","last_became_active":"2023-06-09T04:42:31.494570+0000","last_became_peered":"2023-06-09T04:42:31.494570+0000","last_unstale":"2023-06-09T04:42:32.479487+0000","last_undegraded":"2023-06-09T04:42:32.479487+0000","last_fullsized":"2023-06-09T04:42:32.479487+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:12:55.044632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.480604+0000","last_change":"2023-06-09T04:42:31.495741+0000","last_active":"2023-06-09T04:42:32.480604+0000","last_peered":"2023-06-09T04:42:32.480604+0000","last_clean":"2023-06-09T04:42:32.480604+0000","last_became_active":"2023-06-09T04:42:31.495445+0000","last_became_peered":"2023-06-09T04:42:31.495445+0000","last_unstale":"2023-06-09T04:42:32.480604+0000","last_undegraded":"2023-06-09T04:42:32.480604+0000","last_fullsized":"2023-06-09T04:42:32.480604+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:53:05.716291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.471675+0000","last_change":"2023-06-09T04:42:31.501606+0000","last_active":"2023-06-09T04:42:32.471675+0000","last_peered":"2023-06-09T04:42:32.471675+0000","last_clean":"2023-06-09T04:42:32.471675+0000","last_became_active":"2023-06-09T04:42:31.501197+0000","last_became_peered":"2023-06-09T04:42:31.501197+0000","last_unstale":"2023-06-09T04:42:32.471675+0000","last_undegraded":"2023-06-09T04:42:32.471675+0000","last_fullsized":"2023-06-09T04:42:32.471675+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T13:01:15.130085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.562125+0000","last_change":"2023-06-09T04:42:31.493087+0000","last_active":"2023-06-09T04:42:32.562125+0000","last_peered":"2023-06-09T04:42:32.562125+0000","last_clean":"2023-06-09T04:42:32.562125+0000","last_became_active":"2023-06-09T04:42:31.492811+0000","last_became_peered":"2023-06-09T04:42:31.492811+0000","last_unstale":"2023-06-09T04:42:32.562125+0000","last_undegraded":"2023-06-09T04:42:32.562125+0000","last_fullsized":"2023-06-09T04:42:32.562125+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:24:41.913943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.561737+0000","last_change":"2023-06-09T04:42:31.496215+0000","last_active":"2023-06-09T04:42:32.561737+0000","last_peered":"2023-06-09T04:42:32.561737+0000","last_clean":"2023-06-09T04:42:32.561737+0000","last_became_active":"2023-06-09T04:42:31.495940+0000","last_became_peered":"2023-06-09T04:42:31.495940+0000","last_unstale":"2023-06-09T04:42:32.561737+0000","last_undegraded":"2023-06-09T04:42:32.561737+0000","last_fullsized":"2023-06-09T04:42:32.561737+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:15:16.784831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.479679+0000","last_change":"2023-06-09T04:42:31.477341+0000","last_active":"2023-06-09T04:42:32.479679+0000","last_peered":"2023-06-09T04:42:32.479679+0000","last_clean":"2023-06-09T04:42:32.479679+0000","last_became_active":"2023-06-09T04:42:31.476581+0000","last_became_peered":"2023-06-09T04:42:31.476581+0000","last_unstale":"2023-06-09T04:42:32.479679+0000","last_undegraded":"2023-06-09T04:42:32.479679+0000","last_fullsized":"2023-06-09T04:42:32.479679+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:04:39.065206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.478862+0000","last_change":"2023-06-09T04:42:31.476939+0000","last_active":"2023-06-09T04:42:32.478862+0000","last_peered":"2023-06-09T04:42:32.478862+0000","last_clean":"2023-06-09T04:42:32.478862+0000","last_became_active":"2023-06-09T04:42:31.476596+0000","last_became_peered":"2023-06-09T04:42:31.476596+0000","last_unstale":"2023-06-09T04:42:32.478862+0000","last_undegraded":"2023-06-09T04:42:32.478862+0000","last_fullsized":"2023-06-09T04:42:32.478862+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:51:10.102526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.480410+0000","last_change":"2023-06-09T04:42:31.488653+0000","last_active":"2023-06-09T04:42:32.480410+0000","last_peered":"2023-06-09T04:42:32.480410+0000","last_clean":"2023-06-09T04:42:32.480410+0000","last_became_active":"2023-06-09T04:42:31.485262+0000","last_became_peered":"2023-06-09T04:42:31.485262+0000","last_unstale":"2023-06-09T04:42:32.480410+0000","last_undegraded":"2023-06-09T04:42:32.480410+0000","last_fullsized":"2023-06-09T04:42:32.480410+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:44:21.810252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.472166+0000","last_change":"2023-06-09T04:42:31.488751+0000","last_active":"2023-06-09T04:42:32.472166+0000","last_peered":"2023-06-09T04:42:32.472166+0000","last_clean":"2023-06-09T04:42:32.472166+0000","last_became_active":"2023-06-09T04:42:31.488478+0000","last_became_peered":"2023-06-09T04:42:31.488478+0000","last_unstale":"2023-06-09T04:42:32.472166+0000","last_undegraded":"2023-06-09T04:42:32.472166+0000","last_fullsized":"2023-06-09T04:42:32.472166+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:19:37.505923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.479334+0000","last_change":"2023-06-09T04:42:31.478231+0000","last_active":"2023-06-09T04:42:32.479334+0000","last_peered":"2023-06-09T04:42:32.479334+0000","last_clean":"2023-06-09T04:42:32.479334+0000","last_became_active":"2023-06-09T04:42:31.477949+0000","last_became_peered":"2023-06-09T04:42:31.477949+0000","last_unstale":"2023-06-09T04:42:32.479334+0000","last_undegraded":"2023-06-09T04:42:32.479334+0000","last_fullsized":"2023-06-09T04:42:32.479334+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:43:31.155528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.563829+0000","last_change":"2023-06-09T04:42:31.491116+0000","last_active":"2023-06-09T04:42:32.563829+0000","last_peered":"2023-06-09T04:42:32.563829+0000","last_clean":"2023-06-09T04:42:32.563829+0000","last_became_active":"2023-06-09T04:42:31.490837+0000","last_became_peered":"2023-06-09T04:42:31.490837+0000","last_unstale":"2023-06-09T04:42:32.563829+0000","last_undegraded":"2023-06-09T04:42:32.563829+0000","last_fullsized":"2023-06-09T04:42:32.563829+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:00:22.568885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.480352+0000","last_change":"2023-06-09T04:42:31.478565+0000","last_active":"2023-06-09T04:42:32.480352+0000","last_peered":"2023-06-09T04:42:32.480352+0000","last_clean":"2023-06-09T04:42:32.480352+0000","last_became_active":"2023-06-09T04:42:31.478016+0000","last_became_peered":"2023-06-09T04:42:31.478016+0000","last_unstale":"2023-06-09T04:42:32.480352+0000","last_undegraded":"2023-06-09T04:42:32.480352+0000","last_fullsized":"2023-06-09T04:42:32.480352+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:01:46.303791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.479116+0000","last_change":"2023-06-09T04:42:31.478815+0000","last_active":"2023-06-09T04:42:32.479116+0000","last_peered":"2023-06-09T04:42:32.479116+0000","last_clean":"2023-06-09T04:42:32.479116+0000","last_became_active":"2023-06-09T04:42:31.478551+0000","last_became_peered":"2023-06-09T04:42:31.478551+0000","last_unstale":"2023-06-09T04:42:32.479116+0000","last_undegraded":"2023-06-09T04:42:32.479116+0000","last_fullsized":"2023-06-09T04:42:32.479116+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:45:50.291024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.562319+0000","last_change":"2023-06-09T04:42:31.477292+0000","last_active":"2023-06-09T04:42:32.562319+0000","last_peered":"2023-06-09T04:42:32.562319+0000","last_clean":"2023-06-09T04:42:32.562319+0000","last_became_active":"2023-06-09T04:42:31.476754+0000","last_became_peered":"2023-06-09T04:42:31.476754+0000","last_unstale":"2023-06-09T04:42:32.562319+0000","last_undegraded":"2023-06-09T04:42:32.562319+0000","last_fullsized":"2023-06-09T04:42:32.562319+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:40:00.279793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.471125+0000","last_change":"2023-06-09T04:42:31.483828+0000","last_active":"2023-06-09T04:42:32.471125+0000","last_peered":"2023-06-09T04:42:32.471125+0000","last_clean":"2023-06-09T04:42:32.471125+0000","last_became_active":"2023-06-09T04:42:31.483566+0000","last_became_peered":"2023-06-09T04:42:31.483566+0000","last_unstale":"2023-06-09T04:42:32.471125+0000","last_undegraded":"2023-06-09T04:42:32.471125+0000","last_fullsized":"2023-06-09T04:42:32.471125+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:24:06.467092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.560268+0000","last_change":"2023-06-09T04:42:31.478762+0000","last_active":"2023-06-09T04:42:32.560268+0000","last_peered":"2023-06-09T04:42:32.560268+0000","last_clean":"2023-06-09T04:42:32.560268+0000","last_became_active":"2023-06-09T04:42:31.478313+0000","last_became_peered":"2023-06-09T04:42:31.478313+0000","last_unstale":"2023-06-09T04:42:32.560268+0000","last_undegraded":"2023-06-09T04:42:32.560268+0000","last_fullsized":"2023-06-09T04:42:32.560268+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:34:02.137046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"42'4","reported_seq":17,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.562686+0000","last_change":"2023-06-09T04:42:30.999201+0000","last_active":"2023-06-09T04:42:32.562686+0000","last_peered":"2023-06-09T04:42:32.562686+0000","last_clean":"2023-06-09T04:42:32.562686+0000","last_became_active":"2023-06-09T04:42:30.998923+0000","last_became_peered":"2023-06-09T04:42:30.998923+0000","last_unstale":"2023-06-09T04:42:32.562686+0000","last_undegraded":"2023-06-09T04:42:32.562686+0000","last_fullsized":"2023-06-09T04:42:32.562686+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_clean_scrub_stamp":"2023-06-09T04:42:29.940868+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:00:21.553743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.480489+0000","last_change":"2023-06-09T04:42:31.488254+0000","last_active":"2023-06-09T04:42:32.480489+0000","last_peered":"2023-06-09T04:42:32.480489+0000","last_clean":"2023-06-09T04:42:32.480489+0000","last_became_active":"2023-06-09T04:42:31.485188+0000","last_became_peered":"2023-06-09T04:42:31.485188+0000","last_unstale":"2023-06-09T04:42:32.480489+0000","last_undegraded":"2023-06-09T04:42:32.480489+0000","last_fullsized":"2023-06-09T04:42:32.480489+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:53:34.906721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"42'1","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.479650+0000","last_change":"2023-06-09T04:42:30.998307+0000","last_active":"2023-06-09T04:42:32.479650+0000","last_peered":"2023-06-09T04:42:32.479650+0000","last_clean":"2023-06-09T04:42:32.479650+0000","last_became_active":"2023-06-09T04:42:30.997825+0000","last_became_peered":"2023-06-09T04:42:30.997825+0000","last_unstale":"2023-06-09T04:42:32.479650+0000","last_undegraded":"2023-06-09T04:42:32.479650+0000","last_fullsized":"2023-06-09T04:42:32.479650+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_clean_scrub_stamp":"2023-06-09T04:42:29.940868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:59:35.204244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.563986+0000","last_change":"2023-06-09T04:42:31.484449+0000","last_active":"2023-06-09T04:42:32.563986+0000","last_peered":"2023-06-09T04:42:32.563986+0000","last_clean":"2023-06-09T04:42:32.563986+0000","last_became_active":"2023-06-09T04:42:31.484162+0000","last_became_peered":"2023-06-09T04:42:31.484162+0000","last_unstale":"2023-06-09T04:42:32.563986+0000","last_undegraded":"2023-06-09T04:42:32.563986+0000","last_fullsized":"2023-06-09T04:42:32.563986+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:41:39.853833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"42'2","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.560421+0000","last_change":"2023-06-09T04:42:30.998607+0000","last_active":"2023-06-09T04:42:32.560421+0000","last_peered":"2023-06-09T04:42:32.560421+0000","last_clean":"2023-06-09T04:42:32.560421+0000","last_became_active":"2023-06-09T04:42:30.997529+0000","last_became_peered":"2023-06-09T04:42:30.997529+0000","last_unstale":"2023-06-09T04:42:32.560421+0000","last_undegraded":"2023-06-09T04:42:32.560421+0000","last_fullsized":"2023-06-09T04:42:32.560421+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_clean_scrub_stamp":"2023-06-09T04:42:29.940868+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:40:16.903368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.560479+0000","last_change":"2023-06-09T04:42:31.489531+0000","last_active":"2023-06-09T04:42:32.560479+0000","last_peered":"2023-06-09T04:42:32.560479+0000","last_clean":"2023-06-09T04:42:32.560479+0000","last_became_active":"2023-06-09T04:42:31.489248+0000","last_became_peered":"2023-06-09T04:42:31.489248+0000","last_unstale":"2023-06-09T04:42:32.560479+0000","last_undegraded":"2023-06-09T04:42:32.560479+0000","last_fullsized":"2023-06-09T04:42:32.560479+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:07:58.405912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"42'2","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.564258+0000","last_change":"2023-06-09T04:42:30.992544+0000","last_active":"2023-06-09T04:42:32.564258+0000","last_peered":"2023-06-09T04:42:32.564258+0000","last_clean":"2023-06-09T04:42:32.564258+0000","last_became_active":"2023-06-09T04:42:30.992227+0000","last_became_peered":"2023-06-09T04:42:30.992227+0000","last_unstale":"2023-06-09T04:42:32.564258+0000","last_undegraded":"2023-06-09T04:42:32.564258+0000","last_fullsized":"2023-06-09T04:42:32.564258+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_clean_scrub_stamp":"2023-06-09T04:42:29.940868+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:26:40.814962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.478984+0000","last_change":"2023-06-09T04:42:31.496893+0000","last_active":"2023-06-09T04:42:32.478984+0000","last_peered":"2023-06-09T04:42:32.478984+0000","last_clean":"2023-06-09T04:42:32.478984+0000","last_became_active":"2023-06-09T04:42:31.496624+0000","last_became_peered":"2023-06-09T04:42:31.496624+0000","last_unstale":"2023-06-09T04:42:32.478984+0000","last_undegraded":"2023-06-09T04:42:32.478984+0000","last_fullsized":"2023-06-09T04:42:32.478984+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:33:34.176799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"42'1","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.562545+0000","last_change":"2023-06-09T04:42:30.993281+0000","last_active":"2023-06-09T04:42:32.562545+0000","last_peered":"2023-06-09T04:42:32.562545+0000","last_clean":"2023-06-09T04:42:32.562545+0000","last_became_active":"2023-06-09T04:42:30.993007+0000","last_became_peered":"2023-06-09T04:42:30.993007+0000","last_unstale":"2023-06-09T04:42:32.562545+0000","last_undegraded":"2023-06-09T04:42:32.562545+0000","last_fullsized":"2023-06-09T04:42:32.562545+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_clean_scrub_stamp":"2023-06-09T04:42:29.940868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:55:05.026590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.561906+0000","last_change":"2023-06-09T04:42:31.491770+0000","last_active":"2023-06-09T04:42:32.561906+0000","last_peered":"2023-06-09T04:42:32.561906+0000","last_clean":"2023-06-09T04:42:32.561906+0000","last_became_active":"2023-06-09T04:42:31.491394+0000","last_became_peered":"2023-06-09T04:42:31.491394+0000","last_unstale":"2023-06-09T04:42:32.561906+0000","last_undegraded":"2023-06-09T04:42:32.561906+0000","last_fullsized":"2023-06-09T04:42:32.561906+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:22:20.474949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"42'1","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.479253+0000","last_change":"2023-06-09T04:42:30.992420+0000","last_active":"2023-06-09T04:42:32.479253+0000","last_peered":"2023-06-09T04:42:32.479253+0000","last_clean":"2023-06-09T04:42:32.479253+0000","last_became_active":"2023-06-09T04:42:30.992161+0000","last_became_peered":"2023-06-09T04:42:30.992161+0000","last_unstale":"2023-06-09T04:42:32.479253+0000","last_undegraded":"2023-06-09T04:42:32.479253+0000","last_fullsized":"2023-06-09T04:42:32.479253+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_clean_scrub_stamp":"2023-06-09T04:42:29.940868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:17:44.035751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.561125+0000","last_change":"2023-06-09T04:42:31.500359+0000","last_active":"2023-06-09T04:42:32.561125+0000","last_peered":"2023-06-09T04:42:32.561125+0000","last_clean":"2023-06-09T04:42:32.561125+0000","last_became_active":"2023-06-09T04:42:31.496279+0000","last_became_peered":"2023-06-09T04:42:31.496279+0000","last_unstale":"2023-06-09T04:42:32.561125+0000","last_undegraded":"2023-06-09T04:42:32.561125+0000","last_fullsized":"2023-06-09T04:42:32.561125+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:01:38.471310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.562944+0000","last_change":"2023-06-09T04:42:30.998026+0000","last_active":"2023-06-09T04:42:32.562944+0000","last_peered":"2023-06-09T04:42:32.562944+0000","last_clean":"2023-06-09T04:42:32.562944+0000","last_became_active":"2023-06-09T04:42:30.997598+0000","last_became_peered":"2023-06-09T04:42:30.997598+0000","last_unstale":"2023-06-09T04:42:32.562944+0000","last_undegraded":"2023-06-09T04:42:32.562944+0000","last_fullsized":"2023-06-09T04:42:32.562944+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_clean_scrub_stamp":"2023-06-09T04:42:29.940868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T04:55:58.055395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.479520+0000","last_change":"2023-06-09T04:42:31.485495+0000","last_active":"2023-06-09T04:42:32.479520+0000","last_peered":"2023-06-09T04:42:32.479520+0000","last_clean":"2023-06-09T04:42:32.479520+0000","last_became_active":"2023-06-09T04:42:31.484092+0000","last_became_peered":"2023-06-09T04:42:31.484092+0000","last_unstale":"2023-06-09T04:42:32.479520+0000","last_undegraded":"2023-06-09T04:42:32.479520+0000","last_fullsized":"2023-06-09T04:42:32.479520+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:35:55.163527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.561238+0000","last_change":"2023-06-09T04:42:30.996410+0000","last_active":"2023-06-09T04:42:32.561238+0000","last_peered":"2023-06-09T04:42:32.561238+0000","last_clean":"2023-06-09T04:42:32.561238+0000","last_became_active":"2023-06-09T04:42:30.995903+0000","last_became_peered":"2023-06-09T04:42:30.995903+0000","last_unstale":"2023-06-09T04:42:32.561238+0000","last_undegraded":"2023-06-09T04:42:32.561238+0000","last_fullsized":"2023-06-09T04:42:32.561238+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_clean_scrub_stamp":"2023-06-09T04:42:29.940868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:34:01.121903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.479644+0000","last_change":"2023-06-09T04:42:31.495619+0000","last_active":"2023-06-09T04:42:32.479644+0000","last_peered":"2023-06-09T04:42:32.479644+0000","last_clean":"2023-06-09T04:42:32.479644+0000","last_became_active":"2023-06-09T04:42:31.495363+0000","last_became_peered":"2023-06-09T04:42:31.495363+0000","last_unstale":"2023-06-09T04:42:32.479644+0000","last_undegraded":"2023-06-09T04:42:32.479644+0000","last_fullsized":"2023-06-09T04:42:32.479644+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:56:06.788007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.480072+0000","last_change":"2023-06-09T04:42:30.994339+0000","last_active":"2023-06-09T04:42:32.480072+0000","last_peered":"2023-06-09T04:42:32.480072+0000","last_clean":"2023-06-09T04:42:32.480072+0000","last_became_active":"2023-06-09T04:42:30.994042+0000","last_became_peered":"2023-06-09T04:42:30.994042+0000","last_unstale":"2023-06-09T04:42:32.480072+0000","last_undegraded":"2023-06-09T04:42:32.480072+0000","last_fullsized":"2023-06-09T04:42:32.480072+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_clean_scrub_stamp":"2023-06-09T04:42:29.940868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:13:34.025727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.564407+0000","last_change":"2023-06-09T04:42:31.478765+0000","last_active":"2023-06-09T04:42:32.564407+0000","last_peered":"2023-06-09T04:42:32.564407+0000","last_clean":"2023-06-09T04:42:32.564407+0000","last_became_active":"2023-06-09T04:42:31.477876+0000","last_became_peered":"2023-06-09T04:42:31.477876+0000","last_unstale":"2023-06-09T04:42:32.564407+0000","last_undegraded":"2023-06-09T04:42:32.564407+0000","last_fullsized":"2023-06-09T04:42:32.564407+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:29:12.130785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.563123+0000","last_change":"2023-06-09T04:42:30.998878+0000","last_active":"2023-06-09T04:42:32.563123+0000","last_peered":"2023-06-09T04:42:32.563123+0000","last_clean":"2023-06-09T04:42:32.563123+0000","last_became_active":"2023-06-09T04:42:30.998574+0000","last_became_peered":"2023-06-09T04:42:30.998574+0000","last_unstale":"2023-06-09T04:42:32.563123+0000","last_undegraded":"2023-06-09T04:42:32.563123+0000","last_fullsized":"2023-06-09T04:42:32.563123+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_clean_scrub_stamp":"2023-06-09T04:42:29.940868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T04:55:58.055395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.562840+0000","last_change":"2023-06-09T04:42:31.490068+0000","last_active":"2023-06-09T04:42:32.562840+0000","last_peered":"2023-06-09T04:42:32.562840+0000","last_clean":"2023-06-09T04:42:32.562840+0000","last_became_active":"2023-06-09T04:42:31.489608+0000","last_became_peered":"2023-06-09T04:42:31.489608+0000","last_unstale":"2023-06-09T04:42:32.562840+0000","last_undegraded":"2023-06-09T04:42:32.562840+0000","last_fullsized":"2023-06-09T04:42:32.562840+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:40:39.931202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"42'3","reported_seq":16,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.564355+0000","last_change":"2023-06-09T04:42:31.000506+0000","last_active":"2023-06-09T04:42:32.564355+0000","last_peered":"2023-06-09T04:42:32.564355+0000","last_clean":"2023-06-09T04:42:32.564355+0000","last_became_active":"2023-06-09T04:42:31.000243+0000","last_became_peered":"2023-06-09T04:42:31.000243+0000","last_unstale":"2023-06-09T04:42:32.564355+0000","last_undegraded":"2023-06-09T04:42:32.564355+0000","last_fullsized":"2023-06-09T04:42:32.564355+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_clean_scrub_stamp":"2023-06-09T04:42:29.940868+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:55:05.573347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.564198+0000","last_change":"2023-06-09T04:42:31.482514+0000","last_active":"2023-06-09T04:42:32.564198+0000","last_peered":"2023-06-09T04:42:32.564198+0000","last_clean":"2023-06-09T04:42:32.564198+0000","last_became_active":"2023-06-09T04:42:31.482183+0000","last_became_peered":"2023-06-09T04:42:31.482183+0000","last_unstale":"2023-06-09T04:42:32.564198+0000","last_undegraded":"2023-06-09T04:42:32.564198+0000","last_fullsized":"2023-06-09T04:42:32.564198+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:37:40.949770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"42'6","reported_seq":19,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.471768+0000","last_change":"2023-06-09T04:42:30.993703+0000","last_active":"2023-06-09T04:42:32.471768+0000","last_peered":"2023-06-09T04:42:32.471768+0000","last_clean":"2023-06-09T04:42:32.471768+0000","last_became_active":"2023-06-09T04:42:30.993424+0000","last_became_peered":"2023-06-09T04:42:30.993424+0000","last_unstale":"2023-06-09T04:42:32.471768+0000","last_undegraded":"2023-06-09T04:42:32.471768+0000","last_fullsized":"2023-06-09T04:42:32.471768+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_clean_scrub_stamp":"2023-06-09T04:42:29.940868+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:58:03.068259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.479973+0000","last_change":"2023-06-09T04:42:31.489392+0000","last_active":"2023-06-09T04:42:32.479973+0000","last_peered":"2023-06-09T04:42:32.479973+0000","last_clean":"2023-06-09T04:42:32.479973+0000","last_became_active":"2023-06-09T04:42:31.489105+0000","last_became_peered":"2023-06-09T04:42:31.489105+0000","last_unstale":"2023-06-09T04:42:32.479973+0000","last_undegraded":"2023-06-09T04:42:32.479973+0000","last_fullsized":"2023-06-09T04:42:32.479973+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:25:13.016490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"42'2","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.562763+0000","last_change":"2023-06-09T04:42:31.002540+0000","last_active":"2023-06-09T04:42:32.562763+0000","last_peered":"2023-06-09T04:42:32.562763+0000","last_clean":"2023-06-09T04:42:32.562763+0000","last_became_active":"2023-06-09T04:42:31.002260+0000","last_became_peered":"2023-06-09T04:42:31.002260+0000","last_unstale":"2023-06-09T04:42:32.562763+0000","last_undegraded":"2023-06-09T04:42:32.562763+0000","last_fullsized":"2023-06-09T04:42:32.562763+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_clean_scrub_stamp":"2023-06-09T04:42:29.940868+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:41:38.838691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.562096+0000","last_change":"2023-06-09T04:42:31.482284+0000","last_active":"2023-06-09T04:42:32.562096+0000","last_peered":"2023-06-09T04:42:32.562096+0000","last_clean":"2023-06-09T04:42:32.562096+0000","last_became_active":"2023-06-09T04:42:31.481968+0000","last_became_peered":"2023-06-09T04:42:31.481968+0000","last_unstale":"2023-06-09T04:42:32.562096+0000","last_undegraded":"2023-06-09T04:42:32.562096+0000","last_fullsized":"2023-06-09T04:42:32.562096+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:42:16.281590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.564197+0000","last_change":"2023-06-09T04:42:30.993560+0000","last_active":"2023-06-09T04:42:32.564197+0000","last_peered":"2023-06-09T04:42:32.564197+0000","last_clean":"2023-06-09T04:42:32.564197+0000","last_became_active":"2023-06-09T04:42:30.993239+0000","last_became_peered":"2023-06-09T04:42:30.993239+0000","last_unstale":"2023-06-09T04:42:32.564197+0000","last_undegraded":"2023-06-09T04:42:32.564197+0000","last_fullsized":"2023-06-09T04:42:32.564197+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_clean_scrub_stamp":"2023-06-09T04:42:29.940868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:35:58.058048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.561399+0000","last_change":"2023-06-09T04:42:31.488129+0000","last_active":"2023-06-09T04:42:32.561399+0000","last_peered":"2023-06-09T04:42:32.561399+0000","last_clean":"2023-06-09T04:42:32.561399+0000","last_became_active":"2023-06-09T04:42:31.487824+0000","last_became_peered":"2023-06-09T04:42:31.487824+0000","last_unstale":"2023-06-09T04:42:32.561399+0000","last_undegraded":"2023-06-09T04:42:32.561399+0000","last_fullsized":"2023-06-09T04:42:32.561399+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:20:39.543980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.562449+0000","last_change":"2023-06-09T04:42:31.003354+0000","last_active":"2023-06-09T04:42:32.562449+0000","last_peered":"2023-06-09T04:42:32.562449+0000","last_clean":"2023-06-09T04:42:32.562449+0000","last_became_active":"2023-06-09T04:42:31.003093+0000","last_became_peered":"2023-06-09T04:42:31.003093+0000","last_unstale":"2023-06-09T04:42:32.562449+0000","last_undegraded":"2023-06-09T04:42:32.562449+0000","last_fullsized":"2023-06-09T04:42:32.562449+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_clean_scrub_stamp":"2023-06-09T04:42:29.940868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:20:57.735736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.563640+0000","last_change":"2023-06-09T04:42:31.497178+0000","last_active":"2023-06-09T04:42:32.563640+0000","last_peered":"2023-06-09T04:42:32.563640+0000","last_clean":"2023-06-09T04:42:32.563640+0000","last_became_active":"2023-06-09T04:42:31.496823+0000","last_became_peered":"2023-06-09T04:42:31.496823+0000","last_unstale":"2023-06-09T04:42:32.563640+0000","last_undegraded":"2023-06-09T04:42:32.563640+0000","last_fullsized":"2023-06-09T04:42:32.563640+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:40:39.931202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"42'8","reported_seq":21,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.561333+0000","last_change":"2023-06-09T04:42:30.996186+0000","last_active":"2023-06-09T04:42:32.561333+0000","last_peered":"2023-06-09T04:42:32.561333+0000","last_clean":"2023-06-09T04:42:32.561333+0000","last_became_active":"2023-06-09T04:42:30.995519+0000","last_became_peered":"2023-06-09T04:42:30.995519+0000","last_unstale":"2023-06-09T04:42:32.561333+0000","last_undegraded":"2023-06-09T04:42:32.561333+0000","last_fullsized":"2023-06-09T04:42:32.561333+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_clean_scrub_stamp":"2023-06-09T04:42:29.940868+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:28:52.295148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.472100+0000","last_change":"2023-06-09T04:42:31.482251+0000","last_active":"2023-06-09T04:42:32.472100+0000","last_peered":"2023-06-09T04:42:32.472100+0000","last_clean":"2023-06-09T04:42:32.472100+0000","last_became_active":"2023-06-09T04:42:31.481991+0000","last_became_peered":"2023-06-09T04:42:31.481991+0000","last_unstale":"2023-06-09T04:42:32.472100+0000","last_undegraded":"2023-06-09T04:42:32.472100+0000","last_fullsized":"2023-06-09T04:42:32.472100+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:42:54.453446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"42'1","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.472172+0000","last_change":"2023-06-09T04:42:30.997952+0000","last_active":"2023-06-09T04:42:32.472172+0000","last_peered":"2023-06-09T04:42:32.472172+0000","last_clean":"2023-06-09T04:42:32.472172+0000","last_became_active":"2023-06-09T04:42:30.997680+0000","last_became_peered":"2023-06-09T04:42:30.997680+0000","last_unstale":"2023-06-09T04:42:32.472172+0000","last_undegraded":"2023-06-09T04:42:32.472172+0000","last_fullsized":"2023-06-09T04:42:32.472172+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_clean_scrub_stamp":"2023-06-09T04:42:29.940868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:51:05.281032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.563373+0000","last_change":"2023-06-09T04:42:31.491677+0000","last_active":"2023-06-09T04:42:32.563373+0000","last_peered":"2023-06-09T04:42:32.563373+0000","last_clean":"2023-06-09T04:42:32.563373+0000","last_became_active":"2023-06-09T04:42:31.491269+0000","last_became_peered":"2023-06-09T04:42:31.491269+0000","last_unstale":"2023-06-09T04:42:32.563373+0000","last_undegraded":"2023-06-09T04:42:32.563373+0000","last_fullsized":"2023-06-09T04:42:32.563373+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:40:00.279793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"42'2","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.480435+0000","last_change":"2023-06-09T04:42:30.997230+0000","last_active":"2023-06-09T04:42:32.480435+0000","last_peered":"2023-06-09T04:42:32.480435+0000","last_clean":"2023-06-09T04:42:32.480435+0000","last_became_active":"2023-06-09T04:42:30.996903+0000","last_became_peered":"2023-06-09T04:42:30.996903+0000","last_unstale":"2023-06-09T04:42:32.480435+0000","last_undegraded":"2023-06-09T04:42:32.480435+0000","last_fullsized":"2023-06-09T04:42:32.480435+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_clean_scrub_stamp":"2023-06-09T04:42:29.940868+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:06:28.367823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.480391+0000","last_change":"2023-06-09T04:42:31.488055+0000","last_active":"2023-06-09T04:42:32.480391+0000","last_peered":"2023-06-09T04:42:32.480391+0000","last_clean":"2023-06-09T04:42:32.480391+0000","last_became_active":"2023-06-09T04:42:31.487745+0000","last_became_peered":"2023-06-09T04:42:31.487745+0000","last_unstale":"2023-06-09T04:42:32.480391+0000","last_undegraded":"2023-06-09T04:42:32.480391+0000","last_fullsized":"2023-06-09T04:42:32.480391+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T04:53:16.885700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"42'1","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.563917+0000","last_change":"2023-06-09T04:42:30.997900+0000","last_active":"2023-06-09T04:42:32.563917+0000","last_peered":"2023-06-09T04:42:32.563917+0000","last_clean":"2023-06-09T04:42:32.563917+0000","last_became_active":"2023-06-09T04:42:30.997604+0000","last_became_peered":"2023-06-09T04:42:30.997604+0000","last_unstale":"2023-06-09T04:42:32.563917+0000","last_undegraded":"2023-06-09T04:42:32.563917+0000","last_fullsized":"2023-06-09T04:42:32.563917+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_clean_scrub_stamp":"2023-06-09T04:42:29.940868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:16:11.588557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.480203+0000","last_change":"2023-06-09T04:42:31.488567+0000","last_active":"2023-06-09T04:42:32.480203+0000","last_peered":"2023-06-09T04:42:32.480203+0000","last_clean":"2023-06-09T04:42:32.480203+0000","last_became_active":"2023-06-09T04:42:31.485296+0000","last_became_peered":"2023-06-09T04:42:31.485296+0000","last_unstale":"2023-06-09T04:42:32.480203+0000","last_undegraded":"2023-06-09T04:42:32.480203+0000","last_fullsized":"2023-06-09T04:42:32.480203+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:22:56.756161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.562943+0000","last_change":"2023-06-09T04:42:30.998358+0000","last_active":"2023-06-09T04:42:32.562943+0000","last_peered":"2023-06-09T04:42:32.562943+0000","last_clean":"2023-06-09T04:42:32.562943+0000","last_became_active":"2023-06-09T04:42:30.998052+0000","last_became_peered":"2023-06-09T04:42:30.998052+0000","last_unstale":"2023-06-09T04:42:32.562943+0000","last_undegraded":"2023-06-09T04:42:32.562943+0000","last_fullsized":"2023-06-09T04:42:32.562943+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_clean_scrub_stamp":"2023-06-09T04:42:29.940868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:46:50.843413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.561815+0000","last_change":"2023-06-09T04:42:31.485913+0000","last_active":"2023-06-09T04:42:32.561815+0000","last_peered":"2023-06-09T04:42:32.561815+0000","last_clean":"2023-06-09T04:42:32.561815+0000","last_became_active":"2023-06-09T04:42:31.485638+0000","last_became_peered":"2023-06-09T04:42:31.485638+0000","last_unstale":"2023-06-09T04:42:32.561815+0000","last_undegraded":"2023-06-09T04:42:32.561815+0000","last_fullsized":"2023-06-09T04:42:32.561815+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:35:28.103518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"42'2","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.562757+0000","last_change":"2023-06-09T04:42:30.994778+0000","last_active":"2023-06-09T04:42:32.562757+0000","last_peered":"2023-06-09T04:42:32.562757+0000","last_clean":"2023-06-09T04:42:32.562757+0000","last_became_active":"2023-06-09T04:42:30.994466+0000","last_became_peered":"2023-06-09T04:42:30.994466+0000","last_unstale":"2023-06-09T04:42:32.562757+0000","last_undegraded":"2023-06-09T04:42:32.562757+0000","last_fullsized":"2023-06-09T04:42:32.562757+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_clean_scrub_stamp":"2023-06-09T04:42:29.940868+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:16:11.588557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.560637+0000","last_change":"2023-06-09T04:42:31.473998+0000","last_active":"2023-06-09T04:42:32.560637+0000","last_peered":"2023-06-09T04:42:32.560637+0000","last_clean":"2023-06-09T04:42:32.560637+0000","last_became_active":"2023-06-09T04:42:31.473704+0000","last_became_peered":"2023-06-09T04:42:31.473704+0000","last_unstale":"2023-06-09T04:42:32.560637+0000","last_undegraded":"2023-06-09T04:42:32.560637+0000","last_fullsized":"2023-06-09T04:42:32.560637+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:01:39.426150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.562899+0000","last_change":"2023-06-09T04:42:31.000017+0000","last_active":"2023-06-09T04:42:32.562899+0000","last_peered":"2023-06-09T04:42:32.562899+0000","last_clean":"2023-06-09T04:42:32.562899+0000","last_became_active":"2023-06-09T04:42:30.999712+0000","last_became_peered":"2023-06-09T04:42:30.999712+0000","last_unstale":"2023-06-09T04:42:32.562899+0000","last_undegraded":"2023-06-09T04:42:32.562899+0000","last_fullsized":"2023-06-09T04:42:32.562899+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_clean_scrub_stamp":"2023-06-09T04:42:29.940868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:35:27.088375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.471310+0000","last_change":"2023-06-09T04:42:31.485131+0000","last_active":"2023-06-09T04:42:32.471310+0000","last_peered":"2023-06-09T04:42:32.471310+0000","last_clean":"2023-06-09T04:42:32.471310+0000","last_became_active":"2023-06-09T04:42:31.484843+0000","last_became_peered":"2023-06-09T04:42:31.484843+0000","last_unstale":"2023-06-09T04:42:32.471310+0000","last_undegraded":"2023-06-09T04:42:32.471310+0000","last_fullsized":"2023-06-09T04:42:32.471310+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:33:35.739370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.561949+0000","last_change":"2023-06-09T04:42:30.998935+0000","last_active":"2023-06-09T04:42:32.561949+0000","last_peered":"2023-06-09T04:42:32.561949+0000","last_clean":"2023-06-09T04:42:32.561949+0000","last_became_active":"2023-06-09T04:42:30.998565+0000","last_became_peered":"2023-06-09T04:42:30.998565+0000","last_unstale":"2023-06-09T04:42:32.561949+0000","last_undegraded":"2023-06-09T04:42:32.561949+0000","last_fullsized":"2023-06-09T04:42:32.561949+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_clean_scrub_stamp":"2023-06-09T04:42:29.940868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:12:25.173918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.561765+0000","last_change":"2023-06-09T04:42:31.484442+0000","last_active":"2023-06-09T04:42:32.561765+0000","last_peered":"2023-06-09T04:42:32.561765+0000","last_clean":"2023-06-09T04:42:32.561765+0000","last_became_active":"2023-06-09T04:42:31.484167+0000","last_became_peered":"2023-06-09T04:42:31.484167+0000","last_unstale":"2023-06-09T04:42:32.561765+0000","last_undegraded":"2023-06-09T04:42:32.561765+0000","last_fullsized":"2023-06-09T04:42:32.561765+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:01:39.426150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.562775+0000","last_change":"2023-06-09T04:42:30.993642+0000","last_active":"2023-06-09T04:42:32.562775+0000","last_peered":"2023-06-09T04:42:32.562775+0000","last_clean":"2023-06-09T04:42:32.562775+0000","last_became_active":"2023-06-09T04:42:30.993330+0000","last_became_peered":"2023-06-09T04:42:30.993330+0000","last_unstale":"2023-06-09T04:42:32.562775+0000","last_undegraded":"2023-06-09T04:42:32.562775+0000","last_fullsized":"2023-06-09T04:42:32.562775+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_clean_scrub_stamp":"2023-06-09T04:42:29.940868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:00:21.553743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.562002+0000","last_change":"2023-06-09T04:42:31.479528+0000","last_active":"2023-06-09T04:42:32.562002+0000","last_peered":"2023-06-09T04:42:32.562002+0000","last_clean":"2023-06-09T04:42:32.562002+0000","last_became_active":"2023-06-09T04:42:31.478609+0000","last_became_peered":"2023-06-09T04:42:31.478609+0000","last_unstale":"2023-06-09T04:42:32.562002+0000","last_undegraded":"2023-06-09T04:42:32.562002+0000","last_fullsized":"2023-06-09T04:42:32.562002+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T04:55:59.070537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.563996+0000","last_change":"2023-06-09T04:42:30.999017+0000","last_active":"2023-06-09T04:42:32.563996+0000","last_peered":"2023-06-09T04:42:32.563996+0000","last_clean":"2023-06-09T04:42:32.563996+0000","last_became_active":"2023-06-09T04:42:30.998764+0000","last_became_peered":"2023-06-09T04:42:30.998764+0000","last_unstale":"2023-06-09T04:42:32.563996+0000","last_undegraded":"2023-06-09T04:42:32.563996+0000","last_fullsized":"2023-06-09T04:42:32.563996+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_clean_scrub_stamp":"2023-06-09T04:42:29.940868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:46:50.843413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":55,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.480632+0000","last_change":"2023-06-09T04:40:51.254956+0000","last_active":"2023-06-09T04:42:32.480632+0000","last_peered":"2023-06-09T04:42:32.480632+0000","last_clean":"2023-06-09T04:42:32.480632+0000","last_became_active":"2023-06-09T04:40:51.254627+0000","last_became_peered":"2023-06-09T04:40:51.254627+0000","last_unstale":"2023-06-09T04:42:32.480632+0000","last_undegraded":"2023-06-09T04:42:32.480632+0000","last_fullsized":"2023-06-09T04:42:32.480632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_clean_scrub_stamp":"2023-06-09T04:40:50.211713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:21:31.993744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.562328+0000","last_change":"2023-06-09T04:42:31.490683+0000","last_active":"2023-06-09T04:42:32.562328+0000","last_peered":"2023-06-09T04:42:32.562328+0000","last_clean":"2023-06-09T04:42:32.562328+0000","last_became_active":"2023-06-09T04:42:31.490385+0000","last_became_peered":"2023-06-09T04:42:31.490385+0000","last_unstale":"2023-06-09T04:42:32.562328+0000","last_undegraded":"2023-06-09T04:42:32.562328+0000","last_fullsized":"2023-06-09T04:42:32.562328+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:27:25.413089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.479237+0000","last_change":"2023-06-09T04:42:30.998190+0000","last_active":"2023-06-09T04:42:32.479237+0000","last_peered":"2023-06-09T04:42:32.479237+0000","last_clean":"2023-06-09T04:42:32.479237+0000","last_became_active":"2023-06-09T04:42:30.997883+0000","last_became_peered":"2023-06-09T04:42:30.997883+0000","last_unstale":"2023-06-09T04:42:32.479237+0000","last_undegraded":"2023-06-09T04:42:32.479237+0000","last_fullsized":"2023-06-09T04:42:32.479237+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_clean_scrub_stamp":"2023-06-09T04:42:29.940868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:50:02.023206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":51,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.560504+0000","last_change":"2023-06-09T04:40:51.247235+0000","last_active":"2023-06-09T04:42:32.560504+0000","last_peered":"2023-06-09T04:42:32.560504+0000","last_clean":"2023-06-09T04:42:32.560504+0000","last_became_active":"2023-06-09T04:40:51.246657+0000","last_became_peered":"2023-06-09T04:40:51.246657+0000","last_unstale":"2023-06-09T04:42:32.560504+0000","last_undegraded":"2023-06-09T04:42:32.560504+0000","last_fullsized":"2023-06-09T04:42:32.560504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_clean_scrub_stamp":"2023-06-09T04:40:50.211713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:13:36.040533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.562807+0000","last_change":"2023-06-09T04:42:31.481796+0000","last_active":"2023-06-09T04:42:32.562807+0000","last_peered":"2023-06-09T04:42:32.562807+0000","last_clean":"2023-06-09T04:42:32.562807+0000","last_became_active":"2023-06-09T04:42:31.481526+0000","last_became_peered":"2023-06-09T04:42:31.481526+0000","last_unstale":"2023-06-09T04:42:32.562807+0000","last_undegraded":"2023-06-09T04:42:32.562807+0000","last_fullsized":"2023-06-09T04:42:32.562807+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:33:27.897310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.560404+0000","last_change":"2023-06-09T04:42:31.001041+0000","last_active":"2023-06-09T04:42:32.560404+0000","last_peered":"2023-06-09T04:42:32.560404+0000","last_clean":"2023-06-09T04:42:32.560404+0000","last_became_active":"2023-06-09T04:42:31.000730+0000","last_became_peered":"2023-06-09T04:42:31.000730+0000","last_unstale":"2023-06-09T04:42:32.560404+0000","last_undegraded":"2023-06-09T04:42:32.560404+0000","last_fullsized":"2023-06-09T04:42:32.560404+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_clean_scrub_stamp":"2023-06-09T04:42:29.940868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:28:52.295148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":51,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.564538+0000","last_change":"2023-06-09T04:40:51.254461+0000","last_active":"2023-06-09T04:42:32.564538+0000","last_peered":"2023-06-09T04:42:32.564538+0000","last_clean":"2023-06-09T04:42:32.564538+0000","last_became_active":"2023-06-09T04:40:51.254070+0000","last_became_peered":"2023-06-09T04:40:51.254070+0000","last_unstale":"2023-06-09T04:42:32.564538+0000","last_undegraded":"2023-06-09T04:42:32.564538+0000","last_fullsized":"2023-06-09T04:42:32.564538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_clean_scrub_stamp":"2023-06-09T04:40:50.211713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:52:58.836389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.478953+0000","last_change":"2023-06-09T04:42:31.484629+0000","last_active":"2023-06-09T04:42:32.478953+0000","last_peered":"2023-06-09T04:42:32.478953+0000","last_clean":"2023-06-09T04:42:32.478953+0000","last_became_active":"2023-06-09T04:42:31.484309+0000","last_became_peered":"2023-06-09T04:42:31.484309+0000","last_unstale":"2023-06-09T04:42:32.478953+0000","last_undegraded":"2023-06-09T04:42:32.478953+0000","last_fullsized":"2023-06-09T04:42:32.478953+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:45:42.135804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.561421+0000","last_change":"2023-06-09T04:42:31.003016+0000","last_active":"2023-06-09T04:42:32.561421+0000","last_peered":"2023-06-09T04:42:32.561421+0000","last_clean":"2023-06-09T04:42:32.561421+0000","last_became_active":"2023-06-09T04:42:31.002168+0000","last_became_peered":"2023-06-09T04:42:31.002168+0000","last_unstale":"2023-06-09T04:42:32.561421+0000","last_undegraded":"2023-06-09T04:42:32.561421+0000","last_fullsized":"2023-06-09T04:42:32.561421+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_clean_scrub_stamp":"2023-06-09T04:42:29.940868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:40:16.903368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":51,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.560118+0000","last_change":"2023-06-09T04:40:51.246536+0000","last_active":"2023-06-09T04:42:32.560118+0000","last_peered":"2023-06-09T04:42:32.560118+0000","last_clean":"2023-06-09T04:42:32.560118+0000","last_became_active":"2023-06-09T04:40:51.245999+0000","last_became_peered":"2023-06-09T04:40:51.245999+0000","last_unstale":"2023-06-09T04:42:32.560118+0000","last_undegraded":"2023-06-09T04:42:32.560118+0000","last_fullsized":"2023-06-09T04:42:32.560118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_clean_scrub_stamp":"2023-06-09T04:40:50.211713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:59:57.727013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.480686+0000","last_change":"2023-06-09T04:42:31.500460+0000","last_active":"2023-06-09T04:42:32.480686+0000","last_peered":"2023-06-09T04:42:32.480686+0000","last_clean":"2023-06-09T04:42:32.480686+0000","last_became_active":"2023-06-09T04:42:31.500133+0000","last_became_peered":"2023-06-09T04:42:31.500133+0000","last_unstale":"2023-06-09T04:42:32.480686+0000","last_undegraded":"2023-06-09T04:42:32.480686+0000","last_fullsized":"2023-06-09T04:42:32.480686+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T11:09:37.127627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"43'1","reported_seq":14,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:33.137776+0000","last_change":"2023-06-09T04:42:30.992547+0000","last_active":"2023-06-09T04:42:33.137776+0000","last_peered":"2023-06-09T04:42:33.137776+0000","last_clean":"2023-06-09T04:42:33.137776+0000","last_became_active":"2023-06-09T04:42:30.992218+0000","last_became_peered":"2023-06-09T04:42:30.992218+0000","last_unstale":"2023-06-09T04:42:33.137776+0000","last_undegraded":"2023-06-09T04:42:33.137776+0000","last_fullsized":"2023-06-09T04:42:33.137776+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_clean_scrub_stamp":"2023-06-09T04:42:29.940868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T12:26:40.814962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":47,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.563078+0000","last_change":"2023-06-09T04:40:51.256393+0000","last_active":"2023-06-09T04:42:32.563078+0000","last_peered":"2023-06-09T04:42:32.563078+0000","last_clean":"2023-06-09T04:42:32.563078+0000","last_became_active":"2023-06-09T04:40:51.255964+0000","last_became_peered":"2023-06-09T04:40:51.255964+0000","last_unstale":"2023-06-09T04:42:32.563078+0000","last_undegraded":"2023-06-09T04:42:32.563078+0000","last_fullsized":"2023-06-09T04:42:32.563078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_clean_scrub_stamp":"2023-06-09T04:40:50.211713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:23:01.169645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.562332+0000","last_change":"2023-06-09T04:42:31.495518+0000","last_active":"2023-06-09T04:42:32.562332+0000","last_peered":"2023-06-09T04:42:32.562332+0000","last_clean":"2023-06-09T04:42:32.562332+0000","last_became_active":"2023-06-09T04:42:31.492036+0000","last_became_peered":"2023-06-09T04:42:31.492036+0000","last_unstale":"2023-06-09T04:42:32.562332+0000","last_undegraded":"2023-06-09T04:42:32.562332+0000","last_fullsized":"2023-06-09T04:42:32.562332+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T05:20:39.543980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.564451+0000","last_change":"2023-06-09T04:42:31.000288+0000","last_active":"2023-06-09T04:42:32.564451+0000","last_peered":"2023-06-09T04:42:32.564451+0000","last_clean":"2023-06-09T04:42:32.564451+0000","last_became_active":"2023-06-09T04:42:30.999984+0000","last_became_peered":"2023-06-09T04:42:30.999984+0000","last_unstale":"2023-06-09T04:42:32.564451+0000","last_undegraded":"2023-06-09T04:42:32.564451+0000","last_fullsized":"2023-06-09T04:42:32.564451+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_clean_scrub_stamp":"2023-06-09T04:42:29.940868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T07:52:52.535827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":51,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.471050+0000","last_change":"2023-06-09T04:40:51.582053+0000","last_active":"2023-06-09T04:42:32.471050+0000","last_peered":"2023-06-09T04:42:32.471050+0000","last_clean":"2023-06-09T04:42:32.471050+0000","last_became_active":"2023-06-09T04:40:51.581476+0000","last_became_peered":"2023-06-09T04:40:51.581476+0000","last_unstale":"2023-06-09T04:42:32.471050+0000","last_undegraded":"2023-06-09T04:42:32.471050+0000","last_fullsized":"2023-06-09T04:42:32.471050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_clean_scrub_stamp":"2023-06-09T04:40:50.211713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T08:52:17.293355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.564420+0000","last_change":"2023-06-09T04:42:31.491055+0000","last_active":"2023-06-09T04:42:32.564420+0000","last_peered":"2023-06-09T04:42:32.564420+0000","last_clean":"2023-06-09T04:42:32.564420+0000","last_became_active":"2023-06-09T04:42:31.490798+0000","last_became_peered":"2023-06-09T04:42:31.490798+0000","last_unstale":"2023-06-09T04:42:32.564420+0000","last_undegraded":"2023-06-09T04:42:32.564420+0000","last_fullsized":"2023-06-09T04:42:32.564420+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T06:30:03.105125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.560093+0000","last_change":"2023-06-09T04:42:30.996496+0000","last_active":"2023-06-09T04:42:32.560093+0000","last_peered":"2023-06-09T04:42:32.560093+0000","last_clean":"2023-06-09T04:42:32.560093+0000","last_became_active":"2023-06-09T04:42:30.996218+0000","last_became_peered":"2023-06-09T04:42:30.996218+0000","last_unstale":"2023-06-09T04:42:32.560093+0000","last_undegraded":"2023-06-09T04:42:32.560093+0000","last_fullsized":"2023-06-09T04:42:32.560093+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_clean_scrub_stamp":"2023-06-09T04:42:29.940868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T14:04:36.929804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":51,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.562830+0000","last_change":"2023-06-09T04:40:51.256342+0000","last_active":"2023-06-09T04:42:32.562830+0000","last_peered":"2023-06-09T04:42:32.562830+0000","last_clean":"2023-06-09T04:42:32.562830+0000","last_became_active":"2023-06-09T04:40:51.256010+0000","last_became_peered":"2023-06-09T04:40:51.256010+0000","last_unstale":"2023-06-09T04:42:32.562830+0000","last_undegraded":"2023-06-09T04:42:32.562830+0000","last_fullsized":"2023-06-09T04:42:32.562830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_clean_scrub_stamp":"2023-06-09T04:40:50.211713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T09:14:31.859402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":11,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.563091+0000","last_change":"2023-06-09T04:42:31.491659+0000","last_active":"2023-06-09T04:42:32.563091+0000","last_peered":"2023-06-09T04:42:32.563091+0000","last_clean":"2023-06-09T04:42:32.563091+0000","last_became_active":"2023-06-09T04:42:31.491250+0000","last_became_peered":"2023-06-09T04:42:31.491250+0000","last_unstale":"2023-06-09T04:42:32.563091+0000","last_undegraded":"2023-06-09T04:42:32.563091+0000","last_fullsized":"2023-06-09T04:42:32.563091+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":41,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:30.956011+0000","last_clean_scrub_stamp":"2023-06-09T04:42:30.956011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:35:28.103518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"42'2","reported_seq":15,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.563622+0000","last_change":"2023-06-09T04:42:31.004702+0000","last_active":"2023-06-09T04:42:32.563622+0000","last_peered":"2023-06-09T04:42:32.563622+0000","last_clean":"2023-06-09T04:42:32.563622+0000","last_became_active":"2023-06-09T04:42:31.004482+0000","last_became_peered":"2023-06-09T04:42:31.004482+0000","last_unstale":"2023-06-09T04:42:32.563622+0000","last_undegraded":"2023-06-09T04:42:32.563622+0000","last_fullsized":"2023-06-09T04:42:32.563622+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":40,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:42:29.940868+0000","last_clean_scrub_stamp":"2023-06-09T04:42:29.940868+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T10:20:57.735736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":47,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.563404+0000","last_change":"2023-06-09T04:40:51.253269+0000","last_active":"2023-06-09T04:42:32.563404+0000","last_peered":"2023-06-09T04:42:32.563404+0000","last_clean":"2023-06-09T04:42:32.563404+0000","last_became_active":"2023-06-09T04:40:51.252908+0000","last_became_peered":"2023-06-09T04:40:51.252908+0000","last_unstale":"2023-06-09T04:42:32.563404+0000","last_undegraded":"2023-06-09T04:42:32.563404+0000","last_fullsized":"2023-06-09T04:42:32.563404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:50.211713+0000","last_clean_scrub_stamp":"2023-06-09T04:40:50.211713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T15:38:19.535495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":207,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-06-09T04:42:32.562964+0000","last_change":"2023-06-09T04:40:46.286764+0000","last_active":"2023-06-09T04:42:32.562964+0000","last_peered":"2023-06-09T04:42:32.562964+0000","last_clean":"2023-06-09T04:42:32.562964+0000","last_became_active":"2023-06-09T04:40:46.285285+0000","last_became_peered":"2023-06-09T04:40:46.285285+0000","last_unstale":"2023-06-09T04:42:32.562964+0000","last_undegraded":"2023-06-09T04:42:32.562964+0000","last_fullsized":"2023-06-09T04:42:32.562964+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-09T04:40:45.151406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-09T04:40:45.151406+0000","last_clean_scrub_stamp":"2023-06-09T04:40:45.151406+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-10T16:39:54.049229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28024,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343816,"statfs":{"total":96636764160,"available":96608067584,"internally_reserved":0,"allocated":1097728,"data_stored":813905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:41:46 2023","interfaces":[{"interface":"back","average":{"1min":1.177,"5min":1.177,"15min":1.177},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.657,"5min":1.657,"15min":1.657},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":2.512,"5min":2.512,"15min":2.512},"last":1.355}]},{"osd":1,"last update":"Fri Jun 9 04:41:46 2023","interfaces":[{"interface":"back","average":{"1min":1.097,"5min":1.097,"15min":1.097},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.504,"5min":1.504,"15min":1.504},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.92600000000000005}]},{"osd":2,"last update":"Fri Jun 9 04:41:46 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":1.3029999999999999},{"interface":"front","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.605,"5min":1.605,"15min":1.605},"last":1.1759999999999999}]},{"osd":3,"last update":"Fri Jun 9 04:41:46 2023","interfaces":[{"interface":"back","average":{"1min":1.266,"5min":1.266,"15min":1.266},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.4139999999999999},{"interface":"front","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":1.145,"5min":1.145,"15min":1.145},"max":{"1min":1.7869999999999999,"5min":1.7869999999999999,"15min":1.7869999999999999},"last":1.131}]},{"osd":4,"last update":"Fri Jun 9 04:41:46 2023","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":2.423,"5min":2.423,"15min":2.423},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"max":{"1min":1.734,"5min":1.734,"15min":1.734},"last":1.2230000000000001}]},{"osd":5,"last update":"Fri Jun 9 04:41:46 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"max":{"1min":1.923,"5min":1.923,"15min":1.923},"last":1.333},{"interface":"front","average":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"min":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"max":{"1min":2.117,"5min":2.117,"15min":2.117},"last":1.4610000000000001}]},{"osd":6,"last update":"Fri Jun 9 04:41:46 2023","interfaces":[{"interface":"back","average":{"1min":1.597,"5min":1.597,"15min":1.597},"min":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"max":{"1min":2.3199999999999998,"5min":2.3199999999999998,"15min":2.3199999999999998},"last":1.1919999999999999},{"interface":"front","average":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"min":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":3.1440000000000001,"5min":3.1440000000000001,"15min":3.1440000000000001},"last":1.4950000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":496,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":507904,"data_stored":224119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:41:44 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":1.218},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.9830000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"last":1.272}]},{"osd":1,"last update":"Fri Jun 9 04:41:44 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":2.4980000000000002,"5min":2.4980000000000002,"15min":2.4980000000000002},"last":1.0600000000000001}]},{"osd":2,"last update":"Fri Jun 9 04:41:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":1.125},{"interface":"front","average":{"1min":1.177,"5min":1.177,"15min":1.177},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.556,"5min":1.556,"15min":1.556},"last":1.4359999999999999}]},{"osd":3,"last update":"Fri Jun 9 04:41:44 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.6030000000000002,"5min":2.6030000000000002,"15min":2.6030000000000002},"last":1.4059999999999999},{"interface":"front","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.7769999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":1.341}]},{"osd":4,"last update":"Fri Jun 9 04:41:44 2023","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.163,"15min":1.163},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.9950000000000001,"5min":1.9950000000000001,"15min":1.9950000000000001},"last":1.167},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":2.556,"5min":2.556,"15min":2.556},"last":1.2949999999999999}]},{"osd":5,"last update":"Fri Jun 9 04:41:44 2023","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.871,"5min":0.871,"15min":0.871},"max":{"1min":1.925,"5min":1.925,"15min":1.925},"last":1.645},{"interface":"front","average":{"1min":1.367,"5min":1.367,"15min":1.367},"min":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"max":{"1min":2.1600000000000001,"5min":2.1600000000000001,"15min":2.1600000000000001},"last":1.5860000000000001}]},{"osd":7,"last update":"Fri Jun 9 04:41:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"max":{"1min":2.4300000000000002,"5min":2.4300000000000002,"15min":2.4300000000000002},"last":1.544},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"min":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"max":{"1min":2.0800000000000001,"5min":2.0800000000000001,"15min":2.0800000000000001},"last":1.474}]}]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":503808,"data_stored":223517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:41:48 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":2.2149999999999999,"5min":2.2149999999999999,"15min":2.2149999999999999},"last":1.4470000000000001},{"interface":"front","average":{"1min":1.222,"5min":1.222,"15min":1.222},"min":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"max":{"1min":1.976,"5min":1.976,"15min":1.976},"last":1.5629999999999999}]},{"osd":1,"last update":"Fri Jun 9 04:41:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":1.389},{"interface":"front","average":{"1min":1.153,"5min":1.153,"15min":1.153},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":1.266}]},{"osd":2,"last update":"Fri Jun 9 04:41:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":2.0619999999999998,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":1.321},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.738,"5min":1.738,"15min":1.738},"last":1.125}]},{"osd":3,"last update":"Fri Jun 9 04:41:48 2023","interfaces":[{"interface":"back","average":{"1min":1.2110000000000001,"5min":1.2110000000000001,"15min":1.2110000000000001},"min":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"max":{"1min":1.7509999999999999,"5min":1.7509999999999999,"15min":1.7509999999999999},"last":1.3540000000000001},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.6379999999999999,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":1.302}]},{"osd":4,"last update":"Fri Jun 9 04:41:48 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":2.375,"5min":2.375,"15min":2.375},"last":1.089},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":1.9039999999999999,"5min":1.9039999999999999,"15min":1.9039999999999999},"last":1.4199999999999999}]},{"osd":6,"last update":"Fri Jun 9 04:41:48 2023","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":1.264,"15min":1.264},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":1.71,"5min":1.71,"15min":1.71},"last":1.6020000000000001},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":1.526}]},{"osd":7,"last update":"Fri Jun 9 04:41:48 2023","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.288,"15min":1.288},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.855,"5min":1.855,"15min":1.855},"last":1.179},{"interface":"front","average":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"min":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"max":{"1min":1.798,"5min":1.798,"15min":1.798},"last":1.482}]}]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":500,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":512000,"data_stored":225011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:41:43 2023","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"min":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":1.069}]},{"osd":1,"last update":"Fri Jun 9 04:41:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":1.012},{"interface":"front","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.98799999999999999}]},{"osd":2,"last update":"Fri Jun 9 04:41:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"min":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.91100000000000003},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"min":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.94099999999999995}]},{"osd":3,"last update":"Fri Jun 9 04:41:43 2023","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":1.27,"15min":1.27},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":2.093,"5min":2.093,"15min":2.093},"last":0.80900000000000005},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":2.3660000000000001,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":0.82299999999999995}]},{"osd":5,"last update":"Fri Jun 9 04:41:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"min":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.73899999999999999}]},{"osd":6,"last update":"Fri Jun 9 04:41:43 2023","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.256,"15min":1.256},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":1.921,"5min":1.921,"15min":1.921},"last":0.68799999999999994},{"interface":"front","average":{"1min":1.335,"5min":1.335,"15min":1.335},"min":{"1min":1.054,"5min":1.054,"15min":1.054},"max":{"1min":1.8149999999999999,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":0.76200000000000001}]},{"osd":7,"last update":"Fri Jun 9 04:41:43 2023","interfaces":[{"interface":"back","average":{"1min":1.329,"5min":1.329,"15min":1.329},"min":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.7110000000000001,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":0.58099999999999996},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"min":{"1min":0.878,"5min":0.878,"15min":0.878},"max":{"1min":1.853,"5min":1.853,"15min":1.853},"last":0.96599999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574873,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":500,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":512000,"data_stored":224085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:41:44 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.65400000000000003},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":2.6309999999999998,"5min":2.6309999999999998,"15min":2.6309999999999998},"last":1.3300000000000001}]},{"osd":1,"last update":"Fri Jun 9 04:41:44 2023","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.746,"5min":1.746,"15min":1.746},"last":1.2829999999999999},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":2.8199999999999998,"5min":2.8199999999999998,"15min":2.8199999999999998},"last":0.68899999999999995}]},{"osd":2,"last update":"Fri Jun 9 04:41:44 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":2.3610000000000002,"5min":2.3610000000000002,"15min":2.3610000000000002},"last":1},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"min":{"1min":0.879,"5min":0.879,"15min":0.879},"max":{"1min":2.4340000000000002,"5min":2.4340000000000002,"15min":2.4340000000000002},"last":0.60899999999999999}]},{"osd":4,"last update":"Fri Jun 9 04:41:44 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"min":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":1.1220000000000001},{"interface":"front","average":{"1min":1.355,"5min":1.355,"15min":1.355},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":2.5190000000000001,"5min":2.5190000000000001,"15min":2.5190000000000001},"last":1.0840000000000001}]},{"osd":5,"last update":"Fri Jun 9 04:41:44 2023","interfaces":[{"interface":"back","average":{"1min":1.516,"5min":1.516,"15min":1.516},"min":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"max":{"1min":2.5019999999999998,"5min":2.5019999999999998,"15min":2.5019999999999998},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"min":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":2.569,"5min":2.569,"15min":2.569},"last":1.234}]},{"osd":6,"last update":"Fri Jun 9 04:41:44 2023","interfaces":[{"interface":"back","average":{"1min":1.677,"5min":1.677,"15min":1.677},"min":{"1min":1.016,"5min":1.016,"15min":1.016},"max":{"1min":5.6959999999999997,"5min":5.6959999999999997,"15min":5.6959999999999997},"last":1.3640000000000001},{"interface":"front","average":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"min":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"max":{"1min":2.4660000000000002,"5min":2.4660000000000002,"15min":2.4660000000000002},"last":1.052}]},{"osd":7,"last update":"Fri Jun 9 04:41:44 2023","interfaces":[{"interface":"back","average":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"min":{"1min":1.153,"5min":1.153,"15min":1.153},"max":{"1min":2.5249999999999999,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":1.4159999999999999},{"interface":"front","average":{"1min":1.8180000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"min":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"max":{"1min":5.5,"5min":5.5,"15min":5.5},"last":1.194}]}]},{"osd":2,"up_from":13,"seq":55834574872,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":504,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":516096,"data_stored":225033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.58499999999999996},{"interface":"front","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":3.1400000000000001,"5min":3.1400000000000001,"15min":3.1400000000000001},"last":0.90900000000000003}]},{"osd":1,"last update":"Fri Jun 9 04:41:45 2023","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.97899999999999998},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.95199999999999996}]},{"osd":3,"last update":"Fri Jun 9 04:41:45 2023","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":1.2609999999999999},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":2.7570000000000001,"5min":2.7570000000000001,"15min":2.7570000000000001},"last":1.2310000000000001}]},{"osd":4,"last update":"Fri Jun 9 04:41:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"min":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"max":{"1min":2.0059999999999998,"5min":2.0059999999999998,"15min":2.0059999999999998},"last":1.339},{"interface":"front","average":{"1min":1.454,"5min":1.454,"15min":1.454},"min":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"max":{"1min":2.968,"5min":2.968,"15min":2.968},"last":1.2969999999999999}]},{"osd":5,"last update":"Fri Jun 9 04:41:45 2023","interfaces":[{"interface":"back","average":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"min":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"max":{"1min":2.8109999999999999,"5min":2.8109999999999999,"15min":2.8109999999999999},"last":1.556},{"interface":"front","average":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"min":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":2.9329999999999998,"5min":2.9329999999999998,"15min":2.9329999999999998},"last":1.504}]},{"osd":6,"last update":"Fri Jun 9 04:41:45 2023","interfaces":[{"interface":"back","average":{"1min":1.5649999999999999,"5min":1.5649999999999999,"15min":1.5649999999999999},"min":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"max":{"1min":3.0430000000000001,"5min":3.0430000000000001,"15min":3.0430000000000001},"last":1.3979999999999999},{"interface":"front","average":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"min":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":2.6110000000000002,"5min":2.6110000000000002,"15min":2.6110000000000002},"last":1.464}]},{"osd":7,"last update":"Fri Jun 9 04:41:45 2023","interfaces":[{"interface":"back","average":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"min":{"1min":1.056,"5min":1.056,"15min":1.056},"max":{"1min":3.0960000000000001,"5min":3.0960000000000001,"15min":3.0960000000000001},"last":1.448},{"interface":"front","average":{"1min":1.629,"5min":1.629,"15min":1.629},"min":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"max":{"1min":3.1920000000000002,"5min":3.1920000000000002,"15min":3.1920000000000002},"last":1.371}]}]},{"osd":1,"up_from":13,"seq":55834574872,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":503808,"data_stored":223517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 9 04:41:44 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.64800000000000002}]},{"osd":2,"last update":"Fri Jun 9 04:41:44 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.149,"5min":1.149,"15min":1.149},"last":0.53900000000000003},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.98599999999999999}]},{"osd":3,"last update":"Fri Jun 9 04:41:44 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.226,"15min":1.226},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.9079999999999999,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.1639999999999999},{"interface":"front","average":{"1min":1.163,"5min":1.163,"15min":1.163},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.6379999999999999,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":1.113}]},{"osd":4,"last update":"Fri Jun 9 04:41:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.9410000000000001,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":0.92900000000000005}]},{"osd":5,"last update":"Fri Jun 9 04:41:44 2023","interfaces":[{"interface":"back","average":{"1min":1.403,"5min":1.403,"15min":1.403},"min":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":1.7649999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":0.90200000000000002},{"interface":"front","average":{"1min":1.375,"5min":1.375,"15min":1.375},"min":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"max":{"1min":2.056,"5min":2.056,"15min":2.056},"last":1.379}]},{"osd":6,"last update":"Fri Jun 9 04:41:44 2023","interfaces":[{"interface":"back","average":{"1min":1.419,"5min":1.419,"15min":1.419},"min":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":1.2230000000000001},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"min":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":1.948,"5min":1.948,"15min":1.948},"last":1.143}]},{"osd":7,"last update":"Fri Jun 9 04:41:44 2023","interfaces":[{"interface":"back","average":{"1min":1.52,"5min":1.52,"15min":1.52},"min":{"1min":1.089,"5min":1.089,"15min":1.089},"max":{"1min":1.9410000000000001,"5min":1.9410000000000001,"15min":1.9410000000000001},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.532,"5min":1.532,"15min":1.532},"min":{"1min":1.02,"5min":1.02,"15min":1.02},"max":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":1.292}]}]},{"osd":0,"up_from":13,"seq":55834574874,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28024,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343816,"statfs":{"total":96636764160,"available":96608067584,"internally_reserved":0,"allocated":1097728,"data_stored":813849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jun 9 04:41:47 2023","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.998,"15min":0.998},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":2.4159999999999999,"5min":2.4159999999999999,"15min":2.4159999999999999},"last":1.554},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.742,"5min":1.742,"15min":1.742},"last":0.85099999999999998}]},{"osd":2,"last update":"Fri Jun 9 04:41:47 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.7370000000000001,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":1.4359999999999999},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.91200000000000003}]},{"osd":3,"last update":"Fri Jun 9 04:41:47 2023","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":2.9809999999999999,"5min":2.9809999999999999,"15min":2.9809999999999999},"last":0.873},{"interface":"front","average":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":4.1280000000000001,"5min":4.1280000000000001,"15min":4.1280000000000001},"last":1.264}]},{"osd":4,"last update":"Fri Jun 9 04:41:47 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.792,"5min":1.792,"15min":1.792},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.6160000000000001,"5min":1.6160000000000001,"15min":1.6160000000000001},"min":{"1min":1.002,"5min":1.002,"15min":1.002},"max":{"1min":4.2949999999999999,"5min":4.2949999999999999,"15min":4.2949999999999999},"last":1.619}]},{"osd":5,"last update":"Fri Jun 9 04:41:47 2023","interfaces":[{"interface":"back","average":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"min":{"1min":1.016,"5min":1.016,"15min":1.016},"max":{"1min":2.2240000000000002,"5min":2.2240000000000002,"15min":2.2240000000000002},"last":1.46},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"min":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"max":{"1min":1.9299999999999999,"5min":1.9299999999999999,"15min":1.9299999999999999},"last":1.5780000000000001}]},{"osd":6,"last update":"Fri Jun 9 04:41:47 2023","interfaces":[{"interface":"back","average":{"1min":1.647,"5min":1.647,"15min":1.647},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":5.8529999999999998,"5min":5.8529999999999998,"15min":5.8529999999999998},"last":2.157},{"interface":"front","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"max":{"1min":2.4670000000000001,"5min":2.4670000000000001,"15min":2.4670000000000001},"last":1.5169999999999999}]},{"osd":7,"last update":"Fri Jun 9 04:41:47 2023","interfaces":[{"interface":"back","average":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":1.5469999999999999},"min":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"max":{"1min":2.5899999999999999,"5min":2.5899999999999999,"15min":2.5899999999999999},"last":1.494},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"min":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"max":{"1min":2.0550000000000002,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":1.6100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-09T04:42:36.255 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-06-09T04:42:36.256 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-06-09T04:42:36.477 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.474+0000 7f5652019700 1 Processor -- start 2023-06-09T04:42:36.478 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.474+0000 7f5652019700 1 -- start start 2023-06-09T04:42:36.481 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.478+0000 7f5652019700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f564c15bce0 0x7f564c0cc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:36.481 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.478+0000 7f5652019700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f564c0cf4b0 0x7f564c0b6a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:36.481 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.478+0000 7f5652019700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f564c0cd070 con 0x7f564c0ce650 2023-06-09T04:42:36.482 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.478+0000 7f5652019700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f564c0b49a0 con 0x7f564c0cf4b0 2023-06-09T04:42:36.482 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.478+0000 7f5652019700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f564c0b5c90 con 0x7f564c15bce0 2023-06-09T04:42:36.482 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.478+0000 7f5651818700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f564c0cf4b0 0x7f564c0b6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:36.482 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.478+0000 7f5650816700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f564c0ce650 0x7f564c0ceda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:59768/0 (socket says 172.21.15.62:59768) 2023-06-09T04:42:36.483 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.478+0000 7f5650816700 1 -- 172.21.15.62:0/3798894454 learned_addr learned my addr 172.21.15.62:0/3798894454 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:42:36.483 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.478+0000 7f5651017700 1 --2- 172.21.15.62:0/3798894454 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f564c15bce0 0x7f564c0cc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:36.483 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.478+0000 7f5651818700 1 -- 172.21.15.62:0/3798894454 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f564c15bce0 msgr2=0x7f564c0cc9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:36.484 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.478+0000 7f5651818700 1 --2- 172.21.15.62:0/3798894454 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f564c15bce0 0x7f564c0cc9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:36.484 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.478+0000 7f5651818700 1 -- 172.21.15.62:0/3798894454 >> v1:172.21.15.62:6789/0 conn(0x7f564c0ce650 legacy=0x7f564c0ceda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:36.484 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.478+0000 7f5643fff700 1 -- 172.21.15.62:0/3798894454 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 270854082 0 0) 0x7f564c0cd070 con 0x7f564c0ce650 2023-06-09T04:42:36.484 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.478+0000 7f5651818700 1 -- 172.21.15.62:0/3798894454 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f564c0b5f70 con 0x7f564c0cf4b0 2023-06-09T04:42:36.484 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.482+0000 7f5651818700 1 --2- 172.21.15.62:0/3798894454 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f564c0cf4b0 0x7f564c0b6a50 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f5644009d90 tx=0x7f564400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=111ea05d1eea4518 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:36.485 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.482+0000 7f5643fff700 1 -- 172.21.15.62:0/3798894454 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f564400e070 con 0x7f564c0cf4b0 2023-06-09T04:42:36.485 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.482+0000 7f5643fff700 1 -- 172.21.15.62:0/3798894454 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f564400bb20 con 0x7f564c0cf4b0 2023-06-09T04:42:36.485 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.482+0000 7f5643fff700 1 -- 172.21.15.62:0/3798894454 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5644012430 con 0x7f564c0cf4b0 2023-06-09T04:42:36.485 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.482+0000 7f5652019700 1 -- 172.21.15.62:0/3798894454 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f564c0cf4b0 msgr2=0x7f564c0b6a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:36.485 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.482+0000 7f5652019700 1 --2- 172.21.15.62:0/3798894454 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f564c0cf4b0 0x7f564c0b6a50 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f5644009d90 tx=0x7f564400b330 comp rx=0 tx=0).stop 2023-06-09T04:42:36.486 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.482+0000 7f5652019700 1 -- 172.21.15.62:0/3798894454 shutdown_connections 2023-06-09T04:42:36.486 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.482+0000 7f5652019700 1 --2- 172.21.15.62:0/3798894454 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f564c0cf4b0 0x7f564c0b6a50 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:36.486 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.482+0000 7f5652019700 1 --2- 172.21.15.62:0/3798894454 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f564c15bce0 0x7f564c0cc9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:36.486 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.482+0000 7f5652019700 1 -- 172.21.15.62:0/3798894454 >> 172.21.15.62:0/3798894454 conn(0x7f564c070f20 msgr2=0x7f564c0712f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:36.486 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.482+0000 7f5652019700 1 -- 172.21.15.62:0/3798894454 shutdown_connections 2023-06-09T04:42:36.487 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.482+0000 7f5652019700 1 -- 172.21.15.62:0/3798894454 wait complete. 2023-06-09T04:42:36.487 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.486+0000 7f5652019700 1 Processor -- start 2023-06-09T04:42:36.488 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.486+0000 7f5652019700 1 -- start start 2023-06-09T04:42:36.489 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.486+0000 7f5652019700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f564c0ce650 0x7f564c14cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:36.489 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.486+0000 7f5652019700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f564c0cf4b0 0x7f564c149930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:36.489 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.486+0000 7f5652019700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f564c15bce0 0x7f564c14afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:36.489 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.486+0000 7f5652019700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f564c14d0e0 con 0x7f564c0cf4b0 2023-06-09T04:42:36.489 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.486+0000 7f5652019700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f564c14aba0 con 0x7f564c0ce650 2023-06-09T04:42:36.490 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.486+0000 7f5652019700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f564c14a200 con 0x7f564c15bce0 2023-06-09T04:42:36.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.486+0000 7f5650816700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f564c0cf4b0 0x7f564c149930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:36.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.486+0000 7f5650816700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f564c0cf4b0 0x7f564c149930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:37090/0 (socket says 172.21.15.62:37090) 2023-06-09T04:42:36.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.486+0000 7f5650816700 1 -- 172.21.15.62:0/3361917869 learned_addr learned my addr 172.21.15.62:0/3361917869 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:36.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.486+0000 7f5651017700 1 --2- 172.21.15.62:0/3361917869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f564c0ce650 0x7f564c14cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:36.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.486+0000 7f5651818700 1 --2- 172.21.15.62:0/3361917869 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f564c15bce0 0x7f564c14afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:36.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.486+0000 7f5650816700 1 -- 172.21.15.62:0/3361917869 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f564c15bce0 msgr2=0x7f564c14afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:36.492 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.486+0000 7f5650816700 1 --2- 172.21.15.62:0/3361917869 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f564c15bce0 0x7f564c14afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:36.492 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.486+0000 7f5650816700 1 -- 172.21.15.62:0/3361917869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f564c0ce650 msgr2=0x7f564c14cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:36.492 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.486+0000 7f5650816700 1 --2- 172.21.15.62:0/3361917869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f564c0ce650 0x7f564c14cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:36.492 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.486+0000 7f5650816700 1 -- 172.21.15.62:0/3361917869 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5644009a70 con 0x7f564c0cf4b0 2023-06-09T04:42:36.492 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.486+0000 7f5651017700 1 --2- 172.21.15.62:0/3361917869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f564c0ce650 0x7f564c14cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T04:42:36.492 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.486+0000 7f5650816700 1 --2- 172.21.15.62:0/3361917869 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f564c0cf4b0 0x7f564c149930 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f563c00c580 tx=0x7f563c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:36.492 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.486+0000 7f5641ffb700 1 -- 172.21.15.62:0/3361917869 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563c004ca0 con 0x7f564c0cf4b0 2023-06-09T04:42:36.493 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.486+0000 7f5641ffb700 1 -- 172.21.15.62:0/3361917869 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f563c004e20 con 0x7f564c0cf4b0 2023-06-09T04:42:36.493 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.486+0000 7f5641ffb700 1 -- 172.21.15.62:0/3361917869 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f563c007310 con 0x7f564c0cf4b0 2023-06-09T04:42:36.493 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.490+0000 7f5652019700 1 -- 172.21.15.62:0/3361917869 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f564c14a4e0 con 0x7f564c0cf4b0 2023-06-09T04:42:36.493 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.490+0000 7f5652019700 1 -- 172.21.15.62:0/3361917869 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f564c156fa0 con 0x7f564c0cf4b0 2023-06-09T04:42:36.493 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.490+0000 7f5652019700 1 -- 172.21.15.62:0/3361917869 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f564c14ace0 con 0x7f564c0cf4b0 2023-06-09T04:42:36.494 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.490+0000 7f5641ffb700 1 -- 172.21.15.62:0/3361917869 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f563c007470 con 0x7f564c0cf4b0 2023-06-09T04:42:36.495 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.494+0000 7f5641ffb700 1 --2- 172.21.15.62:0/3361917869 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f56300662f0 0x7f56300687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:36.496 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.494+0000 7f5641ffb700 1 -- 172.21.15.62:0/3361917869 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f563c083c40 con 0x7f564c0cf4b0 2023-06-09T04:42:36.496 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.494+0000 7f5651017700 1 --2- 172.21.15.62:0/3361917869 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f56300662f0 0x7f56300687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:36.498 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.494+0000 7f5651017700 1 --2- 172.21.15.62:0/3361917869 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f56300662f0 0x7f56300687a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5648009ba0 tx=0x7f5648008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:36.502 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.498+0000 7f5641ffb700 1 -- 172.21.15.62:0/3361917869 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f564c14ace0 con 0x7f564c0cf4b0 2023-06-09T04:42:36.749 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.746+0000 7f5652019700 1 -- 172.21.15.62:0/3361917869 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f564c14ace0 con 0x7f564c0cf4b0 2023-06-09T04:42:36.759 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.758+0000 7f5641ffb700 1 -- 172.21.15.62:0/3361917869 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+0 (secure 0 0 0) 0x7f564c14ace0 con 0x7f564c0cf4b0 2023-06-09T04:42:36.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.762+0000 7f5652019700 1 -- 172.21.15.62:0/3361917869 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f56300662f0 msgr2=0x7f56300687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:36.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.762+0000 7f5652019700 1 --2- 172.21.15.62:0/3361917869 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f56300662f0 0x7f56300687a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5648009ba0 tx=0x7f5648008040 comp rx=0 tx=0).stop 2023-06-09T04:42:36.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.762+0000 7f5652019700 1 -- 172.21.15.62:0/3361917869 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f564c0cf4b0 msgr2=0x7f564c149930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:36.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.762+0000 7f5652019700 1 --2- 172.21.15.62:0/3361917869 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f564c0cf4b0 0x7f564c149930 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f563c00c580 tx=0x7f563c00c940 comp rx=0 tx=0).stop 2023-06-09T04:42:36.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.762+0000 7f5652019700 1 -- 172.21.15.62:0/3361917869 shutdown_connections 2023-06-09T04:42:36.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.762+0000 7f5652019700 1 --2- 172.21.15.62:0/3361917869 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f56300662f0 0x7f56300687a0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:36.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.762+0000 7f5652019700 1 --2- 172.21.15.62:0/3361917869 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f564c15bce0 0x7f564c14afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:36.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.762+0000 7f5652019700 1 --2- 172.21.15.62:0/3361917869 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f564c0cf4b0 0x7f564c149930 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:36.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.762+0000 7f5652019700 1 --2- 172.21.15.62:0/3361917869 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f564c0ce650 0x7f564c14cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:36.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.762+0000 7f5652019700 1 -- 172.21.15.62:0/3361917869 >> 172.21.15.62:0/3361917869 conn(0x7f564c070f20 msgr2=0x7f564c1593d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:36.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.762+0000 7f5652019700 1 -- 172.21.15.62:0/3361917869 shutdown_connections 2023-06-09T04:42:36.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.762+0000 7f5652019700 1 -- 172.21.15.62:0/3361917869 wait complete. 2023-06-09T04:42:36.766 INFO:teuthology.orchestra.run.smithi062.stderr:updated caps for client.0 2023-06-09T04:42:36.786 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-09T04:42:36.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.966+0000 7fe221946700 1 Processor -- start 2023-06-09T04:42:36.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.966+0000 7fe221946700 1 -- start start 2023-06-09T04:42:36.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.966+0000 7fe221946700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe21c0ca5b0 0x7fe21c0cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:36.970 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.966+0000 7fe221946700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe21c071180 con 0x7fe21c159a40 2023-06-09T04:42:36.970 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.966+0000 7fe221946700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe21c0cc180 con 0x7fe21c0cd4f0 2023-06-09T04:42:36.970 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.966+0000 7fe221946700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe21c0cbc00 con 0x7fe21c0ca5b0 2023-06-09T04:42:36.970 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.966+0000 7fe21affd700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fe21c159a40 0x7fe21c070a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:59780/0 (socket says 172.21.15.62:59780) 2023-06-09T04:42:36.971 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.966+0000 7fe21affd700 1 -- 172.21.15.62:0/170432289 learned_addr learned my addr 172.21.15.62:0/170432289 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:42:36.971 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.966+0000 7fe21b7fe700 1 --2- 172.21.15.62:0/170432289 >> v2:172.21.15.62:3300/0 conn(0x7fe21c0ca5b0 0x7fe21c0cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:36.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.966+0000 7fe21a7fc700 1 -- 172.21.15.62:0/170432289 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3435815445 0 0) 0x7fe20c001110 con 0x7fe21c159a40 2023-06-09T04:42:36.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.966+0000 7fe21a7fc700 1 -- 172.21.15.62:0/170432289 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2080035d0 con 0x7fe21c159a40 2023-06-09T04:42:36.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.966+0000 7fe21a7fc700 1 -- 172.21.15.62:0/170432289 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 863342015 0 0) 0x7fe21c0cc180 con 0x7fe21c0cd4f0 2023-06-09T04:42:36.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.966+0000 7fe21a7fc700 1 -- 172.21.15.62:0/170432289 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe20c001110 con 0x7fe21c0cd4f0 2023-06-09T04:42:36.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.970+0000 7fe21a7fc700 1 -- 172.21.15.62:0/170432289 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2851527989 0 0) 0x7fe2080035d0 con 0x7fe21c159a40 2023-06-09T04:42:36.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.970+0000 7fe21a7fc700 1 -- 172.21.15.62:0/170432289 >> v2:172.21.15.62:3300/0 conn(0x7fe21c0ca5b0 msgr2=0x7fe21c0cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:36.973 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.970+0000 7fe21a7fc700 1 --2- 172.21.15.62:0/170432289 >> v2:172.21.15.62:3300/0 conn(0x7fe21c0ca5b0 0x7fe21c0cc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:36.973 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.970+0000 7fe21a7fc700 1 -- 172.21.15.62:0/170432289 >> v1:172.21.15.89:6789/0 conn(0x7fe21c0cd4f0 legacy=0x7fe21c0c9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:36.973 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.970+0000 7fe21a7fc700 1 -- 172.21.15.62:0/170432289 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe21c0713c0 con 0x7fe21c159a40 2023-06-09T04:42:36.973 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.970+0000 7fe21a7fc700 1 -- 172.21.15.62:0/170432289 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 540845019 0 0) 0x7fe20c001800 con 0x7fe21c159a40 2023-06-09T04:42:36.973 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.970+0000 7fe21a7fc700 1 -- 172.21.15.62:0/170432289 >> v1:172.21.15.62:6789/0 conn(0x7fe21c159a40 legacy=0x7fe21c070a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:36.973 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.970+0000 7fe21a7fc700 1 --2- 172.21.15.62:0/170432289 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe208004c40 0x7fe208005030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:36.974 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.970+0000 7fe21a7fc700 1 --2- 172.21.15.62:0/170432289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe208003810 0x7fe208003c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:36.974 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.970+0000 7fe21a7fc700 1 --2- 172.21.15.62:0/170432289 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2080041c0 0x7fe20800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:36.974 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.970+0000 7fe21a7fc700 1 -- 172.21.15.62:0/170432289 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe21c0cbc00 con 0x7fe2080041c0 2023-06-09T04:42:36.974 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.970+0000 7fe21a7fc700 1 -- 172.21.15.62:0/170432289 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe20800c0b0 con 0x7fe208003810 2023-06-09T04:42:36.974 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.970+0000 7fe21a7fc700 1 -- 172.21.15.62:0/170432289 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe20800c270 con 0x7fe208004c40 2023-06-09T04:42:36.975 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.970+0000 7fe21b7fe700 1 --2- 172.21.15.62:0/170432289 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2080041c0 0x7fe20800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:36.976 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.970+0000 7fe21affd700 1 --2- 172.21.15.62:0/170432289 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe208004c40 0x7fe208005030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:36.976 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.970+0000 7fe213fff700 1 --2- 172.21.15.62:0/170432289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe208003810 0x7fe208003c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:36.976 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.970+0000 7fe21b7fe700 1 -- 172.21.15.62:0/170432289 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe208004c40 msgr2=0x7fe208005030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:36.976 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.970+0000 7fe21b7fe700 1 --2- 172.21.15.62:0/170432289 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe208004c40 0x7fe208005030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:36.976 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.970+0000 7fe21b7fe700 1 -- 172.21.15.62:0/170432289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe208003810 msgr2=0x7fe208003c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:36.976 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.970+0000 7fe21b7fe700 1 --2- 172.21.15.62:0/170432289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe208003810 0x7fe208003c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:36.977 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.970+0000 7fe21b7fe700 1 -- 172.21.15.62:0/170432289 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2080035d0 con 0x7fe2080041c0 2023-06-09T04:42:36.977 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.970+0000 7fe21affd700 1 --2- 172.21.15.62:0/170432289 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe208004c40 0x7fe208005030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:42:36.977 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.970+0000 7fe213fff700 1 --2- 172.21.15.62:0/170432289 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe208003810 0x7fe208003c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T04:42:36.977 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.970+0000 7fe21b7fe700 1 -- 172.21.15.62:0/170432289 reap_dead start 2023-06-09T04:42:36.977 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.970+0000 7fe21b7fe700 1 --2- 172.21.15.62:0/170432289 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2080041c0 0x7fe20800ba30 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fe21c0ca9a0 tx=0x7fe2080058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21f902743e3e41a server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:36.977 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.970+0000 7fe21a7fc700 1 -- 172.21.15.62:0/170432289 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe214018070 con 0x7fe2080041c0 2023-06-09T04:42:36.977 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.970+0000 7fe21a7fc700 1 -- 172.21.15.62:0/170432289 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe21400f040 con 0x7fe2080041c0 2023-06-09T04:42:36.977 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.970+0000 7fe21a7fc700 1 -- 172.21.15.62:0/170432289 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe21400ec10 con 0x7fe2080041c0 2023-06-09T04:42:36.978 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.970+0000 7fe221946700 1 -- 172.21.15.62:0/170432289 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2080041c0 msgr2=0x7fe20800ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:36.978 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.970+0000 7fe221946700 1 --2- 172.21.15.62:0/170432289 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2080041c0 0x7fe20800ba30 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fe21c0ca9a0 tx=0x7fe2080058a0 comp rx=0 tx=0).stop 2023-06-09T04:42:36.978 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.970+0000 7fe221946700 1 -- 172.21.15.62:0/170432289 shutdown_connections 2023-06-09T04:42:36.978 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.970+0000 7fe221946700 1 --2- 172.21.15.62:0/170432289 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2080041c0 0x7fe20800ba30 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:36.978 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.970+0000 7fe221946700 1 -- 172.21.15.62:0/170432289 >> 172.21.15.62:0/170432289 conn(0x7fe21c06a420 msgr2=0x7fe21c0afc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:36.978 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.974+0000 7fe221946700 1 -- 172.21.15.62:0/170432289 shutdown_connections 2023-06-09T04:42:36.978 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.974+0000 7fe221946700 1 -- 172.21.15.62:0/170432289 wait complete. 2023-06-09T04:42:36.979 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.974+0000 7fe221946700 1 Processor -- start 2023-06-09T04:42:36.979 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.974+0000 7fe221946700 1 -- start start 2023-06-09T04:42:36.980 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.978+0000 7fe221946700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe21c1f0b60 0x7fe21c153c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:36.980 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.978+0000 7fe221946700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe21c1541a0 0x7fe21c15af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:36.980 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.978+0000 7fe221946700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe21c15b4c0 0x7fe21c15b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:36.980 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.978+0000 7fe221946700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe21c1f0f30 con 0x7fe21c15b4c0 2023-06-09T04:42:36.980 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.978+0000 7fe221946700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe21c15aaf0 con 0x7fe21c1541a0 2023-06-09T04:42:36.981 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.978+0000 7fe221946700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe21c151bd0 con 0x7fe21c1f0b60 2023-06-09T04:42:36.981 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.978+0000 7fe21b7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe21c15b4c0 0x7fe21c15b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:36.981 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.978+0000 7fe21b7fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe21c15b4c0 0x7fe21c15b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:37124/0 (socket says 172.21.15.62:37124) 2023-06-09T04:42:36.981 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.978+0000 7fe21b7fe700 1 -- 172.21.15.62:0/3907159304 learned_addr learned my addr 172.21.15.62:0/3907159304 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:36.981 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.978+0000 7fe213fff700 1 --2- 172.21.15.62:0/3907159304 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe21c1541a0 0x7fe21c15af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:36.981 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.978+0000 7fe21affd700 1 --2- 172.21.15.62:0/3907159304 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe21c1f0b60 0x7fe21c153c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:36.982 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.978+0000 7fe21b7fe700 1 -- 172.21.15.62:0/3907159304 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe21c1f0b60 msgr2=0x7fe21c153c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:36.982 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.978+0000 7fe21b7fe700 1 --2- 172.21.15.62:0/3907159304 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe21c1f0b60 0x7fe21c153c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:36.983 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.978+0000 7fe21b7fe700 1 -- 172.21.15.62:0/3907159304 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe21c1541a0 msgr2=0x7fe21c15af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:36.983 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.978+0000 7fe21b7fe700 1 --2- 172.21.15.62:0/3907159304 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe21c1541a0 0x7fe21c15af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:36.983 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.978+0000 7fe21b7fe700 1 -- 172.21.15.62:0/3907159304 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe21c154610 con 0x7fe21c15b4c0 2023-06-09T04:42:36.983 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.978+0000 7fe21b7fe700 1 --2- 172.21.15.62:0/3907159304 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe21c15b4c0 0x7fe21c15b930 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fe21c0cc0f0 tx=0x7fe214009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:36.983 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.978+0000 7fe218ff9700 1 -- 172.21.15.62:0/3907159304 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe214018040 con 0x7fe21c15b4c0 2023-06-09T04:42:36.983 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.978+0000 7fe218ff9700 1 -- 172.21.15.62:0/3907159304 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe214004470 con 0x7fe21c15b4c0 2023-06-09T04:42:36.983 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.978+0000 7fe221946700 1 -- 172.21.15.62:0/3907159304 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe21c15a4e0 con 0x7fe21c15b4c0 2023-06-09T04:42:36.983 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.978+0000 7fe218ff9700 1 -- 172.21.15.62:0/3907159304 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe214004820 con 0x7fe21c15b4c0 2023-06-09T04:42:36.984 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.978+0000 7fe221946700 1 -- 172.21.15.62:0/3907159304 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe21c15a780 con 0x7fe21c15b4c0 2023-06-09T04:42:36.984 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.982+0000 7fe221946700 1 -- 172.21.15.62:0/3907159304 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe21c15a910 con 0x7fe21c15b4c0 2023-06-09T04:42:36.984 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.982+0000 7fe218ff9700 1 -- 172.21.15.62:0/3907159304 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fe214014480 con 0x7fe21c15b4c0 2023-06-09T04:42:36.986 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.982+0000 7fe218ff9700 1 --2- 172.21.15.62:0/3907159304 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fe1fc0662f0 0x7fe1fc0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:36.986 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.982+0000 7fe218ff9700 1 -- 172.21.15.62:0/3907159304 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fe214085610 con 0x7fe21c15b4c0 2023-06-09T04:42:36.986 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.982+0000 7fe21affd700 1 --2- 172.21.15.62:0/3907159304 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fe1fc0662f0 0x7fe1fc0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:36.988 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.986+0000 7fe21affd700 1 --2- 172.21.15.62:0/3907159304 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fe1fc0662f0 0x7fe1fc0687a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe20c0019f0 tx=0x7fe20c009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:36.992 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:36.990+0000 7fe218ff9700 1 -- 172.21.15.62:0/3907159304 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fe214052a60 con 0x7fe21c15b4c0 2023-06-09T04:42:37.201 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.198+0000 7fe221946700 1 -- 172.21.15.62:0/3907159304 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe21c0739c0 con 0x7fe21c15b4c0 2023-06-09T04:42:37.202 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.198+0000 7fe218ff9700 1 -- 172.21.15.62:0/3907159304 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4665 (secure 0 0 0) 0x7fe214056080 con 0x7fe21c15b4c0 2023-06-09T04:42:37.203 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:42:37.203 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5383,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6833/554108593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":554108593},{"type":"v1","addr":"172.21.15.62:6833","nonce":554108593}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5386,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6835/1751549647","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6834","nonce":1751549647},{"type":"v1","addr":"172.21.15.89:6835","nonce":1751549647}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5392,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6837/518828005","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6836","nonce":518828005},{"type":"v1","addr":"172.21.15.89:6837","nonce":518828005}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-09T04:42:31.449850+0000","modified":"2023-06-09T04:42:34.479192+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5478},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5478":{"gid":5478,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.62:6835/3437129940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6834","nonce":3437129940},{"type":"v1","addr":"172.21.15.62:6835","nonce":3437129940}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-06-09T04:42:37.205 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.202+0000 7fe221946700 1 -- 172.21.15.62:0/3907159304 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fe1fc0662f0 msgr2=0x7fe1fc0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:37.205 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.202+0000 7fe221946700 1 --2- 172.21.15.62:0/3907159304 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fe1fc0662f0 0x7fe1fc0687a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe20c0019f0 tx=0x7fe20c009040 comp rx=0 tx=0).stop 2023-06-09T04:42:37.205 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.202+0000 7fe221946700 1 -- 172.21.15.62:0/3907159304 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe21c15b4c0 msgr2=0x7fe21c15b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:37.205 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.202+0000 7fe221946700 1 --2- 172.21.15.62:0/3907159304 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe21c15b4c0 0x7fe21c15b930 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fe21c0cc0f0 tx=0x7fe214009750 comp rx=0 tx=0).stop 2023-06-09T04:42:37.206 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.202+0000 7fe221946700 1 -- 172.21.15.62:0/3907159304 shutdown_connections 2023-06-09T04:42:37.206 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.202+0000 7fe221946700 1 --2- 172.21.15.62:0/3907159304 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fe1fc0662f0 0x7fe1fc0687a0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:37.206 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.202+0000 7fe221946700 1 --2- 172.21.15.62:0/3907159304 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe21c15b4c0 0x7fe21c15b930 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:37.206 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.202+0000 7fe221946700 1 --2- 172.21.15.62:0/3907159304 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe21c1541a0 0x7fe21c15af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:37.207 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.202+0000 7fe221946700 1 --2- 172.21.15.62:0/3907159304 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fe21c1f0b60 0x7fe21c153c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:37.207 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.202+0000 7fe221946700 1 -- 172.21.15.62:0/3907159304 >> 172.21.15.62:0/3907159304 conn(0x7fe2080041c0 msgr2=0x7fe21c0af3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:37.207 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.202+0000 7fe221946700 1 -- 172.21.15.62:0/3907159304 shutdown_connections 2023-06-09T04:42:37.207 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.202+0000 7fe221946700 1 -- 172.21.15.62:0/3907159304 wait complete. 2023-06-09T04:42:37.208 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 17 2023-06-09T04:42:37.629 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-06-09T04:42:31.449850+0000', 'modified': '2023-06-09T04:42:34.479192+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5478}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5478': {'gid': 5478, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.62:6835/3437129940', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6834', 'nonce': 3437129940}, {'type': 'v1', 'addr': '172.21.15.62:6835', 'nonce': 3437129940}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-06-09T04:42:37.630 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-06-09T04:42:37.630 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-06-09T04:42:37.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.814+0000 7f8295d5f700 1 Processor -- start 2023-06-09T04:42:37.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.814+0000 7f8295d5f700 1 -- start start 2023-06-09T04:42:37.819 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.814+0000 7f8295d5f700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f829015ff70 0x7f82900c9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:37.819 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.814+0000 7f8295d5f700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8290160340 0x7f82900caa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:37.819 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.814+0000 7f8295d5f700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82900cdc20 con 0x7f82900ca210 2023-06-09T04:42:37.819 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.814+0000 7f8295d5f700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82900cd330 con 0x7f8290160340 2023-06-09T04:42:37.819 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.814+0000 7f8295d5f700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82900cd5d0 con 0x7f829015ff70 2023-06-09T04:42:37.820 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.818+0000 7f8294d5d700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7f829015ff70 0x7f82900c9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:37.820 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.818+0000 7f828ffff700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8290160340 0x7f82900caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:37.820 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.818+0000 7f829555e700 1 --1- >> v1:172.21.15.89:6789/0 conn(0x7f82900ca210 0x7f8290163df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.89:6789/0 says I am v1:172.21.15.62:50994/0 (socket says 172.21.15.62:50994) 2023-06-09T04:42:37.820 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.818+0000 7f829555e700 1 -- 172.21.15.62:0/298655002 learned_addr learned my addr 172.21.15.62:0/298655002 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:42:37.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.818+0000 7f828ffff700 1 -- 172.21.15.62:0/298655002 >> v2:172.21.15.89:3300/0 conn(0x7f829015ff70 msgr2=0x7f82900c9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:37.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.818+0000 7f828ffff700 1 --2- 172.21.15.62:0/298655002 >> v2:172.21.15.89:3300/0 conn(0x7f829015ff70 0x7f82900c9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:37.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.818+0000 7f828ffff700 1 -- 172.21.15.62:0/298655002 >> v1:172.21.15.89:6789/0 conn(0x7f82900ca210 legacy=0x7f8290163df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:37.822 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.818+0000 7f828ffff700 1 -- 172.21.15.62:0/298655002 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82900cd8b0 con 0x7f8290160340 2023-06-09T04:42:37.822 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.818+0000 7f828f7fe700 1 -- 172.21.15.62:0/298655002 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3818585486 0 0) 0x7f82900cdc20 con 0x7f82900ca210 2023-06-09T04:42:37.822 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.818+0000 7f828ffff700 1 --2- 172.21.15.62:0/298655002 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8290160340 0x7f82900caa40 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f8290071bd0 tx=0x7f827c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39993aeb0f72074f server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:37.822 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.818+0000 7f828f7fe700 1 -- 172.21.15.62:0/298655002 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827c011830 con 0x7f8290160340 2023-06-09T04:42:37.822 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.818+0000 7f828f7fe700 1 -- 172.21.15.62:0/298655002 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f827c011990 con 0x7f8290160340 2023-06-09T04:42:37.823 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.818+0000 7f828f7fe700 1 -- 172.21.15.62:0/298655002 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827c011d20 con 0x7f8290160340 2023-06-09T04:42:37.823 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.818+0000 7f8295d5f700 1 -- 172.21.15.62:0/298655002 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8290160340 msgr2=0x7f82900caa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:37.823 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.818+0000 7f8295d5f700 1 --2- 172.21.15.62:0/298655002 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8290160340 0x7f82900caa40 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f8290071bd0 tx=0x7f827c009b30 comp rx=0 tx=0).stop 2023-06-09T04:42:37.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.822+0000 7f8295d5f700 1 -- 172.21.15.62:0/298655002 shutdown_connections 2023-06-09T04:42:37.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.822+0000 7f8295d5f700 1 --2- 172.21.15.62:0/298655002 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8290160340 0x7f82900caa40 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:37.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.822+0000 7f8295d5f700 1 --2- 172.21.15.62:0/298655002 >> v2:172.21.15.89:3300/0 conn(0x7f829015ff70 0x7f82900c9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:37.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.822+0000 7f8295d5f700 1 -- 172.21.15.62:0/298655002 >> 172.21.15.62:0/298655002 conn(0x7f829006a420 msgr2=0x7f82900afc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:37.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.822+0000 7f8295d5f700 1 -- 172.21.15.62:0/298655002 shutdown_connections 2023-06-09T04:42:37.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.822+0000 7f8295d5f700 1 -- 172.21.15.62:0/298655002 wait complete. 2023-06-09T04:42:37.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.822+0000 7f8295d5f700 1 Processor -- start 2023-06-09T04:42:37.826 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.822+0000 7f8295d5f700 1 -- start start 2023-06-09T04:42:37.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.826+0000 7f8295d5f700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f829015ff70 0x7f82901556d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:37.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.826+0000 7f8295d5f700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8290160340 0x7f82900c6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:37.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.826+0000 7f8295d5f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82900c72e0 0x7f82901f5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:37.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.826+0000 7f8295d5f700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82900b1590 con 0x7f82900c72e0 2023-06-09T04:42:37.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.826+0000 7f8295d5f700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82900c7760 con 0x7f8290160340 2023-06-09T04:42:37.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.826+0000 7f8295d5f700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82901f6510 con 0x7f829015ff70 2023-06-09T04:42:37.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.826+0000 7f829555e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82900c72e0 0x7f82901f5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:37.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.826+0000 7f829555e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82900c72e0 0x7f82901f5770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:37154/0 (socket says 172.21.15.62:37154) 2023-06-09T04:42:37.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.826+0000 7f829555e700 1 -- 172.21.15.62:0/452948101 learned_addr learned my addr 172.21.15.62:0/452948101 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:37.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.826+0000 7f8294d5d700 1 --2- 172.21.15.62:0/452948101 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f829015ff70 0x7f82901556d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:37.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.826+0000 7f828ffff700 1 --2- 172.21.15.62:0/452948101 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8290160340 0x7f82900c6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:37.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.826+0000 7f829555e700 1 -- 172.21.15.62:0/452948101 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f829015ff70 msgr2=0x7f82901556d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:37.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.826+0000 7f829555e700 1 --2- 172.21.15.62:0/452948101 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f829015ff70 0x7f82901556d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:37.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.826+0000 7f829555e700 1 -- 172.21.15.62:0/452948101 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8290160340 msgr2=0x7f82900c6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:37.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.826+0000 7f829555e700 1 --2- 172.21.15.62:0/452948101 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8290160340 0x7f82900c6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:37.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.826+0000 7f829555e700 1 -- 172.21.15.62:0/452948101 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f827c0094b0 con 0x7f82900c72e0 2023-06-09T04:42:37.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.826+0000 7f829555e700 1 --2- 172.21.15.62:0/452948101 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82900c72e0 0x7f82901f5770 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f8288002230 tx=0x7f828800cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:37.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.826+0000 7f828d7fa700 1 -- 172.21.15.62:0/452948101 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828800aac0 con 0x7f82900c72e0 2023-06-09T04:42:37.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.826+0000 7f828d7fa700 1 -- 172.21.15.62:0/452948101 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f828800ac40 con 0x7f82900c72e0 2023-06-09T04:42:37.832 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.826+0000 7f8295d5f700 1 -- 172.21.15.62:0/452948101 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8290160780 con 0x7f82900c72e0 2023-06-09T04:42:37.832 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.826+0000 7f828d7fa700 1 -- 172.21.15.62:0/452948101 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82880070d0 con 0x7f82900c72e0 2023-06-09T04:42:37.832 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.826+0000 7f8295d5f700 1 -- 172.21.15.62:0/452948101 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8290160d40 con 0x7f82900c72e0 2023-06-09T04:42:37.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.830+0000 7f828d7fa700 1 -- 172.21.15.62:0/452948101 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f8288007250 con 0x7f82900c72e0 2023-06-09T04:42:37.837 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.834+0000 7f828d7fa700 1 --2- 172.21.15.62:0/452948101 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f82740662f0 0x7f82740687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:37.837 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.834+0000 7f828d7fa700 1 -- 172.21.15.62:0/452948101 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f8288083d30 con 0x7f82900c72e0 2023-06-09T04:42:37.838 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.834+0000 7f8294d5d700 1 --2- 172.21.15.62:0/452948101 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f82740662f0 0x7f82740687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:37.838 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.834+0000 7f829a245740 1 Processor -- start 2023-06-09T04:42:37.838 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.834+0000 7f829a245740 1 -- start start 2023-06-09T04:42:37.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.838+0000 7f829a245740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x2347eb0 0x25b6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:37.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.838+0000 7f829a245740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x2347ae0 0x25b7420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:37.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.838+0000 7f8294d5d700 1 --2- 172.21.15.62:0/452948101 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f82740662f0 0x7f82740687a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8284009bf0 tx=0x7f8284009240 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:37.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.838+0000 7f829a245740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x2347710 0x25fd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:37.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.838+0000 7f829a245740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x2546ee0 con 0x2347eb0 2023-06-09T04:42:37.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.838+0000 7f829a245740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x24d4690 con 0x2347ae0 2023-06-09T04:42:37.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.838+0000 7f829a245740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x2527340 con 0x2347710 2023-06-09T04:42:37.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.838+0000 7f8294d5d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x2347eb0 0x25b6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:37.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.838+0000 7f8294d5d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x2347eb0 0x25b6ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:37162/0 (socket says 172.21.15.62:37162) 2023-06-09T04:42:37.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.838+0000 7f8294d5d700 1 -- 172.21.15.62:0/1526522907 learned_addr learned my addr 172.21.15.62:0/1526522907 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:37.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.838+0000 7f829555e700 1 --2- 172.21.15.62:0/1526522907 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x2347710 0x25fd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:37.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.838+0000 7f828ffff700 1 --2- 172.21.15.62:0/1526522907 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x2347ae0 0x25b7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:37.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.838+0000 7f8294d5d700 1 -- 172.21.15.62:0/1526522907 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x2347710 msgr2=0x25fd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:37.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.838+0000 7f8294d5d700 1 --2- 172.21.15.62:0/1526522907 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x2347710 0x25fd2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:37.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.838+0000 7f8294d5d700 1 -- 172.21.15.62:0/1526522907 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x2347ae0 msgr2=0x25b7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:37.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.838+0000 7f8294d5d700 1 --2- 172.21.15.62:0/1526522907 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x2347ae0 0x25b7420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:37.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.838+0000 7f8294d5d700 1 -- 172.21.15.62:0/1526522907 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x24d29a0 con 0x2347eb0 2023-06-09T04:42:37.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.838+0000 7f8294d5d700 1 --2- 172.21.15.62:0/1526522907 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x2347eb0 0x25b6ee0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f8284004520 tx=0x7f8284014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af6e5ce62f734d9f server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:37.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.838+0000 7f827a7fc700 1 -- 172.21.15.62:0/1526522907 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828401c040 con 0x2347eb0 2023-06-09T04:42:37.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.838+0000 7f827a7fc700 1 -- 172.21.15.62:0/1526522907 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8284004550 con 0x2347eb0 2023-06-09T04:42:37.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.838+0000 7f827a7fc700 1 -- 172.21.15.62:0/1526522907 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8284003ad0 con 0x2347eb0 2023-06-09T04:42:37.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.838+0000 7f829a245740 1 -- 172.21.15.62:0/1526522907 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x2347eb0 msgr2=0x25b6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:37.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.838+0000 7f829a245740 1 --2- 172.21.15.62:0/1526522907 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x2347eb0 0x25b6ee0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f8284004520 tx=0x7f8284014000 comp rx=0 tx=0).stop 2023-06-09T04:42:37.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.838+0000 7f829a245740 1 -- 172.21.15.62:0/1526522907 shutdown_connections 2023-06-09T04:42:37.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.838+0000 7f829a245740 1 --2- 172.21.15.62:0/1526522907 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x2347710 0x25fd2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:37.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.838+0000 7f829a245740 1 --2- 172.21.15.62:0/1526522907 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x2347ae0 0x25b7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:37.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.838+0000 7f829a245740 1 --2- 172.21.15.62:0/1526522907 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x2347eb0 0x25b6ee0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:37.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.838+0000 7f829a245740 1 -- 172.21.15.62:0/1526522907 >> 172.21.15.62:0/1526522907 conn(0x25b1d10 msgr2=0x25e3f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:37.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.838+0000 7f829a245740 1 -- 172.21.15.62:0/1526522907 shutdown_connections 2023-06-09T04:42:37.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.838+0000 7f829a245740 1 -- 172.21.15.62:0/1526522907 wait complete. 2023-06-09T04:42:37.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.842+0000 7f829a245740 1 -- start start 2023-06-09T04:42:37.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.842+0000 7f829a245740 1 Processor -- start 2023-06-09T04:42:37.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.842+0000 7f829a245740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x2347710 0x25e51c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:37.847 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.842+0000 7f829a245740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x2347ae0 0x25e1250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:37.847 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.842+0000 7f829a245740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x2347eb0 0x2606bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:37.847 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.842+0000 7f829a245740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x25205a0 con 0x2347eb0 2023-06-09T04:42:37.847 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.842+0000 7f829a245740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x24e2f20 con 0x2347710 2023-06-09T04:42:37.847 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.842+0000 7f829a245740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x24e1890 con 0x2347ae0 2023-06-09T04:42:37.847 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.842+0000 7f829a245740 10 client.0 _ll_register_callbacks cb 0x25737d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-09T04:42:37.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.842+0000 7f829555e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x2347eb0 0x2606bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:37.849 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.842+0000 7f829555e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x2347eb0 0x2606bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:37170/0 (socket says 172.21.15.62:37170) 2023-06-09T04:42:37.849 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.842+0000 7f829555e700 1 -- 172.21.15.62:0/3328690704 learned_addr learned my addr 172.21.15.62:0/3328690704 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:37.849 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.846+0000 7f8294d5d700 1 --2- 172.21.15.62:0/3328690704 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x2347710 0x25e51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:37.849 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.846+0000 7f828ffff700 1 --2- 172.21.15.62:0/3328690704 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x2347ae0 0x25e1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:37.849 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.846+0000 7f829555e700 1 -- 172.21.15.62:0/3328690704 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x2347ae0 msgr2=0x25e1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:37.849 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.846+0000 7f829555e700 1 --2- 172.21.15.62:0/3328690704 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x2347ae0 0x25e1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:37.849 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.846+0000 7f829555e700 1 -- 172.21.15.62:0/3328690704 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x2347710 msgr2=0x25e51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:37.849 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.846+0000 7f829555e700 1 --2- 172.21.15.62:0/3328690704 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x2347710 0x25e51c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:37.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.846+0000 7f829555e700 1 -- 172.21.15.62:0/3328690704 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82840041d0 con 0x2347eb0 2023-06-09T04:42:37.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.846+0000 7f829555e700 1 --2- 172.21.15.62:0/3328690704 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x2347eb0 0x2606bf0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f828800a340 tx=0x7f8288054420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3c98b15ba718e08 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:37.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.846+0000 7f826f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2023-06-09T04:42:37.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.846+0000 7f826f7fe700 1 -- 172.21.15.62:0/3328690704 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828806c370 con 0x2347eb0 2023-06-09T04:42:37.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.846+0000 7f829a245740 1 -- 172.21.15.62:0/3328690704 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2519580 con 0x2347eb0 2023-06-09T04:42:37.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.846+0000 7f826f7fe700 1 -- 172.21.15.62:0/3328690704 <== mon.0 v2:172.21.15.62:3300/0 2 ==== osd_map(44..44 src has 1..44) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f8288050a40 con 0x2347eb0 2023-06-09T04:42:37.851 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.846+0000 7f826f7fe700 1 -- 172.21.15.62:0/3328690704 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8288050c00 con 0x2347eb0 2023-06-09T04:42:37.851 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.846+0000 7f829a245740 10 client.5676 fetch_fsmap learned FSMap version 17 2023-06-09T04:42:37.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.846+0000 7f829a245740 1 -- 172.21.15.62:0/3328690704 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x23939e0 con 0x2347eb0 2023-06-09T04:42:37.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.846+0000 7f826f7fe700 1 -- 172.21.15.62:0/3328690704 <== mon.0 v2:172.21.15.62:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8288070020 con 0x2347eb0 2023-06-09T04:42:37.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.846+0000 7f826f7fe700 1 -- 172.21.15.62:0/3328690704 <== mon.0 v2:172.21.15.62:3300/0 5 ==== fsmap(e 17) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f8288053bb0 con 0x2347eb0 2023-06-09T04:42:37.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.846+0000 7f829a245740 10 client.5676 fetch_fsmap finished waiting for FSMap version 17 2023-06-09T04:42:37.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.846+0000 7f829a245740 10 client.5676 resolve_mds: resolved name 'c' to daemon mds.c 2023-06-09T04:42:37.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.846+0000 7f829a245740 20 client.5676 populate_metadata read hostname 'smithi062' 2023-06-09T04:42:37.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.846+0000 7f829a245740 1 --2- 172.21.15.62:0/3328690704 >> [v2:172.21.15.62:6834/3437129940,v1:172.21.15.62:6835/3437129940] conn(0x2392790 0x2608380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:37.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.846+0000 7f829a245740 4 client.5676 mds_command: new command op to 5478 tid=0[{"prefix": "get_command_descriptions"}] 2023-06-09T04:42:37.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.846+0000 7f829a245740 1 -- 172.21.15.62:0/3328690704 --> [v2:172.21.15.62:6834/3437129940,v1:172.21.15.62:6835/3437129940] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x25192a0 con 0x2392790 2023-06-09T04:42:37.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.846+0000 7f8294d5d700 1 --2- 172.21.15.62:0/3328690704 >> [v2:172.21.15.62:6834/3437129940,v1:172.21.15.62:6835/3437129940] conn(0x2392790 0x2608380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:37.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.846+0000 7f826f7fe700 10 client.5676 ms_handle_connect on v2:172.21.15.62:6834/3437129940 2023-06-09T04:42:37.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.846+0000 7f8294d5d700 1 --2- 172.21.15.62:0/3328690704 >> [v2:172.21.15.62:6834/3437129940,v1:172.21.15.62:6835/3437129940] conn(0x2392790 0x2608380 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=353d64284e00671e server_cookie=4cbd6b971cd0b3f6 in_seq=0 out_seq=0 2023-06-09T04:42:37.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.850+0000 7f826f7fe700 1 -- 172.21.15.62:0/3328690704 <== mds.0 v2:172.21.15.62:6834/3437129940 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x25192a0 con 0x2392790 2023-06-09T04:42:37.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.850+0000 7f826f7fe700 10 client.5676 handle_command_reply: tid=0 2023-06-09T04:42:37.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.850+0000 7f829a245740 1 client.5676 shutdown 2023-06-09T04:42:37.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.850+0000 7f829a245740 1 -- 172.21.15.62:0/3328690704 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x2347eb0 msgr2=0x2606bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:37.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.850+0000 7f829a245740 1 --2- 172.21.15.62:0/3328690704 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x2347eb0 0x2606bf0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f828800a340 tx=0x7f8288054420 comp rx=0 tx=0).stop 2023-06-09T04:42:37.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.850+0000 7f829a245740 1 -- 172.21.15.62:0/3328690704 shutdown_connections 2023-06-09T04:42:37.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.850+0000 7f829a245740 1 --2- 172.21.15.62:0/3328690704 >> [v2:172.21.15.62:6834/3437129940,v1:172.21.15.62:6835/3437129940] conn(0x2392790 0x2608380 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:37.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.850+0000 7f829a245740 1 --2- 172.21.15.62:0/3328690704 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x2347eb0 0x2606bf0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:37.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.850+0000 7f829a245740 1 --2- 172.21.15.62:0/3328690704 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x2347ae0 0x25e1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:37.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.850+0000 7f826f7fe700 0 client.5676 ms_handle_reset on v2:172.21.15.62:6834/3437129940 2023-06-09T04:42:37.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.850+0000 7f829a245740 1 --2- 172.21.15.62:0/3328690704 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x2347710 0x25e51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:37.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.850+0000 7f829a245740 1 -- 172.21.15.62:0/3328690704 >> 172.21.15.62:0/3328690704 conn(0x25b1d10 msgr2=0x25b65d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:37.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.850+0000 7f829a245740 1 -- 172.21.15.62:0/3328690704 shutdown_connections 2023-06-09T04:42:37.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.850+0000 7f829a245740 1 -- 172.21.15.62:0/3328690704 wait complete. 2023-06-09T04:42:37.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.850+0000 7f829a245740 20 client.5676 trim_cache size 0 max 16384 2023-06-09T04:42:37.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.870+0000 7f829a245740 1 Processor -- start 2023-06-09T04:42:37.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.870+0000 7f829a245740 1 -- start start 2023-06-09T04:42:37.875 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.874+0000 7f829a245740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x2347710 0x25b8040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:37.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.874+0000 7f829a245740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x2347ae0 0x25b8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:37.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.874+0000 7f829a245740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x2347eb0 0x2606300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:37.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.874+0000 7f829a245740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x23ccb20 con 0x2347ae0 2023-06-09T04:42:37.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.874+0000 7f829a245740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x2523e80 con 0x2347710 2023-06-09T04:42:37.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.874+0000 7f829a245740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x2523100 con 0x2347eb0 2023-06-09T04:42:37.877 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.874+0000 7f828ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x2347ae0 0x25b8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:37.877 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.874+0000 7f8294d5d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x2347710 0x25b8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:37.877 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.874+0000 7f8294d5d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x2347710 0x25b8040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.62:58692/0 (socket says 172.21.15.62:58692) 2023-06-09T04:42:37.877 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.874+0000 7f8294d5d700 1 -- 172.21.15.62:0/1179939507 learned_addr learned my addr 172.21.15.62:0/1179939507 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:37.877 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.874+0000 7f829555e700 1 --2- 172.21.15.62:0/1179939507 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x2347eb0 0x2606300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:37.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.874+0000 7f8294d5d700 1 -- 172.21.15.62:0/1179939507 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x2347eb0 msgr2=0x2606300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:37.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.874+0000 7f8294d5d700 1 --2- 172.21.15.62:0/1179939507 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x2347eb0 0x2606300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:37.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.874+0000 7f8294d5d700 1 -- 172.21.15.62:0/1179939507 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x2347ae0 msgr2=0x25b8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:37.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.874+0000 7f8294d5d700 1 --2- 172.21.15.62:0/1179939507 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x2347ae0 0x25b8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:37.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.874+0000 7f8294d5d700 1 -- 172.21.15.62:0/1179939507 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f829006a780 con 0x2347710 2023-06-09T04:42:37.879 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.874+0000 7f8294d5d700 1 --2- 172.21.15.62:0/1179939507 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x2347710 0x25b8040 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8284011650 tx=0x7f8284016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9b2d9ef133c0df0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:37.879 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.874+0000 7f827affd700 1 -- 172.21.15.62:0/1179939507 <== mon.1 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8284031040 con 0x2347710 2023-06-09T04:42:37.879 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.874+0000 7f827affd700 1 -- 172.21.15.62:0/1179939507 <== mon.1 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8284037610 con 0x2347710 2023-06-09T04:42:37.879 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.874+0000 7f827affd700 1 -- 172.21.15.62:0/1179939507 <== mon.1 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8284037be0 con 0x2347710 2023-06-09T04:42:37.880 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.878+0000 7f829a245740 1 -- 172.21.15.62:0/1179939507 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x2347710 msgr2=0x25b8040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:37.880 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.878+0000 7f829a245740 1 --2- 172.21.15.62:0/1179939507 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x2347710 0x25b8040 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8284011650 tx=0x7f8284016000 comp rx=0 tx=0).stop 2023-06-09T04:42:37.880 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.878+0000 7f829a245740 1 -- 172.21.15.62:0/1179939507 shutdown_connections 2023-06-09T04:42:37.880 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.878+0000 7f829a245740 1 --2- 172.21.15.62:0/1179939507 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x2347eb0 0x2606300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:37.880 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.878+0000 7f829a245740 1 --2- 172.21.15.62:0/1179939507 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x2347ae0 0x25b8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:37.880 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.878+0000 7f829a245740 1 --2- 172.21.15.62:0/1179939507 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x2347710 0x25b8040 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:37.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.878+0000 7f829a245740 1 -- 172.21.15.62:0/1179939507 >> 172.21.15.62:0/1179939507 conn(0x25b1d10 msgr2=0x25e4800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:37.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.878+0000 7f829a245740 1 -- 172.21.15.62:0/1179939507 shutdown_connections 2023-06-09T04:42:37.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.878+0000 7f829a245740 1 -- 172.21.15.62:0/1179939507 wait complete. 2023-06-09T04:42:37.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.878+0000 7f829a245740 1 -- start start 2023-06-09T04:42:37.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.878+0000 7f829a245740 1 Processor -- start 2023-06-09T04:42:37.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.878+0000 7f829a245740 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x2347710 0x26145a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:37.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.878+0000 7f829a245740 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x2347ae0 0x26157e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:37.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.878+0000 7f829a245740 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x2347eb0 0x2615d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:37.883 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.878+0000 7f829a245740 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x24c57c0 con 0x2347ae0 2023-06-09T04:42:37.883 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.878+0000 7f829a245740 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x251f430 con 0x2347eb0 2023-06-09T04:42:37.883 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.878+0000 7f829a245740 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x24f0930 con 0x2347710 2023-06-09T04:42:37.883 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.878+0000 7f829a245740 10 client.0 _ll_register_callbacks cb 0x251f170 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-09T04:42:37.884 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.878+0000 7f828ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x2347ae0 0x26157e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:37.884 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.878+0000 7f828ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x2347ae0 0x26157e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:37190/0 (socket says 172.21.15.62:37190) 2023-06-09T04:42:37.884 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.878+0000 7f828ffff700 1 -- 172.21.15.62:0/3868327671 learned_addr learned my addr 172.21.15.62:0/3868327671 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:37.884 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.878+0000 7f8294d5d700 1 --2- 172.21.15.62:0/3868327671 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x2347710 0x26145a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:37.884 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.882+0000 7f829555e700 1 --2- 172.21.15.62:0/3868327671 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x2347eb0 0x2615d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:37.885 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.882+0000 7f828ffff700 1 -- 172.21.15.62:0/3868327671 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x2347710 msgr2=0x26145a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:37.885 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.882+0000 7f828ffff700 1 --2- 172.21.15.62:0/3868327671 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x2347710 0x26145a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:37.885 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.882+0000 7f828ffff700 1 -- 172.21.15.62:0/3868327671 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x2347eb0 msgr2=0x2615d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:37.885 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.882+0000 7f828ffff700 1 --2- 172.21.15.62:0/3868327671 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x2347eb0 0x2615d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:37.885 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.882+0000 7f828ffff700 1 -- 172.21.15.62:0/3868327671 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x24d29a0 con 0x2347ae0 2023-06-09T04:42:37.885 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.882+0000 7f828ffff700 1 --2- 172.21.15.62:0/3868327671 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x2347ae0 0x26157e0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f827c0090b0 tx=0x7f827c0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc911b79e304c197 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:37.885 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.882+0000 7f826f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2023-06-09T04:42:37.886 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.882+0000 7f826f7fe700 1 -- 172.21.15.62:0/3868327671 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827c01f040 con 0x2347ae0 2023-06-09T04:42:37.887 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.882+0000 7f826f7fe700 1 -- 172.21.15.62:0/3868327671 <== mon.0 v2:172.21.15.62:3300/0 2 ==== osd_map(44..44 src has 1..44) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f827c004580 con 0x2347ae0 2023-06-09T04:42:37.887 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.882+0000 7f829a245740 1 -- 172.21.15.62:0/3868327671 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8284004550 con 0x2347ae0 2023-06-09T04:42:37.887 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.882+0000 7f826f7fe700 1 -- 172.21.15.62:0/3868327671 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f827c0038c0 con 0x2347ae0 2023-06-09T04:42:37.887 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.882+0000 7f829a245740 10 client.5682 fetch_fsmap learned FSMap version 17 2023-06-09T04:42:37.888 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.882+0000 7f829a245740 1 -- 172.21.15.62:0/3868327671 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x24e6670 con 0x2347ae0 2023-06-09T04:42:37.888 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.882+0000 7f826f7fe700 1 -- 172.21.15.62:0/3868327671 <== mon.0 v2:172.21.15.62:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8284004550 con 0x2347ae0 2023-06-09T04:42:37.888 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.882+0000 7f826f7fe700 1 -- 172.21.15.62:0/3868327671 <== mon.0 v2:172.21.15.62:3300/0 5 ==== fsmap(e 17) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f827c030060 con 0x2347ae0 2023-06-09T04:42:37.888 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.882+0000 7f829a245740 10 client.5682 fetch_fsmap finished waiting for FSMap version 17 2023-06-09T04:42:37.889 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.882+0000 7f829a245740 10 client.5682 resolve_mds: resolved name 'c' to daemon mds.c 2023-06-09T04:42:37.889 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.882+0000 7f829a245740 20 client.5682 populate_metadata read hostname 'smithi062' 2023-06-09T04:42:37.889 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.882+0000 7f829a245740 1 --2- 172.21.15.62:0/3868327671 >> [v2:172.21.15.62:6834/3437129940,v1:172.21.15.62:6835/3437129940] conn(0x2617120 0x26174f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:37.890 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.882+0000 7f829a245740 4 client.5682 mds_command: new command op to 5478 tid=0[{"prefix": "status"}] 2023-06-09T04:42:37.890 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.882+0000 7f829a245740 1 -- 172.21.15.62:0/3868327671 --> [v2:172.21.15.62:6834/3437129940,v1:172.21.15.62:6835/3437129940] -- command(tid 0: {"prefix": "status"}) v1 -- 0x239f4e0 con 0x2617120 2023-06-09T04:42:37.890 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.882+0000 7f8294d5d700 1 --2- 172.21.15.62:0/3868327671 >> [v2:172.21.15.62:6834/3437129940,v1:172.21.15.62:6835/3437129940] conn(0x2617120 0x26174f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:37.892 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.882+0000 7f826f7fe700 10 client.5682 ms_handle_connect on v2:172.21.15.62:6834/3437129940 2023-06-09T04:42:37.892 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.882+0000 7f8294d5d700 1 --2- 172.21.15.62:0/3868327671 >> [v2:172.21.15.62:6834/3437129940,v1:172.21.15.62:6835/3437129940] conn(0x2617120 0x26174f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee3b1f7e9e389c91 server_cookie=4546726112e600b2 in_seq=0 out_seq=0 2023-06-09T04:42:37.893 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.886+0000 7f826f7fe700 1 -- 172.21.15.62:0/3868327671 <== mds.0 v2:172.21.15.62:6834/3437129940 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x239f4e0 con 0x2617120 2023-06-09T04:42:37.893 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.886+0000 7f826f7fe700 10 client.5682 handle_command_reply: tid=0 2023-06-09T04:42:37.893 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.886+0000 7f829a245740 1 client.5682 shutdown 2023-06-09T04:42:37.893 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.886+0000 7f829a245740 1 -- 172.21.15.62:0/3868327671 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x2347ae0 msgr2=0x26157e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:37.894 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.886+0000 7f829a245740 1 --2- 172.21.15.62:0/3868327671 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x2347ae0 0x26157e0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f827c0090b0 tx=0x7f827c0047e0 comp rx=0 tx=0).stop 2023-06-09T04:42:37.894 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.886+0000 7f829a245740 1 -- 172.21.15.62:0/3868327671 shutdown_connections 2023-06-09T04:42:37.894 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.886+0000 7f829a245740 1 --2- 172.21.15.62:0/3868327671 >> [v2:172.21.15.62:6834/3437129940,v1:172.21.15.62:6835/3437129940] conn(0x2617120 0x26174f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:37.894 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.886+0000 7f829a245740 1 --2- 172.21.15.62:0/3868327671 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x2347eb0 0x2615d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:37.895 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.886+0000 7f829a245740 1 --2- 172.21.15.62:0/3868327671 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x2347ae0 0x26157e0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:37.895 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.886+0000 7f829a245740 1 --2- 172.21.15.62:0/3868327671 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x2347710 0x26145a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:37.895 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.886+0000 7f829a245740 1 -- 172.21.15.62:0/3868327671 >> 172.21.15.62:0/3868327671 conn(0x25b1d10 msgr2=0x260fed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:37.895 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.886+0000 7f826f7fe700 0 client.5682 ms_handle_reset on v2:172.21.15.62:6834/3437129940 2023-06-09T04:42:37.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.886+0000 7f829a245740 1 -- 172.21.15.62:0/3868327671 shutdown_connections 2023-06-09T04:42:37.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.886+0000 7f829a245740 1 -- 172.21.15.62:0/3868327671 wait complete. 2023-06-09T04:42:37.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.886+0000 7f829a245740 20 client.5682 trim_cache size 0 max 16384 2023-06-09T04:42:37.897 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2023-06-09T04:42:37.897 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_fsid": "f7998a1e-e5a9-4202-abaa-70c0eaae1047", 2023-06-09T04:42:37.897 INFO:teuthology.orchestra.run.smithi062.stdout: "whoami": 0, 2023-06-09T04:42:37.897 INFO:teuthology.orchestra.run.smithi062.stdout: "id": 5478, 2023-06-09T04:42:37.898 INFO:teuthology.orchestra.run.smithi062.stdout: "want_state": "up:active", 2023-06-09T04:42:37.898 INFO:teuthology.orchestra.run.smithi062.stdout: "state": "up:active", 2023-06-09T04:42:37.898 INFO:teuthology.orchestra.run.smithi062.stdout: "fs_name": "cephfs", 2023-06-09T04:42:37.898 INFO:teuthology.orchestra.run.smithi062.stdout: "rank_uptime": 6.4311332390000002, 2023-06-09T04:42:37.898 INFO:teuthology.orchestra.run.smithi062.stdout: "mdsmap_epoch": 17, 2023-06-09T04:42:37.898 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_epoch": 44, 2023-06-09T04:42:37.898 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_epoch_barrier": 43, 2023-06-09T04:42:37.899 INFO:teuthology.orchestra.run.smithi062.stdout: "uptime": 14.757944189 2023-06-09T04:42:37.899 INFO:teuthology.orchestra.run.smithi062.stdout:} 2023-06-09T04:42:37.899 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.886+0000 7f8295d5f700 1 -- 172.21.15.62:0/452948101 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f82740662f0 msgr2=0x7f82740687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:37.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.886+0000 7f8295d5f700 1 --2- 172.21.15.62:0/452948101 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f82740662f0 0x7f82740687a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8284009bf0 tx=0x7f8284009240 comp rx=0 tx=0).stop 2023-06-09T04:42:37.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.886+0000 7f8295d5f700 1 -- 172.21.15.62:0/452948101 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82900c72e0 msgr2=0x7f82901f5770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:37.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.886+0000 7f8295d5f700 1 --2- 172.21.15.62:0/452948101 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82900c72e0 0x7f82901f5770 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f8288002230 tx=0x7f828800cf50 comp rx=0 tx=0).stop 2023-06-09T04:42:37.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.886+0000 7f8295d5f700 1 -- 172.21.15.62:0/452948101 shutdown_connections 2023-06-09T04:42:37.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.886+0000 7f8295d5f700 1 --2- 172.21.15.62:0/452948101 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f82740662f0 0x7f82740687a0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:37.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.886+0000 7f8295d5f700 1 --2- 172.21.15.62:0/452948101 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82900c72e0 0x7f82901f5770 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:37.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.886+0000 7f8295d5f700 1 --2- 172.21.15.62:0/452948101 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8290160340 0x7f82900c6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:37.901 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.886+0000 7f8295d5f700 1 --2- 172.21.15.62:0/452948101 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f829015ff70 0x7f82901556d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:37.901 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.886+0000 7f8295d5f700 1 -- 172.21.15.62:0/452948101 >> 172.21.15.62:0/452948101 conn(0x7f82900ca210 msgr2=0x7f829006f650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:37.901 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.886+0000 7f8295d5f700 1 -- 172.21.15.62:0/452948101 shutdown_connections 2023-06-09T04:42:37.901 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:37.886+0000 7f8295d5f700 1 -- 172.21.15.62:0/452948101 wait complete. 2023-06-09T04:42:37.913 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-09T04:42:38.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:38.086+0000 7fd58759e700 1 Processor -- start 2023-06-09T04:42:38.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:38.086+0000 7fd58759e700 1 -- start start 2023-06-09T04:42:38.089 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:38.086+0000 7fd58759e700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd588159a40 0x7fd5880cc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:38.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:38.086+0000 7fd58759e700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fd5880cd4f0 0x7fd588070a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:38.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:38.086+0000 7fd58759e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd5880c9ea0 0x7fd5880ca320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:38.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:38.086+0000 7fd58759e700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5880cbc00 con 0x7fd588159a40 2023-06-09T04:42:38.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:38.086+0000 7fd58759e700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5880ca860 con 0x7fd5880cd4f0 2023-06-09T04:42:38.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:38.086+0000 7fd58759e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5880cc180 con 0x7fd5880c9ea0 2023-06-09T04:42:38.091 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:38.086+0000 7fd58659c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd588159a40 0x7fd5880cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:38.091 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:38.086+0000 7fd58659c700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd588159a40 0x7fd5880cc610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:37196/0 (socket says 172.21.15.62:37196) 2023-06-09T04:42:38.091 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:38.086+0000 7fd58659c700 1 -- 172.21.15.62:0/41687478 learned_addr learned my addr 172.21.15.62:0/41687478 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:38.092 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:38.086+0000 7fd586d9d700 1 --2- 172.21.15.62:0/41687478 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd5880c9ea0 0x7fd5880ca320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:38.092 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:38.086+0000 7fd57ffff700 1 --2- 172.21.15.62:0/41687478 >> v2:172.21.15.89:3300/0 conn(0x7fd5880cd4f0 0x7fd588070a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:38.092 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:38.086+0000 7fd58659c700 1 -- 172.21.15.62:0/41687478 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd5880c9ea0 msgr2=0x7fd5880ca320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:38.092 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:38.086+0000 7fd58659c700 1 --2- 172.21.15.62:0/41687478 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd5880c9ea0 0x7fd5880ca320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:38.092 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:38.090+0000 7fd58659c700 1 -- 172.21.15.62:0/41687478 >> v2:172.21.15.89:3300/0 conn(0x7fd5880cd4f0 msgr2=0x7fd588070a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:38.092 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:38.090+0000 7fd58659c700 1 --2- 172.21.15.62:0/41687478 >> v2:172.21.15.89:3300/0 conn(0x7fd5880cd4f0 0x7fd588070a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:38.092 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:38.090+0000 7fd58659c700 1 -- 172.21.15.62:0/41687478 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5880713c0 con 0x7fd588159a40 2023-06-09T04:42:38.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:38.090+0000 7fd58659c700 1 --2- 172.21.15.62:0/41687478 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd588159a40 0x7fd5880cc610 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fd5880cd070 tx=0x7fd578009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6f60441474d884c server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:38.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:38.090+0000 7fd585d9b700 1 -- 172.21.15.62:0/41687478 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd578011830 con 0x7fd588159a40 2023-06-09T04:42:38.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:38.090+0000 7fd585d9b700 1 -- 172.21.15.62:0/41687478 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd578011990 con 0x7fd588159a40 2023-06-09T04:42:38.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:38.090+0000 7fd585d9b700 1 -- 172.21.15.62:0/41687478 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd578011d20 con 0x7fd588159a40 2023-06-09T04:42:38.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:38.090+0000 7fd58759e700 1 -- 172.21.15.62:0/41687478 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd588159a40 msgr2=0x7fd5880cc610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:38.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:38.090+0000 7fd58759e700 1 --2- 172.21.15.62:0/41687478 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd588159a40 0x7fd5880cc610 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fd5880cd070 tx=0x7fd578009bf0 comp rx=0 tx=0).stop 2023-06-09T04:42:38.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:38.090+0000 7fd58759e700 1 -- 172.21.15.62:0/41687478 shutdown_connections 2023-06-09T04:42:38.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:38.090+0000 7fd58759e700 1 --2- 172.21.15.62:0/41687478 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd5880c9ea0 0x7fd5880ca320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:38.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:38.090+0000 7fd58759e700 1 --2- 172.21.15.62:0/41687478 >> v2:172.21.15.89:3300/0 conn(0x7fd5880cd4f0 0x7fd588070a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:38.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:38.090+0000 7fd58759e700 1 --2- 172.21.15.62:0/41687478 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd588159a40 0x7fd5880cc610 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:38.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:38.090+0000 7fd58759e700 1 -- 172.21.15.62:0/41687478 >> 172.21.15.62:0/41687478 conn(0x7fd58806a420 msgr2=0x7fd5880afc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:38.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:38.090+0000 7fd58759e700 1 -- 172.21.15.62:0/41687478 shutdown_connections 2023-06-09T04:42:38.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:38.090+0000 7fd58759e700 1 -- 172.21.15.62:0/41687478 wait complete. 2023-06-09T04:42:38.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:38.094+0000 7fd58759e700 1 Processor -- start 2023-06-09T04:42:38.098 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:38.094+0000 7fd58759e700 1 -- start start 2023-06-09T04:42:38.100 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:38.098+0000 7fd58759e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd5880cd4f0 0x7fd588159e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:38.100 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:38.098+0000 7fd58759e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd588159a40 0x7fd5881f4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:38.101 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:38.098+0000 7fd58759e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd5881f5700 0x7fd5881456b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:38.101 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:38.098+0000 7fd58759e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd58815b7e0 con 0x7fd588159a40 2023-06-09T04:42:38.101 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:38.098+0000 7fd58759e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd58815a740 con 0x7fd5881f5700 2023-06-09T04:42:38.101 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:38.098+0000 7fd58759e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd58815aa20 con 0x7fd5880cd4f0 2023-06-09T04:42:38.102 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:38.098+0000 7fd57ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd588159a40 0x7fd5881f4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:38.102 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:38.098+0000 7fd58659c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd5880cd4f0 0x7fd588159e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:38.102 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:38.098+0000 7fd586d9d700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd5881f5700 0x7fd5881456b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:38.102 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:38.098+0000 7fd57ffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd588159a40 0x7fd5881f4cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:37198/0 (socket says 172.21.15.62:37198) 2023-06-09T04:42:38.103 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:38.098+0000 7fd58659c700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd5880cd4f0 0x7fd588159e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.62:42304/0 (socket says 172.21.15.62:42304) 2023-06-09T04:42:38.103 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:38.098+0000 7fd57ffff700 1 -- 172.21.15.62:0/3580314483 learned_addr learned my addr 172.21.15.62:0/3580314483 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:38.104 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:38.098+0000 7fd58659c700 1 -- 172.21.15.62:0/3580314483 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd5881f5700 msgr2=0x7fd5881456b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:38.104 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:38.098+0000 7fd58659c700 1 --2- 172.21.15.62:0/3580314483 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd5881f5700 0x7fd5881456b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:38.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:38.098+0000 7fd58659c700 1 -- 172.21.15.62:0/3580314483 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd588159a40 msgr2=0x7fd5881f4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:38.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:38.098+0000 7fd58659c700 1 --2- 172.21.15.62:0/3580314483 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd588159a40 0x7fd5881f4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:38.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:38.098+0000 7fd58659c700 1 -- 172.21.15.62:0/3580314483 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd578009570 con 0x7fd5880cd4f0 2023-06-09T04:42:38.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:38.098+0000 7fd57ffff700 1 --2- 172.21.15.62:0/3580314483 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd588159a40 0x7fd5881f4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:42:38.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:38.098+0000 7fd58659c700 1 --2- 172.21.15.62:0/3580314483 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd5880cd4f0 0x7fd588159e10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd578016000 tx=0x7fd578004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:38.106 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:38.098+0000 7fd57effd700 1 -- 172.21.15.62:0/3580314483 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd578004240 con 0x7fd5880cd4f0 2023-06-09T04:42:38.106 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:38.098+0000 7fd57effd700 1 -- 172.21.15.62:0/3580314483 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd57801f070 con 0x7fd5880cd4f0 2023-06-09T04:42:38.106 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:38.098+0000 7fd58759e700 1 -- 172.21.15.62:0/3580314483 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd58815ad00 con 0x7fd5880cd4f0 2023-06-09T04:42:38.106 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:38.098+0000 7fd57effd700 1 -- 172.21.15.62:0/3580314483 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd578004600 con 0x7fd5880cd4f0 2023-06-09T04:42:38.106 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:38.098+0000 7fd58759e700 1 -- 172.21.15.62:0/3580314483 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd58815b2c0 con 0x7fd5880cd4f0 2023-06-09T04:42:38.106 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:38.102+0000 7fd58759e700 1 -- 172.21.15.62:0/3580314483 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5880739c0 con 0x7fd5880cd4f0 2023-06-09T04:42:38.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:38.102+0000 7fd57effd700 1 -- 172.21.15.62:0/3580314483 <== mon.2 v2:172.21.15.89:3301/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fd578021030 con 0x7fd5880cd4f0 2023-06-09T04:42:38.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:38.102+0000 7fd57effd700 1 --2- 172.21.15.62:0/3580314483 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fd5680662f0 0x7fd5680687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:38.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:38.106+0000 7fd57effd700 1 -- 172.21.15.62:0/3580314483 <== mon.2 v2:172.21.15.89:3301/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fd578084e30 con 0x7fd5880cd4f0 2023-06-09T04:42:38.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:38.106+0000 7fd57ffff700 1 --2- 172.21.15.62:0/3580314483 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fd5680662f0 0x7fd5680687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:38.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:38.106+0000 7fd57ffff700 1 --2- 172.21.15.62:0/3580314483 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fd5680662f0 0x7fd5680687a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd5880a76d0 tx=0x7fd570009240 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:38.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:38.110+0000 7fd57effd700 1 -- 172.21.15.62:0/3580314483 <== mon.2 v2:172.21.15.89:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fd578052280 con 0x7fd5880cd4f0 2023-06-09T04:42:38.324 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:38.322+0000 7fd58759e700 1 -- 172.21.15.62:0/3580314483 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd588154b30 con 0x7fd5880cd4f0 2023-06-09T04:42:38.325 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:38.322+0000 7fd57effd700 1 -- 172.21.15.62:0/3580314483 <== mon.2 v2:172.21.15.89:3301/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd578029070 con 0x7fd5880cd4f0 2023-06-09T04:42:38.325 INFO:teuthology.orchestra.run.smithi062.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-06-09T04:42:38.328 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:38.326+0000 7fd58759e700 1 -- 172.21.15.62:0/3580314483 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fd5680662f0 msgr2=0x7fd5680687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:38.328 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:38.326+0000 7fd58759e700 1 --2- 172.21.15.62:0/3580314483 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fd5680662f0 0x7fd5680687a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd5880a76d0 tx=0x7fd570009240 comp rx=0 tx=0).stop 2023-06-09T04:42:38.328 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:38.326+0000 7fd58759e700 1 -- 172.21.15.62:0/3580314483 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd5880cd4f0 msgr2=0x7fd588159e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:38.328 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:38.326+0000 7fd58759e700 1 --2- 172.21.15.62:0/3580314483 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd5880cd4f0 0x7fd588159e10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd578016000 tx=0x7fd578004770 comp rx=0 tx=0).stop 2023-06-09T04:42:38.328 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:38.326+0000 7fd58759e700 1 -- 172.21.15.62:0/3580314483 shutdown_connections 2023-06-09T04:42:38.328 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:38.326+0000 7fd58759e700 1 --2- 172.21.15.62:0/3580314483 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fd5680662f0 0x7fd5680687a0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:38.329 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:38.326+0000 7fd58759e700 1 --2- 172.21.15.62:0/3580314483 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd5881f5700 0x7fd5881456b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:38.329 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:38.326+0000 7fd58759e700 1 --2- 172.21.15.62:0/3580314483 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd588159a40 0x7fd5881f4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:38.329 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:38.326+0000 7fd58759e700 1 --2- 172.21.15.62:0/3580314483 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fd5880cd4f0 0x7fd588159e10 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:38.329 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:38.326+0000 7fd58759e700 1 -- 172.21.15.62:0/3580314483 >> 172.21.15.62:0/3580314483 conn(0x7fd5880c9ea0 msgr2=0x7fd5880afa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:38.329 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:38.326+0000 7fd58759e700 1 -- 172.21.15.62:0/3580314483 shutdown_connections 2023-06-09T04:42:38.330 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:38.326+0000 7fd58759e700 1 -- 172.21.15.62:0/3580314483 wait complete. 2023-06-09T04:42:38.353 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-06-09T04:42:38.354 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-09T04:42:38.354 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi062.front.sepia.ceph.com 2023-06-09T04:42:38.355 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-06-09T04:42:38.355 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-06-09T04:42:38.355 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-06-09T04:42:38.356 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-06-09T04:42:38.356 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-09T04:42:38.356 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-06-09T04:42:38.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:38.357 DEBUG:teuthology.orchestra.run.smithi062:> ip addr 2023-06-09T04:42:38.375 INFO:teuthology.orchestra.run.smithi062.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-09T04:42:38.375 INFO:teuthology.orchestra.run.smithi062.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-09T04:42:38.375 INFO:teuthology.orchestra.run.smithi062.stdout: inet 127.0.0.1/8 scope host lo 2023-06-09T04:42:38.375 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:42:38.375 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 ::1/128 scope host 2023-06-09T04:42:38.376 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:42:38.376 INFO:teuthology.orchestra.run.smithi062.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-09T04:42:38.376 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:a9:aa:14 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:42:38.376 INFO:teuthology.orchestra.run.smithi062.stdout: altname enp7s0f0 2023-06-09T04:42:38.376 INFO:teuthology.orchestra.run.smithi062.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-09T04:42:38.376 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:a9:aa:15 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:42:38.376 INFO:teuthology.orchestra.run.smithi062.stdout: altname enp7s0f1 2023-06-09T04:42:38.377 INFO:teuthology.orchestra.run.smithi062.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-09T04:42:38.377 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:bb:d1:c2 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:42:38.377 INFO:teuthology.orchestra.run.smithi062.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-09T04:42:38.377 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 0c:c4:7a:bb:d1:c3 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:42:38.377 INFO:teuthology.orchestra.run.smithi062.stdout: inet 172.21.15.62/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-06-09T04:42:38.377 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft 42348sec preferred_lft 42348sec 2023-06-09T04:42:38.377 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 fe80::ec4:7aff:febb:d1c3/64 scope link 2023-06-09T04:42:38.377 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:42:38.378 INFO:teuthology.orchestra.run.smithi062.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-06-09T04:42:38.378 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 02:42:bd:2a:61:d1 brd ff:ff:ff:ff:ff:ff 2023-06-09T04:42:38.378 INFO:teuthology.orchestra.run.smithi062.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-06-09T04:42:38.378 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:42:38.378 INFO:teuthology.orchestra.run.smithi062.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-06-09T04:42:38.378 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 3a:38:fc:25:10:7f brd ff:ff:ff:ff:ff:ff 2023-06-09T04:42:38.378 INFO:teuthology.orchestra.run.smithi062.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-06-09T04:42:38.379 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:42:38.379 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 fe80::d45a:e2ff:fe00:d56e/64 scope link 2023-06-09T04:42:38.379 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:42:38.379 INFO:teuthology.orchestra.run.smithi062.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-09T04:42:38.379 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 9a:39:11:ee:08:bb brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-06-09T04:42:38.380 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 fe80::9839:11ff:feee:8bb/64 scope link 2023-06-09T04:42:38.380 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:42:38.380 INFO:teuthology.orchestra.run.smithi062.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-06-09T04:42:38.380 INFO:teuthology.orchestra.run.smithi062.stdout: link/ether 3a:38:fc:25:10:7f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-06-09T04:42:38.380 INFO:teuthology.orchestra.run.smithi062.stdout: inet6 fe80::3838:fcff:fe25:107f/64 scope link 2023-06-09T04:42:38.380 INFO:teuthology.orchestra.run.smithi062.stdout: valid_lft forever preferred_lft forever 2023-06-09T04:42:38.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:38.382 DEBUG:teuthology.orchestra.run.smithi062:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-09T04:42:38.459 INFO:teuthology.orchestra.run.smithi062.stdout:1 2023-06-09T04:42:38.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:38.462 DEBUG:teuthology.orchestra.run.smithi062:> route 2023-06-09T04:42:38.521 INFO:teuthology.orchestra.run.smithi062.stdout:Kernel IP routing table 2023-06-09T04:42:38.521 INFO:teuthology.orchestra.run.smithi062.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-09T04:42:38.521 INFO:teuthology.orchestra.run.smithi062.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-06-09T04:42:38.522 INFO:teuthology.orchestra.run.smithi062.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-06-09T04:42:38.522 INFO:teuthology.orchestra.run.smithi062.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-06-09T04:42:38.522 INFO:teuthology.orchestra.run.smithi062.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-06-09T04:42:38.522 INFO:teuthology.orchestra.run.smithi062.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-09T04:42:38.522 INFO:teuthology.orchestra.run.smithi062.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-09T04:42:38.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:38.523 DEBUG:teuthology.orchestra.run.smithi062:> (cd / && exec bash -c ' 2023-06-09T04:42:38.524 DEBUG:teuthology.orchestra.run.smithi062:> set -e 2023-06-09T04:42:38.524 DEBUG:teuthology.orchestra.run.smithi062:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-06-09T04:42:38.524 DEBUG:teuthology.orchestra.run.smithi062:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-06-09T04:42:38.525 DEBUG:teuthology.orchestra.run.smithi062:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-06-09T04:42:38.525 DEBUG:teuthology.orchestra.run.smithi062:> ') 2023-06-09T04:42:38.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:38.665 DEBUG:teuthology.orchestra.run.smithi062:> ip netns list 2023-06-09T04:42:38.681 INFO:teuthology.orchestra.run.smithi062.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-06-09T04:42:38.681 INFO:teuthology.orchestra.run.smithi062.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-06-09T04:42:38.682 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-06-09T04:42:38.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:38.682 DEBUG:teuthology.orchestra.run.smithi062:> sudo ip link set brx.0 up 2023-06-09T04:42:38.759 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-09T04:42:38.759 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-06-09T04:42:38.821 INFO:teuthology.orchestra.run.smithi062.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-06-09T04:42:38.821 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-09T04:42:38.822 DEBUG:teuthology.orchestra.run.smithi062:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-06-09T04:42:38.879 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-06-09T04:42:38.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:38.880 DEBUG:teuthology.orchestra.run.smithi062:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-06-09T04:42:39.016 INFO:teuthology.orchestra.run.smithi062.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-06-09T04:42:39.016 INFO:teuthology.orchestra.run.smithi062.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-06-09T04:42:39.016 INFO:teuthology.orchestra.run.smithi062.stdout:invalid new device string format 2023-06-09T04:42:39.048 INFO:teuthology.orchestra.run.smithi062.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-06-09T04:42:39.048 INFO:teuthology.orchestra.run.smithi062.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-06-09T04:42:39.048 INFO:teuthology.orchestra.run.smithi062.stdout:invalid new device string format 2023-06-09T04:42:39.049 INFO:teuthology.orchestra.run.smithi062.stdout:mount.ceph: resolved to: "172.21.15.62:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-06-09T04:42:39.049 INFO:teuthology.orchestra.run.smithi062.stdout:mount.ceph: switching to using v1 address with old syntax 2023-06-09T04:42:39.065 INFO:teuthology.orchestra.run.smithi062.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-06-09T04:42:39.065 INFO:teuthology.orchestra.run.smithi062.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-06-09T04:42:39.066 INFO:teuthology.orchestra.run.smithi062.stdout:invalid new device string format 2023-06-09T04:42:39.066 INFO:teuthology.orchestra.run.smithi062.stdout:mount.ceph: resolved to: "172.21.15.62:3300,172.21.15.89:3300,172.21.15.89:3301" 2023-06-09T04:42:39.066 INFO:teuthology.orchestra.run.smithi062.stdout:mount.ceph: switching to using v1 address with old syntax 2023-06-09T04:42:39.066 INFO:teuthology.orchestra.run.smithi062.stdout:mount.ceph: resolved to: "172.21.15.62:6789,172.21.15.89:6789,172.21.15.89:6790" 2023-06-09T04:42:39.066 INFO:teuthology.orchestra.run.smithi062.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.62:6789,172.21.15.89:6789,172.21.15.89:6790:/ 2023-06-09T04:42:39.066 INFO:teuthology.orchestra.run.smithi062.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=f7998a1e-e5a9-4202-abaa-70c0eaae1047" will pass to kernel 2023-06-09T04:42:39.071 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-06-09T04:42:39.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:39.072 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-06-09T04:42:39.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:39.108 DEBUG:teuthology.orchestra.run.smithi062:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-06-09T04:42:39.192 INFO:teuthology.orchestra.run.smithi062.stdout:client5581 2023-06-09T04:42:39.192 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-06-09T04:42:39.193 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T04:42:39.255 DEBUG:teuthology.orchestra.run.smithi062:> mktemp -d --suffix=xfstests-dev 2023-06-09T04:42:39.315 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.VpYa8kRkcExfstests-dev 2023-06-09T04:42:39.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:39.316 DEBUG:teuthology.orchestra.run.smithi062:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.VpYa8kRkcExfstests-dev) 2023-06-09T04:42:39.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:39.401 DEBUG:teuthology.orchestra.run.smithi062:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.VpYa8kRkcExfstests-dev) 2023-06-09T04:42:39.475 INFO:teuthology.orchestra.run.smithi062.stderr:Cloning into '/tmp/tmp.VpYa8kRkcExfstests-dev'... 2023-06-09T04:42:40.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:40.389 DEBUG:teuthology.orchestra.run.smithi062:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2023-06-09T04:42:40.469 DEBUG:teuthology.orchestra.run.smithi062:> mktemp -d --suffix=test 2023-06-09T04:42:40.531 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.6L3ic7c8RKtest 2023-06-09T04:42:40.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:42:40.532 DEBUG:teuthology.orchestra.run.smithi062:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2023-06-09T04:42:40.599 DEBUG:teuthology.orchestra.run.smithi062:> mktemp -d --suffix=scratch 2023-06-09T04:42:40.658 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.opjat5JqR7scratch 2023-06-09T04:42:40.659 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "ubuntu" and "20.04". 2023-06-09T04:42:40.659 DEBUG:teuthology.orchestra.run.smithi062:> sudo apt-get install -y xfslibs-dev uuid-dev libtool-bin e2fsprogs automake gcc libuuid1 quota attr libattr1-dev make libacl1-dev libaio-dev xfsprogs libgdbm-dev gawk fio dbench uuid-runtime python2 sqlite3 2023-06-09T04:42:40.827 INFO:teuthology.orchestra.run.smithi062.stdout:Reading package lists... 2023-06-09T04:42:41.033 INFO:teuthology.orchestra.run.smithi062.stdout:Building dependency tree... 2023-06-09T04:42:41.034 INFO:teuthology.orchestra.run.smithi062.stdout:Reading state information... 2023-06-09T04:42:41.228 INFO:teuthology.orchestra.run.smithi062.stdout:attr is already the newest version (1:2.4.48-5). 2023-06-09T04:42:41.228 INFO:teuthology.orchestra.run.smithi062.stdout:automake is already the newest version (1:1.16.1-4ubuntu6). 2023-06-09T04:42:41.228 INFO:teuthology.orchestra.run.smithi062.stdout:gawk is already the newest version (1:5.0.1+dfsg-1). 2023-06-09T04:42:41.228 INFO:teuthology.orchestra.run.smithi062.stdout:gcc is already the newest version (4:9.3.0-1ubuntu2). 2023-06-09T04:42:41.228 INFO:teuthology.orchestra.run.smithi062.stdout:gcc set to manually installed. 2023-06-09T04:42:41.228 INFO:teuthology.orchestra.run.smithi062.stdout:libacl1-dev is already the newest version (2.2.53-6). 2023-06-09T04:42:41.229 INFO:teuthology.orchestra.run.smithi062.stdout:libaio-dev is already the newest version (0.3.112-5). 2023-06-09T04:42:41.229 INFO:teuthology.orchestra.run.smithi062.stdout:libattr1-dev is already the newest version (1:2.4.48-5). 2023-06-09T04:42:41.229 INFO:teuthology.orchestra.run.smithi062.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-06-09T04:42:41.229 INFO:teuthology.orchestra.run.smithi062.stdout:make is already the newest version (4.2.1-1.2). 2023-06-09T04:42:41.229 INFO:teuthology.orchestra.run.smithi062.stdout:make set to manually installed. 2023-06-09T04:42:41.229 INFO:teuthology.orchestra.run.smithi062.stdout:quota is already the newest version (4.05-1). 2023-06-09T04:42:41.229 INFO:teuthology.orchestra.run.smithi062.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-06-09T04:42:41.230 INFO:teuthology.orchestra.run.smithi062.stdout:xfsprogs is already the newest version (5.3.0-1ubuntu2). 2023-06-09T04:42:41.230 INFO:teuthology.orchestra.run.smithi062.stdout:dbench is already the newest version (4.0-2build1). 2023-06-09T04:42:41.230 INFO:teuthology.orchestra.run.smithi062.stdout:python2 is already the newest version (2.7.17-2ubuntu4). 2023-06-09T04:42:41.230 INFO:teuthology.orchestra.run.smithi062.stdout:python2 set to manually installed. 2023-06-09T04:42:41.230 INFO:teuthology.orchestra.run.smithi062.stdout:e2fsprogs is already the newest version (1.45.5-2ubuntu1.1). 2023-06-09T04:42:41.230 INFO:teuthology.orchestra.run.smithi062.stdout:libuuid1 is already the newest version (2.34-0.1ubuntu9.3). 2023-06-09T04:42:41.231 INFO:teuthology.orchestra.run.smithi062.stdout:uuid-dev is already the newest version (2.34-0.1ubuntu9.3). 2023-06-09T04:42:41.231 INFO:teuthology.orchestra.run.smithi062.stdout:uuid-runtime is already the newest version (2.34-0.1ubuntu9.3). 2023-06-09T04:42:41.231 INFO:teuthology.orchestra.run.smithi062.stdout:The following packages were automatically installed and are no longer required: 2023-06-09T04:42:41.231 INFO:teuthology.orchestra.run.smithi062.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-06-09T04:42:41.232 INFO:teuthology.orchestra.run.smithi062.stdout:Use 'sudo apt autoremove' to remove them. 2023-06-09T04:42:41.232 INFO:teuthology.orchestra.run.smithi062.stdout:The following additional packages will be installed: 2023-06-09T04:42:41.232 INFO:teuthology.orchestra.run.smithi062.stdout: libgfapi0 libgfrpc0 libgfxdr0 libglusterfs0 libsqlite3-0 2023-06-09T04:42:41.232 INFO:teuthology.orchestra.run.smithi062.stdout:Suggested packages: 2023-06-09T04:42:41.232 INFO:teuthology.orchestra.run.smithi062.stdout: gnuplot gfio python-scipy sqlite3-doc 2023-06-09T04:42:41.298 INFO:teuthology.orchestra.run.smithi062.stdout:The following NEW packages will be installed: 2023-06-09T04:42:41.300 INFO:teuthology.orchestra.run.smithi062.stdout: fio libgdbm-dev libgfapi0 libgfrpc0 libgfxdr0 libglusterfs0 sqlite3 2023-06-09T04:42:41.301 INFO:teuthology.orchestra.run.smithi062.stdout:The following packages will be upgraded: 2023-06-09T04:42:41.302 INFO:teuthology.orchestra.run.smithi062.stdout: libsqlite3-0 2023-06-09T04:42:41.499 INFO:teuthology.orchestra.run.smithi062.stdout:1 upgraded, 7 newly installed, 0 to remove and 184 not upgraded. 2023-06-09T04:42:41.499 INFO:teuthology.orchestra.run.smithi062.stdout:Need to get 2,428 kB of archives. 2023-06-09T04:42:41.499 INFO:teuthology.orchestra.run.smithi062.stdout:After this operation, 7,043 kB of additional disk space will be used. 2023-06-09T04:42:41.499 INFO:teuthology.orchestra.run.smithi062.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libsqlite3-0 amd64 3.31.1-4ubuntu0.5 [549 kB] 2023-06-09T04:42:42.050 INFO:teuthology.orchestra.run.smithi062.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/universe amd64 libglusterfs0 amd64 7.2-2build1 [286 kB] 2023-06-09T04:42:42.081 INFO:teuthology.orchestra.run.smithi062.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/universe amd64 libgfxdr0 amd64 7.2-2build1 [24.2 kB] 2023-06-09T04:42:42.083 INFO:teuthology.orchestra.run.smithi062.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/universe amd64 libgfrpc0 amd64 7.2-2build1 [46.1 kB] 2023-06-09T04:42:42.089 INFO:teuthology.orchestra.run.smithi062.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/universe amd64 libgfapi0 amd64 7.2-2build1 [72.6 kB] 2023-06-09T04:42:42.096 INFO:teuthology.orchestra.run.smithi062.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/universe amd64 fio amd64 3.16-1 [507 kB] 2023-06-09T04:42:42.172 INFO:teuthology.orchestra.run.smithi062.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 libgdbm-dev amd64 1.18.1-5 [83.4 kB] 2023-06-09T04:42:42.181 INFO:teuthology.orchestra.run.smithi062.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 sqlite3 amd64 3.31.1-4ubuntu0.5 [860 kB] 2023-06-09T04:42:42.566 INFO:teuthology.orchestra.run.smithi062.stderr:debconf: unable to initialize frontend: Dialog 2023-06-09T04:42:42.567 INFO:teuthology.orchestra.run.smithi062.stderr:debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.) 2023-06-09T04:42:42.567 INFO:teuthology.orchestra.run.smithi062.stderr:debconf: falling back to frontend: Readline 2023-06-09T04:42:42.608 INFO:teuthology.orchestra.run.smithi062.stderr:debconf: unable to initialize frontend: Readline 2023-06-09T04:42:42.608 INFO:teuthology.orchestra.run.smithi062.stderr:debconf: (This frontend requires a controlling tty.) 2023-06-09T04:42:42.608 INFO:teuthology.orchestra.run.smithi062.stderr:debconf: falling back to frontend: Teletype 2023-06-09T04:42:42.625 INFO:teuthology.orchestra.run.smithi062.stderr:dpkg-preconfigure: unable to re-open stdin: 2023-06-09T04:42:42.715 INFO:teuthology.orchestra.run.smithi062.stdout:Fetched 2,428 kB in 1s (2,614 kB/s) 2023-06-09T04:42:42.985 INFO:teuthology.orchestra.run.smithi062.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 121309 files and directories currently installed.) 2023-06-09T04:42:42.988 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../0-libsqlite3-0_3.31.1-4ubuntu0.5_amd64.deb ... 2023-06-09T04:42:43.175 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libsqlite3-0:amd64 (3.31.1-4ubuntu0.5) over (3.31.1-4ubuntu0.3) ... 2023-06-09T04:42:43.613 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libglusterfs0:amd64. 2023-06-09T04:42:43.633 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../1-libglusterfs0_7.2-2build1_amd64.deb ... 2023-06-09T04:42:43.670 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libglusterfs0:amd64 (7.2-2build1) ... 2023-06-09T04:42:44.049 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libgfxdr0:amd64. 2023-06-09T04:42:44.063 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../2-libgfxdr0_7.2-2build1_amd64.deb ... 2023-06-09T04:42:44.107 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libgfxdr0:amd64 (7.2-2build1) ... 2023-06-09T04:42:44.444 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libgfrpc0:amd64. 2023-06-09T04:42:44.465 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../3-libgfrpc0_7.2-2build1_amd64.deb ... 2023-06-09T04:42:44.511 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libgfrpc0:amd64 (7.2-2build1) ... 2023-06-09T04:42:44.847 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libgfapi0:amd64. 2023-06-09T04:42:44.868 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../4-libgfapi0_7.2-2build1_amd64.deb ... 2023-06-09T04:42:44.905 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libgfapi0:amd64 (7.2-2build1) ... 2023-06-09T04:42:45.375 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package fio. 2023-06-09T04:42:45.395 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../5-fio_3.16-1_amd64.deb ... 2023-06-09T04:42:45.433 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking fio (3.16-1) ... 2023-06-09T04:42:45.863 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libgdbm-dev:amd64. 2023-06-09T04:42:45.878 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../6-libgdbm-dev_1.18.1-5_amd64.deb ... 2023-06-09T04:42:45.921 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libgdbm-dev:amd64 (1.18.1-5) ... 2023-06-09T04:42:46.249 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package sqlite3. 2023-06-09T04:42:46.269 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../7-sqlite3_3.31.1-4ubuntu0.5_amd64.deb ... 2023-06-09T04:42:46.307 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking sqlite3 (3.31.1-4ubuntu0.5) ... 2023-06-09T04:42:46.724 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libsqlite3-0:amd64 (3.31.1-4ubuntu0.5) ... 2023-06-09T04:42:46.846 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libglusterfs0:amd64 (7.2-2build1) ... 2023-06-09T04:42:46.972 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libgdbm-dev:amd64 (1.18.1-5) ... 2023-06-09T04:42:47.098 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up sqlite3 (3.31.1-4ubuntu0.5) ... 2023-06-09T04:42:47.224 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libgfxdr0:amd64 (7.2-2build1) ... 2023-06-09T04:42:47.341 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libgfrpc0:amd64 (7.2-2build1) ... 2023-06-09T04:42:47.468 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libgfapi0:amd64 (7.2-2build1) ... 2023-06-09T04:42:47.594 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up fio (3.16-1) ... 2023-06-09T04:42:47.880 INFO:teuthology.orchestra.run.smithi062.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-06-09T04:42:48.040 INFO:teuthology.orchestra.run.smithi062.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-06-09T04:42:48.540 INFO:teuthology.orchestra.run.smithi062.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-06-09T04:42:50.675 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:42:50.681 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:42:51.893 INFO:teuthology.orchestra.run.smithi062.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-06-09T04:42:52.818 DEBUG:teuthology.orchestra.run.smithi062:> sudo useradd -m fsgqa 2023-06-09T04:42:52.851 INFO:teuthology.orchestra.run.smithi062.stderr:useradd: user 'fsgqa' already exists 2023-06-09T04:42:52.854 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-06-09T04:42:52.854 DEBUG:teuthology.orchestra.run.smithi062:> sudo groupadd fsgqa 2023-06-09T04:42:52.934 INFO:teuthology.orchestra.run.smithi062.stderr:groupadd: group 'fsgqa' already exists 2023-06-09T04:42:52.938 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-06-09T04:42:52.938 DEBUG:teuthology.orchestra.run.smithi062:> sudo useradd fsgqa2 2023-06-09T04:42:53.427 DEBUG:teuthology.orchestra.run.smithi062:> sudo useradd 123456-fsgqa 2023-06-09T04:42:53.848 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-06-09T04:42:54.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.034+0000 7ff71d7c6700 1 Processor -- start 2023-06-09T04:42:54.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.034+0000 7ff71d7c6700 1 -- start start 2023-06-09T04:42:54.038 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.034+0000 7ff71d7c6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff718159c90 0x7ff718070e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:54.038 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.034+0000 7ff71d7c6700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff7180cb850 0x7ff718071340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:54.038 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.034+0000 7ff71d7c6700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff718071880 con 0x7ff7180b08d0 2023-06-09T04:42:54.039 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.034+0000 7ff71d7c6700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff71806b960 con 0x7ff7180cb850 2023-06-09T04:42:54.039 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.034+0000 7ff71d7c6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff71806f9b0 con 0x7ff718159c90 2023-06-09T04:42:54.039 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.034+0000 7ff716ffd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff718159c90 0x7ff718070e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:54.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.034+0000 7ff716ffd700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff718159c90 0x7ff718070e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3301/0 says I am v2:172.21.15.62:55346/0 (socket says 172.21.15.62:55346) 2023-06-09T04:42:54.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.034+0000 7ff716ffd700 1 -- 172.21.15.62:0/4098947223 learned_addr learned my addr 172.21.15.62:0/4098947223 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:54.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.034+0000 7ff7167fc700 1 --2- 172.21.15.62:0/4098947223 >> v2:172.21.15.89:3300/0 conn(0x7ff7180cb850 0x7ff718071340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:54.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.038+0000 7ff715ffb700 1 -- 172.21.15.62:0/4098947223 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1955883997 0 0) 0x7ff718071880 con 0x7ff7180b08d0 2023-06-09T04:42:54.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.038+0000 7ff715ffb700 1 -- 172.21.15.62:0/4098947223 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7000035d0 con 0x7ff7180b08d0 2023-06-09T04:42:54.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.038+0000 7ff716ffd700 1 -- 172.21.15.62:0/4098947223 >> v2:172.21.15.89:3300/0 conn(0x7ff7180cb850 msgr2=0x7ff718071340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T04:42:54.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.038+0000 7ff716ffd700 1 --2- 172.21.15.62:0/4098947223 >> v2:172.21.15.89:3300/0 conn(0x7ff7180cb850 0x7ff718071340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:54.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.038+0000 7ff716ffd700 1 -- 172.21.15.62:0/4098947223 >> v1:172.21.15.89:6789/0 conn(0x7ff7180b08d0 legacy=0x7ff7180ca160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:54.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.038+0000 7ff716ffd700 1 -- 172.21.15.62:0/4098947223 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff71815a060 con 0x7ff718159c90 2023-06-09T04:42:54.042 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.038+0000 7ff716ffd700 1 --2- 172.21.15.62:0/4098947223 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff718159c90 0x7ff718070e00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff708009910 tx=0x7ff708009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6fae67de87c7704 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:54.042 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.038+0000 7ff715ffb700 1 -- 172.21.15.62:0/4098947223 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff708011830 con 0x7ff718159c90 2023-06-09T04:42:54.042 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.038+0000 7ff715ffb700 1 -- 172.21.15.62:0/4098947223 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff708011990 con 0x7ff718159c90 2023-06-09T04:42:54.043 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.038+0000 7ff715ffb700 1 -- 172.21.15.62:0/4098947223 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff708011d40 con 0x7ff718159c90 2023-06-09T04:42:54.043 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.038+0000 7ff71d7c6700 1 -- 172.21.15.62:0/4098947223 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff718159c90 msgr2=0x7ff718070e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:54.043 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.038+0000 7ff71d7c6700 1 --2- 172.21.15.62:0/4098947223 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff718159c90 0x7ff718070e00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff708009910 tx=0x7ff708009c20 comp rx=0 tx=0).stop 2023-06-09T04:42:54.043 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.038+0000 7ff71d7c6700 1 -- 172.21.15.62:0/4098947223 shutdown_connections 2023-06-09T04:42:54.043 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.038+0000 7ff71d7c6700 1 --2- 172.21.15.62:0/4098947223 >> v2:172.21.15.89:3300/0 conn(0x7ff7180cb850 0x7ff718071340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:54.043 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.038+0000 7ff71d7c6700 1 --2- 172.21.15.62:0/4098947223 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff718159c90 0x7ff718070e00 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:54.043 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.038+0000 7ff71d7c6700 1 -- 172.21.15.62:0/4098947223 >> 172.21.15.62:0/4098947223 conn(0x7ff71806a410 msgr2=0x7ff7180afd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:54.043 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.038+0000 7ff71d7c6700 1 -- 172.21.15.62:0/4098947223 shutdown_connections 2023-06-09T04:42:54.044 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.038+0000 7ff71d7c6700 1 -- 172.21.15.62:0/4098947223 wait complete. 2023-06-09T04:42:54.045 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.042+0000 7ff71d7c6700 1 Processor -- start 2023-06-09T04:42:54.045 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.042+0000 7ff71d7c6700 1 -- start start 2023-06-09T04:42:54.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.042+0000 7ff71d7c6700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7180b08d0 0x7ff7181f48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:54.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.042+0000 7ff71d7c6700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff7180cb850 0x7ff7180c5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:54.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.042+0000 7ff71d7c6700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff718159c90 0x7ff7180c6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:54.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.042+0000 7ff71d7c6700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7181456f0 con 0x7ff718159c90 2023-06-09T04:42:54.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.042+0000 7ff71d7c6700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7180c6840 con 0x7ff7180b08d0 2023-06-09T04:42:54.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.042+0000 7ff71d7c6700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7180c6b20 con 0x7ff7180cb850 2023-06-09T04:42:54.048 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.046+0000 7ff716ffd700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7180b08d0 0x7ff7181f48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:54.048 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.046+0000 7ff7177fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff718159c90 0x7ff7180c6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:54.048 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.046+0000 7ff716ffd700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7180b08d0 0x7ff7181f48d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.62:56602/0 (socket says 172.21.15.62:56602) 2023-06-09T04:42:54.049 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.046+0000 7ff716ffd700 1 -- 172.21.15.62:0/3878601269 learned_addr learned my addr 172.21.15.62:0/3878601269 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:54.049 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.046+0000 7ff7167fc700 1 --2- 172.21.15.62:0/3878601269 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff7180cb850 0x7ff7180c5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:54.049 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.046+0000 7ff7177fe700 1 -- 172.21.15.62:0/3878601269 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff7180cb850 msgr2=0x7ff7180c5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:54.049 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.046+0000 7ff7177fe700 1 --2- 172.21.15.62:0/3878601269 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff7180cb850 0x7ff7180c5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:54.049 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.046+0000 7ff7177fe700 1 -- 172.21.15.62:0/3878601269 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7180b08d0 msgr2=0x7ff7181f48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:54.049 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.046+0000 7ff7177fe700 1 --2- 172.21.15.62:0/3878601269 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7180b08d0 0x7ff7181f48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:54.049 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.046+0000 7ff7177fe700 1 -- 172.21.15.62:0/3878601269 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff708009570 con 0x7ff718159c90 2023-06-09T04:42:54.049 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.046+0000 7ff716ffd700 1 --2- 172.21.15.62:0/3878601269 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7180b08d0 0x7ff7181f48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-09T04:42:54.050 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.046+0000 7ff7177fe700 1 --2- 172.21.15.62:0/3878601269 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff718159c90 0x7ff7180c6210 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7ff71000cbc0 tx=0x7ff71000ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:54.050 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.046+0000 7ff6ff7fe700 1 -- 172.21.15.62:0/3878601269 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff710003c20 con 0x7ff718159c90 2023-06-09T04:42:54.050 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.046+0000 7ff6ff7fe700 1 -- 172.21.15.62:0/3878601269 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff710003d80 con 0x7ff718159c90 2023-06-09T04:42:54.051 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.046+0000 7ff71d7c6700 1 -- 172.21.15.62:0/3878601269 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7180c6e00 con 0x7ff718159c90 2023-06-09T04:42:54.051 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.046+0000 7ff6ff7fe700 1 -- 172.21.15.62:0/3878601269 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff71000aa80 con 0x7ff718159c90 2023-06-09T04:42:54.051 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.046+0000 7ff71d7c6700 1 -- 172.21.15.62:0/3878601269 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7181536e0 con 0x7ff718159c90 2023-06-09T04:42:54.051 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.046+0000 7ff71d7c6700 1 -- 172.21.15.62:0/3878601269 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff718145880 con 0x7ff718159c90 2023-06-09T04:42:54.052 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.050+0000 7ff6ff7fe700 1 -- 172.21.15.62:0/3878601269 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff71000abe0 con 0x7ff718159c90 2023-06-09T04:42:54.054 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.050+0000 7ff6ff7fe700 1 --2- 172.21.15.62:0/3878601269 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7ff7040662f0 0x7ff7040687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:54.055 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.050+0000 7ff6ff7fe700 1 -- 172.21.15.62:0/3878601269 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6440+0+0 (secure 0 0 0) 0x7ff710083e60 con 0x7ff718159c90 2023-06-09T04:42:54.055 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.054+0000 7ff716ffd700 1 --2- 172.21.15.62:0/3878601269 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7ff7040662f0 0x7ff7040687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:54.056 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.054+0000 7ff716ffd700 1 --2- 172.21.15.62:0/3878601269 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7ff7040662f0 0x7ff7040687a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff708009150 tx=0x7ff708008030 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:54.061 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.058+0000 7ff6ff7fe700 1 -- 172.21.15.62:0/3878601269 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff7100510d0 con 0x7ff718159c90 2023-06-09T04:42:54.308 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.306+0000 7ff71d7c6700 1 -- 172.21.15.62:0/3878601269 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ff718066010 con 0x7ff718159c90 2023-06-09T04:42:54.309 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.306+0000 7ff6ff7fe700 1 -- 172.21.15.62:0/3878601269 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1268 (secure 0 0 0) 0x7ff7100546f0 con 0x7ff718159c90 2023-06-09T04:42:54.309 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:42:54.310 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":1,"fsid":"f7998a1e-e5a9-4202-abaa-70c0eaae1047","modified":"2023-06-09T04:39:52.421756Z","created":"2023-06-09T04:39:52.421756Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:3300","nonce":0},{"type":"v1","addr":"172.21.15.62:6789","nonce":0}]},"addr":"172.21.15.62:6789/0","public_addr":"172.21.15.62:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:3300","nonce":0},{"type":"v1","addr":"172.21.15.89:6789","nonce":0}]},"addr":"172.21.15.89:6789/0","public_addr":"172.21.15.89:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:3301","nonce":0},{"type":"v1","addr":"172.21.15.89:6790","nonce":0}]},"addr":"172.21.15.89:6790/0","public_addr":"172.21.15.89:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-06-09T04:42:54.314 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.310+0000 7ff71d7c6700 1 -- 172.21.15.62:0/3878601269 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7ff7040662f0 msgr2=0x7ff7040687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:54.315 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.310+0000 7ff71d7c6700 1 --2- 172.21.15.62:0/3878601269 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7ff7040662f0 0x7ff7040687a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7ff708009150 tx=0x7ff708008030 comp rx=0 tx=0).stop 2023-06-09T04:42:54.315 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.310+0000 7ff71d7c6700 1 -- 172.21.15.62:0/3878601269 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff718159c90 msgr2=0x7ff7180c6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:54.315 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.310+0000 7ff71d7c6700 1 --2- 172.21.15.62:0/3878601269 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff718159c90 0x7ff7180c6210 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7ff71000cbc0 tx=0x7ff71000ced0 comp rx=0 tx=0).stop 2023-06-09T04:42:54.315 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.310+0000 7ff71d7c6700 1 -- 172.21.15.62:0/3878601269 shutdown_connections 2023-06-09T04:42:54.315 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.310+0000 7ff71d7c6700 1 --2- 172.21.15.62:0/3878601269 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7ff7040662f0 0x7ff7040687a0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:54.315 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.310+0000 7ff71d7c6700 1 --2- 172.21.15.62:0/3878601269 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff718159c90 0x7ff7180c6210 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:54.315 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.310+0000 7ff71d7c6700 1 --2- 172.21.15.62:0/3878601269 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff7180cb850 0x7ff7180c5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:54.316 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.310+0000 7ff71d7c6700 1 --2- 172.21.15.62:0/3878601269 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7180b08d0 0x7ff7181f48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:54.316 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.310+0000 7ff71d7c6700 1 -- 172.21.15.62:0/3878601269 >> 172.21.15.62:0/3878601269 conn(0x7ff71806a410 msgr2=0x7ff7181575b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:54.316 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.310+0000 7ff71d7c6700 1 -- 172.21.15.62:0/3878601269 shutdown_connections 2023-06-09T04:42:54.316 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.310+0000 7ff71d7c6700 1 -- 172.21.15.62:0/3878601269 wait complete. 2023-06-09T04:42:54.317 INFO:teuthology.orchestra.run.smithi062.stderr:dumped monmap epoch 1 2023-06-09T04:42:54.338 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2023-06-09T04:42:54.517 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.514+0000 7f9faf59e700 1 Processor -- start 2023-06-09T04:42:54.517 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.514+0000 7f9faf59e700 1 -- start start 2023-06-09T04:42:54.519 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.514+0000 7f9faf59e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9fb0158890 0x7f9fb00cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:54.519 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.518+0000 7f9faf59e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fb006c4c0 con 0x7f9fb00c8e50 2023-06-09T04:42:54.520 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.518+0000 7f9faf59e700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fb006b920 con 0x7f9fb00cc1a0 2023-06-09T04:42:54.520 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.518+0000 7f9faf59e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb006bb90 con 0x7f9fb0158890 2023-06-09T04:42:54.520 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.518+0000 7f9faed9d700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f9fb00c8e50 0x7f9fb006f9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:55600/0 (socket says 172.21.15.62:55600) 2023-06-09T04:42:54.520 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.518+0000 7f9faed9d700 1 -- 172.21.15.62:0/1149273103 learned_addr learned my addr 172.21.15.62:0/1149273103 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T04:42:54.521 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.518+0000 7f9fae59c700 1 --2- 172.21.15.62:0/1149273103 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9fb0158890 0x7f9fb00cd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:54.521 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.518+0000 7f9fadd9b700 1 -- 172.21.15.62:0/1149273103 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 848462706 0 0) 0x7f9fb006c4c0 con 0x7f9fb00c8e50 2023-06-09T04:42:54.522 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.518+0000 7f9fadd9b700 1 -- 172.21.15.62:0/1149273103 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f9c0035d0 con 0x7f9fb00c8e50 2023-06-09T04:42:54.522 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.518+0000 7f9fadd9b700 1 -- 172.21.15.62:0/1149273103 <== mon.1 v1:172.21.15.89:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3017696847 0 0) 0x7f9fb006b920 con 0x7f9fb00cc1a0 2023-06-09T04:42:54.522 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.518+0000 7f9fadd9b700 1 -- 172.21.15.62:0/1149273103 --> v1:172.21.15.89:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fb006c4c0 con 0x7f9fb00cc1a0 2023-06-09T04:42:54.522 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.518+0000 7f9fae59c700 1 -- 172.21.15.62:0/1149273103 >> v1:172.21.15.89:6789/0 conn(0x7f9fb00cc1a0 legacy=0x7f9fb006c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:54.522 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.518+0000 7f9fae59c700 1 -- 172.21.15.62:0/1149273103 >> v1:172.21.15.62:6789/0 conn(0x7f9fb00c8e50 legacy=0x7f9fb006f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:54.522 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.518+0000 7f9fadd9b700 1 -- 172.21.15.62:0/1149273103 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 273888812 0 0) 0x7f9f9c0035d0 con 0x7f9fb00c8e50 2023-06-09T04:42:54.522 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.518+0000 7f9fae59c700 1 -- 172.21.15.62:0/1149273103 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fb006be70 con 0x7f9fb0158890 2023-06-09T04:42:54.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.518+0000 7f9fae59c700 1 --2- 172.21.15.62:0/1149273103 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9fb0158890 0x7f9fb00cd0c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9fa0009880 tx=0x7f9fa0009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1742e0c8f25c2e9d server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:54.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.518+0000 7f9fadd9b700 1 -- 172.21.15.62:0/1149273103 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa80019f0 con 0x7f9fb0158890 2023-06-09T04:42:54.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.518+0000 7f9fadd9b700 1 -- 172.21.15.62:0/1149273103 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fa0004030 con 0x7f9fb0158890 2023-06-09T04:42:54.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.518+0000 7f9fadd9b700 1 -- 172.21.15.62:0/1149273103 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa00043c0 con 0x7f9fb0158890 2023-06-09T04:42:54.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.522+0000 7f9faf59e700 1 -- 172.21.15.62:0/1149273103 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9fb0158890 msgr2=0x7f9fb00cd0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:54.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.522+0000 7f9faf59e700 1 --2- 172.21.15.62:0/1149273103 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9fb0158890 0x7f9fb00cd0c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9fa0009880 tx=0x7f9fa0009b90 comp rx=0 tx=0).stop 2023-06-09T04:42:54.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.522+0000 7f9faf59e700 1 -- 172.21.15.62:0/1149273103 shutdown_connections 2023-06-09T04:42:54.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.522+0000 7f9faf59e700 1 --2- 172.21.15.62:0/1149273103 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9fb0158890 0x7f9fb00cd0c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:54.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.522+0000 7f9faf59e700 1 -- 172.21.15.62:0/1149273103 >> 172.21.15.62:0/1149273103 conn(0x7f9fb006a420 msgr2=0x7f9fb00afc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:54.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.522+0000 7f9faf59e700 1 -- 172.21.15.62:0/1149273103 shutdown_connections 2023-06-09T04:42:54.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.522+0000 7f9faf59e700 1 -- 172.21.15.62:0/1149273103 wait complete. 2023-06-09T04:42:54.526 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.522+0000 7f9faf59e700 1 Processor -- start 2023-06-09T04:42:54.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.522+0000 7f9faf59e700 1 -- start start 2023-06-09T04:42:54.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.526+0000 7f9faf59e700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9fb00cc1a0 0x7f9fb014a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:54.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.526+0000 7f9faf59e700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9fb0158890 0x7f9fb01463a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:54.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.526+0000 7f9faf59e700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9fb00c4580 0x7f9fb01468e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:54.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.526+0000 7f9faf59e700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb00b3860 con 0x7f9fb00cc1a0 2023-06-09T04:42:54.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.526+0000 7f9faf59e700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb00c4a10 con 0x7f9fb0158890 2023-06-09T04:42:54.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.526+0000 7f9faf59e700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb00b1680 con 0x7f9fb00c4580 2023-06-09T04:42:54.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.526+0000 7f9fae59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9fb00cc1a0 0x7f9fb014a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:54.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.526+0000 7f9fae59c700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9fb00cc1a0 0x7f9fb014a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47802/0 (socket says 172.21.15.62:47802) 2023-06-09T04:42:54.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.526+0000 7f9fae59c700 1 -- 172.21.15.62:0/1656117847 learned_addr learned my addr 172.21.15.62:0/1656117847 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T04:42:54.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.526+0000 7f9fa7fff700 1 --2- 172.21.15.62:0/1656117847 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9fb0158890 0x7f9fb01463a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:54.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.526+0000 7f9faed9d700 1 --2- 172.21.15.62:0/1656117847 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9fb00c4580 0x7f9fb01468e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:54.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.526+0000 7f9fae59c700 1 -- 172.21.15.62:0/1656117847 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9fb00c4580 msgr2=0x7f9fb01468e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:54.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.526+0000 7f9fae59c700 1 --2- 172.21.15.62:0/1656117847 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9fb00c4580 0x7f9fb01468e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:54.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.526+0000 7f9fae59c700 1 -- 172.21.15.62:0/1656117847 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9fb0158890 msgr2=0x7f9fb01463a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:54.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.526+0000 7f9fae59c700 1 --2- 172.21.15.62:0/1656117847 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9fb0158890 0x7f9fb01463a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:54.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.526+0000 7f9fae59c700 1 -- 172.21.15.62:0/1656117847 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fa00094b0 con 0x7f9fb00cc1a0 2023-06-09T04:42:54.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.526+0000 7f9fae59c700 1 --2- 172.21.15.62:0/1656117847 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9fb00cc1a0 0x7f9fb014a800 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f9fa0014040 tx=0x7f9fa0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:54.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.526+0000 7f9fa6ffd700 1 -- 172.21.15.62:0/1656117847 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa0003c50 con 0x7f9fb00cc1a0 2023-06-09T04:42:54.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.526+0000 7f9fa6ffd700 1 -- 172.21.15.62:0/1656117847 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fa0003dd0 con 0x7f9fb00cc1a0 2023-06-09T04:42:54.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.526+0000 7f9faf59e700 1 -- 172.21.15.62:0/1656117847 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fb00b10c0 con 0x7f9fb00cc1a0 2023-06-09T04:42:54.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.526+0000 7f9fa6ffd700 1 -- 172.21.15.62:0/1656117847 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa0011870 con 0x7f9fb00cc1a0 2023-06-09T04:42:54.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.526+0000 7f9faf59e700 1 -- 172.21.15.62:0/1656117847 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fb014aec0 con 0x7f9fb00cc1a0 2023-06-09T04:42:54.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.530+0000 7f9faf59e700 1 -- 172.21.15.62:0/1656117847 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fb00b3630 con 0x7f9fb00cc1a0 2023-06-09T04:42:54.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.530+0000 7f9fa6ffd700 1 -- 172.21.15.62:0/1656117847 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f9fa0018040 con 0x7f9fb00cc1a0 2023-06-09T04:42:54.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.534+0000 7f9fa6ffd700 1 --2- 172.21.15.62:0/1656117847 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f9f900662f0 0x7f9f900687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T04:42:54.536 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.534+0000 7f9fa6ffd700 1 -- 172.21.15.62:0/1656117847 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f9fa0084cd0 con 0x7f9fb00cc1a0 2023-06-09T04:42:54.536 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.534+0000 7f9fa7fff700 1 --2- 172.21.15.62:0/1656117847 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f9f900662f0 0x7f9f900687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T04:42:54.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.534+0000 7f9fa7fff700 1 --2- 172.21.15.62:0/1656117847 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f9f900662f0 0x7f9f900687a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f9fb01f4d60 tx=0x7f9f98009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T04:42:54.542 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.538+0000 7f9fa6ffd700 1 -- 172.21.15.62:0/1656117847 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f9fb00b3630 con 0x7f9fb00cc1a0 2023-06-09T04:42:54.780 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.778+0000 7f9faf59e700 1 -- 172.21.15.62:0/1656117847 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) v1 -- 0x7f9fb00b3630 con 0x7f9fb00cc1a0 2023-06-09T04:42:54.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.778+0000 7f9fa6ffd700 1 -- 172.21.15.62:0/1656117847 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v15) v1 ==== 92+0+63 (secure 0 0 0) 0x7f9fb00b3630 con 0x7f9fb00cc1a0 2023-06-09T04:42:54.782 INFO:teuthology.orchestra.run.smithi062.stdout:[client.admin] 2023-06-09T04:42:54.782 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 2023-06-09T04:42:54.784 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.782+0000 7f9faf59e700 1 -- 172.21.15.62:0/1656117847 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f9f900662f0 msgr2=0x7f9f900687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:54.784 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.782+0000 7f9faf59e700 1 --2- 172.21.15.62:0/1656117847 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f9f900662f0 0x7f9f900687a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f9fb01f4d60 tx=0x7f9f98009040 comp rx=0 tx=0).stop 2023-06-09T04:42:54.784 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.782+0000 7f9faf59e700 1 -- 172.21.15.62:0/1656117847 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9fb00cc1a0 msgr2=0x7f9fb014a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T04:42:54.784 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.782+0000 7f9faf59e700 1 --2- 172.21.15.62:0/1656117847 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9fb00cc1a0 0x7f9fb014a800 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f9fa0014040 tx=0x7f9fa0004770 comp rx=0 tx=0).stop 2023-06-09T04:42:54.785 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.782+0000 7f9faf59e700 1 -- 172.21.15.62:0/1656117847 shutdown_connections 2023-06-09T04:42:54.785 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.782+0000 7f9faf59e700 1 --2- 172.21.15.62:0/1656117847 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f9f900662f0 0x7f9f900687a0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:54.785 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.782+0000 7f9faf59e700 1 --2- 172.21.15.62:0/1656117847 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f9fb00c4580 0x7f9fb01468e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:54.786 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.782+0000 7f9faf59e700 1 --2- 172.21.15.62:0/1656117847 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9fb0158890 0x7f9fb01463a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:54.786 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.782+0000 7f9faf59e700 1 --2- 172.21.15.62:0/1656117847 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9fb00cc1a0 0x7f9fb014a800 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T04:42:54.786 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.782+0000 7f9faf59e700 1 -- 172.21.15.62:0/1656117847 >> 172.21.15.62:0/1656117847 conn(0x7f9fb00c8e50 msgr2=0x7f9fb006c950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T04:42:54.786 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.782+0000 7f9faf59e700 1 -- 172.21.15.62:0/1656117847 shutdown_connections 2023-06-09T04:42:54.786 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T04:42:54.782+0000 7f9faf59e700 1 -- 172.21.15.62:0/1656117847 wait complete. 2023-06-09T04:42:54.805 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-06-09T04:42:54.805 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/tmp/tmp.VpYa8kRkcExfstests-dev/local.config 2023-06-09T04:42:54.838 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.62:6789:/test export TEST_DIR=/tmp/tmp.6L3ic7c8RKtest export SCRATCH_DEV=172.21.15.62:6789:/scratch export SCRATCH_MNT=/tmp/tmp.opjat5JqR7scratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw==" 2023-06-09T04:42:54.838 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-06-09T04:42:54.838 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/tmp/tmp.VpYa8kRkcExfstests-dev/ceph.exclude 2023-06-09T04:42:54.915 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo make) 2023-06-09T04:42:55.037 INFO:teuthology.orchestra.run.smithi062.stdout:libtoolize -cfi 2023-06-09T04:42:55.699 INFO:teuthology.orchestra.run.smithi062.stdout:libtoolize: putting auxiliary files in '.'. 2023-06-09T04:42:55.699 INFO:teuthology.orchestra.run.smithi062.stdout:libtoolize: copying file './config.guess' 2023-06-09T04:42:55.723 INFO:teuthology.orchestra.run.smithi062.stdout:libtoolize: copying file './config.sub' 2023-06-09T04:42:55.750 INFO:teuthology.orchestra.run.smithi062.stdout:libtoolize: copying file './install-sh' 2023-06-09T04:42:55.777 INFO:teuthology.orchestra.run.smithi062.stdout:libtoolize: copying file './ltmain.sh' 2023-06-09T04:42:55.886 INFO:teuthology.orchestra.run.smithi062.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-06-09T04:42:55.887 INFO:teuthology.orchestra.run.smithi062.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-06-09T04:42:55.924 INFO:teuthology.orchestra.run.smithi062.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-06-09T04:42:55.951 INFO:teuthology.orchestra.run.smithi062.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-06-09T04:42:55.980 INFO:teuthology.orchestra.run.smithi062.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-06-09T04:42:56.006 INFO:teuthology.orchestra.run.smithi062.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-06-09T04:42:56.032 INFO:teuthology.orchestra.run.smithi062.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-06-09T04:42:56.038 INFO:teuthology.orchestra.run.smithi062.stdout:cp include/install-sh . 2023-06-09T04:42:56.044 INFO:teuthology.orchestra.run.smithi062.stdout:aclocal -I m4 2023-06-09T04:42:57.667 INFO:teuthology.orchestra.run.smithi062.stdout:autoheader 2023-06-09T04:42:58.117 INFO:teuthology.orchestra.run.smithi062.stdout:autoconf 2023-06-09T04:42:58.466 INFO:teuthology.orchestra.run.smithi062.stdout:./configure \ 2023-06-09T04:42:58.466 INFO:teuthology.orchestra.run.smithi062.stdout: --libexecdir=/usr/lib \ 2023-06-09T04:42:58.466 INFO:teuthology.orchestra.run.smithi062.stdout: --exec_prefix=/var/lib 2023-06-09T04:42:59.577 INFO:teuthology.orchestra.run.smithi062.stdout:checking build system type... x86_64-pc-linux-gnu 2023-06-09T04:42:59.577 INFO:teuthology.orchestra.run.smithi062.stdout:checking host system type... x86_64-pc-linux-gnu 2023-06-09T04:42:59.649 INFO:teuthology.orchestra.run.smithi062.stdout:checking how to print strings... printf 2023-06-09T04:42:59.651 INFO:teuthology.orchestra.run.smithi062.stdout:checking for gcc... gcc 2023-06-09T04:42:59.954 INFO:teuthology.orchestra.run.smithi062.stdout:checking whether the C compiler works... yes 2023-06-09T04:42:59.955 INFO:teuthology.orchestra.run.smithi062.stdout:checking for C compiler default output file name... a.out 2023-06-09T04:43:00.048 INFO:teuthology.orchestra.run.smithi062.stdout:checking for suffix of executables... 2023-06-09T04:43:00.180 INFO:teuthology.orchestra.run.smithi062.stdout:checking whether we are cross compiling... no 2023-06-09T04:43:00.249 INFO:teuthology.orchestra.run.smithi062.stdout:checking for suffix of object files... o 2023-06-09T04:43:00.305 INFO:teuthology.orchestra.run.smithi062.stdout:checking whether we are using the GNU C compiler... yes 2023-06-09T04:43:00.366 INFO:teuthology.orchestra.run.smithi062.stdout:checking whether gcc accepts -g... yes 2023-06-09T04:43:00.477 INFO:teuthology.orchestra.run.smithi062.stdout:checking for gcc option to accept ISO C89... none needed 2023-06-09T04:43:00.494 INFO:teuthology.orchestra.run.smithi062.stdout:checking for a sed that does not truncate output... /usr/bin/sed 2023-06-09T04:43:00.507 INFO:teuthology.orchestra.run.smithi062.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2023-06-09T04:43:00.512 INFO:teuthology.orchestra.run.smithi062.stdout:checking for egrep... /usr/bin/grep -E 2023-06-09T04:43:00.519 INFO:teuthology.orchestra.run.smithi062.stdout:checking for fgrep... /usr/bin/grep -F 2023-06-09T04:43:00.535 INFO:teuthology.orchestra.run.smithi062.stdout:checking for ld used by gcc... /usr/bin/ld 2023-06-09T04:43:00.545 INFO:teuthology.orchestra.run.smithi062.stdout:checking if the linker (/usr/bin/ld) is GNU ld... yes 2023-06-09T04:43:00.556 INFO:teuthology.orchestra.run.smithi062.stdout:checking for BSD- or MS-compatible name lister (nm)... /usr/bin/nm -B 2023-06-09T04:43:00.634 INFO:teuthology.orchestra.run.smithi062.stdout:checking the name lister (/usr/bin/nm -B) interface... BSD nm 2023-06-09T04:43:00.634 INFO:teuthology.orchestra.run.smithi062.stdout:checking whether ln -s works... yes 2023-06-09T04:43:00.656 INFO:teuthology.orchestra.run.smithi062.stdout:checking the maximum length of command line arguments... 1572864 2023-06-09T04:43:00.667 INFO:teuthology.orchestra.run.smithi062.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-06-09T04:43:00.668 INFO:teuthology.orchestra.run.smithi062.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-06-09T04:43:00.668 INFO:teuthology.orchestra.run.smithi062.stdout:checking for /usr/bin/ld option to reload object files... -r 2023-06-09T04:43:00.669 INFO:teuthology.orchestra.run.smithi062.stdout:checking for objdump... objdump 2023-06-09T04:43:00.671 INFO:teuthology.orchestra.run.smithi062.stdout:checking how to recognize dependent libraries... pass_all 2023-06-09T04:43:00.672 INFO:teuthology.orchestra.run.smithi062.stdout:checking for dlltool... no 2023-06-09T04:43:00.672 INFO:teuthology.orchestra.run.smithi062.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-06-09T04:43:00.673 INFO:teuthology.orchestra.run.smithi062.stdout:checking for ar... ar 2023-06-09T04:43:00.758 INFO:teuthology.orchestra.run.smithi062.stdout:checking for archiver @FILE support... @ 2023-06-09T04:43:00.758 INFO:teuthology.orchestra.run.smithi062.stdout:checking for strip... strip 2023-06-09T04:43:00.760 INFO:teuthology.orchestra.run.smithi062.stdout:checking for ranlib... ranlib 2023-06-09T04:43:00.761 INFO:teuthology.orchestra.run.smithi062.stdout:checking for gawk... gawk 2023-06-09T04:43:00.957 INFO:teuthology.orchestra.run.smithi062.stdout:checking command to parse /usr/bin/nm -B output from gcc object... ok 2023-06-09T04:43:00.964 INFO:teuthology.orchestra.run.smithi062.stdout:checking for sysroot... no 2023-06-09T04:43:00.979 INFO:teuthology.orchestra.run.smithi062.stdout:checking for a working dd... /usr/bin/dd 2023-06-09T04:43:00.997 INFO:teuthology.orchestra.run.smithi062.stdout:checking how to truncate binary pipes... /usr/bin/dd bs=4096 count=1 2023-06-09T04:43:01.050 INFO:teuthology.orchestra.run.smithi062.stdout:checking for mt... mt 2023-06-09T04:43:01.076 INFO:teuthology.orchestra.run.smithi062.stdout:checking if mt is a manifest tool... no 2023-06-09T04:43:01.186 INFO:teuthology.orchestra.run.smithi062.stdout:checking how to run the C preprocessor... gcc -E 2023-06-09T04:43:01.558 INFO:teuthology.orchestra.run.smithi062.stdout:checking for ANSI C header files... yes 2023-06-09T04:43:01.640 INFO:teuthology.orchestra.run.smithi062.stdout:checking for sys/types.h... yes 2023-06-09T04:43:01.744 INFO:teuthology.orchestra.run.smithi062.stdout:checking for sys/stat.h... yes 2023-06-09T04:43:01.842 INFO:teuthology.orchestra.run.smithi062.stdout:checking for stdlib.h... yes 2023-06-09T04:43:01.944 INFO:teuthology.orchestra.run.smithi062.stdout:checking for string.h... yes 2023-06-09T04:43:02.055 INFO:teuthology.orchestra.run.smithi062.stdout:checking for memory.h... yes 2023-06-09T04:43:02.155 INFO:teuthology.orchestra.run.smithi062.stdout:checking for strings.h... yes 2023-06-09T04:43:02.257 INFO:teuthology.orchestra.run.smithi062.stdout:checking for inttypes.h... yes 2023-06-09T04:43:02.359 INFO:teuthology.orchestra.run.smithi062.stdout:checking for stdint.h... yes 2023-06-09T04:43:02.490 INFO:teuthology.orchestra.run.smithi062.stdout:checking for unistd.h... yes 2023-06-09T04:43:02.585 INFO:teuthology.orchestra.run.smithi062.stdout:checking for dlfcn.h... yes 2023-06-09T04:43:02.605 INFO:teuthology.orchestra.run.smithi062.stdout:checking for objdir... .libs 2023-06-09T04:43:02.845 INFO:teuthology.orchestra.run.smithi062.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-06-09T04:43:02.846 INFO:teuthology.orchestra.run.smithi062.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-06-09T04:43:02.923 INFO:teuthology.orchestra.run.smithi062.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-06-09T04:43:03.131 INFO:teuthology.orchestra.run.smithi062.stdout:checking if gcc static flag -static works... yes 2023-06-09T04:43:03.236 INFO:teuthology.orchestra.run.smithi062.stdout:checking if gcc supports -c -o file.o... yes 2023-06-09T04:43:03.236 INFO:teuthology.orchestra.run.smithi062.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-06-09T04:43:03.269 INFO:teuthology.orchestra.run.smithi062.stdout:checking whether the gcc linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-06-09T04:43:03.350 INFO:teuthology.orchestra.run.smithi062.stdout:checking whether -lc should be explicitly linked in... no 2023-06-09T04:43:03.514 INFO:teuthology.orchestra.run.smithi062.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-06-09T04:43:03.515 INFO:teuthology.orchestra.run.smithi062.stdout:checking how to hardcode library paths into programs... immediate 2023-06-09T04:43:03.529 INFO:teuthology.orchestra.run.smithi062.stdout:checking whether stripping libraries is possible... yes 2023-06-09T04:43:03.530 INFO:teuthology.orchestra.run.smithi062.stdout:checking if libtool supports shared libraries... yes 2023-06-09T04:43:03.530 INFO:teuthology.orchestra.run.smithi062.stdout:checking whether to build shared libraries... yes 2023-06-09T04:43:03.531 INFO:teuthology.orchestra.run.smithi062.stdout:checking whether to build static libraries... yes 2023-06-09T04:43:03.567 INFO:teuthology.orchestra.run.smithi062.stdout:checking for gcc... (cached) gcc 2023-06-09T04:43:03.642 INFO:teuthology.orchestra.run.smithi062.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-06-09T04:43:03.643 INFO:teuthology.orchestra.run.smithi062.stdout:checking whether gcc accepts -g... (cached) yes 2023-06-09T04:43:03.644 INFO:teuthology.orchestra.run.smithi062.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-06-09T04:43:03.645 INFO:teuthology.orchestra.run.smithi062.stdout:checking for gmake... no 2023-06-09T04:43:03.646 INFO:teuthology.orchestra.run.smithi062.stdout:checking for make... /usr/bin/make 2023-06-09T04:43:03.647 INFO:teuthology.orchestra.run.smithi062.stderr:./configure: line 8824: test: $(SHELL): binary operator expected 2023-06-09T04:43:03.648 INFO:teuthology.orchestra.run.smithi062.stdout:checking for tar... /bin/tar 2023-06-09T04:43:03.649 INFO:teuthology.orchestra.run.smithi062.stdout:checking for gzip... /bin/gzip 2023-06-09T04:43:03.678 INFO:teuthology.orchestra.run.smithi062.stdout:checking whether gcc -MM is supported... yes 2023-06-09T04:43:03.680 INFO:teuthology.orchestra.run.smithi062.stdout:checking for sort... /bin/sort 2023-06-09T04:43:03.681 INFO:teuthology.orchestra.run.smithi062.stdout:checking whether ln -s works... yes 2023-06-09T04:43:03.683 INFO:teuthology.orchestra.run.smithi062.stdout:checking for rpm... no 2023-06-09T04:43:03.771 INFO:teuthology.orchestra.run.smithi062.stdout:checking assert.h usability... yes 2023-06-09T04:43:03.800 INFO:teuthology.orchestra.run.smithi062.stdout:checking assert.h presence... yes 2023-06-09T04:43:03.801 INFO:teuthology.orchestra.run.smithi062.stdout:checking for assert.h... yes 2023-06-09T04:43:03.908 INFO:teuthology.orchestra.run.smithi062.stdout:checking bstring.h usability... no 2023-06-09T04:43:03.952 INFO:teuthology.orchestra.run.smithi062.stdout:checking bstring.h presence... no 2023-06-09T04:43:03.953 INFO:teuthology.orchestra.run.smithi062.stdout:checking for bstring.h... no 2023-06-09T04:43:04.043 INFO:teuthology.orchestra.run.smithi062.stdout:checking libgen.h usability... yes 2023-06-09T04:43:04.074 INFO:teuthology.orchestra.run.smithi062.stdout:checking libgen.h presence... yes 2023-06-09T04:43:04.075 INFO:teuthology.orchestra.run.smithi062.stdout:checking for libgen.h... yes 2023-06-09T04:43:04.182 INFO:teuthology.orchestra.run.smithi062.stdout:checking dirent.h usability... yes 2023-06-09T04:43:04.211 INFO:teuthology.orchestra.run.smithi062.stdout:checking dirent.h presence... yes 2023-06-09T04:43:04.211 INFO:teuthology.orchestra.run.smithi062.stdout:checking for dirent.h... yes 2023-06-09T04:43:04.356 INFO:teuthology.orchestra.run.smithi062.stdout:checking errno.h usability... yes 2023-06-09T04:43:04.387 INFO:teuthology.orchestra.run.smithi062.stdout:checking errno.h presence... yes 2023-06-09T04:43:04.387 INFO:teuthology.orchestra.run.smithi062.stdout:checking for errno.h... yes 2023-06-09T04:43:04.492 INFO:teuthology.orchestra.run.smithi062.stdout:checking malloc.h usability... yes 2023-06-09T04:43:04.529 INFO:teuthology.orchestra.run.smithi062.stdout:checking malloc.h presence... yes 2023-06-09T04:43:04.529 INFO:teuthology.orchestra.run.smithi062.stdout:checking for malloc.h... yes 2023-06-09T04:43:04.632 INFO:teuthology.orchestra.run.smithi062.stdout:checking uuid.h usability... no 2023-06-09T04:43:04.682 INFO:teuthology.orchestra.run.smithi062.stdout:checking uuid.h presence... no 2023-06-09T04:43:04.682 INFO:teuthology.orchestra.run.smithi062.stdout:checking for uuid.h... no 2023-06-09T04:43:04.799 INFO:teuthology.orchestra.run.smithi062.stdout:checking uuid/uuid.h usability... yes 2023-06-09T04:43:04.836 INFO:teuthology.orchestra.run.smithi062.stdout:checking uuid/uuid.h presence... yes 2023-06-09T04:43:04.837 INFO:teuthology.orchestra.run.smithi062.stdout:checking for uuid/uuid.h... yes 2023-06-09T04:43:04.955 INFO:teuthology.orchestra.run.smithi062.stdout:checking sys/uuid.h usability... no 2023-06-09T04:43:05.005 INFO:teuthology.orchestra.run.smithi062.stdout:checking sys/uuid.h presence... no 2023-06-09T04:43:05.005 INFO:teuthology.orchestra.run.smithi062.stdout:checking for sys/uuid.h... no 2023-06-09T04:43:05.109 INFO:teuthology.orchestra.run.smithi062.stdout:checking sys/file.h usability... yes 2023-06-09T04:43:05.142 INFO:teuthology.orchestra.run.smithi062.stdout:checking sys/file.h presence... yes 2023-06-09T04:43:05.143 INFO:teuthology.orchestra.run.smithi062.stdout:checking for sys/file.h... yes 2023-06-09T04:43:05.250 INFO:teuthology.orchestra.run.smithi062.stdout:checking sys/fcntl.h usability... yes 2023-06-09T04:43:05.281 INFO:teuthology.orchestra.run.smithi062.stdout:checking sys/fcntl.h presence... yes 2023-06-09T04:43:05.282 INFO:teuthology.orchestra.run.smithi062.stdout:checking for sys/fcntl.h... yes 2023-06-09T04:43:05.390 INFO:teuthology.orchestra.run.smithi062.stdout:checking sys/syssgi.h usability... no 2023-06-09T04:43:05.440 INFO:teuthology.orchestra.run.smithi062.stdout:checking sys/syssgi.h presence... no 2023-06-09T04:43:05.440 INFO:teuthology.orchestra.run.smithi062.stdout:checking for sys/syssgi.h... no 2023-06-09T04:43:05.577 INFO:teuthology.orchestra.run.smithi062.stdout:checking sys/param.h usability... yes 2023-06-09T04:43:05.612 INFO:teuthology.orchestra.run.smithi062.stdout:checking sys/param.h presence... yes 2023-06-09T04:43:05.612 INFO:teuthology.orchestra.run.smithi062.stdout:checking for sys/param.h... yes 2023-06-09T04:43:05.639 INFO:teuthology.orchestra.run.smithi062.stdout:checking for sys/stat.h... (cached) yes 2023-06-09T04:43:05.740 INFO:teuthology.orchestra.run.smithi062.stdout:checking sys/statvfs.h usability... yes 2023-06-09T04:43:05.772 INFO:teuthology.orchestra.run.smithi062.stdout:checking sys/statvfs.h presence... yes 2023-06-09T04:43:05.772 INFO:teuthology.orchestra.run.smithi062.stdout:checking for sys/statvfs.h... yes 2023-06-09T04:43:05.883 INFO:teuthology.orchestra.run.smithi062.stdout:checking sys/time.h usability... yes 2023-06-09T04:43:05.917 INFO:teuthology.orchestra.run.smithi062.stdout:checking sys/time.h presence... yes 2023-06-09T04:43:05.917 INFO:teuthology.orchestra.run.smithi062.stdout:checking for sys/time.h... yes 2023-06-09T04:43:06.025 INFO:teuthology.orchestra.run.smithi062.stdout:checking sys/ioctl.h usability... yes 2023-06-09T04:43:06.055 INFO:teuthology.orchestra.run.smithi062.stdout:checking sys/ioctl.h presence... yes 2023-06-09T04:43:06.056 INFO:teuthology.orchestra.run.smithi062.stdout:checking for sys/ioctl.h... yes 2023-06-09T04:43:06.163 INFO:teuthology.orchestra.run.smithi062.stdout:checking sys/wait.h usability... yes 2023-06-09T04:43:06.199 INFO:teuthology.orchestra.run.smithi062.stdout:checking sys/wait.h presence... yes 2023-06-09T04:43:06.200 INFO:teuthology.orchestra.run.smithi062.stdout:checking for sys/wait.h... yes 2023-06-09T04:43:06.229 INFO:teuthology.orchestra.run.smithi062.stdout:checking for sys/types.h... (cached) yes 2023-06-09T04:43:06.259 INFO:teuthology.orchestra.run.smithi062.stdout:checking for strings.h... (cached) yes 2023-06-09T04:43:06.364 INFO:teuthology.orchestra.run.smithi062.stdout:checking err.h usability... yes 2023-06-09T04:43:06.393 INFO:teuthology.orchestra.run.smithi062.stdout:checking err.h presence... yes 2023-06-09T04:43:06.393 INFO:teuthology.orchestra.run.smithi062.stdout:checking for err.h... yes 2023-06-09T04:43:06.505 INFO:teuthology.orchestra.run.smithi062.stdout:checking linux/falloc.h usability... yes 2023-06-09T04:43:06.536 INFO:teuthology.orchestra.run.smithi062.stdout:checking linux/falloc.h presence... yes 2023-06-09T04:43:06.536 INFO:teuthology.orchestra.run.smithi062.stdout:checking for linux/falloc.h... yes 2023-06-09T04:43:06.638 INFO:teuthology.orchestra.run.smithi062.stdout:checking sys/fs/xfs_fsops.h usability... no 2023-06-09T04:43:06.690 INFO:teuthology.orchestra.run.smithi062.stdout:checking sys/fs/xfs_fsops.h presence... no 2023-06-09T04:43:06.691 INFO:teuthology.orchestra.run.smithi062.stdout:checking for sys/fs/xfs_fsops.h... no 2023-06-09T04:43:06.782 INFO:teuthology.orchestra.run.smithi062.stdout:checking sys/fs/xfs_itable.h usability... no 2023-06-09T04:43:06.830 INFO:teuthology.orchestra.run.smithi062.stdout:checking sys/fs/xfs_itable.h presence... no 2023-06-09T04:43:06.830 INFO:teuthology.orchestra.run.smithi062.stdout:checking for sys/fs/xfs_itable.h... no 2023-06-09T04:43:06.928 INFO:teuthology.orchestra.run.smithi062.stdout:checking xfs/platform_defs.h usability... no 2023-06-09T04:43:06.979 INFO:teuthology.orchestra.run.smithi062.stdout:checking xfs/platform_defs.h presence... no 2023-06-09T04:43:06.980 INFO:teuthology.orchestra.run.smithi062.stdout:checking for xfs/platform_defs.h... no 2023-06-09T04:43:07.071 INFO:teuthology.orchestra.run.smithi062.stdout:checking btrfs/ioctl.h usability... no 2023-06-09T04:43:07.120 INFO:teuthology.orchestra.run.smithi062.stdout:checking btrfs/ioctl.h presence... no 2023-06-09T04:43:07.120 INFO:teuthology.orchestra.run.smithi062.stdout:checking for btrfs/ioctl.h... no 2023-06-09T04:43:07.214 INFO:teuthology.orchestra.run.smithi062.stdout:checking cifs/ioctl.h usability... no 2023-06-09T04:43:07.259 INFO:teuthology.orchestra.run.smithi062.stdout:checking cifs/ioctl.h presence... no 2023-06-09T04:43:07.260 INFO:teuthology.orchestra.run.smithi062.stdout:checking for cifs/ioctl.h... no 2023-06-09T04:43:07.359 INFO:teuthology.orchestra.run.smithi062.stdout:checking sys/mman.h usability... yes 2023-06-09T04:43:07.392 INFO:teuthology.orchestra.run.smithi062.stdout:checking sys/mman.h presence... yes 2023-06-09T04:43:07.393 INFO:teuthology.orchestra.run.smithi062.stdout:checking for sys/mman.h... yes 2023-06-09T04:43:07.463 INFO:teuthology.orchestra.run.smithi062.stdout:checking for xfs/xfs_log_format.h... no 2023-06-09T04:43:07.583 INFO:teuthology.orchestra.run.smithi062.stdout:checking for uuid_compare... no 2023-06-09T04:43:07.681 INFO:teuthology.orchestra.run.smithi062.stdout:checking for uuid_compare in -luuid... yes 2023-06-09T04:43:07.831 INFO:teuthology.orchestra.run.smithi062.stdout:checking for xfs/xfs.h... yes 2023-06-09T04:43:07.892 INFO:teuthology.orchestra.run.smithi062.stdout:checking for xfs/libxfs.h... no 2023-06-09T04:43:07.969 INFO:teuthology.orchestra.run.smithi062.stdout:checking whether xlog_assign_lsn is declared... no 2023-06-09T04:43:08.056 INFO:teuthology.orchestra.run.smithi062.stdout:checking for xfs/xqm.h... yes 2023-06-09T04:43:08.185 INFO:teuthology.orchestra.run.smithi062.stdout:checking xfsctl from xfs/xfs.h... ok 2023-06-09T04:43:08.270 INFO:teuthology.orchestra.run.smithi062.stdout:checking xfs/handle.h usability... yes 2023-06-09T04:43:08.300 INFO:teuthology.orchestra.run.smithi062.stdout:checking xfs/handle.h presence... yes 2023-06-09T04:43:08.300 INFO:teuthology.orchestra.run.smithi062.stdout:checking for xfs/handle.h... yes 2023-06-09T04:43:08.411 INFO:teuthology.orchestra.run.smithi062.stdout:checking for attr_list_by_handle in -lhandle... yes 2023-06-09T04:43:08.496 INFO:teuthology.orchestra.run.smithi062.stdout:checking sys/acl.h usability... yes 2023-06-09T04:43:08.527 INFO:teuthology.orchestra.run.smithi062.stdout:checking sys/acl.h presence... yes 2023-06-09T04:43:08.527 INFO:teuthology.orchestra.run.smithi062.stdout:checking for sys/acl.h... yes 2023-06-09T04:43:08.619 INFO:teuthology.orchestra.run.smithi062.stdout:checking acl/libacl.h usability... yes 2023-06-09T04:43:08.652 INFO:teuthology.orchestra.run.smithi062.stdout:checking acl/libacl.h presence... yes 2023-06-09T04:43:08.652 INFO:teuthology.orchestra.run.smithi062.stdout:checking for acl/libacl.h... yes 2023-06-09T04:43:08.756 INFO:teuthology.orchestra.run.smithi062.stdout:checking for acl_init in -lacl... yes 2023-06-09T04:43:08.854 INFO:teuthology.orchestra.run.smithi062.stdout:checking gdbm-ndbm.h usability... no 2023-06-09T04:43:08.904 INFO:teuthology.orchestra.run.smithi062.stdout:checking gdbm-ndbm.h presence... no 2023-06-09T04:43:08.905 INFO:teuthology.orchestra.run.smithi062.stdout:checking for gdbm-ndbm.h... no 2023-06-09T04:43:08.989 INFO:teuthology.orchestra.run.smithi062.stdout:checking gdbm/ndbm.h usability... no 2023-06-09T04:43:09.041 INFO:teuthology.orchestra.run.smithi062.stdout:checking gdbm/ndbm.h presence... no 2023-06-09T04:43:09.041 INFO:teuthology.orchestra.run.smithi062.stdout:checking for gdbm/ndbm.h... no 2023-06-09T04:43:09.124 INFO:teuthology.orchestra.run.smithi062.stdout:checking ndbm.h usability... no 2023-06-09T04:43:09.177 INFO:teuthology.orchestra.run.smithi062.stdout:checking ndbm.h presence... no 2023-06-09T04:43:09.177 INFO:teuthology.orchestra.run.smithi062.stdout:checking for ndbm.h... no 2023-06-09T04:43:09.262 INFO:teuthology.orchestra.run.smithi062.stdout:checking libaio.h usability... yes 2023-06-09T04:43:09.300 INFO:teuthology.orchestra.run.smithi062.stdout:checking libaio.h presence... yes 2023-06-09T04:43:09.301 INFO:teuthology.orchestra.run.smithi062.stdout:checking for libaio.h... yes 2023-06-09T04:43:09.385 INFO:teuthology.orchestra.run.smithi062.stdout:checking liburing.h usability... no 2023-06-09T04:43:09.432 INFO:teuthology.orchestra.run.smithi062.stdout:checking liburing.h presence... no 2023-06-09T04:43:09.433 INFO:teuthology.orchestra.run.smithi062.stdout:checking for liburing.h... no 2023-06-09T04:43:09.514 INFO:teuthology.orchestra.run.smithi062.stdout:checking sys/capability.h usability... no 2023-06-09T04:43:09.564 INFO:teuthology.orchestra.run.smithi062.stdout:checking sys/capability.h presence... no 2023-06-09T04:43:09.564 INFO:teuthology.orchestra.run.smithi062.stdout:checking for sys/capability.h... no 2023-06-09T04:43:09.652 INFO:teuthology.orchestra.run.smithi062.stdout:checking linux/fiemap.h usability... yes 2023-06-09T04:43:09.683 INFO:teuthology.orchestra.run.smithi062.stdout:checking linux/fiemap.h presence... yes 2023-06-09T04:43:09.683 INFO:teuthology.orchestra.run.smithi062.stdout:checking for linux/fiemap.h... yes 2023-06-09T04:43:09.789 INFO:teuthology.orchestra.run.smithi062.stdout:checking for fallocate... yes 2023-06-09T04:43:09.889 INFO:teuthology.orchestra.run.smithi062.stdout:checking for open_by_handle_at... yes 2023-06-09T04:43:09.967 INFO:teuthology.orchestra.run.smithi062.stdout:checking sys/prctl.h usability... yes 2023-06-09T04:43:09.997 INFO:teuthology.orchestra.run.smithi062.stdout:checking sys/prctl.h presence... yes 2023-06-09T04:43:09.997 INFO:teuthology.orchestra.run.smithi062.stdout:checking for sys/prctl.h... yes 2023-06-09T04:43:10.083 INFO:teuthology.orchestra.run.smithi062.stdout:checking linux/fs.h usability... yes 2023-06-09T04:43:10.115 INFO:teuthology.orchestra.run.smithi062.stdout:checking linux/fs.h presence... yes 2023-06-09T04:43:10.115 INFO:teuthology.orchestra.run.smithi062.stdout:checking for linux/fs.h... yes 2023-06-09T04:43:10.198 INFO:teuthology.orchestra.run.smithi062.stdout:checking btrfsutil.h usability... no 2023-06-09T04:43:10.246 INFO:teuthology.orchestra.run.smithi062.stdout:checking btrfsutil.h presence... no 2023-06-09T04:43:10.247 INFO:teuthology.orchestra.run.smithi062.stdout:checking for btrfsutil.h... no 2023-06-09T04:43:10.349 INFO:teuthology.orchestra.run.smithi062.stdout:checking for copy_file_range... yes 2023-06-09T04:43:10.446 INFO:teuthology.orchestra.run.smithi062.stdout:checking for SEEK_DATA... yes 2023-06-09T04:43:10.570 INFO:teuthology.orchestra.run.smithi062.stdout:checking for BMV_OF_SHARED... yes 2023-06-09T04:43:10.672 INFO:teuthology.orchestra.run.smithi062.stdout:checking for nftw... yes 2023-06-09T04:43:10.778 INFO:teuthology.orchestra.run.smithi062.stdout:checking for RLIMIT_NOFILE... yes 2023-06-09T04:43:10.857 INFO:teuthology.orchestra.run.smithi062.stdout:checking for FIEXCHANGE_RANGE... no 2023-06-09T04:43:10.965 INFO:teuthology.orchestra.run.smithi062.stdout:checking for renameat2... yes 2023-06-09T04:43:11.067 INFO:teuthology.orchestra.run.smithi062.stdout:checking for reallocarray... yes 2023-06-09T04:43:11.133 INFO:teuthology.orchestra.run.smithi062.stdout:checking for struct mount_attr... no 2023-06-09T04:43:11.272 INFO:teuthology.orchestra.run.smithi062.stdout:checking for struct btrfs_qgroup_limit... yes 2023-06-09T04:43:11.395 INFO:teuthology.orchestra.run.smithi062.stdout:checking for struct btrfs_qgroup_inherit... yes 2023-06-09T04:43:11.509 INFO:teuthology.orchestra.run.smithi062.stdout:checking for struct btrfs_ioctl_vol_args... yes 2023-06-09T04:43:11.627 INFO:teuthology.orchestra.run.smithi062.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2023-06-09T04:43:11.757 INFO:teuthology.orchestra.run.smithi062.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2023-06-09T04:43:11.888 INFO:teuthology.orchestra.run.smithi062.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2023-06-09T04:43:12.017 INFO:teuthology.orchestra.run.smithi062.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2023-06-09T04:43:12.110 INFO:teuthology.orchestra.run.smithi062.stdout:checking linux/btrfs.h usability... yes 2023-06-09T04:43:12.141 INFO:teuthology.orchestra.run.smithi062.stdout:checking linux/btrfs.h presence... yes 2023-06-09T04:43:12.141 INFO:teuthology.orchestra.run.smithi062.stdout:checking for linux/btrfs.h... yes 2023-06-09T04:43:12.250 INFO:teuthology.orchestra.run.smithi062.stdout:checking linux/btrfs_tree.h usability... yes 2023-06-09T04:43:12.281 INFO:teuthology.orchestra.run.smithi062.stdout:checking linux/btrfs_tree.h presence... yes 2023-06-09T04:43:12.281 INFO:teuthology.orchestra.run.smithi062.stdout:checking for linux/btrfs_tree.h... yes 2023-06-09T04:43:12.420 INFO:teuthology.orchestra.run.smithi062.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... no 2023-06-09T04:43:12.475 INFO:teuthology.orchestra.run.smithi062.stdout:configure: creating ./config.status 2023-06-09T04:43:14.409 INFO:teuthology.orchestra.run.smithi062.stdout:config.status: creating include/builddefs 2023-06-09T04:43:14.476 INFO:teuthology.orchestra.run.smithi062.stdout:config.status: creating include/config.h 2023-06-09T04:43:14.523 INFO:teuthology.orchestra.run.smithi062.stdout:config.status: executing libtool commands 2023-06-09T04:43:14.680 INFO:teuthology.orchestra.run.smithi062.stdout:Building include 2023-06-09T04:43:14.695 INFO:teuthology.orchestra.run.smithi062.stdout:Building lib 2023-06-09T04:43:14.706 INFO:teuthology.orchestra.run.smithi062.stdout: [LTDEP] 2023-06-09T04:43:15.025 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] dataascii.lo 2023-06-09T04:43:15.330 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] databin.lo 2023-06-09T04:43:15.656 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] datapid.lo 2023-06-09T04:43:15.937 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] file_lock.lo 2023-06-09T04:43:16.285 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] forker.lo 2023-06-09T04:43:16.614 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] pattern.lo 2023-06-09T04:43:16.919 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] open_flags.lo 2023-06-09T04:43:17.242 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] random_range.lo 2023-06-09T04:43:17.673 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] string_to_tokens.lo 2023-06-09T04:43:17.962 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] str_to_bytes.lo 2023-06-09T04:43:18.272 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] tlibio.lo 2023-06-09T04:43:18.722 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] write_log.lo 2023-06-09T04:43:18.904 INFO:teuthology.orchestra.run.smithi062.stderr:write_log.c: In function 'wlog_record_write': 2023-06-09T04:43:18.905 INFO:teuthology.orchestra.run.smithi062.stderr:write_log.c:205:6: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:43:18.905 INFO:teuthology.orchestra.run.smithi062.stderr: 205 | write(wfile->w_afd, wbuf, reclen); 2023-06-09T04:43:18.905 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:43:18.905 INFO:teuthology.orchestra.run.smithi062.stderr:write_log.c:209:6: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:43:18.905 INFO:teuthology.orchestra.run.smithi062.stderr: 209 | write(wfile->w_rfd, wbuf, reclen); 2023-06-09T04:43:18.905 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:43:19.152 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] random.lo 2023-06-09T04:43:19.431 INFO:teuthology.orchestra.run.smithi062.stdout: [LD] 2023-06-09T04:43:19.680 INFO:teuthology.orchestra.run.smithi062.stdout:Building ltp 2023-06-09T04:43:19.692 INFO:teuthology.orchestra.run.smithi062.stdout: [DEP] 2023-06-09T04:43:19.955 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] doio 2023-06-09T04:43:20.989 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] fsstress 2023-06-09T04:43:21.097 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:43:21.103 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:43:22.782 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] fsx 2023-06-09T04:43:24.046 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] growfiles 2023-06-09T04:43:24.914 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] iogen 2023-06-09T04:43:25.264 INFO:teuthology.orchestra.run.smithi062.stderr:iogen.c: In function 'main': 2023-06-09T04:43:25.264 INFO:teuthology.orchestra.run.smithi062.stderr:iogen.c:280:2: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:43:25.264 INFO:teuthology.orchestra.run.smithi062.stderr: 280 | write(outfd, (char *)&req, sizeof(req)); 2023-06-09T04:43:25.264 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:43:25.270 INFO:teuthology.orchestra.run.smithi062.stderr:iogen.c: In function 'parse_cmdline': 2023-06-09T04:43:25.270 INFO:teuthology.orchestra.run.smithi062.stderr:iogen.c:1535:10: warning: ignoring return value of 'getcwd', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:43:25.270 INFO:teuthology.orchestra.run.smithi062.stderr: 1535 | getcwd(fptr->f_path, 2023-06-09T04:43:25.270 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:43:25.270 INFO:teuthology.orchestra.run.smithi062.stderr: 1536 | sizeof(fptr->f_path)-1); 2023-06-09T04:43:25.270 INFO:teuthology.orchestra.run.smithi062.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:43:25.596 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] aio-stress 2023-06-09T04:43:25.937 INFO:teuthology.orchestra.run.smithi062.stderr:aio-stress.c: In function 'setup_shared_mem': 2023-06-09T04:43:25.937 INFO:teuthology.orchestra.run.smithi062.stderr:aio-stress.c:1013:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:43:25.937 INFO:teuthology.orchestra.run.smithi062.stderr: 1013 | ftruncate(fd, total_ram); 2023-06-09T04:43:25.938 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:43:26.335 INFO:teuthology.orchestra.run.smithi062.stdout:Building src 2023-06-09T04:43:26.352 INFO:teuthology.orchestra.run.smithi062.stdout: [DEP] 2023-06-09T04:43:29.994 INFO:teuthology.orchestra.run.smithi062.stdout: [DEP] 2023-06-09T04:43:30.079 INFO:teuthology.orchestra.run.smithi062.stdout: [DEP] 2023-06-09T04:43:30.115 INFO:teuthology.orchestra.run.smithi062.stdout: [DEP] 2023-06-09T04:43:30.616 INFO:teuthology.orchestra.run.smithi062.stdout: [DEP] 2023-06-09T04:43:30.697 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] dirstress 2023-06-09T04:43:31.211 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] fill 2023-06-09T04:43:31.605 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] fill2 2023-06-09T04:43:32.105 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] getpagesize 2023-06-09T04:43:32.475 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] holes 2023-06-09T04:43:32.933 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] lstat64 2023-06-09T04:43:33.380 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] nametest 2023-06-09T04:43:33.727 INFO:teuthology.orchestra.run.smithi062.stderr:nametest.c: In function 'main': 2023-06-09T04:43:33.728 INFO:teuthology.orchestra.run.smithi062.stderr:nametest.c:236:5: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:43:33.728 INFO:teuthology.orchestra.run.smithi062.stderr: 236 | write(1, "\n", 1); 2023-06-09T04:43:33.728 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~ 2023-06-09T04:43:33.728 INFO:teuthology.orchestra.run.smithi062.stderr:nametest.c:238:4: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:43:33.728 INFO:teuthology.orchestra.run.smithi062.stderr: 238 | write(1, ".", 1); 2023-06-09T04:43:33.728 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~ 2023-06-09T04:43:33.729 INFO:teuthology.orchestra.run.smithi062.stderr:nametest.c:288:5: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:43:33.729 INFO:teuthology.orchestra.run.smithi062.stderr: 288 | write(1, ".", 1); 2023-06-09T04:43:33.729 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~ 2023-06-09T04:43:33.899 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] permname 2023-06-09T04:43:34.363 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] randholes 2023-06-09T04:43:34.894 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] runas 2023-06-09T04:43:35.333 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] truncfile 2023-06-09T04:43:35.759 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] usemem 2023-06-09T04:43:36.160 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] mmapcat 2023-06-09T04:43:36.483 INFO:teuthology.orchestra.run.smithi062.stderr:mmapcat.c: In function 'main': 2023-06-09T04:43:36.484 INFO:teuthology.orchestra.run.smithi062.stderr:mmapcat.c:29:2: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:43:36.484 INFO:teuthology.orchestra.run.smithi062.stderr: 29 | write(1,ptr2,ptr - ptr2); 2023-06-09T04:43:36.484 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:43:36.557 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] append_reader 2023-06-09T04:43:36.967 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] append_writer 2023-06-09T04:43:37.368 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] dirperf 2023-06-09T04:43:37.852 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] metaperf 2023-06-09T04:43:38.185 INFO:teuthology.orchestra.run.smithi062.stderr:metaperf.c: In function 'crfiles': 2023-06-09T04:43:38.185 INFO:teuthology.orchestra.run.smithi062.stderr:metaperf.c:166:4: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:43:38.185 INFO:teuthology.orchestra.run.smithi062.stderr: 166 | write(fd, buf, fsize); 2023-06-09T04:43:38.186 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:43:38.186 INFO:teuthology.orchestra.run.smithi062.stderr:metaperf.c: In function 't_linkun': 2023-06-09T04:43:38.186 INFO:teuthology.orchestra.run.smithi062.stderr:metaperf.c:454:4: warning: ignoring return value of 'link', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:43:38.187 INFO:teuthology.orchestra.run.smithi062.stderr: 454 | link("a", *fnp); 2023-06-09T04:43:38.187 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~ 2023-06-09T04:43:38.187 INFO:teuthology.orchestra.run.smithi062.stderr:metaperf.c: In function 't_chown': 2023-06-09T04:43:38.187 INFO:teuthology.orchestra.run.smithi062.stderr:metaperf.c:404:5: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:43:38.187 INFO:teuthology.orchestra.run.smithi062.stderr: 404 | chown(*fnp, 2, -1); 2023-06-09T04:43:38.187 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-06-09T04:43:38.187 INFO:teuthology.orchestra.run.smithi062.stderr:metaperf.c:406:5: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:43:38.188 INFO:teuthology.orchestra.run.smithi062.stderr: 406 | chown(*fnp, 1, -1); 2023-06-09T04:43:38.188 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-06-09T04:43:38.188 INFO:teuthology.orchestra.run.smithi062.stderr:metaperf.c: In function 'i_chown': 2023-06-09T04:43:38.188 INFO:teuthology.orchestra.run.smithi062.stderr:metaperf.c:291:3: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:43:38.188 INFO:teuthology.orchestra.run.smithi062.stderr: 291 | chown(*fnp, 1, -1); 2023-06-09T04:43:38.188 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-06-09T04:43:38.188 INFO:teuthology.orchestra.run.smithi062.stderr:metaperf.c: In function 'main': 2023-06-09T04:43:38.189 INFO:teuthology.orchestra.run.smithi062.stderr:metaperf.c:152:2: warning: ignoring return value of 'chdir', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:43:38.189 INFO:teuthology.orchestra.run.smithi062.stderr: 152 | chdir(".."); 2023-06-09T04:43:38.189 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~ 2023-06-09T04:43:38.380 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] devzero 2023-06-09T04:43:38.819 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] feature 2023-06-09T04:43:39.312 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] alloc 2023-06-09T04:43:39.653 INFO:teuthology.orchestra.run.smithi062.stderr:alloc.c: In function 'main': 2023-06-09T04:43:39.653 INFO:teuthology.orchestra.run.smithi062.stderr:alloc.c:247:3: warning: ignoring return value of 'mkstemp', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:43:39.653 INFO:teuthology.orchestra.run.smithi062.stderr: 247 | mkstemp(tmpfile); 2023-06-09T04:43:39.653 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~ 2023-06-09T04:43:39.789 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] fault 2023-06-09T04:43:40.206 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] fstest 2023-06-09T04:43:40.727 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] t_access_root 2023-06-09T04:43:41.042 INFO:teuthology.orchestra.run.smithi062.stderr:t_access_root.c: In function 'main': 2023-06-09T04:43:41.042 INFO:teuthology.orchestra.run.smithi062.stderr:t_access_root.c:55:5: warning: ignoring return value of 'system', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:43:41.042 INFO:teuthology.orchestra.run.smithi062.stderr: 55 | system(cmd); 2023-06-09T04:43:41.042 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~ 2023-06-09T04:43:41.124 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] godown 2023-06-09T04:43:41.552 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] resvtest 2023-06-09T04:43:42.020 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] writemod 2023-06-09T04:43:42.431 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] writev_on_pagefault 2023-06-09T04:43:42.875 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] makeextents 2023-06-09T04:43:43.322 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] itrash 2023-06-09T04:43:43.724 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] rename 2023-06-09T04:43:44.105 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] multi_open_unlink 2023-06-09T04:43:44.530 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] unwritten_sync 2023-06-09T04:43:44.975 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] genhashnames 2023-06-09T04:43:45.412 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] t_holes 2023-06-09T04:43:45.801 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] t_mmap_writev 2023-06-09T04:43:46.205 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] t_truncate_cmtime 2023-06-09T04:43:46.616 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] dirhash_collide 2023-06-09T04:43:47.067 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] t_rename_overwrite 2023-06-09T04:43:47.449 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] holetest 2023-06-09T04:43:47.787 INFO:teuthology.orchestra.run.smithi062.stderr:holetest.c: In function 'pt_write_marker': 2023-06-09T04:43:47.787 INFO:teuthology.orchestra.run.smithi062.stderr:holetest.c:140:3: warning: ignoring return value of 'pwrite', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:43:47.788 INFO:teuthology.orchestra.run.smithi062.stderr: 140 | pwrite(fd, &tid, sizeof(tid), i * page_size + pgoff); 2023-06-09T04:43:47.788 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:43:47.951 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] t_truncate_self 2023-06-09T04:43:48.333 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] af_unix 2023-06-09T04:43:48.749 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] t_mmap_stale_pmd 2023-06-09T04:43:49.083 INFO:teuthology.orchestra.run.smithi062.stderr:t_mmap_stale_pmd.c: In function 'main': 2023-06-09T04:43:49.083 INFO:teuthology.orchestra.run.smithi062.stderr:t_mmap_stale_pmd.c:42:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:43:49.083 INFO:teuthology.orchestra.run.smithi062.stderr: 42 | ftruncate(fd, 0); 2023-06-09T04:43:49.084 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~ 2023-06-09T04:43:49.084 INFO:teuthology.orchestra.run.smithi062.stderr:t_mmap_stale_pmd.c:43:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:43:49.084 INFO:teuthology.orchestra.run.smithi062.stderr: 43 | ftruncate(fd, MiB(4)); 2023-06-09T04:43:49.084 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:43:49.084 INFO:teuthology.orchestra.run.smithi062.stderr:t_mmap_stale_pmd.c:55:2: warning: ignoring return value of 'pwrite', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:43:49.084 INFO:teuthology.orchestra.run.smithi062.stderr: 55 | pwrite(fd, buffer, strlen(buffer), MiB(2)); 2023-06-09T04:43:49.084 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:43:49.158 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] t_mmap_cow_race 2023-06-09T04:43:49.494 INFO:teuthology.orchestra.run.smithi062.stderr:t_mmap_cow_race.c: In function 'main': 2023-06-09T04:43:49.494 INFO:teuthology.orchestra.run.smithi062.stderr:t_mmap_cow_race.c:61:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:43:49.494 INFO:teuthology.orchestra.run.smithi062.stderr: 61 | ftruncate(fd, 0); 2023-06-09T04:43:49.494 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~ 2023-06-09T04:43:49.494 INFO:teuthology.orchestra.run.smithi062.stderr:t_mmap_cow_race.c:62:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:43:49.495 INFO:teuthology.orchestra.run.smithi062.stderr: 62 | ftruncate(fd, MiB(2)); 2023-06-09T04:43:49.495 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:43:49.584 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] t_mmap_fallocate 2023-06-09T04:43:49.996 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] fsync-err 2023-06-09T04:43:50.412 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] t_mmap_write_ro 2023-06-09T04:43:50.788 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] t_ext4_dax_journal_corruption 2023-06-09T04:43:51.113 INFO:teuthology.orchestra.run.smithi062.stderr:t_ext4_dax_journal_corruption.c: In function 'main': 2023-06-09T04:43:51.113 INFO:teuthology.orchestra.run.smithi062.stderr:t_ext4_dax_journal_corruption.c:61:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:43:51.113 INFO:teuthology.orchestra.run.smithi062.stderr: 61 | ftruncate(fd, 0); 2023-06-09T04:43:51.114 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~ 2023-06-09T04:43:51.168 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:43:51.175 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:43:51.201 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] t_ext4_dax_inline_corruption 2023-06-09T04:43:51.600 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] t_ofd_locks 2023-06-09T04:43:52.058 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] t_mmap_collision 2023-06-09T04:43:52.517 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] mmap-write-concurrent 2023-06-09T04:43:52.948 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] t_get_file_time 2023-06-09T04:43:53.347 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] t_create_short_dirs 2023-06-09T04:43:53.775 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] t_create_long_dirs 2023-06-09T04:43:54.190 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] t_enospc 2023-06-09T04:43:54.639 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] t_mmap_writev_overlap 2023-06-09T04:43:55.063 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] checkpoint_journal 2023-06-09T04:43:55.456 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] mmap-rw-fault 2023-06-09T04:43:55.887 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] allocstale 2023-06-09T04:43:56.304 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] t_mmap_cow_memory_failure 2023-06-09T04:43:56.737 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] fake-dump-rootino 2023-06-09T04:43:57.142 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] dio-buf-fault 2023-06-09T04:43:57.550 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] xfsctl 2023-06-09T04:43:58.009 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] bstat 2023-06-09T04:43:58.482 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] t_mtab 2023-06-09T04:43:58.820 INFO:teuthology.orchestra.run.smithi062.stderr:t_mtab.c: In function 'update_mtab': 2023-06-09T04:43:58.820 INFO:teuthology.orchestra.run.smithi062.stderr:t_mtab.c:256:3: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:43:58.820 INFO:teuthology.orchestra.run.smithi062.stderr: 256 | chown (mounted_temp, sbuf.st_uid, sbuf.st_gid); 2023-06-09T04:43:58.820 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:43:58.940 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] getdevicesize 2023-06-09T04:43:59.333 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] preallo_rw_pattern_reader 2023-06-09T04:43:59.667 INFO:teuthology.orchestra.run.smithi062.stderr:In file included from preallo_rw_pattern_reader.c:2: 2023-06-09T04:43:59.667 INFO:teuthology.orchestra.run.smithi062.stderr:iopat.c: In function 'main': 2023-06-09T04:43:59.668 INFO:teuthology.orchestra.run.smithi062.stderr:iopat.c:38:4: warning: ignoring return value of 'read', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:43:59.668 INFO:teuthology.orchestra.run.smithi062.stderr: 38 | read(fd, &x, 1048576); 2023-06-09T04:43:59.668 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:43:59.745 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] preallo_rw_pattern_writer 2023-06-09T04:44:00.095 INFO:teuthology.orchestra.run.smithi062.stderr:In file included from preallo_rw_pattern_writer.c:2: 2023-06-09T04:44:00.095 INFO:teuthology.orchestra.run.smithi062.stderr:iopat.c: In function 'main': 2023-06-09T04:44:00.095 INFO:teuthology.orchestra.run.smithi062.stderr:iopat.c:34:4: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:00.096 INFO:teuthology.orchestra.run.smithi062.stderr: 34 | write(fd, &x, 1048576); 2023-06-09T04:44:00.096 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:00.167 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] ftrunc 2023-06-09T04:44:00.559 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] trunc 2023-06-09T04:44:00.977 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] fs_perms 2023-06-09T04:44:01.306 INFO:teuthology.orchestra.run.smithi062.stderr:fs_perms.c: In function 'main': 2023-06-09T04:44:01.307 INFO:teuthology.orchestra.run.smithi062.stderr:fs_perms.c:54:4: warning: ignoring return value of 'system', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:01.307 INFO:teuthology.orchestra.run.smithi062.stderr: 54 | system("rm -f test.file"); 2023-06-09T04:44:01.307 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:01.307 INFO:teuthology.orchestra.run.smithi062.stderr:fs_perms.c: In function 'testsetup': 2023-06-09T04:44:01.307 INFO:teuthology.orchestra.run.smithi062.stderr:fs_perms.c:67:4: warning: ignoring return value of 'system', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:01.307 INFO:teuthology.orchestra.run.smithi062.stderr: 67 | system("cp testx.file test.file"); 2023-06-09T04:44:01.307 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:01.308 INFO:teuthology.orchestra.run.smithi062.stderr:fs_perms.c:69:4: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:01.308 INFO:teuthology.orchestra.run.smithi062.stderr: 69 | chown("test.file",cuserId,cgroupId); 2023-06-09T04:44:01.308 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:01.308 INFO:teuthology.orchestra.run.smithi062.stderr:fs_perms.c: In function 'testfperm': 2023-06-09T04:44:01.308 INFO:teuthology.orchestra.run.smithi062.stderr:fs_perms.c:123:5: warning: ignoring return value of 'seteuid', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:01.308 INFO:teuthology.orchestra.run.smithi062.stderr: 123 | seteuid(0); 2023-06-09T04:44:01.308 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~ 2023-06-09T04:44:01.309 INFO:teuthology.orchestra.run.smithi062.stderr:fs_perms.c:124:5: warning: ignoring return value of 'setegid', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:01.309 INFO:teuthology.orchestra.run.smithi062.stderr: 124 | setegid(0); 2023-06-09T04:44:01.309 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~ 2023-06-09T04:44:01.399 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] testx 2023-06-09T04:44:01.769 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] looptest 2023-06-09T04:44:02.229 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] locktest 2023-06-09T04:44:02.843 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] unwritten_mmap 2023-06-09T04:44:03.261 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] bulkstat_unlink_test 2023-06-09T04:44:03.599 INFO:teuthology.orchestra.run.smithi062.stderr:bulkstat_unlink_test.c: In function 'main': 2023-06-09T04:44:03.599 INFO:teuthology.orchestra.run.smithi062.stderr:bulkstat_unlink_test.c:106:4: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:03.599 INFO:teuthology.orchestra.run.smithi062.stderr: 106 | write(fd[i], fname, sizeof(fname)); 2023-06-09T04:44:03.599 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:03.600 INFO:teuthology.orchestra.run.smithi062.stderr:bulkstat_unlink_test.c:178:3: warning: ignoring return value of 'system', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:03.600 INFO:teuthology.orchestra.run.smithi062.stderr: 178 | system(fname); 2023-06-09T04:44:03.600 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~ 2023-06-09T04:44:03.727 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] deduperace 2023-06-09T04:44:04.186 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] bulkstat_unlink_test_modified 2023-06-09T04:44:04.526 INFO:teuthology.orchestra.run.smithi062.stderr:bulkstat_unlink_test_modified.c: In function 'main': 2023-06-09T04:44:04.526 INFO:teuthology.orchestra.run.smithi062.stderr:bulkstat_unlink_test_modified.c:83:6: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:04.527 INFO:teuthology.orchestra.run.smithi062.stderr: 83 | write(fd, fname, sizeof(fname)); 2023-06-09T04:44:04.527 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:04.527 INFO:teuthology.orchestra.run.smithi062.stderr:bulkstat_unlink_test_modified.c:139:6: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:04.528 INFO:teuthology.orchestra.run.smithi062.stderr: 139 | write(fd, fname, sizeof(fname)); 2023-06-09T04:44:04.528 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:04.528 INFO:teuthology.orchestra.run.smithi062.stderr:bulkstat_unlink_test_modified.c:185:2: warning: ignoring return value of 'system', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:04.528 INFO:teuthology.orchestra.run.smithi062.stderr: 185 | system(fname); 2023-06-09T04:44:04.529 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~ 2023-06-09T04:44:04.648 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] t_dir_offset 2023-06-09T04:44:05.039 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] t_futimens 2023-06-09T04:44:05.420 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] t_immutable 2023-06-09T04:44:05.781 INFO:teuthology.orchestra.run.smithi062.stderr:t_immutable.c: In function 'create_test_area': 2023-06-09T04:44:05.781 INFO:teuthology.orchestra.run.smithi062.stderr:t_immutable.c:2061:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:05.781 INFO:teuthology.orchestra.run.smithi062.stderr: 2061 | asprintf(&path, "%s/immutable.d", dir); 2023-06-09T04:44:05.782 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:05.782 INFO:teuthology.orchestra.run.smithi062.stderr:t_immutable.c:2096:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:05.782 INFO:teuthology.orchestra.run.smithi062.stderr: 2096 | asprintf(&path, "%s/append-only.d", dir); 2023-06-09T04:44:05.782 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:05.783 INFO:teuthology.orchestra.run.smithi062.stderr:t_immutable.c: In function 'remove_test_area': 2023-06-09T04:44:05.783 INFO:teuthology.orchestra.run.smithi062.stderr:t_immutable.c:2152:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:05.783 INFO:teuthology.orchestra.run.smithi062.stderr: 2152 | asprintf(&path, "%s/immutable.d", dir); 2023-06-09T04:44:05.784 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:05.784 INFO:teuthology.orchestra.run.smithi062.stderr:t_immutable.c:2163:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:05.784 INFO:teuthology.orchestra.run.smithi062.stderr: 2163 | asprintf(&path, "%s/empty-immutable.d", dir); 2023-06-09T04:44:05.784 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:05.784 INFO:teuthology.orchestra.run.smithi062.stderr:t_immutable.c:2175:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:05.784 INFO:teuthology.orchestra.run.smithi062.stderr: 2175 | asprintf(&path, "%s/append-only.d", dir); 2023-06-09T04:44:05.784 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:05.785 INFO:teuthology.orchestra.run.smithi062.stderr:t_immutable.c:2186:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:05.785 INFO:teuthology.orchestra.run.smithi062.stderr: 2186 | asprintf(&path, "%s/empty-append-only.d", dir); 2023-06-09T04:44:05.785 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:05.785 INFO:teuthology.orchestra.run.smithi062.stderr:t_immutable.c:2197:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:05.785 INFO:teuthology.orchestra.run.smithi062.stderr: 2197 | asprintf(&path, "%s/append-only.f", dir); 2023-06-09T04:44:05.785 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:05.785 INFO:teuthology.orchestra.run.smithi062.stderr:t_immutable.c:2209:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:05.785 INFO:teuthology.orchestra.run.smithi062.stderr: 2209 | asprintf(&path, "%s/immutable.f", dir); 2023-06-09T04:44:05.786 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:05.786 INFO:teuthology.orchestra.run.smithi062.stderr:t_immutable.c: In function 'check_test_area': 2023-06-09T04:44:05.786 INFO:teuthology.orchestra.run.smithi062.stderr:t_immutable.c:1788:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:05.786 INFO:teuthology.orchestra.run.smithi062.stderr: 1788 | asprintf(&path, "%s/", dir); 2023-06-09T04:44:05.786 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:05.786 INFO:teuthology.orchestra.run.smithi062.stderr:t_immutable.c:1800:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:05.786 INFO:teuthology.orchestra.run.smithi062.stderr: 1800 | asprintf(&path, "%s/immutable.f", dir); 2023-06-09T04:44:05.786 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:05.787 INFO:teuthology.orchestra.run.smithi062.stderr:t_immutable.c:1812:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:05.787 INFO:teuthology.orchestra.run.smithi062.stderr: 1812 | asprintf(&path, "%s/append-only.f", dir); 2023-06-09T04:44:05.787 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:05.787 INFO:teuthology.orchestra.run.smithi062.stderr:t_immutable.c:1824:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:05.787 INFO:teuthology.orchestra.run.smithi062.stderr: 1824 | asprintf(&path, "%s/immutable.d", dir); 2023-06-09T04:44:05.787 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:05.787 INFO:teuthology.orchestra.run.smithi062.stderr:t_immutable.c:1837:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:05.787 INFO:teuthology.orchestra.run.smithi062.stderr: 1837 | asprintf(&path, "%s/append-only.d", dir); 2023-06-09T04:44:05.788 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:05.788 INFO:teuthology.orchestra.run.smithi062.stderr:t_immutable.c:1850:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:05.788 INFO:teuthology.orchestra.run.smithi062.stderr: 1850 | asprintf(&path, "%s/immutable.d/file", dir); 2023-06-09T04:44:05.788 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:05.788 INFO:teuthology.orchestra.run.smithi062.stderr:t_immutable.c:1862:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:05.788 INFO:teuthology.orchestra.run.smithi062.stderr: 1862 | asprintf(&path, "%s/append-only.d/file", dir); 2023-06-09T04:44:05.788 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:05.789 INFO:teuthology.orchestra.run.smithi062.stderr:t_immutable.c:1874:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:05.789 INFO:teuthology.orchestra.run.smithi062.stderr: 1874 | asprintf(&path, "%s/immutable.d/dir", dir); 2023-06-09T04:44:05.789 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:05.789 INFO:teuthology.orchestra.run.smithi062.stderr:t_immutable.c:1887:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:05.789 INFO:teuthology.orchestra.run.smithi062.stderr: 1887 | asprintf(&path, "%s/append-only.d/dir", dir); 2023-06-09T04:44:05.789 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:05.790 INFO:teuthology.orchestra.run.smithi062.stderr:t_immutable.c: In function 'test_immutable': 2023-06-09T04:44:05.790 INFO:teuthology.orchestra.run.smithi062.stderr:t_immutable.c:151:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:05.790 INFO:teuthology.orchestra.run.smithi062.stderr: 151 | asprintf(&path, "%s/immutable.f", dir); 2023-06-09T04:44:05.790 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:05.790 INFO:teuthology.orchestra.run.smithi062.stderr:t_immutable.c:381:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:05.791 INFO:teuthology.orchestra.run.smithi062.stderr: 381 | asprintf(&linkpath, "%s/immutable.f.hardlink", dir); 2023-06-09T04:44:05.791 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:05.791 INFO:teuthology.orchestra.run.smithi062.stderr:t_immutable.c:408:9: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:05.791 INFO:teuthology.orchestra.run.smithi062.stderr: 408 | chown(path, 0, 0); 2023-06-09T04:44:05.791 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~ 2023-06-09T04:44:05.791 INFO:teuthology.orchestra.run.smithi062.stderr:t_immutable.c:485:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:05.791 INFO:teuthology.orchestra.run.smithi062.stderr: 485 | asprintf(&linkpath, "%s/immutable.f.newname", dir); 2023-06-09T04:44:05.791 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:05.792 INFO:teuthology.orchestra.run.smithi062.stderr:t_immutable.c:532:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:05.792 INFO:teuthology.orchestra.run.smithi062.stderr: 532 | asprintf(&path, "%s/immutable.d/file", dir); 2023-06-09T04:44:05.792 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:05.792 INFO:teuthology.orchestra.run.smithi062.stderr:t_immutable.c:553:9: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:05.792 INFO:teuthology.orchestra.run.smithi062.stderr: 553 | chown(path, 0, 0); 2023-06-09T04:44:05.792 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~ 2023-06-09T04:44:05.792 INFO:teuthology.orchestra.run.smithi062.stderr:t_immutable.c:556:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:05.793 INFO:teuthology.orchestra.run.smithi062.stderr: 556 | asprintf(&linkpath, "%s/immutable.d/file.link", dir); 2023-06-09T04:44:05.793 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:05.793 INFO:teuthology.orchestra.run.smithi062.stderr:t_immutable.c:575:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:05.793 INFO:teuthology.orchestra.run.smithi062.stderr: 575 | asprintf(&linkpath, "%s/immutable.d/file.newname", dir); 2023-06-09T04:44:05.793 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:05.793 INFO:teuthology.orchestra.run.smithi062.stderr:t_immutable.c:595:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:05.793 INFO:teuthology.orchestra.run.smithi062.stderr: 595 | asprintf(&path, "%s/immutable.d/newfile", dir); 2023-06-09T04:44:05.793 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:05.794 INFO:teuthology.orchestra.run.smithi062.stderr:t_immutable.c:619:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:05.794 INFO:teuthology.orchestra.run.smithi062.stderr: 619 | asprintf(&path, "%s/immutable.d/newdir", dir); 2023-06-09T04:44:05.794 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:05.794 INFO:teuthology.orchestra.run.smithi062.stderr:t_immutable.c:631:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:05.794 INFO:teuthology.orchestra.run.smithi062.stderr: 631 | asprintf(&path, "%s/immutable.d/dir/newfile-%d", dir, getuid()); 2023-06-09T04:44:05.794 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:05.794 INFO:teuthology.orchestra.run.smithi062.stderr:t_immutable.c:653:16: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:05.794 INFO:teuthology.orchestra.run.smithi062.stderr: 653 | chown(path, 0, 0); 2023-06-09T04:44:05.795 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~ 2023-06-09T04:44:05.795 INFO:teuthology.orchestra.run.smithi062.stderr:t_immutable.c:657:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:05.795 INFO:teuthology.orchestra.run.smithi062.stderr: 657 | asprintf(&path, "%s/immutable.d/dir", dir); 2023-06-09T04:44:05.795 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:05.795 INFO:teuthology.orchestra.run.smithi062.stderr:t_immutable.c:668:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:05.795 INFO:teuthology.orchestra.run.smithi062.stderr: 668 | asprintf(&path, "%s/immutable.d", dir); 2023-06-09T04:44:05.795 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:05.795 INFO:teuthology.orchestra.run.smithi062.stderr:t_immutable.c:705:9: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:05.796 INFO:teuthology.orchestra.run.smithi062.stderr: 705 | chown(path, 0, 0); 2023-06-09T04:44:05.796 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~ 2023-06-09T04:44:05.796 INFO:teuthology.orchestra.run.smithi062.stderr:t_immutable.c:782:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:05.796 INFO:teuthology.orchestra.run.smithi062.stderr: 782 | asprintf(&path, "%s/empty-immutable.d", dir); 2023-06-09T04:44:05.796 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:05.797 INFO:teuthology.orchestra.run.smithi062.stderr:t_immutable.c: In function 'test_append': 2023-06-09T04:44:05.798 INFO:teuthology.orchestra.run.smithi062.stderr:t_immutable.c:822:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:05.798 INFO:teuthology.orchestra.run.smithi062.stderr: 822 | asprintf(&path, "%s/append-only.f", dir); 2023-06-09T04:44:05.798 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:05.798 INFO:teuthology.orchestra.run.smithi062.stderr:t_immutable.c:1024:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:05.798 INFO:teuthology.orchestra.run.smithi062.stderr: 1024 | asprintf(&linkpath, "%s/append-only.f.hardlink", dir); 2023-06-09T04:44:05.798 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:05.798 INFO:teuthology.orchestra.run.smithi062.stderr:t_immutable.c:1051:9: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:05.799 INFO:teuthology.orchestra.run.smithi062.stderr: 1051 | chown(path, 0, 0); 2023-06-09T04:44:05.799 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~ 2023-06-09T04:44:05.799 INFO:teuthology.orchestra.run.smithi062.stderr:t_immutable.c:1126:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:05.799 INFO:teuthology.orchestra.run.smithi062.stderr: 1126 | asprintf(&linkpath, "%s/append-only.f.newname", dir); 2023-06-09T04:44:05.799 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:05.799 INFO:teuthology.orchestra.run.smithi062.stderr:t_immutable.c:1495:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:05.799 INFO:teuthology.orchestra.run.smithi062.stderr: 1495 | asprintf(&path, "%s/append-only.d/file", dir); 2023-06-09T04:44:05.799 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:05.800 INFO:teuthology.orchestra.run.smithi062.stderr:t_immutable.c:1516:9: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:05.800 INFO:teuthology.orchestra.run.smithi062.stderr: 1516 | chown(path, 0, 0); 2023-06-09T04:44:05.800 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~ 2023-06-09T04:44:05.800 INFO:teuthology.orchestra.run.smithi062.stderr:t_immutable.c:1519:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:05.800 INFO:teuthology.orchestra.run.smithi062.stderr: 1519 | asprintf(&linkpath, "%s/append-only.d/file.link-%d", dir, getuid()); 2023-06-09T04:44:05.800 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:05.800 INFO:teuthology.orchestra.run.smithi062.stderr:t_immutable.c:1529:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:05.800 INFO:teuthology.orchestra.run.smithi062.stderr: 1529 | asprintf(&linkpath, "%s/append-only.d/file.symlink-%d", dir, getuid()); 2023-06-09T04:44:05.801 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:05.801 INFO:teuthology.orchestra.run.smithi062.stderr:t_immutable.c:1539:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:05.801 INFO:teuthology.orchestra.run.smithi062.stderr: 1539 | asprintf(&linkpath, "%s/append-only.d/file.newname", dir); 2023-06-09T04:44:05.801 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:05.801 INFO:teuthology.orchestra.run.smithi062.stderr:t_immutable.c:1559:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:05.801 INFO:teuthology.orchestra.run.smithi062.stderr: 1559 | asprintf(&path, "%s/append-only.d/newfile-%d", dir, getuid()); 2023-06-09T04:44:05.801 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:05.802 INFO:teuthology.orchestra.run.smithi062.stderr:t_immutable.c:1573:4: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:05.802 INFO:teuthology.orchestra.run.smithi062.stderr: 1573 | asprintf(&path, "%s/append-only.d/newdev-%d", dir, getuid()); 2023-06-09T04:44:05.802 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:05.802 INFO:teuthology.orchestra.run.smithi062.stderr:t_immutable.c:1586:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:05.802 INFO:teuthology.orchestra.run.smithi062.stderr: 1586 | asprintf(&path, "%s/append-only.d/newdir-%d", dir, getuid()); 2023-06-09T04:44:05.802 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:05.802 INFO:teuthology.orchestra.run.smithi062.stderr:t_immutable.c:1596:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:05.802 INFO:teuthology.orchestra.run.smithi062.stderr: 1596 | asprintf(&path, "%s/append-only.d/newdir-%d/newfile-%d", dir, getuid(), getuid()); 2023-06-09T04:44:05.803 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:05.803 INFO:teuthology.orchestra.run.smithi062.stderr:t_immutable.c:1618:16: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:05.803 INFO:teuthology.orchestra.run.smithi062.stderr: 1618 | chown(path, 0, 0); 2023-06-09T04:44:05.803 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~ 2023-06-09T04:44:05.803 INFO:teuthology.orchestra.run.smithi062.stderr:t_immutable.c:1622:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:05.803 INFO:teuthology.orchestra.run.smithi062.stderr: 1622 | asprintf(&path, "%s/append-only.d/dir/newfile-%d", dir, getuid()); 2023-06-09T04:44:05.803 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:05.803 INFO:teuthology.orchestra.run.smithi062.stderr:t_immutable.c:1644:16: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:05.804 INFO:teuthology.orchestra.run.smithi062.stderr: 1644 | chown(path, 0, 0); 2023-06-09T04:44:05.804 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~ 2023-06-09T04:44:05.804 INFO:teuthology.orchestra.run.smithi062.stderr:t_immutable.c:1648:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:05.804 INFO:teuthology.orchestra.run.smithi062.stderr: 1648 | asprintf(&path, "%s/append-only.d/dir", dir); 2023-06-09T04:44:05.804 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:05.804 INFO:teuthology.orchestra.run.smithi062.stderr:t_immutable.c:1659:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:05.804 INFO:teuthology.orchestra.run.smithi062.stderr: 1659 | asprintf(&path, "%s/append-only.d", dir); 2023-06-09T04:44:05.805 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:05.805 INFO:teuthology.orchestra.run.smithi062.stderr:t_immutable.c:1692:9: warning: ignoring return value of 'chown', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:05.805 INFO:teuthology.orchestra.run.smithi062.stderr: 1692 | chown(path, 0, 0); 2023-06-09T04:44:05.805 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~ 2023-06-09T04:44:05.805 INFO:teuthology.orchestra.run.smithi062.stderr:t_immutable.c:1769:6: warning: ignoring return value of 'asprintf', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:05.805 INFO:teuthology.orchestra.run.smithi062.stderr: 1769 | asprintf(&path, "%s/empty-append-only.d", dir); 2023-06-09T04:44:05.805 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:06.465 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] stale_handle 2023-06-09T04:44:06.806 INFO:teuthology.orchestra.run.smithi062.stderr:stale_handle.c: In function 'main': 2023-06-09T04:44:06.806 INFO:teuthology.orchestra.run.smithi062.stderr:stale_handle.c:102:2: warning: ignoring return value of 'system', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:06.806 INFO:teuthology.orchestra.run.smithi062.stderr: 102 | system("echo 3 > /proc/sys/vm/drop_caches"); 2023-06-09T04:44:06.806 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:06.894 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] pwrite_mmap_blocked 2023-06-09T04:44:07.305 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] t_dir_offset2 2023-06-09T04:44:07.763 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] seek_sanity_test 2023-06-09T04:44:08.109 INFO:teuthology.orchestra.run.smithi062.stderr:seek_sanity_test.c: In function 'test18': 2023-06-09T04:44:08.110 INFO:teuthology.orchestra.run.smithi062.stderr:seek_sanity_test.c:460:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:08.110 INFO:teuthology.orchestra.run.smithi062.stderr: 460 | ftruncate(fd, 0); 2023-06-09T04:44:08.110 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~ 2023-06-09T04:44:08.113 INFO:teuthology.orchestra.run.smithi062.stderr:seek_sanity_test.c: In function 'test_basic_support': 2023-06-09T04:44:08.113 INFO:teuthology.orchestra.run.smithi062.stderr:seek_sanity_test.c:1207:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:08.113 INFO:teuthology.orchestra.run.smithi062.stderr: 1207 | ftruncate(fd, 0); 2023-06-09T04:44:08.113 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~ 2023-06-09T04:44:08.113 INFO:teuthology.orchestra.run.smithi062.stderr:seek_sanity_test.c:1256:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:08.113 INFO:teuthology.orchestra.run.smithi062.stderr: 1256 | ftruncate(fd, 0); 2023-06-09T04:44:08.114 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~ 2023-06-09T04:44:08.114 INFO:teuthology.orchestra.run.smithi062.stderr:seek_sanity_test.c: In function 'get_io_sizes': 2023-06-09T04:44:08.114 INFO:teuthology.orchestra.run.smithi062.stderr:seek_sanity_test.c:88:3: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:08.114 INFO:teuthology.orchestra.run.smithi062.stderr: 88 | ftruncate(fd, 0); 2023-06-09T04:44:08.114 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~ 2023-06-09T04:44:08.115 INFO:teuthology.orchestra.run.smithi062.stderr:seek_sanity_test.c:89:3: warning: ignoring return value of 'pwrite', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:08.115 INFO:teuthology.orchestra.run.smithi062.stderr: 89 | pwrite(fd, "a", 1, offset); 2023-06-09T04:44:08.115 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:08.115 INFO:teuthology.orchestra.run.smithi062.stderr:seek_sanity_test.c:98:3: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:08.115 INFO:teuthology.orchestra.run.smithi062.stderr: 98 | ftruncate(fd, 0); 2023-06-09T04:44:08.115 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~ 2023-06-09T04:44:08.115 INFO:teuthology.orchestra.run.smithi062.stderr:seek_sanity_test.c:99:3: warning: ignoring return value of 'pwrite', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:08.115 INFO:teuthology.orchestra.run.smithi062.stderr: 99 | pwrite(fd, "a", 1, offset); 2023-06-09T04:44:08.116 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:08.494 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] seek_copy_test 2023-06-09T04:44:08.928 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] t_readdir_1 2023-06-09T04:44:09.252 INFO:teuthology.orchestra.run.smithi062.stderr:t_readdir_1.c: In function 'main': 2023-06-09T04:44:09.252 INFO:teuthology.orchestra.run.smithi062.stderr:t_readdir_1.c:30:25: warning: ignoring return value of 'read', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:09.252 INFO:teuthology.orchestra.run.smithi062.stderr: 30 | read(fd, buf, 100); 2023-06-09T04:44:09.252 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:09.324 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] t_readdir_2 2023-06-09T04:44:09.731 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] fsync-tester 2023-06-09T04:44:10.067 INFO:teuthology.orchestra.run.smithi062.stderr:fsync-tester.c: In function 'main': 2023-06-09T04:44:10.067 INFO:teuthology.orchestra.run.smithi062.stderr:fsync-tester.c:391:3: warning: ignoring return value of 'read', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:10.067 INFO:teuthology.orchestra.run.smithi062.stderr: 391 | read(fd, &seed, sizeof(seed)); 2023-06-09T04:44:10.067 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:10.068 INFO:teuthology.orchestra.run.smithi062.stderr:fsync-tester.c:541:3: warning: ignoring return value of 'system', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:10.068 INFO:teuthology.orchestra.run.smithi062.stderr: 541 | system("reboot -fn"); 2023-06-09T04:44:10.068 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:10.068 INFO:teuthology.orchestra.run.smithi062.stderr:fsync-tester.c: In function 'drop_all_caches': 2023-06-09T04:44:10.068 INFO:teuthology.orchestra.run.smithi062.stderr:fsync-tester.c:90:2: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:10.069 INFO:teuthology.orchestra.run.smithi062.stderr: 90 | write(fd, value, sizeof(value)-1); 2023-06-09T04:44:10.069 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:10.267 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] nsexec 2023-06-09T04:44:10.693 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] cloner 2023-06-09T04:44:11.138 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] renameat2 2023-06-09T04:44:11.560 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] t_getcwd 2023-06-09T04:44:11.903 INFO:teuthology.orchestra.run.smithi062.stderr:t_getcwd.c: In function 'test_getcwd': 2023-06-09T04:44:11.903 INFO:teuthology.orchestra.run.smithi062.stderr:t_getcwd.c:21:3: warning: ignoring return value of 'getcwd', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:11.903 INFO:teuthology.orchestra.run.smithi062.stderr: 21 | getcwd(cur_cwd, BUF_SIZE); 2023-06-09T04:44:11.903 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:11.987 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] e4compact 2023-06-09T04:44:12.450 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] test-nextquota 2023-06-09T04:44:12.881 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] punch-alternating 2023-06-09T04:44:13.317 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] attr-list-by-handle-cursor-test 2023-06-09T04:44:13.734 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] listxattr 2023-06-09T04:44:14.132 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] dio-interleaved 2023-06-09T04:44:14.550 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] t_dir_type 2023-06-09T04:44:14.961 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] dio-invalidate-cache 2023-06-09T04:44:15.286 INFO:teuthology.orchestra.run.smithi062.stderr:dio-invalidate-cache.c: In function 'main': 2023-06-09T04:44:15.286 INFO:teuthology.orchestra.run.smithi062.stderr:dio-invalidate-cache.c:286:3: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:15.286 INFO:teuthology.orchestra.run.smithi062.stderr: 286 | write(fd, buf, blksz * nr_child); 2023-06-09T04:44:15.287 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:15.427 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] stat_test 2023-06-09T04:44:16.000 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] t_encrypted_d_revalidate 2023-06-09T04:44:16.433 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] attr_replace_test 2023-06-09T04:44:16.856 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] swapon 2023-06-09T04:44:17.284 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] mkswap 2023-06-09T04:44:17.680 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] t_attr_corruption 2023-06-09T04:44:18.082 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] t_open_tmpfiles 2023-06-09T04:44:18.523 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] fscrypt-crypt-util 2023-06-09T04:44:19.527 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] bulkstat_null_ocount 2023-06-09T04:44:19.955 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] splice-test 2023-06-09T04:44:20.382 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] chprojid_fail 2023-06-09T04:44:20.788 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] detached_mounts_propagation 2023-06-09T04:44:21.256 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] ext4_resize 2023-06-09T04:44:21.267 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:44:21.273 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:44:21.645 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] t_readdir_3 2023-06-09T04:44:22.107 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] splice2pipe 2023-06-09T04:44:22.428 INFO:teuthology.orchestra.run.smithi062.stderr:splice2pipe.c: In function 'prepare_pipe': 2023-06-09T04:44:22.428 INFO:teuthology.orchestra.run.smithi062.stderr:splice2pipe.c:56:3: warning: ignoring return value of 'write', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:22.428 INFO:teuthology.orchestra.run.smithi062.stderr: 56 | write(p[1], buffer, n); 2023-06-09T04:44:22.429 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:22.429 INFO:teuthology.orchestra.run.smithi062.stderr:splice2pipe.c:64:3: warning: ignoring return value of 'read', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:22.429 INFO:teuthology.orchestra.run.smithi062.stderr: 64 | read(p[0], buffer, n); 2023-06-09T04:44:22.429 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:22.517 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] uuid_ioctl 2023-06-09T04:44:22.927 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] fiemap-tester 2023-06-09T04:44:23.472 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] t_stripealign 2023-06-09T04:44:23.879 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] open_by_handle 2023-06-09T04:44:24.428 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] t_mmap_dio 2023-06-09T04:44:24.827 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] xfsfind 2023-06-09T04:44:25.280 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] fssum 2023-06-09T04:44:26.041 INFO:teuthology.orchestra.run.smithi062.stdout:Building log-writes 2023-06-09T04:44:26.059 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] replay-log 2023-06-09T04:44:26.667 INFO:teuthology.orchestra.run.smithi062.stdout:Building perf 2023-06-09T04:44:26.682 INFO:teuthology.orchestra.run.smithi062.stdout:Building aio-dio-regress 2023-06-09T04:44:26.701 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] aio-dio-append-write-fallocate-race 2023-06-09T04:44:27.135 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] aio-dio-fcntl-race 2023-06-09T04:44:27.567 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] aio-dio-subblock-eof-read 2023-06-09T04:44:27.969 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] aio-dio-append-write-read-race 2023-06-09T04:44:28.409 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] aio-dio-invalidate-readahead 2023-06-09T04:44:28.844 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] aio-dio-hole-filling-race 2023-06-09T04:44:29.252 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2023-06-09T04:44:29.650 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] aio-last-ref-held-by-io 2023-06-09T04:44:30.088 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] aio-dio-cycle-write 2023-06-09T04:44:30.422 INFO:teuthology.orchestra.run.smithi062.stderr:aio-dio-cycle-write.c: In function 'init_test': 2023-06-09T04:44:30.422 INFO:teuthology.orchestra.run.smithi062.stderr:aio-dio-cycle-write.c:83:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:30.422 INFO:teuthology.orchestra.run.smithi062.stderr: 83 | ftruncate(fd, buf_size); 2023-06-09T04:44:30.422 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:30.560 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] aio-dio-extend-stat 2023-06-09T04:44:30.984 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2023-06-09T04:44:31.362 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] aiocp 2023-06-09T04:44:31.870 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] aio-dio-invalidate-failure 2023-06-09T04:44:32.296 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] aiodio_sparse2 2023-06-09T04:44:32.620 INFO:teuthology.orchestra.run.smithi062.stderr:aiodio_sparse2.c: In function 'aiodio_sparse': 2023-06-09T04:44:32.620 INFO:teuthology.orchestra.run.smithi062.stderr:aiodio_sparse2.c:111:3: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:32.620 INFO:teuthology.orchestra.run.smithi062.stderr: 111 | ftruncate(fd, filesize); 2023-06-09T04:44:32.621 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:32.621 INFO:teuthology.orchestra.run.smithi062.stderr:aiodio_sparse2.c: In function 'dirty_freeblocks': 2023-06-09T04:44:32.621 INFO:teuthology.orchestra.run.smithi062.stderr:aiodio_sparse2.c:274:2: warning: ignoring return value of 'ftruncate', declared with attribute warn_unused_result [-Wunused-result] 2023-06-09T04:44:32.621 INFO:teuthology.orchestra.run.smithi062.stderr: 274 | ftruncate(fd, size); 2023-06-09T04:44:32.621 INFO:teuthology.orchestra.run.smithi062.stderr: | ^~~~~~~~~~~~~~~~~~~ 2023-06-09T04:44:32.790 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] aio-dio-cow-race 2023-06-09T04:44:33.199 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] aio-dio-write-verify 2023-06-09T04:44:33.657 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] aio-dio-eof-race 2023-06-09T04:44:34.097 INFO:teuthology.orchestra.run.smithi062.stdout:Building vfs 2023-06-09T04:44:34.117 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] vfstest 2023-06-09T04:44:36.862 INFO:teuthology.orchestra.run.smithi062.stdout: [CC] mount-idmapped 2023-06-09T04:44:37.554 INFO:teuthology.orchestra.run.smithi062.stdout:Building m4 2023-06-09T04:44:37.569 INFO:teuthology.orchestra.run.smithi062.stdout:Building common 2023-06-09T04:44:37.584 INFO:teuthology.orchestra.run.smithi062.stdout:Building tests 2023-06-09T04:44:37.600 INFO:teuthology.orchestra.run.smithi062.stdout:Building perf 2023-06-09T04:44:37.617 INFO:teuthology.orchestra.run.smithi062.stdout: [GROUP] /tmp/tmp.VpYa8kRkcExfstests-dev/tests/perf/group.list 2023-06-09T04:44:37.679 INFO:teuthology.orchestra.run.smithi062.stdout:Building ext4 2023-06-09T04:44:37.696 INFO:teuthology.orchestra.run.smithi062.stdout: [GROUP] /tmp/tmp.VpYa8kRkcExfstests-dev/tests/ext4/group.list 2023-06-09T04:44:37.891 INFO:teuthology.orchestra.run.smithi062.stdout:Building ocfs2 2023-06-09T04:44:37.906 INFO:teuthology.orchestra.run.smithi062.stdout: [GROUP] /tmp/tmp.VpYa8kRkcExfstests-dev/tests/ocfs2/group.list 2023-06-09T04:44:37.973 INFO:teuthology.orchestra.run.smithi062.stdout:Building overlay 2023-06-09T04:44:37.995 INFO:teuthology.orchestra.run.smithi062.stdout: [GROUP] /tmp/tmp.VpYa8kRkcExfstests-dev/tests/overlay/group.list 2023-06-09T04:44:38.193 INFO:teuthology.orchestra.run.smithi062.stdout:Building cifs 2023-06-09T04:44:38.211 INFO:teuthology.orchestra.run.smithi062.stdout: [GROUP] /tmp/tmp.VpYa8kRkcExfstests-dev/tests/cifs/group.list 2023-06-09T04:44:38.273 INFO:teuthology.orchestra.run.smithi062.stdout:Building generic 2023-06-09T04:44:38.294 INFO:teuthology.orchestra.run.smithi062.stdout: [GROUP] /tmp/tmp.VpYa8kRkcExfstests-dev/tests/generic/group.list 2023-06-09T04:44:38.772 INFO:teuthology.orchestra.run.smithi062.stdout:Building shared 2023-06-09T04:44:38.789 INFO:teuthology.orchestra.run.smithi062.stdout: [GROUP] /tmp/tmp.VpYa8kRkcExfstests-dev/tests/shared/group.list 2023-06-09T04:44:38.873 INFO:teuthology.orchestra.run.smithi062.stdout:Building xfs 2023-06-09T04:44:38.896 INFO:teuthology.orchestra.run.smithi062.stdout: [GROUP] /tmp/tmp.VpYa8kRkcExfstests-dev/tests/xfs/group.list 2023-06-09T04:44:39.381 INFO:teuthology.orchestra.run.smithi062.stdout:Building f2fs 2023-06-09T04:44:39.400 INFO:teuthology.orchestra.run.smithi062.stdout: [GROUP] /tmp/tmp.VpYa8kRkcExfstests-dev/tests/f2fs/group.list 2023-06-09T04:44:39.480 INFO:teuthology.orchestra.run.smithi062.stdout:Building udf 2023-06-09T04:44:39.499 INFO:teuthology.orchestra.run.smithi062.stdout: [GROUP] /tmp/tmp.VpYa8kRkcExfstests-dev/tests/udf/group.list 2023-06-09T04:44:39.550 INFO:teuthology.orchestra.run.smithi062.stdout:Building ceph 2023-06-09T04:44:39.566 INFO:teuthology.orchestra.run.smithi062.stdout: [GROUP] /tmp/tmp.VpYa8kRkcExfstests-dev/tests/ceph/group.list 2023-06-09T04:44:39.639 INFO:teuthology.orchestra.run.smithi062.stdout:Building nfs 2023-06-09T04:44:39.656 INFO:teuthology.orchestra.run.smithi062.stdout: [GROUP] /tmp/tmp.VpYa8kRkcExfstests-dev/tests/nfs/group.list 2023-06-09T04:44:39.729 INFO:teuthology.orchestra.run.smithi062.stdout:Building btrfs 2023-06-09T04:44:39.749 INFO:teuthology.orchestra.run.smithi062.stdout: [GROUP] /tmp/tmp.VpYa8kRkcExfstests-dev/tests/btrfs/group.list 2023-06-09T04:44:40.034 INFO:teuthology.orchestra.run.smithi062.stdout:Building tmpfs 2023-06-09T04:44:40.053 INFO:teuthology.orchestra.run.smithi062.stdout: [GROUP] /tmp/tmp.VpYa8kRkcExfstests-dev/tests/tmpfs/group.list 2023-06-09T04:44:40.120 INFO:teuthology.orchestra.run.smithi062.stdout:Building selftest 2023-06-09T04:44:40.138 INFO:teuthology.orchestra.run.smithi062.stdout: [GROUP] /tmp/tmp.VpYa8kRkcExfstests-dev/tests/selftest/group.list 2023-06-09T04:44:40.204 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo make install) 2023-06-09T04:44:40.290 INFO:teuthology.orchestra.run.smithi062.stdout:Building include 2023-06-09T04:44:40.302 INFO:teuthology.orchestra.run.smithi062.stdout:Building lib 2023-06-09T04:44:40.314 INFO:teuthology.orchestra.run.smithi062.stdout:Building ltp 2023-06-09T04:44:40.329 INFO:teuthology.orchestra.run.smithi062.stdout:Building src 2023-06-09T04:44:40.450 INFO:teuthology.orchestra.run.smithi062.stdout:Building log-writes 2023-06-09T04:44:40.468 INFO:teuthology.orchestra.run.smithi062.stdout:Building perf 2023-06-09T04:44:40.483 INFO:teuthology.orchestra.run.smithi062.stdout:Building aio-dio-regress 2023-06-09T04:44:40.501 INFO:teuthology.orchestra.run.smithi062.stdout:Building vfs 2023-06-09T04:44:40.516 INFO:teuthology.orchestra.run.smithi062.stdout:Building m4 2023-06-09T04:44:40.532 INFO:teuthology.orchestra.run.smithi062.stdout:Building common 2023-06-09T04:44:40.545 INFO:teuthology.orchestra.run.smithi062.stdout:Building tests 2023-06-09T04:44:40.564 INFO:teuthology.orchestra.run.smithi062.stdout:Building perf 2023-06-09T04:44:40.582 INFO:teuthology.orchestra.run.smithi062.stdout: [GROUP] /tmp/tmp.VpYa8kRkcExfstests-dev/tests/perf/group.list 2023-06-09T04:44:40.639 INFO:teuthology.orchestra.run.smithi062.stdout:Building ext4 2023-06-09T04:44:40.657 INFO:teuthology.orchestra.run.smithi062.stdout: [GROUP] /tmp/tmp.VpYa8kRkcExfstests-dev/tests/ext4/group.list 2023-06-09T04:44:40.838 INFO:teuthology.orchestra.run.smithi062.stdout:Building ocfs2 2023-06-09T04:44:40.856 INFO:teuthology.orchestra.run.smithi062.stdout: [GROUP] /tmp/tmp.VpYa8kRkcExfstests-dev/tests/ocfs2/group.list 2023-06-09T04:44:40.928 INFO:teuthology.orchestra.run.smithi062.stdout:Building overlay 2023-06-09T04:44:40.949 INFO:teuthology.orchestra.run.smithi062.stdout: [GROUP] /tmp/tmp.VpYa8kRkcExfstests-dev/tests/overlay/group.list 2023-06-09T04:44:41.155 INFO:teuthology.orchestra.run.smithi062.stdout:Building cifs 2023-06-09T04:44:41.172 INFO:teuthology.orchestra.run.smithi062.stdout: [GROUP] /tmp/tmp.VpYa8kRkcExfstests-dev/tests/cifs/group.list 2023-06-09T04:44:41.238 INFO:teuthology.orchestra.run.smithi062.stdout:Building generic 2023-06-09T04:44:41.268 INFO:teuthology.orchestra.run.smithi062.stdout: [GROUP] /tmp/tmp.VpYa8kRkcExfstests-dev/tests/generic/group.list 2023-06-09T04:44:41.740 INFO:teuthology.orchestra.run.smithi062.stdout:Building shared 2023-06-09T04:44:41.758 INFO:teuthology.orchestra.run.smithi062.stdout: [GROUP] /tmp/tmp.VpYa8kRkcExfstests-dev/tests/shared/group.list 2023-06-09T04:44:41.845 INFO:teuthology.orchestra.run.smithi062.stdout:Building xfs 2023-06-09T04:44:41.866 INFO:teuthology.orchestra.run.smithi062.stdout: [GROUP] /tmp/tmp.VpYa8kRkcExfstests-dev/tests/xfs/group.list 2023-06-09T04:44:42.312 INFO:teuthology.orchestra.run.smithi062.stdout:Building f2fs 2023-06-09T04:44:42.330 INFO:teuthology.orchestra.run.smithi062.stdout: [GROUP] /tmp/tmp.VpYa8kRkcExfstests-dev/tests/f2fs/group.list 2023-06-09T04:44:42.418 INFO:teuthology.orchestra.run.smithi062.stdout:Building udf 2023-06-09T04:44:42.433 INFO:teuthology.orchestra.run.smithi062.stdout: [GROUP] /tmp/tmp.VpYa8kRkcExfstests-dev/tests/udf/group.list 2023-06-09T04:44:42.494 INFO:teuthology.orchestra.run.smithi062.stdout:Building ceph 2023-06-09T04:44:42.513 INFO:teuthology.orchestra.run.smithi062.stdout: [GROUP] /tmp/tmp.VpYa8kRkcExfstests-dev/tests/ceph/group.list 2023-06-09T04:44:42.592 INFO:teuthology.orchestra.run.smithi062.stdout:Building nfs 2023-06-09T04:44:42.610 INFO:teuthology.orchestra.run.smithi062.stdout: [GROUP] /tmp/tmp.VpYa8kRkcExfstests-dev/tests/nfs/group.list 2023-06-09T04:44:42.685 INFO:teuthology.orchestra.run.smithi062.stdout:Building btrfs 2023-06-09T04:44:42.710 INFO:teuthology.orchestra.run.smithi062.stdout: [GROUP] /tmp/tmp.VpYa8kRkcExfstests-dev/tests/btrfs/group.list 2023-06-09T04:44:42.997 INFO:teuthology.orchestra.run.smithi062.stdout:Building tmpfs 2023-06-09T04:44:43.018 INFO:teuthology.orchestra.run.smithi062.stdout: [GROUP] /tmp/tmp.VpYa8kRkcExfstests-dev/tests/tmpfs/group.list 2023-06-09T04:44:43.087 INFO:teuthology.orchestra.run.smithi062.stdout:Building selftest 2023-06-09T04:44:43.105 INFO:teuthology.orchestra.run.smithi062.stdout: [GROUP] /tmp/tmp.VpYa8kRkcExfstests-dev/tests/selftest/group.list 2023-06-09T04:44:43.166 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/make --no-print-directory Q=@ -C include install 2023-06-09T04:44:43.174 INFO:teuthology.orchestra.run.smithi062.stdout:make[1]: Nothing to be done for 'install'. 2023-06-09T04:44:43.175 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/make --no-print-directory Q=@ -C lib install 2023-06-09T04:44:43.186 INFO:teuthology.orchestra.run.smithi062.stdout:make[1]: Nothing to be done for 'install'. 2023-06-09T04:44:43.186 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/make --no-print-directory Q=@ -C ltp install 2023-06-09T04:44:43.198 INFO:teuthology.orchestra.run.smithi062.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2023-06-09T04:44:43.246 INFO:teuthology.orchestra.run.smithi062.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2023-06-09T04:44:43.606 INFO:teuthology.orchestra.run.smithi062.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2023-06-09T04:44:43.651 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/make --no-print-directory Q=@ -C src install 2023-06-09T04:44:43.712 INFO:teuthology.orchestra.run.smithi062.stdout:Building log-writes 2023-06-09T04:44:43.729 INFO:teuthology.orchestra.run.smithi062.stdout:Building perf 2023-06-09T04:44:43.744 INFO:teuthology.orchestra.run.smithi062.stdout:Building aio-dio-regress 2023-06-09T04:44:43.763 INFO:teuthology.orchestra.run.smithi062.stdout:Building vfs 2023-06-09T04:44:43.777 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/make -C log-writes install 2023-06-09T04:44:43.788 INFO:teuthology.orchestra.run.smithi062.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2023-06-09T04:44:43.835 INFO:teuthology.orchestra.run.smithi062.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2023-06-09T04:44:43.882 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/make -C perf install 2023-06-09T04:44:43.892 INFO:teuthology.orchestra.run.smithi062.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2023-06-09T04:44:43.938 INFO:teuthology.orchestra.run.smithi062.stdout:../../install-sh -o root -g root -m 755 ResultData.py fio-insert-and-compare.py FioResultDecoder.py FioCompare.py generate-schema.py fio-results.sql /var/lib/xfstests/src/perf 2023-06-09T04:44:44.055 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/make -C aio-dio-regress install 2023-06-09T04:44:44.067 INFO:teuthology.orchestra.run.smithi062.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2023-06-09T04:44:44.112 INFO:teuthology.orchestra.run.smithi062.stdout:../../install-sh -o root -g root -m 755 aio-dio-fcntl-race aio-dio-subblock-eof-read aio-dio-append-write-read-race aio-dio-invalidate-readahead aio-dio-hole-filling-race aio-free-ring-with-bogus-nr-pages aio-last-ref-held-by-io aio-dio-cycle-write aio-dio-extend-stat aio-io-setup-with-nonwritable-context-pointer aiocp aio-dio-append-write-fallocate-race aio-dio-invalidate-failure aiodio_sparse2 aio-dio-cow-race aio-dio-write-verify aio-dio-eof-race /var/lib/xfstests/src/aio-dio-regress 2023-06-09T04:44:44.376 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/make -C vfs install 2023-06-09T04:44:44.385 INFO:teuthology.orchestra.run.smithi062.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2023-06-09T04:44:44.436 INFO:teuthology.orchestra.run.smithi062.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2023-06-09T04:44:44.496 INFO:teuthology.orchestra.run.smithi062.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2023-06-09T04:44:44.542 INFO:teuthology.orchestra.run.smithi062.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl fiemap-tester t_stripealign open_by_handle t_mmap_dio xfsfind fssum /var/lib/xfstests/src 2023-06-09T04:44:50.769 INFO:teuthology.orchestra.run.smithi062.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py /var/lib/xfstests/src 2023-06-09T04:44:51.228 INFO:teuthology.orchestra.run.smithi062.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2023-06-09T04:44:51.332 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/make --no-print-directory Q=@ -C m4 install 2023-06-09T04:44:51.339 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:44:51.345 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:44:51.346 INFO:teuthology.orchestra.run.smithi062.stdout:make[1]: Nothing to be done for 'install'. 2023-06-09T04:44:51.346 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/make --no-print-directory Q=@ -C common install 2023-06-09T04:44:51.349 INFO:teuthology.orchestra.run.smithi062.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2023-06-09T04:44:51.389 INFO:teuthology.orchestra.run.smithi062.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2023-06-09T04:44:52.046 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/make --no-print-directory Q=@ -C tests install 2023-06-09T04:44:52.053 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.VpYa8kRkcExfstests-dev/tests/btrfs/ install 2023-06-09T04:44:52.065 INFO:teuthology.orchestra.run.smithi062.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2023-06-09T04:44:52.109 INFO:teuthology.orchestra.run.smithi062.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 290 291 299 /var/lib/xfstests/tests/btrfs 2023-06-09T04:44:56.121 INFO:teuthology.orchestra.run.smithi062.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2023-06-09T04:44:56.167 INFO:teuthology.orchestra.run.smithi062.stdout:../../install-sh -o root -g root -m 644 016.out 064.out 186.out 240.out 279.out 180.out 282.out 267.out 280.out 140.out 265.out 206.out 121.out 040.out 106.out 199.out 233.out 234.out 248.out 009.out 033.out 082.out 252.out 270.out 148.out 088.out 137.out 002.out 125.out 110.out 165.out 152.out 143.out 264.out 015.out 192.out 075.out 178.out 284.out 052.out 228.out 276.out 046.out 273.out 074.out 251.out 176.out 209.out 020.out 195.out 215.out 115.out 179.out 250.out 191.out 266.out 111.out 051.out 177.out 219.out 119.out 244.out 128.out 232.out 087.out 212.out 112.out 012.out 107.out 162.out 147.out 196.out 145.out 004.out 187.out 024.out 220.out 238.out 120.out 202.out 102.out 171.out 261.out 156.out 092.out 072.out 068.out 048.out 062.out 084.out 129.out 066.out 229.out 254.out 047.out 011.out 029.out 035.out 134.out 170.out 260.out 034.out 065.out 286.out 161.out 246.out 056.out 216.out 116.out 043.out 274.out 287.out 010.out 001.out 138.out 237.out 097.out 153.out 160.out 175.out 091.out 081.out 071.out 061.out 239.out 067.out 200.out 100.out 025.out 258.out 269.out 208.out 039.out 222.out 275.out 169.out 098.out 290.out 080.out 070.out 060.out 207.out 108.out 006.out 167.out 217.out 133.out 117.out 017.out 236.out 159.out 211.out 158.out 085.out 277.out 146.out 188.out 189.out 204.out 104.out 225.out 242.out 268.out 135.out 257.out 124.out 142.out 172.out 103.out 058.out 262.out 042.out 096.out 193.out 283.out 083.out 099.out 247.out 053.out 109.out 157.out 164.out 154.out 094.out 241.out 089.out 141.out 214.out 114.out 014.out 278.out 041.out 223.out 028.out 086.out 123.out 144.out 032.out 182.out 205.out 136.out 005.out 036.out 198.out 008.out 190.out 173.out 050.out 038.out 105.out 263.out 291.out 185.out 095.out 285.out 155.out 201.out 019.out 063.out 299.out 151.out 231.out 227.out 069.out 131.out 213.out 113.out 013.out 031.out 057.out 272.out 078.out 184.out 259.out 210.out 132.out 037.out 093.out 197.out 235.out 127.out 230.out 027.out 130.out 023.out 044.out 073.out 030.out 203.out 003.out 101.out 055.out 166.out 245.out 243.out 194.out 249.out 122.out 076.out 022.out 174.out 045.out 281.out 090.out 224.out 181.out 271.out 149.out 183.out 077.out 218.out 118.out 018.out 256.out 168.out 007.out 079.out 054.out 059.out 150.out 049.out 226.out 163.out 126.out 026.out 021.out 253.out 255.out 139.out 221.out /var/lib/xfstests/tests/btrfs 2023-06-09T04:45:00.163 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.VpYa8kRkcExfstests-dev/tests/ceph/ install 2023-06-09T04:45:00.171 INFO:teuthology.orchestra.run.smithi062.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2023-06-09T04:45:00.222 INFO:teuthology.orchestra.run.smithi062.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2023-06-09T04:45:00.324 INFO:teuthology.orchestra.run.smithi062.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2023-06-09T04:45:00.373 INFO:teuthology.orchestra.run.smithi062.stdout:../../install-sh -o root -g root -m 644 003.out 005.out 001.out 004.out 002.out /var/lib/xfstests/tests/ceph 2023-06-09T04:45:00.468 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.VpYa8kRkcExfstests-dev/tests/cifs/ install 2023-06-09T04:45:00.475 INFO:teuthology.orchestra.run.smithi062.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2023-06-09T04:45:00.522 INFO:teuthology.orchestra.run.smithi062.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2023-06-09T04:45:00.568 INFO:teuthology.orchestra.run.smithi062.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2023-06-09T04:45:00.615 INFO:teuthology.orchestra.run.smithi062.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2023-06-09T04:45:00.663 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.VpYa8kRkcExfstests-dev/tests/ext4/ install 2023-06-09T04:45:00.670 INFO:teuthology.orchestra.run.smithi062.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2023-06-09T04:45:00.717 INFO:teuthology.orchestra.run.smithi062.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2023-06-09T04:45:01.672 INFO:teuthology.orchestra.run.smithi062.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2023-06-09T04:45:01.718 INFO:teuthology.orchestra.run.smithi062.stdout:../../install-sh -o root -g root -m 644 001.out.nodelalloc 001.out.default 001.out.nozero 001.cfg 049.out 032.out 039.out 045.out 054.out 056.out 308.out 008.out 040.out 307.out 005.out 021.out 012.out 009.out 033.out 015.out 050.out 026.out 034.out 046.out 018.out 010.out 047.out 303.out 302.out 020.out 002.out 028.out 024.out 013.out 031.out 027.out 306.out 048.out 038.out 044.out 052.out 025.out 029.out 011.out 042.out 304.out 055.out 030.out 003.out 017.out 043.out 053.out 035.out 016.out 058.out 022.out 006.out 004.out 057.out 014.out 036.out 271.out 051.out 041.out 037.out 305.out 019.out 301.out 007.out 023.out 059.out /var/lib/xfstests/tests/ext4 2023-06-09T04:45:02.720 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.VpYa8kRkcExfstests-dev/tests/f2fs/ install 2023-06-09T04:45:02.729 INFO:teuthology.orchestra.run.smithi062.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2023-06-09T04:45:02.777 INFO:teuthology.orchestra.run.smithi062.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2023-06-09T04:45:02.834 INFO:teuthology.orchestra.run.smithi062.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2023-06-09T04:45:02.879 INFO:teuthology.orchestra.run.smithi062.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2023-06-09T04:45:02.941 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.VpYa8kRkcExfstests-dev/tests/generic/ install 2023-06-09T04:45:02.953 INFO:teuthology.orchestra.run.smithi062.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2023-06-09T04:45:03.003 INFO:teuthology.orchestra.run.smithi062.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 /var/lib/xfstests/tests/generic 2023-06-09T04:45:13.027 INFO:teuthology.orchestra.run.smithi062.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2023-06-09T04:45:13.073 INFO:teuthology.orchestra.run.smithi062.stdout:../../install-sh -o root -g root -m 644 035.out.nfs 035.out.default 050.out.nojournal 050.out.xfsquota 050.out.default 050.cfg 035.cfg 047.out 021.out 233.out 518.out 055.out 295.out 683.out 337.out 385.out 082.out 270.out 237.out 502.out 088.out 597.out 097.out 202.out 137.out 034.out 110.out 389.out 593.out 571.out 040.out 646.out 592.out 282.out 472.out 468.out 628.out 428.out 507.out 328.out 566.out 127.out 557.out 273.out 182.out 420.out 609.out 576.out 087.out 506.out 057.out 195.out 711.out 007.out 466.out 311.out 532.out 591.out 719.out 111.out 432.out 519.out 623.out 131.out 319.out 177.out 219.out 119.out 423.out 661.out 232.out 645.out 134.out 260.out 095.out 611.out 638.out 465.out 716.out 161.out 416.out 026.out 216.out 116.out 043.out 358.out 338.out 238.out 439.out 138.out 263.out 497.out 160.out 647.out 433.out 481.out 061.out 555.out 686.out 333.out 258.out 322.out 039.out 222.out 098.out 330.out 690.out 480.out 706.out 606.out 406.out 306.out 206.out 106.out 006.out 167.out 003.out 217.out 120.out 191.out 117.out 355.out 357.out 542.out 485.out 074.out 033.out 188.out 367.out 489.out 279.out 624.out 524.out 174.out 163.out 324.out 224.out 257.out 124.out 672.out 668.out 058.out 262.out 366.out 648.out 042.out 537.out 377.out 193.out 083.out 399.out 365.out 509.out 568.out 309.out 209.out 441.out 255.out 356.out 474.out 341.out 094.out 241.out 089.out 691.out 616.out 614.out 514.out 312.out 141.out 314.out 214.out 381.out 056.out 671.out 041.out 016.out 340.out 649.out 572.out 586.out 240.out 549.out 673.out 633.out 321.out 140.out 708.out 608.out 449.out 185.out 408.out 308.out 208.out 380.out 670.out 604.out 404.out 104.out 663.out 599.out 476.out 192.out 199.out 278.out 639.out 443.out 540.out 186.out 539.out 133.out 164.out 376.out 589.out 154.out 339.out 652.out 239.out 440.out 498.out 139.out 180.out 267.out 317.out 552.out 017.out 169.out 565.out 315.out 580.out 452.out 679.out 336.out 020.out 252.out 585.out 678.out 448.out 352.out 348.out 651.out 184.out 435.out 409.out 248.out 009.out 482.out 625.out 283.out 488.out 496.out 325.out 551.out 225.out 636.out 125.out 544.out 693.out 296.out 650.out 152.out 563.out 143.out 024.out 015.out 392.out 682.out 595.out 578.out 642.out 550.out 052.out 062.out 655.out 276.out 451.out 450.out 463.out 004.out 157.out 069.out 644.out 316.out 344.out 487.out 715.out 615.out 395.out 151.out 415.out 674.out 215.out 115.out 384.out 351.out 250.out 266.out 051.out 536.out 228.out 577.out 244.out 128.out 662.out 579.out 144.out 405.out 205.out 136.out 598.out 363.out 712.out 176.out 198.out 723.out 108.out 390.out 680.out 705.out 605.out 505.out 305.out 105.out 005.out 523.out 084.out 703.out 619.out 727.out 685.out 562.out 419.out 570.out 388.out 527.out 158.out 044.out 019.out 695.out 086.out 574.out 332.out 060.out 142.out 584.out 045.out 372.out 478.out 612.out 462.out 173.out 687.out 350.out 132.out 037.out 293.out 197.out 492.out 499.out 246.out 032.out 112.out 660.out 414.out 063.out 101.out 561.out 343.out 323.out 702.out 362.out 387.out 594.out 438.out 721.out 289.out 699.out 284.out 477.out 621.out 290.out 548.out 299.out 456.out 707.out 461.out 391.out 445.out 632.out 256.out 493.out 107.out 658.out 251.out 526.out 479.out 713.out 426.out 221.out 326.out 226.out 413.out 126.out 121.out 313.out 447.out 460.out 694.out 347.out 275.out 038.out 090.out 361.out 528.out 564.out 294.out 656.out 066.out 455.out 558.out 162.out 147.out 288.out 396.out 547.out 531.out 698.out 148.out 301.out 360.out 374.out 261.out 375.out 076.out 657.out 692.out 304.out 634.out 724.out 129.out 726.out 458.out 534.out 626.out 529.out 603.out 434.out 329.out 587.out 165.out 229.out 590.out 371.out 234.out 183.out 486.out 223.out 123.out 179.out 669.out 023.out 459.out 688.out 277.out 516.out 146.out 398.out 696.out 247.out 427.out 190.out 280.out 484.out 491.out 187.out 046.out 227.out 583.out 285.out 631.out 654.out 359.out 501.out 171.out 155.out 431.out 099.out 331.out 231.out 613.out 513.out 028.out 213.out 113.out 013.out 031.out 630.out 675.out 667.out 272.out 530.out 627.out 573.out 430.out 310.out 454.out 259.out 210.out 327.out 397.out 067.out 093.out 287.out 230.out 027.out 292.out 130.out 370.out 403.out 030.out 203.out 103.out 354.out 025.out 386.out 560.out 722.out 291.out 622.out 243.out 522.out 543.out 422.out 394.out 159.out 249.out 122.out 689.out 166.out 022.out 424.out 637.out 684.out 490.out 353.out 181.out 676.out 271.out 149.out 618.out 064.out 018.out 418.out 077.out 218.out 118.out 575.out 172.out 079.out 469.out 054.out 059.out 049.out 442.out 569.out 521.out 378.out 253.out 421.out 475.out 512.out 494.out 412.out 212.out 538.out 379.out 342.out 012.out 554.out 471.out 070.out 596.out 720.out 620.out 196.out 520.out 242.out 457.out 320.out 220.out 629.out 602.out 153.out 402.out 302.out 102.out 002.out 717.out 617.out 517.out 429.out 417.out 156.out 092.out 664.out 072.out 068.out 473.out 369.out 511.out 411.out 029.out 211.out 011.out 659.out 194.out 170.out 053.out 065.out 286.out 245.out 437.out 545.out 714.out 559.out 710.out 036.out 610.out 510.out 274.out 410.out 701.out 601.out 401.out 201.out 010.out 001.out 495.out 281.out 048.out 665.out 114.out 014.out 346.out 581.out 297.out 145.out 168.out 641.out 436.out 091.out 081.out 071.out 075.out 653.out 700.out 600.out 500.out 400.out 300.out 200.out 100.out 464.out 541.out 269.out 546.out 382.out 677.out 553.out 178.out 175.out 298.out 446.out 444.out 080.out 709.out 607.out 508.out 407.out 307.out 207.out 109.out 008.out 643.out 150.out 349.out 453.out 666.out 236.out 078.out 364.out 567.out 725.out 582.out 383.out 085.out 704.out 588.out 635.out 334.out 504.out 525.out 189.out 204.out 535.out 425.out 345.out 318.out 467.out 368.out 681.out 254.out 335.out 718.out 073.out 235.out 470.out 268.out 556.out 135.out 503.out 533.out 303.out 264.out 515.out 373.out 265.out 697.out 640.out 483.out 096.out 393.out /var/lib/xfstests/tests/generic 2023-06-09T04:45:21.478 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:45:21.485 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:45:23.155 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.VpYa8kRkcExfstests-dev/tests/nfs/ install 2023-06-09T04:45:23.162 INFO:teuthology.orchestra.run.smithi062.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2023-06-09T04:45:23.207 INFO:teuthology.orchestra.run.smithi062.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2023-06-09T04:45:23.255 INFO:teuthology.orchestra.run.smithi062.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2023-06-09T04:45:23.301 INFO:teuthology.orchestra.run.smithi062.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2023-06-09T04:45:23.347 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.VpYa8kRkcExfstests-dev/tests/ocfs2/ install 2023-06-09T04:45:23.356 INFO:teuthology.orchestra.run.smithi062.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2023-06-09T04:45:23.407 INFO:teuthology.orchestra.run.smithi062.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2023-06-09T04:45:23.451 INFO:teuthology.orchestra.run.smithi062.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2023-06-09T04:45:23.494 INFO:teuthology.orchestra.run.smithi062.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2023-06-09T04:45:23.539 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.VpYa8kRkcExfstests-dev/tests/overlay/ install 2023-06-09T04:45:23.548 INFO:teuthology.orchestra.run.smithi062.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2023-06-09T04:45:23.595 INFO:teuthology.orchestra.run.smithi062.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2023-06-09T04:45:24.930 INFO:teuthology.orchestra.run.smithi062.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2023-06-09T04:45:24.982 INFO:teuthology.orchestra.run.smithi062.stdout:../../install-sh -o root -g root -m 644 050.out 044.out 019.out 103.out 003.out 074.out 018.out 024.out 078.out 069.out 020.out 102.out 002.out 060.out 113.out 013.out 031.out 015.out 117.out 045.out 072.out 106.out 048.out 062.out 038.out 052.out 076.out 037.out 029.out 111.out 112.out 042.out 035.out 073.out 068.out 030.out 034.out 017.out 055.out 053.out 109.out 116.out 043.out 056.out 010.out 001.out 009.out 065.out 022.out 004.out 115.out 066.out 114.out 014.out 071.out 007.out 061.out 051.out 011.out 041.out 067.out 058.out 100.out 064.out 104.out 028.out 027.out 023.out 059.out 049.out 032.out 039.out 077.out 105.out 005.out 025.out 026.out 036.out 070.out 108.out 008.out 040.out 107.out 006.out 075.out 063.out 021.out 016.out 047.out 110.out 046.out 012.out 101.out 054.out 033.out 057.out /var/lib/xfstests/tests/overlay 2023-06-09T04:45:26.350 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.VpYa8kRkcExfstests-dev/tests/perf/ install 2023-06-09T04:45:26.359 INFO:teuthology.orchestra.run.smithi062.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2023-06-09T04:45:26.409 INFO:teuthology.orchestra.run.smithi062.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2023-06-09T04:45:26.458 INFO:teuthology.orchestra.run.smithi062.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2023-06-09T04:45:26.504 INFO:teuthology.orchestra.run.smithi062.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2023-06-09T04:45:26.551 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.VpYa8kRkcExfstests-dev/tests/selftest/ install 2023-06-09T04:45:26.562 INFO:teuthology.orchestra.run.smithi062.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2023-06-09T04:45:26.613 INFO:teuthology.orchestra.run.smithi062.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2023-06-09T04:45:26.726 INFO:teuthology.orchestra.run.smithi062.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2023-06-09T04:45:26.773 INFO:teuthology.orchestra.run.smithi062.stdout:../../install-sh -o root -g root -m 644 003.out 005.out 006.out 001.out 004.out 002.out /var/lib/xfstests/tests/selftest 2023-06-09T04:45:26.886 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.VpYa8kRkcExfstests-dev/tests/shared/ install 2023-06-09T04:45:26.895 INFO:teuthology.orchestra.run.smithi062.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2023-06-09T04:45:26.943 INFO:teuthology.orchestra.run.smithi062.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2023-06-09T04:45:27.014 INFO:teuthology.orchestra.run.smithi062.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2023-06-09T04:45:27.055 INFO:teuthology.orchestra.run.smithi062.stdout:../../install-sh -o root -g root -m 644 032.out 298.out 002.out /var/lib/xfstests/tests/shared 2023-06-09T04:45:27.127 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.VpYa8kRkcExfstests-dev/tests/tmpfs/ install 2023-06-09T04:45:27.135 INFO:teuthology.orchestra.run.smithi062.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2023-06-09T04:45:27.182 INFO:teuthology.orchestra.run.smithi062.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2023-06-09T04:45:27.226 INFO:teuthology.orchestra.run.smithi062.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2023-06-09T04:45:27.273 INFO:teuthology.orchestra.run.smithi062.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2023-06-09T04:45:27.321 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.VpYa8kRkcExfstests-dev/tests/udf/ install 2023-06-09T04:45:27.327 INFO:teuthology.orchestra.run.smithi062.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2023-06-09T04:45:27.371 INFO:teuthology.orchestra.run.smithi062.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2023-06-09T04:45:27.418 INFO:teuthology.orchestra.run.smithi062.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2023-06-09T04:45:27.468 INFO:teuthology.orchestra.run.smithi062.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2023-06-09T04:45:27.513 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/make --no-print-directory Q=@ -C /tmp/tmp.VpYa8kRkcExfstests-dev/tests/xfs/ install 2023-06-09T04:45:27.526 INFO:teuthology.orchestra.run.smithi062.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2023-06-09T04:45:27.577 INFO:teuthology.orchestra.run.smithi062.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2023-06-09T04:45:37.020 INFO:teuthology.orchestra.run.smithi062.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2023-06-09T04:45:37.072 INFO:teuthology.orchestra.run.smithi062.stdout:../../install-sh -o root -g root -m 644 033.out.crc 096.out.external 033.out.default 071.out.64 216.out.classic 096.out.internal 216.out.64mblog 071.out.32 216.cfg 033.cfg 508.out 221.out 057.out 308.out 208.out 737.out 108.out 404.out 457.out 021.out 455.out 233.out 194.out 443.out 295.out 337.out 237.out 759.out 502.out 088.out 366.out 202.out 137.out 002.out 389.out 593.out 571.out 775.out 040.out 765.out 592.out 282.out 728.out 528.out 428.out 407.out 328.out 566.out 261.out 557.out 273.out 468.out 074.out 427.out 059.out 595.out 789.out 195.out 346.out 732.out 784.out 532.out 191.out 111.out 432.out 519.out 419.out 131.out 319.out 177.out 219.out 119.out 423.out 232.out 329.out 467.out 229.out 103.out 234.out 183.out 733.out 134.out 260.out 157.out 718.out 034.out 465.out 716.out 161.out 416.out 116.out 043.out 155.out 358.out 338.out 238.out 065.out 439.out 138.out 189.out 097.out 160.out 175.out 373.out 481.out 345.out 025.out 772.out 768.out 258.out 379.out 322.out 039.out 498.out 742.out 290.out 480.out 060.out 506.out 406.out 306.out 206.out 006.out 167.out 003.out 217.out 117.out 355.out 017.out 542.out 783.out 485.out 442.out 188.out 099.out 342.out 279.out 524.out 174.out 771.out 324.out 224.out 313.out 257.out 124.out 758.out 058.out 741.out 384.out 262.out 042.out 497.out 377.out 193.out 799.out 473.out 770.out 365.out 409.out 309.out 209.out 441.out 109.out 255.out 740.out 558.out 474.out 341.out 094.out 555.out 712.out 241.out 089.out 540.out 256.out 714.out 514.out 414.out 314.out 214.out 114.out 381.out 147.out 275.out 041.out 721.out 340.out 793.out 156.out 572.out 568.out 586.out 240.out 180.out 549.out 267.out 280.out 543.out 140.out 708.out 449.out 185.out 334.out 504.out 525.out 204.out 535.out 104.out 425.out 399.out 254.out 335.out 531.out 235.out 470.out 268.out 556.out 135.out 503.out 533.out 303.out 264.out 110.out 318.out 515.out 433.out 036.out 169.out 483.out 393.out 333.out 476.out 087.out 192.out 199.out 739.out 278.out 591.out 752.out 736.out 236.out 539.out 749.out 164.out 376.out 154.out 587.out 339.out 239.out 440.out 458.out 456.out 489.out 139.out 774.out 790.out 317.out 552.out 781.out 064.out 444.out 580.out 452.out 020.out 252.out 724.out 352.out 794.out 348.out 709.out 394.out 356.out 184.out 435.out 509.out 466.out 248.out 785.out 009.out 283.out 750.out 045.out 297.out 488.out 496.out 325.out 551.out 225.out 125.out 186.out 544.out 296.out 152.out 563.out 143.out 436.out 392.out 545.out 075.out 472.out 463.out 550.out 052.out 062.out 276.out 266.out 450.out 744.out 004.out 764.out 069.out 316.out 487.out 762.out 715.out 395.out 151.out 415.out 315.out 344.out 215.out 115.out 015.out 351.out 250.out 464.out 051.out 536.out 228.out 244.out 128.out 385.out 336.out 086.out 579.out 144.out 505.out 205.out 136.out 537.out 176.out 198.out 723.out 390.out 178.out 050.out 405.out 305.out 105.out 005.out 523.out 761.out 437.out 719.out 727.out 363.out 095.out 562.out 382.out 271.out 570.out 388.out 590.out 527.out 158.out 044.out 019.out 577.out 777.out 760.out 574.out 332.out 372.out 478.out 462.out 220.out 350.out 132.out 293.out 492.out 263.out 212.out 499.out 246.out 112.out 063.out 101.out 561.out 343.out 362.out 387.out 798.out 594.out 438.out 265.out 289.out 106.out 477.out 281.out 548.out 299.out 364.out 461.out 391.out 451.out 493.out 786.out 007.out 448.out 251.out 380.out 526.out 479.out 713.out 426.out 150.out 326.out 082.out 226.out 413.out 126.out 026.out 347.out 035.out 361.out 564.out 294.out 788.out 066.out 795.out 076.out 747.out 585.out 162.out 796.out 288.out 197.out 396.out 576.out 547.out 298.out 148.out 301.out 360.out 374.out 734.out 447.out 292.out 304.out 482.out 129.out 726.out 729.out 048.out 534.out 073.out 529.out 434.out 368.out 486.out 223.out 123.out 179.out 023.out 032.out 748.out 277.out 516.out 424.out 398.out 168.out 751.out 190.out 173.out 484.out 491.out 754.out 016.out 046.out 227.out 731.out 782.out 583.out 285.out 127.out 501.out 171.out 581.out 027.out 431.out 068.out 331.out 791.out 743.out 047.out 231.out 024.out 513.out 371.out 213.out 730.out 113.out 013.out 031.out 367.out 182.out 323.out 272.out 530.out 573.out 430.out 454.out 259.out 210.out 327.out 330.out 067.out 093.out 287.out 230.out 769.out 061.out 130.out 370.out 403.out 030.out 203.out 354.out 165.out 386.out 560.out 055.out 722.out 291.out 245.out 243.out 522.out 787.out 745.out 422.out 222.out 159.out 249.out 122.out 166.out 022.out 038.out 578.out 490.out 565.out 353.out 375.out 181.out 500.out 149.out 518.out 018.out 418.out 077.out 218.out 118.out 575.out 780.out 172.out 792.out 079.out 469.out 054.out 049.out 247.out 738.out 163.out 776.out 521.out 270.out 378.out 253.out 421.out 321.out 475.out 512.out 494.out 412.out 312.out 121.out 538.out 012.out 028.out 554.out 397.out 773.out 720.out 196.out 520.out 242.out 420.out 098.out 320.out 120.out 153.out 402.out 302.out 102.out 717.out 460.out 517.out 429.out 417.out 142.out 092.out 357.out 072.out 778.out 084.out 056.out 369.out 711.out 511.out 411.out 029.out 311.out 211.out 011.out 767.out 187.out 170.out 053.out 133.out 286.out 756.out 755.out 766.out 559.out 710.out 510.out 274.out 410.out 310.out 401.out 201.out 010.out 001.out 141.out 495.out 584.out 589.out 753.out 014.out 459.out 145.out 797.out 757.out 091.out 081.out 083.out 800.out 037.out 400.out 300.out 200.out 100.out 359.out 471.out 541.out 445.out 779.out 269.out 546.out 553.out 763.out 446.out 090.out 080.out 070.out 507.out 408.out 307.out 207.out 107.out 008.out 746.out 284.out 349.out 453.out 078.out 567.out 725.out 582.out 735.out 383.out 085.out 588.out 146.out /var/lib/xfstests/tests/xfs 2023-06-09T04:45:46.597 INFO:teuthology.orchestra.run.smithi062.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2023-06-09T04:45:46.644 INFO:teuthology.orchestra.run.smithi062.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2023-06-09T04:45:46.692 INFO:teuthology.orchestra.run.smithi062.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2023-06-09T04:45:46.743 INFO:teuthology.orchestra.run.smithi062.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2023-06-09T04:45:46.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T04:45:46.797 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec ls tests/generic) 2023-06-09T04:45:46.822 INFO:teuthology.orchestra.run.smithi062.stdout:001 2023-06-09T04:45:46.822 INFO:teuthology.orchestra.run.smithi062.stdout:001.out 2023-06-09T04:45:46.822 INFO:teuthology.orchestra.run.smithi062.stdout:002 2023-06-09T04:45:46.822 INFO:teuthology.orchestra.run.smithi062.stdout:002.out 2023-06-09T04:45:46.822 INFO:teuthology.orchestra.run.smithi062.stdout:003 2023-06-09T04:45:46.823 INFO:teuthology.orchestra.run.smithi062.stdout:003.out 2023-06-09T04:45:46.823 INFO:teuthology.orchestra.run.smithi062.stdout:004 2023-06-09T04:45:46.823 INFO:teuthology.orchestra.run.smithi062.stdout:004.out 2023-06-09T04:45:46.823 INFO:teuthology.orchestra.run.smithi062.stdout:005 2023-06-09T04:45:46.823 INFO:teuthology.orchestra.run.smithi062.stdout:005.out 2023-06-09T04:45:46.823 INFO:teuthology.orchestra.run.smithi062.stdout:006 2023-06-09T04:45:46.823 INFO:teuthology.orchestra.run.smithi062.stdout:006.out 2023-06-09T04:45:46.824 INFO:teuthology.orchestra.run.smithi062.stdout:007 2023-06-09T04:45:46.824 INFO:teuthology.orchestra.run.smithi062.stdout:007.out 2023-06-09T04:45:46.824 INFO:teuthology.orchestra.run.smithi062.stdout:008 2023-06-09T04:45:46.824 INFO:teuthology.orchestra.run.smithi062.stdout:008.out 2023-06-09T04:45:46.824 INFO:teuthology.orchestra.run.smithi062.stdout:009 2023-06-09T04:45:46.824 INFO:teuthology.orchestra.run.smithi062.stdout:009.out 2023-06-09T04:45:46.824 INFO:teuthology.orchestra.run.smithi062.stdout:010 2023-06-09T04:45:46.824 INFO:teuthology.orchestra.run.smithi062.stdout:010.out 2023-06-09T04:45:46.825 INFO:teuthology.orchestra.run.smithi062.stdout:011 2023-06-09T04:45:46.825 INFO:teuthology.orchestra.run.smithi062.stdout:011.out 2023-06-09T04:45:46.825 INFO:teuthology.orchestra.run.smithi062.stdout:012 2023-06-09T04:45:46.825 INFO:teuthology.orchestra.run.smithi062.stdout:012.out 2023-06-09T04:45:46.825 INFO:teuthology.orchestra.run.smithi062.stdout:013 2023-06-09T04:45:46.825 INFO:teuthology.orchestra.run.smithi062.stdout:013.out 2023-06-09T04:45:46.825 INFO:teuthology.orchestra.run.smithi062.stdout:014 2023-06-09T04:45:46.825 INFO:teuthology.orchestra.run.smithi062.stdout:014.out 2023-06-09T04:45:46.826 INFO:teuthology.orchestra.run.smithi062.stdout:015 2023-06-09T04:45:46.826 INFO:teuthology.orchestra.run.smithi062.stdout:015.out 2023-06-09T04:45:46.826 INFO:teuthology.orchestra.run.smithi062.stdout:016 2023-06-09T04:45:46.826 INFO:teuthology.orchestra.run.smithi062.stdout:016.out 2023-06-09T04:45:46.826 INFO:teuthology.orchestra.run.smithi062.stdout:017 2023-06-09T04:45:46.826 INFO:teuthology.orchestra.run.smithi062.stdout:017.out 2023-06-09T04:45:46.826 INFO:teuthology.orchestra.run.smithi062.stdout:018 2023-06-09T04:45:46.826 INFO:teuthology.orchestra.run.smithi062.stdout:018.out 2023-06-09T04:45:46.827 INFO:teuthology.orchestra.run.smithi062.stdout:019 2023-06-09T04:45:46.827 INFO:teuthology.orchestra.run.smithi062.stdout:019.out 2023-06-09T04:45:46.827 INFO:teuthology.orchestra.run.smithi062.stdout:020 2023-06-09T04:45:46.827 INFO:teuthology.orchestra.run.smithi062.stdout:020.out 2023-06-09T04:45:46.827 INFO:teuthology.orchestra.run.smithi062.stdout:021 2023-06-09T04:45:46.827 INFO:teuthology.orchestra.run.smithi062.stdout:021.out 2023-06-09T04:45:46.827 INFO:teuthology.orchestra.run.smithi062.stdout:022 2023-06-09T04:45:46.827 INFO:teuthology.orchestra.run.smithi062.stdout:022.out 2023-06-09T04:45:46.828 INFO:teuthology.orchestra.run.smithi062.stdout:023 2023-06-09T04:45:46.828 INFO:teuthology.orchestra.run.smithi062.stdout:023.out 2023-06-09T04:45:46.828 INFO:teuthology.orchestra.run.smithi062.stdout:024 2023-06-09T04:45:46.828 INFO:teuthology.orchestra.run.smithi062.stdout:024.out 2023-06-09T04:45:46.828 INFO:teuthology.orchestra.run.smithi062.stdout:025 2023-06-09T04:45:46.828 INFO:teuthology.orchestra.run.smithi062.stdout:025.out 2023-06-09T04:45:46.828 INFO:teuthology.orchestra.run.smithi062.stdout:026 2023-06-09T04:45:46.828 INFO:teuthology.orchestra.run.smithi062.stdout:026.out 2023-06-09T04:45:46.829 INFO:teuthology.orchestra.run.smithi062.stdout:027 2023-06-09T04:45:46.829 INFO:teuthology.orchestra.run.smithi062.stdout:027.out 2023-06-09T04:45:46.829 INFO:teuthology.orchestra.run.smithi062.stdout:028 2023-06-09T04:45:46.829 INFO:teuthology.orchestra.run.smithi062.stdout:028.out 2023-06-09T04:45:46.829 INFO:teuthology.orchestra.run.smithi062.stdout:029 2023-06-09T04:45:46.829 INFO:teuthology.orchestra.run.smithi062.stdout:029.out 2023-06-09T04:45:46.829 INFO:teuthology.orchestra.run.smithi062.stdout:030 2023-06-09T04:45:46.829 INFO:teuthology.orchestra.run.smithi062.stdout:030.out 2023-06-09T04:45:46.830 INFO:teuthology.orchestra.run.smithi062.stdout:031 2023-06-09T04:45:46.830 INFO:teuthology.orchestra.run.smithi062.stdout:031.out 2023-06-09T04:45:46.830 INFO:teuthology.orchestra.run.smithi062.stdout:032 2023-06-09T04:45:46.830 INFO:teuthology.orchestra.run.smithi062.stdout:032.out 2023-06-09T04:45:46.830 INFO:teuthology.orchestra.run.smithi062.stdout:033 2023-06-09T04:45:46.830 INFO:teuthology.orchestra.run.smithi062.stdout:033.out 2023-06-09T04:45:46.830 INFO:teuthology.orchestra.run.smithi062.stdout:034 2023-06-09T04:45:46.831 INFO:teuthology.orchestra.run.smithi062.stdout:034.out 2023-06-09T04:45:46.831 INFO:teuthology.orchestra.run.smithi062.stdout:035 2023-06-09T04:45:46.831 INFO:teuthology.orchestra.run.smithi062.stdout:035.cfg 2023-06-09T04:45:46.831 INFO:teuthology.orchestra.run.smithi062.stdout:035.out.default 2023-06-09T04:45:46.831 INFO:teuthology.orchestra.run.smithi062.stdout:035.out.nfs 2023-06-09T04:45:46.831 INFO:teuthology.orchestra.run.smithi062.stdout:036 2023-06-09T04:45:46.831 INFO:teuthology.orchestra.run.smithi062.stdout:036.out 2023-06-09T04:45:46.831 INFO:teuthology.orchestra.run.smithi062.stdout:037 2023-06-09T04:45:46.832 INFO:teuthology.orchestra.run.smithi062.stdout:037.out 2023-06-09T04:45:46.832 INFO:teuthology.orchestra.run.smithi062.stdout:038 2023-06-09T04:45:46.832 INFO:teuthology.orchestra.run.smithi062.stdout:038.out 2023-06-09T04:45:46.832 INFO:teuthology.orchestra.run.smithi062.stdout:039 2023-06-09T04:45:46.832 INFO:teuthology.orchestra.run.smithi062.stdout:039.out 2023-06-09T04:45:46.832 INFO:teuthology.orchestra.run.smithi062.stdout:040 2023-06-09T04:45:46.832 INFO:teuthology.orchestra.run.smithi062.stdout:040.out 2023-06-09T04:45:46.832 INFO:teuthology.orchestra.run.smithi062.stdout:041 2023-06-09T04:45:46.833 INFO:teuthology.orchestra.run.smithi062.stdout:041.out 2023-06-09T04:45:46.833 INFO:teuthology.orchestra.run.smithi062.stdout:042 2023-06-09T04:45:46.833 INFO:teuthology.orchestra.run.smithi062.stdout:042.out 2023-06-09T04:45:46.833 INFO:teuthology.orchestra.run.smithi062.stdout:043 2023-06-09T04:45:46.833 INFO:teuthology.orchestra.run.smithi062.stdout:043.out 2023-06-09T04:45:46.833 INFO:teuthology.orchestra.run.smithi062.stdout:044 2023-06-09T04:45:46.833 INFO:teuthology.orchestra.run.smithi062.stdout:044.out 2023-06-09T04:45:46.833 INFO:teuthology.orchestra.run.smithi062.stdout:045 2023-06-09T04:45:46.834 INFO:teuthology.orchestra.run.smithi062.stdout:045.out 2023-06-09T04:45:46.834 INFO:teuthology.orchestra.run.smithi062.stdout:046 2023-06-09T04:45:46.834 INFO:teuthology.orchestra.run.smithi062.stdout:046.out 2023-06-09T04:45:46.834 INFO:teuthology.orchestra.run.smithi062.stdout:047 2023-06-09T04:45:46.834 INFO:teuthology.orchestra.run.smithi062.stdout:047.out 2023-06-09T04:45:46.834 INFO:teuthology.orchestra.run.smithi062.stdout:048 2023-06-09T04:45:46.834 INFO:teuthology.orchestra.run.smithi062.stdout:048.out 2023-06-09T04:45:46.834 INFO:teuthology.orchestra.run.smithi062.stdout:049 2023-06-09T04:45:46.835 INFO:teuthology.orchestra.run.smithi062.stdout:049.out 2023-06-09T04:45:46.835 INFO:teuthology.orchestra.run.smithi062.stdout:050 2023-06-09T04:45:46.835 INFO:teuthology.orchestra.run.smithi062.stdout:050.cfg 2023-06-09T04:45:46.835 INFO:teuthology.orchestra.run.smithi062.stdout:050.out.default 2023-06-09T04:45:46.835 INFO:teuthology.orchestra.run.smithi062.stdout:050.out.nojournal 2023-06-09T04:45:46.835 INFO:teuthology.orchestra.run.smithi062.stdout:050.out.xfsquota 2023-06-09T04:45:46.835 INFO:teuthology.orchestra.run.smithi062.stdout:051 2023-06-09T04:45:46.836 INFO:teuthology.orchestra.run.smithi062.stdout:051.out 2023-06-09T04:45:46.836 INFO:teuthology.orchestra.run.smithi062.stdout:052 2023-06-09T04:45:46.836 INFO:teuthology.orchestra.run.smithi062.stdout:052.out 2023-06-09T04:45:46.836 INFO:teuthology.orchestra.run.smithi062.stdout:053 2023-06-09T04:45:46.836 INFO:teuthology.orchestra.run.smithi062.stdout:053.out 2023-06-09T04:45:46.836 INFO:teuthology.orchestra.run.smithi062.stdout:054 2023-06-09T04:45:46.836 INFO:teuthology.orchestra.run.smithi062.stdout:054.out 2023-06-09T04:45:46.836 INFO:teuthology.orchestra.run.smithi062.stdout:055 2023-06-09T04:45:46.837 INFO:teuthology.orchestra.run.smithi062.stdout:055.out 2023-06-09T04:45:46.837 INFO:teuthology.orchestra.run.smithi062.stdout:056 2023-06-09T04:45:46.837 INFO:teuthology.orchestra.run.smithi062.stdout:056.out 2023-06-09T04:45:46.837 INFO:teuthology.orchestra.run.smithi062.stdout:057 2023-06-09T04:45:46.837 INFO:teuthology.orchestra.run.smithi062.stdout:057.out 2023-06-09T04:45:46.837 INFO:teuthology.orchestra.run.smithi062.stdout:058 2023-06-09T04:45:46.837 INFO:teuthology.orchestra.run.smithi062.stdout:058.out 2023-06-09T04:45:46.837 INFO:teuthology.orchestra.run.smithi062.stdout:059 2023-06-09T04:45:46.838 INFO:teuthology.orchestra.run.smithi062.stdout:059.out 2023-06-09T04:45:46.838 INFO:teuthology.orchestra.run.smithi062.stdout:060 2023-06-09T04:45:46.838 INFO:teuthology.orchestra.run.smithi062.stdout:060.out 2023-06-09T04:45:46.838 INFO:teuthology.orchestra.run.smithi062.stdout:061 2023-06-09T04:45:46.838 INFO:teuthology.orchestra.run.smithi062.stdout:061.out 2023-06-09T04:45:46.838 INFO:teuthology.orchestra.run.smithi062.stdout:062 2023-06-09T04:45:46.838 INFO:teuthology.orchestra.run.smithi062.stdout:062.out 2023-06-09T04:45:46.838 INFO:teuthology.orchestra.run.smithi062.stdout:063 2023-06-09T04:45:46.839 INFO:teuthology.orchestra.run.smithi062.stdout:063.out 2023-06-09T04:45:46.839 INFO:teuthology.orchestra.run.smithi062.stdout:064 2023-06-09T04:45:46.839 INFO:teuthology.orchestra.run.smithi062.stdout:064.out 2023-06-09T04:45:46.839 INFO:teuthology.orchestra.run.smithi062.stdout:065 2023-06-09T04:45:46.839 INFO:teuthology.orchestra.run.smithi062.stdout:065.out 2023-06-09T04:45:46.839 INFO:teuthology.orchestra.run.smithi062.stdout:066 2023-06-09T04:45:46.839 INFO:teuthology.orchestra.run.smithi062.stdout:066.out 2023-06-09T04:45:46.839 INFO:teuthology.orchestra.run.smithi062.stdout:067 2023-06-09T04:45:46.840 INFO:teuthology.orchestra.run.smithi062.stdout:067.out 2023-06-09T04:45:46.840 INFO:teuthology.orchestra.run.smithi062.stdout:068 2023-06-09T04:45:46.840 INFO:teuthology.orchestra.run.smithi062.stdout:068.out 2023-06-09T04:45:46.840 INFO:teuthology.orchestra.run.smithi062.stdout:069 2023-06-09T04:45:46.840 INFO:teuthology.orchestra.run.smithi062.stdout:069.out 2023-06-09T04:45:46.840 INFO:teuthology.orchestra.run.smithi062.stdout:070 2023-06-09T04:45:46.840 INFO:teuthology.orchestra.run.smithi062.stdout:070.out 2023-06-09T04:45:46.840 INFO:teuthology.orchestra.run.smithi062.stdout:071 2023-06-09T04:45:46.841 INFO:teuthology.orchestra.run.smithi062.stdout:071.out 2023-06-09T04:45:46.841 INFO:teuthology.orchestra.run.smithi062.stdout:072 2023-06-09T04:45:46.841 INFO:teuthology.orchestra.run.smithi062.stdout:072.out 2023-06-09T04:45:46.841 INFO:teuthology.orchestra.run.smithi062.stdout:073 2023-06-09T04:45:46.841 INFO:teuthology.orchestra.run.smithi062.stdout:073.out 2023-06-09T04:45:46.841 INFO:teuthology.orchestra.run.smithi062.stdout:074 2023-06-09T04:45:46.841 INFO:teuthology.orchestra.run.smithi062.stdout:074.out 2023-06-09T04:45:46.841 INFO:teuthology.orchestra.run.smithi062.stdout:075 2023-06-09T04:45:46.842 INFO:teuthology.orchestra.run.smithi062.stdout:075.out 2023-06-09T04:45:46.842 INFO:teuthology.orchestra.run.smithi062.stdout:076 2023-06-09T04:45:46.842 INFO:teuthology.orchestra.run.smithi062.stdout:076.out 2023-06-09T04:45:46.842 INFO:teuthology.orchestra.run.smithi062.stdout:077 2023-06-09T04:45:46.842 INFO:teuthology.orchestra.run.smithi062.stdout:077.out 2023-06-09T04:45:46.842 INFO:teuthology.orchestra.run.smithi062.stdout:078 2023-06-09T04:45:46.842 INFO:teuthology.orchestra.run.smithi062.stdout:078.out 2023-06-09T04:45:46.842 INFO:teuthology.orchestra.run.smithi062.stdout:079 2023-06-09T04:45:46.843 INFO:teuthology.orchestra.run.smithi062.stdout:079.out 2023-06-09T04:45:46.843 INFO:teuthology.orchestra.run.smithi062.stdout:080 2023-06-09T04:45:46.843 INFO:teuthology.orchestra.run.smithi062.stdout:080.out 2023-06-09T04:45:46.843 INFO:teuthology.orchestra.run.smithi062.stdout:081 2023-06-09T04:45:46.843 INFO:teuthology.orchestra.run.smithi062.stdout:081.out 2023-06-09T04:45:46.843 INFO:teuthology.orchestra.run.smithi062.stdout:082 2023-06-09T04:45:46.843 INFO:teuthology.orchestra.run.smithi062.stdout:082.out 2023-06-09T04:45:46.843 INFO:teuthology.orchestra.run.smithi062.stdout:083 2023-06-09T04:45:46.844 INFO:teuthology.orchestra.run.smithi062.stdout:083.out 2023-06-09T04:45:46.844 INFO:teuthology.orchestra.run.smithi062.stdout:084 2023-06-09T04:45:46.844 INFO:teuthology.orchestra.run.smithi062.stdout:084.out 2023-06-09T04:45:46.844 INFO:teuthology.orchestra.run.smithi062.stdout:085 2023-06-09T04:45:46.844 INFO:teuthology.orchestra.run.smithi062.stdout:085.out 2023-06-09T04:45:46.844 INFO:teuthology.orchestra.run.smithi062.stdout:086 2023-06-09T04:45:46.844 INFO:teuthology.orchestra.run.smithi062.stdout:086.out 2023-06-09T04:45:46.844 INFO:teuthology.orchestra.run.smithi062.stdout:087 2023-06-09T04:45:46.845 INFO:teuthology.orchestra.run.smithi062.stdout:087.out 2023-06-09T04:45:46.845 INFO:teuthology.orchestra.run.smithi062.stdout:088 2023-06-09T04:45:46.845 INFO:teuthology.orchestra.run.smithi062.stdout:088.out 2023-06-09T04:45:46.845 INFO:teuthology.orchestra.run.smithi062.stdout:089 2023-06-09T04:45:46.845 INFO:teuthology.orchestra.run.smithi062.stdout:089.out 2023-06-09T04:45:46.845 INFO:teuthology.orchestra.run.smithi062.stdout:090 2023-06-09T04:45:46.845 INFO:teuthology.orchestra.run.smithi062.stdout:090.out 2023-06-09T04:45:46.845 INFO:teuthology.orchestra.run.smithi062.stdout:091 2023-06-09T04:45:46.846 INFO:teuthology.orchestra.run.smithi062.stdout:091.out 2023-06-09T04:45:46.846 INFO:teuthology.orchestra.run.smithi062.stdout:092 2023-06-09T04:45:46.846 INFO:teuthology.orchestra.run.smithi062.stdout:092.out 2023-06-09T04:45:46.846 INFO:teuthology.orchestra.run.smithi062.stdout:093 2023-06-09T04:45:46.846 INFO:teuthology.orchestra.run.smithi062.stdout:093.out 2023-06-09T04:45:46.846 INFO:teuthology.orchestra.run.smithi062.stdout:094 2023-06-09T04:45:46.846 INFO:teuthology.orchestra.run.smithi062.stdout:094.out 2023-06-09T04:45:46.846 INFO:teuthology.orchestra.run.smithi062.stdout:095 2023-06-09T04:45:46.847 INFO:teuthology.orchestra.run.smithi062.stdout:095.out 2023-06-09T04:45:46.847 INFO:teuthology.orchestra.run.smithi062.stdout:096 2023-06-09T04:45:46.847 INFO:teuthology.orchestra.run.smithi062.stdout:096.out 2023-06-09T04:45:46.847 INFO:teuthology.orchestra.run.smithi062.stdout:097 2023-06-09T04:45:46.847 INFO:teuthology.orchestra.run.smithi062.stdout:097.out 2023-06-09T04:45:46.847 INFO:teuthology.orchestra.run.smithi062.stdout:098 2023-06-09T04:45:46.847 INFO:teuthology.orchestra.run.smithi062.stdout:098.out 2023-06-09T04:45:46.847 INFO:teuthology.orchestra.run.smithi062.stdout:099 2023-06-09T04:45:46.848 INFO:teuthology.orchestra.run.smithi062.stdout:099.out 2023-06-09T04:45:46.848 INFO:teuthology.orchestra.run.smithi062.stdout:100 2023-06-09T04:45:46.848 INFO:teuthology.orchestra.run.smithi062.stdout:100.out 2023-06-09T04:45:46.848 INFO:teuthology.orchestra.run.smithi062.stdout:101 2023-06-09T04:45:46.848 INFO:teuthology.orchestra.run.smithi062.stdout:101.out 2023-06-09T04:45:46.848 INFO:teuthology.orchestra.run.smithi062.stdout:102 2023-06-09T04:45:46.848 INFO:teuthology.orchestra.run.smithi062.stdout:102.out 2023-06-09T04:45:46.849 INFO:teuthology.orchestra.run.smithi062.stdout:103 2023-06-09T04:45:46.849 INFO:teuthology.orchestra.run.smithi062.stdout:103.out 2023-06-09T04:45:46.849 INFO:teuthology.orchestra.run.smithi062.stdout:104 2023-06-09T04:45:46.849 INFO:teuthology.orchestra.run.smithi062.stdout:104.out 2023-06-09T04:45:46.849 INFO:teuthology.orchestra.run.smithi062.stdout:105 2023-06-09T04:45:46.849 INFO:teuthology.orchestra.run.smithi062.stdout:105.out 2023-06-09T04:45:46.849 INFO:teuthology.orchestra.run.smithi062.stdout:106 2023-06-09T04:45:46.849 INFO:teuthology.orchestra.run.smithi062.stdout:106.out 2023-06-09T04:45:46.850 INFO:teuthology.orchestra.run.smithi062.stdout:107 2023-06-09T04:45:46.850 INFO:teuthology.orchestra.run.smithi062.stdout:107.out 2023-06-09T04:45:46.850 INFO:teuthology.orchestra.run.smithi062.stdout:108 2023-06-09T04:45:46.850 INFO:teuthology.orchestra.run.smithi062.stdout:108.out 2023-06-09T04:45:46.850 INFO:teuthology.orchestra.run.smithi062.stdout:109 2023-06-09T04:45:46.850 INFO:teuthology.orchestra.run.smithi062.stdout:109.out 2023-06-09T04:45:46.850 INFO:teuthology.orchestra.run.smithi062.stdout:110 2023-06-09T04:45:46.850 INFO:teuthology.orchestra.run.smithi062.stdout:110.out 2023-06-09T04:45:46.851 INFO:teuthology.orchestra.run.smithi062.stdout:111 2023-06-09T04:45:46.851 INFO:teuthology.orchestra.run.smithi062.stdout:111.out 2023-06-09T04:45:46.851 INFO:teuthology.orchestra.run.smithi062.stdout:112 2023-06-09T04:45:46.851 INFO:teuthology.orchestra.run.smithi062.stdout:112.out 2023-06-09T04:45:46.851 INFO:teuthology.orchestra.run.smithi062.stdout:113 2023-06-09T04:45:46.851 INFO:teuthology.orchestra.run.smithi062.stdout:113.out 2023-06-09T04:45:46.851 INFO:teuthology.orchestra.run.smithi062.stdout:114 2023-06-09T04:45:46.851 INFO:teuthology.orchestra.run.smithi062.stdout:114.out 2023-06-09T04:45:46.852 INFO:teuthology.orchestra.run.smithi062.stdout:115 2023-06-09T04:45:46.852 INFO:teuthology.orchestra.run.smithi062.stdout:115.out 2023-06-09T04:45:46.852 INFO:teuthology.orchestra.run.smithi062.stdout:116 2023-06-09T04:45:46.852 INFO:teuthology.orchestra.run.smithi062.stdout:116.out 2023-06-09T04:45:46.852 INFO:teuthology.orchestra.run.smithi062.stdout:117 2023-06-09T04:45:46.852 INFO:teuthology.orchestra.run.smithi062.stdout:117.out 2023-06-09T04:45:46.852 INFO:teuthology.orchestra.run.smithi062.stdout:118 2023-06-09T04:45:46.852 INFO:teuthology.orchestra.run.smithi062.stdout:118.out 2023-06-09T04:45:46.853 INFO:teuthology.orchestra.run.smithi062.stdout:119 2023-06-09T04:45:46.853 INFO:teuthology.orchestra.run.smithi062.stdout:119.out 2023-06-09T04:45:46.853 INFO:teuthology.orchestra.run.smithi062.stdout:120 2023-06-09T04:45:46.853 INFO:teuthology.orchestra.run.smithi062.stdout:120.out 2023-06-09T04:45:46.853 INFO:teuthology.orchestra.run.smithi062.stdout:121 2023-06-09T04:45:46.853 INFO:teuthology.orchestra.run.smithi062.stdout:121.out 2023-06-09T04:45:46.853 INFO:teuthology.orchestra.run.smithi062.stdout:122 2023-06-09T04:45:46.853 INFO:teuthology.orchestra.run.smithi062.stdout:122.out 2023-06-09T04:45:46.854 INFO:teuthology.orchestra.run.smithi062.stdout:123 2023-06-09T04:45:46.854 INFO:teuthology.orchestra.run.smithi062.stdout:123.out 2023-06-09T04:45:46.854 INFO:teuthology.orchestra.run.smithi062.stdout:124 2023-06-09T04:45:46.854 INFO:teuthology.orchestra.run.smithi062.stdout:124.out 2023-06-09T04:45:46.854 INFO:teuthology.orchestra.run.smithi062.stdout:125 2023-06-09T04:45:46.854 INFO:teuthology.orchestra.run.smithi062.stdout:125.out 2023-06-09T04:45:46.854 INFO:teuthology.orchestra.run.smithi062.stdout:126 2023-06-09T04:45:46.854 INFO:teuthology.orchestra.run.smithi062.stdout:126.out 2023-06-09T04:45:46.855 INFO:teuthology.orchestra.run.smithi062.stdout:127 2023-06-09T04:45:46.855 INFO:teuthology.orchestra.run.smithi062.stdout:127.out 2023-06-09T04:45:46.855 INFO:teuthology.orchestra.run.smithi062.stdout:128 2023-06-09T04:45:46.855 INFO:teuthology.orchestra.run.smithi062.stdout:128.out 2023-06-09T04:45:46.855 INFO:teuthology.orchestra.run.smithi062.stdout:129 2023-06-09T04:45:46.855 INFO:teuthology.orchestra.run.smithi062.stdout:129.out 2023-06-09T04:45:46.855 INFO:teuthology.orchestra.run.smithi062.stdout:130 2023-06-09T04:45:46.855 INFO:teuthology.orchestra.run.smithi062.stdout:130.out 2023-06-09T04:45:46.856 INFO:teuthology.orchestra.run.smithi062.stdout:131 2023-06-09T04:45:46.856 INFO:teuthology.orchestra.run.smithi062.stdout:131.out 2023-06-09T04:45:46.856 INFO:teuthology.orchestra.run.smithi062.stdout:132 2023-06-09T04:45:46.856 INFO:teuthology.orchestra.run.smithi062.stdout:132.out 2023-06-09T04:45:46.856 INFO:teuthology.orchestra.run.smithi062.stdout:133 2023-06-09T04:45:46.856 INFO:teuthology.orchestra.run.smithi062.stdout:133.out 2023-06-09T04:45:46.856 INFO:teuthology.orchestra.run.smithi062.stdout:134 2023-06-09T04:45:46.856 INFO:teuthology.orchestra.run.smithi062.stdout:134.out 2023-06-09T04:45:46.857 INFO:teuthology.orchestra.run.smithi062.stdout:135 2023-06-09T04:45:46.857 INFO:teuthology.orchestra.run.smithi062.stdout:135.out 2023-06-09T04:45:46.857 INFO:teuthology.orchestra.run.smithi062.stdout:136 2023-06-09T04:45:46.857 INFO:teuthology.orchestra.run.smithi062.stdout:136.out 2023-06-09T04:45:46.857 INFO:teuthology.orchestra.run.smithi062.stdout:137 2023-06-09T04:45:46.857 INFO:teuthology.orchestra.run.smithi062.stdout:137.out 2023-06-09T04:45:46.857 INFO:teuthology.orchestra.run.smithi062.stdout:138 2023-06-09T04:45:46.857 INFO:teuthology.orchestra.run.smithi062.stdout:138.out 2023-06-09T04:45:46.858 INFO:teuthology.orchestra.run.smithi062.stdout:139 2023-06-09T04:45:46.858 INFO:teuthology.orchestra.run.smithi062.stdout:139.out 2023-06-09T04:45:46.858 INFO:teuthology.orchestra.run.smithi062.stdout:140 2023-06-09T04:45:46.858 INFO:teuthology.orchestra.run.smithi062.stdout:140.out 2023-06-09T04:45:46.858 INFO:teuthology.orchestra.run.smithi062.stdout:141 2023-06-09T04:45:46.858 INFO:teuthology.orchestra.run.smithi062.stdout:141.out 2023-06-09T04:45:46.858 INFO:teuthology.orchestra.run.smithi062.stdout:142 2023-06-09T04:45:46.858 INFO:teuthology.orchestra.run.smithi062.stdout:142.out 2023-06-09T04:45:46.859 INFO:teuthology.orchestra.run.smithi062.stdout:143 2023-06-09T04:45:46.859 INFO:teuthology.orchestra.run.smithi062.stdout:143.out 2023-06-09T04:45:46.859 INFO:teuthology.orchestra.run.smithi062.stdout:144 2023-06-09T04:45:46.859 INFO:teuthology.orchestra.run.smithi062.stdout:144.out 2023-06-09T04:45:46.859 INFO:teuthology.orchestra.run.smithi062.stdout:145 2023-06-09T04:45:46.859 INFO:teuthology.orchestra.run.smithi062.stdout:145.out 2023-06-09T04:45:46.859 INFO:teuthology.orchestra.run.smithi062.stdout:146 2023-06-09T04:45:46.859 INFO:teuthology.orchestra.run.smithi062.stdout:146.out 2023-06-09T04:45:46.860 INFO:teuthology.orchestra.run.smithi062.stdout:147 2023-06-09T04:45:46.860 INFO:teuthology.orchestra.run.smithi062.stdout:147.out 2023-06-09T04:45:46.860 INFO:teuthology.orchestra.run.smithi062.stdout:148 2023-06-09T04:45:46.860 INFO:teuthology.orchestra.run.smithi062.stdout:148.out 2023-06-09T04:45:46.860 INFO:teuthology.orchestra.run.smithi062.stdout:149 2023-06-09T04:45:46.860 INFO:teuthology.orchestra.run.smithi062.stdout:149.out 2023-06-09T04:45:46.860 INFO:teuthology.orchestra.run.smithi062.stdout:150 2023-06-09T04:45:46.860 INFO:teuthology.orchestra.run.smithi062.stdout:150.out 2023-06-09T04:45:46.861 INFO:teuthology.orchestra.run.smithi062.stdout:151 2023-06-09T04:45:46.861 INFO:teuthology.orchestra.run.smithi062.stdout:151.out 2023-06-09T04:45:46.861 INFO:teuthology.orchestra.run.smithi062.stdout:152 2023-06-09T04:45:46.861 INFO:teuthology.orchestra.run.smithi062.stdout:152.out 2023-06-09T04:45:46.861 INFO:teuthology.orchestra.run.smithi062.stdout:153 2023-06-09T04:45:46.861 INFO:teuthology.orchestra.run.smithi062.stdout:153.out 2023-06-09T04:45:46.861 INFO:teuthology.orchestra.run.smithi062.stdout:154 2023-06-09T04:45:46.861 INFO:teuthology.orchestra.run.smithi062.stdout:154.out 2023-06-09T04:45:46.862 INFO:teuthology.orchestra.run.smithi062.stdout:155 2023-06-09T04:45:46.862 INFO:teuthology.orchestra.run.smithi062.stdout:155.out 2023-06-09T04:45:46.862 INFO:teuthology.orchestra.run.smithi062.stdout:156 2023-06-09T04:45:46.862 INFO:teuthology.orchestra.run.smithi062.stdout:156.out 2023-06-09T04:45:46.862 INFO:teuthology.orchestra.run.smithi062.stdout:157 2023-06-09T04:45:46.862 INFO:teuthology.orchestra.run.smithi062.stdout:157.out 2023-06-09T04:45:46.862 INFO:teuthology.orchestra.run.smithi062.stdout:158 2023-06-09T04:45:46.862 INFO:teuthology.orchestra.run.smithi062.stdout:158.out 2023-06-09T04:45:46.863 INFO:teuthology.orchestra.run.smithi062.stdout:159 2023-06-09T04:45:46.863 INFO:teuthology.orchestra.run.smithi062.stdout:159.out 2023-06-09T04:45:46.863 INFO:teuthology.orchestra.run.smithi062.stdout:160 2023-06-09T04:45:46.863 INFO:teuthology.orchestra.run.smithi062.stdout:160.out 2023-06-09T04:45:46.863 INFO:teuthology.orchestra.run.smithi062.stdout:161 2023-06-09T04:45:46.863 INFO:teuthology.orchestra.run.smithi062.stdout:161.out 2023-06-09T04:45:46.863 INFO:teuthology.orchestra.run.smithi062.stdout:162 2023-06-09T04:45:46.863 INFO:teuthology.orchestra.run.smithi062.stdout:162.out 2023-06-09T04:45:46.864 INFO:teuthology.orchestra.run.smithi062.stdout:163 2023-06-09T04:45:46.864 INFO:teuthology.orchestra.run.smithi062.stdout:163.out 2023-06-09T04:45:46.864 INFO:teuthology.orchestra.run.smithi062.stdout:164 2023-06-09T04:45:46.864 INFO:teuthology.orchestra.run.smithi062.stdout:164.out 2023-06-09T04:45:46.864 INFO:teuthology.orchestra.run.smithi062.stdout:165 2023-06-09T04:45:46.864 INFO:teuthology.orchestra.run.smithi062.stdout:165.out 2023-06-09T04:45:46.864 INFO:teuthology.orchestra.run.smithi062.stdout:166 2023-06-09T04:45:46.865 INFO:teuthology.orchestra.run.smithi062.stdout:166.out 2023-06-09T04:45:46.865 INFO:teuthology.orchestra.run.smithi062.stdout:167 2023-06-09T04:45:46.865 INFO:teuthology.orchestra.run.smithi062.stdout:167.out 2023-06-09T04:45:46.865 INFO:teuthology.orchestra.run.smithi062.stdout:168 2023-06-09T04:45:46.865 INFO:teuthology.orchestra.run.smithi062.stdout:168.out 2023-06-09T04:45:46.865 INFO:teuthology.orchestra.run.smithi062.stdout:169 2023-06-09T04:45:46.865 INFO:teuthology.orchestra.run.smithi062.stdout:169.out 2023-06-09T04:45:46.865 INFO:teuthology.orchestra.run.smithi062.stdout:170 2023-06-09T04:45:46.866 INFO:teuthology.orchestra.run.smithi062.stdout:170.out 2023-06-09T04:45:46.866 INFO:teuthology.orchestra.run.smithi062.stdout:171 2023-06-09T04:45:46.866 INFO:teuthology.orchestra.run.smithi062.stdout:171.out 2023-06-09T04:45:46.866 INFO:teuthology.orchestra.run.smithi062.stdout:172 2023-06-09T04:45:46.866 INFO:teuthology.orchestra.run.smithi062.stdout:172.out 2023-06-09T04:45:46.866 INFO:teuthology.orchestra.run.smithi062.stdout:173 2023-06-09T04:45:46.866 INFO:teuthology.orchestra.run.smithi062.stdout:173.out 2023-06-09T04:45:46.866 INFO:teuthology.orchestra.run.smithi062.stdout:174 2023-06-09T04:45:46.867 INFO:teuthology.orchestra.run.smithi062.stdout:174.out 2023-06-09T04:45:46.867 INFO:teuthology.orchestra.run.smithi062.stdout:175 2023-06-09T04:45:46.867 INFO:teuthology.orchestra.run.smithi062.stdout:175.out 2023-06-09T04:45:46.867 INFO:teuthology.orchestra.run.smithi062.stdout:176 2023-06-09T04:45:46.867 INFO:teuthology.orchestra.run.smithi062.stdout:176.out 2023-06-09T04:45:46.867 INFO:teuthology.orchestra.run.smithi062.stdout:177 2023-06-09T04:45:46.867 INFO:teuthology.orchestra.run.smithi062.stdout:177.out 2023-06-09T04:45:46.867 INFO:teuthology.orchestra.run.smithi062.stdout:178 2023-06-09T04:45:46.868 INFO:teuthology.orchestra.run.smithi062.stdout:178.out 2023-06-09T04:45:46.868 INFO:teuthology.orchestra.run.smithi062.stdout:179 2023-06-09T04:45:46.868 INFO:teuthology.orchestra.run.smithi062.stdout:179.out 2023-06-09T04:45:46.868 INFO:teuthology.orchestra.run.smithi062.stdout:180 2023-06-09T04:45:46.868 INFO:teuthology.orchestra.run.smithi062.stdout:180.out 2023-06-09T04:45:46.868 INFO:teuthology.orchestra.run.smithi062.stdout:181 2023-06-09T04:45:46.868 INFO:teuthology.orchestra.run.smithi062.stdout:181.out 2023-06-09T04:45:46.868 INFO:teuthology.orchestra.run.smithi062.stdout:182 2023-06-09T04:45:46.869 INFO:teuthology.orchestra.run.smithi062.stdout:182.out 2023-06-09T04:45:46.869 INFO:teuthology.orchestra.run.smithi062.stdout:183 2023-06-09T04:45:46.869 INFO:teuthology.orchestra.run.smithi062.stdout:183.out 2023-06-09T04:45:46.869 INFO:teuthology.orchestra.run.smithi062.stdout:184 2023-06-09T04:45:46.869 INFO:teuthology.orchestra.run.smithi062.stdout:184.out 2023-06-09T04:45:46.869 INFO:teuthology.orchestra.run.smithi062.stdout:185 2023-06-09T04:45:46.869 INFO:teuthology.orchestra.run.smithi062.stdout:185.out 2023-06-09T04:45:46.869 INFO:teuthology.orchestra.run.smithi062.stdout:186 2023-06-09T04:45:46.870 INFO:teuthology.orchestra.run.smithi062.stdout:186.out 2023-06-09T04:45:46.870 INFO:teuthology.orchestra.run.smithi062.stdout:187 2023-06-09T04:45:46.870 INFO:teuthology.orchestra.run.smithi062.stdout:187.out 2023-06-09T04:45:46.870 INFO:teuthology.orchestra.run.smithi062.stdout:188 2023-06-09T04:45:46.870 INFO:teuthology.orchestra.run.smithi062.stdout:188.out 2023-06-09T04:45:46.870 INFO:teuthology.orchestra.run.smithi062.stdout:189 2023-06-09T04:45:46.870 INFO:teuthology.orchestra.run.smithi062.stdout:189.out 2023-06-09T04:45:46.870 INFO:teuthology.orchestra.run.smithi062.stdout:190 2023-06-09T04:45:46.871 INFO:teuthology.orchestra.run.smithi062.stdout:190.out 2023-06-09T04:45:46.871 INFO:teuthology.orchestra.run.smithi062.stdout:191 2023-06-09T04:45:46.871 INFO:teuthology.orchestra.run.smithi062.stdout:191.out 2023-06-09T04:45:46.871 INFO:teuthology.orchestra.run.smithi062.stdout:192 2023-06-09T04:45:46.871 INFO:teuthology.orchestra.run.smithi062.stdout:192.out 2023-06-09T04:45:46.871 INFO:teuthology.orchestra.run.smithi062.stdout:193 2023-06-09T04:45:46.871 INFO:teuthology.orchestra.run.smithi062.stdout:193.out 2023-06-09T04:45:46.871 INFO:teuthology.orchestra.run.smithi062.stdout:194 2023-06-09T04:45:46.872 INFO:teuthology.orchestra.run.smithi062.stdout:194.out 2023-06-09T04:45:46.872 INFO:teuthology.orchestra.run.smithi062.stdout:195 2023-06-09T04:45:46.872 INFO:teuthology.orchestra.run.smithi062.stdout:195.out 2023-06-09T04:45:46.872 INFO:teuthology.orchestra.run.smithi062.stdout:196 2023-06-09T04:45:46.872 INFO:teuthology.orchestra.run.smithi062.stdout:196.out 2023-06-09T04:45:46.872 INFO:teuthology.orchestra.run.smithi062.stdout:197 2023-06-09T04:45:46.872 INFO:teuthology.orchestra.run.smithi062.stdout:197.out 2023-06-09T04:45:46.872 INFO:teuthology.orchestra.run.smithi062.stdout:198 2023-06-09T04:45:46.873 INFO:teuthology.orchestra.run.smithi062.stdout:198.out 2023-06-09T04:45:46.873 INFO:teuthology.orchestra.run.smithi062.stdout:199 2023-06-09T04:45:46.873 INFO:teuthology.orchestra.run.smithi062.stdout:199.out 2023-06-09T04:45:46.873 INFO:teuthology.orchestra.run.smithi062.stdout:200 2023-06-09T04:45:46.873 INFO:teuthology.orchestra.run.smithi062.stdout:200.out 2023-06-09T04:45:46.873 INFO:teuthology.orchestra.run.smithi062.stdout:201 2023-06-09T04:45:46.873 INFO:teuthology.orchestra.run.smithi062.stdout:201.out 2023-06-09T04:45:46.873 INFO:teuthology.orchestra.run.smithi062.stdout:202 2023-06-09T04:45:46.874 INFO:teuthology.orchestra.run.smithi062.stdout:202.out 2023-06-09T04:45:46.874 INFO:teuthology.orchestra.run.smithi062.stdout:203 2023-06-09T04:45:46.874 INFO:teuthology.orchestra.run.smithi062.stdout:203.out 2023-06-09T04:45:46.874 INFO:teuthology.orchestra.run.smithi062.stdout:204 2023-06-09T04:45:46.874 INFO:teuthology.orchestra.run.smithi062.stdout:204.out 2023-06-09T04:45:46.874 INFO:teuthology.orchestra.run.smithi062.stdout:205 2023-06-09T04:45:46.874 INFO:teuthology.orchestra.run.smithi062.stdout:205.out 2023-06-09T04:45:46.874 INFO:teuthology.orchestra.run.smithi062.stdout:206 2023-06-09T04:45:46.875 INFO:teuthology.orchestra.run.smithi062.stdout:206.out 2023-06-09T04:45:46.875 INFO:teuthology.orchestra.run.smithi062.stdout:207 2023-06-09T04:45:46.875 INFO:teuthology.orchestra.run.smithi062.stdout:207.out 2023-06-09T04:45:46.875 INFO:teuthology.orchestra.run.smithi062.stdout:208 2023-06-09T04:45:46.875 INFO:teuthology.orchestra.run.smithi062.stdout:208.out 2023-06-09T04:45:46.875 INFO:teuthology.orchestra.run.smithi062.stdout:209 2023-06-09T04:45:46.875 INFO:teuthology.orchestra.run.smithi062.stdout:209.out 2023-06-09T04:45:46.875 INFO:teuthology.orchestra.run.smithi062.stdout:210 2023-06-09T04:45:46.876 INFO:teuthology.orchestra.run.smithi062.stdout:210.out 2023-06-09T04:45:46.876 INFO:teuthology.orchestra.run.smithi062.stdout:211 2023-06-09T04:45:46.876 INFO:teuthology.orchestra.run.smithi062.stdout:211.out 2023-06-09T04:45:46.876 INFO:teuthology.orchestra.run.smithi062.stdout:212 2023-06-09T04:45:46.876 INFO:teuthology.orchestra.run.smithi062.stdout:212.out 2023-06-09T04:45:46.876 INFO:teuthology.orchestra.run.smithi062.stdout:213 2023-06-09T04:45:46.876 INFO:teuthology.orchestra.run.smithi062.stdout:213.out 2023-06-09T04:45:46.876 INFO:teuthology.orchestra.run.smithi062.stdout:214 2023-06-09T04:45:46.877 INFO:teuthology.orchestra.run.smithi062.stdout:214.out 2023-06-09T04:45:46.877 INFO:teuthology.orchestra.run.smithi062.stdout:215 2023-06-09T04:45:46.877 INFO:teuthology.orchestra.run.smithi062.stdout:215.out 2023-06-09T04:45:46.877 INFO:teuthology.orchestra.run.smithi062.stdout:216 2023-06-09T04:45:46.877 INFO:teuthology.orchestra.run.smithi062.stdout:216.out 2023-06-09T04:45:46.877 INFO:teuthology.orchestra.run.smithi062.stdout:217 2023-06-09T04:45:46.877 INFO:teuthology.orchestra.run.smithi062.stdout:217.out 2023-06-09T04:45:46.877 INFO:teuthology.orchestra.run.smithi062.stdout:218 2023-06-09T04:45:46.878 INFO:teuthology.orchestra.run.smithi062.stdout:218.out 2023-06-09T04:45:46.878 INFO:teuthology.orchestra.run.smithi062.stdout:219 2023-06-09T04:45:46.878 INFO:teuthology.orchestra.run.smithi062.stdout:219.out 2023-06-09T04:45:46.878 INFO:teuthology.orchestra.run.smithi062.stdout:220 2023-06-09T04:45:46.878 INFO:teuthology.orchestra.run.smithi062.stdout:220.out 2023-06-09T04:45:46.878 INFO:teuthology.orchestra.run.smithi062.stdout:221 2023-06-09T04:45:46.878 INFO:teuthology.orchestra.run.smithi062.stdout:221.out 2023-06-09T04:45:46.878 INFO:teuthology.orchestra.run.smithi062.stdout:222 2023-06-09T04:45:46.879 INFO:teuthology.orchestra.run.smithi062.stdout:222.out 2023-06-09T04:45:46.879 INFO:teuthology.orchestra.run.smithi062.stdout:223 2023-06-09T04:45:46.879 INFO:teuthology.orchestra.run.smithi062.stdout:223.out 2023-06-09T04:45:46.879 INFO:teuthology.orchestra.run.smithi062.stdout:224 2023-06-09T04:45:46.879 INFO:teuthology.orchestra.run.smithi062.stdout:224.out 2023-06-09T04:45:46.879 INFO:teuthology.orchestra.run.smithi062.stdout:225 2023-06-09T04:45:46.879 INFO:teuthology.orchestra.run.smithi062.stdout:225.out 2023-06-09T04:45:46.879 INFO:teuthology.orchestra.run.smithi062.stdout:226 2023-06-09T04:45:46.880 INFO:teuthology.orchestra.run.smithi062.stdout:226.out 2023-06-09T04:45:46.880 INFO:teuthology.orchestra.run.smithi062.stdout:227 2023-06-09T04:45:46.880 INFO:teuthology.orchestra.run.smithi062.stdout:227.out 2023-06-09T04:45:46.880 INFO:teuthology.orchestra.run.smithi062.stdout:228 2023-06-09T04:45:46.880 INFO:teuthology.orchestra.run.smithi062.stdout:228.out 2023-06-09T04:45:46.880 INFO:teuthology.orchestra.run.smithi062.stdout:229 2023-06-09T04:45:46.880 INFO:teuthology.orchestra.run.smithi062.stdout:229.out 2023-06-09T04:45:46.881 INFO:teuthology.orchestra.run.smithi062.stdout:230 2023-06-09T04:45:46.881 INFO:teuthology.orchestra.run.smithi062.stdout:230.out 2023-06-09T04:45:46.881 INFO:teuthology.orchestra.run.smithi062.stdout:231 2023-06-09T04:45:46.881 INFO:teuthology.orchestra.run.smithi062.stdout:231.out 2023-06-09T04:45:46.881 INFO:teuthology.orchestra.run.smithi062.stdout:232 2023-06-09T04:45:46.881 INFO:teuthology.orchestra.run.smithi062.stdout:232.out 2023-06-09T04:45:46.881 INFO:teuthology.orchestra.run.smithi062.stdout:233 2023-06-09T04:45:46.881 INFO:teuthology.orchestra.run.smithi062.stdout:233.out 2023-06-09T04:45:46.881 INFO:teuthology.orchestra.run.smithi062.stdout:234 2023-06-09T04:45:46.882 INFO:teuthology.orchestra.run.smithi062.stdout:234.out 2023-06-09T04:45:46.882 INFO:teuthology.orchestra.run.smithi062.stdout:235 2023-06-09T04:45:46.882 INFO:teuthology.orchestra.run.smithi062.stdout:235.out 2023-06-09T04:45:46.882 INFO:teuthology.orchestra.run.smithi062.stdout:236 2023-06-09T04:45:46.882 INFO:teuthology.orchestra.run.smithi062.stdout:236.out 2023-06-09T04:45:46.882 INFO:teuthology.orchestra.run.smithi062.stdout:237 2023-06-09T04:45:46.882 INFO:teuthology.orchestra.run.smithi062.stdout:237.out 2023-06-09T04:45:46.882 INFO:teuthology.orchestra.run.smithi062.stdout:238 2023-06-09T04:45:46.883 INFO:teuthology.orchestra.run.smithi062.stdout:238.out 2023-06-09T04:45:46.883 INFO:teuthology.orchestra.run.smithi062.stdout:239 2023-06-09T04:45:46.883 INFO:teuthology.orchestra.run.smithi062.stdout:239.out 2023-06-09T04:45:46.883 INFO:teuthology.orchestra.run.smithi062.stdout:240 2023-06-09T04:45:46.883 INFO:teuthology.orchestra.run.smithi062.stdout:240.out 2023-06-09T04:45:46.883 INFO:teuthology.orchestra.run.smithi062.stdout:241 2023-06-09T04:45:46.883 INFO:teuthology.orchestra.run.smithi062.stdout:241.out 2023-06-09T04:45:46.884 INFO:teuthology.orchestra.run.smithi062.stdout:242 2023-06-09T04:45:46.884 INFO:teuthology.orchestra.run.smithi062.stdout:242.out 2023-06-09T04:45:46.884 INFO:teuthology.orchestra.run.smithi062.stdout:243 2023-06-09T04:45:46.884 INFO:teuthology.orchestra.run.smithi062.stdout:243.out 2023-06-09T04:45:46.884 INFO:teuthology.orchestra.run.smithi062.stdout:244 2023-06-09T04:45:46.884 INFO:teuthology.orchestra.run.smithi062.stdout:244.out 2023-06-09T04:45:46.884 INFO:teuthology.orchestra.run.smithi062.stdout:245 2023-06-09T04:45:46.884 INFO:teuthology.orchestra.run.smithi062.stdout:245.out 2023-06-09T04:45:46.885 INFO:teuthology.orchestra.run.smithi062.stdout:246 2023-06-09T04:45:46.885 INFO:teuthology.orchestra.run.smithi062.stdout:246.out 2023-06-09T04:45:46.885 INFO:teuthology.orchestra.run.smithi062.stdout:247 2023-06-09T04:45:46.885 INFO:teuthology.orchestra.run.smithi062.stdout:247.out 2023-06-09T04:45:46.885 INFO:teuthology.orchestra.run.smithi062.stdout:248 2023-06-09T04:45:46.885 INFO:teuthology.orchestra.run.smithi062.stdout:248.out 2023-06-09T04:45:46.885 INFO:teuthology.orchestra.run.smithi062.stdout:249 2023-06-09T04:45:46.885 INFO:teuthology.orchestra.run.smithi062.stdout:249.out 2023-06-09T04:45:46.886 INFO:teuthology.orchestra.run.smithi062.stdout:250 2023-06-09T04:45:46.886 INFO:teuthology.orchestra.run.smithi062.stdout:250.out 2023-06-09T04:45:46.886 INFO:teuthology.orchestra.run.smithi062.stdout:251 2023-06-09T04:45:46.886 INFO:teuthology.orchestra.run.smithi062.stdout:251.out 2023-06-09T04:45:46.886 INFO:teuthology.orchestra.run.smithi062.stdout:252 2023-06-09T04:45:46.886 INFO:teuthology.orchestra.run.smithi062.stdout:252.out 2023-06-09T04:45:46.886 INFO:teuthology.orchestra.run.smithi062.stdout:253 2023-06-09T04:45:46.886 INFO:teuthology.orchestra.run.smithi062.stdout:253.out 2023-06-09T04:45:46.887 INFO:teuthology.orchestra.run.smithi062.stdout:254 2023-06-09T04:45:46.887 INFO:teuthology.orchestra.run.smithi062.stdout:254.out 2023-06-09T04:45:46.887 INFO:teuthology.orchestra.run.smithi062.stdout:255 2023-06-09T04:45:46.887 INFO:teuthology.orchestra.run.smithi062.stdout:255.out 2023-06-09T04:45:46.887 INFO:teuthology.orchestra.run.smithi062.stdout:256 2023-06-09T04:45:46.887 INFO:teuthology.orchestra.run.smithi062.stdout:256.out 2023-06-09T04:45:46.887 INFO:teuthology.orchestra.run.smithi062.stdout:257 2023-06-09T04:45:46.887 INFO:teuthology.orchestra.run.smithi062.stdout:257.out 2023-06-09T04:45:46.888 INFO:teuthology.orchestra.run.smithi062.stdout:258 2023-06-09T04:45:46.888 INFO:teuthology.orchestra.run.smithi062.stdout:258.out 2023-06-09T04:45:46.888 INFO:teuthology.orchestra.run.smithi062.stdout:259 2023-06-09T04:45:46.888 INFO:teuthology.orchestra.run.smithi062.stdout:259.out 2023-06-09T04:45:46.888 INFO:teuthology.orchestra.run.smithi062.stdout:260 2023-06-09T04:45:46.888 INFO:teuthology.orchestra.run.smithi062.stdout:260.out 2023-06-09T04:45:46.888 INFO:teuthology.orchestra.run.smithi062.stdout:261 2023-06-09T04:45:46.888 INFO:teuthology.orchestra.run.smithi062.stdout:261.out 2023-06-09T04:45:46.889 INFO:teuthology.orchestra.run.smithi062.stdout:262 2023-06-09T04:45:46.889 INFO:teuthology.orchestra.run.smithi062.stdout:262.out 2023-06-09T04:45:46.889 INFO:teuthology.orchestra.run.smithi062.stdout:263 2023-06-09T04:45:46.889 INFO:teuthology.orchestra.run.smithi062.stdout:263.out 2023-06-09T04:45:46.889 INFO:teuthology.orchestra.run.smithi062.stdout:264 2023-06-09T04:45:46.889 INFO:teuthology.orchestra.run.smithi062.stdout:264.out 2023-06-09T04:45:46.889 INFO:teuthology.orchestra.run.smithi062.stdout:265 2023-06-09T04:45:46.889 INFO:teuthology.orchestra.run.smithi062.stdout:265.out 2023-06-09T04:45:46.890 INFO:teuthology.orchestra.run.smithi062.stdout:266 2023-06-09T04:45:46.890 INFO:teuthology.orchestra.run.smithi062.stdout:266.out 2023-06-09T04:45:46.890 INFO:teuthology.orchestra.run.smithi062.stdout:267 2023-06-09T04:45:46.890 INFO:teuthology.orchestra.run.smithi062.stdout:267.out 2023-06-09T04:45:46.890 INFO:teuthology.orchestra.run.smithi062.stdout:268 2023-06-09T04:45:46.890 INFO:teuthology.orchestra.run.smithi062.stdout:268.out 2023-06-09T04:45:46.890 INFO:teuthology.orchestra.run.smithi062.stdout:269 2023-06-09T04:45:46.890 INFO:teuthology.orchestra.run.smithi062.stdout:269.out 2023-06-09T04:45:46.891 INFO:teuthology.orchestra.run.smithi062.stdout:270 2023-06-09T04:45:46.891 INFO:teuthology.orchestra.run.smithi062.stdout:270.out 2023-06-09T04:45:46.891 INFO:teuthology.orchestra.run.smithi062.stdout:271 2023-06-09T04:45:46.891 INFO:teuthology.orchestra.run.smithi062.stdout:271.out 2023-06-09T04:45:46.891 INFO:teuthology.orchestra.run.smithi062.stdout:272 2023-06-09T04:45:46.891 INFO:teuthology.orchestra.run.smithi062.stdout:272.out 2023-06-09T04:45:46.891 INFO:teuthology.orchestra.run.smithi062.stdout:273 2023-06-09T04:45:46.891 INFO:teuthology.orchestra.run.smithi062.stdout:273.out 2023-06-09T04:45:46.892 INFO:teuthology.orchestra.run.smithi062.stdout:274 2023-06-09T04:45:46.892 INFO:teuthology.orchestra.run.smithi062.stdout:274.out 2023-06-09T04:45:46.892 INFO:teuthology.orchestra.run.smithi062.stdout:275 2023-06-09T04:45:46.892 INFO:teuthology.orchestra.run.smithi062.stdout:275.out 2023-06-09T04:45:46.892 INFO:teuthology.orchestra.run.smithi062.stdout:276 2023-06-09T04:45:46.892 INFO:teuthology.orchestra.run.smithi062.stdout:276.out 2023-06-09T04:45:46.892 INFO:teuthology.orchestra.run.smithi062.stdout:277 2023-06-09T04:45:46.892 INFO:teuthology.orchestra.run.smithi062.stdout:277.out 2023-06-09T04:45:46.893 INFO:teuthology.orchestra.run.smithi062.stdout:278 2023-06-09T04:45:46.893 INFO:teuthology.orchestra.run.smithi062.stdout:278.out 2023-06-09T04:45:46.893 INFO:teuthology.orchestra.run.smithi062.stdout:279 2023-06-09T04:45:46.893 INFO:teuthology.orchestra.run.smithi062.stdout:279.out 2023-06-09T04:45:46.893 INFO:teuthology.orchestra.run.smithi062.stdout:280 2023-06-09T04:45:46.893 INFO:teuthology.orchestra.run.smithi062.stdout:280.out 2023-06-09T04:45:46.893 INFO:teuthology.orchestra.run.smithi062.stdout:281 2023-06-09T04:45:46.893 INFO:teuthology.orchestra.run.smithi062.stdout:281.out 2023-06-09T04:45:46.894 INFO:teuthology.orchestra.run.smithi062.stdout:282 2023-06-09T04:45:46.894 INFO:teuthology.orchestra.run.smithi062.stdout:282.out 2023-06-09T04:45:46.894 INFO:teuthology.orchestra.run.smithi062.stdout:283 2023-06-09T04:45:46.894 INFO:teuthology.orchestra.run.smithi062.stdout:283.out 2023-06-09T04:45:46.894 INFO:teuthology.orchestra.run.smithi062.stdout:284 2023-06-09T04:45:46.894 INFO:teuthology.orchestra.run.smithi062.stdout:284.out 2023-06-09T04:45:46.894 INFO:teuthology.orchestra.run.smithi062.stdout:285 2023-06-09T04:45:46.894 INFO:teuthology.orchestra.run.smithi062.stdout:285.out 2023-06-09T04:45:46.895 INFO:teuthology.orchestra.run.smithi062.stdout:286 2023-06-09T04:45:46.895 INFO:teuthology.orchestra.run.smithi062.stdout:286.out 2023-06-09T04:45:46.895 INFO:teuthology.orchestra.run.smithi062.stdout:287 2023-06-09T04:45:46.895 INFO:teuthology.orchestra.run.smithi062.stdout:287.out 2023-06-09T04:45:46.895 INFO:teuthology.orchestra.run.smithi062.stdout:288 2023-06-09T04:45:46.895 INFO:teuthology.orchestra.run.smithi062.stdout:288.out 2023-06-09T04:45:46.895 INFO:teuthology.orchestra.run.smithi062.stdout:289 2023-06-09T04:45:46.895 INFO:teuthology.orchestra.run.smithi062.stdout:289.out 2023-06-09T04:45:46.895 INFO:teuthology.orchestra.run.smithi062.stdout:290 2023-06-09T04:45:46.896 INFO:teuthology.orchestra.run.smithi062.stdout:290.out 2023-06-09T04:45:46.896 INFO:teuthology.orchestra.run.smithi062.stdout:291 2023-06-09T04:45:46.896 INFO:teuthology.orchestra.run.smithi062.stdout:291.out 2023-06-09T04:45:46.896 INFO:teuthology.orchestra.run.smithi062.stdout:292 2023-06-09T04:45:46.896 INFO:teuthology.orchestra.run.smithi062.stdout:292.out 2023-06-09T04:45:46.896 INFO:teuthology.orchestra.run.smithi062.stdout:293 2023-06-09T04:45:46.896 INFO:teuthology.orchestra.run.smithi062.stdout:293.out 2023-06-09T04:45:46.897 INFO:teuthology.orchestra.run.smithi062.stdout:294 2023-06-09T04:45:46.897 INFO:teuthology.orchestra.run.smithi062.stdout:294.out 2023-06-09T04:45:46.897 INFO:teuthology.orchestra.run.smithi062.stdout:295 2023-06-09T04:45:46.897 INFO:teuthology.orchestra.run.smithi062.stdout:295.out 2023-06-09T04:45:46.897 INFO:teuthology.orchestra.run.smithi062.stdout:296 2023-06-09T04:45:46.897 INFO:teuthology.orchestra.run.smithi062.stdout:296.out 2023-06-09T04:45:46.897 INFO:teuthology.orchestra.run.smithi062.stdout:297 2023-06-09T04:45:46.897 INFO:teuthology.orchestra.run.smithi062.stdout:297.out 2023-06-09T04:45:46.897 INFO:teuthology.orchestra.run.smithi062.stdout:298 2023-06-09T04:45:46.898 INFO:teuthology.orchestra.run.smithi062.stdout:298.out 2023-06-09T04:45:46.898 INFO:teuthology.orchestra.run.smithi062.stdout:299 2023-06-09T04:45:46.898 INFO:teuthology.orchestra.run.smithi062.stdout:299.out 2023-06-09T04:45:46.898 INFO:teuthology.orchestra.run.smithi062.stdout:300 2023-06-09T04:45:46.898 INFO:teuthology.orchestra.run.smithi062.stdout:300.out 2023-06-09T04:45:46.898 INFO:teuthology.orchestra.run.smithi062.stdout:301 2023-06-09T04:45:46.898 INFO:teuthology.orchestra.run.smithi062.stdout:301.out 2023-06-09T04:45:46.898 INFO:teuthology.orchestra.run.smithi062.stdout:302 2023-06-09T04:45:46.899 INFO:teuthology.orchestra.run.smithi062.stdout:302.out 2023-06-09T04:45:46.899 INFO:teuthology.orchestra.run.smithi062.stdout:303 2023-06-09T04:45:46.899 INFO:teuthology.orchestra.run.smithi062.stdout:303.out 2023-06-09T04:45:46.899 INFO:teuthology.orchestra.run.smithi062.stdout:304 2023-06-09T04:45:46.899 INFO:teuthology.orchestra.run.smithi062.stdout:304.out 2023-06-09T04:45:46.899 INFO:teuthology.orchestra.run.smithi062.stdout:305 2023-06-09T04:45:46.899 INFO:teuthology.orchestra.run.smithi062.stdout:305.out 2023-06-09T04:45:46.899 INFO:teuthology.orchestra.run.smithi062.stdout:306 2023-06-09T04:45:46.900 INFO:teuthology.orchestra.run.smithi062.stdout:306.out 2023-06-09T04:45:46.900 INFO:teuthology.orchestra.run.smithi062.stdout:307 2023-06-09T04:45:46.900 INFO:teuthology.orchestra.run.smithi062.stdout:307.out 2023-06-09T04:45:46.900 INFO:teuthology.orchestra.run.smithi062.stdout:308 2023-06-09T04:45:46.900 INFO:teuthology.orchestra.run.smithi062.stdout:308.out 2023-06-09T04:45:46.900 INFO:teuthology.orchestra.run.smithi062.stdout:309 2023-06-09T04:45:46.900 INFO:teuthology.orchestra.run.smithi062.stdout:309.out 2023-06-09T04:45:46.900 INFO:teuthology.orchestra.run.smithi062.stdout:310 2023-06-09T04:45:46.901 INFO:teuthology.orchestra.run.smithi062.stdout:310.out 2023-06-09T04:45:46.901 INFO:teuthology.orchestra.run.smithi062.stdout:311 2023-06-09T04:45:46.901 INFO:teuthology.orchestra.run.smithi062.stdout:311.out 2023-06-09T04:45:46.901 INFO:teuthology.orchestra.run.smithi062.stdout:312 2023-06-09T04:45:46.901 INFO:teuthology.orchestra.run.smithi062.stdout:312.out 2023-06-09T04:45:46.901 INFO:teuthology.orchestra.run.smithi062.stdout:313 2023-06-09T04:45:46.901 INFO:teuthology.orchestra.run.smithi062.stdout:313.out 2023-06-09T04:45:46.901 INFO:teuthology.orchestra.run.smithi062.stdout:314 2023-06-09T04:45:46.902 INFO:teuthology.orchestra.run.smithi062.stdout:314.out 2023-06-09T04:45:46.902 INFO:teuthology.orchestra.run.smithi062.stdout:315 2023-06-09T04:45:46.902 INFO:teuthology.orchestra.run.smithi062.stdout:315.out 2023-06-09T04:45:46.902 INFO:teuthology.orchestra.run.smithi062.stdout:316 2023-06-09T04:45:46.902 INFO:teuthology.orchestra.run.smithi062.stdout:316.out 2023-06-09T04:45:46.902 INFO:teuthology.orchestra.run.smithi062.stdout:317 2023-06-09T04:45:46.902 INFO:teuthology.orchestra.run.smithi062.stdout:317.out 2023-06-09T04:45:46.902 INFO:teuthology.orchestra.run.smithi062.stdout:318 2023-06-09T04:45:46.903 INFO:teuthology.orchestra.run.smithi062.stdout:318.out 2023-06-09T04:45:46.903 INFO:teuthology.orchestra.run.smithi062.stdout:319 2023-06-09T04:45:46.903 INFO:teuthology.orchestra.run.smithi062.stdout:319.out 2023-06-09T04:45:46.903 INFO:teuthology.orchestra.run.smithi062.stdout:320 2023-06-09T04:45:46.903 INFO:teuthology.orchestra.run.smithi062.stdout:320.out 2023-06-09T04:45:46.903 INFO:teuthology.orchestra.run.smithi062.stdout:321 2023-06-09T04:45:46.903 INFO:teuthology.orchestra.run.smithi062.stdout:321.out 2023-06-09T04:45:46.903 INFO:teuthology.orchestra.run.smithi062.stdout:322 2023-06-09T04:45:46.904 INFO:teuthology.orchestra.run.smithi062.stdout:322.out 2023-06-09T04:45:46.904 INFO:teuthology.orchestra.run.smithi062.stdout:323 2023-06-09T04:45:46.904 INFO:teuthology.orchestra.run.smithi062.stdout:323.out 2023-06-09T04:45:46.904 INFO:teuthology.orchestra.run.smithi062.stdout:324 2023-06-09T04:45:46.904 INFO:teuthology.orchestra.run.smithi062.stdout:324.out 2023-06-09T04:45:46.904 INFO:teuthology.orchestra.run.smithi062.stdout:325 2023-06-09T04:45:46.904 INFO:teuthology.orchestra.run.smithi062.stdout:325.out 2023-06-09T04:45:46.905 INFO:teuthology.orchestra.run.smithi062.stdout:326 2023-06-09T04:45:46.905 INFO:teuthology.orchestra.run.smithi062.stdout:326.out 2023-06-09T04:45:46.905 INFO:teuthology.orchestra.run.smithi062.stdout:327 2023-06-09T04:45:46.905 INFO:teuthology.orchestra.run.smithi062.stdout:327.out 2023-06-09T04:45:46.905 INFO:teuthology.orchestra.run.smithi062.stdout:328 2023-06-09T04:45:46.905 INFO:teuthology.orchestra.run.smithi062.stdout:328.out 2023-06-09T04:45:46.905 INFO:teuthology.orchestra.run.smithi062.stdout:329 2023-06-09T04:45:46.905 INFO:teuthology.orchestra.run.smithi062.stdout:329.out 2023-06-09T04:45:46.906 INFO:teuthology.orchestra.run.smithi062.stdout:330 2023-06-09T04:45:46.906 INFO:teuthology.orchestra.run.smithi062.stdout:330.out 2023-06-09T04:45:46.906 INFO:teuthology.orchestra.run.smithi062.stdout:331 2023-06-09T04:45:46.906 INFO:teuthology.orchestra.run.smithi062.stdout:331.out 2023-06-09T04:45:46.906 INFO:teuthology.orchestra.run.smithi062.stdout:332 2023-06-09T04:45:46.906 INFO:teuthology.orchestra.run.smithi062.stdout:332.out 2023-06-09T04:45:46.906 INFO:teuthology.orchestra.run.smithi062.stdout:333 2023-06-09T04:45:46.906 INFO:teuthology.orchestra.run.smithi062.stdout:333.out 2023-06-09T04:45:46.907 INFO:teuthology.orchestra.run.smithi062.stdout:334 2023-06-09T04:45:46.907 INFO:teuthology.orchestra.run.smithi062.stdout:334.out 2023-06-09T04:45:46.907 INFO:teuthology.orchestra.run.smithi062.stdout:335 2023-06-09T04:45:46.907 INFO:teuthology.orchestra.run.smithi062.stdout:335.out 2023-06-09T04:45:46.907 INFO:teuthology.orchestra.run.smithi062.stdout:336 2023-06-09T04:45:46.907 INFO:teuthology.orchestra.run.smithi062.stdout:336.out 2023-06-09T04:45:46.907 INFO:teuthology.orchestra.run.smithi062.stdout:337 2023-06-09T04:45:46.907 INFO:teuthology.orchestra.run.smithi062.stdout:337.out 2023-06-09T04:45:46.908 INFO:teuthology.orchestra.run.smithi062.stdout:338 2023-06-09T04:45:46.908 INFO:teuthology.orchestra.run.smithi062.stdout:338.out 2023-06-09T04:45:46.908 INFO:teuthology.orchestra.run.smithi062.stdout:339 2023-06-09T04:45:46.908 INFO:teuthology.orchestra.run.smithi062.stdout:339.out 2023-06-09T04:45:46.908 INFO:teuthology.orchestra.run.smithi062.stdout:340 2023-06-09T04:45:46.908 INFO:teuthology.orchestra.run.smithi062.stdout:340.out 2023-06-09T04:45:46.908 INFO:teuthology.orchestra.run.smithi062.stdout:341 2023-06-09T04:45:46.908 INFO:teuthology.orchestra.run.smithi062.stdout:341.out 2023-06-09T04:45:46.909 INFO:teuthology.orchestra.run.smithi062.stdout:342 2023-06-09T04:45:46.909 INFO:teuthology.orchestra.run.smithi062.stdout:342.out 2023-06-09T04:45:46.909 INFO:teuthology.orchestra.run.smithi062.stdout:343 2023-06-09T04:45:46.909 INFO:teuthology.orchestra.run.smithi062.stdout:343.out 2023-06-09T04:45:46.909 INFO:teuthology.orchestra.run.smithi062.stdout:344 2023-06-09T04:45:46.909 INFO:teuthology.orchestra.run.smithi062.stdout:344.out 2023-06-09T04:45:46.909 INFO:teuthology.orchestra.run.smithi062.stdout:345 2023-06-09T04:45:46.909 INFO:teuthology.orchestra.run.smithi062.stdout:345.out 2023-06-09T04:45:46.910 INFO:teuthology.orchestra.run.smithi062.stdout:346 2023-06-09T04:45:46.910 INFO:teuthology.orchestra.run.smithi062.stdout:346.out 2023-06-09T04:45:46.910 INFO:teuthology.orchestra.run.smithi062.stdout:347 2023-06-09T04:45:46.910 INFO:teuthology.orchestra.run.smithi062.stdout:347.out 2023-06-09T04:45:46.910 INFO:teuthology.orchestra.run.smithi062.stdout:348 2023-06-09T04:45:46.910 INFO:teuthology.orchestra.run.smithi062.stdout:348.out 2023-06-09T04:45:46.910 INFO:teuthology.orchestra.run.smithi062.stdout:349 2023-06-09T04:45:46.910 INFO:teuthology.orchestra.run.smithi062.stdout:349.out 2023-06-09T04:45:46.911 INFO:teuthology.orchestra.run.smithi062.stdout:350 2023-06-09T04:45:46.911 INFO:teuthology.orchestra.run.smithi062.stdout:350.out 2023-06-09T04:45:46.911 INFO:teuthology.orchestra.run.smithi062.stdout:351 2023-06-09T04:45:46.911 INFO:teuthology.orchestra.run.smithi062.stdout:351.out 2023-06-09T04:45:46.911 INFO:teuthology.orchestra.run.smithi062.stdout:352 2023-06-09T04:45:46.911 INFO:teuthology.orchestra.run.smithi062.stdout:352.out 2023-06-09T04:45:46.911 INFO:teuthology.orchestra.run.smithi062.stdout:353 2023-06-09T04:45:46.911 INFO:teuthology.orchestra.run.smithi062.stdout:353.out 2023-06-09T04:45:46.912 INFO:teuthology.orchestra.run.smithi062.stdout:354 2023-06-09T04:45:46.912 INFO:teuthology.orchestra.run.smithi062.stdout:354.out 2023-06-09T04:45:46.912 INFO:teuthology.orchestra.run.smithi062.stdout:355 2023-06-09T04:45:46.912 INFO:teuthology.orchestra.run.smithi062.stdout:355.out 2023-06-09T04:45:46.912 INFO:teuthology.orchestra.run.smithi062.stdout:356 2023-06-09T04:45:46.912 INFO:teuthology.orchestra.run.smithi062.stdout:356.out 2023-06-09T04:45:46.912 INFO:teuthology.orchestra.run.smithi062.stdout:357 2023-06-09T04:45:46.913 INFO:teuthology.orchestra.run.smithi062.stdout:357.out 2023-06-09T04:45:46.913 INFO:teuthology.orchestra.run.smithi062.stdout:358 2023-06-09T04:45:46.913 INFO:teuthology.orchestra.run.smithi062.stdout:358.out 2023-06-09T04:45:46.913 INFO:teuthology.orchestra.run.smithi062.stdout:359 2023-06-09T04:45:46.913 INFO:teuthology.orchestra.run.smithi062.stdout:359.out 2023-06-09T04:45:46.913 INFO:teuthology.orchestra.run.smithi062.stdout:360 2023-06-09T04:45:46.913 INFO:teuthology.orchestra.run.smithi062.stdout:360.out 2023-06-09T04:45:46.913 INFO:teuthology.orchestra.run.smithi062.stdout:361 2023-06-09T04:45:46.914 INFO:teuthology.orchestra.run.smithi062.stdout:361.out 2023-06-09T04:45:46.914 INFO:teuthology.orchestra.run.smithi062.stdout:362 2023-06-09T04:45:46.914 INFO:teuthology.orchestra.run.smithi062.stdout:362.out 2023-06-09T04:45:46.914 INFO:teuthology.orchestra.run.smithi062.stdout:363 2023-06-09T04:45:46.914 INFO:teuthology.orchestra.run.smithi062.stdout:363.out 2023-06-09T04:45:46.914 INFO:teuthology.orchestra.run.smithi062.stdout:364 2023-06-09T04:45:46.914 INFO:teuthology.orchestra.run.smithi062.stdout:364.out 2023-06-09T04:45:46.914 INFO:teuthology.orchestra.run.smithi062.stdout:365 2023-06-09T04:45:46.915 INFO:teuthology.orchestra.run.smithi062.stdout:365.out 2023-06-09T04:45:46.915 INFO:teuthology.orchestra.run.smithi062.stdout:366 2023-06-09T04:45:46.915 INFO:teuthology.orchestra.run.smithi062.stdout:366.out 2023-06-09T04:45:46.915 INFO:teuthology.orchestra.run.smithi062.stdout:367 2023-06-09T04:45:46.915 INFO:teuthology.orchestra.run.smithi062.stdout:367.out 2023-06-09T04:45:46.915 INFO:teuthology.orchestra.run.smithi062.stdout:368 2023-06-09T04:45:46.915 INFO:teuthology.orchestra.run.smithi062.stdout:368.out 2023-06-09T04:45:46.915 INFO:teuthology.orchestra.run.smithi062.stdout:369 2023-06-09T04:45:46.916 INFO:teuthology.orchestra.run.smithi062.stdout:369.out 2023-06-09T04:45:46.916 INFO:teuthology.orchestra.run.smithi062.stdout:370 2023-06-09T04:45:46.916 INFO:teuthology.orchestra.run.smithi062.stdout:370.out 2023-06-09T04:45:46.916 INFO:teuthology.orchestra.run.smithi062.stdout:371 2023-06-09T04:45:46.916 INFO:teuthology.orchestra.run.smithi062.stdout:371.out 2023-06-09T04:45:46.916 INFO:teuthology.orchestra.run.smithi062.stdout:372 2023-06-09T04:45:46.916 INFO:teuthology.orchestra.run.smithi062.stdout:372.out 2023-06-09T04:45:46.916 INFO:teuthology.orchestra.run.smithi062.stdout:373 2023-06-09T04:45:46.917 INFO:teuthology.orchestra.run.smithi062.stdout:373.out 2023-06-09T04:45:46.917 INFO:teuthology.orchestra.run.smithi062.stdout:374 2023-06-09T04:45:46.917 INFO:teuthology.orchestra.run.smithi062.stdout:374.out 2023-06-09T04:45:46.917 INFO:teuthology.orchestra.run.smithi062.stdout:375 2023-06-09T04:45:46.917 INFO:teuthology.orchestra.run.smithi062.stdout:375.out 2023-06-09T04:45:46.917 INFO:teuthology.orchestra.run.smithi062.stdout:376 2023-06-09T04:45:46.917 INFO:teuthology.orchestra.run.smithi062.stdout:376.out 2023-06-09T04:45:46.917 INFO:teuthology.orchestra.run.smithi062.stdout:377 2023-06-09T04:45:46.918 INFO:teuthology.orchestra.run.smithi062.stdout:377.out 2023-06-09T04:45:46.918 INFO:teuthology.orchestra.run.smithi062.stdout:378 2023-06-09T04:45:46.918 INFO:teuthology.orchestra.run.smithi062.stdout:378.out 2023-06-09T04:45:46.918 INFO:teuthology.orchestra.run.smithi062.stdout:379 2023-06-09T04:45:46.918 INFO:teuthology.orchestra.run.smithi062.stdout:379.out 2023-06-09T04:45:46.918 INFO:teuthology.orchestra.run.smithi062.stdout:380 2023-06-09T04:45:46.918 INFO:teuthology.orchestra.run.smithi062.stdout:380.out 2023-06-09T04:45:46.918 INFO:teuthology.orchestra.run.smithi062.stdout:381 2023-06-09T04:45:46.919 INFO:teuthology.orchestra.run.smithi062.stdout:381.out 2023-06-09T04:45:46.919 INFO:teuthology.orchestra.run.smithi062.stdout:382 2023-06-09T04:45:46.919 INFO:teuthology.orchestra.run.smithi062.stdout:382.out 2023-06-09T04:45:46.919 INFO:teuthology.orchestra.run.smithi062.stdout:383 2023-06-09T04:45:46.919 INFO:teuthology.orchestra.run.smithi062.stdout:383.out 2023-06-09T04:45:46.919 INFO:teuthology.orchestra.run.smithi062.stdout:384 2023-06-09T04:45:46.919 INFO:teuthology.orchestra.run.smithi062.stdout:384.out 2023-06-09T04:45:46.919 INFO:teuthology.orchestra.run.smithi062.stdout:385 2023-06-09T04:45:46.920 INFO:teuthology.orchestra.run.smithi062.stdout:385.out 2023-06-09T04:45:46.920 INFO:teuthology.orchestra.run.smithi062.stdout:386 2023-06-09T04:45:46.920 INFO:teuthology.orchestra.run.smithi062.stdout:386.out 2023-06-09T04:45:46.920 INFO:teuthology.orchestra.run.smithi062.stdout:387 2023-06-09T04:45:46.920 INFO:teuthology.orchestra.run.smithi062.stdout:387.out 2023-06-09T04:45:46.920 INFO:teuthology.orchestra.run.smithi062.stdout:388 2023-06-09T04:45:46.920 INFO:teuthology.orchestra.run.smithi062.stdout:388.out 2023-06-09T04:45:46.920 INFO:teuthology.orchestra.run.smithi062.stdout:389 2023-06-09T04:45:46.921 INFO:teuthology.orchestra.run.smithi062.stdout:389.out 2023-06-09T04:45:46.921 INFO:teuthology.orchestra.run.smithi062.stdout:390 2023-06-09T04:45:46.921 INFO:teuthology.orchestra.run.smithi062.stdout:390.out 2023-06-09T04:45:46.921 INFO:teuthology.orchestra.run.smithi062.stdout:391 2023-06-09T04:45:46.921 INFO:teuthology.orchestra.run.smithi062.stdout:391.out 2023-06-09T04:45:46.921 INFO:teuthology.orchestra.run.smithi062.stdout:392 2023-06-09T04:45:46.921 INFO:teuthology.orchestra.run.smithi062.stdout:392.out 2023-06-09T04:45:46.921 INFO:teuthology.orchestra.run.smithi062.stdout:393 2023-06-09T04:45:46.922 INFO:teuthology.orchestra.run.smithi062.stdout:393.out 2023-06-09T04:45:46.922 INFO:teuthology.orchestra.run.smithi062.stdout:394 2023-06-09T04:45:46.922 INFO:teuthology.orchestra.run.smithi062.stdout:394.out 2023-06-09T04:45:46.922 INFO:teuthology.orchestra.run.smithi062.stdout:395 2023-06-09T04:45:46.922 INFO:teuthology.orchestra.run.smithi062.stdout:395.out 2023-06-09T04:45:46.922 INFO:teuthology.orchestra.run.smithi062.stdout:396 2023-06-09T04:45:46.922 INFO:teuthology.orchestra.run.smithi062.stdout:396.out 2023-06-09T04:45:46.922 INFO:teuthology.orchestra.run.smithi062.stdout:397 2023-06-09T04:45:46.923 INFO:teuthology.orchestra.run.smithi062.stdout:397.out 2023-06-09T04:45:46.923 INFO:teuthology.orchestra.run.smithi062.stdout:398 2023-06-09T04:45:46.923 INFO:teuthology.orchestra.run.smithi062.stdout:398.out 2023-06-09T04:45:46.923 INFO:teuthology.orchestra.run.smithi062.stdout:399 2023-06-09T04:45:46.923 INFO:teuthology.orchestra.run.smithi062.stdout:399.out 2023-06-09T04:45:46.923 INFO:teuthology.orchestra.run.smithi062.stdout:400 2023-06-09T04:45:46.923 INFO:teuthology.orchestra.run.smithi062.stdout:400.out 2023-06-09T04:45:46.923 INFO:teuthology.orchestra.run.smithi062.stdout:401 2023-06-09T04:45:46.924 INFO:teuthology.orchestra.run.smithi062.stdout:401.out 2023-06-09T04:45:46.924 INFO:teuthology.orchestra.run.smithi062.stdout:402 2023-06-09T04:45:46.924 INFO:teuthology.orchestra.run.smithi062.stdout:402.out 2023-06-09T04:45:46.924 INFO:teuthology.orchestra.run.smithi062.stdout:403 2023-06-09T04:45:46.924 INFO:teuthology.orchestra.run.smithi062.stdout:403.out 2023-06-09T04:45:46.924 INFO:teuthology.orchestra.run.smithi062.stdout:404 2023-06-09T04:45:46.924 INFO:teuthology.orchestra.run.smithi062.stdout:404.out 2023-06-09T04:45:46.924 INFO:teuthology.orchestra.run.smithi062.stdout:405 2023-06-09T04:45:46.925 INFO:teuthology.orchestra.run.smithi062.stdout:405.out 2023-06-09T04:45:46.925 INFO:teuthology.orchestra.run.smithi062.stdout:406 2023-06-09T04:45:46.925 INFO:teuthology.orchestra.run.smithi062.stdout:406.out 2023-06-09T04:45:46.925 INFO:teuthology.orchestra.run.smithi062.stdout:407 2023-06-09T04:45:46.925 INFO:teuthology.orchestra.run.smithi062.stdout:407.out 2023-06-09T04:45:46.925 INFO:teuthology.orchestra.run.smithi062.stdout:408 2023-06-09T04:45:46.925 INFO:teuthology.orchestra.run.smithi062.stdout:408.out 2023-06-09T04:45:46.925 INFO:teuthology.orchestra.run.smithi062.stdout:409 2023-06-09T04:45:46.926 INFO:teuthology.orchestra.run.smithi062.stdout:409.out 2023-06-09T04:45:46.926 INFO:teuthology.orchestra.run.smithi062.stdout:410 2023-06-09T04:45:46.926 INFO:teuthology.orchestra.run.smithi062.stdout:410.out 2023-06-09T04:45:46.926 INFO:teuthology.orchestra.run.smithi062.stdout:411 2023-06-09T04:45:46.926 INFO:teuthology.orchestra.run.smithi062.stdout:411.out 2023-06-09T04:45:46.926 INFO:teuthology.orchestra.run.smithi062.stdout:412 2023-06-09T04:45:46.926 INFO:teuthology.orchestra.run.smithi062.stdout:412.out 2023-06-09T04:45:46.926 INFO:teuthology.orchestra.run.smithi062.stdout:413 2023-06-09T04:45:46.927 INFO:teuthology.orchestra.run.smithi062.stdout:413.out 2023-06-09T04:45:46.927 INFO:teuthology.orchestra.run.smithi062.stdout:414 2023-06-09T04:45:46.927 INFO:teuthology.orchestra.run.smithi062.stdout:414.out 2023-06-09T04:45:46.927 INFO:teuthology.orchestra.run.smithi062.stdout:415 2023-06-09T04:45:46.927 INFO:teuthology.orchestra.run.smithi062.stdout:415.out 2023-06-09T04:45:46.927 INFO:teuthology.orchestra.run.smithi062.stdout:416 2023-06-09T04:45:46.927 INFO:teuthology.orchestra.run.smithi062.stdout:416.out 2023-06-09T04:45:46.927 INFO:teuthology.orchestra.run.smithi062.stdout:417 2023-06-09T04:45:46.928 INFO:teuthology.orchestra.run.smithi062.stdout:417.out 2023-06-09T04:45:46.928 INFO:teuthology.orchestra.run.smithi062.stdout:418 2023-06-09T04:45:46.928 INFO:teuthology.orchestra.run.smithi062.stdout:418.out 2023-06-09T04:45:46.928 INFO:teuthology.orchestra.run.smithi062.stdout:419 2023-06-09T04:45:46.928 INFO:teuthology.orchestra.run.smithi062.stdout:419.out 2023-06-09T04:45:46.928 INFO:teuthology.orchestra.run.smithi062.stdout:420 2023-06-09T04:45:46.928 INFO:teuthology.orchestra.run.smithi062.stdout:420.out 2023-06-09T04:45:46.928 INFO:teuthology.orchestra.run.smithi062.stdout:421 2023-06-09T04:45:46.929 INFO:teuthology.orchestra.run.smithi062.stdout:421.out 2023-06-09T04:45:46.929 INFO:teuthology.orchestra.run.smithi062.stdout:422 2023-06-09T04:45:46.929 INFO:teuthology.orchestra.run.smithi062.stdout:422.out 2023-06-09T04:45:46.929 INFO:teuthology.orchestra.run.smithi062.stdout:423 2023-06-09T04:45:46.929 INFO:teuthology.orchestra.run.smithi062.stdout:423.out 2023-06-09T04:45:46.929 INFO:teuthology.orchestra.run.smithi062.stdout:424 2023-06-09T04:45:46.929 INFO:teuthology.orchestra.run.smithi062.stdout:424.out 2023-06-09T04:45:46.929 INFO:teuthology.orchestra.run.smithi062.stdout:425 2023-06-09T04:45:46.930 INFO:teuthology.orchestra.run.smithi062.stdout:425.out 2023-06-09T04:45:46.930 INFO:teuthology.orchestra.run.smithi062.stdout:426 2023-06-09T04:45:46.930 INFO:teuthology.orchestra.run.smithi062.stdout:426.out 2023-06-09T04:45:46.930 INFO:teuthology.orchestra.run.smithi062.stdout:427 2023-06-09T04:45:46.930 INFO:teuthology.orchestra.run.smithi062.stdout:427.out 2023-06-09T04:45:46.930 INFO:teuthology.orchestra.run.smithi062.stdout:428 2023-06-09T04:45:46.930 INFO:teuthology.orchestra.run.smithi062.stdout:428.out 2023-06-09T04:45:46.930 INFO:teuthology.orchestra.run.smithi062.stdout:429 2023-06-09T04:45:46.931 INFO:teuthology.orchestra.run.smithi062.stdout:429.out 2023-06-09T04:45:46.931 INFO:teuthology.orchestra.run.smithi062.stdout:430 2023-06-09T04:45:46.931 INFO:teuthology.orchestra.run.smithi062.stdout:430.out 2023-06-09T04:45:46.931 INFO:teuthology.orchestra.run.smithi062.stdout:431 2023-06-09T04:45:46.931 INFO:teuthology.orchestra.run.smithi062.stdout:431.out 2023-06-09T04:45:46.931 INFO:teuthology.orchestra.run.smithi062.stdout:432 2023-06-09T04:45:46.931 INFO:teuthology.orchestra.run.smithi062.stdout:432.out 2023-06-09T04:45:46.931 INFO:teuthology.orchestra.run.smithi062.stdout:433 2023-06-09T04:45:46.932 INFO:teuthology.orchestra.run.smithi062.stdout:433.out 2023-06-09T04:45:46.932 INFO:teuthology.orchestra.run.smithi062.stdout:434 2023-06-09T04:45:46.932 INFO:teuthology.orchestra.run.smithi062.stdout:434.out 2023-06-09T04:45:46.932 INFO:teuthology.orchestra.run.smithi062.stdout:435 2023-06-09T04:45:46.932 INFO:teuthology.orchestra.run.smithi062.stdout:435.out 2023-06-09T04:45:46.932 INFO:teuthology.orchestra.run.smithi062.stdout:436 2023-06-09T04:45:46.932 INFO:teuthology.orchestra.run.smithi062.stdout:436.out 2023-06-09T04:45:46.932 INFO:teuthology.orchestra.run.smithi062.stdout:437 2023-06-09T04:45:46.933 INFO:teuthology.orchestra.run.smithi062.stdout:437.out 2023-06-09T04:45:46.933 INFO:teuthology.orchestra.run.smithi062.stdout:438 2023-06-09T04:45:46.933 INFO:teuthology.orchestra.run.smithi062.stdout:438.out 2023-06-09T04:45:46.933 INFO:teuthology.orchestra.run.smithi062.stdout:439 2023-06-09T04:45:46.933 INFO:teuthology.orchestra.run.smithi062.stdout:439.out 2023-06-09T04:45:46.933 INFO:teuthology.orchestra.run.smithi062.stdout:440 2023-06-09T04:45:46.933 INFO:teuthology.orchestra.run.smithi062.stdout:440.out 2023-06-09T04:45:46.933 INFO:teuthology.orchestra.run.smithi062.stdout:441 2023-06-09T04:45:46.933 INFO:teuthology.orchestra.run.smithi062.stdout:441.out 2023-06-09T04:45:46.934 INFO:teuthology.orchestra.run.smithi062.stdout:442 2023-06-09T04:45:46.934 INFO:teuthology.orchestra.run.smithi062.stdout:442.out 2023-06-09T04:45:46.934 INFO:teuthology.orchestra.run.smithi062.stdout:443 2023-06-09T04:45:46.934 INFO:teuthology.orchestra.run.smithi062.stdout:443.out 2023-06-09T04:45:46.934 INFO:teuthology.orchestra.run.smithi062.stdout:444 2023-06-09T04:45:46.934 INFO:teuthology.orchestra.run.smithi062.stdout:444.out 2023-06-09T04:45:46.934 INFO:teuthology.orchestra.run.smithi062.stdout:445 2023-06-09T04:45:46.934 INFO:teuthology.orchestra.run.smithi062.stdout:445.out 2023-06-09T04:45:46.935 INFO:teuthology.orchestra.run.smithi062.stdout:446 2023-06-09T04:45:46.935 INFO:teuthology.orchestra.run.smithi062.stdout:446.out 2023-06-09T04:45:46.935 INFO:teuthology.orchestra.run.smithi062.stdout:447 2023-06-09T04:45:46.935 INFO:teuthology.orchestra.run.smithi062.stdout:447.out 2023-06-09T04:45:46.935 INFO:teuthology.orchestra.run.smithi062.stdout:448 2023-06-09T04:45:46.935 INFO:teuthology.orchestra.run.smithi062.stdout:448.out 2023-06-09T04:45:46.935 INFO:teuthology.orchestra.run.smithi062.stdout:449 2023-06-09T04:45:46.935 INFO:teuthology.orchestra.run.smithi062.stdout:449.out 2023-06-09T04:45:46.936 INFO:teuthology.orchestra.run.smithi062.stdout:450 2023-06-09T04:45:46.936 INFO:teuthology.orchestra.run.smithi062.stdout:450.out 2023-06-09T04:45:46.936 INFO:teuthology.orchestra.run.smithi062.stdout:451 2023-06-09T04:45:46.936 INFO:teuthology.orchestra.run.smithi062.stdout:451.out 2023-06-09T04:45:46.936 INFO:teuthology.orchestra.run.smithi062.stdout:452 2023-06-09T04:45:46.936 INFO:teuthology.orchestra.run.smithi062.stdout:452.out 2023-06-09T04:45:46.936 INFO:teuthology.orchestra.run.smithi062.stdout:453 2023-06-09T04:45:46.936 INFO:teuthology.orchestra.run.smithi062.stdout:453.out 2023-06-09T04:45:46.937 INFO:teuthology.orchestra.run.smithi062.stdout:454 2023-06-09T04:45:46.937 INFO:teuthology.orchestra.run.smithi062.stdout:454.out 2023-06-09T04:45:46.937 INFO:teuthology.orchestra.run.smithi062.stdout:455 2023-06-09T04:45:46.937 INFO:teuthology.orchestra.run.smithi062.stdout:455.out 2023-06-09T04:45:46.937 INFO:teuthology.orchestra.run.smithi062.stdout:456 2023-06-09T04:45:46.937 INFO:teuthology.orchestra.run.smithi062.stdout:456.out 2023-06-09T04:45:46.937 INFO:teuthology.orchestra.run.smithi062.stdout:457 2023-06-09T04:45:46.937 INFO:teuthology.orchestra.run.smithi062.stdout:457.out 2023-06-09T04:45:46.938 INFO:teuthology.orchestra.run.smithi062.stdout:458 2023-06-09T04:45:46.938 INFO:teuthology.orchestra.run.smithi062.stdout:458.out 2023-06-09T04:45:46.938 INFO:teuthology.orchestra.run.smithi062.stdout:459 2023-06-09T04:45:46.938 INFO:teuthology.orchestra.run.smithi062.stdout:459.out 2023-06-09T04:45:46.938 INFO:teuthology.orchestra.run.smithi062.stdout:460 2023-06-09T04:45:46.938 INFO:teuthology.orchestra.run.smithi062.stdout:460.out 2023-06-09T04:45:46.938 INFO:teuthology.orchestra.run.smithi062.stdout:461 2023-06-09T04:45:46.938 INFO:teuthology.orchestra.run.smithi062.stdout:461.out 2023-06-09T04:45:46.939 INFO:teuthology.orchestra.run.smithi062.stdout:462 2023-06-09T04:45:46.939 INFO:teuthology.orchestra.run.smithi062.stdout:462.out 2023-06-09T04:45:46.939 INFO:teuthology.orchestra.run.smithi062.stdout:463 2023-06-09T04:45:46.939 INFO:teuthology.orchestra.run.smithi062.stdout:463.out 2023-06-09T04:45:46.939 INFO:teuthology.orchestra.run.smithi062.stdout:464 2023-06-09T04:45:46.939 INFO:teuthology.orchestra.run.smithi062.stdout:464.out 2023-06-09T04:45:46.939 INFO:teuthology.orchestra.run.smithi062.stdout:465 2023-06-09T04:45:46.939 INFO:teuthology.orchestra.run.smithi062.stdout:465.out 2023-06-09T04:45:46.940 INFO:teuthology.orchestra.run.smithi062.stdout:466 2023-06-09T04:45:46.940 INFO:teuthology.orchestra.run.smithi062.stdout:466.out 2023-06-09T04:45:46.940 INFO:teuthology.orchestra.run.smithi062.stdout:467 2023-06-09T04:45:46.940 INFO:teuthology.orchestra.run.smithi062.stdout:467.out 2023-06-09T04:45:46.940 INFO:teuthology.orchestra.run.smithi062.stdout:468 2023-06-09T04:45:46.940 INFO:teuthology.orchestra.run.smithi062.stdout:468.out 2023-06-09T04:45:46.940 INFO:teuthology.orchestra.run.smithi062.stdout:469 2023-06-09T04:45:46.940 INFO:teuthology.orchestra.run.smithi062.stdout:469.out 2023-06-09T04:45:46.941 INFO:teuthology.orchestra.run.smithi062.stdout:470 2023-06-09T04:45:46.941 INFO:teuthology.orchestra.run.smithi062.stdout:470.out 2023-06-09T04:45:46.941 INFO:teuthology.orchestra.run.smithi062.stdout:471 2023-06-09T04:45:46.941 INFO:teuthology.orchestra.run.smithi062.stdout:471.out 2023-06-09T04:45:46.941 INFO:teuthology.orchestra.run.smithi062.stdout:472 2023-06-09T04:45:46.941 INFO:teuthology.orchestra.run.smithi062.stdout:472.out 2023-06-09T04:45:46.941 INFO:teuthology.orchestra.run.smithi062.stdout:473 2023-06-09T04:45:46.941 INFO:teuthology.orchestra.run.smithi062.stdout:473.out 2023-06-09T04:45:46.942 INFO:teuthology.orchestra.run.smithi062.stdout:474 2023-06-09T04:45:46.942 INFO:teuthology.orchestra.run.smithi062.stdout:474.out 2023-06-09T04:45:46.942 INFO:teuthology.orchestra.run.smithi062.stdout:475 2023-06-09T04:45:46.942 INFO:teuthology.orchestra.run.smithi062.stdout:475.out 2023-06-09T04:45:46.942 INFO:teuthology.orchestra.run.smithi062.stdout:476 2023-06-09T04:45:46.942 INFO:teuthology.orchestra.run.smithi062.stdout:476.out 2023-06-09T04:45:46.942 INFO:teuthology.orchestra.run.smithi062.stdout:477 2023-06-09T04:45:46.942 INFO:teuthology.orchestra.run.smithi062.stdout:477.out 2023-06-09T04:45:46.943 INFO:teuthology.orchestra.run.smithi062.stdout:478 2023-06-09T04:45:46.943 INFO:teuthology.orchestra.run.smithi062.stdout:478.out 2023-06-09T04:45:46.943 INFO:teuthology.orchestra.run.smithi062.stdout:479 2023-06-09T04:45:46.943 INFO:teuthology.orchestra.run.smithi062.stdout:479.out 2023-06-09T04:45:46.943 INFO:teuthology.orchestra.run.smithi062.stdout:480 2023-06-09T04:45:46.943 INFO:teuthology.orchestra.run.smithi062.stdout:480.out 2023-06-09T04:45:46.943 INFO:teuthology.orchestra.run.smithi062.stdout:481 2023-06-09T04:45:46.943 INFO:teuthology.orchestra.run.smithi062.stdout:481.out 2023-06-09T04:45:46.944 INFO:teuthology.orchestra.run.smithi062.stdout:482 2023-06-09T04:45:46.944 INFO:teuthology.orchestra.run.smithi062.stdout:482.out 2023-06-09T04:45:46.944 INFO:teuthology.orchestra.run.smithi062.stdout:483 2023-06-09T04:45:46.944 INFO:teuthology.orchestra.run.smithi062.stdout:483.out 2023-06-09T04:45:46.944 INFO:teuthology.orchestra.run.smithi062.stdout:484 2023-06-09T04:45:46.944 INFO:teuthology.orchestra.run.smithi062.stdout:484.out 2023-06-09T04:45:46.944 INFO:teuthology.orchestra.run.smithi062.stdout:485 2023-06-09T04:45:46.944 INFO:teuthology.orchestra.run.smithi062.stdout:485.out 2023-06-09T04:45:46.945 INFO:teuthology.orchestra.run.smithi062.stdout:486 2023-06-09T04:45:46.945 INFO:teuthology.orchestra.run.smithi062.stdout:486.out 2023-06-09T04:45:46.945 INFO:teuthology.orchestra.run.smithi062.stdout:487 2023-06-09T04:45:46.945 INFO:teuthology.orchestra.run.smithi062.stdout:487.out 2023-06-09T04:45:46.945 INFO:teuthology.orchestra.run.smithi062.stdout:488 2023-06-09T04:45:46.945 INFO:teuthology.orchestra.run.smithi062.stdout:488.out 2023-06-09T04:45:46.945 INFO:teuthology.orchestra.run.smithi062.stdout:489 2023-06-09T04:45:46.945 INFO:teuthology.orchestra.run.smithi062.stdout:489.out 2023-06-09T04:45:46.946 INFO:teuthology.orchestra.run.smithi062.stdout:490 2023-06-09T04:45:46.946 INFO:teuthology.orchestra.run.smithi062.stdout:490.out 2023-06-09T04:45:46.946 INFO:teuthology.orchestra.run.smithi062.stdout:491 2023-06-09T04:45:46.946 INFO:teuthology.orchestra.run.smithi062.stdout:491.out 2023-06-09T04:45:46.946 INFO:teuthology.orchestra.run.smithi062.stdout:492 2023-06-09T04:45:46.946 INFO:teuthology.orchestra.run.smithi062.stdout:492.out 2023-06-09T04:45:46.946 INFO:teuthology.orchestra.run.smithi062.stdout:493 2023-06-09T04:45:46.946 INFO:teuthology.orchestra.run.smithi062.stdout:493.out 2023-06-09T04:45:46.947 INFO:teuthology.orchestra.run.smithi062.stdout:494 2023-06-09T04:45:46.947 INFO:teuthology.orchestra.run.smithi062.stdout:494.out 2023-06-09T04:45:46.947 INFO:teuthology.orchestra.run.smithi062.stdout:495 2023-06-09T04:45:46.947 INFO:teuthology.orchestra.run.smithi062.stdout:495.out 2023-06-09T04:45:46.947 INFO:teuthology.orchestra.run.smithi062.stdout:496 2023-06-09T04:45:46.947 INFO:teuthology.orchestra.run.smithi062.stdout:496.out 2023-06-09T04:45:46.947 INFO:teuthology.orchestra.run.smithi062.stdout:497 2023-06-09T04:45:46.947 INFO:teuthology.orchestra.run.smithi062.stdout:497.out 2023-06-09T04:45:46.948 INFO:teuthology.orchestra.run.smithi062.stdout:498 2023-06-09T04:45:46.948 INFO:teuthology.orchestra.run.smithi062.stdout:498.out 2023-06-09T04:45:46.948 INFO:teuthology.orchestra.run.smithi062.stdout:499 2023-06-09T04:45:46.948 INFO:teuthology.orchestra.run.smithi062.stdout:499.out 2023-06-09T04:45:46.948 INFO:teuthology.orchestra.run.smithi062.stdout:500 2023-06-09T04:45:46.948 INFO:teuthology.orchestra.run.smithi062.stdout:500.out 2023-06-09T04:45:46.948 INFO:teuthology.orchestra.run.smithi062.stdout:501 2023-06-09T04:45:46.948 INFO:teuthology.orchestra.run.smithi062.stdout:501.out 2023-06-09T04:45:46.949 INFO:teuthology.orchestra.run.smithi062.stdout:502 2023-06-09T04:45:46.949 INFO:teuthology.orchestra.run.smithi062.stdout:502.out 2023-06-09T04:45:46.949 INFO:teuthology.orchestra.run.smithi062.stdout:503 2023-06-09T04:45:46.949 INFO:teuthology.orchestra.run.smithi062.stdout:503.out 2023-06-09T04:45:46.949 INFO:teuthology.orchestra.run.smithi062.stdout:504 2023-06-09T04:45:46.949 INFO:teuthology.orchestra.run.smithi062.stdout:504.out 2023-06-09T04:45:46.949 INFO:teuthology.orchestra.run.smithi062.stdout:505 2023-06-09T04:45:46.949 INFO:teuthology.orchestra.run.smithi062.stdout:505.out 2023-06-09T04:45:46.950 INFO:teuthology.orchestra.run.smithi062.stdout:506 2023-06-09T04:45:46.950 INFO:teuthology.orchestra.run.smithi062.stdout:506.out 2023-06-09T04:45:46.950 INFO:teuthology.orchestra.run.smithi062.stdout:507 2023-06-09T04:45:46.950 INFO:teuthology.orchestra.run.smithi062.stdout:507.out 2023-06-09T04:45:46.950 INFO:teuthology.orchestra.run.smithi062.stdout:508 2023-06-09T04:45:46.950 INFO:teuthology.orchestra.run.smithi062.stdout:508.out 2023-06-09T04:45:46.950 INFO:teuthology.orchestra.run.smithi062.stdout:509 2023-06-09T04:45:46.950 INFO:teuthology.orchestra.run.smithi062.stdout:509.out 2023-06-09T04:45:46.951 INFO:teuthology.orchestra.run.smithi062.stdout:510 2023-06-09T04:45:46.951 INFO:teuthology.orchestra.run.smithi062.stdout:510.out 2023-06-09T04:45:46.951 INFO:teuthology.orchestra.run.smithi062.stdout:511 2023-06-09T04:45:46.951 INFO:teuthology.orchestra.run.smithi062.stdout:511.out 2023-06-09T04:45:46.951 INFO:teuthology.orchestra.run.smithi062.stdout:512 2023-06-09T04:45:46.951 INFO:teuthology.orchestra.run.smithi062.stdout:512.out 2023-06-09T04:45:46.951 INFO:teuthology.orchestra.run.smithi062.stdout:513 2023-06-09T04:45:46.951 INFO:teuthology.orchestra.run.smithi062.stdout:513.out 2023-06-09T04:45:46.952 INFO:teuthology.orchestra.run.smithi062.stdout:514 2023-06-09T04:45:46.952 INFO:teuthology.orchestra.run.smithi062.stdout:514.out 2023-06-09T04:45:46.952 INFO:teuthology.orchestra.run.smithi062.stdout:515 2023-06-09T04:45:46.952 INFO:teuthology.orchestra.run.smithi062.stdout:515.out 2023-06-09T04:45:46.952 INFO:teuthology.orchestra.run.smithi062.stdout:516 2023-06-09T04:45:46.952 INFO:teuthology.orchestra.run.smithi062.stdout:516.out 2023-06-09T04:45:46.952 INFO:teuthology.orchestra.run.smithi062.stdout:517 2023-06-09T04:45:46.952 INFO:teuthology.orchestra.run.smithi062.stdout:517.out 2023-06-09T04:45:46.953 INFO:teuthology.orchestra.run.smithi062.stdout:518 2023-06-09T04:45:46.953 INFO:teuthology.orchestra.run.smithi062.stdout:518.out 2023-06-09T04:45:46.953 INFO:teuthology.orchestra.run.smithi062.stdout:519 2023-06-09T04:45:46.953 INFO:teuthology.orchestra.run.smithi062.stdout:519.out 2023-06-09T04:45:46.953 INFO:teuthology.orchestra.run.smithi062.stdout:520 2023-06-09T04:45:46.953 INFO:teuthology.orchestra.run.smithi062.stdout:520.out 2023-06-09T04:45:46.953 INFO:teuthology.orchestra.run.smithi062.stdout:521 2023-06-09T04:45:46.953 INFO:teuthology.orchestra.run.smithi062.stdout:521.out 2023-06-09T04:45:46.954 INFO:teuthology.orchestra.run.smithi062.stdout:522 2023-06-09T04:45:46.954 INFO:teuthology.orchestra.run.smithi062.stdout:522.out 2023-06-09T04:45:46.954 INFO:teuthology.orchestra.run.smithi062.stdout:523 2023-06-09T04:45:46.954 INFO:teuthology.orchestra.run.smithi062.stdout:523.out 2023-06-09T04:45:46.954 INFO:teuthology.orchestra.run.smithi062.stdout:524 2023-06-09T04:45:46.954 INFO:teuthology.orchestra.run.smithi062.stdout:524.out 2023-06-09T04:45:46.954 INFO:teuthology.orchestra.run.smithi062.stdout:525 2023-06-09T04:45:46.954 INFO:teuthology.orchestra.run.smithi062.stdout:525.out 2023-06-09T04:45:46.954 INFO:teuthology.orchestra.run.smithi062.stdout:526 2023-06-09T04:45:46.955 INFO:teuthology.orchestra.run.smithi062.stdout:526.out 2023-06-09T04:45:46.955 INFO:teuthology.orchestra.run.smithi062.stdout:527 2023-06-09T04:45:46.955 INFO:teuthology.orchestra.run.smithi062.stdout:527.out 2023-06-09T04:45:46.955 INFO:teuthology.orchestra.run.smithi062.stdout:528 2023-06-09T04:45:46.955 INFO:teuthology.orchestra.run.smithi062.stdout:528.out 2023-06-09T04:45:46.955 INFO:teuthology.orchestra.run.smithi062.stdout:529 2023-06-09T04:45:46.955 INFO:teuthology.orchestra.run.smithi062.stdout:529.out 2023-06-09T04:45:46.955 INFO:teuthology.orchestra.run.smithi062.stdout:530 2023-06-09T04:45:46.956 INFO:teuthology.orchestra.run.smithi062.stdout:530.out 2023-06-09T04:45:46.956 INFO:teuthology.orchestra.run.smithi062.stdout:531 2023-06-09T04:45:46.956 INFO:teuthology.orchestra.run.smithi062.stdout:531.out 2023-06-09T04:45:46.956 INFO:teuthology.orchestra.run.smithi062.stdout:532 2023-06-09T04:45:46.956 INFO:teuthology.orchestra.run.smithi062.stdout:532.out 2023-06-09T04:45:46.956 INFO:teuthology.orchestra.run.smithi062.stdout:533 2023-06-09T04:45:46.956 INFO:teuthology.orchestra.run.smithi062.stdout:533.out 2023-06-09T04:45:46.956 INFO:teuthology.orchestra.run.smithi062.stdout:534 2023-06-09T04:45:46.957 INFO:teuthology.orchestra.run.smithi062.stdout:534.out 2023-06-09T04:45:46.957 INFO:teuthology.orchestra.run.smithi062.stdout:535 2023-06-09T04:45:46.957 INFO:teuthology.orchestra.run.smithi062.stdout:535.out 2023-06-09T04:45:46.957 INFO:teuthology.orchestra.run.smithi062.stdout:536 2023-06-09T04:45:46.957 INFO:teuthology.orchestra.run.smithi062.stdout:536.out 2023-06-09T04:45:46.957 INFO:teuthology.orchestra.run.smithi062.stdout:537 2023-06-09T04:45:46.957 INFO:teuthology.orchestra.run.smithi062.stdout:537.out 2023-06-09T04:45:46.957 INFO:teuthology.orchestra.run.smithi062.stdout:538 2023-06-09T04:45:46.958 INFO:teuthology.orchestra.run.smithi062.stdout:538.out 2023-06-09T04:45:46.958 INFO:teuthology.orchestra.run.smithi062.stdout:539 2023-06-09T04:45:46.958 INFO:teuthology.orchestra.run.smithi062.stdout:539.out 2023-06-09T04:45:46.958 INFO:teuthology.orchestra.run.smithi062.stdout:540 2023-06-09T04:45:46.958 INFO:teuthology.orchestra.run.smithi062.stdout:540.out 2023-06-09T04:45:46.958 INFO:teuthology.orchestra.run.smithi062.stdout:541 2023-06-09T04:45:46.958 INFO:teuthology.orchestra.run.smithi062.stdout:541.out 2023-06-09T04:45:46.958 INFO:teuthology.orchestra.run.smithi062.stdout:542 2023-06-09T04:45:46.959 INFO:teuthology.orchestra.run.smithi062.stdout:542.out 2023-06-09T04:45:46.959 INFO:teuthology.orchestra.run.smithi062.stdout:543 2023-06-09T04:45:46.959 INFO:teuthology.orchestra.run.smithi062.stdout:543.out 2023-06-09T04:45:46.959 INFO:teuthology.orchestra.run.smithi062.stdout:544 2023-06-09T04:45:46.959 INFO:teuthology.orchestra.run.smithi062.stdout:544.out 2023-06-09T04:45:46.959 INFO:teuthology.orchestra.run.smithi062.stdout:545 2023-06-09T04:45:46.959 INFO:teuthology.orchestra.run.smithi062.stdout:545.out 2023-06-09T04:45:46.959 INFO:teuthology.orchestra.run.smithi062.stdout:546 2023-06-09T04:45:46.960 INFO:teuthology.orchestra.run.smithi062.stdout:546.out 2023-06-09T04:45:46.960 INFO:teuthology.orchestra.run.smithi062.stdout:547 2023-06-09T04:45:46.960 INFO:teuthology.orchestra.run.smithi062.stdout:547.out 2023-06-09T04:45:46.960 INFO:teuthology.orchestra.run.smithi062.stdout:548 2023-06-09T04:45:46.960 INFO:teuthology.orchestra.run.smithi062.stdout:548.out 2023-06-09T04:45:46.960 INFO:teuthology.orchestra.run.smithi062.stdout:549 2023-06-09T04:45:46.960 INFO:teuthology.orchestra.run.smithi062.stdout:549.out 2023-06-09T04:45:46.960 INFO:teuthology.orchestra.run.smithi062.stdout:550 2023-06-09T04:45:46.961 INFO:teuthology.orchestra.run.smithi062.stdout:550.out 2023-06-09T04:45:46.961 INFO:teuthology.orchestra.run.smithi062.stdout:551 2023-06-09T04:45:46.961 INFO:teuthology.orchestra.run.smithi062.stdout:551.out 2023-06-09T04:45:46.961 INFO:teuthology.orchestra.run.smithi062.stdout:552 2023-06-09T04:45:46.961 INFO:teuthology.orchestra.run.smithi062.stdout:552.out 2023-06-09T04:45:46.961 INFO:teuthology.orchestra.run.smithi062.stdout:553 2023-06-09T04:45:46.961 INFO:teuthology.orchestra.run.smithi062.stdout:553.out 2023-06-09T04:45:46.961 INFO:teuthology.orchestra.run.smithi062.stdout:554 2023-06-09T04:45:46.962 INFO:teuthology.orchestra.run.smithi062.stdout:554.out 2023-06-09T04:45:46.962 INFO:teuthology.orchestra.run.smithi062.stdout:555 2023-06-09T04:45:46.962 INFO:teuthology.orchestra.run.smithi062.stdout:555.out 2023-06-09T04:45:46.962 INFO:teuthology.orchestra.run.smithi062.stdout:556 2023-06-09T04:45:46.962 INFO:teuthology.orchestra.run.smithi062.stdout:556.out 2023-06-09T04:45:46.962 INFO:teuthology.orchestra.run.smithi062.stdout:557 2023-06-09T04:45:46.962 INFO:teuthology.orchestra.run.smithi062.stdout:557.out 2023-06-09T04:45:46.962 INFO:teuthology.orchestra.run.smithi062.stdout:558 2023-06-09T04:45:46.963 INFO:teuthology.orchestra.run.smithi062.stdout:558.out 2023-06-09T04:45:46.963 INFO:teuthology.orchestra.run.smithi062.stdout:559 2023-06-09T04:45:46.963 INFO:teuthology.orchestra.run.smithi062.stdout:559.out 2023-06-09T04:45:46.963 INFO:teuthology.orchestra.run.smithi062.stdout:560 2023-06-09T04:45:46.963 INFO:teuthology.orchestra.run.smithi062.stdout:560.out 2023-06-09T04:45:46.963 INFO:teuthology.orchestra.run.smithi062.stdout:561 2023-06-09T04:45:46.963 INFO:teuthology.orchestra.run.smithi062.stdout:561.out 2023-06-09T04:45:46.963 INFO:teuthology.orchestra.run.smithi062.stdout:562 2023-06-09T04:45:46.964 INFO:teuthology.orchestra.run.smithi062.stdout:562.out 2023-06-09T04:45:46.964 INFO:teuthology.orchestra.run.smithi062.stdout:563 2023-06-09T04:45:46.964 INFO:teuthology.orchestra.run.smithi062.stdout:563.out 2023-06-09T04:45:46.964 INFO:teuthology.orchestra.run.smithi062.stdout:564 2023-06-09T04:45:46.964 INFO:teuthology.orchestra.run.smithi062.stdout:564.out 2023-06-09T04:45:46.964 INFO:teuthology.orchestra.run.smithi062.stdout:565 2023-06-09T04:45:46.964 INFO:teuthology.orchestra.run.smithi062.stdout:565.out 2023-06-09T04:45:46.964 INFO:teuthology.orchestra.run.smithi062.stdout:566 2023-06-09T04:45:46.965 INFO:teuthology.orchestra.run.smithi062.stdout:566.out 2023-06-09T04:45:46.965 INFO:teuthology.orchestra.run.smithi062.stdout:567 2023-06-09T04:45:46.965 INFO:teuthology.orchestra.run.smithi062.stdout:567.out 2023-06-09T04:45:46.965 INFO:teuthology.orchestra.run.smithi062.stdout:568 2023-06-09T04:45:46.965 INFO:teuthology.orchestra.run.smithi062.stdout:568.out 2023-06-09T04:45:46.965 INFO:teuthology.orchestra.run.smithi062.stdout:569 2023-06-09T04:45:46.965 INFO:teuthology.orchestra.run.smithi062.stdout:569.out 2023-06-09T04:45:46.965 INFO:teuthology.orchestra.run.smithi062.stdout:570 2023-06-09T04:45:46.966 INFO:teuthology.orchestra.run.smithi062.stdout:570.out 2023-06-09T04:45:46.966 INFO:teuthology.orchestra.run.smithi062.stdout:571 2023-06-09T04:45:46.966 INFO:teuthology.orchestra.run.smithi062.stdout:571.out 2023-06-09T04:45:46.966 INFO:teuthology.orchestra.run.smithi062.stdout:572 2023-06-09T04:45:46.966 INFO:teuthology.orchestra.run.smithi062.stdout:572.out 2023-06-09T04:45:46.966 INFO:teuthology.orchestra.run.smithi062.stdout:573 2023-06-09T04:45:46.966 INFO:teuthology.orchestra.run.smithi062.stdout:573.out 2023-06-09T04:45:46.966 INFO:teuthology.orchestra.run.smithi062.stdout:574 2023-06-09T04:45:46.967 INFO:teuthology.orchestra.run.smithi062.stdout:574.out 2023-06-09T04:45:46.967 INFO:teuthology.orchestra.run.smithi062.stdout:575 2023-06-09T04:45:46.967 INFO:teuthology.orchestra.run.smithi062.stdout:575.out 2023-06-09T04:45:46.967 INFO:teuthology.orchestra.run.smithi062.stdout:576 2023-06-09T04:45:46.967 INFO:teuthology.orchestra.run.smithi062.stdout:576.out 2023-06-09T04:45:46.967 INFO:teuthology.orchestra.run.smithi062.stdout:577 2023-06-09T04:45:46.967 INFO:teuthology.orchestra.run.smithi062.stdout:577.out 2023-06-09T04:45:46.967 INFO:teuthology.orchestra.run.smithi062.stdout:578 2023-06-09T04:45:46.968 INFO:teuthology.orchestra.run.smithi062.stdout:578.out 2023-06-09T04:45:46.968 INFO:teuthology.orchestra.run.smithi062.stdout:579 2023-06-09T04:45:46.968 INFO:teuthology.orchestra.run.smithi062.stdout:579.out 2023-06-09T04:45:46.968 INFO:teuthology.orchestra.run.smithi062.stdout:580 2023-06-09T04:45:46.968 INFO:teuthology.orchestra.run.smithi062.stdout:580.out 2023-06-09T04:45:46.968 INFO:teuthology.orchestra.run.smithi062.stdout:581 2023-06-09T04:45:46.968 INFO:teuthology.orchestra.run.smithi062.stdout:581.out 2023-06-09T04:45:46.968 INFO:teuthology.orchestra.run.smithi062.stdout:582 2023-06-09T04:45:46.969 INFO:teuthology.orchestra.run.smithi062.stdout:582.out 2023-06-09T04:45:46.969 INFO:teuthology.orchestra.run.smithi062.stdout:583 2023-06-09T04:45:46.969 INFO:teuthology.orchestra.run.smithi062.stdout:583.out 2023-06-09T04:45:46.969 INFO:teuthology.orchestra.run.smithi062.stdout:584 2023-06-09T04:45:46.969 INFO:teuthology.orchestra.run.smithi062.stdout:584.out 2023-06-09T04:45:46.969 INFO:teuthology.orchestra.run.smithi062.stdout:585 2023-06-09T04:45:46.969 INFO:teuthology.orchestra.run.smithi062.stdout:585.out 2023-06-09T04:45:46.969 INFO:teuthology.orchestra.run.smithi062.stdout:586 2023-06-09T04:45:46.970 INFO:teuthology.orchestra.run.smithi062.stdout:586.out 2023-06-09T04:45:46.970 INFO:teuthology.orchestra.run.smithi062.stdout:587 2023-06-09T04:45:46.970 INFO:teuthology.orchestra.run.smithi062.stdout:587.out 2023-06-09T04:45:46.970 INFO:teuthology.orchestra.run.smithi062.stdout:588 2023-06-09T04:45:46.970 INFO:teuthology.orchestra.run.smithi062.stdout:588.out 2023-06-09T04:45:46.970 INFO:teuthology.orchestra.run.smithi062.stdout:589 2023-06-09T04:45:46.970 INFO:teuthology.orchestra.run.smithi062.stdout:589.out 2023-06-09T04:45:46.970 INFO:teuthology.orchestra.run.smithi062.stdout:590 2023-06-09T04:45:46.970 INFO:teuthology.orchestra.run.smithi062.stdout:590.out 2023-06-09T04:45:46.971 INFO:teuthology.orchestra.run.smithi062.stdout:591 2023-06-09T04:45:46.971 INFO:teuthology.orchestra.run.smithi062.stdout:591.out 2023-06-09T04:45:46.971 INFO:teuthology.orchestra.run.smithi062.stdout:592 2023-06-09T04:45:46.971 INFO:teuthology.orchestra.run.smithi062.stdout:592.out 2023-06-09T04:45:46.971 INFO:teuthology.orchestra.run.smithi062.stdout:593 2023-06-09T04:45:46.971 INFO:teuthology.orchestra.run.smithi062.stdout:593.out 2023-06-09T04:45:46.971 INFO:teuthology.orchestra.run.smithi062.stdout:594 2023-06-09T04:45:46.971 INFO:teuthology.orchestra.run.smithi062.stdout:594.out 2023-06-09T04:45:46.972 INFO:teuthology.orchestra.run.smithi062.stdout:595 2023-06-09T04:45:46.972 INFO:teuthology.orchestra.run.smithi062.stdout:595.out 2023-06-09T04:45:46.972 INFO:teuthology.orchestra.run.smithi062.stdout:596 2023-06-09T04:45:46.972 INFO:teuthology.orchestra.run.smithi062.stdout:596.out 2023-06-09T04:45:46.972 INFO:teuthology.orchestra.run.smithi062.stdout:597 2023-06-09T04:45:46.972 INFO:teuthology.orchestra.run.smithi062.stdout:597.out 2023-06-09T04:45:46.972 INFO:teuthology.orchestra.run.smithi062.stdout:598 2023-06-09T04:45:46.972 INFO:teuthology.orchestra.run.smithi062.stdout:598.out 2023-06-09T04:45:46.973 INFO:teuthology.orchestra.run.smithi062.stdout:599 2023-06-09T04:45:46.973 INFO:teuthology.orchestra.run.smithi062.stdout:599.out 2023-06-09T04:45:46.973 INFO:teuthology.orchestra.run.smithi062.stdout:600 2023-06-09T04:45:46.973 INFO:teuthology.orchestra.run.smithi062.stdout:600.out 2023-06-09T04:45:46.973 INFO:teuthology.orchestra.run.smithi062.stdout:601 2023-06-09T04:45:46.973 INFO:teuthology.orchestra.run.smithi062.stdout:601.out 2023-06-09T04:45:46.973 INFO:teuthology.orchestra.run.smithi062.stdout:602 2023-06-09T04:45:46.974 INFO:teuthology.orchestra.run.smithi062.stdout:602.out 2023-06-09T04:45:46.974 INFO:teuthology.orchestra.run.smithi062.stdout:603 2023-06-09T04:45:46.974 INFO:teuthology.orchestra.run.smithi062.stdout:603.out 2023-06-09T04:45:46.974 INFO:teuthology.orchestra.run.smithi062.stdout:604 2023-06-09T04:45:46.974 INFO:teuthology.orchestra.run.smithi062.stdout:604.out 2023-06-09T04:45:46.974 INFO:teuthology.orchestra.run.smithi062.stdout:605 2023-06-09T04:45:46.974 INFO:teuthology.orchestra.run.smithi062.stdout:605.out 2023-06-09T04:45:46.974 INFO:teuthology.orchestra.run.smithi062.stdout:606 2023-06-09T04:45:46.974 INFO:teuthology.orchestra.run.smithi062.stdout:606.out 2023-06-09T04:45:46.975 INFO:teuthology.orchestra.run.smithi062.stdout:607 2023-06-09T04:45:46.975 INFO:teuthology.orchestra.run.smithi062.stdout:607.out 2023-06-09T04:45:46.975 INFO:teuthology.orchestra.run.smithi062.stdout:608 2023-06-09T04:45:46.975 INFO:teuthology.orchestra.run.smithi062.stdout:608.out 2023-06-09T04:45:46.975 INFO:teuthology.orchestra.run.smithi062.stdout:609 2023-06-09T04:45:46.975 INFO:teuthology.orchestra.run.smithi062.stdout:609.out 2023-06-09T04:45:46.975 INFO:teuthology.orchestra.run.smithi062.stdout:610 2023-06-09T04:45:46.975 INFO:teuthology.orchestra.run.smithi062.stdout:610.out 2023-06-09T04:45:46.976 INFO:teuthology.orchestra.run.smithi062.stdout:611 2023-06-09T04:45:46.976 INFO:teuthology.orchestra.run.smithi062.stdout:611.out 2023-06-09T04:45:46.976 INFO:teuthology.orchestra.run.smithi062.stdout:612 2023-06-09T04:45:46.976 INFO:teuthology.orchestra.run.smithi062.stdout:612.out 2023-06-09T04:45:46.976 INFO:teuthology.orchestra.run.smithi062.stdout:613 2023-06-09T04:45:46.976 INFO:teuthology.orchestra.run.smithi062.stdout:613.out 2023-06-09T04:45:46.976 INFO:teuthology.orchestra.run.smithi062.stdout:614 2023-06-09T04:45:46.976 INFO:teuthology.orchestra.run.smithi062.stdout:614.out 2023-06-09T04:45:46.977 INFO:teuthology.orchestra.run.smithi062.stdout:615 2023-06-09T04:45:46.977 INFO:teuthology.orchestra.run.smithi062.stdout:615.out 2023-06-09T04:45:46.977 INFO:teuthology.orchestra.run.smithi062.stdout:616 2023-06-09T04:45:46.977 INFO:teuthology.orchestra.run.smithi062.stdout:616.out 2023-06-09T04:45:46.977 INFO:teuthology.orchestra.run.smithi062.stdout:617 2023-06-09T04:45:46.977 INFO:teuthology.orchestra.run.smithi062.stdout:617.out 2023-06-09T04:45:46.977 INFO:teuthology.orchestra.run.smithi062.stdout:618 2023-06-09T04:45:46.977 INFO:teuthology.orchestra.run.smithi062.stdout:618.out 2023-06-09T04:45:46.978 INFO:teuthology.orchestra.run.smithi062.stdout:619 2023-06-09T04:45:46.978 INFO:teuthology.orchestra.run.smithi062.stdout:619.out 2023-06-09T04:45:46.978 INFO:teuthology.orchestra.run.smithi062.stdout:620 2023-06-09T04:45:46.978 INFO:teuthology.orchestra.run.smithi062.stdout:620.out 2023-06-09T04:45:46.978 INFO:teuthology.orchestra.run.smithi062.stdout:621 2023-06-09T04:45:46.978 INFO:teuthology.orchestra.run.smithi062.stdout:621.out 2023-06-09T04:45:46.978 INFO:teuthology.orchestra.run.smithi062.stdout:622 2023-06-09T04:45:46.978 INFO:teuthology.orchestra.run.smithi062.stdout:622.out 2023-06-09T04:45:46.979 INFO:teuthology.orchestra.run.smithi062.stdout:623 2023-06-09T04:45:46.979 INFO:teuthology.orchestra.run.smithi062.stdout:623.out 2023-06-09T04:45:46.979 INFO:teuthology.orchestra.run.smithi062.stdout:624 2023-06-09T04:45:46.979 INFO:teuthology.orchestra.run.smithi062.stdout:624.out 2023-06-09T04:45:46.979 INFO:teuthology.orchestra.run.smithi062.stdout:625 2023-06-09T04:45:46.979 INFO:teuthology.orchestra.run.smithi062.stdout:625.out 2023-06-09T04:45:46.979 INFO:teuthology.orchestra.run.smithi062.stdout:626 2023-06-09T04:45:46.979 INFO:teuthology.orchestra.run.smithi062.stdout:626.out 2023-06-09T04:45:46.980 INFO:teuthology.orchestra.run.smithi062.stdout:627 2023-06-09T04:45:46.980 INFO:teuthology.orchestra.run.smithi062.stdout:627.out 2023-06-09T04:45:46.980 INFO:teuthology.orchestra.run.smithi062.stdout:628 2023-06-09T04:45:46.980 INFO:teuthology.orchestra.run.smithi062.stdout:628.out 2023-06-09T04:45:46.980 INFO:teuthology.orchestra.run.smithi062.stdout:629 2023-06-09T04:45:46.980 INFO:teuthology.orchestra.run.smithi062.stdout:629.out 2023-06-09T04:45:46.980 INFO:teuthology.orchestra.run.smithi062.stdout:630 2023-06-09T04:45:46.980 INFO:teuthology.orchestra.run.smithi062.stdout:630.out 2023-06-09T04:45:46.981 INFO:teuthology.orchestra.run.smithi062.stdout:631 2023-06-09T04:45:46.981 INFO:teuthology.orchestra.run.smithi062.stdout:631.out 2023-06-09T04:45:46.981 INFO:teuthology.orchestra.run.smithi062.stdout:632 2023-06-09T04:45:46.981 INFO:teuthology.orchestra.run.smithi062.stdout:632.out 2023-06-09T04:45:46.981 INFO:teuthology.orchestra.run.smithi062.stdout:633 2023-06-09T04:45:46.981 INFO:teuthology.orchestra.run.smithi062.stdout:633.out 2023-06-09T04:45:46.981 INFO:teuthology.orchestra.run.smithi062.stdout:634 2023-06-09T04:45:46.981 INFO:teuthology.orchestra.run.smithi062.stdout:634.out 2023-06-09T04:45:46.982 INFO:teuthology.orchestra.run.smithi062.stdout:635 2023-06-09T04:45:46.982 INFO:teuthology.orchestra.run.smithi062.stdout:635.out 2023-06-09T04:45:46.982 INFO:teuthology.orchestra.run.smithi062.stdout:636 2023-06-09T04:45:46.982 INFO:teuthology.orchestra.run.smithi062.stdout:636.out 2023-06-09T04:45:46.982 INFO:teuthology.orchestra.run.smithi062.stdout:637 2023-06-09T04:45:46.982 INFO:teuthology.orchestra.run.smithi062.stdout:637.out 2023-06-09T04:45:46.982 INFO:teuthology.orchestra.run.smithi062.stdout:638 2023-06-09T04:45:46.982 INFO:teuthology.orchestra.run.smithi062.stdout:638.out 2023-06-09T04:45:46.983 INFO:teuthology.orchestra.run.smithi062.stdout:639 2023-06-09T04:45:46.983 INFO:teuthology.orchestra.run.smithi062.stdout:639.out 2023-06-09T04:45:46.983 INFO:teuthology.orchestra.run.smithi062.stdout:640 2023-06-09T04:45:46.983 INFO:teuthology.orchestra.run.smithi062.stdout:640.out 2023-06-09T04:45:46.983 INFO:teuthology.orchestra.run.smithi062.stdout:641 2023-06-09T04:45:46.983 INFO:teuthology.orchestra.run.smithi062.stdout:641.out 2023-06-09T04:45:46.983 INFO:teuthology.orchestra.run.smithi062.stdout:642 2023-06-09T04:45:46.983 INFO:teuthology.orchestra.run.smithi062.stdout:642.out 2023-06-09T04:45:46.984 INFO:teuthology.orchestra.run.smithi062.stdout:643 2023-06-09T04:45:46.984 INFO:teuthology.orchestra.run.smithi062.stdout:643.out 2023-06-09T04:45:46.984 INFO:teuthology.orchestra.run.smithi062.stdout:644 2023-06-09T04:45:46.984 INFO:teuthology.orchestra.run.smithi062.stdout:644.out 2023-06-09T04:45:46.984 INFO:teuthology.orchestra.run.smithi062.stdout:645 2023-06-09T04:45:46.984 INFO:teuthology.orchestra.run.smithi062.stdout:645.out 2023-06-09T04:45:46.984 INFO:teuthology.orchestra.run.smithi062.stdout:646 2023-06-09T04:45:46.984 INFO:teuthology.orchestra.run.smithi062.stdout:646.out 2023-06-09T04:45:46.985 INFO:teuthology.orchestra.run.smithi062.stdout:647 2023-06-09T04:45:46.985 INFO:teuthology.orchestra.run.smithi062.stdout:647.out 2023-06-09T04:45:46.985 INFO:teuthology.orchestra.run.smithi062.stdout:648 2023-06-09T04:45:46.985 INFO:teuthology.orchestra.run.smithi062.stdout:648.out 2023-06-09T04:45:46.985 INFO:teuthology.orchestra.run.smithi062.stdout:649 2023-06-09T04:45:46.985 INFO:teuthology.orchestra.run.smithi062.stdout:649.out 2023-06-09T04:45:46.985 INFO:teuthology.orchestra.run.smithi062.stdout:650 2023-06-09T04:45:46.985 INFO:teuthology.orchestra.run.smithi062.stdout:650.out 2023-06-09T04:45:46.986 INFO:teuthology.orchestra.run.smithi062.stdout:651 2023-06-09T04:45:46.986 INFO:teuthology.orchestra.run.smithi062.stdout:651.out 2023-06-09T04:45:46.986 INFO:teuthology.orchestra.run.smithi062.stdout:652 2023-06-09T04:45:46.986 INFO:teuthology.orchestra.run.smithi062.stdout:652.out 2023-06-09T04:45:46.986 INFO:teuthology.orchestra.run.smithi062.stdout:653 2023-06-09T04:45:46.986 INFO:teuthology.orchestra.run.smithi062.stdout:653.out 2023-06-09T04:45:46.986 INFO:teuthology.orchestra.run.smithi062.stdout:654 2023-06-09T04:45:46.986 INFO:teuthology.orchestra.run.smithi062.stdout:654.out 2023-06-09T04:45:46.987 INFO:teuthology.orchestra.run.smithi062.stdout:655 2023-06-09T04:45:46.987 INFO:teuthology.orchestra.run.smithi062.stdout:655.out 2023-06-09T04:45:46.987 INFO:teuthology.orchestra.run.smithi062.stdout:656 2023-06-09T04:45:46.987 INFO:teuthology.orchestra.run.smithi062.stdout:656.out 2023-06-09T04:45:46.987 INFO:teuthology.orchestra.run.smithi062.stdout:657 2023-06-09T04:45:46.987 INFO:teuthology.orchestra.run.smithi062.stdout:657.out 2023-06-09T04:45:46.987 INFO:teuthology.orchestra.run.smithi062.stdout:658 2023-06-09T04:45:46.987 INFO:teuthology.orchestra.run.smithi062.stdout:658.out 2023-06-09T04:45:46.988 INFO:teuthology.orchestra.run.smithi062.stdout:659 2023-06-09T04:45:46.988 INFO:teuthology.orchestra.run.smithi062.stdout:659.out 2023-06-09T04:45:46.988 INFO:teuthology.orchestra.run.smithi062.stdout:660 2023-06-09T04:45:46.988 INFO:teuthology.orchestra.run.smithi062.stdout:660.out 2023-06-09T04:45:46.988 INFO:teuthology.orchestra.run.smithi062.stdout:661 2023-06-09T04:45:46.988 INFO:teuthology.orchestra.run.smithi062.stdout:661.out 2023-06-09T04:45:46.988 INFO:teuthology.orchestra.run.smithi062.stdout:662 2023-06-09T04:45:46.988 INFO:teuthology.orchestra.run.smithi062.stdout:662.out 2023-06-09T04:45:46.989 INFO:teuthology.orchestra.run.smithi062.stdout:663 2023-06-09T04:45:46.989 INFO:teuthology.orchestra.run.smithi062.stdout:663.out 2023-06-09T04:45:46.989 INFO:teuthology.orchestra.run.smithi062.stdout:664 2023-06-09T04:45:46.989 INFO:teuthology.orchestra.run.smithi062.stdout:664.out 2023-06-09T04:45:46.989 INFO:teuthology.orchestra.run.smithi062.stdout:665 2023-06-09T04:45:46.989 INFO:teuthology.orchestra.run.smithi062.stdout:665.out 2023-06-09T04:45:46.989 INFO:teuthology.orchestra.run.smithi062.stdout:666 2023-06-09T04:45:46.989 INFO:teuthology.orchestra.run.smithi062.stdout:666.out 2023-06-09T04:45:46.990 INFO:teuthology.orchestra.run.smithi062.stdout:667 2023-06-09T04:45:46.990 INFO:teuthology.orchestra.run.smithi062.stdout:667.out 2023-06-09T04:45:46.990 INFO:teuthology.orchestra.run.smithi062.stdout:668 2023-06-09T04:45:46.990 INFO:teuthology.orchestra.run.smithi062.stdout:668.out 2023-06-09T04:45:46.990 INFO:teuthology.orchestra.run.smithi062.stdout:669 2023-06-09T04:45:46.990 INFO:teuthology.orchestra.run.smithi062.stdout:669.out 2023-06-09T04:45:46.990 INFO:teuthology.orchestra.run.smithi062.stdout:670 2023-06-09T04:45:46.990 INFO:teuthology.orchestra.run.smithi062.stdout:670.out 2023-06-09T04:45:46.991 INFO:teuthology.orchestra.run.smithi062.stdout:671 2023-06-09T04:45:46.991 INFO:teuthology.orchestra.run.smithi062.stdout:671.out 2023-06-09T04:45:46.991 INFO:teuthology.orchestra.run.smithi062.stdout:672 2023-06-09T04:45:46.991 INFO:teuthology.orchestra.run.smithi062.stdout:672.out 2023-06-09T04:45:46.991 INFO:teuthology.orchestra.run.smithi062.stdout:673 2023-06-09T04:45:46.991 INFO:teuthology.orchestra.run.smithi062.stdout:673.out 2023-06-09T04:45:46.991 INFO:teuthology.orchestra.run.smithi062.stdout:674 2023-06-09T04:45:46.991 INFO:teuthology.orchestra.run.smithi062.stdout:674.out 2023-06-09T04:45:46.992 INFO:teuthology.orchestra.run.smithi062.stdout:675 2023-06-09T04:45:46.992 INFO:teuthology.orchestra.run.smithi062.stdout:675.out 2023-06-09T04:45:46.992 INFO:teuthology.orchestra.run.smithi062.stdout:676 2023-06-09T04:45:46.992 INFO:teuthology.orchestra.run.smithi062.stdout:676.out 2023-06-09T04:45:46.992 INFO:teuthology.orchestra.run.smithi062.stdout:677 2023-06-09T04:45:46.992 INFO:teuthology.orchestra.run.smithi062.stdout:677.out 2023-06-09T04:45:46.992 INFO:teuthology.orchestra.run.smithi062.stdout:678 2023-06-09T04:45:46.992 INFO:teuthology.orchestra.run.smithi062.stdout:678.out 2023-06-09T04:45:46.993 INFO:teuthology.orchestra.run.smithi062.stdout:679 2023-06-09T04:45:46.993 INFO:teuthology.orchestra.run.smithi062.stdout:679.out 2023-06-09T04:45:46.993 INFO:teuthology.orchestra.run.smithi062.stdout:680 2023-06-09T04:45:46.993 INFO:teuthology.orchestra.run.smithi062.stdout:680.out 2023-06-09T04:45:46.993 INFO:teuthology.orchestra.run.smithi062.stdout:681 2023-06-09T04:45:46.993 INFO:teuthology.orchestra.run.smithi062.stdout:681.out 2023-06-09T04:45:46.993 INFO:teuthology.orchestra.run.smithi062.stdout:682 2023-06-09T04:45:46.993 INFO:teuthology.orchestra.run.smithi062.stdout:682.out 2023-06-09T04:45:46.994 INFO:teuthology.orchestra.run.smithi062.stdout:683 2023-06-09T04:45:46.994 INFO:teuthology.orchestra.run.smithi062.stdout:683.out 2023-06-09T04:45:46.994 INFO:teuthology.orchestra.run.smithi062.stdout:684 2023-06-09T04:45:46.994 INFO:teuthology.orchestra.run.smithi062.stdout:684.out 2023-06-09T04:45:46.994 INFO:teuthology.orchestra.run.smithi062.stdout:685 2023-06-09T04:45:46.994 INFO:teuthology.orchestra.run.smithi062.stdout:685.out 2023-06-09T04:45:46.994 INFO:teuthology.orchestra.run.smithi062.stdout:686 2023-06-09T04:45:46.994 INFO:teuthology.orchestra.run.smithi062.stdout:686.out 2023-06-09T04:45:46.995 INFO:teuthology.orchestra.run.smithi062.stdout:687 2023-06-09T04:45:46.995 INFO:teuthology.orchestra.run.smithi062.stdout:687.out 2023-06-09T04:45:46.995 INFO:teuthology.orchestra.run.smithi062.stdout:688 2023-06-09T04:45:46.995 INFO:teuthology.orchestra.run.smithi062.stdout:688.out 2023-06-09T04:45:46.995 INFO:teuthology.orchestra.run.smithi062.stdout:689 2023-06-09T04:45:46.995 INFO:teuthology.orchestra.run.smithi062.stdout:689.out 2023-06-09T04:45:46.995 INFO:teuthology.orchestra.run.smithi062.stdout:690 2023-06-09T04:45:46.995 INFO:teuthology.orchestra.run.smithi062.stdout:690.out 2023-06-09T04:45:46.996 INFO:teuthology.orchestra.run.smithi062.stdout:691 2023-06-09T04:45:46.996 INFO:teuthology.orchestra.run.smithi062.stdout:691.out 2023-06-09T04:45:46.996 INFO:teuthology.orchestra.run.smithi062.stdout:692 2023-06-09T04:45:46.996 INFO:teuthology.orchestra.run.smithi062.stdout:692.out 2023-06-09T04:45:46.996 INFO:teuthology.orchestra.run.smithi062.stdout:693 2023-06-09T04:45:46.996 INFO:teuthology.orchestra.run.smithi062.stdout:693.out 2023-06-09T04:45:46.996 INFO:teuthology.orchestra.run.smithi062.stdout:694 2023-06-09T04:45:46.996 INFO:teuthology.orchestra.run.smithi062.stdout:694.out 2023-06-09T04:45:46.997 INFO:teuthology.orchestra.run.smithi062.stdout:695 2023-06-09T04:45:46.997 INFO:teuthology.orchestra.run.smithi062.stdout:695.out 2023-06-09T04:45:46.997 INFO:teuthology.orchestra.run.smithi062.stdout:696 2023-06-09T04:45:46.997 INFO:teuthology.orchestra.run.smithi062.stdout:696.out 2023-06-09T04:45:46.997 INFO:teuthology.orchestra.run.smithi062.stdout:697 2023-06-09T04:45:46.997 INFO:teuthology.orchestra.run.smithi062.stdout:697.out 2023-06-09T04:45:46.997 INFO:teuthology.orchestra.run.smithi062.stdout:698 2023-06-09T04:45:46.997 INFO:teuthology.orchestra.run.smithi062.stdout:698.out 2023-06-09T04:45:46.998 INFO:teuthology.orchestra.run.smithi062.stdout:699 2023-06-09T04:45:46.998 INFO:teuthology.orchestra.run.smithi062.stdout:699.out 2023-06-09T04:45:46.998 INFO:teuthology.orchestra.run.smithi062.stdout:700 2023-06-09T04:45:46.998 INFO:teuthology.orchestra.run.smithi062.stdout:700.out 2023-06-09T04:45:46.998 INFO:teuthology.orchestra.run.smithi062.stdout:701 2023-06-09T04:45:46.998 INFO:teuthology.orchestra.run.smithi062.stdout:701.out 2023-06-09T04:45:46.998 INFO:teuthology.orchestra.run.smithi062.stdout:702 2023-06-09T04:45:46.998 INFO:teuthology.orchestra.run.smithi062.stdout:702.out 2023-06-09T04:45:46.999 INFO:teuthology.orchestra.run.smithi062.stdout:703 2023-06-09T04:45:46.999 INFO:teuthology.orchestra.run.smithi062.stdout:703.out 2023-06-09T04:45:46.999 INFO:teuthology.orchestra.run.smithi062.stdout:704 2023-06-09T04:45:46.999 INFO:teuthology.orchestra.run.smithi062.stdout:704.out 2023-06-09T04:45:46.999 INFO:teuthology.orchestra.run.smithi062.stdout:705 2023-06-09T04:45:46.999 INFO:teuthology.orchestra.run.smithi062.stdout:705.out 2023-06-09T04:45:46.999 INFO:teuthology.orchestra.run.smithi062.stdout:706 2023-06-09T04:45:46.999 INFO:teuthology.orchestra.run.smithi062.stdout:706.out 2023-06-09T04:45:46.999 INFO:teuthology.orchestra.run.smithi062.stdout:707 2023-06-09T04:45:47.000 INFO:teuthology.orchestra.run.smithi062.stdout:707.out 2023-06-09T04:45:47.000 INFO:teuthology.orchestra.run.smithi062.stdout:708 2023-06-09T04:45:47.000 INFO:teuthology.orchestra.run.smithi062.stdout:708.out 2023-06-09T04:45:47.000 INFO:teuthology.orchestra.run.smithi062.stdout:709 2023-06-09T04:45:47.000 INFO:teuthology.orchestra.run.smithi062.stdout:709.out 2023-06-09T04:45:47.000 INFO:teuthology.orchestra.run.smithi062.stdout:710 2023-06-09T04:45:47.000 INFO:teuthology.orchestra.run.smithi062.stdout:710.out 2023-06-09T04:45:47.000 INFO:teuthology.orchestra.run.smithi062.stdout:711 2023-06-09T04:45:47.001 INFO:teuthology.orchestra.run.smithi062.stdout:711.out 2023-06-09T04:45:47.001 INFO:teuthology.orchestra.run.smithi062.stdout:712 2023-06-09T04:45:47.001 INFO:teuthology.orchestra.run.smithi062.stdout:712.out 2023-06-09T04:45:47.001 INFO:teuthology.orchestra.run.smithi062.stdout:713 2023-06-09T04:45:47.001 INFO:teuthology.orchestra.run.smithi062.stdout:713.out 2023-06-09T04:45:47.001 INFO:teuthology.orchestra.run.smithi062.stdout:714 2023-06-09T04:45:47.001 INFO:teuthology.orchestra.run.smithi062.stdout:714.out 2023-06-09T04:45:47.002 INFO:teuthology.orchestra.run.smithi062.stdout:715 2023-06-09T04:45:47.002 INFO:teuthology.orchestra.run.smithi062.stdout:715.out 2023-06-09T04:45:47.002 INFO:teuthology.orchestra.run.smithi062.stdout:716 2023-06-09T04:45:47.002 INFO:teuthology.orchestra.run.smithi062.stdout:716.out 2023-06-09T04:45:47.002 INFO:teuthology.orchestra.run.smithi062.stdout:717 2023-06-09T04:45:47.002 INFO:teuthology.orchestra.run.smithi062.stdout:717.out 2023-06-09T04:45:47.002 INFO:teuthology.orchestra.run.smithi062.stdout:718 2023-06-09T04:45:47.002 INFO:teuthology.orchestra.run.smithi062.stdout:718.out 2023-06-09T04:45:47.003 INFO:teuthology.orchestra.run.smithi062.stdout:719 2023-06-09T04:45:47.003 INFO:teuthology.orchestra.run.smithi062.stdout:719.out 2023-06-09T04:45:47.003 INFO:teuthology.orchestra.run.smithi062.stdout:720 2023-06-09T04:45:47.003 INFO:teuthology.orchestra.run.smithi062.stdout:720.out 2023-06-09T04:45:47.003 INFO:teuthology.orchestra.run.smithi062.stdout:721 2023-06-09T04:45:47.003 INFO:teuthology.orchestra.run.smithi062.stdout:721.out 2023-06-09T04:45:47.003 INFO:teuthology.orchestra.run.smithi062.stdout:722 2023-06-09T04:45:47.003 INFO:teuthology.orchestra.run.smithi062.stdout:722.out 2023-06-09T04:45:47.003 INFO:teuthology.orchestra.run.smithi062.stdout:723 2023-06-09T04:45:47.004 INFO:teuthology.orchestra.run.smithi062.stdout:723.out 2023-06-09T04:45:47.004 INFO:teuthology.orchestra.run.smithi062.stdout:724 2023-06-09T04:45:47.004 INFO:teuthology.orchestra.run.smithi062.stdout:724.out 2023-06-09T04:45:47.004 INFO:teuthology.orchestra.run.smithi062.stdout:725 2023-06-09T04:45:47.004 INFO:teuthology.orchestra.run.smithi062.stdout:725.out 2023-06-09T04:45:47.004 INFO:teuthology.orchestra.run.smithi062.stdout:726 2023-06-09T04:45:47.004 INFO:teuthology.orchestra.run.smithi062.stdout:726.out 2023-06-09T04:45:47.005 INFO:teuthology.orchestra.run.smithi062.stdout:727 2023-06-09T04:45:47.005 INFO:teuthology.orchestra.run.smithi062.stdout:727.out 2023-06-09T04:45:47.005 INFO:teuthology.orchestra.run.smithi062.stdout:group.list 2023-06-09T04:45:47.005 INFO:teuthology.orchestra.run.smithi062.stdout:Makefile 2023-06-09T04:45:47.006 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/001) 2023-06-09T04:45:47.837 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T04:45:47.859 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:45:47.861 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T04:45:47.866 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T04:45:47.866 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:45:51.610 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:45:51.616 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:46:01.689 INFO:teuthology.orchestra.run.smithi062.stdout:generic/001 13s 2023-06-09T04:46:01.750 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/001 2023-06-09T04:46:01.751 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T04:46:01.763 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:46:02.242 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:46:02.243 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/002) 2023-06-09T04:46:02.995 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T04:46:03.017 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:46:03.019 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T04:46:03.024 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T04:46:03.024 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:46:04.654 INFO:teuthology.orchestra.run.smithi062.stdout:generic/002 1s 2023-06-09T04:46:04.678 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/002 2023-06-09T04:46:04.679 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T04:46:04.691 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:46:04.805 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:46:04.806 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/003) 2023-06-09T04:46:05.572 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T04:46:05.594 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:46:05.597 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T04:46:05.602 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T04:46:05.602 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:46:06.587 INFO:teuthology.orchestra.run.smithi062.stdout:generic/003 [not run] atime not maintained by ceph 2023-06-09T04:46:06.610 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/003 2023-06-09T04:46:06.610 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/003 2023-06-09T04:46:06.611 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T04:46:06.623 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:46:06.715 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:46:06.715 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/004) 2023-06-09T04:46:07.486 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T04:46:07.506 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:46:07.508 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T04:46:07.512 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T04:46:07.513 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:46:08.459 INFO:teuthology.orchestra.run.smithi062.stdout:generic/004 [not run] O_TMPFILE is not supported 2023-06-09T04:46:08.481 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/004 2023-06-09T04:46:08.481 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/004 2023-06-09T04:46:08.481 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T04:46:08.495 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:46:08.577 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:46:08.578 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/005) 2023-06-09T04:46:09.345 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T04:46:09.367 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:46:09.371 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T04:46:09.377 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T04:46:09.377 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:46:10.863 INFO:teuthology.orchestra.run.smithi062.stdout:generic/005 1s 2023-06-09T04:46:10.890 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/005 2023-06-09T04:46:10.891 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T04:46:10.903 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:46:11.055 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:46:11.056 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/006) 2023-06-09T04:46:11.813 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T04:46:11.836 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:46:11.840 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T04:46:11.846 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T04:46:11.847 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:46:21.757 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:46:21.764 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:46:41.443 INFO:teuthology.orchestra.run.smithi062.stdout:generic/006 29s 2023-06-09T04:46:41.466 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/006 2023-06-09T04:46:41.466 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T04:46:41.477 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:46:41.815 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:46:41.816 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/007) 2023-06-09T04:46:42.550 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T04:46:42.571 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:46:42.573 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T04:46:42.578 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T04:46:42.578 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:46:51.896 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:46:51.900 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:47:21.992 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:47:21.996 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:47:44.384 INFO:teuthology.orchestra.run.smithi062.stdout:generic/007 62s 2023-06-09T04:47:44.411 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/007 2023-06-09T04:47:44.412 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T04:47:44.423 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:47:44.559 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:47:44.560 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/008) 2023-06-09T04:47:45.335 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T04:47:45.358 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:47:45.361 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T04:47:45.367 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T04:47:45.367 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:47:46.452 INFO:teuthology.orchestra.run.smithi062.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-06-09T04:47:46.471 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/008 2023-06-09T04:47:46.472 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/008 2023-06-09T04:47:46.472 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T04:47:46.486 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:47:46.584 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:47:46.584 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/009) 2023-06-09T04:47:47.328 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T04:47:47.349 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:47:47.351 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T04:47:47.356 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T04:47:47.357 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:47:48.441 INFO:teuthology.orchestra.run.smithi062.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-06-09T04:47:48.460 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/009 2023-06-09T04:47:48.461 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/009 2023-06-09T04:47:48.461 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T04:47:48.474 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:47:48.575 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:47:48.576 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/010) 2023-06-09T04:47:49.306 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T04:47:49.329 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:47:49.331 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T04:47:49.337 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T04:47:49.338 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:47:50.257 INFO:teuthology.orchestra.run.smithi062.stdout:generic/010 [not run] /tmp/tmp.VpYa8kRkcExfstests-dev/src/dbtest not built 2023-06-09T04:47:50.278 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/010 2023-06-09T04:47:50.278 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/010 2023-06-09T04:47:50.279 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T04:47:50.293 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:47:50.394 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:47:50.395 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/011) 2023-06-09T04:47:51.147 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T04:47:51.169 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:47:51.172 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T04:47:51.178 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T04:47:51.178 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:47:52.680 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:47:52.687 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:48:22.755 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:48:22.759 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:48:39.145 INFO:teuthology.orchestra.run.smithi062.stdout:generic/011 48s 2023-06-09T04:48:39.173 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/011 2023-06-09T04:48:39.174 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T04:48:39.186 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:48:39.366 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:48:39.367 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/012) 2023-06-09T04:48:40.082 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T04:48:40.102 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:48:40.104 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T04:48:40.111 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T04:48:40.111 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:48:41.320 INFO:teuthology.orchestra.run.smithi062.stdout:generic/012 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T04:48:41.337 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/012 2023-06-09T04:48:41.338 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/012 2023-06-09T04:48:41.338 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T04:48:41.350 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:48:41.465 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:48:41.465 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/013) 2023-06-09T04:48:42.214 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T04:48:42.238 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:48:42.241 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T04:48:42.246 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T04:48:42.246 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:48:52.894 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:48:52.901 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:49:22.982 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:49:22.991 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:49:53.323 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:49:53.329 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:49:55.944 INFO:teuthology.orchestra.run.smithi062.stdout:generic/013 73s 2023-06-09T04:49:56.363 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/013 2023-06-09T04:49:56.364 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T04:49:56.377 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:49:56.483 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:49:56.484 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/014) 2023-06-09T04:49:57.167 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T04:49:57.194 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:49:57.197 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T04:49:57.201 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T04:49:57.201 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:50:27.247 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:50:27.252 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:50:58.897 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:50:58.902 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:51:33.125 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:51:33.130 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:52:07.382 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:52:07.386 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:52:38.345 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:52:38.353 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:53:09.235 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:53:09.242 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:53:39.966 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:53:39.972 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:54:10.672 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:54:10.677 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:54:40.880 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:54:40.884 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:55:12.156 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:55:12.161 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:55:18.031 INFO:teuthology.orchestra.run.smithi062.stdout:generic/014 321s 2023-06-09T04:55:18.058 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/014 2023-06-09T04:55:18.058 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T04:55:18.071 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:55:18.169 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:55:18.170 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/015) 2023-06-09T04:55:18.862 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T04:55:18.877 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:55:18.880 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T04:55:18.885 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T04:55:18.885 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:55:19.730 INFO:teuthology.orchestra.run.smithi062.stdout:generic/015 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-09T04:55:19.747 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/015 2023-06-09T04:55:19.748 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/015 2023-06-09T04:55:19.748 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T04:55:19.763 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:55:19.847 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:55:19.848 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/016) 2023-06-09T04:55:20.552 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T04:55:20.571 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:55:20.573 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T04:55:20.577 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T04:55:20.578 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:55:21.746 INFO:teuthology.orchestra.run.smithi062.stdout:generic/016 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T04:55:21.763 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/016 2023-06-09T04:55:21.764 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/016 2023-06-09T04:55:21.764 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T04:55:21.775 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:55:22.048 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:55:22.049 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/017) 2023-06-09T04:55:22.864 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T04:55:22.880 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:55:22.883 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T04:55:22.887 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T04:55:22.887 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:55:23.784 INFO:teuthology.orchestra.run.smithi062.stdout:generic/017 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-06-09T04:55:23.802 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/017 2023-06-09T04:55:23.803 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/017 2023-06-09T04:55:23.803 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T04:55:23.813 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:55:23.908 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:55:23.909 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/018) 2023-06-09T04:55:24.573 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T04:55:24.590 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:55:24.593 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T04:55:24.597 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T04:55:24.597 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:55:25.706 INFO:teuthology.orchestra.run.smithi062.stdout:generic/018 [not run] defragmentation not supported for fstype "ceph" 2023-06-09T04:55:25.778 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/018 2023-06-09T04:55:25.778 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/018 2023-06-09T04:55:25.778 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T04:55:25.790 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:55:25.872 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:55:25.873 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/019) 2023-06-09T04:55:26.565 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T04:55:26.583 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:55:26.585 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T04:55:26.589 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T04:55:26.589 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:55:27.446 INFO:teuthology.orchestra.run.smithi062.stdout:generic/019 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-06-09T04:55:27.464 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/019 2023-06-09T04:55:27.465 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/019 2023-06-09T04:55:27.465 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T04:55:27.475 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:55:27.547 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:55:27.547 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/020) 2023-06-09T04:55:28.219 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T04:55:28.240 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:55:28.243 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T04:55:28.246 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T04:55:28.246 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:55:38.065 INFO:teuthology.orchestra.run.smithi062.stdout:generic/020 10s 2023-06-09T04:55:38.091 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/020 2023-06-09T04:55:38.091 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T04:55:38.104 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:55:38.440 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:55:38.440 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/021) 2023-06-09T04:55:39.177 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T04:55:39.196 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:55:39.198 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T04:55:39.202 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T04:55:39.202 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:55:40.323 INFO:teuthology.orchestra.run.smithi062.stdout:generic/021 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T04:55:40.340 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/021 2023-06-09T04:55:40.340 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/021 2023-06-09T04:55:40.341 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T04:55:40.352 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:55:40.614 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:55:40.614 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/022) 2023-06-09T04:55:41.452 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T04:55:41.471 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:55:41.473 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T04:55:41.476 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T04:55:41.476 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:55:42.244 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:55:42.249 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:55:42.587 INFO:teuthology.orchestra.run.smithi062.stdout:generic/022 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T04:55:42.602 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/022 2023-06-09T04:55:42.602 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/022 2023-06-09T04:55:42.602 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T04:55:42.617 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:55:43.053 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:55:43.053 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/023) 2023-06-09T04:55:43.803 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T04:55:43.826 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:55:43.828 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T04:55:43.831 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T04:55:43.831 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:56:13.263 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:56:13.270 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:56:23.852 INFO:teuthology.orchestra.run.smithi062.stdout:generic/023 39s 2023-06-09T04:56:23.879 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/023 2023-06-09T04:56:23.879 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T04:56:23.890 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:56:24.224 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:56:24.225 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/024) 2023-06-09T04:56:25.061 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T04:56:25.085 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:56:25.088 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T04:56:25.093 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T04:56:25.094 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:56:25.995 INFO:teuthology.orchestra.run.smithi062.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2023-06-09T04:56:26.010 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/024 2023-06-09T04:56:26.010 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/024 2023-06-09T04:56:26.010 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T04:56:26.021 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:56:26.359 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:56:26.359 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/025) 2023-06-09T04:56:27.163 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T04:56:27.180 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:56:27.182 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T04:56:27.192 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T04:56:27.192 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:56:28.106 INFO:teuthology.orchestra.run.smithi062.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2023-06-09T04:56:28.122 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/025 2023-06-09T04:56:28.122 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/025 2023-06-09T04:56:28.122 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T04:56:28.140 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:56:28.348 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:56:28.348 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/026) 2023-06-09T04:56:29.294 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T04:56:29.310 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:56:29.312 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T04:56:29.317 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T04:56:29.317 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:56:30.292 INFO:teuthology.orchestra.run.smithi062.stdout:generic/026 [not run] ceph does not define maximum ACL count 2023-06-09T04:56:30.307 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/026 2023-06-09T04:56:30.307 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/026 2023-06-09T04:56:30.307 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T04:56:30.317 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:56:30.424 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:56:30.424 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/027) 2023-06-09T04:56:31.147 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T04:56:31.169 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:56:31.173 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T04:56:31.176 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T04:56:31.176 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:56:32.023 INFO:teuthology.orchestra.run.smithi062.stdout:generic/027 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-09T04:56:32.039 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/027 2023-06-09T04:56:32.039 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/027 2023-06-09T04:56:32.039 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T04:56:32.048 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:56:32.123 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:56:32.123 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/028) 2023-06-09T04:56:32.864 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T04:56:32.884 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:56:32.886 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T04:56:32.890 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T04:56:32.890 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:56:40.387 INFO:teuthology.orchestra.run.smithi062.stdout:generic/028 7s 2023-06-09T04:56:41.293 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/028 2023-06-09T04:56:41.293 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T04:56:41.305 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:56:41.389 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:56:41.389 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/029) 2023-06-09T04:56:42.277 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T04:56:42.296 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:56:42.300 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T04:56:42.304 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T04:56:42.304 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:56:43.331 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:56:43.336 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:56:44.871 INFO:teuthology.orchestra.run.smithi062.stdout:generic/029 2s 2023-06-09T04:56:44.899 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/029 2023-06-09T04:56:44.900 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T04:56:44.909 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:56:44.942 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:56:44.942 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/030) 2023-06-09T04:56:45.731 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T04:56:45.752 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:56:45.755 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T04:56:45.759 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T04:56:45.759 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:56:48.768 INFO:teuthology.orchestra.run.smithi062.stdout:generic/030 2s 2023-06-09T04:56:48.817 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/030 2023-06-09T04:56:48.818 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T04:56:48.836 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:56:48.882 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:56:48.882 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/031) 2023-06-09T04:56:49.713 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T04:56:49.731 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:56:49.734 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T04:56:49.739 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T04:56:49.739 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:56:51.096 INFO:teuthology.orchestra.run.smithi062.stdout:generic/031 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-06-09T04:56:51.135 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/031 2023-06-09T04:56:51.136 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/031 2023-06-09T04:56:51.136 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T04:56:51.146 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:56:51.227 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:56:51.228 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/032) 2023-06-09T04:56:52.128 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T04:56:52.150 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:56:52.153 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T04:56:52.159 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T04:56:52.159 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:56:53.039 INFO:teuthology.orchestra.run.smithi062.stdout:generic/032 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T04:56:53.059 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/032 2023-06-09T04:56:53.059 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/032 2023-06-09T04:56:53.059 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T04:56:53.068 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:56:53.154 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:56:53.155 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/033) 2023-06-09T04:56:53.912 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T04:56:53.940 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:56:53.942 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T04:56:53.947 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T04:56:53.947 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:56:55.304 INFO:teuthology.orchestra.run.smithi062.stdout:generic/033 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-06-09T04:56:55.323 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/033 2023-06-09T04:56:55.323 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/033 2023-06-09T04:56:55.323 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T04:56:55.335 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:56:55.438 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:56:55.439 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/034) 2023-06-09T04:56:56.232 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T04:56:56.256 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:56:56.258 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T04:56:56.262 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T04:56:56.262 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:56:57.109 INFO:teuthology.orchestra.run.smithi062.stdout:generic/034 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-06-09T04:56:57.127 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/034 2023-06-09T04:56:57.128 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/034 2023-06-09T04:56:57.128 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T04:56:57.144 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:56:57.234 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:56:57.234 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/035) 2023-06-09T04:56:57.934 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T04:56:57.952 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:56:57.954 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T04:56:57.962 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T04:56:57.962 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:56:59.320 INFO:teuthology.orchestra.run.smithi062.stdout:generic/035 1s 2023-06-09T04:56:59.355 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/035 2023-06-09T04:56:59.356 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T04:56:59.364 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:56:59.656 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:56:59.657 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/036) 2023-06-09T04:57:00.645 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T04:57:00.667 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:57:00.669 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T04:57:00.673 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T04:57:00.674 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:57:11.874 INFO:teuthology.orchestra.run.smithi062.stdout:generic/036 10s 2023-06-09T04:57:11.899 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/036 2023-06-09T04:57:11.899 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T04:57:11.911 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:57:12.066 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:57:12.067 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/037) 2023-06-09T04:57:12.943 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T04:57:12.967 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:57:12.970 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T04:57:12.976 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T04:57:12.976 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:57:13.437 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:57:13.445 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:57:23.976 INFO:teuthology.orchestra.run.smithi062.stdout:generic/037 10s 2023-06-09T04:57:24.003 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/037 2023-06-09T04:57:24.003 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T04:57:24.015 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:57:24.055 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:57:24.056 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/038) 2023-06-09T04:57:24.802 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T04:57:24.823 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:57:24.826 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T04:57:24.833 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T04:57:24.833 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:57:25.859 INFO:teuthology.orchestra.run.smithi062.stdout:generic/038 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T04:57:25.881 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/038 2023-06-09T04:57:25.881 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/038 2023-06-09T04:57:25.881 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T04:57:25.893 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:57:26.000 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:57:26.001 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/039) 2023-06-09T04:57:26.766 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T04:57:26.787 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:57:26.789 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T04:57:26.795 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T04:57:26.795 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:57:27.797 INFO:teuthology.orchestra.run.smithi062.stdout:generic/039 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-06-09T04:57:27.818 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/039 2023-06-09T04:57:27.819 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/039 2023-06-09T04:57:27.819 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T04:57:27.831 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:57:27.927 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:57:27.927 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/040) 2023-06-09T04:57:28.694 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T04:57:28.716 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:57:28.718 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T04:57:28.724 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T04:57:28.724 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:57:29.779 INFO:teuthology.orchestra.run.smithi062.stdout:generic/040 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-06-09T04:57:29.800 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/040 2023-06-09T04:57:29.801 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/040 2023-06-09T04:57:29.801 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T04:57:29.814 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:57:29.892 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:57:29.892 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/041) 2023-06-09T04:57:30.649 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T04:57:30.676 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:57:30.679 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T04:57:30.686 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T04:57:30.686 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:57:31.679 INFO:teuthology.orchestra.run.smithi062.stdout:generic/041 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-06-09T04:57:31.698 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/041 2023-06-09T04:57:31.699 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/041 2023-06-09T04:57:31.699 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T04:57:31.710 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:57:31.798 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:57:31.798 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/042) 2023-06-09T04:57:32.583 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T04:57:32.609 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:57:32.612 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T04:57:32.617 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T04:57:32.618 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:57:33.823 INFO:teuthology.orchestra.run.smithi062.stdout:generic/042 [not run] ceph does not support shutdown 2023-06-09T04:57:33.908 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/042 2023-06-09T04:57:33.908 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/042 2023-06-09T04:57:33.908 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T04:57:33.922 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:57:34.005 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:57:34.005 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/043) 2023-06-09T04:57:34.757 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T04:57:34.777 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:57:34.781 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T04:57:34.786 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T04:57:34.787 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:57:35.935 INFO:teuthology.orchestra.run.smithi062.stdout:generic/043 [not run] ceph does not support shutdown 2023-06-09T04:57:36.036 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/043 2023-06-09T04:57:36.037 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/043 2023-06-09T04:57:36.037 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T04:57:36.050 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:57:36.149 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:57:36.149 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/044) 2023-06-09T04:57:36.914 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T04:57:36.936 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:57:36.939 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T04:57:36.945 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T04:57:36.946 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:57:38.122 INFO:teuthology.orchestra.run.smithi062.stdout:generic/044 [not run] ceph does not support shutdown 2023-06-09T04:57:38.186 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/044 2023-06-09T04:57:38.186 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/044 2023-06-09T04:57:38.186 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T04:57:38.200 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:57:38.298 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:57:38.298 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/045) 2023-06-09T04:57:39.075 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T04:57:39.096 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:57:39.099 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T04:57:39.105 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T04:57:39.105 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:57:40.296 INFO:teuthology.orchestra.run.smithi062.stdout:generic/045 [not run] ceph does not support shutdown 2023-06-09T04:57:40.364 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/045 2023-06-09T04:57:40.364 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/045 2023-06-09T04:57:40.365 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T04:57:40.378 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:57:40.463 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:57:40.464 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/046) 2023-06-09T04:57:41.201 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T04:57:41.224 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:57:41.228 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T04:57:41.234 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T04:57:41.234 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:57:42.420 INFO:teuthology.orchestra.run.smithi062.stdout:generic/046 [not run] ceph does not support shutdown 2023-06-09T04:57:42.495 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/046 2023-06-09T04:57:42.495 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/046 2023-06-09T04:57:42.495 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T04:57:42.510 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:57:42.585 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:57:42.585 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/047) 2023-06-09T04:57:43.334 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T04:57:43.358 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:57:43.361 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T04:57:43.367 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T04:57:43.367 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:57:43.577 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:57:43.582 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:57:44.559 INFO:teuthology.orchestra.run.smithi062.stdout:generic/047 [not run] ceph does not support shutdown 2023-06-09T04:57:44.620 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/047 2023-06-09T04:57:44.620 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/047 2023-06-09T04:57:44.620 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T04:57:44.633 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:57:44.722 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:57:44.722 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/048) 2023-06-09T04:57:45.486 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T04:57:45.508 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:57:45.511 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T04:57:45.516 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T04:57:45.517 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:57:46.694 INFO:teuthology.orchestra.run.smithi062.stdout:generic/048 [not run] ceph does not support shutdown 2023-06-09T04:57:46.776 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/048 2023-06-09T04:57:46.776 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/048 2023-06-09T04:57:46.777 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T04:57:46.787 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:57:46.884 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:57:46.885 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/049) 2023-06-09T04:57:47.625 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T04:57:47.646 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:57:47.649 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T04:57:47.655 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T04:57:47.655 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:57:48.835 INFO:teuthology.orchestra.run.smithi062.stdout:generic/049 [not run] ceph does not support shutdown 2023-06-09T04:57:48.896 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/049 2023-06-09T04:57:48.896 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/049 2023-06-09T04:57:48.896 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T04:57:48.910 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:57:48.998 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:57:48.999 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/050) 2023-06-09T04:57:49.774 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T04:57:49.796 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:57:49.799 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T04:57:49.805 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T04:57:49.805 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:57:51.009 INFO:teuthology.orchestra.run.smithi062.stdout:generic/050 [not run] ceph does not support shutdown 2023-06-09T04:57:51.090 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/050 2023-06-09T04:57:51.090 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/050 2023-06-09T04:57:51.091 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T04:57:51.103 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:57:51.188 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:57:51.188 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/051) 2023-06-09T04:57:51.929 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T04:57:51.951 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:57:51.954 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T04:57:51.959 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T04:57:51.960 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:57:53.177 INFO:teuthology.orchestra.run.smithi062.stdout:generic/051 [not run] ceph does not support shutdown 2023-06-09T04:57:53.197 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/051 2023-06-09T04:57:53.197 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/051 2023-06-09T04:57:53.197 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T04:57:53.210 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:57:53.290 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:57:53.290 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/052) 2023-06-09T04:57:54.061 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T04:57:54.083 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:57:54.087 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T04:57:54.093 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T04:57:54.093 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:57:55.297 INFO:teuthology.orchestra.run.smithi062.stdout:generic/052 [not run] ceph does not support shutdown 2023-06-09T04:57:55.368 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/052 2023-06-09T04:57:55.368 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/052 2023-06-09T04:57:55.368 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T04:57:55.380 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:57:55.456 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:57:55.456 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/053) 2023-06-09T04:57:56.204 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T04:57:56.227 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:57:56.230 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T04:57:56.236 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T04:57:56.236 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:57:58.442 INFO:teuthology.orchestra.run.smithi062.stdout:generic/053 2s 2023-06-09T04:57:58.519 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/053 2023-06-09T04:57:58.519 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T04:57:58.531 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:57:58.557 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:57:58.558 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/054) 2023-06-09T04:57:59.299 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T04:57:59.322 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:57:59.325 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T04:57:59.332 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T04:57:59.332 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:58:00.577 INFO:teuthology.orchestra.run.smithi062.stdout:generic/054 [not run] ceph does not support shutdown 2023-06-09T04:58:00.638 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/054 2023-06-09T04:58:00.638 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/054 2023-06-09T04:58:00.638 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T04:58:00.652 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:58:00.736 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:58:00.736 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/055) 2023-06-09T04:58:01.496 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T04:58:01.517 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:58:01.520 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T04:58:01.527 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T04:58:01.527 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:58:02.711 INFO:teuthology.orchestra.run.smithi062.stdout:generic/055 [not run] ceph does not support shutdown 2023-06-09T04:58:02.796 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/055 2023-06-09T04:58:02.796 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/055 2023-06-09T04:58:02.797 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T04:58:02.809 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:58:02.890 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:58:02.891 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/056) 2023-06-09T04:58:03.646 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T04:58:03.666 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:58:03.669 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T04:58:03.675 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T04:58:03.675 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:58:04.718 INFO:teuthology.orchestra.run.smithi062.stdout:generic/056 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-06-09T04:58:04.739 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/056 2023-06-09T04:58:04.739 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/056 2023-06-09T04:58:04.740 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T04:58:04.754 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:58:04.842 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:58:04.843 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/057) 2023-06-09T04:58:05.610 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T04:58:05.634 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:58:05.637 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T04:58:05.643 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T04:58:05.644 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:58:06.665 INFO:teuthology.orchestra.run.smithi062.stdout:generic/057 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-06-09T04:58:06.686 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/057 2023-06-09T04:58:06.686 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/057 2023-06-09T04:58:06.686 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T04:58:06.699 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:58:06.799 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:58:06.800 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/058) 2023-06-09T04:58:07.545 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T04:58:07.565 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:58:07.568 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T04:58:07.574 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T04:58:07.574 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:58:08.771 INFO:teuthology.orchestra.run.smithi062.stdout:generic/058 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T04:58:08.792 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/058 2023-06-09T04:58:08.792 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/058 2023-06-09T04:58:08.793 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T04:58:08.804 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:58:09.123 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:58:09.123 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/059) 2023-06-09T04:58:09.927 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T04:58:09.949 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:58:09.952 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T04:58:09.958 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T04:58:09.958 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:58:10.975 INFO:teuthology.orchestra.run.smithi062.stdout:generic/059 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-06-09T04:58:10.993 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/059 2023-06-09T04:58:10.994 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/059 2023-06-09T04:58:10.994 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T04:58:11.006 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:58:11.094 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:58:11.095 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/060) 2023-06-09T04:58:11.859 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T04:58:11.881 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:58:11.885 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T04:58:11.891 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T04:58:11.891 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:58:13.101 INFO:teuthology.orchestra.run.smithi062.stdout:generic/060 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T04:58:13.121 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/060 2023-06-09T04:58:13.121 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/060 2023-06-09T04:58:13.122 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T04:58:13.137 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:58:13.458 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:58:13.458 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/061) 2023-06-09T04:58:13.715 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:58:13.721 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:58:14.204 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T04:58:14.225 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:58:14.228 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T04:58:14.234 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T04:58:14.234 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:58:15.404 INFO:teuthology.orchestra.run.smithi062.stdout:generic/061 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T04:58:15.425 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/061 2023-06-09T04:58:15.426 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/061 2023-06-09T04:58:15.426 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T04:58:15.439 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:58:15.860 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:58:15.860 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/062) 2023-06-09T04:58:16.611 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T04:58:16.636 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:58:16.640 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T04:58:16.645 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T04:58:16.645 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:58:21.351 INFO:teuthology.orchestra.run.smithi062.stdout:generic/062 4s 2023-06-09T04:58:21.412 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/062 2023-06-09T04:58:21.413 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T04:58:21.445 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:58:21.490 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:58:21.490 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/063) 2023-06-09T04:58:22.211 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T04:58:22.236 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:58:22.238 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T04:58:22.243 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T04:58:22.244 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:58:23.655 INFO:teuthology.orchestra.run.smithi062.stdout:generic/063 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T04:58:23.673 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/063 2023-06-09T04:58:23.673 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/063 2023-06-09T04:58:23.673 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T04:58:23.685 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:58:23.886 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:58:23.887 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/064) 2023-06-09T04:58:24.821 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T04:58:24.843 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:58:24.846 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T04:58:24.852 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T04:58:24.852 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:58:25.856 INFO:teuthology.orchestra.run.smithi062.stdout:generic/064 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-06-09T04:58:25.879 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/064 2023-06-09T04:58:25.879 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/064 2023-06-09T04:58:25.879 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T04:58:25.893 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:58:25.995 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:58:25.996 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/065) 2023-06-09T04:58:26.745 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T04:58:26.771 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:58:26.774 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T04:58:26.779 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T04:58:26.779 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:58:27.834 INFO:teuthology.orchestra.run.smithi062.stdout:generic/065 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-06-09T04:58:27.856 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/065 2023-06-09T04:58:27.856 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/065 2023-06-09T04:58:27.856 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T04:58:27.867 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:58:27.967 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:58:27.968 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/066) 2023-06-09T04:58:28.715 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T04:58:28.737 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:58:28.741 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T04:58:28.746 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T04:58:28.747 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:58:29.743 INFO:teuthology.orchestra.run.smithi062.stdout:generic/066 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-06-09T04:58:29.765 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/066 2023-06-09T04:58:29.765 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/066 2023-06-09T04:58:29.766 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T04:58:29.779 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:58:29.867 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:58:29.867 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/067) 2023-06-09T04:58:30.633 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T04:58:30.656 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:58:30.658 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T04:58:30.664 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T04:58:30.665 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:58:31.706 INFO:teuthology.orchestra.run.smithi062.stdout:generic/067 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-06-09T04:58:31.727 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/067 2023-06-09T04:58:31.728 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/067 2023-06-09T04:58:31.728 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T04:58:31.741 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:58:31.837 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:58:31.838 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/068) 2023-06-09T04:58:32.595 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T04:58:32.617 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:58:32.619 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T04:58:32.624 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T04:58:32.625 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:58:33.648 INFO:teuthology.orchestra.run.smithi062.stdout:generic/068 [not run] ceph does not support freezing 2023-06-09T04:58:33.669 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/068 2023-06-09T04:58:33.669 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/068 2023-06-09T04:58:33.669 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T04:58:33.681 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:58:33.769 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:58:33.770 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/069) 2023-06-09T04:58:34.515 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T04:58:34.539 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:58:34.542 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T04:58:34.549 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T04:58:34.549 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:58:43.780 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:58:43.787 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:58:56.377 INFO:teuthology.orchestra.run.smithi062.stdout:generic/069 22s 2023-06-09T04:58:56.409 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/069 2023-06-09T04:58:56.409 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T04:58:56.420 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:58:56.451 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:58:56.451 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/070) 2023-06-09T04:58:57.210 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T04:58:57.232 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:58:57.235 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T04:58:57.240 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T04:58:57.240 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:59:13.853 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:59:13.857 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:59:23.562 INFO:teuthology.orchestra.run.smithi062.stdout:generic/070 26s 2023-06-09T04:59:23.590 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/070 2023-06-09T04:59:23.590 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T04:59:23.602 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:59:24.338 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:59:24.338 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/071) 2023-06-09T04:59:25.166 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T04:59:25.179 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:59:25.181 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T04:59:25.185 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T04:59:25.186 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:59:26.078 INFO:teuthology.orchestra.run.smithi062.stdout:generic/071 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-06-09T04:59:26.094 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/071 2023-06-09T04:59:26.094 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/071 2023-06-09T04:59:26.095 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T04:59:26.104 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:59:26.183 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:59:26.184 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/072) 2023-06-09T04:59:26.880 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T04:59:26.902 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:59:26.904 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T04:59:26.907 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T04:59:26.907 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:59:27.972 INFO:teuthology.orchestra.run.smithi062.stdout:generic/072 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-06-09T04:59:27.995 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/072 2023-06-09T04:59:27.996 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/072 2023-06-09T04:59:27.996 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T04:59:28.009 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:59:28.130 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:59:28.130 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/073) 2023-06-09T04:59:28.873 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T04:59:28.893 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:59:28.895 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T04:59:28.904 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T04:59:28.905 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:59:29.763 INFO:teuthology.orchestra.run.smithi062.stdout:generic/073 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-06-09T04:59:29.781 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/073 2023-06-09T04:59:29.782 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/073 2023-06-09T04:59:29.782 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T04:59:29.792 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:59:29.870 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T04:59:29.870 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/074) 2023-06-09T04:59:30.588 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T04:59:30.617 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T04:59:30.619 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T04:59:30.624 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T04:59:30.624 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T04:59:43.983 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T04:59:43.989 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:00:14.059 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:00:14.065 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:00:14.151 INFO:tasks.ceph.mds.c.smithi062.stderr:2023-06-09T05:00:14.142+0000 7f506cdd7700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 127663) UID: 0 2023-06-09T05:00:14.153 INFO:tasks.ceph.mds.a.smithi062.stderr:2023-06-09T05:00:14.146+0000 7fafd2fdc700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 127663) UID: 0 2023-06-09T05:00:19.411 INFO:teuthology.orchestra.run.smithi062.stdout:generic/074 49s 2023-06-09T05:00:19.439 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/074 2023-06-09T05:00:19.439 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T05:00:19.455 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:00:20.458 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:00:20.458 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/075) 2023-06-09T05:00:21.468 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T05:00:21.486 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T05:00:21.488 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T05:00:21.494 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T05:00:21.494 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:00:58.830 INFO:teuthology.orchestra.run.smithi062.stdout:generic/075 37s 2023-06-09T05:00:58.884 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/075 2023-06-09T05:00:58.884 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T05:00:58.901 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:00:59.157 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:00:59.158 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/076) 2023-06-09T05:01:00.091 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T05:01:00.109 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T05:01:00.111 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T05:01:00.115 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T05:01:00.115 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:01:00.957 INFO:teuthology.orchestra.run.smithi062.stdout:generic/076 [not run] require 172.21.15.62:6789:/scratch to be local device 2023-06-09T05:01:00.989 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/076 2023-06-09T05:01:00.990 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/076 2023-06-09T05:01:00.990 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T05:01:01.003 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:01:01.093 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:01:01.094 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/077) 2023-06-09T05:01:01.896 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T05:01:01.914 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T05:01:01.915 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T05:01:01.925 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T05:01:01.925 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:01:04.983 INFO:teuthology.orchestra.run.smithi062.stdout:generic/077 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-09T05:01:05.002 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/077 2023-06-09T05:01:05.002 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/077 2023-06-09T05:01:05.003 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T05:01:05.022 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:01:05.426 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:01:05.427 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/078) 2023-06-09T05:01:06.376 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T05:01:06.397 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T05:01:06.401 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T05:01:06.410 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T05:01:06.410 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:01:07.300 INFO:teuthology.orchestra.run.smithi062.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2023-06-09T05:01:07.328 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/078 2023-06-09T05:01:07.328 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/078 2023-06-09T05:01:07.328 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T05:01:07.344 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:01:07.523 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:01:07.523 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/079) 2023-06-09T05:01:08.658 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T05:01:08.680 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T05:01:08.682 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T05:01:08.686 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T05:01:08.687 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:01:09.622 INFO:teuthology.orchestra.run.smithi062.stdout:generic/079 [not run] file system doesn't support chattr +ia 2023-06-09T05:01:09.640 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/079 2023-06-09T05:01:09.640 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/079 2023-06-09T05:01:09.640 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T05:01:09.654 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:01:09.774 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:01:09.774 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/080) 2023-06-09T05:01:10.526 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T05:01:10.548 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T05:01:10.550 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T05:01:10.554 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T05:01:10.554 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:01:13.721 INFO:teuthology.orchestra.run.smithi062.stdout:generic/080 3s 2023-06-09T05:01:13.757 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/080 2023-06-09T05:01:13.758 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T05:01:13.774 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:01:13.866 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:01:13.867 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/081) 2023-06-09T05:01:14.662 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T05:01:14.685 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T05:01:14.687 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T05:01:14.691 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T05:01:14.692 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:01:15.678 INFO:teuthology.orchestra.run.smithi062.stdout:generic/081 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-06-09T05:01:15.694 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/081 2023-06-09T05:01:15.695 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/081 2023-06-09T05:01:15.695 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T05:01:15.705 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:01:15.799 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:01:15.800 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/082) 2023-06-09T05:01:16.545 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T05:01:16.566 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T05:01:16.570 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T05:01:16.574 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T05:01:16.575 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:01:17.558 INFO:teuthology.orchestra.run.smithi062.stdout:generic/082 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-09T05:01:17.583 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/082 2023-06-09T05:01:17.583 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/082 2023-06-09T05:01:17.584 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T05:01:17.598 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:01:17.676 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:01:17.677 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/083) 2023-06-09T05:01:18.453 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T05:01:18.474 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T05:01:18.477 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T05:01:18.482 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T05:01:18.482 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:01:19.376 INFO:teuthology.orchestra.run.smithi062.stdout:generic/083 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-09T05:01:19.396 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/083 2023-06-09T05:01:19.396 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/083 2023-06-09T05:01:19.396 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T05:01:19.409 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:01:19.480 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:01:19.481 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/084) 2023-06-09T05:01:20.219 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T05:01:20.241 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T05:01:20.243 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T05:01:20.249 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T05:01:20.250 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:01:27.056 INFO:teuthology.orchestra.run.smithi062.stdout:generic/084 6s 2023-06-09T05:01:27.280 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/084 2023-06-09T05:01:27.280 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T05:01:27.390 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:01:27.423 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:01:27.424 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/085) 2023-06-09T05:01:28.165 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T05:01:28.184 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T05:01:28.188 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T05:01:28.191 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T05:01:28.191 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:01:29.126 INFO:teuthology.orchestra.run.smithi062.stdout:generic/085 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-06-09T05:01:29.154 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/085 2023-06-09T05:01:29.154 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/085 2023-06-09T05:01:29.155 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T05:01:29.164 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:01:29.263 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:01:29.263 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/086) 2023-06-09T05:01:30.123 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T05:01:30.140 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T05:01:30.142 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T05:01:30.145 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T05:01:30.146 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:01:31.074 INFO:teuthology.orchestra.run.smithi062.stdout:generic/086 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T05:01:31.091 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/086 2023-06-09T05:01:31.091 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/086 2023-06-09T05:01:31.091 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T05:01:31.102 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:01:31.196 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:01:31.196 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/087) 2023-06-09T05:01:32.034 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T05:01:32.052 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T05:01:32.054 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T05:01:32.058 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T05:01:32.058 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:01:33.247 INFO:teuthology.orchestra.run.smithi062.stdout:generic/087 1s 2023-06-09T05:01:33.274 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/087 2023-06-09T05:01:33.274 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T05:01:33.288 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:01:33.795 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:01:33.795 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/088) 2023-06-09T05:01:34.704 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T05:01:34.720 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T05:01:34.723 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T05:01:34.728 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T05:01:34.729 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:01:35.716 INFO:teuthology.orchestra.run.smithi062.stdout:generic/088 0s 2023-06-09T05:01:35.743 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/088 2023-06-09T05:01:35.743 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T05:01:35.752 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:01:36.160 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:01:36.160 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/089) 2023-06-09T05:01:37.073 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T05:01:37.092 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T05:01:37.094 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T05:01:37.101 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T05:01:37.101 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:04:31.804 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:04:31.808 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:05:01.979 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:05:01.984 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:05:32.058 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:05:32.062 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:06:03.300 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:06:03.306 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:06:33.729 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:06:33.735 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:07:03.801 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:07:03.807 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:07:03.850 INFO:tasks.ceph.mds.c.smithi062.stderr:2023-06-09T05:07:03.842+0000 7f506cdd7700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 135905) UID: 0 2023-06-09T05:07:03.850 INFO:tasks.ceph.mds.a.smithi062.stderr:2023-06-09T05:07:03.842+0000 7fafd2fdc700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 135905) UID: 0 2023-06-09T05:10:09.376 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:10:09.384 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:10:39.530 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:10:39.535 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:11:09.652 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:11:09.660 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:11:39.807 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:11:39.813 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:12:10.014 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:12:10.018 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:12:41.144 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:12:41.151 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:12:41.193 INFO:tasks.ceph.mds.c.smithi062.stderr:2023-06-09T05:12:41.186+0000 7f506cdd7700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 137946) UID: 0 2023-06-09T05:12:41.193 INFO:tasks.ceph.mds.a.smithi062.stderr:2023-06-09T05:12:41.186+0000 7fafd2fdc700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 137946) UID: 0 2023-06-09T05:13:26.411 INFO:teuthology.orchestra.run.smithi062.stdout:generic/089 709s 2023-06-09T05:13:26.437 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/089 2023-06-09T05:13:26.438 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T05:13:26.449 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:13:27.145 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:13:27.146 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/090) 2023-06-09T05:13:28.134 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T05:13:28.153 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T05:13:28.155 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T05:13:28.160 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T05:13:28.160 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:13:29.077 INFO:teuthology.orchestra.run.smithi062.stdout:generic/090 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-06-09T05:13:29.096 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/090 2023-06-09T05:13:29.096 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/090 2023-06-09T05:13:29.096 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T05:13:29.108 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:13:29.197 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:13:29.198 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/091) 2023-06-09T05:13:29.872 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T05:13:29.889 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T05:13:29.892 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T05:13:29.897 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T05:13:29.897 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:15:30.748 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:15:30.755 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:16:01.050 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:16:01.054 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:16:31.188 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:16:31.196 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:16:33.896 INFO:teuthology.orchestra.run.smithi062.stdout:generic/091 183s 2023-06-09T05:16:33.922 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/091 2023-06-09T05:16:33.923 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T05:16:33.938 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:16:34.244 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:16:34.245 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/092) 2023-06-09T05:16:35.101 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T05:16:35.126 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T05:16:35.129 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T05:16:35.135 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T05:16:35.135 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:16:36.189 INFO:teuthology.orchestra.run.smithi062.stdout:generic/092 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T05:16:36.214 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/092 2023-06-09T05:16:36.214 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/092 2023-06-09T05:16:36.214 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T05:16:36.228 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:16:36.314 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:16:36.314 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/093) 2023-06-09T05:16:37.053 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T05:16:37.076 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T05:16:37.079 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T05:16:37.085 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T05:16:37.085 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:16:38.758 INFO:teuthology.orchestra.run.smithi062.stdout:generic/093 1s 2023-06-09T05:16:38.787 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/093 2023-06-09T05:16:38.787 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T05:16:38.803 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:16:39.016 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:16:39.016 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/094) 2023-06-09T05:16:39.870 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T05:16:39.894 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T05:16:39.896 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T05:16:39.902 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T05:16:39.903 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:16:40.986 INFO:teuthology.orchestra.run.smithi062.stdout:generic/094 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-06-09T05:16:41.007 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/094 2023-06-09T05:16:41.007 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/094 2023-06-09T05:16:41.008 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T05:16:41.022 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:16:41.243 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:16:41.243 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/095) 2023-06-09T05:16:42.147 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T05:16:42.172 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T05:16:42.175 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T05:16:42.181 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T05:16:42.181 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:16:59.966 INFO:teuthology.orchestra.run.smithi062.stdout:generic/095 17s 2023-06-09T05:16:59.989 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/095 2023-06-09T05:16:59.989 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T05:17:00.000 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:17:00.031 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:17:00.032 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/096) 2023-06-09T05:17:00.790 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T05:17:00.810 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T05:17:00.814 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T05:17:00.820 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T05:17:00.820 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:17:01.269 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:17:01.275 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:17:01.946 INFO:teuthology.orchestra.run.smithi062.stdout:generic/096 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-06-09T05:17:01.967 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/096 2023-06-09T05:17:01.967 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/096 2023-06-09T05:17:01.968 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T05:17:01.983 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:17:02.112 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:17:02.112 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/097) 2023-06-09T05:17:02.860 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T05:17:02.880 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T05:17:02.883 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T05:17:02.890 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T05:17:02.890 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:17:04.556 INFO:teuthology.orchestra.run.smithi062.stdout:generic/097 1s 2023-06-09T05:17:04.580 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/097 2023-06-09T05:17:04.580 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T05:17:04.592 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:17:04.675 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:17:04.676 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/098) 2023-06-09T05:17:05.453 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T05:17:05.474 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T05:17:05.477 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T05:17:05.483 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T05:17:05.483 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:17:08.943 INFO:teuthology.orchestra.run.smithi062.stdout:generic/098 3s 2023-06-09T05:17:08.972 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/098 2023-06-09T05:17:08.972 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T05:17:08.986 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:17:09.030 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:17:09.031 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/099) 2023-06-09T05:17:09.797 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T05:17:09.820 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T05:17:09.823 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T05:17:09.828 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T05:17:09.828 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:17:12.329 INFO:teuthology.orchestra.run.smithi062.stdout:generic/099 2s 2023-06-09T05:17:12.353 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/099 2023-06-09T05:17:12.353 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T05:17:12.368 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:17:12.822 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:17:12.823 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/100) 2023-06-09T05:17:13.567 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T05:17:13.589 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T05:17:13.592 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T05:17:13.598 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T05:17:13.598 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:17:31.344 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:17:31.352 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:18:01.121 INFO:teuthology.orchestra.run.smithi062.stdout:generic/100 48s 2023-06-09T05:18:01.146 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/100 2023-06-09T05:18:01.146 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T05:18:01.159 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:18:01.472 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:18:01.478 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:18:03.041 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:18:03.041 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/101) 2023-06-09T05:18:03.754 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T05:18:03.777 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T05:18:03.779 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T05:18:03.784 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T05:18:03.785 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:18:04.764 INFO:teuthology.orchestra.run.smithi062.stdout:generic/101 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-06-09T05:18:04.780 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/101 2023-06-09T05:18:04.780 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/101 2023-06-09T05:18:04.780 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T05:18:04.793 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:18:04.883 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:18:04.884 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/102) 2023-06-09T05:18:05.647 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T05:18:05.665 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T05:18:05.669 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T05:18:05.674 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T05:18:05.675 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:18:06.561 INFO:teuthology.orchestra.run.smithi062.stdout:generic/102 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-09T05:18:06.820 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/102 2023-06-09T05:18:06.821 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/102 2023-06-09T05:18:06.821 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T05:18:06.830 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:18:06.901 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:18:06.901 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/103) 2023-06-09T05:18:07.566 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T05:18:07.586 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T05:18:07.588 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T05:18:07.594 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T05:18:07.594 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:18:08.619 INFO:teuthology.orchestra.run.smithi062.stdout:generic/103 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T05:18:08.640 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/103 2023-06-09T05:18:08.641 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/103 2023-06-09T05:18:08.641 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T05:18:08.653 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:18:08.955 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:18:08.955 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/104) 2023-06-09T05:18:09.824 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T05:18:09.848 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T05:18:09.851 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T05:18:09.857 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T05:18:09.858 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:18:10.855 INFO:teuthology.orchestra.run.smithi062.stdout:generic/104 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-06-09T05:18:10.876 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/104 2023-06-09T05:18:10.876 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/104 2023-06-09T05:18:10.876 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T05:18:10.890 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:18:10.986 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:18:10.986 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/105) 2023-06-09T05:18:11.739 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T05:18:11.761 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T05:18:11.764 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T05:18:11.770 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T05:18:11.770 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:18:13.602 INFO:teuthology.orchestra.run.smithi062.stdout:generic/105 1s 2023-06-09T05:18:13.683 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/105 2023-06-09T05:18:13.683 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T05:18:13.695 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:18:13.723 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:18:13.723 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/106) 2023-06-09T05:18:14.466 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T05:18:14.487 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T05:18:14.490 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T05:18:14.496 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T05:18:14.497 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:18:15.566 INFO:teuthology.orchestra.run.smithi062.stdout:generic/106 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-06-09T05:18:15.586 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/106 2023-06-09T05:18:15.587 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/106 2023-06-09T05:18:15.587 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T05:18:15.601 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:18:15.691 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:18:15.691 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/107) 2023-06-09T05:18:16.433 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T05:18:16.455 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T05:18:16.458 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T05:18:16.464 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T05:18:16.465 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:18:17.528 INFO:teuthology.orchestra.run.smithi062.stdout:generic/107 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-06-09T05:18:17.547 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/107 2023-06-09T05:18:17.548 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/107 2023-06-09T05:18:17.548 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T05:18:17.560 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:18:17.660 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:18:17.661 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/108) 2023-06-09T05:18:18.430 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T05:18:18.456 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T05:18:18.458 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T05:18:18.465 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T05:18:18.465 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:18:19.760 INFO:teuthology.orchestra.run.smithi062.stdout:generic/108 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-06-09T05:18:19.783 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/108 2023-06-09T05:18:19.784 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/108 2023-06-09T05:18:19.784 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T05:18:19.796 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:18:19.874 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:18:19.874 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/109) 2023-06-09T05:18:20.623 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T05:18:20.643 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T05:18:20.647 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T05:18:20.654 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T05:18:20.654 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:18:31.689 INFO:teuthology.orchestra.run.smithi062.stdout:generic/109 10s 2023-06-09T05:18:31.705 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:18:31.714 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:18:31.717 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/109 2023-06-09T05:18:31.717 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T05:18:31.725 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:18:31.752 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:18:31.753 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/110) 2023-06-09T05:18:32.637 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T05:18:32.657 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T05:18:32.660 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T05:18:32.666 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T05:18:32.666 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:18:57.488 INFO:teuthology.orchestra.run.smithi062.stdout:generic/110 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T05:18:57.509 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/110 2023-06-09T05:18:57.509 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/110 2023-06-09T05:18:57.510 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T05:18:57.523 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:18:57.939 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:18:57.940 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/111) 2023-06-09T05:18:58.679 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T05:18:58.703 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T05:18:58.706 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T05:18:58.712 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T05:18:58.712 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:18:59.788 INFO:teuthology.orchestra.run.smithi062.stdout:generic/111 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T05:18:59.808 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/111 2023-06-09T05:18:59.809 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/111 2023-06-09T05:18:59.809 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T05:18:59.821 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:19:00.135 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:19:00.135 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/112) 2023-06-09T05:19:00.965 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T05:19:00.988 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T05:19:00.991 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T05:19:00.998 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T05:19:00.999 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:19:01.793 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:19:01.800 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:19:31.905 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:19:31.911 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:19:33.367 INFO:teuthology.orchestra.run.smithi062.stdout:generic/112 32s 2023-06-09T05:19:33.396 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/112 2023-06-09T05:19:33.396 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T05:19:33.410 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:19:33.725 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:19:33.726 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/113) 2023-06-09T05:19:34.555 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T05:19:34.577 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T05:19:34.581 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T05:19:34.586 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T05:19:34.586 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:19:54.101 INFO:teuthology.orchestra.run.smithi062.stdout:generic/113 20s 2023-06-09T05:19:54.128 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/113 2023-06-09T05:19:54.128 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T05:19:54.141 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:19:54.507 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:19:54.507 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/114) 2023-06-09T05:19:55.306 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T05:19:55.329 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T05:19:55.332 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T05:19:55.338 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T05:19:55.338 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:19:56.470 INFO:teuthology.orchestra.run.smithi062.stdout:generic/114 [not run] device block size: 4096 greater than 512 2023-06-09T05:19:56.489 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/114 2023-06-09T05:19:56.489 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/114 2023-06-09T05:19:56.490 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T05:19:56.502 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:19:56.598 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:19:56.598 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/115) 2023-06-09T05:19:57.359 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T05:19:57.381 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T05:19:57.384 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T05:19:57.390 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T05:19:57.390 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:19:58.463 INFO:teuthology.orchestra.run.smithi062.stdout:generic/115 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T05:19:58.487 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/115 2023-06-09T05:19:58.487 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/115 2023-06-09T05:19:58.488 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T05:19:58.501 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:19:58.766 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:19:58.766 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/116) 2023-06-09T05:19:59.639 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T05:19:59.660 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T05:19:59.663 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T05:19:59.668 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T05:19:59.668 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:20:00.732 INFO:teuthology.orchestra.run.smithi062.stdout:generic/116 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T05:20:00.752 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/116 2023-06-09T05:20:00.752 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/116 2023-06-09T05:20:00.752 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T05:20:00.767 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:20:01.126 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:20:01.126 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/117) 2023-06-09T05:20:01.949 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T05:20:01.973 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T05:20:01.975 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T05:20:01.981 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T05:20:01.982 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:20:02.012 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:20:02.019 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:20:17.963 INFO:teuthology.orchestra.run.smithi062.stdout:generic/117 15s 2023-06-09T05:20:17.989 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/117 2023-06-09T05:20:17.989 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T05:20:18.004 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:20:18.040 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:20:18.040 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/118) 2023-06-09T05:20:18.809 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T05:20:18.832 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T05:20:18.835 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T05:20:18.841 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T05:20:18.841 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:20:20.669 INFO:teuthology.orchestra.run.smithi062.stdout:generic/118 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T05:20:20.692 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/118 2023-06-09T05:20:20.693 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/118 2023-06-09T05:20:20.693 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T05:20:20.706 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:20:21.035 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:20:21.035 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/119) 2023-06-09T05:20:21.809 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T05:20:21.831 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T05:20:21.834 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T05:20:21.840 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T05:20:21.841 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:20:22.941 INFO:teuthology.orchestra.run.smithi062.stdout:generic/119 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T05:20:22.963 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/119 2023-06-09T05:20:22.963 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/119 2023-06-09T05:20:22.964 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T05:20:22.977 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:20:23.314 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:20:23.315 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/120) 2023-06-09T05:20:24.110 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T05:20:24.133 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T05:20:24.136 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T05:20:24.142 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T05:20:24.142 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:20:25.113 INFO:teuthology.orchestra.run.smithi062.stdout:generic/120 [not run] atime not maintained by ceph 2023-06-09T05:20:25.133 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/120 2023-06-09T05:20:25.134 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/120 2023-06-09T05:20:25.134 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T05:20:25.148 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:20:25.238 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:20:25.239 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/121) 2023-06-09T05:20:26.009 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T05:20:26.032 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T05:20:26.035 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T05:20:26.042 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T05:20:26.042 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:20:27.123 INFO:teuthology.orchestra.run.smithi062.stdout:generic/121 [not run] Dedupe not supported by test filesystem type: ceph 2023-06-09T05:20:27.142 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/121 2023-06-09T05:20:27.142 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/121 2023-06-09T05:20:27.142 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T05:20:27.156 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:20:27.345 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:20:27.345 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/122) 2023-06-09T05:20:28.195 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T05:20:28.217 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T05:20:28.220 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T05:20:28.226 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T05:20:28.227 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:20:29.318 INFO:teuthology.orchestra.run.smithi062.stdout:generic/122 [not run] Dedupe not supported by test filesystem type: ceph 2023-06-09T05:20:29.338 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/122 2023-06-09T05:20:29.338 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/122 2023-06-09T05:20:29.338 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T05:20:29.350 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:20:29.608 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:20:29.608 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/123) 2023-06-09T05:20:30.508 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T05:20:30.531 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T05:20:30.535 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T05:20:30.540 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T05:20:30.540 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:20:32.150 INFO:teuthology.orchestra.run.smithi062.stdout:generic/123 2s 2023-06-09T05:20:32.175 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/123 2023-06-09T05:20:32.175 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T05:20:32.192 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:20:32.209 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:20:32.215 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:20:32.601 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:20:32.601 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/124) 2023-06-09T05:20:33.371 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T05:20:33.395 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T05:20:33.399 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T05:20:33.404 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T05:20:33.404 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:20:40.794 INFO:teuthology.orchestra.run.smithi062.stdout:generic/124 7s 2023-06-09T05:20:40.867 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/124 2023-06-09T05:20:40.868 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T05:20:40.889 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:20:41.269 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:20:41.270 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/125) 2023-06-09T05:20:41.992 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T05:20:42.014 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T05:20:42.017 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T05:20:42.023 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T05:20:42.023 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:21:02.606 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:21:02.614 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:21:32.754 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:21:32.758 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:21:44.640 INFO:teuthology.orchestra.run.smithi062.stdout:generic/125 62s 2023-06-09T05:21:44.665 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/125 2023-06-09T05:21:44.665 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T05:21:44.679 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:21:45.064 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:21:45.065 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/126) 2023-06-09T05:21:45.826 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T05:21:45.849 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T05:21:45.852 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T05:21:45.858 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T05:21:45.858 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:21:47.381 INFO:teuthology.orchestra.run.smithi062.stdout:generic/126 1s 2023-06-09T05:21:47.405 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/126 2023-06-09T05:21:47.406 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T05:21:47.417 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:21:47.784 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:21:47.785 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/127) 2023-06-09T05:21:48.599 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T05:21:48.621 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T05:21:48.624 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T05:21:48.629 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T05:21:48.629 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:22:02.843 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:22:02.849 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:22:32.923 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:22:32.931 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:23:03.012 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:23:03.016 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:23:34.121 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:23:34.125 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:24:04.191 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:24:04.196 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:24:34.323 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:24:34.328 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:25:04.395 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:25:04.401 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:25:34.550 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:25:34.556 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:26:04.682 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:26:04.689 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:26:34.862 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:26:34.868 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:27:05.902 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:27:05.909 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:27:35.982 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:27:35.990 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:28:06.155 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:28:06.161 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:28:36.284 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:28:36.291 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:29:06.415 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:29:06.421 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:29:36.513 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:29:36.518 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:30:06.585 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:30:06.592 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:30:36.699 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:30:36.704 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:31:06.847 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:31:06.853 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:31:36.918 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:31:36.925 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:32:06.992 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:32:06.999 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:32:37.114 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:32:37.120 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:33:07.194 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:33:07.198 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:33:37.333 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:33:37.340 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:34:07.474 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:34:07.480 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:34:37.605 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:34:37.610 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:35:07.735 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:35:07.741 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:35:37.819 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:35:37.825 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:36:08.038 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:36:08.044 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:36:38.145 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:36:38.151 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:37:08.249 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:37:08.256 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:37:38.347 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:37:38.352 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:38:09.239 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:38:09.244 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:38:40.527 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:38:40.534 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:39:10.813 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:39:10.820 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:39:40.888 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:39:40.895 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:40:11.046 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:40:11.053 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:40:32.342 INFO:teuthology.orchestra.run.smithi062.stdout:generic/127 1123s 2023-06-09T05:40:32.374 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/127 2023-06-09T05:40:32.374 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T05:40:32.388 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:40:32.546 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:40:32.546 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/128) 2023-06-09T05:40:33.532 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T05:40:33.557 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T05:40:33.559 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T05:40:33.566 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T05:40:33.567 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:40:36.057 INFO:teuthology.orchestra.run.smithi062.stdout:generic/128 3s 2023-06-09T05:40:36.084 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/128 2023-06-09T05:40:36.084 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T05:40:36.098 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:40:36.145 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T05:40:36.145 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/129) 2023-06-09T05:40:36.903 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T05:40:36.926 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T05:40:36.929 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T05:40:36.934 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T05:40:36.934 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T05:40:41.127 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:40:41.133 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:41:11.269 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:41:11.274 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:41:41.361 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:41:41.376 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:42:11.484 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:42:11.487 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:42:42.397 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:42:42.402 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:43:12.547 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:43:12.551 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:43:42.658 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:43:42.666 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:44:12.825 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:44:12.829 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:44:12.928 INFO:tasks.ceph.osd.0.smithi062.stderr:2023-06-09T05:44:12.919+0000 7fa052e46700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 175079) UID: 0 2023-06-09T05:44:12.928 INFO:tasks.ceph.osd.1.smithi062.stderr:2023-06-09T05:44:12.919+0000 7f51ef5ce700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 175079) UID: 0 2023-06-09T05:44:12.929 INFO:tasks.ceph.osd.3.smithi062.stderr:2023-06-09T05:44:12.919+0000 7fb4af5ce700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 175079) UID: 0 2023-06-09T05:44:12.929 INFO:tasks.ceph.osd.2.smithi062.stderr:2023-06-09T05:44:12.919+0000 7f9e3696d700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 175079) UID: 0 2023-06-09T05:49:58.218 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:49:58.224 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T05:49:58.328 INFO:tasks.ceph.osd.5.smithi089.stderr:2023-06-09T05:49:58.323+0000 7fa2fe1bb700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 41980) UID: 0 2023-06-09T05:49:58.328 INFO:tasks.ceph.osd.7.smithi089.stderr:2023-06-09T05:49:58.323+0000 7ff7cd1d9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 41980) UID: 0 2023-06-09T05:49:58.328 INFO:tasks.ceph.osd.6.smithi089.stderr:2023-06-09T05:49:58.323+0000 7f683358f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 41980) UID: 0 2023-06-09T05:49:58.329 INFO:tasks.ceph.osd.4.smithi089.stderr:2023-06-09T05:49:58.323+0000 7f3af9fd2700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 41980) UID: 0 2023-06-09T05:49:58.336 INFO:tasks.ceph.osd.2.smithi062.stderr:2023-06-09T05:49:58.330+0000 7f9e3696d700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 175101) UID: 0 2023-06-09T05:49:58.337 INFO:tasks.ceph.osd.3.smithi062.stderr:2023-06-09T05:49:58.330+0000 7fb4af5ce700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 175101) UID: 0 2023-06-09T05:49:58.337 INFO:tasks.ceph.osd.1.smithi062.stderr:2023-06-09T05:49:58.330+0000 7f51ef5ce700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 175101) UID: 0 2023-06-09T05:49:58.337 INFO:tasks.ceph.osd.0.smithi062.stderr:2023-06-09T05:49:58.330+0000 7fa052e46700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 175101) UID: 0 2023-06-09T06:03:13.290 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:03:13.295 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:03:13.372 INFO:tasks.ceph.mds.c.smithi062.stderr:2023-06-09T06:03:13.366+0000 7f506cdd7700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 175128) UID: 0 2023-06-09T06:03:13.373 INFO:tasks.ceph.mds.a.smithi062.stderr:2023-06-09T06:03:13.366+0000 7fafd2fdc700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 175128) UID: 0 2023-06-09T06:03:13.610 INFO:tasks.ceph.osd.7.smithi089.stderr:2023-06-09T06:03:13.601+0000 7ff7cd1d9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 42067) UID: 0 2023-06-09T06:03:13.610 INFO:tasks.ceph.osd.4.smithi089.stderr:2023-06-09T06:03:13.601+0000 7f3af9fd2700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 42067) UID: 0 2023-06-09T06:03:13.611 INFO:tasks.ceph.osd.5.smithi089.stderr:2023-06-09T06:03:13.601+0000 7fa2fe1bb700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 42067) UID: 0 2023-06-09T06:03:13.611 INFO:tasks.ceph.osd.6.smithi089.stderr:2023-06-09T06:03:13.601+0000 7f683358f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 42067) UID: 0 2023-06-09T06:04:08.575 INFO:teuthology.orchestra.run.smithi062.stdout:generic/129 1411s 2023-06-09T06:04:08.719 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/129 2023-06-09T06:04:08.719 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:04:08.731 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:04:08.766 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:04:08.766 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/130) 2023-06-09T06:04:10.295 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:04:10.315 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:04:10.318 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:04:10.322 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:04:10.323 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:04:31.280 INFO:teuthology.orchestra.run.smithi062.stdout:generic/130 21s 2023-06-09T06:04:31.322 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/130 2023-06-09T06:04:31.322 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:04:31.333 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:04:31.369 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:04:31.370 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/131) 2023-06-09T06:04:32.299 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:04:32.318 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:04:32.321 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:04:32.326 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:04:32.326 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:04:34.557 INFO:teuthology.orchestra.run.smithi062.stdout:generic/131 2s 2023-06-09T06:04:34.585 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/131 2023-06-09T06:04:34.586 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:04:34.595 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:04:34.964 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:04:34.964 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/132) 2023-06-09T06:04:35.997 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:04:36.022 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:04:36.032 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:04:36.039 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:04:36.039 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:04:52.585 INFO:teuthology.orchestra.run.smithi062.stdout:generic/132 16s 2023-06-09T06:04:52.610 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/132 2023-06-09T06:04:52.610 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:04:52.622 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:04:52.655 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:04:52.655 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/133) 2023-06-09T06:04:53.348 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:04:53.367 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:04:53.368 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:04:53.374 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:04:53.374 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:06:21.744 INFO:tasks.ceph.osd.0.smithi062.stderr:2023-06-09T06:06:21.735+0000 7fa052e46700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 177516) UID: 0 2023-06-09T06:06:21.745 INFO:tasks.ceph.osd.2.smithi062.stderr:2023-06-09T06:06:21.735+0000 7f9e3696d700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 177516) UID: 0 2023-06-09T06:06:21.745 INFO:tasks.ceph.osd.1.smithi062.stderr:2023-06-09T06:06:21.735+0000 7f51ef5ce700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 177516) UID: 0 2023-06-09T06:06:21.745 INFO:tasks.ceph.osd.3.smithi062.stderr:2023-06-09T06:06:21.735+0000 7fb4af5ce700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 177516) UID: 0 2023-06-09T06:11:22.615 INFO:teuthology.orchestra.run.smithi062.stdout:generic/133 389s 2023-06-09T06:11:22.639 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/133 2023-06-09T06:11:22.639 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:11:22.652 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:11:22.989 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:11:22.990 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/134) 2023-06-09T06:11:23.929 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:11:23.946 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:11:23.949 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:11:23.956 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:11:23.956 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:11:25.008 INFO:teuthology.orchestra.run.smithi062.stdout:generic/134 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T06:11:25.027 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/134 2023-06-09T06:11:25.027 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/134 2023-06-09T06:11:25.028 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:11:25.040 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:11:25.284 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:11:25.285 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/135) 2023-06-09T06:11:26.093 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:11:26.107 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:11:26.109 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:11:26.113 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:11:26.113 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:11:28.136 INFO:teuthology.orchestra.run.smithi062.stdout:generic/135 2s 2023-06-09T06:11:28.161 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/135 2023-06-09T06:11:28.161 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:11:28.172 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:11:28.213 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:11:28.214 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/136) 2023-06-09T06:11:28.923 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:11:28.943 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:11:28.946 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:11:28.951 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:11:28.951 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:11:29.938 INFO:teuthology.orchestra.run.smithi062.stdout:generic/136 [not run] Dedupe not supported by test filesystem type: ceph 2023-06-09T06:11:29.957 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/136 2023-06-09T06:11:29.958 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/136 2023-06-09T06:11:29.958 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:11:29.970 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:11:30.311 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:11:30.312 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/137) 2023-06-09T06:11:31.098 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:11:31.118 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:11:31.120 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:11:31.125 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:11:31.125 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:11:32.090 INFO:teuthology.orchestra.run.smithi062.stdout:generic/137 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T06:11:32.110 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/137 2023-06-09T06:11:32.111 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/137 2023-06-09T06:11:32.111 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:11:32.121 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:11:32.455 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:11:32.455 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/138) 2023-06-09T06:11:33.230 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:11:33.250 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:11:33.253 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:11:33.258 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:11:33.259 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:11:34.225 INFO:teuthology.orchestra.run.smithi062.stdout:generic/138 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T06:11:34.246 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/138 2023-06-09T06:11:34.247 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/138 2023-06-09T06:11:34.247 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:11:34.261 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:11:34.667 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:11:34.668 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/139) 2023-06-09T06:11:35.398 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:11:35.417 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:11:35.419 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:11:35.424 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:11:35.424 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:11:36.372 INFO:teuthology.orchestra.run.smithi062.stdout:generic/139 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T06:11:36.390 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/139 2023-06-09T06:11:36.390 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/139 2023-06-09T06:11:36.390 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:11:36.401 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:11:36.633 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:11:36.634 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/140) 2023-06-09T06:11:37.496 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:11:37.517 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:11:37.520 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:11:37.526 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:11:37.526 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:11:38.520 INFO:teuthology.orchestra.run.smithi062.stdout:generic/140 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T06:11:38.541 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/140 2023-06-09T06:11:38.542 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/140 2023-06-09T06:11:38.542 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:11:38.554 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:11:38.945 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:11:38.946 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/141) 2023-06-09T06:11:39.682 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:11:39.703 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:11:39.707 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:11:39.713 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:11:39.713 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:11:40.993 INFO:teuthology.orchestra.run.smithi062.stdout:generic/141 0s 2023-06-09T06:11:41.018 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/141 2023-06-09T06:11:41.018 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:11:41.030 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:11:41.062 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:11:41.063 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/142) 2023-06-09T06:11:41.747 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:11:41.769 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:11:41.772 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:11:41.777 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:11:41.777 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:11:42.721 INFO:teuthology.orchestra.run.smithi062.stdout:generic/142 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T06:11:42.741 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/142 2023-06-09T06:11:42.741 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/142 2023-06-09T06:11:42.741 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:11:42.752 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:11:43.188 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:11:43.189 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/143) 2023-06-09T06:11:43.953 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:11:43.974 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:11:43.977 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:11:43.982 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:11:43.982 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:11:44.928 INFO:teuthology.orchestra.run.smithi062.stdout:generic/143 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T06:11:44.945 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/143 2023-06-09T06:11:44.945 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/143 2023-06-09T06:11:44.946 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:11:44.957 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:11:45.307 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:11:45.308 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/144) 2023-06-09T06:11:46.104 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:11:46.123 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:11:46.126 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:11:46.131 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:11:46.131 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:11:47.124 INFO:teuthology.orchestra.run.smithi062.stdout:generic/144 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T06:11:47.145 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/144 2023-06-09T06:11:47.145 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/144 2023-06-09T06:11:47.146 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:11:47.156 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:11:47.480 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:11:47.481 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/145) 2023-06-09T06:11:48.292 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:11:48.314 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:11:48.317 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:11:48.322 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:11:48.322 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:11:49.336 INFO:teuthology.orchestra.run.smithi062.stdout:generic/145 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T06:11:49.354 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/145 2023-06-09T06:11:49.355 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/145 2023-06-09T06:11:49.355 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:11:49.367 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:11:49.775 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:11:49.775 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/146) 2023-06-09T06:11:50.451 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:11:50.472 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:11:50.475 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:11:50.480 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:11:50.480 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:11:51.457 INFO:teuthology.orchestra.run.smithi062.stdout:generic/146 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T06:11:51.473 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/146 2023-06-09T06:11:51.474 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/146 2023-06-09T06:11:51.474 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:11:51.487 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:11:51.940 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:11:51.941 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/147) 2023-06-09T06:11:52.654 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:11:52.670 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:11:52.672 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:11:52.676 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:11:52.676 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:11:53.891 INFO:teuthology.orchestra.run.smithi062.stdout:generic/147 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T06:11:53.909 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/147 2023-06-09T06:11:53.910 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/147 2023-06-09T06:11:53.910 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:11:53.919 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:11:54.231 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:11:54.232 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/148) 2023-06-09T06:11:55.062 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:11:55.123 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:11:55.123 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:11:55.123 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:11:55.124 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:11:56.038 INFO:teuthology.orchestra.run.smithi062.stdout:generic/148 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T06:11:56.059 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/148 2023-06-09T06:11:56.060 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/148 2023-06-09T06:11:56.060 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:11:56.071 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:11:56.430 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:11:56.431 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/149) 2023-06-09T06:11:57.220 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:11:57.239 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:11:57.242 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:11:57.247 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:11:57.247 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:11:58.202 INFO:teuthology.orchestra.run.smithi062.stdout:generic/149 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T06:11:58.221 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/149 2023-06-09T06:11:58.221 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/149 2023-06-09T06:11:58.221 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:11:58.233 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:11:58.512 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:11:58.512 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/150) 2023-06-09T06:11:59.352 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:11:59.372 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:11:59.374 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:11:59.379 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:11:59.379 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:12:00.356 INFO:teuthology.orchestra.run.smithi062.stdout:generic/150 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T06:12:00.375 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/150 2023-06-09T06:12:00.375 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/150 2023-06-09T06:12:00.376 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:12:00.387 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:12:00.710 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:12:00.710 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/151) 2023-06-09T06:12:01.496 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:12:01.516 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:12:01.518 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:12:01.522 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:12:01.523 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:12:02.452 INFO:teuthology.orchestra.run.smithi062.stdout:generic/151 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T06:12:02.470 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/151 2023-06-09T06:12:02.470 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/151 2023-06-09T06:12:02.470 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:12:02.481 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:12:02.924 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:12:02.925 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/152) 2023-06-09T06:12:03.720 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:12:03.739 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:12:03.741 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:12:03.746 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:12:03.746 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:12:04.752 INFO:teuthology.orchestra.run.smithi062.stdout:generic/152 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T06:12:04.773 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/152 2023-06-09T06:12:04.773 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/152 2023-06-09T06:12:04.774 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:12:04.786 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:12:05.211 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:12:05.212 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/153) 2023-06-09T06:12:06.016 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:12:06.039 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:12:06.042 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:12:06.047 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:12:06.048 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:12:07.191 INFO:teuthology.orchestra.run.smithi062.stdout:generic/153 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T06:12:07.211 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/153 2023-06-09T06:12:07.212 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/153 2023-06-09T06:12:07.212 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:12:07.225 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:12:07.659 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:12:07.659 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/154) 2023-06-09T06:12:08.455 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:12:08.475 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:12:08.477 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:12:08.484 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:12:08.484 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:12:09.573 INFO:teuthology.orchestra.run.smithi062.stdout:generic/154 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T06:12:09.594 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/154 2023-06-09T06:12:09.595 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/154 2023-06-09T06:12:09.595 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:12:09.608 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:12:09.893 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:12:09.894 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/155) 2023-06-09T06:12:10.776 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:12:10.799 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:12:10.803 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:12:10.808 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:12:10.808 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:12:11.912 INFO:teuthology.orchestra.run.smithi062.stdout:generic/155 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T06:12:11.933 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/155 2023-06-09T06:12:11.933 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/155 2023-06-09T06:12:11.933 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:12:11.945 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:12:12.389 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:12:12.390 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/156) 2023-06-09T06:12:13.150 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:12:13.170 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:12:13.173 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:12:13.179 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:12:13.179 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:12:14.286 INFO:teuthology.orchestra.run.smithi062.stdout:generic/156 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T06:12:14.306 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/156 2023-06-09T06:12:14.307 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/156 2023-06-09T06:12:14.307 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:12:14.321 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:12:14.716 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:12:14.717 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/157) 2023-06-09T06:12:15.542 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:12:15.563 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:12:15.566 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:12:15.571 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:12:15.572 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:12:16.694 INFO:teuthology.orchestra.run.smithi062.stdout:generic/157 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T06:12:16.716 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/157 2023-06-09T06:12:16.716 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/157 2023-06-09T06:12:16.716 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:12:16.731 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:12:17.203 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:12:17.203 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/158) 2023-06-09T06:12:17.964 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:12:17.987 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:12:17.990 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:12:17.996 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:12:17.996 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:12:19.121 INFO:teuthology.orchestra.run.smithi062.stdout:generic/158 [not run] Dedupe not supported by test filesystem type: ceph 2023-06-09T06:12:19.139 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/158 2023-06-09T06:12:19.139 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/158 2023-06-09T06:12:19.139 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:12:19.152 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:12:19.589 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:12:19.590 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/159) 2023-06-09T06:12:20.379 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:12:20.401 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:12:20.404 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:12:20.410 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:12:20.410 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:12:21.404 INFO:teuthology.orchestra.run.smithi062.stdout:generic/159 [not run] file system doesn't support chattr +i 2023-06-09T06:12:21.427 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/159 2023-06-09T06:12:21.427 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/159 2023-06-09T06:12:21.427 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:12:21.441 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:12:21.545 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:12:21.546 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/160) 2023-06-09T06:12:22.300 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:12:22.322 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:12:22.325 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:12:22.330 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:12:22.331 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:12:23.352 INFO:teuthology.orchestra.run.smithi062.stdout:generic/160 [not run] file system doesn't support chattr +i 2023-06-09T06:12:23.371 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/160 2023-06-09T06:12:23.372 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/160 2023-06-09T06:12:23.372 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:12:23.384 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:12:23.500 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:12:23.501 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/161) 2023-06-09T06:12:24.278 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:12:24.302 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:12:24.305 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:12:24.310 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:12:24.311 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:12:25.890 INFO:teuthology.orchestra.run.smithi062.stdout:generic/161 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:12:26.079 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/161 2023-06-09T06:12:26.079 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/161 2023-06-09T06:12:26.079 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:12:26.079 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:12:26.199 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:12:26.200 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/162) 2023-06-09T06:12:26.948 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:12:26.969 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:12:26.972 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:12:26.978 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:12:26.978 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:12:28.339 INFO:teuthology.orchestra.run.smithi062.stdout:generic/162 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-06-09T06:12:28.686 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/162 2023-06-09T06:12:28.687 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/162 2023-06-09T06:12:28.688 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:12:28.808 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:12:28.957 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:12:28.957 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/163) 2023-06-09T06:12:29.716 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:12:29.738 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:12:29.740 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:12:29.746 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:12:29.747 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:12:31.124 INFO:teuthology.orchestra.run.smithi062.stdout:generic/163 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-06-09T06:12:31.313 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/163 2023-06-09T06:12:31.313 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/163 2023-06-09T06:12:31.313 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:12:31.427 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:12:31.685 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:12:31.686 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/164) 2023-06-09T06:12:32.327 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:12:32.344 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:12:32.347 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:12:32.350 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:12:32.351 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:12:33.820 INFO:teuthology.orchestra.run.smithi062.stdout:generic/164 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:12:33.852 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/164 2023-06-09T06:12:33.852 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/164 2023-06-09T06:12:33.852 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:12:33.944 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:12:34.158 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:12:34.159 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/165) 2023-06-09T06:12:34.604 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:12:34.608 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:12:34.894 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:12:34.919 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:12:34.922 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:12:34.928 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:12:34.928 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:12:36.473 INFO:teuthology.orchestra.run.smithi062.stdout:generic/165 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:12:36.647 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/165 2023-06-09T06:12:36.647 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/165 2023-06-09T06:12:36.647 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:12:36.690 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:12:36.812 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:12:36.812 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/166) 2023-06-09T06:12:37.564 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:12:37.585 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:12:37.588 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:12:37.594 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:12:37.594 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:12:39.210 INFO:teuthology.orchestra.run.smithi062.stdout:generic/166 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:12:39.349 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/166 2023-06-09T06:12:39.349 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/166 2023-06-09T06:12:39.350 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:12:39.378 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:12:39.491 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:12:39.492 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/167) 2023-06-09T06:12:40.245 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:12:40.268 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:12:40.271 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:12:40.276 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:12:40.277 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:12:41.920 INFO:teuthology.orchestra.run.smithi062.stdout:generic/167 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:12:42.052 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/167 2023-06-09T06:12:42.052 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/167 2023-06-09T06:12:42.052 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:12:42.073 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:12:42.185 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:12:42.186 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/168) 2023-06-09T06:12:42.932 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:12:42.956 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:12:42.959 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:12:42.964 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:12:42.964 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:12:44.585 INFO:teuthology.orchestra.run.smithi062.stdout:generic/168 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:12:44.622 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/168 2023-06-09T06:12:44.622 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/168 2023-06-09T06:12:44.622 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:12:44.719 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:12:44.881 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:12:44.882 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/169) 2023-06-09T06:12:45.645 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:12:45.667 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:12:45.669 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:12:45.675 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:12:45.675 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:12:47.557 INFO:teuthology.orchestra.run.smithi062.stdout:generic/169 1s 2023-06-09T06:12:47.584 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/169 2023-06-09T06:12:47.584 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:12:47.597 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:12:47.637 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:12:47.637 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/170) 2023-06-09T06:12:48.420 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:12:48.441 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:12:48.444 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:12:48.450 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:12:48.450 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:12:50.239 INFO:teuthology.orchestra.run.smithi062.stdout:generic/170 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:12:50.306 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/170 2023-06-09T06:12:50.307 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/170 2023-06-09T06:12:50.307 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:12:50.315 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:12:50.417 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:12:50.418 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/171) 2023-06-09T06:12:51.158 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:12:51.182 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:12:51.186 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:12:51.192 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:12:51.193 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:12:52.863 INFO:teuthology.orchestra.run.smithi062.stdout:generic/171 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:12:52.897 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/171 2023-06-09T06:12:52.898 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/171 2023-06-09T06:12:52.898 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:12:52.910 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:12:53.073 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:12:53.074 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/172) 2023-06-09T06:12:53.837 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:12:53.860 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:12:53.863 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:12:53.868 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:12:53.868 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:12:55.578 INFO:teuthology.orchestra.run.smithi062.stdout:generic/172 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:12:55.660 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/172 2023-06-09T06:12:55.660 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/172 2023-06-09T06:12:55.660 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:12:55.677 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:12:55.813 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:12:55.813 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/173) 2023-06-09T06:12:56.585 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:12:56.609 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:12:56.612 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:12:56.618 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:12:56.618 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:12:58.215 INFO:teuthology.orchestra.run.smithi062.stdout:generic/173 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:12:58.302 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/173 2023-06-09T06:12:58.303 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/173 2023-06-09T06:12:58.303 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:12:58.377 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:12:58.478 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:12:58.479 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/174) 2023-06-09T06:12:59.204 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:12:59.226 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:12:59.230 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:12:59.235 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:12:59.236 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:13:00.972 INFO:teuthology.orchestra.run.smithi062.stdout:generic/174 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:13:01.000 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/174 2023-06-09T06:13:01.000 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/174 2023-06-09T06:13:01.000 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:13:01.068 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:13:01.181 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:13:01.182 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/175) 2023-06-09T06:13:01.948 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:13:01.970 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:13:01.973 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:13:01.979 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:13:01.979 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:13:03.477 INFO:teuthology.orchestra.run.smithi062.stdout:generic/175 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:13:03.574 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/175 2023-06-09T06:13:03.575 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/175 2023-06-09T06:13:03.575 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:13:03.700 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:13:03.872 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:13:03.873 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/176) 2023-06-09T06:13:04.530 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:13:04.550 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:13:04.554 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:13:04.559 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:13:04.559 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:13:04.726 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:13:04.730 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:13:06.377 INFO:teuthology.orchestra.run.smithi062.stdout:generic/176 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:13:06.439 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/176 2023-06-09T06:13:06.439 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/176 2023-06-09T06:13:06.440 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:13:06.450 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:13:06.523 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:13:06.523 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/177) 2023-06-09T06:13:07.292 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:13:07.314 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:13:07.317 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:13:07.321 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:13:07.321 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:13:08.716 INFO:teuthology.orchestra.run.smithi062.stdout:generic/177 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-06-09T06:13:08.735 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/177 2023-06-09T06:13:08.735 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/177 2023-06-09T06:13:08.735 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:13:08.749 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:13:09.119 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:13:09.119 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/178) 2023-06-09T06:13:09.948 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:13:09.968 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:13:09.971 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:13:09.976 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:13:09.977 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:13:11.088 INFO:teuthology.orchestra.run.smithi062.stdout:generic/178 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T06:13:11.108 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/178 2023-06-09T06:13:11.108 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/178 2023-06-09T06:13:11.108 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:13:11.119 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:13:11.506 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:13:11.507 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/179) 2023-06-09T06:13:12.313 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:13:12.334 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:13:12.337 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:13:12.344 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:13:12.344 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:13:13.416 INFO:teuthology.orchestra.run.smithi062.stdout:generic/179 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T06:13:13.438 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/179 2023-06-09T06:13:13.439 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/179 2023-06-09T06:13:13.439 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:13:13.455 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:13:13.789 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:13:13.790 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/180) 2023-06-09T06:13:14.633 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:13:14.655 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:13:14.658 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:13:14.664 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:13:14.665 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:13:15.763 INFO:teuthology.orchestra.run.smithi062.stdout:generic/180 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T06:13:15.784 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/180 2023-06-09T06:13:15.784 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/180 2023-06-09T06:13:15.784 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:13:15.799 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:13:16.220 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:13:16.220 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/181) 2023-06-09T06:13:17.023 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:13:17.049 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:13:17.052 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:13:17.059 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:13:17.059 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:13:18.165 INFO:teuthology.orchestra.run.smithi062.stdout:generic/181 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T06:13:18.187 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/181 2023-06-09T06:13:18.187 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/181 2023-06-09T06:13:18.187 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:13:18.201 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:13:18.509 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:13:18.510 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/182) 2023-06-09T06:13:19.402 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:13:19.425 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:13:19.428 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:13:19.435 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:13:19.435 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:13:20.519 INFO:teuthology.orchestra.run.smithi062.stdout:generic/182 [not run] Dedupe not supported by test filesystem type: ceph 2023-06-09T06:13:20.540 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/182 2023-06-09T06:13:20.540 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/182 2023-06-09T06:13:20.541 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:13:20.553 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:13:21.000 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:13:21.001 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/183) 2023-06-09T06:13:21.756 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:13:21.779 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:13:21.781 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:13:21.787 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:13:21.787 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:13:23.344 INFO:teuthology.orchestra.run.smithi062.stdout:generic/183 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:13:23.496 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/183 2023-06-09T06:13:23.498 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/183 2023-06-09T06:13:23.498 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:13:23.514 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:13:23.632 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:13:23.633 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/184) 2023-06-09T06:13:24.376 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:13:24.397 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:13:24.399 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:13:24.405 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:13:24.405 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:13:25.508 INFO:teuthology.orchestra.run.smithi062.stdout:generic/184 1s 2023-06-09T06:13:25.536 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/184 2023-06-09T06:13:25.536 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:13:25.552 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:13:25.644 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:13:25.644 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/185) 2023-06-09T06:13:26.410 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:13:26.433 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:13:26.436 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:13:26.443 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:13:26.443 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:13:28.020 INFO:teuthology.orchestra.run.smithi062.stdout:generic/185 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:13:28.177 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/185 2023-06-09T06:13:28.177 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/185 2023-06-09T06:13:28.177 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:13:28.200 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:13:28.310 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:13:28.311 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/186) 2023-06-09T06:13:29.064 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:13:29.087 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:13:29.090 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:13:29.096 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:13:29.096 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:13:30.736 INFO:teuthology.orchestra.run.smithi062.stdout:generic/186 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:13:30.804 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/186 2023-06-09T06:13:30.804 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/186 2023-06-09T06:13:30.804 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:13:30.848 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:13:31.049 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:13:31.050 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/187) 2023-06-09T06:13:31.815 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:13:31.838 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:13:31.842 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:13:31.847 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:13:31.847 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:13:33.441 INFO:teuthology.orchestra.run.smithi062.stdout:generic/187 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:13:33.515 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/187 2023-06-09T06:13:33.515 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/187 2023-06-09T06:13:33.515 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:13:33.576 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:13:33.692 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:13:33.692 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/188) 2023-06-09T06:13:34.450 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:13:34.475 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:13:34.478 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:13:34.485 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:13:34.485 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:13:35.821 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:13:35.826 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:13:36.065 INFO:teuthology.orchestra.run.smithi062.stdout:generic/188 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:13:36.086 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/188 2023-06-09T06:13:36.087 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/188 2023-06-09T06:13:36.087 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:13:36.099 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:13:36.313 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:13:36.314 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/189) 2023-06-09T06:13:36.972 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:13:36.995 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:13:36.999 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:13:37.004 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:13:37.004 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:13:38.622 INFO:teuthology.orchestra.run.smithi062.stdout:generic/189 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:13:38.651 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/189 2023-06-09T06:13:38.651 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/189 2023-06-09T06:13:38.652 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:13:38.784 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:13:38.894 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:13:38.894 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/190) 2023-06-09T06:13:39.671 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:13:39.693 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:13:39.696 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:13:39.702 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:13:39.702 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:13:41.222 INFO:teuthology.orchestra.run.smithi062.stdout:generic/190 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:13:41.382 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/190 2023-06-09T06:13:41.383 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/190 2023-06-09T06:13:41.383 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:13:41.441 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:13:41.558 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:13:41.558 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/191) 2023-06-09T06:13:42.300 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:13:42.324 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:13:42.327 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:13:42.332 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:13:42.332 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:13:44.086 INFO:teuthology.orchestra.run.smithi062.stdout:generic/191 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:13:44.148 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/191 2023-06-09T06:13:44.148 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/191 2023-06-09T06:13:44.148 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:13:44.159 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:13:44.251 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:13:44.252 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/192) 2023-06-09T06:13:45.000 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:13:45.027 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:13:45.031 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:13:45.037 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:13:45.037 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:13:46.065 INFO:teuthology.orchestra.run.smithi062.stdout:generic/192 [not run] atime not maintained by ceph 2023-06-09T06:13:46.086 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/192 2023-06-09T06:13:46.087 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/192 2023-06-09T06:13:46.087 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:13:46.102 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:13:46.195 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:13:46.196 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/193) 2023-06-09T06:13:46.966 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:13:46.990 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:13:46.993 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:13:47.000 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:13:47.000 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:13:49.985 INFO:teuthology.orchestra.run.smithi062.stdout:generic/193 2s 2023-06-09T06:13:50.013 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/193 2023-06-09T06:13:50.013 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:13:50.025 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:13:50.374 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:13:50.375 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/194) 2023-06-09T06:13:51.257 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:13:51.279 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:13:51.281 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:13:51.288 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:13:51.289 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:13:52.813 INFO:teuthology.orchestra.run.smithi062.stdout:generic/194 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:13:52.893 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/194 2023-06-09T06:13:52.894 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/194 2023-06-09T06:13:52.894 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:13:52.919 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:13:53.149 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:13:53.149 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/195) 2023-06-09T06:13:53.909 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:13:53.933 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:13:53.936 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:13:53.942 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:13:53.942 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:13:55.450 INFO:teuthology.orchestra.run.smithi062.stdout:generic/195 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:13:55.567 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/195 2023-06-09T06:13:55.567 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/195 2023-06-09T06:13:55.567 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:13:55.682 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:13:55.811 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:13:55.812 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/196) 2023-06-09T06:13:56.566 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:13:56.588 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:13:56.591 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:13:56.596 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:13:56.597 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:13:58.312 INFO:teuthology.orchestra.run.smithi062.stdout:generic/196 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:13:58.353 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/196 2023-06-09T06:13:58.354 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/196 2023-06-09T06:13:58.354 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:13:58.411 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:13:58.549 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:13:58.549 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/197) 2023-06-09T06:13:59.300 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:13:59.320 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:13:59.322 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:13:59.327 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:13:59.328 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:14:00.794 INFO:teuthology.orchestra.run.smithi062.stdout:generic/197 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:14:00.836 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/197 2023-06-09T06:14:00.837 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/197 2023-06-09T06:14:00.837 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:14:00.906 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:14:01.250 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:14:01.251 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/198) 2023-06-09T06:14:02.013 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:14:02.034 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:14:02.037 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:14:02.043 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:14:02.043 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:14:04.111 INFO:teuthology.orchestra.run.smithi062.stdout:generic/198 2s 2023-06-09T06:14:04.138 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/198 2023-06-09T06:14:04.138 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:14:04.152 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:14:04.614 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:14:04.615 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/199) 2023-06-09T06:14:05.468 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:14:05.490 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:14:05.493 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:14:05.498 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:14:05.499 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:14:06.654 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:14:06.659 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:14:07.175 INFO:teuthology.orchestra.run.smithi062.stdout:generic/199 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:14:07.231 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/199 2023-06-09T06:14:07.231 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/199 2023-06-09T06:14:07.231 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:14:07.246 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:14:07.392 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:14:07.393 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/200) 2023-06-09T06:14:08.074 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:14:08.097 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:14:08.101 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:14:08.107 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:14:08.107 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:14:09.704 INFO:teuthology.orchestra.run.smithi062.stdout:generic/200 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:14:09.725 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/200 2023-06-09T06:14:09.725 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/200 2023-06-09T06:14:09.726 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:14:09.745 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:14:09.929 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:14:09.929 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/201) 2023-06-09T06:14:10.649 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:14:10.672 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:14:10.675 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:14:10.681 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:14:10.681 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:14:12.183 INFO:teuthology.orchestra.run.smithi062.stdout:generic/201 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:14:12.359 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/201 2023-06-09T06:14:12.360 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/201 2023-06-09T06:14:12.361 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:14:12.450 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:14:12.664 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:14:12.664 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/202) 2023-06-09T06:14:13.436 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:14:13.456 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:14:13.458 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:14:13.463 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:14:13.463 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:14:15.105 INFO:teuthology.orchestra.run.smithi062.stdout:generic/202 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:14:15.186 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/202 2023-06-09T06:14:15.187 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/202 2023-06-09T06:14:15.188 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:14:15.223 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:14:15.353 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:14:15.354 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/203) 2023-06-09T06:14:16.107 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:14:16.131 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:14:16.134 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:14:16.139 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:14:16.140 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:14:17.710 INFO:teuthology.orchestra.run.smithi062.stdout:generic/203 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:14:17.823 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/203 2023-06-09T06:14:17.823 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/203 2023-06-09T06:14:17.823 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:14:17.844 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:14:18.008 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:14:18.009 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/204) 2023-06-09T06:14:18.772 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:14:18.793 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:14:18.796 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:14:18.802 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:14:18.802 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:14:20.522 INFO:teuthology.orchestra.run.smithi062.stdout:generic/204 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-09T06:14:20.540 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/204 2023-06-09T06:14:20.540 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/204 2023-06-09T06:14:20.540 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:14:20.552 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:14:20.666 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:14:20.666 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/205) 2023-06-09T06:14:21.432 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:14:21.454 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:14:21.457 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:14:21.462 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:14:21.462 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:14:22.890 INFO:teuthology.orchestra.run.smithi062.stdout:generic/205 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:14:22.918 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/205 2023-06-09T06:14:22.918 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/205 2023-06-09T06:14:22.918 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:14:22.931 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:14:23.293 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:14:23.293 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/206) 2023-06-09T06:14:24.030 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:14:24.053 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:14:24.056 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:14:24.062 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:14:24.062 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:14:25.600 INFO:teuthology.orchestra.run.smithi062.stdout:generic/206 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:14:25.741 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/206 2023-06-09T06:14:25.741 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/206 2023-06-09T06:14:25.741 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:14:25.782 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:14:26.024 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:14:26.024 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/207) 2023-06-09T06:14:26.775 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:14:26.800 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:14:26.803 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:14:26.809 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:14:26.809 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:14:36.734 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:14:36.740 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:14:38.326 INFO:teuthology.orchestra.run.smithi062.stdout:generic/207 11s 2023-06-09T06:14:38.353 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/207 2023-06-09T06:14:38.354 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:14:38.364 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:14:38.689 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:14:38.689 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/208) 2023-06-09T06:14:39.544 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:14:39.566 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:14:39.569 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:14:39.575 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:14:39.575 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:15:06.884 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:15:06.890 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:15:37.580 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:15:37.584 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:16:07.652 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:16:07.664 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:16:37.754 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:16:37.761 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:17:07.874 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:17:07.879 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:17:38.023 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:17:38.028 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:18:00.852 INFO:teuthology.orchestra.run.smithi062.stdout:generic/208 201s 2023-06-09T06:18:00.881 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/208 2023-06-09T06:18:00.881 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:18:00.895 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:18:01.279 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:18:01.279 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/209) 2023-06-09T06:18:02.100 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:18:02.122 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:18:02.124 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:18:02.131 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:18:02.131 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:18:08.248 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:18:08.256 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:18:35.929 INFO:teuthology.orchestra.run.smithi062.stdout:generic/209 33s 2023-06-09T06:18:35.961 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/209 2023-06-09T06:18:35.962 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:18:35.975 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:18:36.174 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:18:36.175 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/210) 2023-06-09T06:18:37.151 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:18:37.174 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:18:37.177 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:18:37.182 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:18:37.182 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:18:38.326 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:18:38.333 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:18:38.486 INFO:teuthology.orchestra.run.smithi062.stdout:generic/210 1s 2023-06-09T06:18:38.513 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/210 2023-06-09T06:18:38.513 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:18:38.526 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:18:38.878 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:18:38.879 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/211) 2023-06-09T06:18:39.680 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:18:39.702 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:18:39.706 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:18:39.711 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:18:39.711 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:18:41.497 INFO:teuthology.orchestra.run.smithi062.stdout:generic/211 1s 2023-06-09T06:18:41.523 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/211 2023-06-09T06:18:41.523 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:18:41.533 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:18:41.644 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:18:41.645 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/212) 2023-06-09T06:18:42.434 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:18:42.457 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:18:42.460 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:18:42.465 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:18:42.465 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:18:43.656 INFO:teuthology.orchestra.run.smithi062.stdout:generic/212 1s 2023-06-09T06:18:43.686 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/212 2023-06-09T06:18:43.686 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:18:43.699 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:18:43.818 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:18:43.818 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/213) 2023-06-09T06:18:44.547 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:18:44.568 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:18:44.571 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:18:44.577 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:18:44.578 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:18:45.633 INFO:teuthology.orchestra.run.smithi062.stdout:generic/213 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T06:18:45.654 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/213 2023-06-09T06:18:45.654 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/213 2023-06-09T06:18:45.655 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:18:45.670 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:18:45.773 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:18:45.773 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/214) 2023-06-09T06:18:46.539 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:18:46.561 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:18:46.564 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:18:46.570 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:18:46.570 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:18:47.581 INFO:teuthology.orchestra.run.smithi062.stdout:generic/214 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T06:18:47.606 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/214 2023-06-09T06:18:47.606 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/214 2023-06-09T06:18:47.606 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:18:47.619 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:18:47.713 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:18:47.713 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/215) 2023-06-09T06:18:48.472 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:18:48.497 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:18:48.500 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:18:48.505 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:18:48.506 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:18:51.686 INFO:teuthology.orchestra.run.smithi062.stdout:generic/215 3s 2023-06-09T06:18:51.710 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/215 2023-06-09T06:18:51.710 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:18:51.725 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:18:51.852 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:18:51.852 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/216) 2023-06-09T06:18:52.630 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:18:52.655 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:18:52.659 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:18:52.664 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:18:52.665 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:18:54.294 INFO:teuthology.orchestra.run.smithi062.stdout:generic/216 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:18:54.335 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/216 2023-06-09T06:18:54.336 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/216 2023-06-09T06:18:54.336 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:18:54.365 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:18:54.482 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:18:54.483 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/217) 2023-06-09T06:18:55.199 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:18:55.223 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:18:55.226 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:18:55.232 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:18:55.232 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:18:56.988 INFO:teuthology.orchestra.run.smithi062.stdout:generic/217 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:18:57.010 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/217 2023-06-09T06:18:57.011 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/217 2023-06-09T06:18:57.011 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:18:57.043 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:18:57.152 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:18:57.153 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/218) 2023-06-09T06:18:57.881 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:18:57.902 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:18:57.906 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:18:57.913 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:18:57.913 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:18:59.575 INFO:teuthology.orchestra.run.smithi062.stdout:generic/218 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:18:59.607 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/218 2023-06-09T06:18:59.608 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/218 2023-06-09T06:18:59.608 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:18:59.627 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:18:59.766 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:18:59.767 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/219) 2023-06-09T06:19:00.478 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:19:00.501 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:19:00.504 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:19:00.510 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:19:00.510 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:19:01.500 INFO:teuthology.orchestra.run.smithi062.stdout:generic/219 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-09T06:19:01.523 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/219 2023-06-09T06:19:01.523 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/219 2023-06-09T06:19:01.523 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:19:01.536 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:19:01.637 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:19:01.638 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/220) 2023-06-09T06:19:02.402 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:19:02.425 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:19:02.428 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:19:02.434 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:19:02.434 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:19:04.096 INFO:teuthology.orchestra.run.smithi062.stdout:generic/220 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:19:04.166 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/220 2023-06-09T06:19:04.166 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/220 2023-06-09T06:19:04.166 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:19:04.178 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:19:04.314 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:19:04.314 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/221) 2023-06-09T06:19:05.072 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:19:05.096 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:19:05.098 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:19:05.104 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:19:05.105 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:19:07.382 INFO:teuthology.orchestra.run.smithi062.stdout:generic/221 2s 2023-06-09T06:19:07.409 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/221 2023-06-09T06:19:07.410 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:19:07.423 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:19:07.527 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:19:07.528 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/222) 2023-06-09T06:19:08.313 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:19:08.336 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:19:08.339 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:19:08.345 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:19:08.345 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:19:09.383 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:19:09.393 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:19:09.909 INFO:teuthology.orchestra.run.smithi062.stdout:generic/222 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:19:10.038 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/222 2023-06-09T06:19:10.038 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/222 2023-06-09T06:19:10.038 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:19:10.062 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:19:10.223 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:19:10.223 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/223) 2023-06-09T06:19:10.972 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:19:10.995 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:19:10.998 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:19:11.004 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:19:11.005 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:19:12.017 INFO:teuthology.orchestra.run.smithi062.stdout:generic/223 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T06:19:12.036 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/223 2023-06-09T06:19:12.036 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/223 2023-06-09T06:19:12.037 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:19:12.048 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:19:12.152 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:19:12.153 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/224) 2023-06-09T06:19:12.912 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:19:12.932 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:19:12.935 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:19:12.940 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:19:12.941 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:19:13.916 INFO:teuthology.orchestra.run.smithi062.stdout:generic/224 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-09T06:19:13.938 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/224 2023-06-09T06:19:13.939 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/224 2023-06-09T06:19:13.939 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:19:13.953 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:19:14.047 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:19:14.048 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/225) 2023-06-09T06:19:14.792 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:19:14.815 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:19:14.818 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:19:14.825 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:19:14.825 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:19:15.914 INFO:teuthology.orchestra.run.smithi062.stdout:generic/225 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-06-09T06:19:15.934 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/225 2023-06-09T06:19:15.935 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/225 2023-06-09T06:19:15.935 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:19:15.948 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:19:16.232 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:19:16.233 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/226) 2023-06-09T06:19:17.140 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:19:17.163 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:19:17.166 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:19:17.173 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:19:17.173 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:19:18.252 INFO:teuthology.orchestra.run.smithi062.stdout:generic/226 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-09T06:19:18.274 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/226 2023-06-09T06:19:18.274 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/226 2023-06-09T06:19:18.274 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:19:18.286 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:19:18.405 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:19:18.405 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/227) 2023-06-09T06:19:19.180 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:19:19.202 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:19:19.205 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:19:19.211 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:19:19.211 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:19:20.717 INFO:teuthology.orchestra.run.smithi062.stdout:generic/227 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:19:20.833 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/227 2023-06-09T06:19:20.834 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/227 2023-06-09T06:19:20.834 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:19:20.891 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:19:21.068 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:19:21.069 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/228) 2023-06-09T06:19:21.826 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:19:21.850 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:19:21.853 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:19:21.859 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:19:21.859 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:19:22.917 INFO:teuthology.orchestra.run.smithi062.stdout:generic/228 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T06:19:22.937 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/228 2023-06-09T06:19:22.937 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/228 2023-06-09T06:19:22.937 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:19:22.951 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:19:23.065 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:19:23.065 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/229) 2023-06-09T06:19:23.836 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:19:23.861 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:19:23.864 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:19:23.870 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:19:23.870 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:19:25.505 INFO:teuthology.orchestra.run.smithi062.stdout:generic/229 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:19:25.534 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/229 2023-06-09T06:19:25.535 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/229 2023-06-09T06:19:25.535 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:19:25.629 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:19:25.748 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:19:25.748 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/230) 2023-06-09T06:19:26.500 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:19:26.521 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:19:26.524 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:19:26.530 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:19:26.530 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:19:27.523 INFO:teuthology.orchestra.run.smithi062.stdout:generic/230 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-09T06:19:27.542 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/230 2023-06-09T06:19:27.542 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/230 2023-06-09T06:19:27.542 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:19:27.556 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:19:27.657 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:19:27.658 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/231) 2023-06-09T06:19:28.432 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:19:28.455 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:19:28.457 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:19:28.462 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:19:28.463 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:19:29.412 INFO:teuthology.orchestra.run.smithi062.stdout:generic/231 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-09T06:19:29.430 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/231 2023-06-09T06:19:29.431 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/231 2023-06-09T06:19:29.431 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:19:29.445 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:19:29.556 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:19:29.557 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/232) 2023-06-09T06:19:30.323 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:19:30.343 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:19:30.346 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:19:30.353 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:19:30.354 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:19:31.320 INFO:teuthology.orchestra.run.smithi062.stdout:generic/232 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-09T06:19:31.342 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/232 2023-06-09T06:19:31.343 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/232 2023-06-09T06:19:31.343 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:19:31.356 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:19:31.460 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:19:31.461 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/233) 2023-06-09T06:19:32.222 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:19:32.245 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:19:32.247 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:19:32.253 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:19:32.254 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:19:33.216 INFO:teuthology.orchestra.run.smithi062.stdout:generic/233 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-09T06:19:33.237 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/233 2023-06-09T06:19:33.237 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/233 2023-06-09T06:19:33.237 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:19:33.249 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:19:33.341 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:19:33.341 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/234) 2023-06-09T06:19:34.104 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:19:34.126 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:19:34.129 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:19:34.134 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:19:34.134 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:19:35.129 INFO:teuthology.orchestra.run.smithi062.stdout:generic/234 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-09T06:19:35.146 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/234 2023-06-09T06:19:35.147 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/234 2023-06-09T06:19:35.147 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:19:35.160 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:19:35.246 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:19:35.246 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/235) 2023-06-09T06:19:36.015 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:19:36.037 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:19:36.040 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:19:36.045 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:19:36.045 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:19:37.021 INFO:teuthology.orchestra.run.smithi062.stdout:generic/235 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-09T06:19:37.044 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/235 2023-06-09T06:19:37.044 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/235 2023-06-09T06:19:37.045 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:19:37.057 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:19:37.148 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:19:37.148 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/236) 2023-06-09T06:19:37.845 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:19:37.867 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:19:37.869 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:19:37.874 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:19:37.875 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:19:39.463 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:19:39.470 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:19:40.080 INFO:teuthology.orchestra.run.smithi062.stdout:generic/236 2s 2023-06-09T06:19:40.106 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/236 2023-06-09T06:19:40.106 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:19:40.119 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:19:40.629 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:19:40.629 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/237) 2023-06-09T06:19:41.378 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:19:41.402 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:19:41.405 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:19:41.410 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:19:41.410 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:19:42.672 INFO:teuthology.orchestra.run.smithi062.stdout:generic/237 1s 2023-06-09T06:19:42.699 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/237 2023-06-09T06:19:42.699 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:19:42.714 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:19:43.225 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:19:43.226 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/238) 2023-06-09T06:19:43.973 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:19:43.994 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:19:43.998 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:19:44.004 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:19:44.004 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:19:45.561 INFO:teuthology.orchestra.run.smithi062.stdout:generic/238 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:19:45.736 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/238 2023-06-09T06:19:45.736 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/238 2023-06-09T06:19:45.736 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:19:45.762 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:19:45.931 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:19:45.931 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/239) 2023-06-09T06:19:46.675 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:19:46.699 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:19:46.701 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:19:46.707 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:19:46.707 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:20:09.626 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:20:09.632 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:20:39.775 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:20:39.780 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:21:09.926 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:21:09.936 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:21:41.030 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:21:41.035 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:22:03.409 INFO:teuthology.orchestra.run.smithi062.stdout:generic/239 136s 2023-06-09T06:22:03.435 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/239 2023-06-09T06:22:03.435 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:22:03.446 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:22:03.823 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:22:03.823 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/240) 2023-06-09T06:22:04.572 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:22:04.595 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:22:04.598 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:22:04.603 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:22:04.603 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:22:06.354 INFO:teuthology.orchestra.run.smithi062.stdout:generic/240 2s 2023-06-09T06:22:06.380 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/240 2023-06-09T06:22:06.381 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:22:06.394 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:22:06.813 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:22:06.813 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/241) 2023-06-09T06:22:07.586 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:22:07.607 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:22:07.610 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:22:07.616 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:22:07.616 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:22:12.796 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:22:12.800 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:22:43.025 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:22:43.032 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:23:13.096 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:23:13.102 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:23:22.846 INFO:teuthology.orchestra.run.smithi062.stdout:generic/241 75s 2023-06-09T06:23:22.872 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/241 2023-06-09T06:23:22.872 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:23:22.881 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:23:23.804 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:23:23.805 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/242) 2023-06-09T06:23:24.949 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:23:24.983 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:23:24.987 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:23:24.992 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:23:24.992 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:23:26.553 INFO:teuthology.orchestra.run.smithi062.stdout:generic/242 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:23:26.573 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/242 2023-06-09T06:23:26.573 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/242 2023-06-09T06:23:26.573 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:23:26.657 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:23:26.801 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:23:26.802 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/243) 2023-06-09T06:23:27.459 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:23:27.476 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:23:27.479 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:23:27.484 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:23:27.484 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:23:29.414 INFO:teuthology.orchestra.run.smithi062.stdout:generic/243 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:23:29.671 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/243 2023-06-09T06:23:29.672 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/243 2023-06-09T06:23:29.672 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:23:29.683 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:23:29.775 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:23:29.775 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/244) 2023-06-09T06:23:30.416 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:23:30.434 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:23:30.437 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:23:30.441 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:23:30.442 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:23:32.305 INFO:teuthology.orchestra.run.smithi062.stdout:generic/244 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-09T06:23:32.325 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/244 2023-06-09T06:23:32.326 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/244 2023-06-09T06:23:32.326 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:23:32.341 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:23:32.433 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:23:32.433 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/245) 2023-06-09T06:23:33.209 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:23:33.229 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:23:33.232 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:23:33.238 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:23:33.238 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:23:34.385 INFO:teuthology.orchestra.run.smithi062.stdout:generic/245 1s 2023-06-09T06:23:34.410 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/245 2023-06-09T06:23:34.411 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:23:34.422 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:23:34.742 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:23:34.742 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/246) 2023-06-09T06:23:35.614 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:23:35.638 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:23:35.640 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:23:35.645 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:23:35.646 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:23:36.734 INFO:teuthology.orchestra.run.smithi062.stdout:generic/246 0s 2023-06-09T06:23:36.762 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/246 2023-06-09T06:23:36.762 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:23:36.776 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:23:37.104 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:23:37.105 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/247) 2023-06-09T06:23:37.936 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:23:37.958 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:23:37.961 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:23:37.966 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:23:37.966 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:23:43.245 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:23:43.249 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:23:51.458 INFO:teuthology.orchestra.run.smithi062.stdout:generic/247 13s 2023-06-09T06:23:51.486 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/247 2023-06-09T06:23:51.486 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:23:51.497 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:23:51.537 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:23:51.538 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/248) 2023-06-09T06:23:52.327 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:23:52.348 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:23:52.351 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:23:52.356 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:23:52.357 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:23:53.430 INFO:teuthology.orchestra.run.smithi062.stdout:generic/248 1s 2023-06-09T06:23:53.462 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/248 2023-06-09T06:23:53.462 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:23:53.476 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:23:53.589 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:23:53.589 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/249) 2023-06-09T06:23:54.356 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:23:54.378 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:23:54.380 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:23:54.386 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:23:54.386 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:23:55.792 INFO:teuthology.orchestra.run.smithi062.stdout:generic/249 1s 2023-06-09T06:23:55.819 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/249 2023-06-09T06:23:55.820 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:23:55.835 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:23:56.288 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:23:56.289 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/250) 2023-06-09T06:23:57.075 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:23:57.097 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:23:57.100 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:23:57.106 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:23:57.106 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:23:58.149 INFO:teuthology.orchestra.run.smithi062.stdout:generic/250 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-06-09T06:23:58.171 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/250 2023-06-09T06:23:58.171 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/250 2023-06-09T06:23:58.171 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:23:58.184 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:23:58.280 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:23:58.281 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/251) 2023-06-09T06:23:59.035 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:23:59.058 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:23:59.061 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:23:59.067 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:23:59.067 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:24:00.336 INFO:teuthology.orchestra.run.smithi062.stdout:generic/251 [not run] FITRIM not supported on /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:24:00.402 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/251 2023-06-09T06:24:00.403 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/251 2023-06-09T06:24:00.403 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:24:00.417 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:24:00.519 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:24:00.520 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/252) 2023-06-09T06:24:01.289 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:24:01.310 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:24:01.314 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:24:01.320 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:24:01.320 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:24:02.315 INFO:teuthology.orchestra.run.smithi062.stdout:generic/252 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-06-09T06:24:02.338 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/252 2023-06-09T06:24:02.338 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/252 2023-06-09T06:24:02.338 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:24:02.352 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:24:02.433 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:24:02.433 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/253) 2023-06-09T06:24:03.210 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:24:03.232 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:24:03.235 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:24:03.240 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:24:03.240 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:24:04.829 INFO:teuthology.orchestra.run.smithi062.stdout:generic/253 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:24:04.973 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/253 2023-06-09T06:24:04.973 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/253 2023-06-09T06:24:04.973 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:24:04.992 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:24:05.107 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:24:05.107 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/254) 2023-06-09T06:24:05.821 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:24:05.843 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:24:05.846 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:24:05.852 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:24:05.853 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:24:07.389 INFO:teuthology.orchestra.run.smithi062.stdout:generic/254 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:24:07.420 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/254 2023-06-09T06:24:07.420 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/254 2023-06-09T06:24:07.420 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:24:07.453 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:24:07.683 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:24:07.683 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/255) 2023-06-09T06:24:08.408 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:24:08.429 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:24:08.432 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:24:08.438 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:24:08.438 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:24:09.670 INFO:teuthology.orchestra.run.smithi062.stdout:generic/255 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T06:24:09.690 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/255 2023-06-09T06:24:09.690 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/255 2023-06-09T06:24:09.690 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:24:09.703 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:24:09.905 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:24:09.905 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/256) 2023-06-09T06:24:10.876 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:24:10.899 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:24:10.902 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:24:10.907 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:24:10.907 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:24:12.921 INFO:teuthology.orchestra.run.smithi062.stdout:generic/256 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-09T06:24:12.944 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/256 2023-06-09T06:24:12.944 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/256 2023-06-09T06:24:12.944 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:24:12.958 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:24:13.058 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:24:13.059 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/257) 2023-06-09T06:24:13.351 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:24:13.358 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:24:13.789 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:24:13.811 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:24:13.814 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:24:13.820 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:24:13.820 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:24:15.873 INFO:teuthology.orchestra.run.smithi062.stdout:generic/257 1s 2023-06-09T06:24:15.898 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/257 2023-06-09T06:24:15.898 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:24:15.910 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:24:16.381 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:24:16.381 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/258) 2023-06-09T06:24:17.155 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:24:17.177 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:24:17.180 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:24:17.185 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:24:17.186 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:24:18.165 INFO:teuthology.orchestra.run.smithi062.stdout:generic/258 [not run] ceph does not support negative timestamps 2023-06-09T06:24:18.182 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/258 2023-06-09T06:24:18.183 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/258 2023-06-09T06:24:18.183 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:24:18.194 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:24:18.282 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:24:18.282 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/259) 2023-06-09T06:24:19.049 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:24:19.073 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:24:19.076 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:24:19.081 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:24:19.081 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:24:20.671 INFO:teuthology.orchestra.run.smithi062.stdout:generic/259 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:24:20.791 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/259 2023-06-09T06:24:20.792 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/259 2023-06-09T06:24:20.792 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:24:20.834 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:24:20.900 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:24:20.901 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/260) 2023-06-09T06:24:21.653 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:24:21.677 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:24:21.680 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:24:21.687 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:24:21.687 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:24:22.958 INFO:teuthology.orchestra.run.smithi062.stdout:generic/260 [not run] FITRIM not supported on /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:24:23.044 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/260 2023-06-09T06:24:23.044 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/260 2023-06-09T06:24:23.044 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:24:23.057 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:24:23.141 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:24:23.142 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/261) 2023-06-09T06:24:23.895 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:24:23.919 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:24:23.921 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:24:23.927 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:24:23.927 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:24:25.529 INFO:teuthology.orchestra.run.smithi062.stdout:generic/261 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:24:25.630 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/261 2023-06-09T06:24:25.631 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/261 2023-06-09T06:24:25.631 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:24:25.683 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:24:25.802 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:24:25.802 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/262) 2023-06-09T06:24:26.585 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:24:26.607 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:24:26.610 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:24:26.615 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:24:26.615 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:24:28.247 INFO:teuthology.orchestra.run.smithi062.stdout:generic/262 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:24:28.419 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/262 2023-06-09T06:24:28.419 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/262 2023-06-09T06:24:28.419 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:24:28.470 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:24:28.559 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:24:28.560 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/263) 2023-06-09T06:24:29.316 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:24:29.340 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:24:29.343 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:24:29.351 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:24:29.351 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:24:43.474 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:24:43.478 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:25:14.227 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:25:14.232 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:25:14.283 INFO:tasks.ceph.osd.6.smithi089.stderr:2023-06-09T06:25:14.275+0000 7f683358f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43335) UID: 0 2023-06-09T06:25:14.283 INFO:tasks.ceph.osd.7.smithi089.stderr:2023-06-09T06:25:14.275+0000 7ff7cd1d9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43335) UID: 0 2023-06-09T06:25:14.284 INFO:tasks.ceph.osd.4.smithi089.stderr:2023-06-09T06:25:14.275+0000 7f3af9fd2700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43335) UID: 0 2023-06-09T06:25:14.284 INFO:tasks.ceph.osd.5.smithi089.stderr:2023-06-09T06:25:14.275+0000 7fa2fe1bb700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43335) UID: 0 2023-06-09T06:25:43.706 INFO:teuthology.orchestra.run.smithi062.stdout:generic/263 74s 2023-06-09T06:25:43.735 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/263 2023-06-09T06:25:43.736 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:25:43.749 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:25:44.081 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:25:44.081 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/264) 2023-06-09T06:25:44.966 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:25:44.991 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:25:44.993 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:25:45.000 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:25:45.001 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:25:46.578 INFO:teuthology.orchestra.run.smithi062.stdout:generic/264 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:25:46.641 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/264 2023-06-09T06:25:46.641 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/264 2023-06-09T06:25:46.641 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:25:46.658 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:25:46.787 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:25:46.788 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/265) 2023-06-09T06:25:47.528 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:25:47.551 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:25:47.553 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:25:47.559 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:25:47.560 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:25:49.120 INFO:teuthology.orchestra.run.smithi062.stdout:generic/265 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:25:49.236 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/265 2023-06-09T06:25:49.237 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/265 2023-06-09T06:25:49.237 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:25:49.272 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:25:49.410 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:25:49.410 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/266) 2023-06-09T06:25:50.114 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:25:50.134 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:25:50.136 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:25:50.141 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:25:50.142 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:25:51.763 INFO:teuthology.orchestra.run.smithi062.stdout:generic/266 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:25:51.811 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/266 2023-06-09T06:25:51.811 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/266 2023-06-09T06:25:51.812 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:25:51.900 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:25:52.034 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:25:52.034 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/267) 2023-06-09T06:25:52.801 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:25:52.823 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:25:52.827 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:25:52.833 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:25:52.834 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:25:54.368 INFO:teuthology.orchestra.run.smithi062.stdout:generic/267 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:25:54.533 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/267 2023-06-09T06:25:54.533 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/267 2023-06-09T06:25:54.534 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:25:54.549 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:25:54.677 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:25:54.678 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/268) 2023-06-09T06:25:55.411 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:25:55.433 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:25:55.436 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:25:55.441 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:25:55.441 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:25:57.076 INFO:teuthology.orchestra.run.smithi062.stdout:generic/268 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:25:57.127 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/268 2023-06-09T06:25:57.127 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/268 2023-06-09T06:25:57.128 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:25:57.152 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:25:57.306 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:25:57.307 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/269) 2023-06-09T06:25:57.997 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:25:58.014 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:25:58.017 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:25:58.023 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:25:58.023 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:25:58.971 INFO:teuthology.orchestra.run.smithi062.stdout:generic/269 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-09T06:25:58.993 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/269 2023-06-09T06:25:58.994 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/269 2023-06-09T06:25:58.994 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:25:59.008 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:25:59.095 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:25:59.095 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/270) 2023-06-09T06:25:59.852 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:25:59.875 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:25:59.877 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:25:59.884 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:25:59.884 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:26:00.840 INFO:teuthology.orchestra.run.smithi062.stdout:generic/270 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-09T06:26:00.863 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/270 2023-06-09T06:26:00.864 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/270 2023-06-09T06:26:00.864 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:26:00.876 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:26:00.968 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:26:00.968 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/271) 2023-06-09T06:26:01.733 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:26:01.756 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:26:01.759 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:26:01.765 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:26:01.765 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:26:03.254 INFO:teuthology.orchestra.run.smithi062.stdout:generic/271 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:26:03.283 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/271 2023-06-09T06:26:03.283 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/271 2023-06-09T06:26:03.283 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:26:03.361 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:26:03.529 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:26:03.530 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/272) 2023-06-09T06:26:04.264 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:26:04.286 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:26:04.289 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:26:04.295 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:26:04.295 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:26:05.860 INFO:teuthology.orchestra.run.smithi062.stdout:generic/272 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:26:05.911 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/272 2023-06-09T06:26:05.911 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/272 2023-06-09T06:26:05.912 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:26:05.990 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:26:06.111 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:26:06.112 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/273) 2023-06-09T06:26:06.840 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:26:06.859 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:26:06.862 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:26:06.868 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:26:06.868 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:26:07.845 INFO:teuthology.orchestra.run.smithi062.stdout:generic/273 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-09T06:26:07.864 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/273 2023-06-09T06:26:07.865 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/273 2023-06-09T06:26:07.865 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:26:07.881 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:26:07.968 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:26:07.969 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/274) 2023-06-09T06:26:08.718 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:26:08.737 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:26:08.741 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:26:08.746 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:26:08.746 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:26:09.698 INFO:teuthology.orchestra.run.smithi062.stdout:generic/274 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-06-09T06:26:09.721 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/274 2023-06-09T06:26:09.721 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/274 2023-06-09T06:26:09.721 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:26:09.736 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:26:09.844 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:26:09.845 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/275) 2023-06-09T06:26:10.590 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:26:10.612 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:26:10.615 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:26:10.620 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:26:10.620 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:26:11.594 INFO:teuthology.orchestra.run.smithi062.stdout:generic/275 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-09T06:26:11.614 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/275 2023-06-09T06:26:11.615 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/275 2023-06-09T06:26:11.615 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:26:11.629 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:26:11.726 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:26:11.727 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/276) 2023-06-09T06:26:12.489 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:26:12.511 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:26:12.514 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:26:12.519 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:26:12.520 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:26:14.157 INFO:teuthology.orchestra.run.smithi062.stdout:generic/276 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:26:14.239 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/276 2023-06-09T06:26:14.239 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/276 2023-06-09T06:26:14.239 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:26:14.255 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:26:14.365 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:26:14.366 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/277) 2023-06-09T06:26:15.094 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:26:15.118 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:26:15.121 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:26:15.128 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:26:15.128 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:26:16.189 INFO:teuthology.orchestra.run.smithi062.stdout:generic/277 [not run] file system doesn't support chattr +A 2023-06-09T06:26:16.211 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/277 2023-06-09T06:26:16.211 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/277 2023-06-09T06:26:16.212 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:26:16.226 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:26:16.344 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:26:16.344 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/278) 2023-06-09T06:26:17.102 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:26:17.123 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:26:17.126 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:26:17.131 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:26:17.132 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:26:18.646 INFO:teuthology.orchestra.run.smithi062.stdout:generic/278 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:26:18.664 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/278 2023-06-09T06:26:18.665 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/278 2023-06-09T06:26:18.666 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:26:18.706 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:26:18.878 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:26:18.878 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/279) 2023-06-09T06:26:19.637 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:26:19.658 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:26:19.662 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:26:19.668 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:26:19.668 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:26:21.320 INFO:teuthology.orchestra.run.smithi062.stdout:generic/279 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:26:21.356 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/279 2023-06-09T06:26:21.356 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/279 2023-06-09T06:26:21.356 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:26:21.394 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:26:21.485 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:26:21.486 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/280) 2023-06-09T06:26:22.235 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:26:22.261 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:26:22.264 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:26:22.270 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:26:22.270 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:26:23.289 INFO:teuthology.orchestra.run.smithi062.stdout:generic/280 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-09T06:26:23.311 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/280 2023-06-09T06:26:23.312 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/280 2023-06-09T06:26:23.312 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:26:23.329 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:26:23.432 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:26:23.432 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/281) 2023-06-09T06:26:24.160 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:26:24.182 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:26:24.185 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:26:24.191 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:26:24.191 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:26:25.665 INFO:teuthology.orchestra.run.smithi062.stdout:generic/281 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:26:25.776 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/281 2023-06-09T06:26:25.776 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/281 2023-06-09T06:26:25.776 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:26:25.819 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:26:25.962 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:26:25.962 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/282) 2023-06-09T06:26:26.693 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:26:26.717 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:26:26.719 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:26:26.725 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:26:26.726 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:26:28.262 INFO:teuthology.orchestra.run.smithi062.stdout:generic/282 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:26:28.336 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/282 2023-06-09T06:26:28.336 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/282 2023-06-09T06:26:28.336 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:26:28.373 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:26:28.524 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:26:28.524 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/283) 2023-06-09T06:26:29.264 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:26:29.290 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:26:29.293 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:26:29.298 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:26:29.298 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:26:30.896 INFO:teuthology.orchestra.run.smithi062.stdout:generic/283 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:26:31.003 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/283 2023-06-09T06:26:31.003 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/283 2023-06-09T06:26:31.003 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:26:31.066 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:26:31.168 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:26:31.169 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/284) 2023-06-09T06:26:31.908 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:26:31.932 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:26:31.935 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:26:31.941 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:26:31.942 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:26:33.445 INFO:teuthology.orchestra.run.smithi062.stdout:generic/284 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:26:33.634 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/284 2023-06-09T06:26:33.634 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/284 2023-06-09T06:26:33.635 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:26:33.670 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:26:33.770 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:26:33.771 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/285) 2023-06-09T06:26:34.493 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:26:34.515 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:26:34.518 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:26:34.524 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:26:34.524 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:26:37.202 INFO:teuthology.orchestra.run.smithi062.stdout:generic/285 3s 2023-06-09T06:26:37.233 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/285 2023-06-09T06:26:37.233 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:26:37.245 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:26:38.077 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:26:38.078 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/286) 2023-06-09T06:26:38.820 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:26:38.840 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:26:38.842 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:26:38.845 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:26:38.846 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:26:39.701 INFO:teuthology.orchestra.run.smithi062.stdout:generic/286 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T06:26:39.718 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/286 2023-06-09T06:26:39.718 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/286 2023-06-09T06:26:39.718 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:26:39.728 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:26:39.825 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:26:39.826 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/287) 2023-06-09T06:26:40.530 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:26:40.549 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:26:40.551 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:26:40.556 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:26:40.556 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:26:41.941 INFO:teuthology.orchestra.run.smithi062.stdout:generic/287 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:26:42.052 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/287 2023-06-09T06:26:42.052 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/287 2023-06-09T06:26:42.053 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:26:42.069 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:26:42.274 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:26:42.275 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/288) 2023-06-09T06:26:43.001 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:26:43.016 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:26:43.019 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:26:43.023 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:26:43.023 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:26:44.105 INFO:teuthology.orchestra.run.smithi062.stdout:generic/288 [not run] FITRIM not supported on /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:26:44.182 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/288 2023-06-09T06:26:44.182 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/288 2023-06-09T06:26:44.182 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:26:44.197 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:26:44.286 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:26:44.287 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/289) 2023-06-09T06:26:45.035 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:26:45.057 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:26:45.061 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:26:45.067 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:26:45.068 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:26:46.549 INFO:teuthology.orchestra.run.smithi062.stdout:generic/289 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:26:46.714 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/289 2023-06-09T06:26:46.714 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/289 2023-06-09T06:26:46.714 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:26:46.727 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:26:46.888 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:26:46.889 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/290) 2023-06-09T06:26:47.626 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:26:47.647 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:26:47.650 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:26:47.657 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:26:47.658 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:26:49.207 INFO:teuthology.orchestra.run.smithi062.stdout:generic/290 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:26:49.283 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/290 2023-06-09T06:26:49.284 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/290 2023-06-09T06:26:49.284 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:26:49.328 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:26:49.443 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:26:49.443 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/291) 2023-06-09T06:26:50.156 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:26:50.178 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:26:50.181 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:26:50.185 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:26:50.186 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:26:51.757 INFO:teuthology.orchestra.run.smithi062.stdout:generic/291 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:26:51.851 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/291 2023-06-09T06:26:51.851 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/291 2023-06-09T06:26:51.852 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:26:51.875 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:26:51.999 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:26:52.000 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/292) 2023-06-09T06:26:52.715 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:26:52.739 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:26:52.742 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:26:52.747 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:26:52.748 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:26:54.251 INFO:teuthology.orchestra.run.smithi062.stdout:generic/292 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:26:54.404 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/292 2023-06-09T06:26:54.404 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/292 2023-06-09T06:26:54.405 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:26:54.422 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:26:54.561 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:26:54.562 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/293) 2023-06-09T06:26:55.302 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:26:55.324 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:26:55.328 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:26:55.334 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:26:55.334 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:26:56.921 INFO:teuthology.orchestra.run.smithi062.stdout:generic/293 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:26:56.997 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/293 2023-06-09T06:26:56.998 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/293 2023-06-09T06:26:56.998 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:26:57.009 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:26:57.145 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:26:57.145 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/294) 2023-06-09T06:26:57.876 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:26:57.899 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:26:57.901 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:26:57.907 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:26:57.907 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:26:59.843 INFO:teuthology.orchestra.run.smithi062.stdout:generic/294 1s 2023-06-09T06:26:59.911 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/294 2023-06-09T06:26:59.911 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:26:59.931 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:26:59.960 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:26:59.961 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/295) 2023-06-09T06:27:00.693 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:27:00.715 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:27:00.719 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:27:00.724 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:27:00.725 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:27:02.253 INFO:teuthology.orchestra.run.smithi062.stdout:generic/295 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:27:02.406 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/295 2023-06-09T06:27:02.406 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/295 2023-06-09T06:27:02.406 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:27:02.499 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:27:02.589 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:27:02.589 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/296) 2023-06-09T06:27:03.264 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:27:03.285 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:27:03.287 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:27:03.293 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:27:03.293 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:27:04.836 INFO:teuthology.orchestra.run.smithi062.stdout:generic/296 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:27:04.966 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/296 2023-06-09T06:27:04.968 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/296 2023-06-09T06:27:04.968 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:27:05.022 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:27:05.143 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:27:05.144 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/297) 2023-06-09T06:27:05.876 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:27:05.898 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:27:05.900 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:27:05.906 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:27:05.906 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:27:07.352 INFO:teuthology.orchestra.run.smithi062.stdout:generic/297 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:27:07.426 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/297 2023-06-09T06:27:07.427 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/297 2023-06-09T06:27:07.427 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:27:07.551 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:27:07.678 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:27:07.679 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/298) 2023-06-09T06:27:08.412 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:27:08.435 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:27:08.438 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:27:08.445 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:27:08.445 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:27:09.973 INFO:teuthology.orchestra.run.smithi062.stdout:generic/298 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:27:10.064 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/298 2023-06-09T06:27:10.064 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/298 2023-06-09T06:27:10.064 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:27:10.130 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:27:10.272 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:27:10.272 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/299) 2023-06-09T06:27:10.997 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:27:11.021 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:27:11.024 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:27:11.030 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:27:11.030 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:27:12.174 INFO:teuthology.orchestra.run.smithi062.stdout:generic/299 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-06-09T06:27:12.192 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/299 2023-06-09T06:27:12.193 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/299 2023-06-09T06:27:12.193 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:27:12.205 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:27:12.293 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:27:12.294 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/300) 2023-06-09T06:27:13.046 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:27:13.070 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:27:13.074 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:27:13.079 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:27:13.080 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:27:14.193 INFO:teuthology.orchestra.run.smithi062.stdout:generic/300 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-06-09T06:27:14.214 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/300 2023-06-09T06:27:14.214 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/300 2023-06-09T06:27:14.214 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:27:14.227 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:27:14.316 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:27:14.316 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/301) 2023-06-09T06:27:15.070 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:27:15.093 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:27:15.096 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:27:15.101 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:27:15.101 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:27:16.600 INFO:teuthology.orchestra.run.smithi062.stdout:generic/301 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:27:16.810 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/301 2023-06-09T06:27:16.810 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/301 2023-06-09T06:27:16.810 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:27:16.834 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:27:16.948 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:27:16.948 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/302) 2023-06-09T06:27:17.696 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:27:17.719 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:27:17.724 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:27:17.729 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:27:17.729 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:27:19.296 INFO:teuthology.orchestra.run.smithi062.stdout:generic/302 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:27:19.395 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/302 2023-06-09T06:27:19.395 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/302 2023-06-09T06:27:19.396 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:27:19.467 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:27:19.594 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:27:19.594 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/303) 2023-06-09T06:27:20.328 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:27:20.351 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:27:20.355 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:27:20.360 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:27:20.360 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:27:21.451 INFO:teuthology.orchestra.run.smithi062.stdout:generic/303 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T06:27:21.470 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/303 2023-06-09T06:27:21.471 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/303 2023-06-09T06:27:21.471 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:27:21.485 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:27:21.685 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:27:21.686 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/304) 2023-06-09T06:27:22.680 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:27:22.705 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:27:22.708 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:27:22.713 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:27:22.714 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:27:23.788 INFO:teuthology.orchestra.run.smithi062.stdout:generic/304 [not run] Dedupe not supported by test filesystem type: ceph 2023-06-09T06:27:23.808 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/304 2023-06-09T06:27:23.808 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/304 2023-06-09T06:27:23.808 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:27:23.821 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:27:24.304 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:27:24.305 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/305) 2023-06-09T06:27:25.051 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:27:25.075 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:27:25.078 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:27:25.084 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:27:25.085 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:27:26.631 INFO:teuthology.orchestra.run.smithi062.stdout:generic/305 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:27:26.713 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/305 2023-06-09T06:27:26.713 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/305 2023-06-09T06:27:26.713 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:27:26.772 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:27:26.905 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:27:26.905 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/306) 2023-06-09T06:27:27.660 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:27:27.683 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:27:27.686 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:27:27.692 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:27:27.692 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:27:29.735 INFO:teuthology.orchestra.run.smithi062.stdout:generic/306 1s 2023-06-09T06:27:29.767 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/306 2023-06-09T06:27:29.767 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:27:29.775 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:27:30.132 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:27:30.133 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/307) 2023-06-09T06:27:30.873 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:27:30.895 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:27:30.898 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:27:30.904 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:27:30.904 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:27:33.753 INFO:teuthology.orchestra.run.smithi062.stdout:generic/307 2s 2023-06-09T06:27:33.779 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/307 2023-06-09T06:27:33.779 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:27:33.793 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:27:33.833 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:27:33.833 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/308) 2023-06-09T06:27:34.552 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:27:34.569 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:27:34.571 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:27:34.577 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:27:34.577 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:27:35.641 INFO:teuthology.orchestra.run.smithi062.stdout:generic/308 1s 2023-06-09T06:27:35.676 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/308 2023-06-09T06:27:35.676 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:27:35.688 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:27:35.802 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:27:35.803 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/309) 2023-06-09T06:27:36.580 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:27:36.602 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:27:36.605 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:27:36.610 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:27:36.610 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:27:38.730 INFO:teuthology.orchestra.run.smithi062.stdout:generic/309 2s 2023-06-09T06:27:38.755 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/309 2023-06-09T06:27:38.755 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:27:38.767 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:27:39.115 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:27:39.115 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/310) 2023-06-09T06:27:39.944 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:27:39.968 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:27:39.971 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:27:39.977 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:27:39.978 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:27:55.922 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:27:55.927 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:27:55.968 INFO:tasks.ceph.osd.2.smithi062.stderr:2023-06-09T06:27:55.959+0000 7f9e3696d700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 265876) UID: 0 2023-06-09T06:27:55.969 INFO:tasks.ceph.osd.3.smithi062.stderr:2023-06-09T06:27:55.959+0000 7fb4af5ce700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 265876) UID: 0 2023-06-09T06:27:55.969 INFO:tasks.ceph.osd.0.smithi062.stderr:2023-06-09T06:27:55.959+0000 7fa052e46700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 265876) UID: 0 2023-06-09T06:27:55.969 INFO:tasks.ceph.osd.1.smithi062.stderr:2023-06-09T06:27:55.959+0000 7f51ef5ce700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 265876) UID: 0 2023-06-09T06:29:09.621 INFO:teuthology.orchestra.run.smithi062.stdout:generic/310 89s 2023-06-09T06:29:09.654 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/310 2023-06-09T06:29:09.654 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:29:09.665 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:29:10.127 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:29:10.128 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/311) 2023-06-09T06:29:11.046 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:29:11.065 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:29:11.068 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:29:11.074 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:29:11.074 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:29:12.077 INFO:teuthology.orchestra.run.smithi062.stdout:generic/311 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-06-09T06:29:12.095 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/311 2023-06-09T06:29:12.095 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/311 2023-06-09T06:29:12.095 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:29:12.107 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:29:12.214 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:29:12.215 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/312) 2023-06-09T06:29:12.928 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:29:12.946 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:29:12.949 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:29:12.954 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:29:12.954 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:29:13.835 INFO:teuthology.orchestra.run.smithi062.stdout:generic/312 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T06:29:13.849 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/312 2023-06-09T06:29:13.850 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/312 2023-06-09T06:29:13.850 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:29:13.861 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:29:13.958 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:29:13.958 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/313) 2023-06-09T06:29:14.595 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:29:14.612 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:29:14.614 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:29:14.619 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:29:14.619 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:29:19.598 INFO:teuthology.orchestra.run.smithi062.stdout:generic/313 5s 2023-06-09T06:29:19.621 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/313 2023-06-09T06:29:19.622 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:29:19.633 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:29:19.732 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:29:19.732 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/314) 2023-06-09T06:29:20.406 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:29:20.426 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:29:20.429 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:29:20.434 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:29:20.434 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:29:22.198 INFO:teuthology.orchestra.run.smithi062.stdout:generic/314 2s 2023-06-09T06:29:22.273 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/314 2023-06-09T06:29:22.273 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:29:22.285 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:29:22.379 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:29:22.379 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/315) 2023-06-09T06:29:24.440 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:29:24.458 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:29:24.461 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:29:24.467 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:29:24.467 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:29:25.461 INFO:teuthology.orchestra.run.smithi062.stdout:generic/315 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-06-09T06:29:25.484 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/315 2023-06-09T06:29:25.484 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/315 2023-06-09T06:29:25.484 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:29:25.495 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:29:25.588 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:29:25.588 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/316) 2023-06-09T06:29:26.284 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:29:26.302 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:29:26.304 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:29:26.309 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:29:26.310 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:29:27.686 INFO:teuthology.orchestra.run.smithi062.stdout:generic/316 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-06-09T06:29:27.703 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/316 2023-06-09T06:29:27.703 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/316 2023-06-09T06:29:27.704 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:29:27.717 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:29:27.918 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:29:27.918 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/317) 2023-06-09T06:29:28.871 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:29:28.891 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:29:28.894 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:29:28.899 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:29:28.900 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:29:31.130 INFO:teuthology.orchestra.run.smithi062.stdout:generic/317 2s 2023-06-09T06:29:31.156 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/317 2023-06-09T06:29:31.157 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:29:31.172 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:29:31.205 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:29:31.206 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/318) 2023-06-09T06:29:31.897 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:29:31.918 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:29:31.920 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:29:31.926 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:29:31.926 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:29:34.097 INFO:teuthology.orchestra.run.smithi062.stdout:generic/318 2s 2023-06-09T06:29:34.123 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/318 2023-06-09T06:29:34.123 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:29:34.130 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:29:34.164 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:29:34.164 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/319) 2023-06-09T06:29:34.823 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:29:34.842 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:29:34.844 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:29:34.848 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:29:34.849 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:29:36.213 INFO:teuthology.orchestra.run.smithi062.stdout:generic/319 1s 2023-06-09T06:29:36.235 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/319 2023-06-09T06:29:36.236 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:29:36.248 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:29:36.284 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:29:36.285 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/320) 2023-06-09T06:29:36.947 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:29:36.969 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:29:36.972 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:29:36.977 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:29:36.978 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:29:37.852 INFO:teuthology.orchestra.run.smithi062.stdout:generic/320 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-09T06:29:37.870 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/320 2023-06-09T06:29:37.871 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/320 2023-06-09T06:29:37.871 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:29:37.881 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:29:37.953 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:29:37.954 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/321) 2023-06-09T06:29:38.638 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:29:38.658 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:29:38.660 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:29:38.663 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:29:38.663 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:29:39.575 INFO:teuthology.orchestra.run.smithi062.stdout:generic/321 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-06-09T06:29:39.597 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/321 2023-06-09T06:29:39.597 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/321 2023-06-09T06:29:39.598 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:29:39.613 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:29:39.700 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:29:39.701 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/322) 2023-06-09T06:29:40.392 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:29:40.411 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:29:40.413 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:29:40.420 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:29:40.420 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:29:41.317 INFO:teuthology.orchestra.run.smithi062.stdout:generic/322 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-06-09T06:29:41.337 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/322 2023-06-09T06:29:41.337 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/322 2023-06-09T06:29:41.338 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:29:41.349 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:29:41.453 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:29:41.453 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/323) 2023-06-09T06:29:42.156 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:29:42.175 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:29:42.177 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:29:42.182 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:29:42.183 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:31:05.583 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:31:05.589 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:31:05.642 INFO:tasks.ceph.osd.6.smithi089.stderr:2023-06-09T06:31:05.635+0000 7f683358f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43423) UID: 0 2023-06-09T06:31:05.642 INFO:tasks.ceph.osd.7.smithi089.stderr:2023-06-09T06:31:05.635+0000 7ff7cd1d9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43423) UID: 0 2023-06-09T06:31:05.643 INFO:tasks.ceph.osd.4.smithi089.stderr:2023-06-09T06:31:05.635+0000 7f3af9fd2700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43423) UID: 0 2023-06-09T06:31:05.643 INFO:tasks.ceph.osd.5.smithi089.stderr:2023-06-09T06:31:05.635+0000 7fa2fe1bb700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43423) UID: 0 2023-06-09T06:31:44.087 INFO:teuthology.orchestra.run.smithi062.stdout:generic/323 122s 2023-06-09T06:31:44.113 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/323 2023-06-09T06:31:44.113 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:31:44.125 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:31:44.499 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:31:44.500 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/324) 2023-06-09T06:31:45.342 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:31:45.364 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:31:45.367 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:31:45.373 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:31:45.373 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:31:46.346 INFO:teuthology.orchestra.run.smithi062.stdout:generic/324 [not run] defragmentation not supported for fstype "ceph" 2023-06-09T06:31:46.363 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/324 2023-06-09T06:31:46.363 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/324 2023-06-09T06:31:46.364 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:31:46.375 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:31:46.450 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:31:46.451 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/325) 2023-06-09T06:31:47.209 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:31:47.231 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:31:47.234 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:31:47.240 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:31:47.240 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:31:48.276 INFO:teuthology.orchestra.run.smithi062.stdout:generic/325 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-06-09T06:31:48.297 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/325 2023-06-09T06:31:48.298 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/325 2023-06-09T06:31:48.298 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:31:48.309 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:31:48.386 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:31:48.386 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/326) 2023-06-09T06:31:49.125 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:31:49.147 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:31:49.151 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:31:49.157 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:31:49.157 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:31:50.772 INFO:teuthology.orchestra.run.smithi062.stdout:generic/326 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:31:50.804 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/326 2023-06-09T06:31:50.804 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/326 2023-06-09T06:31:50.805 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:31:50.818 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:31:51.217 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:31:51.218 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/327) 2023-06-09T06:31:51.928 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:31:51.949 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:31:51.952 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:31:51.958 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:31:51.958 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:31:53.504 INFO:teuthology.orchestra.run.smithi062.stdout:generic/327 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:31:53.679 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/327 2023-06-09T06:31:53.679 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/327 2023-06-09T06:31:53.679 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:31:53.737 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:31:53.848 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:31:53.848 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/328) 2023-06-09T06:31:54.645 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:31:54.667 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:31:54.670 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:31:54.676 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:31:54.676 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:31:56.268 INFO:teuthology.orchestra.run.smithi062.stdout:generic/328 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:31:56.314 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/328 2023-06-09T06:31:56.314 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/328 2023-06-09T06:31:56.315 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:31:56.352 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:31:56.647 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:31:56.648 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/329) 2023-06-09T06:31:57.431 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:31:57.456 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:31:57.460 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:31:57.465 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:31:57.466 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:31:59.138 INFO:teuthology.orchestra.run.smithi062.stdout:generic/329 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:31:59.303 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/329 2023-06-09T06:31:59.303 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/329 2023-06-09T06:31:59.304 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:31:59.316 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:31:59.431 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:31:59.431 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/330) 2023-06-09T06:32:00.164 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:32:00.187 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:32:00.190 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:32:00.195 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:32:00.195 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:32:01.866 INFO:teuthology.orchestra.run.smithi062.stdout:generic/330 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:32:01.969 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/330 2023-06-09T06:32:01.979 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/330 2023-06-09T06:32:01.980 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:32:02.012 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:32:02.150 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:32:02.150 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/331) 2023-06-09T06:32:02.900 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:32:02.925 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:32:02.927 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:32:02.934 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:32:02.934 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:32:04.502 INFO:teuthology.orchestra.run.smithi062.stdout:generic/331 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:32:04.602 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/331 2023-06-09T06:32:04.602 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/331 2023-06-09T06:32:04.603 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:32:04.654 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:32:04.838 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:32:04.838 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/332) 2023-06-09T06:32:05.610 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:32:05.635 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:32:05.639 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:32:05.645 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:32:05.645 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:32:07.321 INFO:teuthology.orchestra.run.smithi062.stdout:generic/332 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:32:07.401 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/332 2023-06-09T06:32:07.402 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/332 2023-06-09T06:32:07.402 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:32:07.453 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:32:07.547 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:32:07.547 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/333) 2023-06-09T06:32:08.288 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:32:08.310 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:32:08.313 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:32:08.318 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:32:08.318 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:32:10.120 INFO:teuthology.orchestra.run.smithi062.stdout:generic/333 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:32:10.147 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/333 2023-06-09T06:32:10.148 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/333 2023-06-09T06:32:10.148 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:32:10.162 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:32:10.229 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:32:10.230 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/334) 2023-06-09T06:32:10.992 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:32:11.014 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:32:11.017 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:32:11.023 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:32:11.023 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:32:12.654 INFO:teuthology.orchestra.run.smithi062.stdout:generic/334 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:32:12.726 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/334 2023-06-09T06:32:12.726 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/334 2023-06-09T06:32:12.726 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:32:12.784 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:32:12.927 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:32:12.927 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/335) 2023-06-09T06:32:13.678 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:32:13.699 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:32:13.702 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:32:13.707 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:32:13.708 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:32:14.704 INFO:teuthology.orchestra.run.smithi062.stdout:generic/335 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-06-09T06:32:14.725 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/335 2023-06-09T06:32:14.725 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/335 2023-06-09T06:32:14.725 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:32:14.740 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:32:14.853 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:32:14.853 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/336) 2023-06-09T06:32:15.609 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:32:15.631 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:32:15.633 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:32:15.639 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:32:15.639 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:32:16.697 INFO:teuthology.orchestra.run.smithi062.stdout:generic/336 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-06-09T06:32:16.719 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/336 2023-06-09T06:32:16.719 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/336 2023-06-09T06:32:16.719 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:32:16.730 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:32:16.831 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:32:16.831 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/337) 2023-06-09T06:32:17.594 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:32:17.615 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:32:17.618 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:32:17.623 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:32:17.624 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:32:19.247 INFO:teuthology.orchestra.run.smithi062.stdout:generic/337 1s 2023-06-09T06:32:19.272 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/337 2023-06-09T06:32:19.273 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:32:19.285 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:32:19.326 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:32:19.326 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/338) 2023-06-09T06:32:20.108 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:32:20.129 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:32:20.133 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:32:20.138 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:32:20.138 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:32:21.169 INFO:teuthology.orchestra.run.smithi062.stdout:generic/338 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-06-09T06:32:21.190 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/338 2023-06-09T06:32:21.190 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/338 2023-06-09T06:32:21.190 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:32:21.205 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:32:21.311 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:32:21.311 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/339) 2023-06-09T06:32:22.074 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:32:22.093 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:32:22.096 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:32:22.100 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:32:22.100 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:33:34.022 INFO:teuthology.orchestra.run.smithi062.stdout:generic/339 71s 2023-06-09T06:33:34.049 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/339 2023-06-09T06:33:34.049 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:33:34.062 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:33:34.100 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:33:34.101 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/340) 2023-06-09T06:33:34.897 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:33:34.920 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:33:34.924 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:33:34.929 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:33:34.930 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:33:43.508 INFO:teuthology.orchestra.run.smithi062.stdout:generic/340 6s 2023-06-09T06:33:43.762 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/340 2023-06-09T06:33:43.762 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:33:43.774 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:33:43.819 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:33:43.820 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/341) 2023-06-09T06:33:44.585 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:33:44.606 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:33:44.610 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:33:44.616 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:33:44.616 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:33:45.640 INFO:teuthology.orchestra.run.smithi062.stdout:generic/341 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-06-09T06:33:45.661 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/341 2023-06-09T06:33:45.661 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/341 2023-06-09T06:33:45.662 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:33:45.675 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:33:45.772 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:33:45.773 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/342) 2023-06-09T06:33:46.538 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:33:46.561 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:33:46.564 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:33:46.570 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:33:46.571 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:33:47.580 INFO:teuthology.orchestra.run.smithi062.stdout:generic/342 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-06-09T06:33:47.601 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/342 2023-06-09T06:33:47.601 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/342 2023-06-09T06:33:47.601 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:33:47.614 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:33:47.715 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:33:47.716 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/343) 2023-06-09T06:33:48.468 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:33:48.490 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:33:48.493 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:33:48.499 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:33:48.499 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:33:49.581 INFO:teuthology.orchestra.run.smithi062.stdout:generic/343 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-06-09T06:33:49.600 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/343 2023-06-09T06:33:49.600 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/343 2023-06-09T06:33:49.601 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:33:49.613 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:33:49.717 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:33:49.717 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/344) 2023-06-09T06:33:50.437 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:33:50.459 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:33:50.462 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:33:50.468 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:33:50.469 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:34:02.023 INFO:teuthology.orchestra.run.smithi062.stdout:generic/344 11s 2023-06-09T06:34:02.051 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/344 2023-06-09T06:34:02.051 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:34:02.064 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:34:02.091 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:34:02.091 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/345) 2023-06-09T06:34:02.856 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:34:02.873 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:34:02.875 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:34:02.879 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:34:02.879 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:34:15.539 INFO:teuthology.orchestra.run.smithi062.stdout:generic/345 12s 2023-06-09T06:34:15.572 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/345 2023-06-09T06:34:15.573 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:34:15.585 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:34:15.634 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:34:15.635 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/346) 2023-06-09T06:34:16.366 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:34:16.388 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:34:16.392 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:34:16.398 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:34:16.398 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:34:19.640 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:34:19.645 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:34:22.562 INFO:teuthology.orchestra.run.smithi062.stdout:generic/346 6s 2023-06-09T06:34:22.599 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/346 2023-06-09T06:34:22.600 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:34:22.613 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:34:22.660 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:34:22.661 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/347) 2023-06-09T06:34:23.369 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:34:23.389 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:34:23.391 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:34:23.397 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:34:23.397 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:34:24.485 INFO:teuthology.orchestra.run.smithi062.stdout:generic/347 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-06-09T06:34:24.508 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/347 2023-06-09T06:34:24.509 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/347 2023-06-09T06:34:24.509 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:34:24.522 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:34:24.609 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:34:24.609 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/348) 2023-06-09T06:34:25.351 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:34:25.376 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:34:25.378 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:34:25.384 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:34:25.384 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:34:26.427 INFO:teuthology.orchestra.run.smithi062.stdout:generic/348 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-06-09T06:34:26.450 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/348 2023-06-09T06:34:26.451 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/348 2023-06-09T06:34:26.451 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:34:26.463 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:34:26.563 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:34:26.564 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/349) 2023-06-09T06:34:27.312 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:34:27.335 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:34:27.338 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:34:27.344 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:34:27.344 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:34:28.572 INFO:teuthology.orchestra.run.smithi062.stdout:generic/349 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-06-09T06:34:28.593 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/349 2023-06-09T06:34:28.593 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/349 2023-06-09T06:34:28.593 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:34:28.604 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:34:28.715 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:34:28.715 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/350) 2023-06-09T06:34:29.480 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:34:29.503 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:34:29.507 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:34:29.513 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:34:29.513 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:34:31.909 INFO:teuthology.orchestra.run.smithi062.stdout:generic/350 2s 2023-06-09T06:34:31.934 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/350 2023-06-09T06:34:31.934 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:34:31.948 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:34:31.986 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:34:31.986 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/351) 2023-06-09T06:34:32.747 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:34:32.769 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:34:32.772 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:34:32.778 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:34:32.779 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:34:33.776 INFO:teuthology.orchestra.run.smithi062.stdout:generic/351 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T06:34:33.796 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/351 2023-06-09T06:34:33.796 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/351 2023-06-09T06:34:33.796 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:34:33.808 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:34:33.923 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:34:33.923 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/352) 2023-06-09T06:34:34.676 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:34:34.702 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:34:34.705 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:34:34.711 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:34:34.711 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:34:36.293 INFO:teuthology.orchestra.run.smithi062.stdout:generic/352 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:34:36.351 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/352 2023-06-09T06:34:36.351 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/352 2023-06-09T06:34:36.351 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:34:36.415 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:34:36.563 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:34:36.564 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/353) 2023-06-09T06:34:37.252 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:34:37.274 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:34:37.277 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:34:37.282 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:34:37.283 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:34:38.860 INFO:teuthology.orchestra.run.smithi062.stdout:generic/353 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:34:39.015 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/353 2023-06-09T06:34:39.016 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/353 2023-06-09T06:34:39.016 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:34:39.036 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:34:39.143 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:34:39.143 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/354) 2023-06-09T06:34:39.851 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:34:39.874 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:34:39.876 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:34:39.882 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:34:39.882 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:34:49.860 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:34:49.865 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:34:51.888 INFO:teuthology.orchestra.run.smithi062.stdout:generic/354 11s 2023-06-09T06:34:51.939 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/354 2023-06-09T06:34:51.939 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:34:51.950 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:34:51.978 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:34:51.979 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/355) 2023-06-09T06:34:52.727 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:34:52.751 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:34:52.758 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:34:52.763 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:34:52.764 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:34:54.836 INFO:teuthology.orchestra.run.smithi062.stdout:generic/355 1s 2023-06-09T06:34:54.862 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/355 2023-06-09T06:34:54.862 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:34:54.875 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:34:55.162 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:34:55.163 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/356) 2023-06-09T06:34:56.113 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:34:56.138 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:34:56.140 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:34:56.145 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:34:56.146 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:34:57.626 INFO:teuthology.orchestra.run.smithi062.stdout:generic/356 [not run] swapfiles are not supported 2023-06-09T06:34:57.646 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/356 2023-06-09T06:34:57.646 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/356 2023-06-09T06:34:57.646 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:34:57.661 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:34:57.765 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:34:57.766 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/357) 2023-06-09T06:34:58.505 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:34:58.526 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:34:58.530 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:34:58.535 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:34:58.535 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:34:59.928 INFO:teuthology.orchestra.run.smithi062.stdout:generic/357 [not run] swapfiles are not supported 2023-06-09T06:34:59.949 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/357 2023-06-09T06:34:59.950 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/357 2023-06-09T06:34:59.950 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:34:59.963 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:35:00.062 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:35:00.062 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/358) 2023-06-09T06:35:00.824 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:35:00.847 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:35:00.850 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:35:00.856 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:35:00.857 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:35:02.499 INFO:teuthology.orchestra.run.smithi062.stdout:generic/358 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:35:02.679 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/358 2023-06-09T06:35:02.680 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/358 2023-06-09T06:35:02.680 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:35:02.714 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:35:02.804 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:35:02.804 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/359) 2023-06-09T06:35:03.557 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:35:03.579 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:35:03.583 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:35:03.589 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:35:03.590 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:35:05.076 INFO:teuthology.orchestra.run.smithi062.stdout:generic/359 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:35:05.287 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/359 2023-06-09T06:35:05.288 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/359 2023-06-09T06:35:05.288 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:35:05.321 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:35:05.443 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:35:05.443 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/360) 2023-06-09T06:35:06.167 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:35:06.192 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:35:06.195 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:35:06.201 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:35:06.201 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:35:07.328 INFO:teuthology.orchestra.run.smithi062.stdout:generic/360 1s 2023-06-09T06:35:07.358 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/360 2023-06-09T06:35:07.358 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:35:07.369 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:35:07.464 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:35:07.465 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/361) 2023-06-09T06:35:08.198 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:35:08.221 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:35:08.224 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:35:08.231 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:35:08.231 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:35:09.273 INFO:teuthology.orchestra.run.smithi062.stdout:generic/361 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-06-09T06:35:09.293 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/361 2023-06-09T06:35:09.294 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/361 2023-06-09T06:35:09.294 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:35:09.308 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:35:09.400 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:35:09.401 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/362) 2023-06-09T06:35:10.164 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:35:10.189 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:35:10.192 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:35:10.197 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:35:10.197 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:35:11.157 INFO:teuthology.orchestra.run.smithi062.stdout:generic/362 [not run] this test requires richacl support on $SCRATCH_DEV 2023-06-09T06:35:11.178 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/362 2023-06-09T06:35:11.179 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/362 2023-06-09T06:35:11.179 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:35:11.191 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:35:11.287 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:35:11.287 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/363) 2023-06-09T06:35:12.046 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:35:12.070 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:35:12.073 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:35:12.079 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:35:12.079 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:35:13.049 INFO:teuthology.orchestra.run.smithi062.stdout:generic/363 [not run] this test requires richacl support on $SCRATCH_DEV 2023-06-09T06:35:13.069 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/363 2023-06-09T06:35:13.070 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/363 2023-06-09T06:35:13.070 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:35:13.081 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:35:13.172 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:35:13.172 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/364) 2023-06-09T06:35:13.936 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:35:13.957 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:35:13.960 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:35:13.967 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:35:13.968 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:35:14.952 INFO:teuthology.orchestra.run.smithi062.stdout:generic/364 [not run] this test requires richacl support on $SCRATCH_DEV 2023-06-09T06:35:14.972 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/364 2023-06-09T06:35:14.972 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/364 2023-06-09T06:35:14.972 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:35:14.985 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:35:15.072 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:35:15.073 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/365) 2023-06-09T06:35:15.829 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:35:15.853 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:35:15.857 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:35:15.861 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:35:15.862 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:35:16.836 INFO:teuthology.orchestra.run.smithi062.stdout:generic/365 [not run] this test requires richacl support on $SCRATCH_DEV 2023-06-09T06:35:16.858 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/365 2023-06-09T06:35:16.858 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/365 2023-06-09T06:35:16.859 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:35:16.870 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:35:16.971 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:35:16.971 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/366) 2023-06-09T06:35:17.723 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:35:17.744 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:35:17.747 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:35:17.753 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:35:17.753 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:35:18.687 INFO:teuthology.orchestra.run.smithi062.stdout:generic/366 [not run] this test requires richacl support on $SCRATCH_DEV 2023-06-09T06:35:18.712 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/366 2023-06-09T06:35:18.712 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/366 2023-06-09T06:35:18.712 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:35:18.726 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:35:18.817 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:35:18.818 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/367) 2023-06-09T06:35:19.579 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:35:19.603 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:35:19.606 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:35:19.611 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:35:19.611 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:35:20.024 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:35:20.031 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:35:20.558 INFO:teuthology.orchestra.run.smithi062.stdout:generic/367 [not run] this test requires richacl support on $SCRATCH_DEV 2023-06-09T06:35:20.579 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/367 2023-06-09T06:35:20.579 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/367 2023-06-09T06:35:20.579 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:35:20.592 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:35:20.675 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:35:20.675 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/368) 2023-06-09T06:35:21.449 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:35:21.471 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:35:21.475 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:35:21.481 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:35:21.482 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:35:22.442 INFO:teuthology.orchestra.run.smithi062.stdout:generic/368 [not run] this test requires richacl support on $SCRATCH_DEV 2023-06-09T06:35:22.466 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/368 2023-06-09T06:35:22.466 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/368 2023-06-09T06:35:22.467 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:35:22.481 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:35:22.571 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:35:22.571 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/369) 2023-06-09T06:35:23.330 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:35:23.354 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:35:23.357 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:35:23.364 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:35:23.364 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:35:24.300 INFO:teuthology.orchestra.run.smithi062.stdout:generic/369 [not run] this test requires richacl support on $SCRATCH_DEV 2023-06-09T06:35:24.320 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/369 2023-06-09T06:35:24.320 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/369 2023-06-09T06:35:24.320 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:35:24.331 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:35:24.433 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:35:24.434 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/370) 2023-06-09T06:35:25.204 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:35:25.225 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:35:25.228 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:35:25.235 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:35:25.235 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:35:26.192 INFO:teuthology.orchestra.run.smithi062.stdout:generic/370 [not run] this test requires richacl support on $SCRATCH_DEV 2023-06-09T06:35:26.213 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/370 2023-06-09T06:35:26.213 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/370 2023-06-09T06:35:26.213 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:35:26.228 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:35:26.318 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:35:26.318 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/371) 2023-06-09T06:35:27.088 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:35:27.111 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:35:27.114 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:35:27.121 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:35:27.121 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:35:28.150 INFO:teuthology.orchestra.run.smithi062.stdout:generic/371 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T06:35:28.169 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/371 2023-06-09T06:35:28.170 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/371 2023-06-09T06:35:28.170 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:35:28.184 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:35:28.282 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:35:28.282 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/372) 2023-06-09T06:35:29.028 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:35:29.050 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:35:29.053 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:35:29.058 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:35:29.058 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:35:30.619 INFO:teuthology.orchestra.run.smithi062.stdout:generic/372 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:35:30.690 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/372 2023-06-09T06:35:30.690 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/372 2023-06-09T06:35:30.690 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:35:30.722 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:35:30.871 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:35:30.872 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/373) 2023-06-09T06:35:31.611 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:35:31.632 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:35:31.636 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:35:31.641 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:35:31.641 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:35:33.192 INFO:teuthology.orchestra.run.smithi062.stdout:generic/373 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:35:33.345 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/373 2023-06-09T06:35:33.347 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/373 2023-06-09T06:35:33.347 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:35:33.368 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:35:33.484 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:35:33.485 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/374) 2023-06-09T06:35:34.243 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:35:34.267 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:35:34.270 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:35:34.275 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:35:34.276 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:35:35.589 INFO:teuthology.orchestra.run.smithi062.stdout:generic/374 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-06-09T06:35:35.736 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/374 2023-06-09T06:35:35.737 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/374 2023-06-09T06:35:35.737 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:35:35.915 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:35:36.153 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:35:36.153 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/375) 2023-06-09T06:35:36.911 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:35:36.932 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:35:36.935 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:35:36.942 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:35:36.942 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:35:38.243 INFO:teuthology.orchestra.run.smithi062.stdout:generic/375 1s 2023-06-09T06:35:38.271 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/375 2023-06-09T06:35:38.271 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:35:38.284 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:35:38.672 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:35:38.673 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/376) 2023-06-09T06:35:39.504 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:35:39.524 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:35:39.528 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:35:39.534 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:35:39.534 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:35:40.550 INFO:teuthology.orchestra.run.smithi062.stdout:generic/376 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-06-09T06:35:40.571 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/376 2023-06-09T06:35:40.571 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/376 2023-06-09T06:35:40.571 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:35:40.586 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:35:40.675 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:35:40.676 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/377) 2023-06-09T06:35:41.415 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:35:41.438 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:35:41.441 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:35:41.447 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:35:41.447 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:35:42.974 INFO:teuthology.orchestra.run.smithi062.stdout:generic/377 1s 2023-06-09T06:35:43.006 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/377 2023-06-09T06:35:43.006 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:35:43.020 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:35:43.065 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:35:43.065 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/378) 2023-06-09T06:35:43.831 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:35:43.852 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:35:43.854 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:35:43.859 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:35:43.860 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:35:45.469 INFO:teuthology.orchestra.run.smithi062.stdout:generic/378 1s 2023-06-09T06:35:45.498 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/378 2023-06-09T06:35:45.499 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:35:45.510 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:35:45.950 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:35:45.950 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/379) 2023-06-09T06:35:46.725 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:35:46.747 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:35:46.751 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:35:46.757 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:35:46.758 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:35:47.753 INFO:teuthology.orchestra.run.smithi062.stdout:generic/379 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-09T06:35:47.771 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/379 2023-06-09T06:35:47.771 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/379 2023-06-09T06:35:47.772 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:35:47.784 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:35:47.869 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:35:47.870 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/380) 2023-06-09T06:35:48.641 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:35:48.662 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:35:48.665 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:35:48.671 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:35:48.672 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:35:49.664 INFO:teuthology.orchestra.run.smithi062.stdout:generic/380 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-09T06:35:49.687 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/380 2023-06-09T06:35:49.687 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/380 2023-06-09T06:35:49.687 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:35:49.699 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:35:49.787 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:35:49.787 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/381) 2023-06-09T06:35:50.190 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:35:50.195 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:35:50.510 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:35:50.533 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:35:50.536 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:35:50.541 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:35:50.541 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:35:51.513 INFO:teuthology.orchestra.run.smithi062.stdout:generic/381 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-09T06:35:51.533 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/381 2023-06-09T06:35:51.533 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/381 2023-06-09T06:35:51.534 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:35:51.548 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:35:51.646 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:35:51.647 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/382) 2023-06-09T06:35:52.410 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:35:52.432 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:35:52.434 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:35:52.439 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:35:52.439 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:35:53.405 INFO:teuthology.orchestra.run.smithi062.stdout:generic/382 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-09T06:35:53.425 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/382 2023-06-09T06:35:53.426 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/382 2023-06-09T06:35:53.426 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:35:53.440 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:35:53.545 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:35:53.545 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/383) 2023-06-09T06:35:54.305 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:35:54.328 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:35:54.331 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:35:54.336 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:35:54.336 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:35:55.468 INFO:teuthology.orchestra.run.smithi062.stdout:generic/383 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-09T06:35:55.483 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/383 2023-06-09T06:35:55.483 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/383 2023-06-09T06:35:55.483 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:35:55.493 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:35:55.588 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:35:55.589 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/384) 2023-06-09T06:35:56.357 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:35:56.381 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:35:56.384 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:35:56.391 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:35:56.392 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:35:57.383 INFO:teuthology.orchestra.run.smithi062.stdout:generic/384 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-09T06:35:57.405 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/384 2023-06-09T06:35:57.405 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/384 2023-06-09T06:35:57.405 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:35:57.418 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:35:57.529 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:35:57.529 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/385) 2023-06-09T06:35:58.309 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:35:58.331 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:35:58.334 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:35:58.339 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:35:58.340 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:35:59.349 INFO:teuthology.orchestra.run.smithi062.stdout:generic/385 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-09T06:35:59.371 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/385 2023-06-09T06:35:59.371 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/385 2023-06-09T06:35:59.371 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:35:59.384 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:35:59.491 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:35:59.492 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/386) 2023-06-09T06:36:00.243 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:36:00.266 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:36:00.268 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:36:00.273 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:36:00.274 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:36:01.179 INFO:teuthology.orchestra.run.smithi062.stdout:generic/386 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-09T06:36:01.201 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/386 2023-06-09T06:36:01.201 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/386 2023-06-09T06:36:01.201 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:36:01.215 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:36:01.310 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:36:01.311 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/387) 2023-06-09T06:36:02.078 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:36:02.101 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:36:02.103 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:36:02.108 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:36:02.108 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:36:03.607 INFO:teuthology.orchestra.run.smithi062.stdout:generic/387 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:36:03.665 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/387 2023-06-09T06:36:03.665 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/387 2023-06-09T06:36:03.665 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:36:03.697 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:36:03.924 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:36:03.924 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/388) 2023-06-09T06:36:04.672 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:36:04.699 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:36:04.702 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:36:04.708 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:36:04.708 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:36:05.719 INFO:teuthology.orchestra.run.smithi062.stdout:generic/388 [not run] require 172.21.15.62:6789:/scratch to be local device 2023-06-09T06:36:05.741 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/388 2023-06-09T06:36:05.742 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/388 2023-06-09T06:36:05.742 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:36:05.753 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:36:05.849 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:36:05.849 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/389) 2023-06-09T06:36:06.625 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:36:06.650 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:36:06.652 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:36:06.659 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:36:06.660 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:36:07.677 INFO:teuthology.orchestra.run.smithi062.stdout:generic/389 [not run] O_TMPFILE is not supported 2023-06-09T06:36:07.697 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/389 2023-06-09T06:36:07.698 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/389 2023-06-09T06:36:07.698 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:36:07.711 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:36:07.808 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:36:07.809 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/390) 2023-06-09T06:36:08.597 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:36:08.619 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:36:08.623 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:36:08.628 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:36:08.628 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:36:09.684 INFO:teuthology.orchestra.run.smithi062.stdout:generic/390 [not run] ceph does not support freezing 2023-06-09T06:36:09.704 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/390 2023-06-09T06:36:09.704 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/390 2023-06-09T06:36:09.704 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:36:09.717 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:36:09.807 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:36:09.808 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/391) 2023-06-09T06:36:10.578 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:36:10.600 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:36:10.604 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:36:10.609 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:36:10.610 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:36:11.618 INFO:teuthology.orchestra.run.smithi062.stdout:generic/391 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T06:36:11.640 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/391 2023-06-09T06:36:11.640 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/391 2023-06-09T06:36:11.640 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:36:11.652 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:36:11.759 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:36:11.759 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/392) 2023-06-09T06:36:12.519 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:36:12.540 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:36:12.544 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:36:12.550 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:36:12.550 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:36:13.823 INFO:teuthology.orchestra.run.smithi062.stdout:generic/392 [not run] ceph does not support shutdown 2023-06-09T06:36:13.902 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/392 2023-06-09T06:36:13.903 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/392 2023-06-09T06:36:13.903 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:36:13.916 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:36:14.015 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:36:14.016 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/393) 2023-06-09T06:36:14.758 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:36:14.780 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:36:14.782 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:36:14.788 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:36:14.788 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:36:17.214 INFO:teuthology.orchestra.run.smithi062.stdout:generic/393 2s 2023-06-09T06:36:17.243 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/393 2023-06-09T06:36:17.244 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:36:17.258 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:36:17.302 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:36:17.303 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/394) 2023-06-09T06:36:18.045 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:36:18.067 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:36:18.070 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:36:18.076 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:36:18.076 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:36:19.142 INFO:teuthology.orchestra.run.smithi062.stdout:generic/394 1s 2023-06-09T06:36:19.167 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/394 2023-06-09T06:36:19.167 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:36:19.180 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:36:19.651 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:36:19.651 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/395) 2023-06-09T06:36:20.327 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:36:20.332 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:36:20.413 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:36:20.431 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:36:20.436 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:36:20.440 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:36:20.440 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:36:23.551 INFO:teuthology.orchestra.run.smithi062.stdout:generic/395 3s 2023-06-09T06:36:23.582 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/395 2023-06-09T06:36:23.583 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:36:23.594 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:36:23.623 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:36:23.623 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/396) 2023-06-09T06:36:24.425 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:36:24.447 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:36:24.450 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:36:24.455 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:36:24.456 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:36:26.573 INFO:teuthology.orchestra.run.smithi062.stdout:generic/396 2s 2023-06-09T06:36:26.602 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/396 2023-06-09T06:36:26.602 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:36:26.617 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:36:26.657 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:36:26.657 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/397) 2023-06-09T06:36:27.441 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:36:27.464 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:36:27.466 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:36:27.471 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:36:27.472 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:36:31.006 INFO:teuthology.orchestra.run.smithi062.stdout:generic/397 3s 2023-06-09T06:36:31.031 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/397 2023-06-09T06:36:31.031 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:36:31.044 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:36:31.085 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:36:31.085 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/398) 2023-06-09T06:36:31.839 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:36:31.863 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:36:31.867 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:36:31.871 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:36:31.872 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:36:33.527 INFO:teuthology.orchestra.run.smithi062.stdout:generic/398 [not run] kernel doesn't support renameat2 syscall 2023-06-09T06:36:33.550 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/398 2023-06-09T06:36:33.550 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/398 2023-06-09T06:36:33.550 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:36:33.565 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:36:33.806 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:36:33.807 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/399) 2023-06-09T06:36:34.747 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:36:34.769 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:36:34.772 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:36:34.778 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:36:34.779 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:36:36.436 INFO:teuthology.orchestra.run.smithi062.stdout:generic/399 [not run] Filesystem ceph not supported in _scratch_mkfs_sized_encrypted 2023-06-09T06:36:36.455 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/399 2023-06-09T06:36:36.456 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/399 2023-06-09T06:36:36.456 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:36:36.469 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:36:36.579 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:36:36.579 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/400) 2023-06-09T06:36:37.346 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:36:37.368 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:36:37.371 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:36:37.377 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:36:37.378 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:36:38.322 INFO:teuthology.orchestra.run.smithi062.stdout:generic/400 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-09T06:36:38.343 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/400 2023-06-09T06:36:38.343 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/400 2023-06-09T06:36:38.343 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:36:38.356 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:36:38.451 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:36:38.452 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/401) 2023-06-09T06:36:39.207 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:36:39.231 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:36:39.234 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:36:39.242 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:36:39.243 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:36:41.230 INFO:teuthology.orchestra.run.smithi062.stdout:generic/401 2s 2023-06-09T06:36:41.254 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/401 2023-06-09T06:36:41.254 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:36:41.266 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:36:41.293 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:36:41.294 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/402) 2023-06-09T06:36:42.041 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:36:42.065 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:36:42.068 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:36:42.074 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:36:42.074 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:36:43.458 INFO:teuthology.orchestra.run.smithi062.stdout:generic/402 [not run] filesystem ceph timestamp bounds are unknown 2023-06-09T06:36:43.539 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/402 2023-06-09T06:36:43.540 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/402 2023-06-09T06:36:43.540 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:36:43.553 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:36:43.651 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:36:43.652 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/403) 2023-06-09T06:36:44.415 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:36:44.436 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:36:44.439 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:36:44.443 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:36:44.444 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:36:46.515 INFO:teuthology.orchestra.run.smithi062.stdout:generic/403 2s 2023-06-09T06:36:46.542 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/403 2023-06-09T06:36:46.542 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:36:46.553 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:36:46.597 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:36:46.598 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/404) 2023-06-09T06:36:47.351 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:36:47.375 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:36:47.379 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:36:47.384 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:36:47.384 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:36:48.394 INFO:teuthology.orchestra.run.smithi062.stdout:generic/404 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T06:36:48.414 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/404 2023-06-09T06:36:48.414 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/404 2023-06-09T06:36:48.414 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:36:48.429 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:36:48.555 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:36:48.556 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/405) 2023-06-09T06:36:49.326 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:36:49.349 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:36:49.352 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:36:49.357 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:36:49.357 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:36:50.397 INFO:teuthology.orchestra.run.smithi062.stdout:generic/405 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-06-09T06:36:50.419 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/405 2023-06-09T06:36:50.420 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/405 2023-06-09T06:36:50.420 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:36:50.433 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:36:50.492 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:36:50.499 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:36:50.527 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:36:50.527 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/406) 2023-06-09T06:36:51.381 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:36:51.404 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:36:51.407 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:36:51.413 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:36:51.414 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:36:55.067 INFO:teuthology.orchestra.run.smithi062.stdout:generic/406 4s 2023-06-09T06:36:55.094 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/406 2023-06-09T06:36:55.095 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:36:55.107 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:36:55.150 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:36:55.151 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/407) 2023-06-09T06:36:55.918 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:36:55.941 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:36:55.944 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:36:55.949 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:36:55.950 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:36:57.048 INFO:teuthology.orchestra.run.smithi062.stdout:generic/407 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T06:36:57.071 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/407 2023-06-09T06:36:57.071 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/407 2023-06-09T06:36:57.071 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:36:57.086 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:36:57.401 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:36:57.402 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/408) 2023-06-09T06:36:58.296 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:36:58.318 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:36:58.321 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:36:58.326 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:36:58.327 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:36:59.440 INFO:teuthology.orchestra.run.smithi062.stdout:generic/408 [not run] Dedupe not supported by test filesystem type: ceph 2023-06-09T06:36:59.461 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/408 2023-06-09T06:36:59.462 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/408 2023-06-09T06:36:59.462 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:36:59.475 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:36:59.921 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:36:59.921 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/409) 2023-06-09T06:37:00.688 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:37:00.709 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:37:00.712 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:37:00.718 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:37:00.718 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:37:01.705 INFO:teuthology.orchestra.run.smithi062.stdout:generic/409 [not run] require 172.21.15.62:6789:/scratch to be local device 2023-06-09T06:37:01.724 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/409 2023-06-09T06:37:01.724 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/409 2023-06-09T06:37:01.725 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:37:01.737 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:37:01.838 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:37:01.838 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/410) 2023-06-09T06:37:02.578 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:37:02.598 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:37:02.601 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:37:02.605 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:37:02.605 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:37:03.575 INFO:teuthology.orchestra.run.smithi062.stdout:generic/410 [not run] require 172.21.15.62:6789:/scratch to be local device 2023-06-09T06:37:03.596 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/410 2023-06-09T06:37:03.597 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/410 2023-06-09T06:37:03.597 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:37:03.610 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:37:03.718 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:37:03.718 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/411) 2023-06-09T06:37:04.483 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:37:04.504 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:37:04.507 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:37:04.513 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:37:04.513 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:37:05.529 INFO:teuthology.orchestra.run.smithi062.stdout:generic/411 [not run] require 172.21.15.62:6789:/scratch to be local device 2023-06-09T06:37:05.549 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/411 2023-06-09T06:37:05.549 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/411 2023-06-09T06:37:05.549 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:37:05.561 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:37:05.657 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:37:05.658 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/412) 2023-06-09T06:37:06.389 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:37:06.415 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:37:06.417 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:37:06.423 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:37:06.424 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:37:08.182 INFO:teuthology.orchestra.run.smithi062.stdout:generic/412 2s 2023-06-09T06:37:08.208 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/412 2023-06-09T06:37:08.208 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:37:08.221 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:37:08.261 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:37:08.262 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/413) 2023-06-09T06:37:09.013 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:37:09.034 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:37:09.038 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:37:09.044 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:37:09.044 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:37:10.273 INFO:teuthology.orchestra.run.smithi062.stdout:generic/413 [not run] mount 172.21.15.62:6789:/scratch with dax failed 2023-06-09T06:37:10.293 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/413 2023-06-09T06:37:10.294 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/413 2023-06-09T06:37:10.294 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:37:10.305 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:37:10.388 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:37:10.389 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/414) 2023-06-09T06:37:11.146 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:37:11.168 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:37:11.171 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:37:11.177 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:37:11.177 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:37:12.723 INFO:teuthology.orchestra.run.smithi062.stdout:generic/414 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:37:12.839 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/414 2023-06-09T06:37:12.839 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/414 2023-06-09T06:37:12.839 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:37:12.856 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:37:12.970 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:37:12.971 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/415) 2023-06-09T06:37:13.705 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:37:13.727 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:37:13.731 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:37:13.737 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:37:13.737 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:37:15.372 INFO:teuthology.orchestra.run.smithi062.stdout:generic/415 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:37:15.434 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/415 2023-06-09T06:37:15.434 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/415 2023-06-09T06:37:15.434 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:37:15.446 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:37:15.547 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:37:15.548 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/416) 2023-06-09T06:37:16.284 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:37:16.305 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:37:16.308 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:37:16.313 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:37:16.314 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:37:17.289 INFO:teuthology.orchestra.run.smithi062.stdout:generic/416 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-09T06:37:17.309 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/416 2023-06-09T06:37:17.309 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/416 2023-06-09T06:37:17.309 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:37:17.321 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:37:17.410 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:37:17.411 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/417) 2023-06-09T06:37:18.160 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:37:18.184 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:37:18.188 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:37:18.193 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:37:18.194 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:37:19.393 INFO:teuthology.orchestra.run.smithi062.stdout:generic/417 [not run] ceph does not support shutdown 2023-06-09T06:37:19.447 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/417 2023-06-09T06:37:19.448 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/417 2023-06-09T06:37:19.448 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:37:19.461 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:37:19.554 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:37:19.555 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/418) 2023-06-09T06:37:20.317 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:37:20.339 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:37:20.342 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:37:20.348 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:37:20.349 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:37:20.617 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:37:20.624 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:37:21.330 INFO:teuthology.orchestra.run.smithi062.stdout:generic/418 [not run] require 172.21.15.62:6789:/test to be valid block disk 2023-06-09T06:37:21.352 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/418 2023-06-09T06:37:21.353 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/418 2023-06-09T06:37:21.353 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:37:21.368 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:37:21.468 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:37:21.468 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/419) 2023-06-09T06:37:22.229 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:37:22.250 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:37:22.253 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:37:22.260 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:37:22.260 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:37:23.829 INFO:teuthology.orchestra.run.smithi062.stdout:generic/419 [not run] kernel doesn't support renameat2 syscall 2023-06-09T06:37:23.848 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/419 2023-06-09T06:37:23.848 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/419 2023-06-09T06:37:23.849 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:37:23.861 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:37:24.221 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:37:24.222 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/420) 2023-06-09T06:37:24.990 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:37:25.012 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:37:25.015 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:37:25.021 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:37:25.021 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:37:26.324 INFO:teuthology.orchestra.run.smithi062.stdout:generic/420 1s 2023-06-09T06:37:26.351 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/420 2023-06-09T06:37:26.351 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:37:26.366 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:37:26.736 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:37:26.737 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/421) 2023-06-09T06:37:27.570 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:37:27.594 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:37:27.597 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:37:27.602 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:37:27.602 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:37:37.034 INFO:teuthology.orchestra.run.smithi062.stdout:generic/421 9s 2023-06-09T06:37:37.090 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/421 2023-06-09T06:37:37.090 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:37:37.102 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:37:37.133 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:37:37.133 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/422) 2023-06-09T06:37:37.849 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:37:37.872 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:37:37.875 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:37:37.881 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:37:37.881 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:37:38.917 INFO:teuthology.orchestra.run.smithi062.stdout:generic/422 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-06-09T06:37:38.941 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/422 2023-06-09T06:37:38.941 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/422 2023-06-09T06:37:38.941 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:37:38.956 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:37:39.046 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:37:39.047 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/423) 2023-06-09T06:37:39.780 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:37:39.802 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:37:39.805 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:37:39.811 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:37:39.811 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:37:41.049 INFO:teuthology.orchestra.run.smithi062.stdout:generic/423 1s 2023-06-09T06:37:41.078 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/423 2023-06-09T06:37:41.078 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:37:41.091 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:37:41.503 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:37:41.504 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/424) 2023-06-09T06:37:42.313 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:37:42.337 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:37:42.339 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:37:42.345 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:37:42.345 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:37:43.356 INFO:teuthology.orchestra.run.smithi062.stdout:generic/424 [not run] file system doesn't support any of /usr/bin/chattr +a/+c/+d/+i 2023-06-09T06:37:43.378 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/424 2023-06-09T06:37:43.379 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/424 2023-06-09T06:37:43.379 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:37:43.394 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:37:43.490 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:37:43.491 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/425) 2023-06-09T06:37:44.236 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:37:44.262 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:37:44.265 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:37:44.270 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:37:44.270 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:37:45.331 INFO:teuthology.orchestra.run.smithi062.stdout:generic/425 [not run] xfs_io fiemap -a failed (old kernel/wrong fs?) 2023-06-09T06:37:45.352 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/425 2023-06-09T06:37:45.352 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/425 2023-06-09T06:37:45.353 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:37:45.365 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:37:45.681 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:37:45.682 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/426) 2023-06-09T06:37:46.527 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:37:46.552 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:37:46.555 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:37:46.561 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:37:46.561 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:37:50.714 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:37:50.720 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:38:20.854 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:38:20.858 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:38:40.301 INFO:teuthology.orchestra.run.smithi062.stdout:generic/426 54s 2023-06-09T06:38:40.470 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/426 2023-06-09T06:38:40.471 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:38:40.486 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:38:40.879 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:38:40.880 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/427) 2023-06-09T06:38:42.928 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:38:42.954 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:38:42.957 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:38:42.961 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:38:42.962 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:38:44.147 INFO:teuthology.orchestra.run.smithi062.stdout:generic/427 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-09T06:38:44.169 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/427 2023-06-09T06:38:44.169 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/427 2023-06-09T06:38:44.169 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:38:44.183 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:38:44.274 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:38:44.275 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/428) 2023-06-09T06:38:45.057 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:38:45.078 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:38:45.081 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:38:45.087 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:38:45.087 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:38:46.163 INFO:teuthology.orchestra.run.smithi062.stdout:generic/428 1s 2023-06-09T06:38:46.195 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/428 2023-06-09T06:38:46.196 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:38:46.209 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:38:46.314 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:38:46.315 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/429) 2023-06-09T06:38:47.071 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:38:47.093 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:38:47.096 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:38:47.102 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:38:47.103 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:38:51.540 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:38:51.546 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:39:00.666 INFO:teuthology.orchestra.run.smithi062.stdout:generic/429 13s 2023-06-09T06:39:00.694 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/429 2023-06-09T06:39:00.694 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:39:00.705 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:39:00.745 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:39:00.745 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/430) 2023-06-09T06:39:01.598 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:39:01.642 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:39:01.646 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:39:01.652 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:39:01.652 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:39:03.125 INFO:teuthology.orchestra.run.smithi062.stdout:generic/430 1s 2023-06-09T06:39:03.152 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/430 2023-06-09T06:39:03.152 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:39:03.164 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:39:03.588 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:39:03.589 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/431) 2023-06-09T06:39:04.373 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:39:04.396 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:39:04.398 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:39:04.404 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:39:04.404 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:39:05.693 INFO:teuthology.orchestra.run.smithi062.stdout:generic/431 1s 2023-06-09T06:39:05.721 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/431 2023-06-09T06:39:05.721 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:39:05.733 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:39:06.140 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:39:06.140 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/432) 2023-06-09T06:39:06.917 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:39:06.939 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:39:06.942 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:39:06.947 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:39:06.948 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:39:08.267 INFO:teuthology.orchestra.run.smithi062.stdout:generic/432 1s 2023-06-09T06:39:08.295 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/432 2023-06-09T06:39:08.295 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:39:08.309 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:39:08.695 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:39:08.695 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/433) 2023-06-09T06:39:09.520 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:39:09.543 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:39:09.546 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:39:09.553 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:39:09.553 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:39:10.769 INFO:teuthology.orchestra.run.smithi062.stdout:generic/433 1s 2023-06-09T06:39:10.795 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/433 2023-06-09T06:39:10.795 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:39:10.808 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:39:11.269 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:39:11.270 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/434) 2023-06-09T06:39:12.025 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:39:12.040 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:39:12.043 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:39:12.048 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:39:12.048 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:39:13.838 INFO:teuthology.orchestra.run.smithi062.stdout:generic/434 1s 2023-06-09T06:39:13.864 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/434 2023-06-09T06:39:13.865 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:39:13.877 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:39:14.291 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:39:14.292 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/435) 2023-06-09T06:39:15.080 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:39:15.104 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:39:15.107 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:39:15.113 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:39:15.113 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:39:21.669 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:39:21.674 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:39:51.789 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:39:51.795 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:39:51.865 INFO:tasks.ceph.mds.c.smithi062.stderr:2023-06-09T06:39:51.856+0000 7f506cdd7700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 326546) UID: 0 2023-06-09T06:39:51.865 INFO:tasks.ceph.mds.a.smithi062.stderr:2023-06-09T06:39:51.856+0000 7fafd2fdc700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 326546) UID: 0 2023-06-09T06:43:09.616 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:43:09.622 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:43:39.792 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:43:39.799 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:44:09.933 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:44:09.939 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:44:41.957 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:44:41.965 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:45:12.029 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:45:12.034 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:45:42.166 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:45:42.187 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:46:12.389 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:46:12.397 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:46:42.515 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:46:42.522 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:46:42.791 INFO:tasks.ceph.mds.c.smithi062.stderr:2023-06-09T06:46:42.781+0000 7f506cdd7700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 326782) UID: 0 2023-06-09T06:46:42.791 INFO:tasks.ceph.mds.a.smithi062.stderr:2023-06-09T06:46:42.781+0000 7fafd2fdc700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 326782) UID: 0 2023-06-09T06:50:48.259 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:50:48.266 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:51:18.503 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:51:18.510 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:51:48.736 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:51:48.742 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:51:49.980 INFO:tasks.ceph.mds.a.smithi062.stderr:2023-06-09T06:51:49.973+0000 7fafd2fdc700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 326802) UID: 0 2023-06-09T06:51:49.981 INFO:tasks.ceph.mds.c.smithi062.stderr:2023-06-09T06:51:49.973+0000 7f506cdd7700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 326802) UID: 0 2023-06-09T06:53:07.794 INFO:teuthology.orchestra.run.smithi062.stdout:generic/435 832s 2023-06-09T06:53:07.943 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/435 2023-06-09T06:53:07.943 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:53:07.956 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:53:08.025 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:53:08.026 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/436) 2023-06-09T06:53:09.340 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:53:09.360 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:53:09.362 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:53:09.368 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:53:09.368 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:53:10.824 INFO:teuthology.orchestra.run.smithi062.stdout:generic/436 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T06:53:10.846 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/436 2023-06-09T06:53:10.847 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/436 2023-06-09T06:53:10.847 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:53:10.858 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:53:11.247 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:53:11.248 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/437) 2023-06-09T06:53:11.966 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:53:11.987 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:53:11.990 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:53:11.994 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:53:11.994 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:53:13.754 INFO:teuthology.orchestra.run.smithi062.stdout:generic/437 1s 2023-06-09T06:53:13.778 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/437 2023-06-09T06:53:13.778 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:53:13.789 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:53:13.869 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:53:13.869 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/438) 2023-06-09T06:53:14.568 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:53:14.586 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:53:14.589 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:53:14.594 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:53:14.595 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:54:27.708 INFO:tasks.ceph.osd.3.smithi062.stderr:2023-06-09T06:54:27.699+0000 7fb4af5ce700 -1 Fail to open '/proc/338804/cmdline' error = (2) No such file or directory 2023-06-09T06:54:27.709 INFO:tasks.ceph.osd.3.smithi062.stderr:2023-06-09T06:54:27.699+0000 7fb4af5ce700 -1 received signal: Hangup from (PID: 338804) UID: 0 2023-06-09T06:54:27.709 INFO:tasks.ceph.osd.0.smithi062.stderr:2023-06-09T06:54:27.699+0000 7fa052e46700 -1 Fail to open '/proc/338804/cmdline' error = (2) No such file or directory 2023-06-09T06:54:27.709 INFO:tasks.ceph.osd.0.smithi062.stderr:2023-06-09T06:54:27.699+0000 7fa052e46700 -1 received signal: Hangup from (PID: 338804) UID: 0 2023-06-09T06:54:27.710 INFO:tasks.ceph.osd.1.smithi062.stderr:2023-06-09T06:54:27.699+0000 7f51ef5ce700 -1 Fail to open '/proc/338804/cmdline' error = (2) No such file or directory 2023-06-09T06:54:27.710 INFO:tasks.ceph.osd.1.smithi062.stderr:2023-06-09T06:54:27.699+0000 7f51ef5ce700 -1 received signal: Hangup from (PID: 338804) UID: 0 2023-06-09T06:54:27.710 INFO:tasks.ceph.osd.2.smithi062.stderr:2023-06-09T06:54:27.699+0000 7f9e3696d700 -1 Fail to open '/proc/338804/cmdline' error = (2) No such file or directory 2023-06-09T06:54:27.710 INFO:tasks.ceph.osd.2.smithi062.stderr:2023-06-09T06:54:27.699+0000 7f9e3696d700 -1 received signal: Hangup from (PID: 338804) UID: 0 2023-06-09T06:54:58.473 INFO:teuthology.orchestra.run.smithi062.stdout:generic/438 104s 2023-06-09T06:54:58.500 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/438 2023-06-09T06:54:58.500 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:54:58.510 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:54:58.599 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:54:58.599 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/439) 2023-06-09T06:54:59.308 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:54:59.327 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:54:59.330 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:54:59.335 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:54:59.335 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:55:01.395 INFO:teuthology.orchestra.run.smithi062.stdout:generic/439 2s 2023-06-09T06:55:01.421 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/439 2023-06-09T06:55:01.421 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:55:01.432 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:55:01.517 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:55:01.518 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/440) 2023-06-09T06:55:02.190 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:55:02.204 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:55:02.206 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:55:02.210 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:55:02.211 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:55:06.104 INFO:teuthology.orchestra.run.smithi062.stdout:generic/440 4s 2023-06-09T06:55:06.127 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/440 2023-06-09T06:55:06.127 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:55:06.138 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:55:06.176 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:55:06.176 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/441) 2023-06-09T06:55:06.847 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:55:06.866 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:55:06.868 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:55:06.874 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:55:06.874 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:55:07.933 INFO:teuthology.orchestra.run.smithi062.stdout:generic/441 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-06-09T06:55:07.953 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/441 2023-06-09T06:55:07.953 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/441 2023-06-09T06:55:07.954 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:55:07.965 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:55:08.042 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:55:08.042 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/442) 2023-06-09T06:55:08.751 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:55:08.770 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:55:08.773 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:55:08.778 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:55:08.778 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:55:09.660 INFO:teuthology.orchestra.run.smithi062.stdout:generic/442 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-06-09T06:55:09.680 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/442 2023-06-09T06:55:09.681 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/442 2023-06-09T06:55:09.681 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:55:09.694 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:55:09.773 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:55:09.774 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/443) 2023-06-09T06:55:10.463 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:55:10.483 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:55:10.485 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:55:10.491 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:55:10.491 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:55:11.426 INFO:teuthology.orchestra.run.smithi062.stdout:generic/443 1s 2023-06-09T06:55:11.453 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/443 2023-06-09T06:55:11.453 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:55:11.466 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:55:11.565 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:55:11.566 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/444) 2023-06-09T06:55:12.276 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:55:12.295 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:55:12.298 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:55:12.303 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:55:12.303 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:55:13.359 INFO:teuthology.orchestra.run.smithi062.stdout:generic/444 1s 2023-06-09T06:55:13.386 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/444 2023-06-09T06:55:13.386 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:55:13.398 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:55:13.496 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:55:13.496 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/445) 2023-06-09T06:55:14.176 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:55:14.197 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:55:14.199 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:55:14.204 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:55:14.205 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:55:15.643 INFO:teuthology.orchestra.run.smithi062.stdout:generic/445 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T06:55:15.662 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/445 2023-06-09T06:55:15.662 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/445 2023-06-09T06:55:15.662 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:55:15.675 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:55:15.927 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:55:15.928 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/446) 2023-06-09T06:55:16.726 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:55:16.746 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:55:16.748 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:55:16.753 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:55:16.753 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:55:46.668 INFO:teuthology.orchestra.run.smithi062.stdout:generic/446 29s 2023-06-09T06:55:46.832 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/446 2023-06-09T06:55:46.833 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:55:46.888 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:55:46.920 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:55:46.921 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/447) 2023-06-09T06:55:47.576 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:55:47.596 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:55:47.598 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:55:47.603 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:55:47.604 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:55:49.082 INFO:teuthology.orchestra.run.smithi062.stdout:generic/447 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:55:49.219 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/447 2023-06-09T06:55:49.219 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/447 2023-06-09T06:55:49.219 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:55:49.276 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:55:49.379 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:55:49.380 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/448) 2023-06-09T06:55:50.046 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:55:50.062 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:55:50.064 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:55:50.067 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:55:50.067 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:55:52.257 INFO:teuthology.orchestra.run.smithi062.stdout:generic/448 2s 2023-06-09T06:55:52.280 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/448 2023-06-09T06:55:52.280 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:55:52.294 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:55:52.656 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:55:52.657 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/449) 2023-06-09T06:55:53.390 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:55:53.410 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:55:53.412 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:55:53.417 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:55:53.418 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:55:54.378 INFO:teuthology.orchestra.run.smithi062.stdout:generic/449 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-09T06:55:54.401 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/449 2023-06-09T06:55:54.401 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/449 2023-06-09T06:55:54.402 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:55:54.414 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:55:54.695 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:55:54.696 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/450) 2023-06-09T06:55:55.514 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:55:55.534 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:55:55.537 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:55:55.541 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:55:55.541 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:55:57.218 INFO:teuthology.orchestra.run.smithi062.stdout:generic/450 2s 2023-06-09T06:55:57.244 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/450 2023-06-09T06:55:57.244 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:55:57.257 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:55:57.601 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:55:57.601 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/451) 2023-06-09T06:55:58.373 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:55:58.392 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:55:58.394 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:55:58.400 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:55:58.400 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:56:29.644 INFO:teuthology.orchestra.run.smithi062.stdout:generic/451 31s 2023-06-09T06:56:29.671 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/451 2023-06-09T06:56:29.671 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:56:29.684 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:56:29.935 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:56:29.936 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/452) 2023-06-09T06:56:30.790 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:56:30.811 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:56:30.813 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:56:30.819 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:56:30.819 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:56:32.206 INFO:teuthology.orchestra.run.smithi062.stdout:generic/452 1s 2023-06-09T06:56:32.229 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/452 2023-06-09T06:56:32.230 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:56:32.241 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:56:32.277 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:56:32.278 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/453) 2023-06-09T06:56:32.956 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:56:32.976 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:56:32.978 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:56:32.984 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:56:32.984 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:56:33.828 INFO:teuthology.orchestra.run.smithi062.stdout:generic/453 [not run] ceph does not allow unrestricted byte streams for names 2023-06-09T06:56:33.846 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/453 2023-06-09T06:56:33.846 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/453 2023-06-09T06:56:33.847 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:56:33.858 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:56:33.936 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:56:33.937 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/454) 2023-06-09T06:56:34.636 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:56:34.656 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:56:34.658 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:56:34.664 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:56:34.665 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:56:35.553 INFO:teuthology.orchestra.run.smithi062.stdout:generic/454 [not run] ceph does not allow unrestricted byte streams for names 2023-06-09T06:56:35.573 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/454 2023-06-09T06:56:35.573 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/454 2023-06-09T06:56:35.574 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:56:35.585 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:56:35.684 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:56:35.684 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/455) 2023-06-09T06:56:36.396 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:56:36.411 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:56:36.414 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:56:36.419 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:56:36.419 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:56:37.510 INFO:teuthology.orchestra.run.smithi062.stdout:generic/455 [not run] This test requires a valid $LOGWRITES_DEV 2023-06-09T06:56:37.527 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/455 2023-06-09T06:56:37.527 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/455 2023-06-09T06:56:37.527 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:56:37.539 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:56:37.624 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:56:37.625 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/456) 2023-06-09T06:56:38.303 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:56:38.325 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:56:38.328 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:56:38.333 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:56:38.333 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:56:39.273 INFO:teuthology.orchestra.run.smithi062.stdout:generic/456 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T06:56:39.292 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/456 2023-06-09T06:56:39.292 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/456 2023-06-09T06:56:39.293 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:56:39.305 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:56:39.398 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:56:39.399 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/457) 2023-06-09T06:56:40.099 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:56:40.120 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:56:40.122 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:56:40.127 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:56:40.127 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:56:41.908 INFO:teuthology.orchestra.run.smithi062.stdout:generic/457 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:56:41.939 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/457 2023-06-09T06:56:41.939 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/457 2023-06-09T06:56:41.939 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:56:41.951 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:56:42.036 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:56:42.037 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/458) 2023-06-09T06:56:42.674 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:56:42.694 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:56:42.697 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:56:42.703 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:56:42.703 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:56:44.090 INFO:teuthology.orchestra.run.smithi062.stdout:generic/458 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T06:56:44.144 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/458 2023-06-09T06:56:44.144 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/458 2023-06-09T06:56:44.144 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:56:44.181 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:56:44.418 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:56:44.419 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/459) 2023-06-09T06:56:45.084 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:56:45.104 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:56:45.107 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:56:45.112 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:56:45.112 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:56:46.604 INFO:teuthology.orchestra.run.smithi062.stdout:generic/459 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-06-09T06:56:46.621 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/459 2023-06-09T06:56:46.621 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/459 2023-06-09T06:56:46.621 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:56:46.635 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:56:46.714 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:56:46.714 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/460) 2023-06-09T06:56:47.383 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:56:47.404 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:56:47.406 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:56:47.411 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:56:47.412 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:56:51.398 INFO:teuthology.orchestra.run.smithi062.stdout:generic/460 4s 2023-06-09T06:56:51.423 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/460 2023-06-09T06:56:51.423 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:56:51.433 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:56:51.464 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:56:51.465 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/461) 2023-06-09T06:56:52.159 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:56:52.178 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:56:52.181 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:56:52.187 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:56:52.187 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:56:53.376 INFO:teuthology.orchestra.run.smithi062.stdout:generic/461 [not run] ceph does not support shutdown 2023-06-09T06:56:53.398 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/461 2023-06-09T06:56:53.398 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/461 2023-06-09T06:56:53.399 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:56:53.410 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:56:53.520 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:56:53.521 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/462) 2023-06-09T06:56:54.262 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:56:54.283 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:56:54.286 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:56:54.291 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:56:54.291 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:56:55.386 INFO:teuthology.orchestra.run.smithi062.stdout:generic/462 [not run] mount 172.21.15.62:6789:/scratch with dax failed 2023-06-09T06:56:55.405 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/462 2023-06-09T06:56:55.405 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/462 2023-06-09T06:56:55.406 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:56:55.417 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:56:55.515 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:56:55.515 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/463) 2023-06-09T06:56:56.217 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:56:56.238 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:56:56.241 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:56:56.246 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:56:56.246 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:56:57.216 INFO:teuthology.orchestra.run.smithi062.stdout:generic/463 [not run] Reflink not supported by test filesystem type: ceph 2023-06-09T06:56:57.236 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/463 2023-06-09T06:56:57.236 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/463 2023-06-09T06:56:57.237 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:56:57.248 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:56:57.541 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:56:57.542 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/464) 2023-06-09T06:56:58.314 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:56:58.332 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:56:58.334 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:56:58.339 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:56:58.339 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:57:29.614 INFO:teuthology.orchestra.run.smithi062.stderr:error: Compressing program wrote following message to stderr when compressing log /var/log/ceph/ceph-osd.3.log.1: 2023-06-09T06:57:29.614 INFO:teuthology.orchestra.run.smithi062.stderr:gzip: stdin: file size changed while zipping 2023-06-09T06:57:59.068 INFO:teuthology.orchestra.run.smithi062.stdout:generic/464 61s 2023-06-09T06:57:59.095 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/464 2023-06-09T06:57:59.096 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:57:59.111 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:57:59.154 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:57:59.154 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/465) 2023-06-09T06:57:59.913 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:57:59.935 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:57:59.938 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:57:59.944 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:57:59.944 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:58:05.994 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:58:05.999 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:58:07.721 INFO:teuthology.orchestra.run.smithi062.stdout:generic/465 7s 2023-06-09T06:58:07.745 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/465 2023-06-09T06:58:07.745 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:58:07.761 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:58:07.792 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:58:07.792 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/466) 2023-06-09T06:58:08.473 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:58:08.494 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:58:08.496 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:58:08.502 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:58:08.503 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:58:09.469 INFO:teuthology.orchestra.run.smithi062.stdout:generic/466 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-06-09T06:58:09.487 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/466 2023-06-09T06:58:09.488 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/466 2023-06-09T06:58:09.488 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:58:09.500 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:58:09.595 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:58:09.596 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/467) 2023-06-09T06:58:10.370 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:58:10.393 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:58:10.396 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:58:10.403 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:58:10.403 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:58:25.878 INFO:teuthology.orchestra.run.smithi062.stdout:generic/467 15s 2023-06-09T06:58:26.047 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/467 2023-06-09T06:58:26.047 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:58:26.059 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:58:26.480 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:58:26.480 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/468) 2023-06-09T06:58:28.480 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:58:28.501 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:58:28.504 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:58:28.510 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:58:28.510 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:58:29.811 INFO:teuthology.orchestra.run.smithi062.stdout:generic/468 [not run] ceph does not support shutdown 2023-06-09T06:58:29.896 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/468 2023-06-09T06:58:29.897 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/468 2023-06-09T06:58:29.897 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:58:29.909 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:58:29.999 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:58:30.000 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/469) 2023-06-09T06:58:30.758 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:58:30.779 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:58:30.782 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:58:30.788 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:58:30.788 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:58:31.867 INFO:teuthology.orchestra.run.smithi062.stdout:generic/469 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-06-09T06:58:31.889 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/469 2023-06-09T06:58:31.889 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/469 2023-06-09T06:58:31.890 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:58:31.904 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:58:32.002 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:58:32.003 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/470) 2023-06-09T06:58:32.732 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:58:32.754 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:58:32.758 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:58:32.763 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:58:32.764 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:58:33.767 INFO:teuthology.orchestra.run.smithi062.stdout:generic/470 [not run] This test requires a valid $LOGWRITES_DEV 2023-06-09T06:58:33.789 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/470 2023-06-09T06:58:33.789 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/470 2023-06-09T06:58:33.790 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:58:33.802 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:58:33.882 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:58:33.882 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/471) 2023-06-09T06:58:34.636 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:58:34.656 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:58:34.660 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:58:34.665 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:58:34.665 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:58:35.766 INFO:teuthology.orchestra.run.smithi062.stdout:generic/471 [not run] xfs_io pwrite -V 1 -b 4k -N failed (old kernel/wrong fs?) 2023-06-09T06:58:35.783 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/471 2023-06-09T06:58:35.783 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/471 2023-06-09T06:58:35.784 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:58:35.798 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:58:36.147 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:58:36.152 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:58:36.208 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:58:36.209 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/472) 2023-06-09T06:58:36.991 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:58:37.013 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:58:37.016 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:58:37.021 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:58:37.021 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:58:38.475 INFO:teuthology.orchestra.run.smithi062.stdout:generic/472 [not run] swapfiles are not supported 2023-06-09T06:58:38.495 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/472 2023-06-09T06:58:38.495 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/472 2023-06-09T06:58:38.495 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:58:38.508 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:58:38.598 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:58:38.599 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/473) 2023-06-09T06:58:39.346 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:58:39.367 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:58:39.370 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:58:39.376 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:58:39.376 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:58:40.518 INFO:teuthology.orchestra.run.smithi062.stdout:generic/473 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-06-09T06:58:40.538 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/473 2023-06-09T06:58:40.538 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/473 2023-06-09T06:58:40.539 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:58:40.552 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:58:40.664 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:58:40.665 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/474) 2023-06-09T06:58:41.433 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:58:41.456 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:58:41.459 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:58:41.465 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:58:41.466 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:58:42.700 INFO:teuthology.orchestra.run.smithi062.stdout:generic/474 [not run] ceph does not support shutdown 2023-06-09T06:58:42.779 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/474 2023-06-09T06:58:42.779 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/474 2023-06-09T06:58:42.779 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:58:42.792 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:58:42.910 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:58:42.911 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/475) 2023-06-09T06:58:43.664 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:58:43.687 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:58:43.690 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:58:43.696 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:58:43.696 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:58:44.742 INFO:teuthology.orchestra.run.smithi062.stdout:generic/475 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-06-09T06:58:44.762 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/475 2023-06-09T06:58:44.762 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/475 2023-06-09T06:58:44.762 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T06:58:44.774 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:58:44.859 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T06:58:44.859 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/476) 2023-06-09T06:58:45.617 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T06:58:45.639 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T06:58:45.642 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T06:58:45.648 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T06:58:45.648 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T06:59:06.340 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:59:06.345 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:59:36.431 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T06:59:36.436 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:00:06.809 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:00:06.814 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:00:36.961 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:00:36.970 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:01:08.287 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:01:08.292 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:01:38.673 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:01:38.678 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:02:08.741 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:02:08.746 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:02:38.872 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:02:38.877 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:03:08.939 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:03:08.944 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:03:39.093 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:03:39.100 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:04:09.432 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:04:09.438 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:04:39.671 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:04:39.677 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:05:09.795 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:05:09.801 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:05:39.924 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:05:39.929 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:06:10.045 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:06:10.051 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:06:43.221 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:06:43.226 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:07:13.362 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:07:13.367 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:07:43.569 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:07:43.574 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:08:13.801 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:08:13.806 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:08:43.962 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:08:43.970 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:09:14.231 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:09:14.236 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:09:44.468 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:09:44.474 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:10:14.552 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:10:14.556 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:10:44.662 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:10:44.668 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:10:44.767 INFO:tasks.ceph.mds.c.smithi062.stderr:2023-06-09T07:10:44.756+0000 7f506cdd7700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 441754) UID: 0 2023-06-09T07:10:44.768 INFO:tasks.ceph.mds.a.smithi062.stderr:2023-06-09T07:10:44.756+0000 7fafd2fdc700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 441754) UID: 0 2023-06-09T07:18:17.989 INFO:tasks.ceph.osd.2.smithi062.stderr:2023-06-09T07:18:17.981+0000 7f9e3696d700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 441785) UID: 0 2023-06-09T07:18:17.989 INFO:tasks.ceph.osd.0.smithi062.stderr:2023-06-09T07:18:17.981+0000 7fa052e46700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 441785) UID: 0 2023-06-09T07:18:17.990 INFO:tasks.ceph.osd.3.smithi062.stderr:2023-06-09T07:18:17.981+0000 7fb4af5ce700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 441785) UID: 0 2023-06-09T07:18:17.993 INFO:tasks.ceph.osd.1.smithi062.stderr:2023-06-09T07:18:17.985+0000 7f51ef5ce700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 441785) UID: 0 2023-06-09T07:27:19.186 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:27:19.192 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T07:27:19.394 INFO:tasks.ceph.osd.7.smithi089.stderr:2023-06-09T07:27:19.385+0000 7ff7cd1d9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44896) UID: 0 2023-06-09T07:27:19.394 INFO:tasks.ceph.osd.4.smithi089.stderr:2023-06-09T07:27:19.385+0000 7f3af9fd2700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44896) UID: 0 2023-06-09T07:27:19.395 INFO:tasks.ceph.osd.5.smithi089.stderr:2023-06-09T07:27:19.385+0000 7fa2fe1bb700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44896) UID: 0 2023-06-09T07:27:19.395 INFO:tasks.ceph.osd.6.smithi089.stderr:2023-06-09T07:27:19.385+0000 7f683358f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44896) UID: 0 2023-06-09T07:27:19.440 INFO:tasks.ceph.mds.a.smithi062.stderr:2023-06-09T07:27:19.433+0000 7fafd2fdc700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 441835) UID: 0 2023-06-09T07:27:19.444 INFO:tasks.ceph.mds.c.smithi062.stderr:2023-06-09T07:27:19.433+0000 7f506cdd7700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 441835) UID: 0 2023-06-09T07:34:38.759 INFO:tasks.ceph.osd.2.smithi062.stderr:2023-06-09T07:34:38.750+0000 7f9e3696d700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 441870) UID: 0 2023-06-09T07:34:38.761 INFO:tasks.ceph.osd.3.smithi062.stderr:2023-06-09T07:34:38.750+0000 7fb4af5ce700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 441870) UID: 0 2023-06-09T07:34:38.768 INFO:tasks.ceph.osd.1.smithi062.stderr:2023-06-09T07:34:38.758+0000 7f51ef5ce700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 441870) UID: 0 2023-06-09T07:34:38.798 INFO:tasks.ceph.osd.0.smithi062.stderr:2023-06-09T07:34:38.750+0000 7fa052e46700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 441870) UID: 0 2023-06-09T08:02:32.510 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:02:32.518 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:02:32.718 INFO:tasks.ceph.mds.c.smithi062.stderr:2023-06-09T08:02:32.709+0000 7f506cdd7700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 441992) UID: 0 2023-06-09T08:02:32.719 INFO:tasks.ceph.mds.a.smithi062.stderr:2023-06-09T08:02:32.713+0000 7fafd2fdc700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 441992) UID: 0 2023-06-09T08:02:32.910 INFO:tasks.ceph.osd.5.smithi089.stderr:2023-06-09T08:02:32.902+0000 7fa2fe1bb700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45078) UID: 0 2023-06-09T08:02:32.910 INFO:tasks.ceph.osd.7.smithi089.stderr:2023-06-09T08:02:32.902+0000 7ff7cd1d9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45078) UID: 0 2023-06-09T08:02:32.910 INFO:tasks.ceph.osd.4.smithi089.stderr:2023-06-09T08:02:32.902+0000 7f3af9fd2700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45078) UID: 0 2023-06-09T08:02:32.911 INFO:tasks.ceph.osd.6.smithi089.stderr:2023-06-09T08:02:32.902+0000 7f683358f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45078) UID: 0 2023-06-09T08:08:56.292 INFO:teuthology.orchestra.run.smithi062.stdout:generic/476 4210s 2023-06-09T08:08:58.370 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/476 2023-06-09T08:08:58.370 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T08:08:58.497 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:08:58.757 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T08:08:58.757 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/477) 2023-06-09T08:09:14.360 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T08:09:14.377 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T08:09:14.379 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T08:09:14.383 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T08:09:14.383 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:16:04.264 INFO:tasks.ceph.osd.0.smithi062.stderr:2023-06-09T08:16:04.257+0000 7fa052e46700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 442302) UID: 0 2023-06-09T08:16:04.265 INFO:tasks.ceph.osd.2.smithi062.stderr:2023-06-09T08:16:04.257+0000 7f9e3696d700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 442302) UID: 0 2023-06-09T08:16:04.265 INFO:tasks.ceph.osd.1.smithi062.stderr:2023-06-09T08:16:04.257+0000 7f51ef5ce700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 442302) UID: 0 2023-06-09T08:16:04.265 INFO:tasks.ceph.osd.3.smithi062.stderr:2023-06-09T08:16:04.257+0000 7fb4af5ce700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 442302) UID: 0 2023-06-09T08:18:23.686 INFO:teuthology.orchestra.run.smithi062.stdout:generic/477 62s 2023-06-09T08:18:24.137 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/477 2023-06-09T08:18:24.138 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T08:18:24.150 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:18:24.315 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T08:18:24.316 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/478) 2023-06-09T08:18:29.062 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T08:18:29.080 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T08:18:29.083 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T08:18:29.088 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T08:18:29.088 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:18:45.266 INFO:teuthology.orchestra.run.smithi062.stdout:generic/478 16s 2023-06-09T08:18:45.299 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/478 2023-06-09T08:18:45.299 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T08:18:45.310 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:18:45.414 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T08:18:45.414 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/479) 2023-06-09T08:18:46.283 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T08:18:46.302 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T08:18:46.305 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T08:18:46.320 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T08:18:46.320 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:18:47.404 INFO:teuthology.orchestra.run.smithi062.stdout:generic/479 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-06-09T08:18:47.423 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/479 2023-06-09T08:18:47.423 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/479 2023-06-09T08:18:47.423 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T08:18:47.433 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:18:47.561 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T08:18:47.562 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/480) 2023-06-09T08:18:48.560 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T08:18:48.579 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T08:18:48.579 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T08:18:48.584 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T08:18:48.584 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:18:49.828 INFO:teuthology.orchestra.run.smithi062.stdout:generic/480 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-06-09T08:18:49.849 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/480 2023-06-09T08:18:49.849 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/480 2023-06-09T08:18:49.850 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T08:18:49.872 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:18:49.964 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T08:18:49.965 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/481) 2023-06-09T08:18:50.856 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T08:18:50.880 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T08:18:50.884 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T08:18:50.888 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T08:18:50.888 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:18:51.988 INFO:teuthology.orchestra.run.smithi062.stdout:generic/481 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-06-09T08:18:52.005 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/481 2023-06-09T08:18:52.006 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/481 2023-06-09T08:18:52.006 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T08:18:52.021 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:18:52.097 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T08:18:52.098 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/482) 2023-06-09T08:18:52.887 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T08:18:52.912 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T08:18:52.914 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T08:18:52.919 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T08:18:52.919 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:18:54.016 INFO:teuthology.orchestra.run.smithi062.stdout:generic/482 [not run] This test requires a valid $LOGWRITES_DEV 2023-06-09T08:18:54.037 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/482 2023-06-09T08:18:54.037 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/482 2023-06-09T08:18:54.037 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T08:18:54.055 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:18:54.154 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T08:18:54.155 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/483) 2023-06-09T08:18:54.934 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T08:18:54.955 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T08:18:54.958 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T08:18:54.964 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T08:18:54.964 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:18:55.905 INFO:teuthology.orchestra.run.smithi062.stdout:generic/483 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-06-09T08:18:55.921 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/483 2023-06-09T08:18:55.921 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/483 2023-06-09T08:18:55.921 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T08:18:55.945 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:18:56.049 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T08:18:56.049 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/484) 2023-06-09T08:18:56.822 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T08:18:56.842 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T08:18:56.845 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T08:18:56.850 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T08:18:56.850 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:18:57.794 INFO:teuthology.orchestra.run.smithi062.stdout:generic/484 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-06-09T08:18:57.810 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/484 2023-06-09T08:18:57.810 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/484 2023-06-09T08:18:57.810 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T08:18:57.828 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:18:57.942 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T08:18:57.942 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/485) 2023-06-09T08:18:58.758 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T08:18:58.780 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T08:18:58.783 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T08:18:58.791 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T08:18:58.792 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:18:59.793 INFO:teuthology.orchestra.run.smithi062.stdout:generic/485 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-06-09T08:18:59.809 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/485 2023-06-09T08:18:59.810 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/485 2023-06-09T08:18:59.810 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T08:18:59.826 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:18:59.927 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T08:18:59.927 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/486) 2023-06-09T08:19:00.768 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T08:19:00.793 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T08:19:00.795 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T08:19:00.802 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T08:19:00.802 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:19:02.316 INFO:teuthology.orchestra.run.smithi062.stdout:generic/486 1s 2023-06-09T08:19:02.350 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/486 2023-06-09T08:19:02.350 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T08:19:02.368 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:19:02.402 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T08:19:02.403 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/487) 2023-06-09T08:19:03.256 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T08:19:03.276 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T08:19:03.278 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T08:19:03.283 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T08:19:03.283 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:19:04.222 INFO:teuthology.orchestra.run.smithi062.stdout:generic/487 [not run] This test requires a valid $SCRATCH_LOGDEV 2023-06-09T08:19:04.236 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/487 2023-06-09T08:19:04.237 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/487 2023-06-09T08:19:04.237 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T08:19:04.251 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:19:04.360 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T08:19:04.360 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/488) 2023-06-09T08:19:05.213 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T08:19:05.229 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T08:19:05.232 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T08:19:05.236 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T08:19:05.236 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:19:06.178 INFO:teuthology.orchestra.run.smithi062.stdout:generic/488 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-06-09T08:19:06.195 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/488 2023-06-09T08:19:06.195 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/488 2023-06-09T08:19:06.195 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T08:19:06.205 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:19:06.292 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T08:19:06.293 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/489) 2023-06-09T08:19:07.078 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T08:19:07.103 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T08:19:07.104 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T08:19:07.109 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T08:19:07.109 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:19:08.012 INFO:teuthology.orchestra.run.smithi062.stdout:generic/489 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-06-09T08:19:08.032 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/489 2023-06-09T08:19:08.032 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/489 2023-06-09T08:19:08.032 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T08:19:08.042 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:19:08.158 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T08:19:08.158 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/490) 2023-06-09T08:19:08.978 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T08:19:08.997 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T08:19:08.999 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T08:19:09.002 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T08:19:09.002 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:19:12.279 INFO:teuthology.orchestra.run.smithi062.stdout:generic/490 3s 2023-06-09T08:19:12.307 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/490 2023-06-09T08:19:12.307 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T08:19:12.318 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:19:12.689 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T08:19:12.690 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/491) 2023-06-09T08:19:13.771 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T08:19:13.789 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T08:19:13.790 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T08:19:13.795 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T08:19:13.795 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:19:14.744 INFO:teuthology.orchestra.run.smithi062.stdout:generic/491 [not run] ceph does not support freezing 2023-06-09T08:19:14.766 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/491 2023-06-09T08:19:14.766 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/491 2023-06-09T08:19:14.766 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T08:19:14.774 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:19:14.877 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T08:19:14.878 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/492) 2023-06-09T08:19:15.724 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T08:19:15.743 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T08:19:15.745 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T08:19:15.748 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T08:19:15.748 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:19:16.703 INFO:teuthology.orchestra.run.smithi062.stdout:generic/492 [not run] xfs_io label failed (old kernel/wrong fs?) 2023-06-09T08:19:16.718 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/492 2023-06-09T08:19:16.719 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/492 2023-06-09T08:19:16.719 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T08:19:16.730 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:19:16.816 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T08:19:16.816 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/493) 2023-06-09T08:19:17.600 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T08:19:17.625 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T08:19:17.627 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T08:19:17.638 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T08:19:17.638 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:19:19.073 INFO:teuthology.orchestra.run.smithi062.stdout:generic/493 [not run] swapfiles are not supported 2023-06-09T08:19:19.097 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/493 2023-06-09T08:19:19.097 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/493 2023-06-09T08:19:19.097 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T08:19:19.107 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:19:19.202 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T08:19:19.203 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/494) 2023-06-09T08:19:19.971 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T08:19:20.010 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T08:19:20.012 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T08:19:20.019 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T08:19:20.020 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:19:21.403 INFO:teuthology.orchestra.run.smithi062.stdout:generic/494 [not run] swapfiles are not supported 2023-06-09T08:19:21.429 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/494 2023-06-09T08:19:21.430 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/494 2023-06-09T08:19:21.430 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T08:19:21.440 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:19:21.527 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T08:19:21.527 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/495) 2023-06-09T08:19:22.294 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T08:19:22.310 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T08:19:22.312 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T08:19:22.316 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T08:19:22.316 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:19:23.880 INFO:teuthology.orchestra.run.smithi062.stdout:generic/495 [not run] swapfiles are not supported 2023-06-09T08:19:23.897 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/495 2023-06-09T08:19:23.897 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/495 2023-06-09T08:19:23.898 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T08:19:23.909 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:19:24.026 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T08:19:24.026 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/496) 2023-06-09T08:19:24.739 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T08:19:24.763 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T08:19:24.766 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T08:19:24.770 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T08:19:24.771 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:19:26.274 INFO:teuthology.orchestra.run.smithi062.stdout:generic/496 [not run] swapfiles are not supported 2023-06-09T08:19:26.295 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/496 2023-06-09T08:19:26.295 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/496 2023-06-09T08:19:26.295 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T08:19:26.308 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:19:26.410 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T08:19:26.410 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/497) 2023-06-09T08:19:27.187 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T08:19:27.205 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T08:19:27.206 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T08:19:27.210 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T08:19:27.210 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:19:28.626 INFO:teuthology.orchestra.run.smithi062.stdout:generic/497 [not run] swapfiles are not supported 2023-06-09T08:19:28.643 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/497 2023-06-09T08:19:28.644 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/497 2023-06-09T08:19:28.644 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T08:19:28.651 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:19:28.759 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T08:19:28.760 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/498) 2023-06-09T08:19:29.566 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T08:19:29.594 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T08:19:29.599 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T08:19:29.607 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T08:19:29.607 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:19:30.623 INFO:teuthology.orchestra.run.smithi062.stdout:generic/498 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-06-09T08:19:30.637 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/498 2023-06-09T08:19:30.638 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/498 2023-06-09T08:19:30.638 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T08:19:30.653 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:19:30.760 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T08:19:30.760 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/499) 2023-06-09T08:19:31.518 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T08:19:31.562 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T08:19:31.565 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T08:19:31.570 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T08:19:31.570 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:19:32.553 INFO:teuthology.orchestra.run.smithi062.stdout:generic/499 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-06-09T08:19:32.574 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/499 2023-06-09T08:19:32.574 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/499 2023-06-09T08:19:32.574 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T08:19:32.584 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:19:32.710 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T08:19:32.711 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/500) 2023-06-09T08:19:33.484 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T08:19:33.505 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T08:19:33.508 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T08:19:33.512 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T08:19:33.512 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:19:34.539 INFO:teuthology.orchestra.run.smithi062.stdout:generic/500 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-06-09T08:19:34.557 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/500 2023-06-09T08:19:34.558 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/500 2023-06-09T08:19:34.558 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T08:19:34.569 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:19:34.682 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T08:19:34.682 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/501) 2023-06-09T08:19:35.431 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T08:19:35.450 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T08:19:35.452 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T08:19:35.456 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T08:19:35.456 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:19:37.110 INFO:teuthology.orchestra.run.smithi062.stdout:generic/501 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T08:19:37.162 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/501 2023-06-09T08:19:37.162 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/501 2023-06-09T08:19:37.162 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T08:19:37.173 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:19:37.395 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T08:19:37.395 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/502) 2023-06-09T08:19:38.184 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T08:19:38.202 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T08:19:38.210 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T08:19:38.214 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T08:19:38.214 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:19:39.240 INFO:teuthology.orchestra.run.smithi062.stdout:generic/502 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-06-09T08:19:39.262 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/502 2023-06-09T08:19:39.262 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/502 2023-06-09T08:19:39.262 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T08:19:39.272 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:19:39.380 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T08:19:39.380 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/503) 2023-06-09T08:19:40.226 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T08:19:40.258 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T08:19:40.262 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T08:19:40.266 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T08:19:40.266 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:19:41.242 INFO:teuthology.orchestra.run.smithi062.stdout:generic/503 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T08:19:41.264 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/503 2023-06-09T08:19:41.265 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/503 2023-06-09T08:19:41.265 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T08:19:41.279 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:19:41.393 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T08:19:41.394 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/504) 2023-06-09T08:19:42.200 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T08:19:42.222 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T08:19:42.223 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T08:19:42.228 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T08:19:42.228 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:19:43.343 INFO:teuthology.orchestra.run.smithi062.stdout:generic/504 1s 2023-06-09T08:19:43.383 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/504 2023-06-09T08:19:43.383 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T08:19:43.399 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:19:43.493 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T08:19:43.493 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/505) 2023-06-09T08:19:44.299 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T08:19:44.319 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T08:19:44.321 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T08:19:44.326 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T08:19:44.326 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:19:45.547 INFO:teuthology.orchestra.run.smithi062.stdout:generic/505 [not run] ceph does not support shutdown 2023-06-09T08:19:45.628 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/505 2023-06-09T08:19:45.628 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/505 2023-06-09T08:19:45.628 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T08:19:45.638 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:19:45.728 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T08:19:45.728 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/506) 2023-06-09T08:19:46.563 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T08:19:46.584 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T08:19:46.586 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T08:19:46.589 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T08:19:46.590 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:19:47.532 INFO:teuthology.orchestra.run.smithi062.stdout:generic/506 [not run] disk quotas not supported by this filesystem type: ceph 2023-06-09T08:19:47.552 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/506 2023-06-09T08:19:47.552 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/506 2023-06-09T08:19:47.552 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T08:19:47.562 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:19:47.657 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T08:19:47.658 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/507) 2023-06-09T08:19:48.422 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T08:19:48.449 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T08:19:48.451 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T08:19:48.457 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T08:19:48.457 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:19:49.422 INFO:teuthology.orchestra.run.smithi062.stdout:generic/507 [not run] file system doesn't support chattr +ASai 2023-06-09T08:19:49.442 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/507 2023-06-09T08:19:49.443 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/507 2023-06-09T08:19:49.443 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T08:19:49.455 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:19:49.566 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T08:19:49.567 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/508) 2023-06-09T08:19:50.418 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T08:19:50.443 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T08:19:50.445 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T08:19:50.450 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T08:19:50.451 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:19:51.346 INFO:teuthology.orchestra.run.smithi062.stdout:generic/508 [not run] lsattr not supported by test filesystem type: ceph 2023-06-09T08:19:51.363 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/508 2023-06-09T08:19:51.363 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/508 2023-06-09T08:19:51.363 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T08:19:51.377 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:19:51.475 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T08:19:51.475 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/509) 2023-06-09T08:19:52.236 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T08:19:52.263 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T08:19:52.266 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T08:19:52.270 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T08:19:52.271 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:19:53.277 INFO:teuthology.orchestra.run.smithi062.stdout:generic/509 [not run] O_TMPFILE is not supported 2023-06-09T08:19:53.294 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/509 2023-06-09T08:19:53.294 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/509 2023-06-09T08:19:53.294 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T08:19:53.306 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:19:53.392 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T08:19:53.393 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/510) 2023-06-09T08:19:54.234 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T08:19:54.257 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T08:19:54.258 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T08:19:54.265 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T08:19:54.265 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:19:55.221 INFO:teuthology.orchestra.run.smithi062.stdout:generic/510 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-06-09T08:19:55.244 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/510 2023-06-09T08:19:55.244 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/510 2023-06-09T08:19:55.245 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T08:19:55.265 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:19:55.379 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T08:19:55.379 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/511) 2023-06-09T08:19:56.202 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T08:19:56.231 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T08:19:56.232 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T08:19:56.244 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T08:19:56.245 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:19:57.212 INFO:teuthology.orchestra.run.smithi062.stdout:generic/511 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-06-09T08:19:57.232 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/511 2023-06-09T08:19:57.233 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/511 2023-06-09T08:19:57.233 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T08:19:57.243 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:19:57.329 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T08:19:57.330 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/512) 2023-06-09T08:19:58.036 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T08:19:58.050 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T08:19:58.052 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T08:19:58.057 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T08:19:58.057 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:19:59.129 INFO:teuthology.orchestra.run.smithi062.stdout:generic/512 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T08:19:59.143 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/512 2023-06-09T08:19:59.144 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/512 2023-06-09T08:19:59.144 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T08:19:59.158 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:19:59.270 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T08:19:59.271 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/513) 2023-06-09T08:19:59.929 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T08:19:59.949 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T08:19:59.952 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T08:19:59.955 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T08:19:59.955 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:20:01.512 INFO:teuthology.orchestra.run.smithi062.stdout:generic/513 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T08:20:01.564 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/513 2023-06-09T08:20:01.565 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/513 2023-06-09T08:20:01.565 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T08:20:01.624 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:20:01.814 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T08:20:01.815 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/514) 2023-06-09T08:20:02.580 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T08:20:02.596 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T08:20:02.598 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T08:20:02.601 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T08:20:02.601 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:20:04.224 INFO:teuthology.orchestra.run.smithi062.stdout:generic/514 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T08:20:04.266 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/514 2023-06-09T08:20:04.266 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/514 2023-06-09T08:20:04.266 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T08:20:04.279 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:20:04.514 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T08:20:04.515 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/515) 2023-06-09T08:20:05.311 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T08:20:05.328 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T08:20:05.329 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T08:20:05.333 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T08:20:05.333 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:20:06.822 INFO:teuthology.orchestra.run.smithi062.stdout:generic/515 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T08:20:06.842 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/515 2023-06-09T08:20:06.842 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/515 2023-06-09T08:20:06.842 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T08:20:06.853 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:20:07.105 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T08:20:07.105 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/516) 2023-06-09T08:20:07.990 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T08:20:08.007 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T08:20:08.009 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T08:20:08.019 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T08:20:08.019 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:20:09.084 INFO:teuthology.orchestra.run.smithi062.stdout:generic/516 [not run] Dedupe not supported by test filesystem type: ceph 2023-06-09T08:20:09.103 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/516 2023-06-09T08:20:09.104 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/516 2023-06-09T08:20:09.104 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T08:20:09.114 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:20:09.322 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T08:20:09.322 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/517) 2023-06-09T08:20:10.457 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T08:20:10.473 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T08:20:10.476 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T08:20:10.480 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T08:20:10.481 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:20:11.735 INFO:teuthology.orchestra.run.smithi062.stdout:generic/517 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-06-09T08:20:11.961 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/517 2023-06-09T08:20:11.961 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/517 2023-06-09T08:20:11.962 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T08:20:12.000 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:20:12.390 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T08:20:12.391 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/518) 2023-06-09T08:20:13.174 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T08:20:13.205 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T08:20:13.208 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T08:20:13.216 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T08:20:13.216 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:20:14.820 INFO:teuthology.orchestra.run.smithi062.stdout:generic/518 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T08:20:14.985 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/518 2023-06-09T08:20:14.985 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/518 2023-06-09T08:20:14.985 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T08:20:14.996 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:20:15.148 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T08:20:15.149 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/519) 2023-06-09T08:20:15.939 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T08:20:15.961 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T08:20:15.963 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T08:20:15.969 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T08:20:15.969 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:20:17.013 INFO:teuthology.orchestra.run.smithi062.stdout:generic/519 [not run] FIBMAP not supported by this filesystem 2023-06-09T08:20:17.036 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/519 2023-06-09T08:20:17.037 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/519 2023-06-09T08:20:17.038 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T08:20:17.051 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:20:17.420 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T08:20:17.421 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/520) 2023-06-09T08:20:18.316 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T08:20:18.335 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T08:20:18.336 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T08:20:18.339 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T08:20:18.339 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:20:19.246 INFO:teuthology.orchestra.run.smithi062.stdout:generic/520 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-06-09T08:20:19.269 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/520 2023-06-09T08:20:19.269 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/520 2023-06-09T08:20:19.269 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T08:20:19.278 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:20:19.366 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T08:20:19.366 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/521) 2023-06-09T08:20:20.146 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T08:20:20.167 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T08:20:20.169 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T08:20:20.184 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T08:20:20.185 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T08:30:43.398 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:30:43.405 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:30:43.627 INFO:tasks.ceph.mds.c.smithi062.stderr:2023-06-09T08:30:43.620+0000 7f506cdd7700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 462546) UID: 0 2023-06-09T08:30:43.627 INFO:tasks.ceph.mds.a.smithi062.stderr:2023-06-09T08:30:43.620+0000 7fafd2fdc700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 462546) UID: 0 2023-06-09T08:30:43.909 INFO:tasks.ceph.osd.7.smithi089.stderr:2023-06-09T08:30:43.901+0000 7ff7cd1d9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45172) UID: 0 2023-06-09T08:30:43.909 INFO:tasks.ceph.osd.4.smithi089.stderr:2023-06-09T08:30:43.901+0000 7f3af9fd2700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45172) UID: 0 2023-06-09T08:30:43.910 INFO:tasks.ceph.osd.6.smithi089.stderr:2023-06-09T08:30:43.901+0000 7f683358f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45172) UID: 0 2023-06-09T08:30:43.910 INFO:tasks.ceph.osd.5.smithi089.stderr:2023-06-09T08:30:43.901+0000 7fa2fe1bb700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45172) UID: 0 2023-06-09T08:37:56.559 INFO:tasks.ceph.osd.0.smithi062.stderr:2023-06-09T08:37:56.554+0000 7fa052e46700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 462563) UID: 0 2023-06-09T08:37:56.560 INFO:tasks.ceph.osd.3.smithi062.stderr:2023-06-09T08:37:56.554+0000 7fb4af5ce700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 462563) UID: 0 2023-06-09T08:37:56.561 INFO:tasks.ceph.osd.2.smithi062.stderr:2023-06-09T08:37:56.554+0000 7f9e3696d700 -1 received signal: Hangup from (PID: 462563) UID: 0 2023-06-09T08:37:56.561 INFO:tasks.ceph.osd.1.smithi062.stderr:2023-06-09T08:37:56.554+0000 7f51ef5ce700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 462563) UID: 0 2023-06-09T08:48:55.317 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:48:55.322 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:48:55.660 INFO:tasks.ceph.osd.7.smithi089.stderr:2023-06-09T08:48:55.649+0000 7ff7cd1d9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45220) UID: 0 2023-06-09T08:48:55.661 INFO:tasks.ceph.osd.6.smithi089.stderr:2023-06-09T08:48:55.649+0000 7f683358f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45220) UID: 0 2023-06-09T08:48:55.661 INFO:tasks.ceph.osd.4.smithi089.stderr:2023-06-09T08:48:55.653+0000 7f3af9fd2700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45220) UID: 0 2023-06-09T08:48:55.662 INFO:tasks.ceph.osd.5.smithi089.stderr:2023-06-09T08:48:55.653+0000 7fa2fe1bb700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45220) UID: 0 2023-06-09T08:54:29.232 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:54:29.242 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:54:29.284 INFO:tasks.ceph.osd.0.smithi062.stderr:2023-06-09T08:54:29.275+0000 7fa052e46700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 462601) UID: 0 2023-06-09T08:54:29.284 INFO:tasks.ceph.osd.2.smithi062.stderr:2023-06-09T08:54:29.275+0000 7f9e3696d700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 462601) UID: 0 2023-06-09T08:54:29.284 INFO:tasks.ceph.osd.3.smithi062.stderr:2023-06-09T08:54:29.275+0000 7fb4af5ce700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 462601) UID: 0 2023-06-09T08:54:29.285 INFO:tasks.ceph.osd.1.smithi062.stderr:2023-06-09T08:54:29.275+0000 7f51ef5ce700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 462601) UID: 0 2023-06-09T08:59:09.454 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:59:09.459 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T08:59:09.503 INFO:tasks.ceph.osd.7.smithi089.stderr:2023-06-09T08:59:09.496+0000 7ff7cd1d9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45249) UID: 0 2023-06-09T08:59:09.503 INFO:tasks.ceph.osd.5.smithi089.stderr:2023-06-09T08:59:09.496+0000 7fa2fe1bb700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45249) UID: 0 2023-06-09T08:59:09.504 INFO:tasks.ceph.osd.6.smithi089.stderr:2023-06-09T08:59:09.496+0000 7f683358f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45249) UID: 0 2023-06-09T08:59:09.504 INFO:tasks.ceph.osd.4.smithi089.stderr:2023-06-09T08:59:09.496+0000 7f3af9fd2700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45249) UID: 0 2023-06-09T08:59:09.517 INFO:tasks.ceph.osd.0.smithi062.stderr:2023-06-09T08:59:09.510+0000 7fa052e46700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 462618) UID: 0 2023-06-09T08:59:09.517 INFO:tasks.ceph.osd.2.smithi062.stderr:2023-06-09T08:59:09.510+0000 7f9e3696d700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 462618) UID: 0 2023-06-09T08:59:09.518 INFO:tasks.ceph.osd.3.smithi062.stderr:2023-06-09T08:59:09.510+0000 7fb4af5ce700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 462618) UID: 0 2023-06-09T08:59:09.518 INFO:tasks.ceph.osd.1.smithi062.stderr:2023-06-09T08:59:09.514+0000 7f51ef5ce700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 462618) UID: 0 2023-06-09T09:03:11.459 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:03:11.463 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:03:41.627 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:03:41.630 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:04:12.287 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:04:12.292 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:04:42.386 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:04:42.392 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:05:13.143 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:05:13.148 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:05:43.213 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:05:43.218 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:06:13.326 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:06:13.331 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:06:43.452 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:06:43.457 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:07:13.554 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:07:13.558 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:07:43.622 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:07:43.630 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:08:13.714 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:08:13.718 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:08:43.831 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:08:43.835 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:09:14.509 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:09:14.515 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:09:44.679 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:09:44.683 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:10:14.898 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:10:14.904 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:10:44.971 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:10:44.977 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:10:45.107 INFO:tasks.ceph.osd.6.smithi089.stderr:2023-06-09T09:10:45.096+0000 7f683358f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45312) UID: 0 2023-06-09T09:10:45.108 INFO:tasks.ceph.osd.7.smithi089.stderr:2023-06-09T09:10:45.096+0000 7ff7cd1d9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45312) UID: 0 2023-06-09T09:10:45.108 INFO:tasks.ceph.osd.4.smithi089.stderr:2023-06-09T09:10:45.096+0000 7f3af9fd2700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45312) UID: 0 2023-06-09T09:10:45.108 INFO:tasks.ceph.osd.5.smithi089.stderr:2023-06-09T09:10:45.096+0000 7fa2fe1bb700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45312) UID: 0 2023-06-09T09:15:02.237 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:15:02.242 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:15:33.710 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:15:33.714 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:16:03.789 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:16:03.793 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:16:34.331 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:16:34.336 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:17:04.403 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:17:04.408 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:17:35.266 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:17:35.271 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:18:05.349 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:18:05.354 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:18:36.305 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:18:36.310 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:19:06.397 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:19:06.404 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:19:37.109 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:19:37.114 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:20:07.278 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:20:07.283 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:20:37.732 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:20:37.738 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:21:07.849 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:21:07.855 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:21:37.980 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:21:37.987 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:22:08.099 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:22:08.103 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:22:38.225 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:22:38.230 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:23:08.300 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:23:08.305 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:23:39.170 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:23:39.176 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:23:39.243 INFO:tasks.ceph.osd.4.smithi089.stderr:2023-06-09T09:23:39.236+0000 7f3af9fd2700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45383) UID: 0 2023-06-09T09:23:39.244 INFO:tasks.ceph.osd.5.smithi089.stderr:2023-06-09T09:23:39.236+0000 7fa2fe1bb700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45383) UID: 0 2023-06-09T09:23:39.244 INFO:tasks.ceph.osd.6.smithi089.stderr:2023-06-09T09:23:39.236+0000 7f683358f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45383) UID: 0 2023-06-09T09:23:39.246 INFO:tasks.ceph.osd.7.smithi089.stderr:2023-06-09T09:23:39.236+0000 7ff7cd1d9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45383) UID: 0 2023-06-09T09:27:48.410 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:27:48.415 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:27:48.478 INFO:tasks.ceph.osd.0.smithi062.stderr:2023-06-09T09:27:48.472+0000 7fa052e46700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 462748) UID: 0 2023-06-09T09:27:48.478 INFO:tasks.ceph.osd.2.smithi062.stderr:2023-06-09T09:27:48.472+0000 7f9e3696d700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 462748) UID: 0 2023-06-09T09:27:48.479 INFO:tasks.ceph.osd.1.smithi062.stderr:2023-06-09T09:27:48.472+0000 7f51ef5ce700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 462748) UID: 0 2023-06-09T09:27:48.479 INFO:tasks.ceph.osd.3.smithi062.stderr:2023-06-09T09:27:48.472+0000 7fb4af5ce700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 462748) UID: 0 2023-06-09T09:27:48.488 INFO:tasks.ceph.osd.6.smithi089.stderr:2023-06-09T09:27:48.478+0000 7f683358f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45399) UID: 0 2023-06-09T09:27:48.488 INFO:tasks.ceph.osd.7.smithi089.stderr:2023-06-09T09:27:48.478+0000 7ff7cd1d9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45399) UID: 0 2023-06-09T09:27:48.488 INFO:tasks.ceph.osd.4.smithi089.stderr:2023-06-09T09:27:48.478+0000 7f3af9fd2700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45399) UID: 0 2023-06-09T09:27:48.489 INFO:tasks.ceph.osd.5.smithi089.stderr:2023-06-09T09:27:48.482+0000 7fa2fe1bb700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45399) UID: 0 2023-06-09T09:36:14.734 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:36:14.740 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:36:14.824 INFO:tasks.ceph.osd.1.smithi062.stderr:2023-06-09T09:36:14.816+0000 7f51ef5ce700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 462770) UID: 0 2023-06-09T09:36:14.825 INFO:tasks.ceph.osd.0.smithi062.stderr:2023-06-09T09:36:14.816+0000 7fa052e46700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 462770) UID: 0 2023-06-09T09:36:14.825 INFO:tasks.ceph.osd.3.smithi062.stderr:2023-06-09T09:36:14.816+0000 7fb4af5ce700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 462770) UID: 0 2023-06-09T09:36:14.825 INFO:tasks.ceph.osd.2.smithi062.stderr:2023-06-09T09:36:14.816+0000 7f9e3696d700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 462770) UID: 0 2023-06-09T09:40:33.991 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:40:33.997 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:40:34.048 INFO:tasks.ceph.osd.0.smithi062.stderr:2023-06-09T09:40:34.040+0000 7fa052e46700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 462799) UID: 0 2023-06-09T09:40:34.048 INFO:tasks.ceph.osd.3.smithi062.stderr:2023-06-09T09:40:34.040+0000 7fb4af5ce700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 462799) UID: 0 2023-06-09T09:40:34.049 INFO:tasks.ceph.osd.1.smithi062.stderr:2023-06-09T09:40:34.040+0000 7f51ef5ce700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 462799) UID: 0 2023-06-09T09:40:34.049 INFO:tasks.ceph.osd.2.smithi062.stderr:2023-06-09T09:40:34.040+0000 7f9e3696d700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 462799) UID: 0 2023-06-09T09:44:50.348 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:44:50.353 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:44:50.507 INFO:tasks.ceph.osd.1.smithi062.stderr:2023-06-09T09:44:50.500+0000 7f51ef5ce700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 462811) UID: 0 2023-06-09T09:44:50.508 INFO:tasks.ceph.osd.2.smithi062.stderr:2023-06-09T09:44:50.500+0000 7f9e3696d700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 462811) UID: 0 2023-06-09T09:44:50.508 INFO:tasks.ceph.osd.0.smithi062.stderr:2023-06-09T09:44:50.500+0000 7fa052e46700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 462811) UID: 0 2023-06-09T09:44:50.508 INFO:tasks.ceph.osd.3.smithi062.stderr:2023-06-09T09:44:50.500+0000 7fb4af5ce700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 462811) UID: 0 2023-06-09T09:49:06.263 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:49:06.268 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:49:06.337 INFO:tasks.ceph.osd.4.smithi089.stderr:2023-06-09T09:49:06.331+0000 7f3af9fd2700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45522) UID: 0 2023-06-09T09:49:06.338 INFO:tasks.ceph.osd.7.smithi089.stderr:2023-06-09T09:49:06.331+0000 7ff7cd1d9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45522) UID: 0 2023-06-09T09:49:06.338 INFO:tasks.ceph.osd.5.smithi089.stderr:2023-06-09T09:49:06.331+0000 7fa2fe1bb700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45522) UID: 0 2023-06-09T09:49:06.338 INFO:tasks.ceph.osd.6.smithi089.stderr:2023-06-09T09:49:06.331+0000 7f683358f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45522) UID: 0 2023-06-09T09:53:21.087 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:53:21.093 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:53:51.376 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:53:51.382 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:54:21.511 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:54:21.518 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:54:53.227 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:54:53.233 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:54:53.274 INFO:tasks.ceph.osd.6.smithi089.stderr:2023-06-09T09:54:53.267+0000 7f683358f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45544) UID: 0 2023-06-09T09:54:53.276 INFO:tasks.ceph.osd.7.smithi089.stderr:2023-06-09T09:54:53.267+0000 7ff7cd1d9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45544) UID: 0 2023-06-09T09:54:53.276 INFO:tasks.ceph.osd.4.smithi089.stderr:2023-06-09T09:54:53.267+0000 7f3af9fd2700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45544) UID: 0 2023-06-09T09:54:53.276 INFO:tasks.ceph.osd.5.smithi089.stderr:2023-06-09T09:54:53.267+0000 7fa2fe1bb700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45544) UID: 0 2023-06-09T09:57:55.975 INFO:teuthology.orchestra.run.smithi062.stdout:generic/521 5855s 2023-06-09T09:57:56.127 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/521 2023-06-09T09:57:56.127 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T09:57:56.137 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T09:57:56.466 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T09:57:56.467 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/522) 2023-06-09T09:57:58.585 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T09:57:58.605 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T09:57:58.608 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T09:57:58.612 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T09:57:58.612 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T09:58:58.168 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:58:58.172 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T09:58:58.395 INFO:tasks.ceph.osd.6.smithi089.stderr:2023-06-09T09:58:58.386+0000 7f683358f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45563) UID: 0 2023-06-09T09:58:58.396 INFO:tasks.ceph.osd.7.smithi089.stderr:2023-06-09T09:58:58.386+0000 7ff7cd1d9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45563) UID: 0 2023-06-09T09:58:58.396 INFO:tasks.ceph.osd.4.smithi089.stderr:2023-06-09T09:58:58.386+0000 7f3af9fd2700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45563) UID: 0 2023-06-09T09:58:58.397 INFO:tasks.ceph.osd.5.smithi089.stderr:2023-06-09T09:58:58.386+0000 7fa2fe1bb700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45563) UID: 0 2023-06-09T10:02:38.811 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:02:38.815 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:02:38.909 INFO:tasks.ceph.osd.1.smithi062.stderr:2023-06-09T10:02:38.900+0000 7f51ef5ce700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 463324) UID: 0 2023-06-09T10:02:38.910 INFO:tasks.ceph.osd.3.smithi062.stderr:2023-06-09T10:02:38.900+0000 7fb4af5ce700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 463324) UID: 0 2023-06-09T10:02:38.910 INFO:tasks.ceph.osd.2.smithi062.stderr:2023-06-09T10:02:38.900+0000 7f9e3696d700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 463324) UID: 0 2023-06-09T10:02:38.911 INFO:tasks.ceph.osd.0.smithi062.stderr:2023-06-09T10:02:38.900+0000 7fa052e46700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 463324) UID: 0 2023-06-09T10:06:52.760 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:06:52.766 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:06:52.927 INFO:tasks.ceph.mds.a.smithi062.stderr:2023-06-09T10:06:52.920+0000 7fafd2fdc700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 463340) UID: 0 2023-06-09T10:06:52.928 INFO:tasks.ceph.mds.c.smithi062.stderr:2023-06-09T10:06:52.916+0000 7f506cdd7700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 463340) UID: 0 2023-06-09T10:11:20.107 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:11:20.112 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:11:50.280 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:11:50.285 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:12:20.461 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:12:20.466 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:12:50.567 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:12:50.571 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:13:21.548 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:13:21.554 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:13:51.627 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:13:51.635 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:14:21.724 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:14:21.729 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:14:51.814 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:14:51.819 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:15:21.911 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:15:21.919 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:15:53.166 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:15:53.170 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:15:53.411 INFO:tasks.ceph.osd.6.smithi089.stderr:2023-06-09T10:15:53.400+0000 7f683358f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45627) UID: 0 2023-06-09T10:15:53.412 INFO:tasks.ceph.osd.4.smithi089.stderr:2023-06-09T10:15:53.400+0000 7f3af9fd2700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45627) UID: 0 2023-06-09T10:15:53.412 INFO:tasks.ceph.osd.5.smithi089.stderr:2023-06-09T10:15:53.400+0000 7fa2fe1bb700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45627) UID: 0 2023-06-09T10:15:53.412 INFO:tasks.ceph.osd.7.smithi089.stderr:2023-06-09T10:15:53.400+0000 7ff7cd1d9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45627) UID: 0 2023-06-09T10:19:50.233 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:19:50.239 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:19:50.308 INFO:tasks.ceph.osd.2.smithi062.stderr:2023-06-09T10:19:50.300+0000 7f9e3696d700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 463395) UID: 0 2023-06-09T10:19:50.309 INFO:tasks.ceph.osd.1.smithi062.stderr:2023-06-09T10:19:50.300+0000 7f51ef5ce700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 463395) UID: 0 2023-06-09T10:19:50.311 INFO:tasks.ceph.osd.0.smithi062.stderr:2023-06-09T10:19:50.300+0000 7fa052e46700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 463395) UID: 0 2023-06-09T10:19:50.311 INFO:tasks.ceph.osd.3.smithi062.stderr:2023-06-09T10:19:50.300+0000 7fb4af5ce700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 463395) UID: 0 2023-06-09T10:24:28.958 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:24:28.963 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:24:59.147 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:24:59.152 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:25:29.224 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:25:29.229 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:25:59.329 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:25:59.334 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:26:29.403 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:26:29.408 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:27:00.442 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:27:00.447 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:27:30.511 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:27:30.517 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:28:00.814 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:28:00.820 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:28:30.893 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:28:30.897 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:29:00.968 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:29:00.973 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:29:31.088 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:29:31.093 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:30:01.236 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:30:01.241 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:30:31.409 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:30:31.413 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:31:02.677 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:31:02.682 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:31:32.764 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:31:32.770 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:32:03.510 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:32:03.515 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:32:03.609 INFO:tasks.ceph.osd.2.smithi062.stderr:2023-06-09T10:32:03.601+0000 7f9e3696d700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 463459) UID: 0 2023-06-09T10:32:03.610 INFO:tasks.ceph.osd.0.smithi062.stderr:2023-06-09T10:32:03.601+0000 7fa052e46700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 463459) UID: 0 2023-06-09T10:32:03.610 INFO:tasks.ceph.osd.1.smithi062.stderr:2023-06-09T10:32:03.601+0000 7f51ef5ce700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 463459) UID: 0 2023-06-09T10:32:03.610 INFO:tasks.ceph.osd.3.smithi062.stderr:2023-06-09T10:32:03.601+0000 7fb4af5ce700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 463459) UID: 0 2023-06-09T10:36:30.682 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:36:30.687 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:36:30.736 INFO:tasks.ceph.osd.6.smithi089.stderr:2023-06-09T10:36:30.730+0000 7f683358f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45739) UID: 0 2023-06-09T10:36:30.737 INFO:tasks.ceph.osd.4.smithi089.stderr:2023-06-09T10:36:30.730+0000 7f3af9fd2700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45739) UID: 0 2023-06-09T10:36:30.737 INFO:tasks.ceph.osd.5.smithi089.stderr:2023-06-09T10:36:30.730+0000 7fa2fe1bb700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45739) UID: 0 2023-06-09T10:36:30.737 INFO:tasks.ceph.osd.7.smithi089.stderr:2023-06-09T10:36:30.730+0000 7ff7cd1d9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45739) UID: 0 2023-06-09T10:36:30.746 INFO:tasks.ceph.osd.2.smithi062.stderr:2023-06-09T10:36:30.737+0000 7f9e3696d700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 463476) UID: 0 2023-06-09T10:36:30.747 INFO:tasks.ceph.osd.0.smithi062.stderr:2023-06-09T10:36:30.737+0000 7fa052e46700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 463476) UID: 0 2023-06-09T10:36:30.747 INFO:tasks.ceph.osd.3.smithi062.stderr:2023-06-09T10:36:30.737+0000 7fb4af5ce700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 463476) UID: 0 2023-06-09T10:36:30.749 INFO:tasks.ceph.osd.1.smithi062.stderr:2023-06-09T10:36:30.741+0000 7f51ef5ce700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 463476) UID: 0 2023-06-09T10:40:46.938 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:40:46.944 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:41:17.186 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:41:17.191 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:41:17.259 INFO:tasks.ceph.osd.6.smithi089.stderr:2023-06-09T10:41:17.252+0000 7f683358f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45755) UID: 0 2023-06-09T10:41:17.260 INFO:tasks.ceph.osd.7.smithi089.stderr:2023-06-09T10:41:17.252+0000 7ff7cd1d9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45755) UID: 0 2023-06-09T10:41:17.261 INFO:tasks.ceph.osd.4.smithi089.stderr:2023-06-09T10:41:17.252+0000 7f3af9fd2700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45755) UID: 0 2023-06-09T10:41:17.261 INFO:tasks.ceph.osd.5.smithi089.stderr:2023-06-09T10:41:17.252+0000 7fa2fe1bb700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45755) UID: 0 2023-06-09T10:45:17.380 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:45:17.385 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:45:17.432 INFO:tasks.ceph.osd.6.smithi089.stderr:2023-06-09T10:45:17.422+0000 7f683358f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45770) UID: 0 2023-06-09T10:45:17.432 INFO:tasks.ceph.osd.4.smithi089.stderr:2023-06-09T10:45:17.422+0000 7f3af9fd2700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45770) UID: 0 2023-06-09T10:45:17.433 INFO:tasks.ceph.osd.7.smithi089.stderr:2023-06-09T10:45:17.422+0000 7ff7cd1d9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45770) UID: 0 2023-06-09T10:45:17.433 INFO:tasks.ceph.osd.5.smithi089.stderr:2023-06-09T10:45:17.426+0000 7fa2fe1bb700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45770) UID: 0 2023-06-09T10:45:17.440 INFO:tasks.ceph.osd.2.smithi062.stderr:2023-06-09T10:45:17.433+0000 7f9e3696d700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 463512) UID: 0 2023-06-09T10:45:17.440 INFO:tasks.ceph.osd.3.smithi062.stderr:2023-06-09T10:45:17.433+0000 7fb4af5ce700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 463512) UID: 0 2023-06-09T10:45:17.441 INFO:tasks.ceph.osd.0.smithi062.stderr:2023-06-09T10:45:17.433+0000 7fa052e46700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 463512) UID: 0 2023-06-09T10:45:17.441 INFO:tasks.ceph.osd.1.smithi062.stderr:2023-06-09T10:45:17.433+0000 7f51ef5ce700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 463512) UID: 0 2023-06-09T10:49:55.936 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:49:55.942 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:49:56.017 INFO:tasks.ceph.osd.3.smithi062.stderr:2023-06-09T10:49:56.009+0000 7fb4af5ce700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 463524) UID: 0 2023-06-09T10:49:56.018 INFO:tasks.ceph.osd.0.smithi062.stderr:2023-06-09T10:49:56.009+0000 7fa052e46700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 463524) UID: 0 2023-06-09T10:49:56.018 INFO:tasks.ceph.osd.2.smithi062.stderr:2023-06-09T10:49:56.009+0000 7f9e3696d700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 463524) UID: 0 2023-06-09T10:49:56.019 INFO:tasks.ceph.osd.1.smithi062.stderr:2023-06-09T10:49:56.009+0000 7f51ef5ce700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 463524) UID: 0 2023-06-09T10:54:25.573 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:54:25.579 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:54:55.724 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:54:55.729 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:55:25.812 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:55:25.818 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:55:55.946 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:55:55.952 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:56:26.023 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:56:26.028 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:56:56.109 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:56:56.114 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T10:56:56.156 INFO:tasks.ceph.osd.7.smithi089.stderr:2023-06-09T10:56:56.151+0000 7ff7cd1d9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45812) UID: 0 2023-06-09T10:56:56.157 INFO:tasks.ceph.osd.5.smithi089.stderr:2023-06-09T10:56:56.151+0000 7fa2fe1bb700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45812) UID: 0 2023-06-09T10:56:56.157 INFO:tasks.ceph.osd.6.smithi089.stderr:2023-06-09T10:56:56.151+0000 7f683358f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45812) UID: 0 2023-06-09T10:56:56.158 INFO:tasks.ceph.osd.4.smithi089.stderr:2023-06-09T10:56:56.151+0000 7f3af9fd2700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45812) UID: 0 2023-06-09T11:00:49.390 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:00:49.397 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:01:19.542 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:01:19.548 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:01:49.647 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:01:49.657 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:02:19.815 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:02:19.820 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:02:49.934 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:02:49.938 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:03:20.586 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:03:20.591 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:03:50.651 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:03:50.658 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:04:20.810 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:04:20.814 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:04:51.498 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:04:51.504 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:05:21.571 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:05:21.577 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:05:51.660 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:05:51.665 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:06:22.259 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:06:22.265 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:06:52.337 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:06:52.344 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:07:22.412 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:07:22.417 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:07:29.382 INFO:teuthology.orchestra.run.smithi062.stdout:generic/522 4170s 2023-06-09T11:07:29.506 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/522 2023-06-09T11:07:29.506 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T11:07:29.520 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T11:07:29.756 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:07:29.757 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/523) 2023-06-09T11:07:31.566 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T11:07:31.585 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:07:31.587 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T11:07:31.592 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T11:07:31.592 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T11:07:34.004 INFO:teuthology.orchestra.run.smithi062.stdout:generic/523 2s 2023-06-09T11:07:34.040 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/523 2023-06-09T11:07:34.041 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T11:07:34.054 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T11:07:34.098 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:07:34.098 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/524) 2023-06-09T11:07:34.799 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T11:07:34.813 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:07:34.815 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T11:07:34.819 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T11:07:34.820 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T11:07:43.757 INFO:teuthology.orchestra.run.smithi062.stdout:generic/524 8s 2023-06-09T11:07:43.785 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/524 2023-06-09T11:07:43.785 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T11:07:43.796 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T11:07:43.835 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:07:43.836 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/525) 2023-06-09T11:07:44.543 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T11:07:44.557 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:07:44.559 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T11:07:44.562 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T11:07:44.563 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T11:07:45.740 INFO:teuthology.orchestra.run.smithi062.stdout:generic/525 [not run] filesystem does not support huge file size 2023-06-09T11:07:45.829 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/525 2023-06-09T11:07:45.829 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/525 2023-06-09T11:07:45.829 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T11:07:45.840 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T11:07:45.939 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:07:45.940 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/526) 2023-06-09T11:07:46.623 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T11:07:46.641 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:07:46.644 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T11:07:46.648 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T11:07:46.648 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T11:07:47.655 INFO:teuthology.orchestra.run.smithi062.stdout:generic/526 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-06-09T11:07:47.672 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/526 2023-06-09T11:07:47.672 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/526 2023-06-09T11:07:47.673 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T11:07:47.683 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T11:07:47.790 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:07:47.791 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/527) 2023-06-09T11:07:48.537 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T11:07:48.554 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:07:48.555 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T11:07:48.558 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T11:07:48.559 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T11:07:49.538 INFO:teuthology.orchestra.run.smithi062.stdout:generic/527 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-06-09T11:07:49.554 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/527 2023-06-09T11:07:49.554 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/527 2023-06-09T11:07:49.554 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T11:07:49.567 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T11:07:49.655 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:07:49.656 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/528) 2023-06-09T11:07:50.384 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T11:07:50.400 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:07:50.401 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T11:07:50.405 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T11:07:50.405 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T11:07:51.559 INFO:teuthology.orchestra.run.smithi062.stdout:generic/528 1s 2023-06-09T11:07:51.587 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/528 2023-06-09T11:07:51.587 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T11:07:51.596 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T11:07:52.020 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:07:52.020 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/529) 2023-06-09T11:07:52.515 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:07:52.521 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:07:52.882 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T11:07:52.904 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:07:52.905 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T11:07:52.910 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T11:07:52.910 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T11:07:54.371 INFO:teuthology.orchestra.run.smithi062.stdout:generic/529 1s 2023-06-09T11:07:54.399 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/529 2023-06-09T11:07:54.400 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T11:07:54.411 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T11:07:54.445 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:07:54.445 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/530) 2023-06-09T11:07:55.174 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T11:07:55.193 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:07:55.194 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T11:07:55.198 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T11:07:55.198 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T11:07:56.302 INFO:teuthology.orchestra.run.smithi062.stdout:generic/530 [not run] ceph does not support shutdown 2023-06-09T11:07:56.377 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/530 2023-06-09T11:07:56.377 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/530 2023-06-09T11:07:56.377 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T11:07:56.388 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T11:07:56.478 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:07:56.479 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/531) 2023-06-09T11:07:57.184 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T11:07:57.203 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:07:57.205 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T11:07:57.208 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T11:07:57.208 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T11:07:58.207 INFO:teuthology.orchestra.run.smithi062.stdout:generic/531 [not run] O_TMPFILE is not supported 2023-06-09T11:07:58.227 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/531 2023-06-09T11:07:58.227 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/531 2023-06-09T11:07:58.227 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T11:07:58.237 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T11:07:58.318 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:07:58.318 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/532) 2023-06-09T11:07:59.039 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T11:07:59.059 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:07:59.060 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T11:07:59.064 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T11:07:59.064 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T11:08:00.091 INFO:teuthology.orchestra.run.smithi062.stdout:generic/532 1s 2023-06-09T11:08:00.121 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/532 2023-06-09T11:08:00.122 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T11:08:00.131 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T11:08:00.238 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:08:00.238 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/533) 2023-06-09T11:08:00.991 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T11:08:01.011 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:08:01.013 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T11:08:01.017 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T11:08:01.018 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T11:08:02.874 INFO:teuthology.orchestra.run.smithi062.stdout:generic/533 1s 2023-06-09T11:08:02.897 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/533 2023-06-09T11:08:02.897 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T11:08:02.911 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T11:08:03.000 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:08:03.000 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/534) 2023-06-09T11:08:03.712 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T11:08:03.732 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:08:03.734 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T11:08:03.739 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T11:08:03.739 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T11:08:04.679 INFO:teuthology.orchestra.run.smithi062.stdout:generic/534 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-06-09T11:08:04.697 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/534 2023-06-09T11:08:04.697 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/534 2023-06-09T11:08:04.697 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T11:08:04.708 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T11:08:04.801 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:08:04.802 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/535) 2023-06-09T11:08:05.527 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T11:08:05.547 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:08:05.549 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T11:08:05.555 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T11:08:05.555 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T11:08:06.422 INFO:teuthology.orchestra.run.smithi062.stdout:generic/535 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-06-09T11:08:06.439 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/535 2023-06-09T11:08:06.439 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/535 2023-06-09T11:08:06.440 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T11:08:06.451 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T11:08:06.564 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:08:06.565 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/536) 2023-06-09T11:08:07.324 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T11:08:07.342 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:08:07.347 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T11:08:07.351 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T11:08:07.351 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T11:08:08.722 INFO:teuthology.orchestra.run.smithi062.stdout:generic/536 [not run] ceph does not support shutdown 2023-06-09T11:08:08.803 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/536 2023-06-09T11:08:08.803 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/536 2023-06-09T11:08:08.803 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T11:08:08.811 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T11:08:08.888 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:08:08.889 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/537) 2023-06-09T11:08:09.593 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T11:08:09.612 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:08:09.613 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T11:08:09.618 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T11:08:09.618 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T11:08:10.744 INFO:teuthology.orchestra.run.smithi062.stdout:generic/537 [not run] FSTRIM not supported 2023-06-09T11:08:10.823 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/537 2023-06-09T11:08:10.823 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/537 2023-06-09T11:08:10.824 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T11:08:10.836 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T11:08:10.924 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:08:10.924 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/538) 2023-06-09T11:08:11.641 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T11:08:11.661 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:08:11.663 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T11:08:11.668 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T11:08:11.668 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T11:08:22.630 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:08:22.635 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:08:53.687 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:08:53.693 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:09:23.757 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:09:23.762 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:09:54.398 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:09:54.404 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:10:24.542 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:10:24.547 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:10:25.006 INFO:tasks.ceph.osd.2.smithi062.stderr:2023-06-09T11:10:24.998+0000 7f9e3696d700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 472621) UID: 0 2023-06-09T11:10:25.007 INFO:tasks.ceph.osd.0.smithi062.stderr:2023-06-09T11:10:24.998+0000 7fa052e46700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 472621) UID: 0 2023-06-09T11:10:25.007 INFO:tasks.ceph.osd.1.smithi062.stderr:2023-06-09T11:10:24.998+0000 7f51ef5ce700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 472621) UID: 0 2023-06-09T11:10:25.007 INFO:tasks.ceph.osd.3.smithi062.stderr:2023-06-09T11:10:24.998+0000 7fb4af5ce700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 472621) UID: 0 2023-06-09T11:14:35.863 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:14:35.869 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:14:36.856 INFO:tasks.ceph.osd.7.smithi089.stderr:2023-06-09T11:14:36.845+0000 7ff7cd1d9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46180) UID: 0 2023-06-09T11:14:36.857 INFO:tasks.ceph.osd.4.smithi089.stderr:2023-06-09T11:14:36.845+0000 7f3af9fd2700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46180) UID: 0 2023-06-09T11:14:36.857 INFO:tasks.ceph.osd.6.smithi089.stderr:2023-06-09T11:14:36.845+0000 7f683358f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46180) UID: 0 2023-06-09T11:14:36.857 INFO:tasks.ceph.osd.5.smithi089.stderr:2023-06-09T11:14:36.845+0000 7fa2fe1bb700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46180) UID: 0 2023-06-09T11:18:37.766 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:18:37.772 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:19:07.847 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:19:07.853 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:19:37.933 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:19:37.938 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:20:08.924 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:20:08.929 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:20:39.005 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:20:39.012 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:21:09.085 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:21:09.090 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:21:39.166 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:21:39.174 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:21:39.222 INFO:tasks.ceph.osd.0.smithi062.stderr:2023-06-09T11:21:39.212+0000 7fa052e46700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 477741) UID: 0 2023-06-09T11:21:39.222 INFO:tasks.ceph.osd.2.smithi062.stderr:2023-06-09T11:21:39.212+0000 7f9e3696d700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 477741) UID: 0 2023-06-09T11:21:39.223 INFO:tasks.ceph.osd.3.smithi062.stderr:2023-06-09T11:21:39.212+0000 7fb4af5ce700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 477741) UID: 0 2023-06-09T11:21:39.223 INFO:tasks.ceph.osd.1.smithi062.stderr:2023-06-09T11:21:39.212+0000 7f51ef5ce700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 477741) UID: 0 2023-06-09T11:22:10.815 INFO:teuthology.orchestra.run.smithi062.stdout:generic/538 838s 2023-06-09T11:22:10.838 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/538 2023-06-09T11:22:10.839 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T11:22:10.851 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T11:22:11.115 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:22:11.116 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/539) 2023-06-09T11:22:12.195 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T11:22:12.214 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:22:12.216 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T11:22:12.220 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T11:22:12.220 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T11:22:17.356 INFO:teuthology.orchestra.run.smithi062.stdout:generic/539 5s 2023-06-09T11:22:17.386 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/539 2023-06-09T11:22:17.386 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T11:22:17.396 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T11:22:17.794 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:22:17.795 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/540) 2023-06-09T11:22:18.664 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T11:22:18.685 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:22:18.687 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T11:22:18.692 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T11:22:18.693 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T11:22:20.801 INFO:teuthology.orchestra.run.smithi062.stdout:generic/540 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T11:22:20.825 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/540 2023-06-09T11:22:20.825 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/540 2023-06-09T11:22:20.825 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T11:22:20.841 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T11:22:21.028 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:22:21.028 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/541) 2023-06-09T11:22:21.829 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T11:22:21.849 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:22:21.851 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T11:22:21.856 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T11:22:21.857 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T11:22:23.321 INFO:teuthology.orchestra.run.smithi062.stdout:generic/541 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T11:22:23.343 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/541 2023-06-09T11:22:23.343 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/541 2023-06-09T11:22:23.344 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T11:22:23.355 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T11:22:23.577 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:22:23.577 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/542) 2023-06-09T11:22:24.327 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T11:22:24.345 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:22:24.348 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T11:22:24.353 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T11:22:24.353 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T11:22:25.889 INFO:teuthology.orchestra.run.smithi062.stdout:generic/542 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T11:22:26.024 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/542 2023-06-09T11:22:26.024 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/542 2023-06-09T11:22:26.024 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T11:22:26.038 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T11:22:26.267 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:22:26.268 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/543) 2023-06-09T11:22:27.093 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T11:22:27.116 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:22:27.118 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T11:22:27.121 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T11:22:27.122 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T11:22:28.896 INFO:teuthology.orchestra.run.smithi062.stdout:generic/543 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T11:22:29.056 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/543 2023-06-09T11:22:29.057 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/543 2023-06-09T11:22:29.057 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T11:22:29.074 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T11:22:29.217 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:22:29.217 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/544) 2023-06-09T11:22:29.935 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T11:22:29.955 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:22:29.957 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T11:22:29.961 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T11:22:29.962 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T11:22:31.408 INFO:teuthology.orchestra.run.smithi062.stdout:generic/544 [not run] Reflink not supported by scratch filesystem type: ceph 2023-06-09T11:22:31.432 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/544 2023-06-09T11:22:31.433 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/544 2023-06-09T11:22:31.433 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T11:22:31.508 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T11:22:31.890 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:22:31.891 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/545) 2023-06-09T11:22:32.631 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T11:22:32.652 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:22:32.654 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T11:22:32.659 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T11:22:32.659 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T11:22:33.772 INFO:teuthology.orchestra.run.smithi062.stdout:generic/545 [not run] file system doesn't support chattr +i 2023-06-09T11:22:33.795 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/545 2023-06-09T11:22:33.796 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/545 2023-06-09T11:22:33.796 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T11:22:33.806 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T11:22:33.925 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:22:33.925 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/546) 2023-06-09T11:22:34.745 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T11:22:34.767 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:22:34.768 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T11:22:34.773 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T11:22:34.773 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T11:22:36.157 INFO:teuthology.orchestra.run.smithi062.stdout:generic/546 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-06-09T11:22:36.180 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/546 2023-06-09T11:22:36.180 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/546 2023-06-09T11:22:36.180 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T11:22:36.189 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T11:22:36.316 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:22:36.316 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/547) 2023-06-09T11:22:37.054 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T11:22:37.074 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:22:37.077 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T11:22:37.082 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T11:22:37.082 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T11:22:38.403 INFO:teuthology.orchestra.run.smithi062.stdout:generic/547 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-06-09T11:22:38.421 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/547 2023-06-09T11:22:38.421 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/547 2023-06-09T11:22:38.421 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T11:22:38.439 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T11:22:38.531 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:22:38.532 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/548) 2023-06-09T11:22:39.232 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T11:22:39.248 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:22:39.251 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T11:22:39.256 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T11:22:39.256 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T11:22:41.775 INFO:teuthology.orchestra.run.smithi062.stdout:generic/548 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-06-09T11:22:41.795 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/548 2023-06-09T11:22:41.795 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/548 2023-06-09T11:22:41.795 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T11:22:41.810 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T11:22:41.920 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:22:41.920 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/549) 2023-06-09T11:22:42.674 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T11:22:42.696 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:22:42.698 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T11:22:42.704 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T11:22:42.704 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T11:22:45.965 INFO:teuthology.orchestra.run.smithi062.stdout:generic/549 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-06-09T11:22:45.985 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/549 2023-06-09T11:22:45.985 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/549 2023-06-09T11:22:45.985 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T11:22:45.995 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T11:22:46.098 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:22:46.098 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/550) 2023-06-09T11:22:46.759 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T11:22:46.774 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:22:46.776 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T11:22:46.780 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T11:22:46.780 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T11:22:48.407 INFO:teuthology.orchestra.run.smithi062.stdout:generic/550 [not run] encryption policy '-c 9 -n 9 -f 0' is unusable; probably missing kernel crypto API support 2023-06-09T11:22:48.507 INFO:teuthology.orchestra.run.smithi062.stdout:Ran: generic/550 2023-06-09T11:22:48.507 INFO:teuthology.orchestra.run.smithi062.stdout:Not run: generic/550 2023-06-09T11:22:48.507 INFO:teuthology.orchestra.run.smithi062.stdout:Passed all 1 tests 2023-06-09T11:22:48.518 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T11:22:48.603 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-06-09T11:22:48.603 DEBUG:teuthology.orchestra.run.smithi062:> (cd /tmp/tmp.VpYa8kRkcExfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/551) 2023-06-09T11:22:49.364 INFO:teuthology.orchestra.run.smithi062.stdout:FSTYP -- ceph 2023-06-09T11:22:49.385 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM -- Linux/x86_64 smithi062 6.4.0-rc2-g10b2f20a4f46 #1 SMP PREEMPT_DYNAMIC Thu Jun 1 02:28:37 UTC 2023 2023-06-09T11:22:49.387 INFO:teuthology.orchestra.run.smithi062.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-06-09T11:22:49.390 INFO:teuthology.orchestra.run.smithi062.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAYrYJktsYyKRAAVggDLdkn6SYj5CYdlPptuw== 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch 2023-06-09T11:22:49.390 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T11:26:41.827 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:26:41.835 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:26:42.123 INFO:tasks.ceph.osd.0.smithi062.stderr:2023-06-09T11:26:42.112+0000 7fa052e46700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 485994) UID: 0 2023-06-09T11:26:42.124 INFO:tasks.ceph.osd.3.smithi062.stderr:2023-06-09T11:26:42.112+0000 7fb4af5ce700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 485994) UID: 0 2023-06-09T11:26:42.124 INFO:tasks.ceph.osd.1.smithi062.stderr:2023-06-09T11:26:42.112+0000 7f51ef5ce700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 485994) UID: 0 2023-06-09T11:26:42.145 INFO:tasks.ceph.osd.2.smithi062.stderr:2023-06-09T11:26:42.112+0000 7f9e3696d700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 485994) UID: 0 2023-06-09T11:31:48.546 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:31:48.554 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:31:48.616 INFO:tasks.ceph.osd.6.smithi089.stderr:2023-06-09T11:31:48.607+0000 7f683358f700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48275) UID: 0 2023-06-09T11:31:48.617 INFO:tasks.ceph.osd.4.smithi089.stderr:2023-06-09T11:31:48.607+0000 7f3af9fd2700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48275) UID: 0 2023-06-09T11:31:48.617 INFO:tasks.ceph.osd.7.smithi089.stderr:2023-06-09T11:31:48.607+0000 7ff7cd1d9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48275) UID: 0 2023-06-09T11:31:48.618 INFO:tasks.ceph.osd.5.smithi089.stderr:2023-06-09T11:31:48.607+0000 7fa2fe1bb700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48275) UID: 0 2023-06-09T11:31:48.765 INFO:tasks.ceph.mds.a.smithi062.stderr:2023-06-09T11:31:48.755+0000 7fafd2fdc700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 486559) UID: 0 2023-06-09T11:31:48.765 INFO:tasks.ceph.mds.c.smithi062.stderr:2023-06-09T11:31:48.755+0000 7f506cdd7700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 486559) UID: 0 2023-06-09T11:35:56.078 INFO:tasks.ceph.osd.2.smithi062.stderr:2023-06-09T11:35:56.067+0000 7f9e3696d700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 487110) UID: 0 2023-06-09T11:35:56.079 INFO:tasks.ceph.osd.3.smithi062.stderr:2023-06-09T11:35:56.067+0000 7fb4af5ce700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 487110) UID: 0 2023-06-09T11:35:56.079 INFO:tasks.ceph.osd.0.smithi062.stderr:2023-06-09T11:35:56.067+0000 7fa052e46700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 487110) UID: 0 2023-06-09T11:35:56.079 INFO:tasks.ceph.osd.1.smithi062.stderr:2023-06-09T11:35:56.067+0000 7f51ef5ce700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 487110) UID: 0 2023-06-09T11:38:26.014 INFO:tasks.ceph.osd.6.smithi089.stderr:2023-06-09T11:38:26.006+0000 7f68295ef700 -1 bdev(0x55a6164fce00 /var/lib/ceph/osd/ceph-6/block) _aio_thread got r=-28 ((28) No space left on device) 2023-06-09T11:38:26.458 INFO:tasks.ceph.osd.6.smithi089.stderr:/build/ceph-18.0.0-4313-ga02638f8/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f68295ef700 time 2023-06-09T11:38:26.108776+0000 2023-06-09T11:38:26.459 INFO:tasks.ceph.osd.6.smithi089.stderr:/build/ceph-18.0.0-4313-ga02638f8/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2023-06-09T11:38:26.478 INFO:tasks.ceph.osd.6.smithi089.stderr: ceph version 18.0.0-4313-ga02638f8 (a02638f808b8fe11bccdd01222c0e6e2eb71120b) reef (dev) 2023-06-09T11:38:26.478 INFO:tasks.ceph.osd.6.smithi089.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x55a613dbc785] 2023-06-09T11:38:26.478 INFO:tasks.ceph.osd.6.smithi089.stderr: 2: (KernelDevice::_aio_thread()+0xe41) [0x55a6149543b1] 2023-06-09T11:38:26.478 INFO:tasks.ceph.osd.6.smithi089.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55a614959e81] 2023-06-09T11:38:26.479 INFO:tasks.ceph.osd.6.smithi089.stderr: 4: /lib/x86_64-linux-gnu/libpthread.so.0(+0x8609) [0x7f6837c66609] 2023-06-09T11:38:26.479 INFO:tasks.ceph.osd.6.smithi089.stderr: 5: clone() 2023-06-09T11:38:26.479 INFO:tasks.ceph.osd.6.smithi089.stderr:2023-06-09T11:38:26.470+0000 7f68295ef700 -1 /build/ceph-18.0.0-4313-ga02638f8/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f68295ef700 time 2023-06-09T11:38:26.108776+0000 2023-06-09T11:38:26.479 INFO:tasks.ceph.osd.6.smithi089.stderr:/build/ceph-18.0.0-4313-ga02638f8/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2023-06-09T11:38:26.479 INFO:tasks.ceph.osd.6.smithi089.stderr: 2023-06-09T11:38:26.479 INFO:tasks.ceph.osd.6.smithi089.stderr: ceph version 18.0.0-4313-ga02638f8 (a02638f808b8fe11bccdd01222c0e6e2eb71120b) reef (dev) 2023-06-09T11:38:26.480 INFO:tasks.ceph.osd.6.smithi089.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x55a613dbc785] 2023-06-09T11:38:26.480 INFO:tasks.ceph.osd.6.smithi089.stderr: 2: (KernelDevice::_aio_thread()+0xe41) [0x55a6149543b1] 2023-06-09T11:38:26.480 INFO:tasks.ceph.osd.6.smithi089.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55a614959e81] 2023-06-09T11:38:26.480 INFO:tasks.ceph.osd.6.smithi089.stderr: 4: /lib/x86_64-linux-gnu/libpthread.so.0(+0x8609) [0x7f6837c66609] 2023-06-09T11:38:26.480 INFO:tasks.ceph.osd.6.smithi089.stderr: 5: clone() 2023-06-09T11:38:26.480 INFO:tasks.ceph.osd.6.smithi089.stderr: 2023-06-09T11:38:26.480 INFO:tasks.ceph.osd.6.smithi089.stderr:*** Caught signal (Aborted) ** 2023-06-09T11:38:26.481 INFO:tasks.ceph.osd.6.smithi089.stderr: in thread 7f68295ef700 thread_name:bstore_aio 2023-06-09T11:38:26.500 INFO:tasks.ceph.osd.6.smithi089.stderr: ceph version 18.0.0-4313-ga02638f8 (a02638f808b8fe11bccdd01222c0e6e2eb71120b) reef (dev) 2023-06-09T11:38:26.501 INFO:tasks.ceph.osd.6.smithi089.stderr: 1: /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420) [0x7f6837c72420] 2023-06-09T11:38:26.501 INFO:tasks.ceph.osd.6.smithi089.stderr: 2: gsignal() 2023-06-09T11:38:26.501 INFO:tasks.ceph.osd.6.smithi089.stderr: 3: abort() 2023-06-09T11:38:26.501 INFO:tasks.ceph.osd.6.smithi089.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x190) [0x55a613dbc83e] 2023-06-09T11:38:26.501 INFO:tasks.ceph.osd.6.smithi089.stderr: 5: (KernelDevice::_aio_thread()+0xe41) [0x55a6149543b1] 2023-06-09T11:38:26.501 INFO:tasks.ceph.osd.6.smithi089.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55a614959e81] 2023-06-09T11:38:26.502 INFO:tasks.ceph.osd.6.smithi089.stderr: 7: /lib/x86_64-linux-gnu/libpthread.so.0(+0x8609) [0x7f6837c66609] 2023-06-09T11:38:26.502 INFO:tasks.ceph.osd.6.smithi089.stderr: 8: clone() 2023-06-09T11:38:26.529 INFO:tasks.ceph.osd.6.smithi089.stderr:2023-06-09T11:38:26.522+0000 7f68295ef700 -1 *** Caught signal (Aborted) ** 2023-06-09T11:38:26.529 INFO:tasks.ceph.osd.6.smithi089.stderr: in thread 7f68295ef700 thread_name:bstore_aio 2023-06-09T11:38:26.529 INFO:tasks.ceph.osd.6.smithi089.stderr: 2023-06-09T11:38:26.529 INFO:tasks.ceph.osd.6.smithi089.stderr: ceph version 18.0.0-4313-ga02638f8 (a02638f808b8fe11bccdd01222c0e6e2eb71120b) reef (dev) 2023-06-09T11:38:26.529 INFO:tasks.ceph.osd.6.smithi089.stderr: 1: /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420) [0x7f6837c72420] 2023-06-09T11:38:26.529 INFO:tasks.ceph.osd.6.smithi089.stderr: 2: gsignal() 2023-06-09T11:38:26.530 INFO:tasks.ceph.osd.6.smithi089.stderr: 3: abort() 2023-06-09T11:38:26.530 INFO:tasks.ceph.osd.6.smithi089.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x190) [0x55a613dbc83e] 2023-06-09T11:38:26.530 INFO:tasks.ceph.osd.6.smithi089.stderr: 5: (KernelDevice::_aio_thread()+0xe41) [0x55a6149543b1] 2023-06-09T11:38:26.530 INFO:tasks.ceph.osd.6.smithi089.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55a614959e81] 2023-06-09T11:38:26.530 INFO:tasks.ceph.osd.6.smithi089.stderr: 7: /lib/x86_64-linux-gnu/libpthread.so.0(+0x8609) [0x7f6837c66609] 2023-06-09T11:38:26.530 INFO:tasks.ceph.osd.6.smithi089.stderr: 8: clone() 2023-06-09T11:38:26.530 INFO:tasks.ceph.osd.6.smithi089.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-06-09T11:38:26.531 INFO:tasks.ceph.osd.6.smithi089.stderr: 2023-06-09T11:38:26.543 INFO:tasks.ceph.osd.6.smithi089.stderr: -14> 2023-06-09T11:38:26.470+0000 7f68295ef700 -1 /build/ceph-18.0.0-4313-ga02638f8/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f68295ef700 time 2023-06-09T11:38:26.108776+0000 2023-06-09T11:38:26.543 INFO:tasks.ceph.osd.6.smithi089.stderr:/build/ceph-18.0.0-4313-ga02638f8/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2023-06-09T11:38:26.543 INFO:tasks.ceph.osd.6.smithi089.stderr: 2023-06-09T11:38:26.544 INFO:tasks.ceph.osd.6.smithi089.stderr: ceph version 18.0.0-4313-ga02638f8 (a02638f808b8fe11bccdd01222c0e6e2eb71120b) reef (dev) 2023-06-09T11:38:26.544 INFO:tasks.ceph.osd.6.smithi089.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x55a613dbc785] 2023-06-09T11:38:26.544 INFO:tasks.ceph.osd.6.smithi089.stderr: 2: (KernelDevice::_aio_thread()+0xe41) [0x55a6149543b1] 2023-06-09T11:38:26.544 INFO:tasks.ceph.osd.6.smithi089.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55a614959e81] 2023-06-09T11:38:26.544 INFO:tasks.ceph.osd.6.smithi089.stderr: 4: /lib/x86_64-linux-gnu/libpthread.so.0(+0x8609) [0x7f6837c66609] 2023-06-09T11:38:26.544 INFO:tasks.ceph.osd.6.smithi089.stderr: 5: clone() 2023-06-09T11:38:26.544 INFO:tasks.ceph.osd.6.smithi089.stderr: 2023-06-09T11:38:26.545 INFO:tasks.ceph.osd.6.smithi089.stderr: 0> 2023-06-09T11:38:26.522+0000 7f68295ef700 -1 *** Caught signal (Aborted) ** 2023-06-09T11:38:26.545 INFO:tasks.ceph.osd.6.smithi089.stderr: in thread 7f68295ef700 thread_name:bstore_aio 2023-06-09T11:38:26.545 INFO:tasks.ceph.osd.6.smithi089.stderr: 2023-06-09T11:38:26.545 INFO:tasks.ceph.osd.6.smithi089.stderr: ceph version 18.0.0-4313-ga02638f8 (a02638f808b8fe11bccdd01222c0e6e2eb71120b) reef (dev) 2023-06-09T11:38:26.545 INFO:tasks.ceph.osd.6.smithi089.stderr: 1: /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420) [0x7f6837c72420] 2023-06-09T11:38:26.545 INFO:tasks.ceph.osd.6.smithi089.stderr: 2: gsignal() 2023-06-09T11:38:26.545 INFO:tasks.ceph.osd.6.smithi089.stderr: 3: abort() 2023-06-09T11:38:26.546 INFO:tasks.ceph.osd.6.smithi089.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x190) [0x55a613dbc83e] 2023-06-09T11:38:26.546 INFO:tasks.ceph.osd.6.smithi089.stderr: 5: (KernelDevice::_aio_thread()+0xe41) [0x55a6149543b1] 2023-06-09T11:38:26.546 INFO:tasks.ceph.osd.6.smithi089.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55a614959e81] 2023-06-09T11:38:26.546 INFO:tasks.ceph.osd.6.smithi089.stderr: 7: /lib/x86_64-linux-gnu/libpthread.so.0(+0x8609) [0x7f6837c66609] 2023-06-09T11:38:26.546 INFO:tasks.ceph.osd.6.smithi089.stderr: 8: clone() 2023-06-09T11:38:26.546 INFO:tasks.ceph.osd.6.smithi089.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-06-09T11:38:26.546 INFO:tasks.ceph.osd.6.smithi089.stderr: 2023-06-09T11:38:26.577 INFO:tasks.ceph.osd.6.smithi089.stderr: -15> 2023-06-09T11:38:26.470+0000 7f68295ef700 -1 /build/ceph-18.0.0-4313-ga02638f8/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f68295ef700 time 2023-06-09T11:38:26.108776+0000 2023-06-09T11:38:26.577 INFO:tasks.ceph.osd.6.smithi089.stderr:/build/ceph-18.0.0-4313-ga02638f8/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2023-06-09T11:38:26.577 INFO:tasks.ceph.osd.6.smithi089.stderr: 2023-06-09T11:38:26.577 INFO:tasks.ceph.osd.6.smithi089.stderr: ceph version 18.0.0-4313-ga02638f8 (a02638f808b8fe11bccdd01222c0e6e2eb71120b) reef (dev) 2023-06-09T11:38:26.578 INFO:tasks.ceph.osd.6.smithi089.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x55a613dbc785] 2023-06-09T11:38:26.578 INFO:tasks.ceph.osd.6.smithi089.stderr: 2: (KernelDevice::_aio_thread()+0xe41) [0x55a6149543b1] 2023-06-09T11:38:26.578 INFO:tasks.ceph.osd.6.smithi089.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55a614959e81] 2023-06-09T11:38:26.578 INFO:tasks.ceph.osd.6.smithi089.stderr: 4: /lib/x86_64-linux-gnu/libpthread.so.0(+0x8609) [0x7f6837c66609] 2023-06-09T11:38:26.578 INFO:tasks.ceph.osd.6.smithi089.stderr: 5: clone() 2023-06-09T11:38:26.578 INFO:tasks.ceph.osd.6.smithi089.stderr: 2023-06-09T11:38:26.578 INFO:tasks.ceph.osd.6.smithi089.stderr: -1> 2023-06-09T11:38:26.522+0000 7f68295ef700 -1 *** Caught signal (Aborted) ** 2023-06-09T11:38:26.579 INFO:tasks.ceph.osd.6.smithi089.stderr: in thread 7f68295ef700 thread_name:bstore_aio 2023-06-09T11:38:26.579 INFO:tasks.ceph.osd.6.smithi089.stderr: 2023-06-09T11:38:26.579 INFO:tasks.ceph.osd.6.smithi089.stderr: ceph version 18.0.0-4313-ga02638f8 (a02638f808b8fe11bccdd01222c0e6e2eb71120b) reef (dev) 2023-06-09T11:38:26.579 INFO:tasks.ceph.osd.6.smithi089.stderr: 1: /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420) [0x7f6837c72420] 2023-06-09T11:38:26.579 INFO:tasks.ceph.osd.6.smithi089.stderr: 2: gsignal() 2023-06-09T11:38:26.579 INFO:tasks.ceph.osd.6.smithi089.stderr: 3: abort() 2023-06-09T11:38:26.579 INFO:tasks.ceph.osd.6.smithi089.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x190) [0x55a613dbc83e] 2023-06-09T11:38:26.579 INFO:tasks.ceph.osd.6.smithi089.stderr: 5: (KernelDevice::_aio_thread()+0xe41) [0x55a6149543b1] 2023-06-09T11:38:26.580 INFO:tasks.ceph.osd.6.smithi089.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55a614959e81] 2023-06-09T11:38:26.580 INFO:tasks.ceph.osd.6.smithi089.stderr: 7: /lib/x86_64-linux-gnu/libpthread.so.0(+0x8609) [0x7f6837c66609] 2023-06-09T11:38:26.580 INFO:tasks.ceph.osd.6.smithi089.stderr: 8: clone() 2023-06-09T11:38:26.580 INFO:tasks.ceph.osd.6.smithi089.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-06-09T11:38:26.580 INFO:tasks.ceph.osd.6.smithi089.stderr: 2023-06-09T11:38:27.299 INFO:tasks.ceph.osd.6.smithi089.stderr:daemon-helper: command failed with exit status 5 2023-06-09T11:38:29.985 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2023-06-09T11:38:36.611 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~7s 2023-06-09T11:38:43.221 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~13s 2023-06-09T11:38:49.831 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~20s 2023-06-09T11:38:56.439 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~26s 2023-06-09T11:39:03.046 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~33s 2023-06-09T11:39:09.654 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~40s 2023-06-09T11:39:16.261 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~46s 2023-06-09T11:39:22.870 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~53s 2023-06-09T11:39:29.477 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~59s 2023-06-09T11:39:36.085 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~66s 2023-06-09T11:39:42.692 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~73s 2023-06-09T11:39:49.300 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~79s 2023-06-09T11:39:55.909 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~86s 2023-06-09T11:40:02.520 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~93s 2023-06-09T11:40:09.127 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~99s 2023-06-09T11:40:15.736 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~106s 2023-06-09T11:40:22.346 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~112s 2023-06-09T11:40:28.955 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~119s 2023-06-09T11:40:35.562 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~126s 2023-06-09T11:40:42.172 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~132s 2023-06-09T11:40:48.780 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~139s 2023-06-09T11:40:55.387 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~145s 2023-06-09T11:41:01.996 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~152s 2023-06-09T11:41:08.603 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~159s 2023-06-09T11:41:15.211 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~165s 2023-06-09T11:41:21.818 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~172s 2023-06-09T11:41:28.426 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~178s 2023-06-09T11:41:35.034 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~185s 2023-06-09T11:41:41.642 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~192s 2023-06-09T11:41:43.844 INFO:tasks.ceph.osd.0.smithi062.stderr:2023-06-09T11:41:43.838+0000 7fa048def700 -1 bdev(0x5586c9b9ee00 /var/lib/ceph/osd/ceph-0/block) _aio_thread got r=-28 ((28) No space left on device) 2023-06-09T11:41:44.902 INFO:tasks.ceph.osd.0.smithi062.stderr:/build/ceph-18.0.0-4313-ga02638f8/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7fa048def700 time 2023-06-09T11:41:43.878296+0000 2023-06-09T11:41:44.903 INFO:tasks.ceph.osd.0.smithi062.stderr:/build/ceph-18.0.0-4313-ga02638f8/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2023-06-09T11:41:44.998 INFO:tasks.ceph.osd.0.smithi062.stderr: ceph version 18.0.0-4313-ga02638f8 (a02638f808b8fe11bccdd01222c0e6e2eb71120b) reef (dev) 2023-06-09T11:41:44.998 INFO:tasks.ceph.osd.0.smithi062.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x5586c6681785] 2023-06-09T11:41:44.998 INFO:tasks.ceph.osd.0.smithi062.stderr: 2: (KernelDevice::_aio_thread()+0xe41) [0x5586c72193b1] 2023-06-09T11:41:44.999 INFO:tasks.ceph.osd.0.smithi062.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x5586c721ee81] 2023-06-09T11:41:44.999 INFO:tasks.ceph.osd.0.smithi062.stderr: 4: /lib/x86_64-linux-gnu/libpthread.so.0(+0x8609) [0x7fa05751c609] 2023-06-09T11:41:44.999 INFO:tasks.ceph.osd.0.smithi062.stderr: 5: clone() 2023-06-09T11:41:44.999 INFO:tasks.ceph.osd.0.smithi062.stderr:*** Caught signal (Aborted) ** 2023-06-09T11:41:44.999 INFO:tasks.ceph.osd.0.smithi062.stderr: in thread 7fa048def700 thread_name:bstore_aio 2023-06-09T11:41:44.999 INFO:tasks.ceph.osd.0.smithi062.stderr:2023-06-09T11:41:44.966+0000 7fa048def700 -1 /build/ceph-18.0.0-4313-ga02638f8/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7fa048def700 time 2023-06-09T11:41:43.878296+0000 2023-06-09T11:41:44.999 INFO:tasks.ceph.osd.0.smithi062.stderr:/build/ceph-18.0.0-4313-ga02638f8/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2023-06-09T11:41:45.000 INFO:tasks.ceph.osd.0.smithi062.stderr: 2023-06-09T11:41:45.000 INFO:tasks.ceph.osd.0.smithi062.stderr: ceph version 18.0.0-4313-ga02638f8 (a02638f808b8fe11bccdd01222c0e6e2eb71120b) reef (dev) 2023-06-09T11:41:45.000 INFO:tasks.ceph.osd.0.smithi062.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x5586c6681785] 2023-06-09T11:41:45.000 INFO:tasks.ceph.osd.0.smithi062.stderr: 2: (KernelDevice::_aio_thread()+0xe41) [0x5586c72193b1] 2023-06-09T11:41:45.000 INFO:tasks.ceph.osd.0.smithi062.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x5586c721ee81] 2023-06-09T11:41:45.000 INFO:tasks.ceph.osd.0.smithi062.stderr: 4: /lib/x86_64-linux-gnu/libpthread.so.0(+0x8609) [0x7fa05751c609] 2023-06-09T11:41:45.001 INFO:tasks.ceph.osd.0.smithi062.stderr: 5: clone() 2023-06-09T11:41:45.001 INFO:tasks.ceph.osd.0.smithi062.stderr: 2023-06-09T11:41:45.019 INFO:tasks.ceph.osd.0.smithi062.stderr: ceph version 18.0.0-4313-ga02638f8 (a02638f808b8fe11bccdd01222c0e6e2eb71120b) reef (dev) 2023-06-09T11:41:45.019 INFO:tasks.ceph.osd.0.smithi062.stderr: 1: /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420) [0x7fa057528420] 2023-06-09T11:41:45.019 INFO:tasks.ceph.osd.0.smithi062.stderr: 2: gsignal() 2023-06-09T11:41:45.020 INFO:tasks.ceph.osd.0.smithi062.stderr: 3: abort() 2023-06-09T11:41:45.020 INFO:tasks.ceph.osd.0.smithi062.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x190) [0x5586c668183e] 2023-06-09T11:41:45.020 INFO:tasks.ceph.osd.0.smithi062.stderr: 5: (KernelDevice::_aio_thread()+0xe41) [0x5586c72193b1] 2023-06-09T11:41:45.020 INFO:tasks.ceph.osd.0.smithi062.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x5586c721ee81] 2023-06-09T11:41:45.020 INFO:tasks.ceph.osd.0.smithi062.stderr: 7: /lib/x86_64-linux-gnu/libpthread.so.0(+0x8609) [0x7fa05751c609] 2023-06-09T11:41:45.020 INFO:tasks.ceph.osd.0.smithi062.stderr: 8: clone() 2023-06-09T11:41:45.080 INFO:tasks.ceph.osd.0.smithi062.stderr:2023-06-09T11:41:45.074+0000 7fa048def700 -1 *** Caught signal (Aborted) ** 2023-06-09T11:41:45.080 INFO:tasks.ceph.osd.0.smithi062.stderr: in thread 7fa048def700 thread_name:bstore_aio 2023-06-09T11:41:45.080 INFO:tasks.ceph.osd.0.smithi062.stderr: 2023-06-09T11:41:45.080 INFO:tasks.ceph.osd.0.smithi062.stderr: ceph version 18.0.0-4313-ga02638f8 (a02638f808b8fe11bccdd01222c0e6e2eb71120b) reef (dev) 2023-06-09T11:41:45.081 INFO:tasks.ceph.osd.0.smithi062.stderr: 1: /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420) [0x7fa057528420] 2023-06-09T11:41:45.081 INFO:tasks.ceph.osd.0.smithi062.stderr: 2: gsignal() 2023-06-09T11:41:45.081 INFO:tasks.ceph.osd.0.smithi062.stderr: 3: abort() 2023-06-09T11:41:45.081 INFO:tasks.ceph.osd.0.smithi062.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x190) [0x5586c668183e] 2023-06-09T11:41:45.081 INFO:tasks.ceph.osd.0.smithi062.stderr: 5: (KernelDevice::_aio_thread()+0xe41) [0x5586c72193b1] 2023-06-09T11:41:45.081 INFO:tasks.ceph.osd.0.smithi062.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x5586c721ee81] 2023-06-09T11:41:45.081 INFO:tasks.ceph.osd.0.smithi062.stderr: 7: /lib/x86_64-linux-gnu/libpthread.so.0(+0x8609) [0x7fa05751c609] 2023-06-09T11:41:45.082 INFO:tasks.ceph.osd.0.smithi062.stderr: 8: clone() 2023-06-09T11:41:45.082 INFO:tasks.ceph.osd.0.smithi062.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-06-09T11:41:45.082 INFO:tasks.ceph.osd.0.smithi062.stderr: 2023-06-09T11:41:45.105 INFO:tasks.ceph.osd.0.smithi062.stderr: -64> 2023-06-09T11:41:44.966+0000 7fa048def700 -1 /build/ceph-18.0.0-4313-ga02638f8/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7fa048def700 time 2023-06-09T11:41:43.878296+0000 2023-06-09T11:41:45.105 INFO:tasks.ceph.osd.0.smithi062.stderr:/build/ceph-18.0.0-4313-ga02638f8/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2023-06-09T11:41:45.105 INFO:tasks.ceph.osd.0.smithi062.stderr: 2023-06-09T11:41:45.105 INFO:tasks.ceph.osd.0.smithi062.stderr: ceph version 18.0.0-4313-ga02638f8 (a02638f808b8fe11bccdd01222c0e6e2eb71120b) reef (dev) 2023-06-09T11:41:45.105 INFO:tasks.ceph.osd.0.smithi062.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x5586c6681785] 2023-06-09T11:41:45.106 INFO:tasks.ceph.osd.0.smithi062.stderr: 2: (KernelDevice::_aio_thread()+0xe41) [0x5586c72193b1] 2023-06-09T11:41:45.106 INFO:tasks.ceph.osd.0.smithi062.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x5586c721ee81] 2023-06-09T11:41:45.106 INFO:tasks.ceph.osd.0.smithi062.stderr: 4: /lib/x86_64-linux-gnu/libpthread.so.0(+0x8609) [0x7fa05751c609] 2023-06-09T11:41:45.106 INFO:tasks.ceph.osd.0.smithi062.stderr: 5: clone() 2023-06-09T11:41:45.106 INFO:tasks.ceph.osd.0.smithi062.stderr: 2023-06-09T11:41:45.106 INFO:tasks.ceph.osd.0.smithi062.stderr: 0> 2023-06-09T11:41:45.074+0000 7fa048def700 -1 *** Caught signal (Aborted) ** 2023-06-09T11:41:45.106 INFO:tasks.ceph.osd.0.smithi062.stderr: in thread 7fa048def700 thread_name:bstore_aio 2023-06-09T11:41:45.107 INFO:tasks.ceph.osd.0.smithi062.stderr: 2023-06-09T11:41:45.107 INFO:tasks.ceph.osd.0.smithi062.stderr: ceph version 18.0.0-4313-ga02638f8 (a02638f808b8fe11bccdd01222c0e6e2eb71120b) reef (dev) 2023-06-09T11:41:45.107 INFO:tasks.ceph.osd.0.smithi062.stderr: 1: /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420) [0x7fa057528420] 2023-06-09T11:41:45.107 INFO:tasks.ceph.osd.0.smithi062.stderr: 2: gsignal() 2023-06-09T11:41:45.107 INFO:tasks.ceph.osd.0.smithi062.stderr: 3: abort() 2023-06-09T11:41:45.107 INFO:tasks.ceph.osd.0.smithi062.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x190) [0x5586c668183e] 2023-06-09T11:41:45.107 INFO:tasks.ceph.osd.0.smithi062.stderr: 5: (KernelDevice::_aio_thread()+0xe41) [0x5586c72193b1] 2023-06-09T11:41:45.108 INFO:tasks.ceph.osd.0.smithi062.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x5586c721ee81] 2023-06-09T11:41:45.108 INFO:tasks.ceph.osd.0.smithi062.stderr: 7: /lib/x86_64-linux-gnu/libpthread.so.0(+0x8609) [0x7fa05751c609] 2023-06-09T11:41:45.108 INFO:tasks.ceph.osd.0.smithi062.stderr: 8: clone() 2023-06-09T11:41:45.108 INFO:tasks.ceph.osd.0.smithi062.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-06-09T11:41:45.108 INFO:tasks.ceph.osd.0.smithi062.stderr: 2023-06-09T11:41:45.119 INFO:tasks.ceph.osd.0.smithi062.stderr: -64> 2023-06-09T11:41:44.966+0000 7fa048def700 -1 /build/ceph-18.0.0-4313-ga02638f8/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7fa048def700 time 2023-06-09T11:41:43.878296+0000 2023-06-09T11:41:45.119 INFO:tasks.ceph.osd.0.smithi062.stderr:/build/ceph-18.0.0-4313-ga02638f8/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2023-06-09T11:41:45.119 INFO:tasks.ceph.osd.0.smithi062.stderr: 2023-06-09T11:41:45.119 INFO:tasks.ceph.osd.0.smithi062.stderr: ceph version 18.0.0-4313-ga02638f8 (a02638f808b8fe11bccdd01222c0e6e2eb71120b) reef (dev) 2023-06-09T11:41:45.119 INFO:tasks.ceph.osd.0.smithi062.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xd7) [0x5586c6681785] 2023-06-09T11:41:45.120 INFO:tasks.ceph.osd.0.smithi062.stderr: 2: (KernelDevice::_aio_thread()+0xe41) [0x5586c72193b1] 2023-06-09T11:41:45.120 INFO:tasks.ceph.osd.0.smithi062.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x5586c721ee81] 2023-06-09T11:41:45.120 INFO:tasks.ceph.osd.0.smithi062.stderr: 4: /lib/x86_64-linux-gnu/libpthread.so.0(+0x8609) [0x7fa05751c609] 2023-06-09T11:41:45.120 INFO:tasks.ceph.osd.0.smithi062.stderr: 5: clone() 2023-06-09T11:41:45.120 INFO:tasks.ceph.osd.0.smithi062.stderr: 2023-06-09T11:41:45.120 INFO:tasks.ceph.osd.0.smithi062.stderr: 0> 2023-06-09T11:41:45.074+0000 7fa048def700 -1 *** Caught signal (Aborted) ** 2023-06-09T11:41:45.120 INFO:tasks.ceph.osd.0.smithi062.stderr: in thread 7fa048def700 thread_name:bstore_aio 2023-06-09T11:41:45.121 INFO:tasks.ceph.osd.0.smithi062.stderr: 2023-06-09T11:41:45.121 INFO:tasks.ceph.osd.0.smithi062.stderr: ceph version 18.0.0-4313-ga02638f8 (a02638f808b8fe11bccdd01222c0e6e2eb71120b) reef (dev) 2023-06-09T11:41:45.121 INFO:tasks.ceph.osd.0.smithi062.stderr: 1: /lib/x86_64-linux-gnu/libpthread.so.0(+0x14420) [0x7fa057528420] 2023-06-09T11:41:45.121 INFO:tasks.ceph.osd.0.smithi062.stderr: 2: gsignal() 2023-06-09T11:41:45.121 INFO:tasks.ceph.osd.0.smithi062.stderr: 3: abort() 2023-06-09T11:41:45.121 INFO:tasks.ceph.osd.0.smithi062.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x190) [0x5586c668183e] 2023-06-09T11:41:45.121 INFO:tasks.ceph.osd.0.smithi062.stderr: 5: (KernelDevice::_aio_thread()+0xe41) [0x5586c72193b1] 2023-06-09T11:41:45.122 INFO:tasks.ceph.osd.0.smithi062.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x5586c721ee81] 2023-06-09T11:41:45.122 INFO:tasks.ceph.osd.0.smithi062.stderr: 7: /lib/x86_64-linux-gnu/libpthread.so.0(+0x8609) [0x7fa05751c609] 2023-06-09T11:41:45.122 INFO:tasks.ceph.osd.0.smithi062.stderr: 8: clone() 2023-06-09T11:41:45.122 INFO:tasks.ceph.osd.0.smithi062.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-06-09T11:41:45.122 INFO:tasks.ceph.osd.0.smithi062.stderr: 2023-06-09T11:41:46.301 INFO:tasks.ceph.osd.0.smithi062.stderr:daemon-helper: command failed with exit status 5 2023-06-09T11:41:48.250 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~198s 2023-06-09T11:41:54.758 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2023-06-09T11:41:54.758 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~205s 2023-06-09T11:42:01.265 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~7s 2023-06-09T11:42:01.266 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~211s 2023-06-09T11:42:07.772 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~13s 2023-06-09T11:42:07.773 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~218s 2023-06-09T11:42:14.281 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~20s 2023-06-09T11:42:14.282 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~224s 2023-06-09T11:42:20.791 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~26s 2023-06-09T11:42:20.791 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~231s 2023-06-09T11:42:27.299 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~33s 2023-06-09T11:42:27.299 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~237s 2023-06-09T11:42:33.806 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~39s 2023-06-09T11:42:33.807 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~244s 2023-06-09T11:42:40.313 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~46s 2023-06-09T11:42:40.314 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~250s 2023-06-09T11:42:46.820 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~52s 2023-06-09T11:42:46.821 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~257s 2023-06-09T11:42:53.329 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~59s 2023-06-09T11:42:53.330 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~263s 2023-06-09T11:42:59.837 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~65s 2023-06-09T11:42:59.838 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~270s 2023-06-09T11:43:06.347 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~72s 2023-06-09T11:43:06.347 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~276s 2023-06-09T11:43:12.855 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~78s 2023-06-09T11:43:12.856 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~283s 2023-06-09T11:43:19.365 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~85s 2023-06-09T11:43:19.366 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~289s 2023-06-09T11:43:25.875 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~91s 2023-06-09T11:43:25.876 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~296s 2023-06-09T11:43:32.384 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~98s 2023-06-09T11:43:32.384 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~302s 2023-06-09T11:43:32.384 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2023-06-09T11:43:32.384 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-06-09T11:43:32.417 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T11:43:32.554 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-06-09T11:43:32.554 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T11:43:32.614 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-09T11:43:34.003 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:33.996+0000 7f39c77fe700 1 Processor -- start 2023-06-09T11:43:34.003 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:33.996+0000 7f39c77fe700 1 -- start start 2023-06-09T11:43:34.004 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:33.996+0000 7f39c77fe700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f39b80e0700 0x7f39b8054cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:43:34.005 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:33.996+0000 7f39c77fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39b80383c0 0x7f39b8034c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:43:34.005 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:33.996+0000 7f39c77fe700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39b8037e70 con 0x7f39b80e0ad0 2023-06-09T11:43:34.005 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:33.996+0000 7f39c77fe700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39b8057f10 con 0x7f39b80e0700 2023-06-09T11:43:34.005 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:33.996+0000 7f39c77fe700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39b8056c90 con 0x7f39b80383c0 2023-06-09T11:43:34.006 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:33.996+0000 7f39cd84a700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f39b80e0700 0x7f39b8054cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:43:34.006 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:33.996+0000 7f39cd84a700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f39b80e0700 0x7f39b8054cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57794/0 (socket says 172.21.15.62:57794) 2023-06-09T11:43:34.007 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:33.996+0000 7f39cd84a700 1 -- 172.21.15.62:0/4040302665 learned_addr learned my addr 172.21.15.62:0/4040302665 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T11:43:34.007 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:33.996+0000 7f39c7fff700 1 --2- 172.21.15.62:0/4040302665 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39b80383c0 0x7f39b8034c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:43:34.007 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.000+0000 7f39cd84a700 1 -- 172.21.15.62:0/4040302665 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39b80383c0 msgr2=0x7f39b8034c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:43:34.007 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.000+0000 7f39cd84a700 1 --2- 172.21.15.62:0/4040302665 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39b80383c0 0x7f39b8034c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:43:34.007 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.000+0000 7f39cd84a700 1 -- 172.21.15.62:0/4040302665 >> v1:172.21.15.89:6789/0 conn(0x7f39b80e0ad0 legacy=0x7f39b8034530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:43:34.007 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.000+0000 7f39cd84a700 1 -- 172.21.15.62:0/4040302665 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39b80380c0 con 0x7f39b80e0700 2023-06-09T11:43:34.008 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.000+0000 7f39cd84a700 1 --2- 172.21.15.62:0/4040302665 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39b80e0700 0x7f39b8054cf0 secure :-1 s=READY pgs=2627 cs=0 l=1 rev1=1 crypto rx=0x7f39c000a900 tx=0x7f39c000ac10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c6a5e91e524cd79 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:43:34.008 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.000+0000 7f39c5ffb700 1 -- 172.21.15.62:0/4040302665 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c000c670 con 0x7f39b80e0700 2023-06-09T11:43:34.014 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.004+0000 7f39c5ffb700 1 -- 172.21.15.62:0/4040302665 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39c000c7f0 con 0x7f39b80e0700 2023-06-09T11:43:34.014 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.004+0000 7f39c5ffb700 1 -- 172.21.15.62:0/4040302665 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c000cba0 con 0x7f39b80e0700 2023-06-09T11:43:34.015 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.008+0000 7f39c77fe700 1 -- 172.21.15.62:0/4040302665 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39b80e0700 msgr2=0x7f39b8054cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:43:34.015 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.008+0000 7f39c77fe700 1 --2- 172.21.15.62:0/4040302665 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39b80e0700 0x7f39b8054cf0 secure :-1 s=READY pgs=2627 cs=0 l=1 rev1=1 crypto rx=0x7f39c000a900 tx=0x7f39c000ac10 comp rx=0 tx=0).stop 2023-06-09T11:43:34.016 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.008+0000 7f39c77fe700 1 -- 172.21.15.62:0/4040302665 shutdown_connections 2023-06-09T11:43:34.016 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.008+0000 7f39c77fe700 1 --2- 172.21.15.62:0/4040302665 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39b80383c0 0x7f39b8034c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:43:34.016 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.008+0000 7f39c77fe700 1 --2- 172.21.15.62:0/4040302665 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39b80e0700 0x7f39b8054cf0 unknown :-1 s=CLOSED pgs=2627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:43:34.017 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.008+0000 7f39c77fe700 1 -- 172.21.15.62:0/4040302665 >> 172.21.15.62:0/4040302665 conn(0x7f39b80202c0 msgr2=0x7f39b8056fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:43:34.017 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.008+0000 7f39c77fe700 1 -- 172.21.15.62:0/4040302665 shutdown_connections 2023-06-09T11:43:34.017 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.008+0000 7f39c77fe700 1 -- 172.21.15.62:0/4040302665 wait complete. 2023-06-09T11:43:34.021 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.012+0000 7f39c77fe700 1 Processor -- start 2023-06-09T11:43:34.022 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.012+0000 7f39c77fe700 1 -- start start 2023-06-09T11:43:34.024 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.016+0000 7f39c77fe700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39b80383c0 0x7f39b80d3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:43:34.024 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.016+0000 7f39c77fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39b80e0700 0x7f39b80d4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:43:34.024 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.016+0000 7f39c77fe700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39b80e0ad0 0x7f39b803b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:43:34.024 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.016+0000 7f39c77fe700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39b8034d00 con 0x7f39b80e0700 2023-06-09T11:43:34.024 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.016+0000 7f39c77fe700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39b8035b60 con 0x7f39b80383c0 2023-06-09T11:43:34.024 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.016+0000 7f39c77fe700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39b8035ff0 con 0x7f39b80e0ad0 2023-06-09T11:43:34.025 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.016+0000 7f39c67fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39b80e0700 0x7f39b80d4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:43:34.025 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.016+0000 7f39cd84a700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39b80383c0 0x7f39b80d3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:43:34.025 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.016+0000 7f39c67fc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39b80e0700 0x7f39b80d4530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57802/0 (socket says 172.21.15.62:57802) 2023-06-09T11:43:34.025 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.016+0000 7f39c67fc700 1 -- 172.21.15.62:0/1949773033 learned_addr learned my addr 172.21.15.62:0/1949773033 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T11:43:34.026 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.016+0000 7f39c67fc700 1 -- 172.21.15.62:0/1949773033 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39b80e0ad0 msgr2=0x7f39b803b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:43:34.026 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.016+0000 7f39c67fc700 1 --2- 172.21.15.62:0/1949773033 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39b80e0ad0 0x7f39b803b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:43:34.026 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.016+0000 7f39c67fc700 1 -- 172.21.15.62:0/1949773033 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39b80383c0 msgr2=0x7f39b80d3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:43:34.026 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.016+0000 7f39c67fc700 1 --2- 172.21.15.62:0/1949773033 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39b80383c0 0x7f39b80d3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:43:34.027 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.016+0000 7f39c67fc700 1 -- 172.21.15.62:0/1949773033 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39c000d040 con 0x7f39b80e0700 2023-06-09T11:43:34.027 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.020+0000 7f39c67fc700 1 --2- 172.21.15.62:0/1949773033 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39b80e0700 0x7f39b80d4530 secure :-1 s=READY pgs=2628 cs=0 l=1 rev1=1 crypto rx=0x7f39bc00c510 tx=0x7f39bc00c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:43:34.027 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.020+0000 7f39affff700 1 -- 172.21.15.62:0/1949773033 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39bc011790 con 0x7f39b80e0700 2023-06-09T11:43:34.028 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.020+0000 7f39affff700 1 -- 172.21.15.62:0/1949773033 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39bc011910 con 0x7f39b80e0700 2023-06-09T11:43:34.028 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.020+0000 7f39c77fe700 1 -- 172.21.15.62:0/1949773033 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39b8034f50 con 0x7f39b80e0700 2023-06-09T11:43:34.028 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.020+0000 7f39affff700 1 -- 172.21.15.62:0/1949773033 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39bc011cc0 con 0x7f39b80e0700 2023-06-09T11:43:34.028 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.020+0000 7f39c77fe700 1 -- 172.21.15.62:0/1949773033 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39b8035510 con 0x7f39b80e0700 2023-06-09T11:43:34.030 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.020+0000 7f39c77fe700 1 -- 172.21.15.62:0/1949773033 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39b8035cf0 con 0x7f39b80e0700 2023-06-09T11:43:34.032 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.024+0000 7f39affff700 1 -- 172.21.15.62:0/1949773033 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f39bc01c460 con 0x7f39b80e0700 2023-06-09T11:43:34.032 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.024+0000 7f39affff700 1 --2- 172.21.15.62:0/1949773033 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f39b40662f0 0x7f39b40687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:43:34.033 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.024+0000 7f39affff700 1 -- 172.21.15.62:0/1949773033 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f39bc083ca0 con 0x7f39b80e0700 2023-06-09T11:43:34.033 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.024+0000 7f39cd84a700 1 --2- 172.21.15.62:0/1949773033 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f39b40662f0 0x7f39b40687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:43:34.034 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.028+0000 7f39cd84a700 1 --2- 172.21.15.62:0/1949773033 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f39b40662f0 0x7f39b40687a0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f39c000afd0 tx=0x7f39c0010000 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:43:34.337 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.328+0000 7f39affff700 1 -- 172.21.15.62:0/1949773033 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f39bc050f00 con 0x7f39b80e0700 2023-06-09T11:43:34.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.504+0000 7f39c77fe700 1 -- 172.21.15.62:0/1949773033 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f39b8005500 con 0x7f39b80e0700 2023-06-09T11:43:34.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.544+0000 7f39affff700 1 -- 172.21.15.62:0/1949773033 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+18594 (secure 0 0 0) 0x7f39bc054520 con 0x7f39b80e0700 2023-06-09T11:43:34.596 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-06-09T11:43:34.597 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":49,"fsid":"f7998a1e-e5a9-4202-abaa-70c0eaae1047","created":"2023-06-09T04:40:30.469588+0000","modified":"2023-06-09T11:41:46.993989+0000","last_up_change":"2023-06-09T11:41:45.956296+0000","last_in_change":"2023-06-09T04:40:33.568221+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-06-09T04:40:44.646921+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":7.690000057220459,"score_stable":7.690000057220459,"optimal_score":0.12999999523162842,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-06-09T04:40:50.006643+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2.9800000190734863,"score_stable":2.9800000190734863,"optimal_score":0.62999999523162842,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-06-09T04:42:29.603206+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":0.75,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-06-09T04:42:30.461627+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"error_message":"pool 7 has some PGs where all OSDs are with primary_affinity 0 (at least pg 7.7), read balance score may not be reliable","score_acting":0,"score_stable":0}}],"osds":[{"osd":0,"uuid":"bc50bbc0-dd08-42ed-804c-ec3029e36c19","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":48,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6802","nonce":1295788017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6807","nonce":1295788017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6815","nonce":1295788017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6809","nonce":1295788017},{"type":"v1","addr":"172.21.15.62:6811","nonce":1295788017}]},"public_addr":"172.21.15.62:6802/1295788017","cluster_addr":"172.21.15.62:6807/1295788017","heartbeat_back_addr":"172.21.15.62:6815/1295788017","heartbeat_front_addr":"172.21.15.62:6811/1295788017","state":["exists"]},{"osd":1,"uuid":"8230b12d-e22f-4985-a584-4cc64404cdbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6825","nonce":4120692006}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6827","nonce":4120692006}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6831","nonce":4120692006}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":4120692006},{"type":"v1","addr":"172.21.15.62:6829","nonce":4120692006}]},"public_addr":"172.21.15.62:6825/4120692006","cluster_addr":"172.21.15.62:6827/4120692006","heartbeat_back_addr":"172.21.15.62:6831/4120692006","heartbeat_front_addr":"172.21.15.62:6829/4120692006","state":["exists","up"]},{"osd":2,"uuid":"d0202506-dbe9-4e3c-9271-687929abf96a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6801","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6803","nonce":4169607876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6805","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6806","nonce":4169607876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6814","nonce":4169607876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":4169607876},{"type":"v1","addr":"172.21.15.62:6810","nonce":4169607876}]},"public_addr":"172.21.15.62:6803/4169607876","cluster_addr":"172.21.15.62:6806/4169607876","heartbeat_back_addr":"172.21.15.62:6814/4169607876","heartbeat_front_addr":"172.21.15.62:6810/4169607876","state":["exists","up"]},{"osd":3,"uuid":"f3c0298a-b075-4411-af50-e16cd74fdddb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6817","nonce":3268438986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6819","nonce":3268438986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6823","nonce":3268438986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":3268438986},{"type":"v1","addr":"172.21.15.62:6821","nonce":3268438986}]},"public_addr":"172.21.15.62:6817/3268438986","cluster_addr":"172.21.15.62:6819/3268438986","heartbeat_back_addr":"172.21.15.62:6823/3268438986","heartbeat_front_addr":"172.21.15.62:6821/3268438986","state":["exists","up"]},{"osd":4,"uuid":"1ab5c5ca-e74f-475a-a309-683cc0029928","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6817","nonce":3139617628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6819","nonce":3139617628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6823","nonce":3139617628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":3139617628},{"type":"v1","addr":"172.21.15.89:6821","nonce":3139617628}]},"public_addr":"172.21.15.89:6817/3139617628","cluster_addr":"172.21.15.89:6819/3139617628","heartbeat_back_addr":"172.21.15.89:6823/3139617628","heartbeat_front_addr":"172.21.15.89:6821/3139617628","state":["exists","up"]},{"osd":5,"uuid":"a933e184-bd8f-4369-a1ba-a68de53c578c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6825","nonce":2681723596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6827","nonce":2681723596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6830","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6831","nonce":2681723596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":2681723596},{"type":"v1","addr":"172.21.15.89:6829","nonce":2681723596}]},"public_addr":"172.21.15.89:6825/2681723596","cluster_addr":"172.21.15.89:6827/2681723596","heartbeat_back_addr":"172.21.15.89:6831/2681723596","heartbeat_front_addr":"172.21.15.89:6829/2681723596","state":["exists","up"]},{"osd":6,"uuid":"1ed7ad37-2eee-49a6-954c-b537e2b7f0ed","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":46,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6809","nonce":1657136033}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6811","nonce":1657136033}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6815","nonce":1657136033}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":1657136033},{"type":"v1","addr":"172.21.15.89:6813","nonce":1657136033}]},"public_addr":"172.21.15.89:6809/1657136033","cluster_addr":"172.21.15.89:6811/1657136033","heartbeat_back_addr":"172.21.15.89:6815/1657136033","heartbeat_front_addr":"172.21.15.89:6813/1657136033","state":["exists"]},{"osd":7,"uuid":"6ed732e9-33ff-40df-9038-a9f1d1622671","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6801","nonce":1710561686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6803","nonce":1710561686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6807","nonce":1710561686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":1710561686},{"type":"v1","addr":"172.21.15.89:6805","nonce":1710561686}]},"public_addr":"172.21.15.89:6801/1710561686","cluster_addr":"172.21.15.89:6803/1710561686","heartbeat_back_addr":"172.21.15.89:6807/1710561686","heartbeat_front_addr":"172.21.15.89:6805/1710561686","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.335803+0000","dead_epoch":48},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.419788+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.179334+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.263310+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.071846+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.375627+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.282277+0000","dead_epoch":46},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-09T04:40:39.315997+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.16","mappings":[{"from":0,"to":5}]},{"pgid":"7.32","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-09T11:43:34.597 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.548+0000 7f39c77fe700 1 -- 172.21.15.62:0/1949773033 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f39b40662f0 msgr2=0x7f39b40687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:43:34.597 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.548+0000 7f39c77fe700 1 --2- 172.21.15.62:0/1949773033 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f39b40662f0 0x7f39b40687a0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f39c000afd0 tx=0x7f39c0010000 comp rx=0 tx=0).stop 2023-06-09T11:43:34.597 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.548+0000 7f39c77fe700 1 -- 172.21.15.62:0/1949773033 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39b80e0700 msgr2=0x7f39b80d4530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:43:34.597 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.548+0000 7f39c77fe700 1 --2- 172.21.15.62:0/1949773033 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39b80e0700 0x7f39b80d4530 secure :-1 s=READY pgs=2628 cs=0 l=1 rev1=1 crypto rx=0x7f39bc00c510 tx=0x7f39bc00c820 comp rx=0 tx=0).stop 2023-06-09T11:43:34.598 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.548+0000 7f39c77fe700 1 -- 172.21.15.62:0/1949773033 shutdown_connections 2023-06-09T11:43:34.598 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.548+0000 7f39c77fe700 1 --2- 172.21.15.62:0/1949773033 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f39b40662f0 0x7f39b40687a0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:43:34.598 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.548+0000 7f39c77fe700 1 --2- 172.21.15.62:0/1949773033 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f39b80e0ad0 0x7f39b803b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:43:34.598 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.548+0000 7f39c77fe700 1 --2- 172.21.15.62:0/1949773033 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f39b80e0700 0x7f39b80d4530 unknown :-1 s=CLOSED pgs=2628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:43:34.598 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.548+0000 7f39c77fe700 1 --2- 172.21.15.62:0/1949773033 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39b80383c0 0x7f39b80d3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:43:34.598 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.548+0000 7f39c77fe700 1 -- 172.21.15.62:0/1949773033 >> 172.21.15.62:0/1949773033 conn(0x7f39b80202c0 msgr2=0x7f39b8008850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:43:34.598 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.548+0000 7f39c77fe700 1 -- 172.21.15.62:0/1949773033 shutdown_connections 2023-06-09T11:43:34.598 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.548+0000 7f39c77fe700 1 -- 172.21.15.62:0/1949773033 wait complete. 2023-06-09T11:43:34.627 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-06-09T04:40:44.646921+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 7.690000057220459, 'score_stable': 7.690000057220459, 'optimal_score': 0.12999999523162842, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-06-09T04:40:50.006643+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2.9800000190734863, 'score_stable': 2.9800000190734863, 'optimal_score': 0.6299999952316284, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-09T04:42:29.603206+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 0.75, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-06-09T04:42:30.461627+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'error_message': 'pool 7 has some PGs where all OSDs are with primary_affinity 0 (at least pg 7.7), read balance score may not be reliable', 'score_acting': 0, 'score_stable': 0}}] 2023-06-09T11:43:34.628 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-09T11:43:34.811 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.804+0000 7f050f416700 1 Processor -- start 2023-06-09T11:43:34.811 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.804+0000 7f050f416700 1 -- start start 2023-06-09T11:43:34.814 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.808+0000 7f050f416700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f05080b3ed0 0x7f05080b42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:43:34.814 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.808+0000 7f050f416700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f05080cf2b0 0x7f05080b52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:43:34.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.808+0000 7f050f416700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05080d0c00 con 0x7f05080d1090 2023-06-09T11:43:34.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.808+0000 7f050f416700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05080cf730 con 0x7f05080b3ed0 2023-06-09T11:43:34.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.808+0000 7f050f416700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05080b1b30 con 0x7f05080cf2b0 2023-06-09T11:43:34.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.808+0000 7f050e414700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f05080b3ed0 0x7f05080b42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:43:34.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.808+0000 7f050e414700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f05080b3ed0 0x7f05080b42a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57804/0 (socket says 172.21.15.62:57804) 2023-06-09T11:43:34.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.808+0000 7f050e414700 1 -- 172.21.15.62:0/3835790375 learned_addr learned my addr 172.21.15.62:0/3835790375 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T11:43:34.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.808+0000 7f050ec15700 1 --2- 172.21.15.62:0/3835790375 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f05080cf2b0 0x7f05080b52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:43:34.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.808+0000 7f050e414700 1 -- 172.21.15.62:0/3835790375 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f05080cf2b0 msgr2=0x7f05080b52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:43:34.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.808+0000 7f050e414700 1 --2- 172.21.15.62:0/3835790375 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f05080cf2b0 0x7f05080b52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:43:34.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.808+0000 7f050e414700 1 -- 172.21.15.62:0/3835790375 >> v1:172.21.15.89:6789/0 conn(0x7f05080d1090 legacy=0x7f05080ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:43:34.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.808+0000 7f050e414700 1 -- 172.21.15.62:0/3835790375 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05080b47e0 con 0x7f05080b3ed0 2023-06-09T11:43:34.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.808+0000 7f050ec15700 1 --2- 172.21.15.62:0/3835790375 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f05080cf2b0 0x7f05080b52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T11:43:34.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.808+0000 7f050e414700 1 --2- 172.21.15.62:0/3835790375 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05080b3ed0 0x7f05080b42a0 secure :-1 s=READY pgs=2629 cs=0 l=1 rev1=1 crypto rx=0x7f0504009910 tx=0x7f0504009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8482f818d2d2940c server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:43:34.818 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.808+0000 7f050d412700 1 -- 172.21.15.62:0/3835790375 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f050400ba60 con 0x7f05080b3ed0 2023-06-09T11:43:34.818 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.808+0000 7f050d412700 1 -- 172.21.15.62:0/3835790375 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f050400bbc0 con 0x7f05080b3ed0 2023-06-09T11:43:34.818 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.808+0000 7f050d412700 1 -- 172.21.15.62:0/3835790375 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0504009e60 con 0x7f05080b3ed0 2023-06-09T11:43:34.819 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.812+0000 7f050f416700 1 -- 172.21.15.62:0/3835790375 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05080b3ed0 msgr2=0x7f05080b42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:43:34.819 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.812+0000 7f050f416700 1 --2- 172.21.15.62:0/3835790375 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05080b3ed0 0x7f05080b42a0 secure :-1 s=READY pgs=2629 cs=0 l=1 rev1=1 crypto rx=0x7f0504009910 tx=0x7f0504009c20 comp rx=0 tx=0).stop 2023-06-09T11:43:34.819 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.812+0000 7f050f416700 1 -- 172.21.15.62:0/3835790375 shutdown_connections 2023-06-09T11:43:34.819 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.812+0000 7f050f416700 1 --2- 172.21.15.62:0/3835790375 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f05080cf2b0 0x7f05080b52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:43:34.819 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.812+0000 7f050f416700 1 --2- 172.21.15.62:0/3835790375 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05080b3ed0 0x7f05080b42a0 unknown :-1 s=CLOSED pgs=2629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:43:34.819 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.812+0000 7f050f416700 1 -- 172.21.15.62:0/3835790375 >> 172.21.15.62:0/3835790375 conn(0x7f050806a500 msgr2=0x7f050806a900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:43:34.820 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.812+0000 7f050f416700 1 -- 172.21.15.62:0/3835790375 shutdown_connections 2023-06-09T11:43:34.820 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.812+0000 7f050f416700 1 -- 172.21.15.62:0/3835790375 wait complete. 2023-06-09T11:43:34.822 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.812+0000 7f050f416700 1 Processor -- start 2023-06-09T11:43:34.822 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.816+0000 7f050f416700 1 -- start start 2023-06-09T11:43:34.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.816+0000 7f050f416700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05080b3ed0 0x7f05080ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:43:34.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.816+0000 7f050f416700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f05080cf2b0 0x7f05081f1b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:43:34.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.816+0000 7f050f416700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f05080d1090 0x7f05080a9260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:43:34.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.816+0000 7f050f416700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05081f2070 con 0x7f05080b3ed0 2023-06-09T11:43:34.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.816+0000 7f050f416700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05081f2280 con 0x7f05080d1090 2023-06-09T11:43:34.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.816+0000 7f050f416700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05080ca6a0 con 0x7f05080cf2b0 2023-06-09T11:43:34.826 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.816+0000 7f050e414700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05080b3ed0 0x7f05080ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:43:34.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.816+0000 7f050e414700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05080b3ed0 0x7f05080ccf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57816/0 (socket says 172.21.15.62:57816) 2023-06-09T11:43:34.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.816+0000 7f050e414700 1 -- 172.21.15.62:0/4000383623 learned_addr learned my addr 172.21.15.62:0/4000383623 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T11:43:34.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.816+0000 7f050ec15700 1 --2- 172.21.15.62:0/4000383623 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f05080d1090 0x7f05080a9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:43:34.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.816+0000 7f050dc13700 1 --2- 172.21.15.62:0/4000383623 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f05080cf2b0 0x7f05081f1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:43:34.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.816+0000 7f050e414700 1 -- 172.21.15.62:0/4000383623 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f05080cf2b0 msgr2=0x7f05081f1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:43:34.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.816+0000 7f050e414700 1 --2- 172.21.15.62:0/4000383623 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f05080cf2b0 0x7f05081f1b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:43:34.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.816+0000 7f050e414700 1 -- 172.21.15.62:0/4000383623 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f05080d1090 msgr2=0x7f05080a9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:43:34.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.816+0000 7f050e414700 1 --2- 172.21.15.62:0/4000383623 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f05080d1090 0x7f05080a9260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:43:34.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.816+0000 7f050e414700 1 -- 172.21.15.62:0/4000383623 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0504009570 con 0x7f05080b3ed0 2023-06-09T11:43:34.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.816+0000 7f050ec15700 1 --2- 172.21.15.62:0/4000383623 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f05080d1090 0x7f05080a9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T11:43:34.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.816+0000 7f050dc13700 1 --2- 172.21.15.62:0/4000383623 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f05080cf2b0 0x7f05081f1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-09T11:43:34.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.816+0000 7f050e414700 1 --2- 172.21.15.62:0/4000383623 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05080b3ed0 0x7f05080ccf90 secure :-1 s=READY pgs=2630 cs=0 l=1 rev1=1 crypto rx=0x7f0504000c00 tx=0x7f0504004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:43:34.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.820+0000 7f04feffd700 1 -- 172.21.15.62:0/4000383623 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0504004610 con 0x7f05080b3ed0 2023-06-09T11:43:34.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.820+0000 7f04feffd700 1 -- 172.21.15.62:0/4000383623 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f050401f070 con 0x7f05080b3ed0 2023-06-09T11:43:34.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.820+0000 7f050f416700 1 -- 172.21.15.62:0/4000383623 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05080ca980 con 0x7f05080b3ed0 2023-06-09T11:43:34.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.820+0000 7f04feffd700 1 -- 172.21.15.62:0/4000383623 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0504003900 con 0x7f05080b3ed0 2023-06-09T11:43:34.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.820+0000 7f050f416700 1 -- 172.21.15.62:0/4000383623 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05080caf40 con 0x7f05080b3ed0 2023-06-09T11:43:34.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.820+0000 7f050f416700 1 -- 172.21.15.62:0/4000383623 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05080cb130 con 0x7f05080b3ed0 2023-06-09T11:43:34.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.820+0000 7f04feffd700 1 -- 172.21.15.62:0/4000383623 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f0504003a60 con 0x7f05080b3ed0 2023-06-09T11:43:34.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.824+0000 7f04feffd700 1 --2- 172.21.15.62:0/4000383623 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f04ec0662f0 0x7f04ec0687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:43:34.832 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.824+0000 7f04feffd700 1 -- 172.21.15.62:0/4000383623 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f0504021070 con 0x7f05080b3ed0 2023-06-09T11:43:34.832 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.824+0000 7f050dc13700 1 --2- 172.21.15.62:0/4000383623 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f04ec0662f0 0x7f04ec0687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:43:34.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.824+0000 7f050dc13700 1 --2- 172.21.15.62:0/4000383623 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f04ec0662f0 0x7f04ec0687a0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f0508151410 tx=0x7f04f8009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:43:34.837 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:34.828+0000 7f04feffd700 1 -- 172.21.15.62:0/4000383623 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f0504052ab0 con 0x7f05080b3ed0 2023-06-09T11:43:35.010 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.000+0000 7f050f416700 1 -- 172.21.15.62:0/4000383623 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f05080739c0 con 0x7f05080b3ed0 2023-06-09T11:43:35.038 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.032+0000 7f04feffd700 1 -- 172.21.15.62:0/4000383623 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v49) v1 ==== 93+0+10 (secure 0 0 0) 0x7f05040560d0 con 0x7f05080b3ed0 2023-06-09T11:43:35.039 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2023-06-09T11:43:35.043 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.036+0000 7f050f416700 1 -- 172.21.15.62:0/4000383623 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f04ec0662f0 msgr2=0x7f04ec0687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:43:35.043 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.036+0000 7f050f416700 1 --2- 172.21.15.62:0/4000383623 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f04ec0662f0 0x7f04ec0687a0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f0508151410 tx=0x7f04f8009040 comp rx=0 tx=0).stop 2023-06-09T11:43:35.044 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.036+0000 7f050f416700 1 -- 172.21.15.62:0/4000383623 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05080b3ed0 msgr2=0x7f05080ccf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:43:35.044 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.036+0000 7f050f416700 1 --2- 172.21.15.62:0/4000383623 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05080b3ed0 0x7f05080ccf90 secure :-1 s=READY pgs=2630 cs=0 l=1 rev1=1 crypto rx=0x7f0504000c00 tx=0x7f0504004770 comp rx=0 tx=0).stop 2023-06-09T11:43:35.044 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.036+0000 7f050f416700 1 -- 172.21.15.62:0/4000383623 shutdown_connections 2023-06-09T11:43:35.044 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.036+0000 7f050f416700 1 --2- 172.21.15.62:0/4000383623 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f04ec0662f0 0x7f04ec0687a0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:43:35.044 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.036+0000 7f050f416700 1 --2- 172.21.15.62:0/4000383623 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f05080d1090 0x7f05080a9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:43:35.044 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.036+0000 7f050f416700 1 --2- 172.21.15.62:0/4000383623 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f05080cf2b0 0x7f05081f1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:43:35.044 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.036+0000 7f050f416700 1 --2- 172.21.15.62:0/4000383623 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05080b3ed0 0x7f05080ccf90 unknown :-1 s=CLOSED pgs=2630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:43:35.045 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.036+0000 7f050f416700 1 -- 172.21.15.62:0/4000383623 >> 172.21.15.62:0/4000383623 conn(0x7f050806a500 msgr2=0x7f05080b7290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:43:35.045 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.036+0000 7f050f416700 1 -- 172.21.15.62:0/4000383623 shutdown_connections 2023-06-09T11:43:35.045 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.036+0000 7f050f416700 1 -- 172.21.15.62:0/4000383623 wait complete. 2023-06-09T11:43:35.067 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-09T11:43:35.245 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.236+0000 7ff063cc3700 1 Processor -- start 2023-06-09T11:43:35.245 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.236+0000 7ff063cc3700 1 -- start start 2023-06-09T11:43:35.248 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.240+0000 7ff063cc3700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff05c1637c0 0x7ff05c0cd470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:43:35.249 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.240+0000 7ff063cc3700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7ff05c0b0be0 0x7ff05c0697f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:43:35.249 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.240+0000 7ff063cc3700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff05c06f7f0 con 0x7ff05c0b1310 2023-06-09T11:43:35.249 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.240+0000 7ff063cc3700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff05c0cd9b0 con 0x7ff05c1637c0 2023-06-09T11:43:35.250 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.240+0000 7ff063cc3700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff05c071a80 con 0x7ff05c0b0be0 2023-06-09T11:43:35.250 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.240+0000 7ff061a5f700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff05c1637c0 0x7ff05c0cd470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:43:35.250 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.240+0000 7ff061a5f700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff05c1637c0 0x7ff05c0cd470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57822/0 (socket says 172.21.15.62:57822) 2023-06-09T11:43:35.250 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.240+0000 7ff061a5f700 1 -- 172.21.15.62:0/603646107 learned_addr learned my addr 172.21.15.62:0/603646107 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T11:43:35.250 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.240+0000 7ff06125e700 1 --2- 172.21.15.62:0/603646107 >> v2:172.21.15.89:3300/0 conn(0x7ff05c0b0be0 0x7ff05c0697f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:43:35.251 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.244+0000 7ff061a5f700 1 -- 172.21.15.62:0/603646107 >> v2:172.21.15.89:3300/0 conn(0x7ff05c0b0be0 msgr2=0x7ff05c0697f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:43:35.251 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.244+0000 7ff061a5f700 1 --2- 172.21.15.62:0/603646107 >> v2:172.21.15.89:3300/0 conn(0x7ff05c0b0be0 0x7ff05c0697f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:43:35.251 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.244+0000 7ff061a5f700 1 -- 172.21.15.62:0/603646107 >> v1:172.21.15.62:6789/0 conn(0x7ff05c0b1310 legacy=0x7ff05c163f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:43:35.252 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.244+0000 7ff061a5f700 1 -- 172.21.15.62:0/603646107 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff05c163b90 con 0x7ff05c1637c0 2023-06-09T11:43:35.252 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.244+0000 7ff061a5f700 1 --2- 172.21.15.62:0/603646107 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff05c1637c0 0x7ff05c0cd470 secure :-1 s=READY pgs=2632 cs=0 l=1 rev1=1 crypto rx=0x7ff05c06adb0 tx=0x7ff058009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ce255fbab6e34b8 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:43:35.252 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.244+0000 7ff060a5d700 1 -- 172.21.15.62:0/603646107 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff058011830 con 0x7ff05c1637c0 2023-06-09T11:43:35.252 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.244+0000 7ff060a5d700 1 -- 172.21.15.62:0/603646107 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff058011990 con 0x7ff05c1637c0 2023-06-09T11:43:35.252 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.244+0000 7ff060a5d700 1 -- 172.21.15.62:0/603646107 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff058011d20 con 0x7ff05c1637c0 2023-06-09T11:43:35.253 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.244+0000 7ff063cc3700 1 -- 172.21.15.62:0/603646107 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff05c1637c0 msgr2=0x7ff05c0cd470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:43:35.253 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.244+0000 7ff063cc3700 1 --2- 172.21.15.62:0/603646107 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff05c1637c0 0x7ff05c0cd470 secure :-1 s=READY pgs=2632 cs=0 l=1 rev1=1 crypto rx=0x7ff05c06adb0 tx=0x7ff058009bf0 comp rx=0 tx=0).stop 2023-06-09T11:43:35.253 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.244+0000 7ff063cc3700 1 -- 172.21.15.62:0/603646107 shutdown_connections 2023-06-09T11:43:35.253 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.244+0000 7ff063cc3700 1 --2- 172.21.15.62:0/603646107 >> v2:172.21.15.89:3300/0 conn(0x7ff05c0b0be0 0x7ff05c0697f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:43:35.253 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.244+0000 7ff063cc3700 1 --2- 172.21.15.62:0/603646107 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff05c1637c0 0x7ff05c0cd470 unknown :-1 s=CLOSED pgs=2632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:43:35.253 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.244+0000 7ff063cc3700 1 -- 172.21.15.62:0/603646107 >> 172.21.15.62:0/603646107 conn(0x7ff05c06c5d0 msgr2=0x7ff05c0cad60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:43:35.254 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.244+0000 7ff063cc3700 1 -- 172.21.15.62:0/603646107 shutdown_connections 2023-06-09T11:43:35.254 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.244+0000 7ff063cc3700 1 -- 172.21.15.62:0/603646107 wait complete. 2023-06-09T11:43:35.256 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.248+0000 7ff063cc3700 1 Processor -- start 2023-06-09T11:43:35.256 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.248+0000 7ff063cc3700 1 -- start start 2023-06-09T11:43:35.258 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.252+0000 7ff063cc3700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff05c0b0be0 0x7ff05c0c3e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:43:35.258 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.252+0000 7ff063cc3700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff05c0b1310 0x7ff05c0c4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:43:35.259 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.252+0000 7ff063cc3700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff05c1637c0 0x7ff05c0697f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:43:35.259 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.252+0000 7ff063cc3700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff05c0c5150 con 0x7ff05c0b0be0 2023-06-09T11:43:35.259 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.252+0000 7ff063cc3700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff05c1f5ce0 con 0x7ff05c1637c0 2023-06-09T11:43:35.259 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.252+0000 7ff063cc3700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff05c1f5fc0 con 0x7ff05c0b1310 2023-06-09T11:43:35.260 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.252+0000 7ff061a5f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff05c0b0be0 0x7ff05c0c3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:43:35.260 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.252+0000 7ff061a5f700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff05c0b0be0 0x7ff05c0c3e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57830/0 (socket says 172.21.15.62:57830) 2023-06-09T11:43:35.260 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.252+0000 7ff061a5f700 1 -- 172.21.15.62:0/3517321753 learned_addr learned my addr 172.21.15.62:0/3517321753 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T11:43:35.260 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.252+0000 7ff062260700 1 --2- 172.21.15.62:0/3517321753 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff05c1637c0 0x7ff05c0697f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:43:35.260 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.252+0000 7ff061a5f700 1 -- 172.21.15.62:0/3517321753 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff05c0b1310 msgr2=0x7ff05c0c4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:43:35.261 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.252+0000 7ff06125e700 1 --2- 172.21.15.62:0/3517321753 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff05c0b1310 0x7ff05c0c4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:43:35.261 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.252+0000 7ff061a5f700 1 --2- 172.21.15.62:0/3517321753 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff05c0b1310 0x7ff05c0c4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:43:35.261 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.252+0000 7ff061a5f700 1 -- 172.21.15.62:0/3517321753 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff05c1637c0 msgr2=0x7ff05c0697f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:43:35.261 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.252+0000 7ff061a5f700 1 --2- 172.21.15.62:0/3517321753 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff05c1637c0 0x7ff05c0697f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:43:35.261 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.252+0000 7ff061a5f700 1 -- 172.21.15.62:0/3517321753 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff058009570 con 0x7ff05c0b0be0 2023-06-09T11:43:35.261 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.252+0000 7ff062260700 1 --2- 172.21.15.62:0/3517321753 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff05c1637c0 0x7ff05c0697f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T11:43:35.261 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.252+0000 7ff06125e700 1 --2- 172.21.15.62:0/3517321753 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff05c0b1310 0x7ff05c0c4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T11:43:35.261 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.252+0000 7ff061a5f700 1 --2- 172.21.15.62:0/3517321753 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff05c0b0be0 0x7ff05c0c3e00 secure :-1 s=READY pgs=2633 cs=0 l=1 rev1=1 crypto rx=0x7ff05c066ce0 tx=0x7ff058004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:43:35.262 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.252+0000 7ff0527fc700 1 -- 172.21.15.62:0/3517321753 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff058004550 con 0x7ff05c0b0be0 2023-06-09T11:43:35.262 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.252+0000 7ff0527fc700 1 -- 172.21.15.62:0/3517321753 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff05801f070 con 0x7ff05c0b0be0 2023-06-09T11:43:35.262 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.252+0000 7ff0527fc700 1 -- 172.21.15.62:0/3517321753 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff058003900 con 0x7ff05c0b0be0 2023-06-09T11:43:35.263 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.252+0000 7ff063cc3700 1 -- 172.21.15.62:0/3517321753 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff05c1f62a0 con 0x7ff05c0b0be0 2023-06-09T11:43:35.263 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.252+0000 7ff063cc3700 1 -- 172.21.15.62:0/3517321753 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff05c1f6860 con 0x7ff05c0b0be0 2023-06-09T11:43:35.263 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.252+0000 7ff063cc3700 1 -- 172.21.15.62:0/3517321753 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff05c0713c0 con 0x7ff05c0b0be0 2023-06-09T11:43:35.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.268+0000 7ff0527fc700 1 -- 172.21.15.62:0/3517321753 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7ff058003a60 con 0x7ff05c0b0be0 2023-06-09T11:43:35.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.268+0000 7ff0527fc700 1 --2- 172.21.15.62:0/3517321753 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7ff0400662f0 0x7ff0400687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:43:35.278 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.268+0000 7ff0527fc700 1 -- 172.21.15.62:0/3517321753 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6440+0+0 (secure 0 0 0) 0x7ff058021070 con 0x7ff05c0b0be0 2023-06-09T11:43:35.278 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.272+0000 7ff06125e700 1 --2- 172.21.15.62:0/3517321753 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7ff0400662f0 0x7ff0400687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:43:35.279 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.272+0000 7ff06125e700 1 --2- 172.21.15.62:0/3517321753 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7ff0400662f0 0x7ff0400687a0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7ff05c0cb970 tx=0x7ff04c008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:43:35.284 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.276+0000 7ff0527fc700 1 -- 172.21.15.62:0/3517321753 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7ff058052a60 con 0x7ff05c0b0be0 2023-06-09T11:43:35.461 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.452+0000 7ff063cc3700 1 -- 172.21.15.62:0/3517321753 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff05c1f8ff0 con 0x7ff05c0b0be0 2023-06-09T11:43:35.462 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.456+0000 7ff0527fc700 1 -- 172.21.15.62:0/3517321753 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v49) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff058015020 con 0x7ff05c0b0be0 2023-06-09T11:43:35.462 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2023-06-09T11:43:35.464 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.456+0000 7ff063cc3700 1 -- 172.21.15.62:0/3517321753 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7ff0400662f0 msgr2=0x7ff0400687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:43:35.464 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.456+0000 7ff063cc3700 1 --2- 172.21.15.62:0/3517321753 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7ff0400662f0 0x7ff0400687a0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7ff05c0cb970 tx=0x7ff04c008040 comp rx=0 tx=0).stop 2023-06-09T11:43:35.465 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.456+0000 7ff063cc3700 1 -- 172.21.15.62:0/3517321753 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff05c0b0be0 msgr2=0x7ff05c0c3e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:43:35.465 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.456+0000 7ff063cc3700 1 --2- 172.21.15.62:0/3517321753 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff05c0b0be0 0x7ff05c0c3e00 secure :-1 s=READY pgs=2633 cs=0 l=1 rev1=1 crypto rx=0x7ff05c066ce0 tx=0x7ff058004770 comp rx=0 tx=0).stop 2023-06-09T11:43:35.465 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.456+0000 7ff063cc3700 1 -- 172.21.15.62:0/3517321753 shutdown_connections 2023-06-09T11:43:35.466 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.456+0000 7ff063cc3700 1 --2- 172.21.15.62:0/3517321753 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7ff0400662f0 0x7ff0400687a0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:43:35.466 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.456+0000 7ff063cc3700 1 --2- 172.21.15.62:0/3517321753 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff05c1637c0 0x7ff05c0697f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:43:35.466 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.456+0000 7ff063cc3700 1 --2- 172.21.15.62:0/3517321753 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7ff05c0b1310 0x7ff05c0c4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:43:35.466 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.456+0000 7ff063cc3700 1 --2- 172.21.15.62:0/3517321753 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff05c0b0be0 0x7ff05c0c3e00 unknown :-1 s=CLOSED pgs=2633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:43:35.466 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.456+0000 7ff063cc3700 1 -- 172.21.15.62:0/3517321753 >> 172.21.15.62:0/3517321753 conn(0x7ff05c06c5d0 msgr2=0x7ff05c0b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:43:35.466 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.456+0000 7ff063cc3700 1 -- 172.21.15.62:0/3517321753 shutdown_connections 2023-06-09T11:43:35.466 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.456+0000 7ff063cc3700 1 -- 172.21.15.62:0/3517321753 wait complete. 2023-06-09T11:43:35.487 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-09T11:43:35.666 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.656+0000 7f62192bc700 1 Processor -- start 2023-06-09T11:43:35.666 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.660+0000 7f62192bc700 1 -- start start 2023-06-09T11:43:35.669 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.660+0000 7f62192bc700 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f62140cd2e0 0x7f62140b3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:43:35.669 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.660+0000 7f62192bc700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62140b4d50 con 0x7f62140d1f80 2023-06-09T11:43:35.670 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.660+0000 7f62192bc700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62140ceff0 con 0x7f62140cebf0 2023-06-09T11:43:35.670 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.660+0000 7f62192bc700 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62140b4140 con 0x7f62140cd2e0 2023-06-09T11:43:35.670 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.664+0000 7f6212ffd700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f62140d1f80 0x7f62140ccbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:52364/0 (socket says 172.21.15.62:52364) 2023-06-09T11:43:35.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.664+0000 7f6212ffd700 1 -- 172.21.15.62:0/1935421378 learned_addr learned my addr 172.21.15.62:0/1935421378 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T11:43:35.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.664+0000 7f62127fc700 1 --2- 172.21.15.62:0/1935421378 >> v2:172.21.15.62:3300/0 conn(0x7f62140cd2e0 0x7f62140b3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:43:35.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.664+0000 7f6211ffb700 1 -- 172.21.15.62:0/1935421378 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1352363852 0 0) 0x7f62140b4d50 con 0x7f62140d1f80 2023-06-09T11:43:35.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.664+0000 7f6211ffb700 1 -- 172.21.15.62:0/1935421378 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61fc0035d0 con 0x7f62140d1f80 2023-06-09T11:43:35.672 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.664+0000 7f62127fc700 1 -- 172.21.15.62:0/1935421378 >> v1:172.21.15.89:6789/0 conn(0x7f62140cebf0 legacy=0x7f62140d0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:43:35.672 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.664+0000 7f62127fc700 1 -- 172.21.15.62:0/1935421378 >> v1:172.21.15.62:6789/0 conn(0x7f62140d1f80 legacy=0x7f62140ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:43:35.672 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.664+0000 7f62127fc700 1 -- 172.21.15.62:0/1935421378 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62140b4420 con 0x7f62140cd2e0 2023-06-09T11:43:35.673 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.664+0000 7f62127fc700 1 --2- 172.21.15.62:0/1935421378 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f62140cd2e0 0x7f62140b3b20 secure :-1 s=READY pgs=2635 cs=0 l=1 rev1=1 crypto rx=0x7f6208009850 tx=0x7f6208009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47fc1d8fd2024a6a server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:43:35.673 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.664+0000 7f6211ffb700 1 -- 172.21.15.62:0/1935421378 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6208011830 con 0x7f62140cd2e0 2023-06-09T11:43:35.673 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.664+0000 7f6211ffb700 1 -- 172.21.15.62:0/1935421378 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6208011990 con 0x7f62140cd2e0 2023-06-09T11:43:35.673 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.664+0000 7f6211ffb700 1 -- 172.21.15.62:0/1935421378 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6208011d40 con 0x7f62140cd2e0 2023-06-09T11:43:35.673 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.664+0000 7f62192bc700 1 -- 172.21.15.62:0/1935421378 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f62140cd2e0 msgr2=0x7f62140b3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:43:35.673 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.664+0000 7f62192bc700 1 --2- 172.21.15.62:0/1935421378 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f62140cd2e0 0x7f62140b3b20 secure :-1 s=READY pgs=2635 cs=0 l=1 rev1=1 crypto rx=0x7f6208009850 tx=0x7f6208009b60 comp rx=0 tx=0).stop 2023-06-09T11:43:35.674 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.664+0000 7f62192bc700 1 -- 172.21.15.62:0/1935421378 shutdown_connections 2023-06-09T11:43:35.674 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.664+0000 7f62192bc700 1 --2- 172.21.15.62:0/1935421378 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f62140cd2e0 0x7f62140b3b20 unknown :-1 s=CLOSED pgs=2635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:43:35.674 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.664+0000 7f62192bc700 1 -- 172.21.15.62:0/1935421378 >> 172.21.15.62:0/1935421378 conn(0x7f6214071840 msgr2=0x7f621409b760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:43:35.674 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.664+0000 7f62192bc700 1 -- 172.21.15.62:0/1935421378 shutdown_connections 2023-06-09T11:43:35.674 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.664+0000 7f62192bc700 1 -- 172.21.15.62:0/1935421378 wait complete. 2023-06-09T11:43:35.675 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.668+0000 7f62192bc700 1 Processor -- start 2023-06-09T11:43:35.675 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.668+0000 7f62192bc700 1 -- start start 2023-06-09T11:43:35.676 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.668+0000 7f62192bc700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62140cd2e0 0x7f62140b0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:43:35.677 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.668+0000 7f62192bc700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62140cebf0 0x7f62141589d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:43:35.677 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.668+0000 7f62192bc700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f62140d1f80 0x7f62140d0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:43:35.677 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.668+0000 7f62192bc700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62140b1160 con 0x7f62140d1f80 2023-06-09T11:43:35.677 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.668+0000 7f62192bc700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62140cc4f0 con 0x7f62140cd2e0 2023-06-09T11:43:35.677 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.668+0000 7f62192bc700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62140cbc90 con 0x7f62140cebf0 2023-06-09T11:43:35.678 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.668+0000 7f62137fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f62140d1f80 0x7f62140d0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:43:35.678 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.668+0000 7f62137fe700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f62140d1f80 0x7f62140d0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57852/0 (socket says 172.21.15.62:57852) 2023-06-09T11:43:35.678 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.668+0000 7f62137fe700 1 -- 172.21.15.62:0/324785156 learned_addr learned my addr 172.21.15.62:0/324785156 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T11:43:35.679 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.668+0000 7f6212ffd700 1 --2- 172.21.15.62:0/324785156 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62140cd2e0 0x7f62140b0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:43:35.679 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.668+0000 7f62127fc700 1 --2- 172.21.15.62:0/324785156 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62140cebf0 0x7f62141589d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:43:35.679 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.668+0000 7f62137fe700 1 -- 172.21.15.62:0/324785156 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62140cebf0 msgr2=0x7f62141589d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:43:35.679 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.668+0000 7f62137fe700 1 --2- 172.21.15.62:0/324785156 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62140cebf0 0x7f62141589d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:43:35.679 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.668+0000 7f62137fe700 1 -- 172.21.15.62:0/324785156 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62140cd2e0 msgr2=0x7f62140b0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:43:35.679 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.668+0000 7f62137fe700 1 --2- 172.21.15.62:0/324785156 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62140cd2e0 0x7f62140b0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:43:35.679 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.668+0000 7f62137fe700 1 -- 172.21.15.62:0/324785156 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62080094b0 con 0x7f62140d1f80 2023-06-09T11:43:35.679 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.672+0000 7f62137fe700 1 --2- 172.21.15.62:0/324785156 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f62140d1f80 0x7f62140d0d90 secure :-1 s=READY pgs=2636 cs=0 l=1 rev1=1 crypto rx=0x7f620c00cc50 tx=0x7f620c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:43:35.680 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.672+0000 7f61fb7fe700 1 -- 172.21.15.62:0/324785156 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f620c00ad80 con 0x7f62140d1f80 2023-06-09T11:43:35.680 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.672+0000 7f61fb7fe700 1 -- 172.21.15.62:0/324785156 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f620c00ce50 con 0x7f62140d1f80 2023-06-09T11:43:35.680 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.672+0000 7f61fb7fe700 1 -- 172.21.15.62:0/324785156 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f620c003c60 con 0x7f62140d1f80 2023-06-09T11:43:35.680 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.672+0000 7f62192bc700 1 -- 172.21.15.62:0/324785156 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62140b0ec0 con 0x7f62140d1f80 2023-06-09T11:43:35.681 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.672+0000 7f62192bc700 1 -- 172.21.15.62:0/324785156 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62140cbf30 con 0x7f62140d1f80 2023-06-09T11:43:35.681 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.672+0000 7f62192bc700 1 -- 172.21.15.62:0/324785156 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62140c9630 con 0x7f62140d1f80 2023-06-09T11:43:35.681 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.672+0000 7f61fb7fe700 1 -- 172.21.15.62:0/324785156 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7f620c0050d0 con 0x7f62140d1f80 2023-06-09T11:43:35.683 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.676+0000 7f61fb7fe700 1 --2- 172.21.15.62:0/324785156 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f62000662f0 0x7f62000687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:43:35.683 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.676+0000 7f61fb7fe700 1 -- 172.21.15.62:0/324785156 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6440+0+0 (secure 0 0 0) 0x7f620c083f70 con 0x7f62140d1f80 2023-06-09T11:43:35.684 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.676+0000 7f6212ffd700 1 --2- 172.21.15.62:0/324785156 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f62000662f0 0x7f62000687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:43:35.685 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.676+0000 7f6212ffd700 1 --2- 172.21.15.62:0/324785156 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f62000662f0 0x7f62000687a0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f62040010e0 tx=0x7f6204009040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:43:35.689 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.680+0000 7f61fb7fe700 1 -- 172.21.15.62:0/324785156 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7f62140c9630 con 0x7f62140d1f80 2023-06-09T11:43:35.859 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.852+0000 7f62192bc700 1 -- 172.21.15.62:0/324785156 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f62140c9630 con 0x7f62140d1f80 2023-06-09T11:43:35.860 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.852+0000 7f61fb7fe700 1 -- 172.21.15.62:0/324785156 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v49) v1 ==== 104+0+11 (secure 0 0 0) 0x7f62140c9630 con 0x7f62140d1f80 2023-06-09T11:43:35.860 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-06-09T11:43:35.864 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.856+0000 7f62192bc700 1 -- 172.21.15.62:0/324785156 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f62000662f0 msgr2=0x7f62000687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:43:35.864 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.856+0000 7f62192bc700 1 --2- 172.21.15.62:0/324785156 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f62000662f0 0x7f62000687a0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f62040010e0 tx=0x7f6204009040 comp rx=0 tx=0).stop 2023-06-09T11:43:35.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.856+0000 7f62192bc700 1 -- 172.21.15.62:0/324785156 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f62140d1f80 msgr2=0x7f62140d0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:43:35.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.856+0000 7f62192bc700 1 --2- 172.21.15.62:0/324785156 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f62140d1f80 0x7f62140d0d90 secure :-1 s=READY pgs=2636 cs=0 l=1 rev1=1 crypto rx=0x7f620c00cc50 tx=0x7f620c00a340 comp rx=0 tx=0).stop 2023-06-09T11:43:35.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.856+0000 7f62192bc700 1 -- 172.21.15.62:0/324785156 shutdown_connections 2023-06-09T11:43:35.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.856+0000 7f62192bc700 1 --2- 172.21.15.62:0/324785156 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7f62000662f0 0x7f62000687a0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:43:35.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.856+0000 7f62192bc700 1 --2- 172.21.15.62:0/324785156 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f62140d1f80 0x7f62140d0d90 unknown :-1 s=CLOSED pgs=2636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:43:35.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.856+0000 7f62192bc700 1 --2- 172.21.15.62:0/324785156 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7f62140cebf0 0x7f62141589d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:43:35.866 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.856+0000 7f62192bc700 1 --2- 172.21.15.62:0/324785156 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62140cd2e0 0x7f62140b0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:43:35.866 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.856+0000 7f62192bc700 1 -- 172.21.15.62:0/324785156 >> 172.21.15.62:0/324785156 conn(0x7f6214071840 msgr2=0x7f62140b7310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:43:35.866 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.856+0000 7f62192bc700 1 -- 172.21.15.62:0/324785156 shutdown_connections 2023-06-09T11:43:35.866 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:35.856+0000 7f62192bc700 1 -- 172.21.15.62:0/324785156 wait complete. 2023-06-09T11:43:35.886 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-09T11:43:36.064 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.056+0000 7fba05a62700 1 Processor -- start 2023-06-09T11:43:36.065 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.056+0000 7fba05a62700 1 -- start start 2023-06-09T11:43:36.067 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.060+0000 7fba05a62700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fba000d0270 0x7fba0006ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:43:36.067 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.060+0000 7fba05a62700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fba000d2220 0x7fba000d0640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:43:36.067 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.060+0000 7fba05a62700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba000d2670 con 0x7fba000cf060 2023-06-09T11:43:36.067 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.060+0000 7fba05a62700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba0015c720 con 0x7fba000d0270 2023-06-09T11:43:36.067 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.060+0000 7fba05a62700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba000cce90 con 0x7fba000d2220 2023-06-09T11:43:36.068 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.060+0000 7fb9ff7fe700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fba000d0270 0x7fba0006ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:43:36.068 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.060+0000 7fb9ff7fe700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fba000d0270 0x7fba0006ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.62:36198/0 (socket says 172.21.15.62:36198) 2023-06-09T11:43:36.068 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.060+0000 7fb9fffff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fba000cf060 0x7fba000cf4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:52376/0 (socket says 172.21.15.62:52376) 2023-06-09T11:43:36.069 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.060+0000 7fb9ff7fe700 1 -- 172.21.15.62:0/4114186365 learned_addr learned my addr 172.21.15.62:0/4114186365 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T11:43:36.069 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.060+0000 7fb9f6ffd700 1 --2- 172.21.15.62:0/4114186365 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fba000d2220 0x7fba000d0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:43:36.069 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.060+0000 7fb9f6ffd700 1 -- 172.21.15.62:0/4114186365 >> v2:172.21.15.89:3300/0 conn(0x7fba000d0270 msgr2=0x7fba0006ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:43:36.069 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.060+0000 7fb9f6ffd700 1 --2- 172.21.15.62:0/4114186365 >> v2:172.21.15.89:3300/0 conn(0x7fba000d0270 0x7fba0006ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:43:36.070 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.060+0000 7fb9f6ffd700 1 -- 172.21.15.62:0/4114186365 >> v1:172.21.15.62:6789/0 conn(0x7fba000cf060 legacy=0x7fba000cf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:43:36.070 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.060+0000 7fb9f6ffd700 1 -- 172.21.15.62:0/4114186365 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba0006bb60 con 0x7fba000d2220 2023-06-09T11:43:36.070 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.060+0000 7fb9f6ffd700 1 --2- 172.21.15.62:0/4114186365 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fba000d2220 0x7fba000d0640 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb9e8009850 tx=0x7fb9e8009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9b83e94d74acfb4 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:43:36.071 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.064+0000 7fb9feffd700 1 -- 172.21.15.62:0/4114186365 <== mon.2 v2:172.21.15.89:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e8011830 con 0x7fba000d2220 2023-06-09T11:43:36.071 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.064+0000 7fb9feffd700 1 -- 172.21.15.62:0/4114186365 <== mon.2 v2:172.21.15.89:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9e8011990 con 0x7fba000d2220 2023-06-09T11:43:36.071 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.064+0000 7fb9feffd700 1 -- 172.21.15.62:0/4114186365 <== mon.2 v2:172.21.15.89:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e8011d40 con 0x7fba000d2220 2023-06-09T11:43:36.072 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.064+0000 7fba05a62700 1 -- 172.21.15.62:0/4114186365 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fba000d2220 msgr2=0x7fba000d0640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:43:36.072 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.064+0000 7fba05a62700 1 --2- 172.21.15.62:0/4114186365 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fba000d2220 0x7fba000d0640 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb9e8009850 tx=0x7fb9e8009b60 comp rx=0 tx=0).stop 2023-06-09T11:43:36.072 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.064+0000 7fba05a62700 1 -- 172.21.15.62:0/4114186365 shutdown_connections 2023-06-09T11:43:36.073 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.064+0000 7fba05a62700 1 --2- 172.21.15.62:0/4114186365 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fba000d2220 0x7fba000d0640 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:43:36.073 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.064+0000 7fba05a62700 1 --2- 172.21.15.62:0/4114186365 >> v2:172.21.15.89:3300/0 conn(0x7fba000d0270 0x7fba0006ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:43:36.073 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.064+0000 7fba05a62700 1 -- 172.21.15.62:0/4114186365 >> 172.21.15.62:0/4114186365 conn(0x7fba00089fc0 msgr2=0x7fba0009b950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:43:36.073 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.064+0000 7fba05a62700 1 -- 172.21.15.62:0/4114186365 shutdown_connections 2023-06-09T11:43:36.073 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.064+0000 7fba05a62700 1 -- 172.21.15.62:0/4114186365 wait complete. 2023-06-09T11:43:36.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.068+0000 7fba05a62700 1 Processor -- start 2023-06-09T11:43:36.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.068+0000 7fba05a62700 1 -- start start 2023-06-09T11:43:36.078 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.072+0000 7fba05a62700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fba000cf060 0x7fba0015a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:43:36.078 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.072+0000 7fba05a62700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba000d0270 0x7fba001e6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:43:36.078 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.072+0000 7fba05a62700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba000d2220 0x7fba001e6760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:43:36.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.072+0000 7fba05a62700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba0015e4f0 con 0x7fba000d2220 2023-06-09T11:43:36.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.072+0000 7fba05a62700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba0015d8e0 con 0x7fba000d0270 2023-06-09T11:43:36.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.072+0000 7fba05a62700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba0015dbc0 con 0x7fba000cf060 2023-06-09T11:43:36.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.072+0000 7fb9fffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba000d2220 0x7fba001e6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:43:36.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.072+0000 7fb9fffff700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba000d2220 0x7fba001e6760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57858/0 (socket says 172.21.15.62:57858) 2023-06-09T11:43:36.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.072+0000 7fb9fffff700 1 -- 172.21.15.62:0/1876506197 learned_addr learned my addr 172.21.15.62:0/1876506197 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T11:43:36.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.072+0000 7fb9f6ffd700 1 --2- 172.21.15.62:0/1876506197 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba000d0270 0x7fba001e6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:43:36.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.072+0000 7fb9ff7fe700 1 --2- 172.21.15.62:0/1876506197 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fba000cf060 0x7fba0015a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:43:36.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.072+0000 7fb9fffff700 1 -- 172.21.15.62:0/1876506197 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fba000cf060 msgr2=0x7fba0015a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:43:36.080 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.072+0000 7fb9fffff700 1 --2- 172.21.15.62:0/1876506197 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fba000cf060 0x7fba0015a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:43:36.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.072+0000 7fb9fffff700 1 -- 172.21.15.62:0/1876506197 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba000d0270 msgr2=0x7fba001e6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:43:36.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.072+0000 7fb9fffff700 1 --2- 172.21.15.62:0/1876506197 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba000d0270 0x7fba001e6220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:43:36.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.072+0000 7fb9fffff700 1 -- 172.21.15.62:0/1876506197 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e80094b0 con 0x7fba000d2220 2023-06-09T11:43:36.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.072+0000 7fb9fffff700 1 --2- 172.21.15.62:0/1876506197 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba000d2220 0x7fba001e6760 secure :-1 s=READY pgs=2638 cs=0 l=1 rev1=1 crypto rx=0x7fb9f800c410 tx=0x7fb9f800c720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:43:36.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.072+0000 7fb9fcff9700 1 -- 172.21.15.62:0/1876506197 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f8005cd0 con 0x7fba000d2220 2023-06-09T11:43:36.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.072+0000 7fb9fcff9700 1 -- 172.21.15.62:0/1876506197 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9f8005e30 con 0x7fba000d2220 2023-06-09T11:43:36.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.072+0000 7fba05a62700 1 -- 172.21.15.62:0/1876506197 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba0015dea0 con 0x7fba000d2220 2023-06-09T11:43:36.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.072+0000 7fb9fcff9700 1 -- 172.21.15.62:0/1876506197 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f80072f0 con 0x7fba000d2220 2023-06-09T11:43:36.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.072+0000 7fba05a62700 1 -- 172.21.15.62:0/1876506197 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba0015a5b0 con 0x7fba000d2220 2023-06-09T11:43:36.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.076+0000 7fba05a62700 1 -- 172.21.15.62:0/1876506197 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba0015e660 con 0x7fba000d2220 2023-06-09T11:43:36.085 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.076+0000 7fb9fcff9700 1 -- 172.21.15.62:0/1876506197 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fb9f8007450 con 0x7fba000d2220 2023-06-09T11:43:36.087 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.080+0000 7fb9fcff9700 1 --2- 172.21.15.62:0/1876506197 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fb9e00662f0 0x7fb9e00687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:43:36.087 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.080+0000 7fb9fcff9700 1 -- 172.21.15.62:0/1876506197 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fb9f8083220 con 0x7fba000d2220 2023-06-09T11:43:36.087 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.080+0000 7fb9ff7fe700 1 --2- 172.21.15.62:0/1876506197 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fb9e00662f0 0x7fb9e00687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:43:36.089 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.080+0000 7fb9ff7fe700 1 --2- 172.21.15.62:0/1876506197 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fb9e00662f0 0x7fb9e00687a0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fb9f00113a0 tx=0x7fb9f000b040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:43:36.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.088+0000 7fb9fcff9700 1 -- 172.21.15.62:0/1876506197 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fb9f8050480 con 0x7fba000d2220 2023-06-09T11:43:36.270 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.260+0000 7fba05a62700 1 -- 172.21.15.62:0/1876506197 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fba000739c0 con 0x7fba000d2220 2023-06-09T11:43:36.271 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.264+0000 7fb9fcff9700 1 -- 172.21.15.62:0/1876506197 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v49) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb9f8017020 con 0x7fba000d2220 2023-06-09T11:43:36.272 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 64 2023-06-09T11:43:36.274 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.264+0000 7fba05a62700 1 -- 172.21.15.62:0/1876506197 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fb9e00662f0 msgr2=0x7fb9e00687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:43:36.274 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.264+0000 7fba05a62700 1 --2- 172.21.15.62:0/1876506197 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fb9e00662f0 0x7fb9e00687a0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fb9f00113a0 tx=0x7fb9f000b040 comp rx=0 tx=0).stop 2023-06-09T11:43:36.274 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.264+0000 7fba05a62700 1 -- 172.21.15.62:0/1876506197 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba000d2220 msgr2=0x7fba001e6760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:43:36.274 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.264+0000 7fba05a62700 1 --2- 172.21.15.62:0/1876506197 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba000d2220 0x7fba001e6760 secure :-1 s=READY pgs=2638 cs=0 l=1 rev1=1 crypto rx=0x7fb9f800c410 tx=0x7fb9f800c720 comp rx=0 tx=0).stop 2023-06-09T11:43:36.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.268+0000 7fba05a62700 1 -- 172.21.15.62:0/1876506197 shutdown_connections 2023-06-09T11:43:36.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.268+0000 7fba05a62700 1 --2- 172.21.15.62:0/1876506197 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fb9e00662f0 0x7fb9e00687a0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:43:36.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.268+0000 7fba05a62700 1 --2- 172.21.15.62:0/1876506197 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fba000d2220 0x7fba001e6760 unknown :-1 s=CLOSED pgs=2638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:43:36.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.268+0000 7fba05a62700 1 --2- 172.21.15.62:0/1876506197 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba000d0270 0x7fba001e6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:43:36.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.268+0000 7fba05a62700 1 --2- 172.21.15.62:0/1876506197 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fba000cf060 0x7fba0015a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:43:36.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.268+0000 7fba05a62700 1 -- 172.21.15.62:0/1876506197 >> 172.21.15.62:0/1876506197 conn(0x7fba00089fc0 msgr2=0x7fba000b1250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:43:36.276 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.268+0000 7fba05a62700 1 -- 172.21.15.62:0/1876506197 shutdown_connections 2023-06-09T11:43:36.276 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.268+0000 7fba05a62700 1 -- 172.21.15.62:0/1876506197 wait complete. 2023-06-09T11:43:36.298 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-09T11:43:36.482 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.476+0000 7fec7b1a0700 1 Processor -- start 2023-06-09T11:43:36.483 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.476+0000 7fec7b1a0700 1 -- start start 2023-06-09T11:43:36.485 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.476+0000 7fec7b1a0700 1 --2- >> v2:172.21.15.89:3300/0 conn(0x7fec740cc030 0x7fec740cd750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:43:36.485 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.476+0000 7fec7b1a0700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec740cb6c0 con 0x7fec740c8840 2023-06-09T11:43:36.486 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.476+0000 7fec7b1a0700 1 -- --> v1:172.21.15.89:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec740ccfe0 con 0x7fec740ca7a0 2023-06-09T11:43:36.486 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.476+0000 7fec7b1a0700 1 -- --> v2:172.21.15.89:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec740c1360 con 0x7fec740cc030 2023-06-09T11:43:36.486 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.480+0000 7fec73fff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fec740c8840 0x7fec740ca090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:52390/0 (socket says 172.21.15.62:52390) 2023-06-09T11:43:36.486 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.480+0000 7fec73fff700 1 -- 172.21.15.62:0/573452600 learned_addr learned my addr 172.21.15.62:0/573452600 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-06-09T11:43:36.487 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.480+0000 7fec78f3c700 1 --2- 172.21.15.62:0/573452600 >> v2:172.21.15.89:3300/0 conn(0x7fec740cc030 0x7fec740cd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:43:36.487 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.480+0000 7fec737fe700 1 -- 172.21.15.62:0/573452600 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 5272573 0 0) 0x7fec740cb6c0 con 0x7fec740c8840 2023-06-09T11:43:36.487 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.480+0000 7fec737fe700 1 -- 172.21.15.62:0/573452600 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec640035d0 con 0x7fec740c8840 2023-06-09T11:43:36.488 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.480+0000 7fec737fe700 1 -- 172.21.15.62:0/573452600 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2979814212 0 0) 0x7fec640035d0 con 0x7fec740c8840 2023-06-09T11:43:36.488 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.480+0000 7fec737fe700 1 -- 172.21.15.62:0/573452600 >> v2:172.21.15.89:3300/0 conn(0x7fec740cc030 msgr2=0x7fec740cd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:43:36.488 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.480+0000 7fec737fe700 1 --2- 172.21.15.62:0/573452600 >> v2:172.21.15.89:3300/0 conn(0x7fec740cc030 0x7fec740cd750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:43:36.488 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.480+0000 7fec737fe700 1 -- 172.21.15.62:0/573452600 >> v1:172.21.15.89:6789/0 conn(0x7fec740ca7a0 legacy=0x7fec7415fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:43:36.488 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.480+0000 7fec737fe700 1 -- 172.21.15.62:0/573452600 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec740c1080 con 0x7fec740c8840 2023-06-09T11:43:36.488 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.480+0000 7fec737fe700 1 -- 172.21.15.62:0/573452600 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 540845019 0 0) 0x7fec60001690 con 0x7fec740c8840 2023-06-09T11:43:36.490 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.480+0000 7fec737fe700 1 -- 172.21.15.62:0/573452600 >> v1:172.21.15.62:6789/0 conn(0x7fec740c8840 legacy=0x7fec740ca090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:43:36.490 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.480+0000 7fec737fe700 1 --2- 172.21.15.62:0/573452600 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec64003a20 0x7fec64003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:43:36.490 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.480+0000 7fec737fe700 1 --2- 172.21.15.62:0/573452600 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec64004410 0x7fec640048d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:43:36.490 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.480+0000 7fec737fe700 1 --2- 172.21.15.62:0/573452600 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fec640050d0 0x7fec6400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:43:36.490 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.480+0000 7fec737fe700 1 -- 172.21.15.62:0/573452600 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec740c1360 con 0x7fec64004410 2023-06-09T11:43:36.490 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.480+0000 7fec737fe700 1 -- 172.21.15.62:0/573452600 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec6400c020 con 0x7fec64003a20 2023-06-09T11:43:36.490 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.480+0000 7fec737fe700 1 -- 172.21.15.62:0/573452600 --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec6400c1e0 con 0x7fec640050d0 2023-06-09T11:43:36.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.480+0000 7fec73fff700 1 --2- 172.21.15.62:0/573452600 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec64004410 0x7fec640048d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:43:36.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.480+0000 7fec73fff700 1 -- 172.21.15.62:0/573452600 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fec640050d0 msgr2=0x7fec6400ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:43:36.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.480+0000 7fec73fff700 1 --2- 172.21.15.62:0/573452600 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fec640050d0 0x7fec6400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:43:36.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.480+0000 7fec73fff700 1 -- 172.21.15.62:0/573452600 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec64003a20 msgr2=0x7fec64003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-09T11:43:36.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.480+0000 7fec73fff700 1 --2- 172.21.15.62:0/573452600 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec64003a20 0x7fec64003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:43:36.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.480+0000 7fec73fff700 1 -- 172.21.15.62:0/573452600 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec640035d0 con 0x7fec64004410 2023-06-09T11:43:36.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.480+0000 7fec7973d700 1 -- 172.21.15.62:0/573452600 reap_dead start 2023-06-09T11:43:36.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.480+0000 7fec73fff700 1 --2- 172.21.15.62:0/573452600 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec64004410 0x7fec640048d0 secure :-1 s=READY pgs=2640 cs=0 l=1 rev1=1 crypto rx=0x7fec740adc40 tx=0x7fec640058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=207245585a84b804 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:43:36.492 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.480+0000 7fec737fe700 1 -- 172.21.15.62:0/573452600 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec6000cde0 con 0x7fec64004410 2023-06-09T11:43:36.492 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.480+0000 7fec737fe700 1 -- 172.21.15.62:0/573452600 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec60005980 con 0x7fec64004410 2023-06-09T11:43:36.492 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.480+0000 7fec737fe700 1 -- 172.21.15.62:0/573452600 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec60005d30 con 0x7fec64004410 2023-06-09T11:43:36.492 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.480+0000 7fec7b1a0700 1 -- 172.21.15.62:0/573452600 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec64004410 msgr2=0x7fec640048d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:43:36.492 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.480+0000 7fec7b1a0700 1 --2- 172.21.15.62:0/573452600 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec64004410 0x7fec640048d0 secure :-1 s=READY pgs=2640 cs=0 l=1 rev1=1 crypto rx=0x7fec740adc40 tx=0x7fec640058a0 comp rx=0 tx=0).stop 2023-06-09T11:43:36.493 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.484+0000 7fec7b1a0700 1 -- 172.21.15.62:0/573452600 shutdown_connections 2023-06-09T11:43:36.493 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.484+0000 7fec7b1a0700 1 --2- 172.21.15.62:0/573452600 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec64004410 0x7fec640048d0 unknown :-1 s=CLOSED pgs=2640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:43:36.493 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.484+0000 7fec7b1a0700 1 -- 172.21.15.62:0/573452600 >> 172.21.15.62:0/573452600 conn(0x7fec7406a410 msgr2=0x7fec740afd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:43:36.493 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.484+0000 7fec7b1a0700 1 -- 172.21.15.62:0/573452600 shutdown_connections 2023-06-09T11:43:36.493 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.484+0000 7fec7b1a0700 1 -- 172.21.15.62:0/573452600 wait complete. 2023-06-09T11:43:36.494 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.484+0000 7fec7b1a0700 1 Processor -- start 2023-06-09T11:43:36.494 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.484+0000 7fec7b1a0700 1 -- start start 2023-06-09T11:43:36.494 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.488+0000 7fec7b1a0700 1 --2- >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fec64004410 0x7fec740c6770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:43:36.495 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.488+0000 7fec7b1a0700 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec741f54d0 0x7fec741f65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:43:36.495 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.488+0000 7fec7b1a0700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec740c7e10 0x7fec7406f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:43:36.495 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.488+0000 7fec7b1a0700 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec741f6ae0 con 0x7fec740c7e10 2023-06-09T11:43:36.495 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.488+0000 7fec7b1a0700 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec740c4860 con 0x7fec741f54d0 2023-06-09T11:43:36.495 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.488+0000 7fec7b1a0700 1 -- --> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec740c6d70 con 0x7fec64004410 2023-06-09T11:43:36.495 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.488+0000 7fec7973d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec740c7e10 0x7fec7406f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:43:36.495 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.488+0000 7fec7973d700 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec740c7e10 0x7fec7406f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:57876/0 (socket says 172.21.15.62:57876) 2023-06-09T11:43:36.496 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.488+0000 7fec7973d700 1 -- 172.21.15.62:0/2053119940 learned_addr learned my addr 172.21.15.62:0/2053119940 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-06-09T11:43:36.497 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.488+0000 7fec78f3c700 1 --2- 172.21.15.62:0/2053119940 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fec64004410 0x7fec740c6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:43:36.497 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.488+0000 7fec73fff700 1 --2- 172.21.15.62:0/2053119940 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec741f54d0 0x7fec741f65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:43:36.497 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.488+0000 7fec7973d700 1 -- 172.21.15.62:0/2053119940 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fec64004410 msgr2=0x7fec740c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:43:36.497 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.488+0000 7fec7973d700 1 --2- 172.21.15.62:0/2053119940 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fec64004410 0x7fec740c6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:43:36.497 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.488+0000 7fec7973d700 1 -- 172.21.15.62:0/2053119940 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec741f54d0 msgr2=0x7fec741f65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:43:36.497 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.488+0000 7fec7973d700 1 --2- 172.21.15.62:0/2053119940 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec741f54d0 0x7fec741f65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:43:36.498 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.488+0000 7fec7973d700 1 -- 172.21.15.62:0/2053119940 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec740c7050 con 0x7fec740c7e10 2023-06-09T11:43:36.498 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.488+0000 7fec78f3c700 1 --2- 172.21.15.62:0/2053119940 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fec64004410 0x7fec740c6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T11:43:36.498 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.488+0000 7fec73fff700 1 --2- 172.21.15.62:0/2053119940 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec741f54d0 0x7fec741f65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-09T11:43:36.498 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.488+0000 7fec7973d700 1 --2- 172.21.15.62:0/2053119940 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec740c7e10 0x7fec7406f640 secure :-1 s=READY pgs=2641 cs=0 l=1 rev1=1 crypto rx=0x7fec740adc10 tx=0x7fec6c00cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:43:36.498 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.488+0000 7fec717fa700 1 -- 172.21.15.62:0/2053119940 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec6c00aa40 con 0x7fec740c7e10 2023-06-09T11:43:36.498 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.488+0000 7fec717fa700 1 -- 172.21.15.62:0/2053119940 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec6c00abc0 con 0x7fec740c7e10 2023-06-09T11:43:36.498 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.488+0000 7fec717fa700 1 -- 172.21.15.62:0/2053119940 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec6c007070 con 0x7fec740c7e10 2023-06-09T11:43:36.498 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.488+0000 7fec7b1a0700 1 -- 172.21.15.62:0/2053119940 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec740c7330 con 0x7fec740c7e10 2023-06-09T11:43:36.499 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.488+0000 7fec7b1a0700 1 -- 172.21.15.62:0/2053119940 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec740c78f0 con 0x7fec740c7e10 2023-06-09T11:43:36.499 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.488+0000 7fec7b1a0700 1 -- 172.21.15.62:0/2053119940 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec740ccaf0 con 0x7fec740c7e10 2023-06-09T11:43:36.499 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.492+0000 7fec717fa700 1 -- 172.21.15.62:0/2053119940 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 85658+0+0 (secure 0 0 0) 0x7fec6c0071d0 con 0x7fec740c7e10 2023-06-09T11:43:36.500 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.492+0000 7fec717fa700 1 --2- 172.21.15.62:0/2053119940 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fec580662f0 0x7fec580687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-09T11:43:36.501 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.492+0000 7fec717fa700 1 -- 172.21.15.62:0/2053119940 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6440+0+0 (secure 0 0 0) 0x7fec6c0836f0 con 0x7fec740c7e10 2023-06-09T11:43:36.501 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.492+0000 7fec78f3c700 1 --2- 172.21.15.62:0/2053119940 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fec580662f0 0x7fec580687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-09T11:43:36.502 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.496+0000 7fec78f3c700 1 --2- 172.21.15.62:0/2053119940 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fec580662f0 0x7fec580687a0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fec74069390 tx=0x7fec68008040 comp rx=0 tx=0).ready entity=mgr.4106 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-09T11:43:36.506 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.500+0000 7fec717fa700 1 -- 172.21.15.62:0/2053119940 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169708 (secure 0 0 0) 0x7fec6c0509e0 con 0x7fec740c7e10 2023-06-09T11:43:36.693 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.684+0000 7fec7b1a0700 1 -- 172.21.15.62:0/2053119940 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fec740b4170 con 0x7fec740c7e10 2023-06-09T11:43:36.694 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.688+0000 7fec717fa700 1 -- 172.21.15.62:0/2053119940 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v49) v1 ==== 80+0+0 (secure 0 0 0) 0x7fec6c054000 con 0x7fec740c7e10 2023-06-09T11:43:36.696 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.688+0000 7fec7b1a0700 1 -- 172.21.15.62:0/2053119940 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fec580662f0 msgr2=0x7fec580687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:43:36.697 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.688+0000 7fec7b1a0700 1 --2- 172.21.15.62:0/2053119940 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fec580662f0 0x7fec580687a0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fec74069390 tx=0x7fec68008040 comp rx=0 tx=0).stop 2023-06-09T11:43:36.697 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.688+0000 7fec7b1a0700 1 -- 172.21.15.62:0/2053119940 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec740c7e10 msgr2=0x7fec7406f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-09T11:43:36.697 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.688+0000 7fec7b1a0700 1 --2- 172.21.15.62:0/2053119940 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec740c7e10 0x7fec7406f640 secure :-1 s=READY pgs=2641 cs=0 l=1 rev1=1 crypto rx=0x7fec740adc10 tx=0x7fec6c00cf20 comp rx=0 tx=0).stop 2023-06-09T11:43:36.698 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.688+0000 7fec7b1a0700 1 -- 172.21.15.62:0/2053119940 shutdown_connections 2023-06-09T11:43:36.698 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.688+0000 7fec7b1a0700 1 --2- 172.21.15.62:0/2053119940 >> [v2:172.21.15.89:6832/3073446405,v1:172.21.15.89:6833/3073446405] conn(0x7fec580662f0 0x7fec580687a0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:43:36.698 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.688+0000 7fec7b1a0700 1 --2- 172.21.15.62:0/2053119940 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec740c7e10 0x7fec7406f640 unknown :-1 s=CLOSED pgs=2641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:43:36.698 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.688+0000 7fec7b1a0700 1 --2- 172.21.15.62:0/2053119940 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec741f54d0 0x7fec741f65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:43:36.698 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.688+0000 7fec7b1a0700 1 --2- 172.21.15.62:0/2053119940 >> [v2:172.21.15.89:3301/0,v1:172.21.15.89:6790/0] conn(0x7fec64004410 0x7fec740c6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-09T11:43:36.698 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.688+0000 7fec7b1a0700 1 -- 172.21.15.62:0/2053119940 >> 172.21.15.62:0/2053119940 conn(0x7fec7406a410 msgr2=0x7fec740ca090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-09T11:43:36.698 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.688+0000 7fec7b1a0700 1 -- 172.21.15.62:0/2053119940 shutdown_connections 2023-06-09T11:43:36.699 INFO:teuthology.orchestra.run.smithi062.stderr:2023-06-09T11:43:36.688+0000 7fec7b1a0700 1 -- 172.21.15.62:0/2053119940 wait complete. 2023-06-09T11:43:36.700 INFO:teuthology.orchestra.run.smithi062.stderr:listed 0 entries 2023-06-09T11:43:36.720 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-06-09T11:43:36.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:43:36.720 DEBUG:teuthology.orchestra.run.smithi062:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-06-09T11:43:36.826 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi062.front.sepia.ceph.com 2023-06-09T11:43:36.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:43:36.826 DEBUG:teuthology.orchestra.run.smithi062:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-06-09T11:43:36.927 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-06-09T11:43:36.927 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T11:43:36.947 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352484k,nr_inodes=4088121,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275396k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=902 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275392k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275396k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 172.21.15.62:6789:/test /tmp/tmp.6L3ic7c8RKtest ceph rw,relatime,name=admin,secret=,fsid=f7998a1e-e5a9-4202-abaa-70c0eaae1047,acl 0 0 172.21.15.62:6789:/scratch /tmp/tmp.opjat5JqR7scratch ceph rw,relatime,name=admin,secret=,fsid=f7998a1e-e5a9-4202-abaa-70c0eaae1047,acl 0 0 2023-06-09T11:43:36.947 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi062.front.sepia.ceph.com 2023-06-09T11:43:36.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:43:36.948 DEBUG:teuthology.orchestra.run.smithi062:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-06-09T11:43:37.012 INFO:teuthology.orchestra.run.smithi062.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-06-09T11:43:37.013 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T11:43:37.014 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-06-09T11:43:37.014 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T11:43:37.061 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352296k,nr_inodes=4088074,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275360k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=232 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275356k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275360k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-06-09T11:43:37.061 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi089.front.sepia.ceph.com 2023-06-09T11:43:37.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:43:37.061 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-06-09T11:43:37.135 INFO:teuthology.orchestra.run.smithi089.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-06-09T11:43:37.137 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T11:43:37.137 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2023-06-09T11:43:37.137 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-09T11:43:37.196 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352296k,nr_inodes=4088074,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275360k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=232 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275356k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275360k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-06-09T11:43:37.197 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi089.front.sepia.ceph.com 2023-06-09T11:43:37.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-09T11:43:37.197 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-06-09T11:43:37.256 INFO:teuthology.orchestra.run.smithi089.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-06-09T11:43:37.257 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-09T11:43:38.763 INFO:tasks.ceph.osd.1:Sent signal 15 2023-06-09T11:43:38.764 INFO:tasks.ceph.osd.2:Sent signal 15 2023-06-09T11:43:38.764 INFO:tasks.ceph.osd.3:Sent signal 15 2023-06-09T11:43:38.764 INFO:tasks.ceph.osd.4:Sent signal 15 2023-06-09T11:43:38.765 INFO:tasks.ceph.osd.5:Sent signal 15 2023-06-09T11:43:38.765 INFO:tasks.ceph.osd.7:Sent signal 15 2023-06-09T11:43:38.765 INFO:tasks.ceph.mds.a:Sent signal 15 2023-06-09T11:43:38.765 INFO:tasks.ceph.mds.c:Sent signal 15 2023-06-09T11:43:38.766 INFO:tasks.ceph.mds.b:Sent signal 15 2023-06-09T11:43:38.766 INFO:tasks.ceph.mds.d:Sent signal 15 2023-06-09T11:43:38.766 INFO:tasks.ceph.mon.a:Sent signal 15 2023-06-09T11:43:38.766 INFO:tasks.ceph.mon.b:Sent signal 15 2023-06-09T11:43:38.767 INFO:tasks.ceph.mon.c:Sent signal 15 2023-06-09T11:43:38.767 INFO:tasks.ceph.mgr.y:Sent signal 15 2023-06-09T11:43:38.767 INFO:tasks.ceph.mgr.x:Sent signal 15 2023-06-09T11:43:38.983 INFO:tasks.ceph.osd.3.smithi062.stderr:2023-06-09T11:43:38.976+0000 7fb4af5ce700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 34348) UID: 0 2023-06-09T11:43:38.983 INFO:tasks.ceph.osd.3.smithi062.stderr:2023-06-09T11:43:38.976+0000 7fb4af5ce700 -1 osd.3 49 *** Got signal Terminated *** 2023-06-09T11:43:38.983 INFO:tasks.ceph.osd.3.smithi062.stderr:2023-06-09T11:43:38.976+0000 7fb4af5ce700 -1 osd.3 49 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-06-09T11:43:39.019 INFO:tasks.ceph.osd.7.smithi089.stderr:2023-06-09T11:43:39.015+0000 7ff7cd1d9700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 34554) UID: 0 2023-06-09T11:43:39.020 INFO:tasks.ceph.osd.7.smithi089.stderr:2023-06-09T11:43:39.015+0000 7ff7cd1d9700 -1 osd.7 49 *** Got signal Terminated *** 2023-06-09T11:43:39.020 INFO:tasks.ceph.osd.7.smithi089.stderr:2023-06-09T11:43:39.015+0000 7ff7cd1d9700 -1 osd.7 49 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-06-09T11:43:39.027 INFO:tasks.ceph.osd.1.smithi062.stderr:2023-06-09T11:43:39.020+0000 7f51ef5ce700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 34345) UID: 0 2023-06-09T11:43:39.028 INFO:tasks.ceph.osd.1.smithi062.stderr:2023-06-09T11:43:39.020+0000 7f51ef5ce700 -1 osd.1 49 *** Got signal Terminated *** 2023-06-09T11:43:39.028 INFO:tasks.ceph.osd.1.smithi062.stderr:2023-06-09T11:43:39.020+0000 7f51ef5ce700 -1 osd.1 49 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-06-09T11:43:39.081 INFO:tasks.ceph.osd.2.smithi062.stderr:2023-06-09T11:43:39.072+0000 7f9e3696d700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 34343) UID: 0 2023-06-09T11:43:39.081 INFO:tasks.ceph.osd.2.smithi062.stderr:2023-06-09T11:43:39.072+0000 7f9e3696d700 -1 osd.2 49 *** Got signal Terminated *** 2023-06-09T11:43:39.081 INFO:tasks.ceph.osd.2.smithi062.stderr:2023-06-09T11:43:39.072+0000 7f9e3696d700 -1 osd.2 49 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-06-09T11:43:39.098 INFO:tasks.ceph.mds.c.smithi062.stderr:2023-06-09T11:43:39.092+0000 7f506cdd7700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-mds -f --cluster ceph -i c (PID: 44799) UID: 0 2023-06-09T11:43:39.100 INFO:tasks.ceph.mds.a.smithi062.stderr:2023-06-09T11:43:39.092+0000 7fafd2fdc700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-mds -f --cluster ceph -i a (PID: 44801) UID: 0 2023-06-09T11:43:39.121 INFO:tasks.ceph.mds.c.smithi062.stderr:2023-06-09T11:43:39.112+0000 7f506cdd7700 -1 mds.c *** got signal Terminated *** 2023-06-09T11:43:39.122 INFO:tasks.ceph.mds.a.smithi062.stderr:2023-06-09T11:43:39.112+0000 7fafd2fdc700 -1 mds.a *** got signal Terminated *** 2023-06-09T11:43:39.220 INFO:tasks.ceph.mon.a.smithi062.stderr:2023-06-09T11:43:39.212+0000 7f791c5ff700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-mon -f --cluster ceph -i a (PID: 34218) UID: 0 2023-06-09T11:43:39.221 INFO:tasks.ceph.mon.a.smithi062.stderr:2023-06-09T11:43:39.212+0000 7f791c5ff700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-06-09T11:43:39.248 INFO:tasks.ceph.mon.c.smithi089.stderr:2023-06-09T11:43:39.199+0000 7f88d75ff700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-mon -f --cluster ceph -i c (PID: 34212) UID: 0 2023-06-09T11:43:39.248 INFO:tasks.ceph.mon.c.smithi089.stderr:2023-06-09T11:43:39.243+0000 7f88d75ff700 -1 mon.c@2(peon) e1 *** Got Signal Terminated *** 2023-06-09T11:43:39.259 INFO:tasks.ceph.mds.b.smithi089.stderr:2023-06-09T11:43:39.239+0000 7f15ead4c700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-mds -f --cluster ceph -i b (PID: 40196) UID: 0 2023-06-09T11:43:39.259 INFO:tasks.ceph.mds.d.smithi089.stderr:2023-06-09T11:43:39.247+0000 7feadc55b700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-mds -f --cluster ceph -i d (PID: 40197) UID: 0 2023-06-09T11:43:39.271 INFO:tasks.ceph.osd.4.smithi089.stderr:2023-06-09T11:43:39.267+0000 7f3af9fd2700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 34549) UID: 0 2023-06-09T11:43:39.271 INFO:tasks.ceph.osd.4.smithi089.stderr:2023-06-09T11:43:39.267+0000 7f3af9fd2700 -1 osd.4 50 *** Got signal Terminated *** 2023-06-09T11:43:39.271 INFO:tasks.ceph.osd.4.smithi089.stderr:2023-06-09T11:43:39.267+0000 7f3af9fd2700 -1 osd.4 50 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-06-09T11:43:39.272 INFO:tasks.ceph.osd.5.smithi089.stderr:2023-06-09T11:43:39.267+0000 7fa2fe1bb700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 34552) UID: 0 2023-06-09T11:43:39.272 INFO:tasks.ceph.osd.5.smithi089.stderr:2023-06-09T11:43:39.267+0000 7fa2fe1bb700 -1 osd.5 49 *** Got signal Terminated *** 2023-06-09T11:43:39.272 INFO:tasks.ceph.osd.5.smithi089.stderr:2023-06-09T11:43:39.267+0000 7fa2fe1bb700 -1 osd.5 49 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-06-09T11:43:39.284 INFO:tasks.ceph.mds.b.smithi089.stderr:2023-06-09T11:43:39.255+0000 7f15ead4c700 -1 mds.b *** got signal Terminated *** 2023-06-09T11:43:39.284 INFO:tasks.ceph.mds.d.smithi089.stderr:2023-06-09T11:43:39.255+0000 7feadc55b700 -1 mds.d *** got signal Terminated *** 2023-06-09T11:43:39.436 INFO:tasks.ceph.mon.b.smithi089.stderr:2023-06-09T11:43:39.431+0000 7f25d0bff700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-mon -f --cluster ceph -i b (PID: 34210) UID: 0 2023-06-09T11:43:39.449 INFO:tasks.ceph.mon.b.smithi089.stderr:2023-06-09T11:43:39.431+0000 7f25d0bff700 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2023-06-09T11:43:39.480 INFO:tasks.ceph.mgr.x.smithi089.stderr:2023-06-09T11:43:39.471+0000 7f1eed7b4700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-mgr -f --cluster ceph -i x (PID: 34214) UID: 0 2023-06-09T11:43:40.072 INFO:tasks.ceph.mgr.y.smithi062.stderr:daemon-helper: command crashed with signal 15 2023-06-09T11:43:55.488 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:43:55.496 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:43:55.725 INFO:teuthology.orchestra.run.smithi089.stderr:ceph-osd: no process found 2023-06-09T11:51:16.569 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:51:16.576 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:51:46.770 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:51:46.778 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:52:16.948 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:52:16.955 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:52:47.094 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:52:47.101 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:53:17.266 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:53:17.273 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:53:47.428 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:53:47.435 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:54:17.557 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:54:17.565 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:54:47.712 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:54:47.720 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:55:17.841 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:55:17.848 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:55:48.004 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:55:48.012 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:56:18.200 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:56:18.208 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:56:48.370 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:56:48.377 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:57:18.509 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:57:18.517 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:57:48.672 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:57:48.680 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:58:18.826 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:58:18.834 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:58:48.986 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:58:48.994 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:59:19.140 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:59:19.148 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:59:49.277 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T11:59:49.285 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:00:19.422 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:00:19.430 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:00:49.545 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:00:49.552 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:01:19.705 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:01:19.713 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:01:49.869 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:01:49.877 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:02:19.959 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:02:19.966 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:02:50.160 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:02:50.168 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:03:20.301 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:03:20.309 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:03:50.463 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:03:50.471 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:04:20.618 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:04:20.626 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:04:50.789 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:04:50.797 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:05:20.927 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:05:20.935 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:05:51.078 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:05:51.085 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:06:21.299 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:06:21.307 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:06:51.379 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:06:51.387 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:07:21.592 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:07:21.600 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:07:51.752 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:07:51.760 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:08:21.917 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:08:21.924 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:08:52.063 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:08:52.070 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:09:22.235 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:09:22.243 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:09:52.380 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:09:52.388 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:10:22.535 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:10:22.543 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:10:52.706 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:10:52.713 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:11:22.828 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:11:22.835 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:11:52.991 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:11:52.999 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:12:23.152 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:12:23.160 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:12:53.313 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:12:53.320 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:13:23.458 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:13:23.465 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:13:53.622 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:13:53.630 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:14:23.885 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:14:23.893 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:14:54.039 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:14:54.047 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:15:24.177 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:15:24.184 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:15:54.338 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:15:54.346 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:16:24.544 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:16:24.551 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:16:54.707 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:16:54.714 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:17:24.853 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:17:24.860 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:17:55.016 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:17:55.023 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:18:25.145 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:18:25.152 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:18:55.355 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:18:55.362 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:19:25.487 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:19:25.494 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:19:55.649 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:19:55.657 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:20:25.811 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:20:25.818 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:20:55.957 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:20:55.965 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:21:26.054 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:21:26.062 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:21:56.141 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:21:56.148 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:22:26.270 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:22:26.278 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:22:56.367 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:22:56.375 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:23:26.539 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:23:26.546 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:23:56.669 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:23:56.676 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:24:26.815 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:24:26.822 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:24:56.948 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:24:56.956 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:25:27.085 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:25:27.093 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:25:57.223 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:25:57.231 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:26:27.328 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:26:27.335 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:26:57.456 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:26:57.464 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:27:27.604 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:27:27.612 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:27:57.741 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:27:57.748 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:28:27.888 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:28:27.896 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:28:58.050 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:28:58.058 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:29:28.223 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:29:28.230 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:29:58.368 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:29:58.376 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:30:28.539 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:30:28.546 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:30:58.694 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:30:58.702 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:31:29.037 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:31:29.044 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:31:59.214 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:31:59.221 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:32:29.370 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:32:29.378 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:32:59.542 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:32:59.549 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:33:29.696 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:33:29.703 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:33:59.842 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:33:59.849 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:34:30.005 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:34:30.012 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:35:00.141 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:35:00.148 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:35:30.304 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:35:30.312 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:36:00.467 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:36:00.475 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:36:30.639 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:36:30.646 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:37:00.803 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:37:00.810 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:37:30.966 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:37:30.973 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:38:01.103 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:38:01.110 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:38:31.240 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:38:31.248 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:39:01.399 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:39:01.407 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:39:31.554 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:39:31.562 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:40:01.700 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:40:01.708 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:40:31.855 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:40:31.863 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:41:02.018 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:41:02.026 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:41:32.206 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:41:32.213 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:42:02.368 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:42:02.376 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:42:32.513 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:42:32.520 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:43:02.669 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:43:02.677 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:43:32.831 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:43:32.838 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:44:02.985 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:44:02.992 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:44:33.122 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:44:33.130 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:45:03.270 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:45:03.278 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:45:33.407 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:45:33.412 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:46:03.557 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:46:03.565 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:46:33.696 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:46:33.704 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:47:03.816 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:47:03.824 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:47:33.988 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:47:33.995 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:48:04.134 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:48:04.141 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:48:34.271 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:48:34.278 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:49:04.433 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:49:04.440 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:49:34.590 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:49:34.597 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:50:04.760 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:50:04.767 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:50:34.905 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:50:34.913 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:51:05.045 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:51:05.052 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:51:35.274 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:51:35.282 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:52:05.445 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:52:05.453 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:52:35.616 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:52:35.623 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:53:05.770 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:53:05.778 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:53:35.925 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:53:35.933 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:54:06.080 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:54:06.087 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:54:36.225 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:54:36.233 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:55:06.380 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:55:06.388 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:55:36.478 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:55:36.486 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:56:06.633 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:56:06.641 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:56:36.812 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:56:36.819 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:57:06.967 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:57:06.975 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:57:37.105 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:57:37.112 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:58:07.267 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:58:07.275 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:58:37.437 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:58:37.445 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:59:07.584 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:59:07.591 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:59:37.709 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T12:59:37.716 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:00:07.846 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:00:07.853 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:00:38.010 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:00:38.017 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:01:08.164 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:01:08.171 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:01:38.336 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:01:38.343 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:02:08.473 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:02:08.480 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:02:38.601 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:02:38.608 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:03:08.748 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:03:08.756 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:03:38.919 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:03:38.926 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:04:09.073 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:04:09.081 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:04:39.228 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:04:39.235 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:05:09.366 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:05:09.373 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:05:39.512 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:05:39.519 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:06:09.659 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:06:09.675 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:06:40.071 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:06:40.080 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:07:10.241 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:07:10.249 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:07:40.403 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:07:40.411 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:08:10.557 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:08:10.565 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:08:40.720 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:08:40.727 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:09:10.874 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:09:10.882 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:09:41.028 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:09:41.035 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:10:11.200 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:10:11.207 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:10:41.337 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:10:41.345 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:11:11.491 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:11:11.498 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:11:41.663 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:11:41.671 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:12:11.815 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:12:11.824 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:12:41.963 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:12:41.972 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:13:12.110 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:13:12.117 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:13:42.264 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:13:42.272 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:14:12.418 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:14:12.426 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:14:42.556 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:14:42.564 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:15:12.710 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:15:12.718 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:15:42.865 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:15:42.872 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:16:13.020 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:16:13.027 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:16:43.257 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:16:43.264 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:17:13.420 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:17:13.428 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:17:43.592 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:17:43.600 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:18:13.688 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:18:13.695 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:18:43.834 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:18:43.842 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:19:13.981 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:19:13.989 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:19:44.136 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:19:44.143 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:20:14.291 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:20:14.298 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:20:44.443 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:20:44.451 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:21:14.590 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:21:14.597 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:21:44.755 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:21:44.763 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:22:14.926 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:22:14.933 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:22:45.070 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:22:45.077 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:23:15.156 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:23:15.163 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:23:45.298 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:23:45.305 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:24:15.461 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:24:15.468 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:24:45.564 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:24:45.572 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:25:15.719 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:25:15.727 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:25:45.800 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:25:45.808 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:26:15.955 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:26:15.963 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:26:46.318 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:26:46.326 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:27:16.409 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:27:16.416 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:27:46.560 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:27:46.567 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:28:16.647 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:28:16.656 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:28:46.802 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:28:46.810 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:29:16.951 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:29:16.958 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:29:47.105 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:29:47.113 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:30:17.259 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:30:17.266 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:30:47.414 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:30:47.422 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:31:17.494 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:31:17.502 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:31:47.631 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:31:47.638 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:32:17.886 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:32:17.895 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:32:48.041 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:32:48.049 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:33:18.196 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:33:18.204 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:33:48.342 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:33:48.349 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:34:18.497 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:34:18.505 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:34:48.643 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:34:48.650 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:35:18.788 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:35:18.796 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:35:48.936 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:35:48.943 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:36:19.100 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:36:19.107 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:36:49.179 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:36:49.187 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:37:19.267 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:37:19.274 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:37:49.447 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:37:49.455 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:38:19.576 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:38:19.584 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:38:49.739 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:38:49.748 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:39:19.885 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:39:19.893 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:39:50.017 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:39:50.025 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:40:20.105 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:40:20.112 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:40:50.184 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:40:50.191 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:41:20.338 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:41:20.345 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:41:50.701 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:41:50.708 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:42:20.881 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:42:20.889 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:42:51.035 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:42:51.042 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:43:21.194 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:43:21.201 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:43:51.346 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:43:51.354 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:44:21.493 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:44:21.501 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:44:51.656 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:44:51.663 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:45:21.811 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:45:21.819 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:45:51.974 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:45:51.982 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:46:22.154 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:46:22.162 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:46:52.308 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:46:52.316 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:47:22.454 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:47:22.462 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:47:52.609 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:47:52.613 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:48:22.770 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:48:22.777 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:48:52.908 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:48:52.916 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:49:23.006 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:49:23.014 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:49:53.160 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:49:53.167 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:50:23.324 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:50:23.332 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:50:53.443 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:50:53.450 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:51:23.614 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:51:23.621 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:51:53.711 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:51:53.719 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:52:23.872 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:52:23.880 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:52:54.127 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:52:54.134 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:53:24.274 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:53:24.282 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:53:54.438 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:53:54.446 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:54:24.609 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:54:24.617 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:54:54.755 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:54:54.762 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:55:24.900 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:55:24.908 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:55:55.055 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:55:55.063 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:56:25.226 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:56:25.234 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:56:55.421 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:56:55.428 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:57:25.585 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:57:25.592 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:57:55.747 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:57:55.755 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:58:25.919 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:58:25.926 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:58:56.040 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:58:56.047 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:59:26.203 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:59:26.211 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:59:56.349 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T13:59:56.356 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:00:26.502 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:00:26.509 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:00:56.649 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:00:56.657 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:01:26.818 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:01:26.823 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:01:56.998 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:01:57.006 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:02:27.160 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:02:27.168 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:02:57.308 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:02:57.315 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:03:27.446 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:03:27.454 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:03:57.625 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:03:57.633 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:04:27.779 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:04:27.787 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:04:57.919 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:04:57.927 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:05:28.076 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:05:28.083 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:05:58.249 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:05:58.255 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:06:28.379 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:06:28.387 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:06:58.555 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:06:58.562 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:07:28.702 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:07:28.711 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:07:58.857 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:07:58.864 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:08:29.018 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:08:29.025 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:08:59.164 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:08:59.171 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:09:29.298 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:09:29.305 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:09:59.464 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:09:59.472 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:10:29.610 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:10:29.618 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:10:59.703 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:10:59.710 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:11:29.836 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:11:29.843 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:11:59.991 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:11:59.999 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:12:30.153 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:12:30.161 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:13:00.293 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:13:00.300 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:13:30.447 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:13:30.454 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:14:00.611 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:14:00.619 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:14:30.756 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:14:30.763 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:15:00.934 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:15:00.941 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:15:31.103 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:15:31.110 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:16:01.270 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:16:01.278 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:16:31.430 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:16:31.438 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:17:01.553 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:17:01.561 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:17:31.739 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:17:31.746 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:18:01.893 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:18:01.901 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:18:32.057 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:18:32.065 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:19:02.203 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:19:02.211 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:19:32.340 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:19:32.348 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:20:02.463 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:20:02.471 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:20:32.589 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:20:32.596 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:21:02.726 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:21:02.733 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:21:32.894 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:21:32.901 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:22:03.218 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:22:03.222 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:22:33.372 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:22:33.380 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:23:03.511 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:23:03.515 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:23:33.651 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:23:33.658 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:24:03.807 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:24:03.814 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:24:33.966 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:24:33.973 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:25:04.132 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:25:04.139 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:25:34.305 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:25:34.313 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:26:04.453 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:26:04.461 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:26:34.629 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:26:34.637 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:27:04.725 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:27:04.733 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:27:34.890 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:27:34.898 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:28:05.035 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:28:05.043 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:28:35.192 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:28:35.200 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:29:05.342 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:29:05.350 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:29:35.504 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:29:35.511 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:30:05.651 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:30:05.659 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:30:35.792 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:30:35.799 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:31:05.940 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:31:05.947 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:31:36.105 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:31:36.113 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:32:06.203 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:32:06.210 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:32:36.360 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:32:36.367 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:33:06.502 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:33:06.509 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:33:36.644 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:33:36.652 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:34:06.795 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:34:06.803 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:34:36.945 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:34:36.952 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:35:07.096 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:35:07.103 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:35:37.248 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:35:37.256 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:36:07.416 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:36:07.423 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:36:37.564 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:36:37.569 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:37:07.729 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:37:07.737 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:37:37.877 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:37:37.884 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:38:08.036 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:38:08.043 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:38:38.180 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:38:38.188 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:39:08.345 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:39:08.353 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:39:38.492 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:39:38.499 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:40:08.643 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:40:08.651 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:40:38.788 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:40:38.796 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:41:08.953 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:41:08.961 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:41:39.132 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:41:39.140 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:42:09.320 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:42:09.328 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:42:39.472 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:42:39.480 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:43:09.624 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:43:09.632 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:43:39.774 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:43:39.782 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:44:09.934 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:44:09.942 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:44:40.098 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:44:40.107 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:45:10.269 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:45:10.278 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:45:40.417 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:45:40.427 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:46:10.556 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:46:10.568 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:46:40.725 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:46:40.734 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:47:10.900 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:47:10.914 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:47:41.072 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:47:41.084 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:48:11.211 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:48:11.220 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:48:41.359 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:48:41.368 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:49:11.500 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:49:11.508 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:49:41.640 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:49:41.647 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:50:11.727 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:50:11.736 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:50:41.951 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:50:41.958 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:51:12.090 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:51:12.097 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:51:42.248 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:51:42.256 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:52:12.470 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:52:12.481 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:52:42.626 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:52:42.633 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:53:12.795 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:53:12.803 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:53:42.962 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:53:42.969 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:54:13.106 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:54:13.113 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:54:43.252 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:54:43.260 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:55:13.342 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:55:13.350 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:55:43.523 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:55:43.531 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:56:13.677 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:56:13.684 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:56:43.814 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:56:43.823 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:57:13.963 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:57:13.971 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:57:44.118 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:57:44.126 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:58:14.275 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:58:14.283 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:58:44.406 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:58:44.413 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:59:14.506 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:59:14.514 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:59:44.650 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T14:59:44.658 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:00:14.808 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:00:14.816 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:00:44.972 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:00:44.980 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:01:15.119 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:01:15.127 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:01:45.285 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:01:45.292 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:02:15.466 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:02:15.474 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:02:45.617 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:02:45.624 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:03:15.790 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:03:15.798 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:03:45.946 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:03:45.953 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:04:16.084 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:04:16.092 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:04:46.196 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:04:46.203 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:05:16.330 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:05:16.338 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:05:46.417 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:05:46.424 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:06:16.559 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:06:16.567 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:06:46.659 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:06:46.667 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:07:17.065 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:07:17.074 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:07:47.148 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:07:47.157 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:08:17.382 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:08:17.390 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:08:47.547 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:08:47.555 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:09:17.692 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:09:17.699 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:09:47.839 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:09:47.847 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:10:17.988 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:10:17.995 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:10:48.167 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:10:48.175 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:11:18.247 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:11:18.256 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:11:48.387 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:11:48.395 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:12:18.487 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:12:18.494 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:12:48.775 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:12:48.783 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:13:18.932 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:13:18.941 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:13:49.079 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:13:49.087 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:14:19.227 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:14:19.236 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:14:49.382 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:14:49.389 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:15:19.530 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:15:19.538 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:15:49.673 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:15:49.682 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:16:19.750 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:16:19.757 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:16:49.891 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:16:49.899 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:17:20.034 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:17:20.041 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:17:50.201 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:17:50.208 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:18:20.350 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:18:20.358 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:18:50.436 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:18:50.444 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:19:20.588 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:19:20.596 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:19:50.691 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:19:50.699 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:20:20.822 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:20:20.830 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:20:50.978 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:20:50.986 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:21:21.135 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:21:21.142 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:21:51.292 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:21:51.299 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:22:21.467 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:22:21.475 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:22:51.613 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:22:51.620 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:23:21.764 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:23:21.772 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:23:51.929 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:23:51.937 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:24:22.060 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:24:22.068 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:24:52.225 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:24:52.232 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:25:22.386 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:25:22.393 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:25:52.475 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:25:52.483 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:26:22.664 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:26:22.671 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:26:52.823 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:26:52.831 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:27:23.039 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:27:23.047 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:27:53.195 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:27:53.202 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:28:23.332 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:28:23.340 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:28:53.478 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:28:53.486 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:29:23.626 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:29:23.634 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:29:53.791 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:29:53.799 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:30:23.945 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:30:23.952 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:30:54.078 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:30:54.085 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:31:24.234 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:31:24.241 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:31:54.388 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:31:54.395 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:32:24.547 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:32:24.554 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:32:54.693 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:32:54.701 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:33:24.867 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:33:24.875 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:33:55.033 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:33:55.041 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:34:25.198 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:34:25.205 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:34:55.371 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:34:55.378 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:35:25.594 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:35:25.602 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:35:55.683 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:35:55.690 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:36:25.820 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:36:25.828 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:36:55.969 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:36:55.976 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:37:26.146 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:37:26.154 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:37:56.276 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:37:56.284 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:38:26.408 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:38:26.416 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:38:56.565 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:38:56.573 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:39:26.719 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:39:26.727 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:39:56.887 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:39:56.895 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:40:27.044 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:40:27.052 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:40:57.147 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:40:57.155 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:41:27.231 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:41:27.238 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:41:57.335 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:41:57.343 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:42:27.434 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:42:27.441 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:42:57.581 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:42:57.588 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:43:27.722 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:43:27.729 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:43:57.880 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:43:57.888 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:44:28.026 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:44:28.034 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:44:58.118 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:44:58.126 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:45:28.263 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:45:28.271 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:45:58.418 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:45:58.426 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:46:28.591 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:46:28.599 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:46:58.756 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:46:58.763 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:47:28.952 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:47:28.960 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:47:59.118 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:47:59.125 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:48:29.282 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:48:29.290 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:48:59.437 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:48:59.445 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:49:29.518 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:49:29.526 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:49:59.677 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:49:59.685 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:50:29.842 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:50:29.849 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:51:00.000 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:51:00.008 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:51:30.157 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:51:30.165 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:52:00.297 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:52:00.305 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:52:30.530 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:52:30.537 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:53:00.687 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:53:00.694 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:53:30.844 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:53:30.851 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:54:00.976 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:54:00.983 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:54:31.123 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:54:31.131 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:55:01.271 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:55:01.278 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:55:31.434 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:55:31.442 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:56:01.610 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:56:01.618 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:56:31.760 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:56:31.768 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:57:01.925 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:57:01.933 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:57:32.073 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:57:32.081 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:58:02.164 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:58:02.171 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:58:32.316 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:58:32.323 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:59:02.442 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:59:02.449 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:59:32.574 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T15:59:32.581 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:00:02.737 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:00:02.745 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:00:32.893 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:00:32.901 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:01:03.058 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:01:03.065 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:01:33.204 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:01:33.212 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:02:03.360 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:02:03.367 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:02:33.666 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:02:33.674 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:03:03.761 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:03:03.769 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:03:33.921 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:03:33.928 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:04:04.083 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:04:04.096 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:04:34.238 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:04:34.246 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:05:04.378 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:05:04.386 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:05:34.521 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:05:34.528 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:06:04.676 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:06:04.684 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:06:34.823 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:06:34.831 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:07:04.986 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:07:04.994 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:07:35.152 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:07:35.159 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:08:05.306 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:08:05.313 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:08:35.455 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:08:35.463 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:09:05.618 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:09:05.625 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:09:35.776 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:09:35.783 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:10:05.921 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:10:05.930 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:10:36.077 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:10:36.084 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:11:06.238 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:11:06.246 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:11:36.400 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:11:36.408 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:12:06.557 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:12:06.565 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:12:36.810 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:12:36.817 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:13:06.959 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:13:06.967 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:13:37.119 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:13:37.126 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:14:07.207 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:14:07.215 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:14:37.361 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:14:37.369 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:15:07.516 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:15:07.524 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:15:37.684 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:15:37.692 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:16:07.850 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:16:07.857 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:16:37.983 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:16:37.990 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:17:08.133 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:17:08.140 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:17:38.373 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:17:38.380 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:18:08.495 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:18:08.504 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:18:38.639 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:18:38.647 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:19:08.724 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:19:08.731 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:19:38.876 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:19:38.884 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:20:09.026 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:20:09.033 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:20:39.183 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:20:39.190 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:21:09.330 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:21:09.337 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:21:39.494 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:21:39.502 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:22:09.651 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:22:09.659 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:22:39.806 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:22:39.813 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:23:09.894 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:23:09.902 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:23:40.208 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:23:40.217 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:24:10.364 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:24:10.372 DEBUG:teuthology.orchestra.run.smithi089:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-09T16:24:35.779 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2023-06-09T16:24:35.780 DEBUG:teuthology.task.console_log:Killing console logger for smithi062 2023-06-09T16:24:35.781 DEBUG:teuthology.task.console_log:Killing console logger for smithi089 2023-06-09T16:24:35.781 DEBUG:teuthology.exit:Finished running handlers